-- Logs begin at Mon 2022-05-09 14:23:59 UTC, end at Mon 2022-05-09 16:38:57 UTC. -- May 09 15:04:10.142633 dv-cinder-835881-7-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 09 15:04:10.151314 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 09 15:04:10.154961 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 9 15:04:10 2022] *** May 09 15:04:10.155196 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 09 15:04:10.155364 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 09 15:04:10.155527 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: nodename: dv-cinder-835881-7-iscsi May 09 15:04:10.155679 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: machine: x86_64 May 09 15:04:10.155838 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: clock source: unix May 09 15:04:10.155995 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: pcre jit disabled May 09 15:04:10.156160 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: detected number of CPU cores: 4 May 09 15:04:10.156318 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: current working directory: / May 09 15:04:10.156492 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: detected binary path: /usr/bin/uwsgi-core May 09 15:04:10.156657 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: your processes number limit is 47680 May 09 15:04:10.156815 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: your memory page size is 4096 bytes May 09 15:04:10.156972 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: detected max file descriptor number: 2048 May 09 15:04:10.157157 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: lock engine: pthread robust mutexes May 09 15:04:10.157505 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: thunder lock: enabled May 09 15:04:10.157865 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 09 15:04:10.158105 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 09 15:04:10.205784 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: Python main interpreter initialized at 0x55b36c4f39c0 May 09 15:04:10.205784 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: python threads support enabled May 09 15:04:10.205784 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: your server socket listen backlog is limited to 100 connections May 09 15:04:10.205784 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: your mercy for graceful operations on workers is 90 seconds May 09 15:04:10.206171 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: mapped 403077 bytes (393 KB) for 2 cores May 09 15:04:10.206243 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: *** Operational MODE: preforking *** May 09 15:04:10.206509 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: *** uWSGI is running in multiple interpreter mode *** May 09 15:04:10.206509 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: spawned uWSGI master process (pid: 80151) May 09 15:04:10.206718 dv-cinder-835881-7-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 09 15:04:10.209816 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: spawned uWSGI worker 1 (pid: 80164, cores: 1) May 09 15:04:10.209816 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: spawned uWSGI worker 2 (pid: 80165, cores: 1) May 09 15:04:10.209816 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 09 15:04:16.024391 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:04:16.024391 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: from cryptography.utils import int_from_bytes May 09 15:04:16.025903 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:04:16.025903 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: from cryptography.utils import int_from_bytes May 09 15:04:16.030369 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:04:16.030369 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: from cryptography.utils import int_from_bytes May 09 15:04:16.031777 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:04:16.031777 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: from cryptography.utils import int_from_bytes May 09 15:04:16.075399 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 15:04:16.075587 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 15:04:16.075781 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] command line args: [] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 15:04:16.076019 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 15:04:16.076200 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ================================================================================ {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 15:04:16.076452 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] admin_token = **** {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.076697 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] config_dir = [] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.076882 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.077061 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] config_source = [] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.077238 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] debug = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.077473 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.079914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.079914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.079914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.079914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.079914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] list_limit = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.079914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] log_config_append = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.079914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.079914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] log_dir = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.079914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] log_file = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.081675 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.081675 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.081675 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.081675 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.082389 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 15:04:16.082587 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.082819 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 15:04:16.082988 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.083203 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] command line args: [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 15:04:16.083400 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.083598 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 15:04:16.083796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.084028 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ================================================================================ {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 15:04:16.084192 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.084389 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] admin_token = **** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.084597 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.084757 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] config_dir = [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.084920 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.085083 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.085217 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.085344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] config_source = [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.085344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] debug = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.085634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.085771 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.085928 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.086062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.086221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.086368 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.086368 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.086619 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.086756 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.086891 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] publish_errors = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.087026 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] list_limit = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.087176 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.087311 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] log_config_append = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.087474 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.087614 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.087755 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.087930 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] log_dir = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.087930 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] log_file = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.088206 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.088334 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.088461 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.088597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.088724 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] standard_threads = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.088866 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.089080 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.089080 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.089447 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.089587 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.089715 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.089971 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] use_journal = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.090152 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.090327 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] use_json = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.090455 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.090589 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] use_stderr = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.090727 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.090857 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] use_syslog = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.090857 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.091129 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.091129 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.091460 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.091599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.091728 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.091855 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.091982 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.092121 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.092257 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.092385 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.092511 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.092637 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.092766 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.092766 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.092766 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.093134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.093134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] publish_errors = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.093440 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.093591 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.093720 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.093848 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.093990 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.094117 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.094250 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.094391 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.094524 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.094524 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.094771 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.094904 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.094904 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.095176 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] standard_threads = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.095312 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.095446 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.095573 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.095711 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.095913 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.096043 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.096176 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.096310 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] use_journal = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.096438 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.096571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] use_json = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.096571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] use_stderr = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.096824 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.096957 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] use_syslog = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.097085 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.097218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:04:16.097401 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.097551 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.097695 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.097824 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.097951 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.098078 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.098211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.098347 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.098481 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.098609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.098742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.098876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.099021 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.099177 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.099313 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.099493 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.099630 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.099764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.099897 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.100034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.100171 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.100300 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.100437 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.100566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.100693 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.100828 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.100956 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.100956 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.101194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.101332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.101510 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.101652 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.101780 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.101908 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.102050 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.102178 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.102304 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.102506 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.102635 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.102762 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.102889 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.103023 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.103175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.103315 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.103449 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.103601 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.103737 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.103870 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.103998 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.104133 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.104261 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.104389 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.104516 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.104643 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.104778 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.104922 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.105049 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.105176 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.105302 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.105479 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.105479 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.105741 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.105869 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.106001 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.106128 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.106254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.106388 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.106515 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.106641 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.108106 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.108344 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.108511 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.108739 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.108907 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.109099 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.109563 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.109756 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.109994 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.110164 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.110391 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.110621 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.110820 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.111049 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.111250 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.111452 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.111619 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.111810 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.112034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.112236 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.112439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.112642 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.112806 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.112998 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.113191 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.113410 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.113574 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.113766 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.113912 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.114043 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.114211 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.114345 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.114474 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.114474 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.114717 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.114887 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.115030 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.115171 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.115300 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.115429 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.115568 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.115704 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.115834 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.115962 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.116090 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.116090 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.116377 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.116514 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.116643 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.116821 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.116955 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.117084 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.117221 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.117352 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.117567 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.117707 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.117836 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.117974 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.118112 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.118242 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.118379 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.118509 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.118638 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.118767 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.118931 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.119222 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.119222 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.119622 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.119755 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.119884 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.120013 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.120677 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.120818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.120948 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.121077 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.121207 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.121345 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.121497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.121627 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.121756 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.121893 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.122037 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.122174 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.122304 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.122433 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.122562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.122690 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.122827 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.122964 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.123119 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.123262 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] auth.external = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.123416 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.123551 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.123687 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.123816 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.123957 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.124094 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.124224 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.124352 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] auth.password = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.124480 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.124615 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] auth.token = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.124744 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.124880 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.124880 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.125123 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.125252 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.125415 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.125551 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.125704 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.125835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.125963 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.126092 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.126220 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.126422 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.126577 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.126710 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] credential.caching = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.126838 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.126967 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.127123 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.127123 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.127441 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.127604 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.127757 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.127888 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.128018 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.128147 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.128277 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.128406 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.128544 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.128674 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.128811 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.128940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.129069 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.129198 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.129342 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.129515 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.129647 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.129777 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.129908 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.130038 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.130180 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.130310 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.130446 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.130591 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] auth.external = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.130721 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.130859 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.130991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.131136 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.131274 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] federation.caching = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.131415 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.131544 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.131692 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] auth.password = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.131823 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.131958 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] auth.token = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.132096 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.132226 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.132355 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.132498 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.132628 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.132758 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.132887 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.133018 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.133158 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.133296 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.133508 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.133642 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.133773 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.133903 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.134033 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.134175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] credential.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.134306 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.134435 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.134563 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.caching = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.134740 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.134877 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.135029 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.135182 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.135321 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.135450 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.135450 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.135696 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.136431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.136431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.136689 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.136819 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.136949 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.137158 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.137434 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.137574 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.137717 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.137847 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.137847 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.138092 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.138231 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.138361 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.138491 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.138620 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.138755 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.138893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.139044 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.139187 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.139319 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.139457 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.139600 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.139766 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] federation.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.139910 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.140041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.140171 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.140307 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.140437 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.140566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.140712 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.140842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.140972 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.141101 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.141231 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.141416 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.141553 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.141683 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.141812 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.141959 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.142209 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.142384 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.142521 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.142521 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.142764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.142894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.143040 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.143187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.143318 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.143471 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.143608 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.143739 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.143867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.144005 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.144135 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.144264 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.144393 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.144524 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.144652 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.144790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.144920 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.145049 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.145177 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.145315 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.145468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.145612 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.145743 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.145871 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.146000 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.146128 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.146257 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.146394 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.146525 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.146656 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.146785 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.146914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.147070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.147212 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.147343 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.147472 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.147601 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.147732 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.147861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.147998 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.148136 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.148266 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.148395 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.148523 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.148651 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.148788 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.148928 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.149058 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.149186 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.149315 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.149473 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.149615 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.149746 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.149882 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.150011 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.150140 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.150269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.150406 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.150536 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.150675 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.150805 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.150934 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.151083 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.151224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.151224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.152005 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.152189 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.152327 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.152458 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.152604 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.152798 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.152939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.153069 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.153208 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.153337 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.153566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.153566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.153814 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.153945 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.154081 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.154211 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.154348 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.154348 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.154591 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.154720 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.154720 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.154963 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.155134 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.155267 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.155396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.155525 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.155655 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.155784 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.155922 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.156053 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.156182 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.156311 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.156440 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.156569 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.156705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.156845 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.156974 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.157104 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.157233 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.157406 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.157544 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.157674 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.157803 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.157931 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.158060 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.158201 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.158332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.158460 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.158590 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.158590 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.158843 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.158981 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] resource.caching = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.159127 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.159260 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.159399 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.159530 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.159658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.159795 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.159925 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.160053 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.160182 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.160312 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.160440 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.160587 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.160717 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.160845 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.160974 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.161102 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.161231 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.161387 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.161536 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.161668 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] role.caching = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.161797 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.161926 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] role.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.162061 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.162198 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.162346 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.162476 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.162605 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.162733 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.162863 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.163087 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.163265 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.163401 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.163530 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.163660 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.163790 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.163927 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.164057 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.164186 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.164325 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.164456 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.164585 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.164723 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.164852 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.164987 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.165117 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.165246 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.165447 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.165596 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.165729 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.165859 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.165989 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.165989 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.166298 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.166439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.166571 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.166700 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.166829 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.166960 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.167782 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.168003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.168204 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.168348 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.168485 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.168623 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.168758 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.168918 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] resource.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.169055 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.169191 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.169334 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.169495 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.169643 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.169782 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.169917 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.170052 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.170187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.170322 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.170465 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.170602 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.170749 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.170884 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.171023 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.171175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.171320 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.171456 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.171592 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.171728 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] role.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.171864 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.172000 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] role.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.172144 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.172281 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.172416 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] token.caching = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.172416 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.172682 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.172819 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.172971 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.173109 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.173109 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.173425 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.173572 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.173714 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.173862 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.174001 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.174137 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.174273 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.174409 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.174556 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.174700 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.174836 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.174973 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.175135 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.175273 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.175273 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.175538 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.175675 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.175810 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.175949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.176085 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.176221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.176364 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.176512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.176647 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.176783 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.176918 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.177054 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] database.connection = **** {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.177203 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.177352 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.177513 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.177650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.177650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.177907 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.178042 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.178191 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.178339 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.178474 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.178612 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.178748 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.178883 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.179034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.179185 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.179331 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.179469 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.179605 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.179740 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.179883 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.180021 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.180159 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.180305 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.180441 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.180634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.180796 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.180935 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.181071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.181208 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.181344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.181565 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.181714 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.181852 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.181988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.182225 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.182225 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 15:04:16.182537 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] token.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.182537 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.182537 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.182537 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.182537 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.182537 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.182537 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.182537 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.182537 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.183694 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.183694 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.183694 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.183694 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.183694 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.183694 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.183694 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.183694 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.183694 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.184816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.connection = **** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.184816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.184816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.184816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.184816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.184816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.184816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.184816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.184816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.186172 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.186172 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.186172 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.186172 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.186172 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.186172 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.186172 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.186172 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.186172 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.187311 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:04:16.187311 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 15:04:16.192221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.192455 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.192681 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.197321 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.197570 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.197803 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.202194 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.207620 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.232663 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.232980 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.236484 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.236741 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.292485 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.292904 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.347669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.347926 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.350764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.351110 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.416564 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.416774 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.416850 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.417081 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.417355 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.417464 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.417764 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.417849 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.418124 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.418211 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.418518 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.418841 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.445100 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.445599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.445740 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.445984 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.446180 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.446490 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.446710 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.447402 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.447659 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.447901 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.448081 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.448930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.449182 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.449323 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.459125 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.460131 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.475435 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.475663 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.475878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.476096 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.476347 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.476564 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.476776 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80164) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.481235 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.481673 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.482008 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.482341 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.482664 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.483018 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.483340 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80165) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:04:16.496680 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.497002 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:04:16.497350 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.497670 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:04:16.497891 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.498402 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.498530 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.498690 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.498922 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:04:16.499082 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.499482 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.499778 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:04:16.500151 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.500527 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.500884 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.501276 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.512089 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.512513 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.512741 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.513017 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.514374 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.514807 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.515182 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.515635 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.522182 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.524367 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.525806 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.526083 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.526459 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.527516 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.527820 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.528081 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.528351 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.528622 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.528891 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.529161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.529445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.529988 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.530371 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.530758 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.531272 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.531711 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.532099 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.532484 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.532903 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.533305 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.533707 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.534084 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.558735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.560603 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.561016 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.562367 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.564335 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.564815 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.567403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.567802 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.568090 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.570895 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.571300 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.571704 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.576779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.577071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.580483 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.580944 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.582657 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.582949 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.583229 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.583504 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.583773 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.584046 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.584310 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.584574 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.586689 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.587098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.587490 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.587867 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.588251 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.588625 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.589655 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.590054 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.607282 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.607601 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.610825 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.611230 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.613050 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.616209 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.616841 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.617135 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.620897 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.621406 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.622713 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.626478 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.627119 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.630752 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.631050 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.631289 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.631444 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.631622 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.632029 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.632326 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.636450 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.636784 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.637280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.637800 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.638181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.638593 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.655005 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.655404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.655668 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.655932 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.659426 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.659950 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.660333 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.660701 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.664341 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.666376 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.666643 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.669519 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.670044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.670348 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.670626 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.670910 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.671302 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.671980 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.672359 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.675643 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.676064 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.676453 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.676869 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.677268 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.686644 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.686952 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.687230 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.687516 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.687795 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.688212 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.688490 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.692595 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.693000 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.693506 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.693876 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.694293 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.694699 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.695085 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.709345 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.712883 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.714955 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.716764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.718635 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.718766 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.720620 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.721009 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.721303 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.722774 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.724568 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.726413 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.726843 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.727255 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.730145 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.732051 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.735891 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.736136 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.736239 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.736447 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.736750 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.738302 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.741706 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.742105 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.742501 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.742879 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.746875 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.747304 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.747601 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.753849 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.754326 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.754728 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.756459 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80164) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.756740 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.757018 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.757289 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.757590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.757877 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.758141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.758411 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.758676 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.758976 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.759411 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.759685 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.759987 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.760243 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80164) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.765562 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80165) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:04:16.766007 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.766396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.766808 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.767186 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.767599 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.767978 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.768402 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.768791 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.769165 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.769570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.769920 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.770202 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.770468 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80165) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:04:16.804168 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b36c4f39c0 pid: 80164 (default app) May 09 15:04:16.808222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc987b-9b0e-4b0a-82fb-e78be336ce84 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:16.808636 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc987b-9b0e-4b0a-82fb-e78be336ce84 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:16.809103 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc987b-9b0e-4b0a-82fb-e78be336ce84 None None] PATH_INFO: `/v3` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:16.812080 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b36c4f39c0 pid: 80165 (default app) May 09 15:04:16.814202 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Mon May 9 15:04:16 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:25.286027 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db91a86-506f-4c4e-9cb8-c36455bdf8af None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:25.286596 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db91a86-506f-4c4e-9cb8-c36455bdf8af None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:25.286596 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db91a86-506f-4c4e-9cb8-c36455bdf8af None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:25.291049 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:25.296743 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf57a5-5eab-4386-a771-20b39eb6d7ef None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:25.297164 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf57a5-5eab-4386-a771-20b39eb6d7ef None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:25.297454 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf57a5-5eab-4386-a771-20b39eb6d7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:25.334035 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG oslo_db.sqlalchemy.engines [None req-38cf57a5-5eab-4386-a771-20b39eb6d7ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80164) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 15:04:25.533135 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG passlib.handlers.bcrypt [None req-38cf57a5-5eab-4386-a771-20b39eb6d7ef None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80164) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 09 15:04:25.533578 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG passlib.handlers.bcrypt [None req-38cf57a5-5eab-4386-a771-20b39eb6d7ef None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80164) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 09 15:04:25.591080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-38cf57a5-5eab-4386-a771-20b39eb6d7ef None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:25.592599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-38cf57a5-5eab-4386-a771-20b39eb6d7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:25.716997 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 09 15:04:25.912213 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db91a86-506f-4c4e-9cb8-c36455bdf8af None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:25.947511 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG oslo_db.sqlalchemy.engines [None req-9db91a86-506f-4c4e-9cb8-c36455bdf8af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80165) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 15:04:26.081481 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db91a86-506f-4c4e-9cb8-c36455bdf8af None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:26.085758 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc8b4e-2244-46fe-ba7f-8fa645095b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cfee729a9d442518d1002c1b9a42feb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:26.086431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc8b4e-2244-46fe-ba7f-8fa645095b9f admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:26.086717 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc8b4e-2244-46fe-ba7f-8fa645095b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:26.087119 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc8b4e-2244-46fe-ba7f-8fa645095b9f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:26.096567 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc8b4e-2244-46fe-ba7f-8fa645095b9f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:26.149924 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1ebc8b4e-2244-46fe-ba7f-8fa645095b9f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 09 15:04:26.150266 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc8b4e-2244-46fe-ba7f-8fa645095b9f admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:26.161199 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Mon May 9 15:04:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 09 15:04:26.167744 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf57a5-5eab-4386-a771-20b39eb6d7ef None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:26.183122 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf57a5-5eab-4386-a771-20b39eb6d7ef None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:26.188229 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d68a4-6d14-4c21-a908-786e23cb39d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cfee729a9d442518d1002c1b9a42feb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:26.189350 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d68a4-6d14-4c21-a908-786e23cb39d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:26.189669 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d68a4-6d14-4c21-a908-786e23cb39d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:26.189960 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d68a4-6d14-4c21-a908-786e23cb39d2 admin admin] PATH_INFO: `/v3/projects/5cfee729a9d442518d1002c1b9a42feb` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:26.191467 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d68a4-6d14-4c21-a908-786e23cb39d2 admin admin] RBAC: Authorizing `identity:get_project(project_id=5cfee729a9d442518d1002c1b9a42feb)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:26.242771 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3b6d68a4-6d14-4c21-a908-786e23cb39d2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 09 15:04:26.243118 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d68a4-6d14-4c21-a908-786e23cb39d2 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:26.248788 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Mon May 9 15:04:26 2022] GET /identity/v3/projects/5cfee729a9d442518d1002c1b9a42feb => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:28.662387 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62419e-5ad3-4318-89ac-29e41d2422cc None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:28.662925 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62419e-5ad3-4318-89ac-29e41d2422cc None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:28.662925 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62419e-5ad3-4318-89ac-29e41d2422cc None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:28.667148 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:04:28.673495 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acce0fb-c741-471b-b39d-3bbace22e761 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:28.674008 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acce0fb-c741-471b-b39d-3bbace22e761 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:28.674096 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acce0fb-c741-471b-b39d-3bbace22e761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:28.695675 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-8acce0fb-c741-471b-b39d-3bbace22e761 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:28.697235 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8acce0fb-c741-471b-b39d-3bbace22e761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:28.706265 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 09 15:04:28.729608 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62419e-5ad3-4318-89ac-29e41d2422cc None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:28.742141 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62419e-5ad3-4318-89ac-29e41d2422cc None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:28.751002 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f213c1-9cbf-4a2a-b6e0-3e48fa66ec5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cfee729a9d442518d1002c1b9a42feb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:28.751836 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f213c1-9cbf-4a2a-b6e0-3e48fa66ec5d admin admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:28.752117 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f213c1-9cbf-4a2a-b6e0-3e48fa66ec5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:28.752387 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f213c1-9cbf-4a2a-b6e0-3e48fa66ec5d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:28.762406 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f213c1-9cbf-4a2a-b6e0-3e48fa66ec5d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:28.764166 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f213c1-9cbf-4a2a-b6e0-3e48fa66ec5d admin admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:28.774978 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Mon May 9 15:04:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 15:04:28.780893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acce0fb-c741-471b-b39d-3bbace22e761 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:28.789862 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acce0fb-c741-471b-b39d-3bbace22e761 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:28.794420 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6b1ec-e933-4cf1-9218-dacb1be49363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cfee729a9d442518d1002c1b9a42feb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:28.795289 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6b1ec-e933-4cf1-9218-dacb1be49363 admin admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:28.795615 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6b1ec-e933-4cf1-9218-dacb1be49363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:28.795888 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6b1ec-e933-4cf1-9218-dacb1be49363 admin admin] PATH_INFO: `/v3/users/f27a0181336c474fa1a80c34325076d1` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:28.797269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6b1ec-e933-4cf1-9218-dacb1be49363 admin admin] RBAC: Authorizing `identity:get_user(user_id=f27a0181336c474fa1a80c34325076d1)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:28.799124 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6b1ec-e933-4cf1-9218-dacb1be49363 admin admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:28.800699 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Mon May 9 15:04:28 2022] GET /identity/v3/users/f27a0181336c474fa1a80c34325076d1 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:31.103030 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14917018-ec43-4579-b3bc-84abf6e9c075 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:31.103576 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14917018-ec43-4579-b3bc-84abf6e9c075 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:31.103576 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14917018-ec43-4579-b3bc-84abf6e9c075 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:31.105006 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:31.110994 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d5606-eceb-4968-97e2-192bacff23af None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:31.111503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d5606-eceb-4968-97e2-192bacff23af None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:31.111596 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d5606-eceb-4968-97e2-192bacff23af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:31.236858 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d0855-26d8-4d44-a44c-99c25ddabf8f None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:31.237146 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d0855-26d8-4d44-a44c-99c25ddabf8f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:31.237456 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d0855-26d8-4d44-a44c-99c25ddabf8f None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:31.238791 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:04:31.239651 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3d2d5606-eceb-4968-97e2-192bacff23af None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:31.240909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3d2d5606-eceb-4968-97e2-192bacff23af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:31.244169 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98569ae-2652-4ce1-8236-dee8d2bb182e None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:31.244453 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98569ae-2652-4ce1-8236-dee8d2bb182e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:31.244726 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98569ae-2652-4ce1-8236-dee8d2bb182e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:31.286385 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG passlib.handlers.bcrypt [None req-f98569ae-2652-4ce1-8236-dee8d2bb182e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80165) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 09 15:04:31.286814 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG passlib.handlers.bcrypt [None req-f98569ae-2652-4ce1-8236-dee8d2bb182e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80165) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 09 15:04:31.319589 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:04:31.334654 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-f98569ae-2652-4ce1-8236-dee8d2bb182e None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:31.336259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-f98569ae-2652-4ce1-8236-dee8d2bb182e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:31.343553 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d5606-eceb-4968-97e2-192bacff23af None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:31.440484 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:04:31.441149 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d5606-eceb-4968-97e2-192bacff23af None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:31.465000 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98569ae-2652-4ce1-8236-dee8d2bb182e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:31.474764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3893a-f4ec-4eba-96e1-b0c4fa8d2d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:31.475568 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3893a-f4ec-4eba-96e1-b0c4fa8d2d4c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:31.475854 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3893a-f4ec-4eba-96e1-b0c4fa8d2d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:31.476128 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3893a-f4ec-4eba-96e1-b0c4fa8d2d4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:31.487945 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3893a-f4ec-4eba-96e1-b0c4fa8d2d4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:31.499090 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f9e3893a-f4ec-4eba-96e1-b0c4fa8d2d4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:31.499090 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:31.499090 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:31.499090 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:31.499090 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:31.499090 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:31.499090 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:31.499090 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:31.499090 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:31.499090 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:31.499090 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:31.499090 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:31.499090 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:31.499090 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:31.499090 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:31.499090 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:31.500134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:31.500134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:31.500134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:31.500134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:31.500134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:31.500134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:31.500134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:31.500134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:31.500134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:31.500134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:31.500134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:31.500134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:04:31.500134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:31.500134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:31.500134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:31.500134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:31.500932 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:31.500932 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:31.500932 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:31.500932 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:31.500932 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:31.500932 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:31.500932 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:31.500932 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:31.500932 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:31.500932 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:31.500932 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:31.500932 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:04:31.500932 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:04:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:04:31.506233 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3893a-f4ec-4eba-96e1-b0c4fa8d2d4c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:31.564258 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98569ae-2652-4ce1-8236-dee8d2bb182e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:31.597713 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792a865-13f9-4094-bf74-fc3f6768641b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:31.598622 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792a865-13f9-4094-bf74-fc3f6768641b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:31.598913 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792a865-13f9-4094-bf74-fc3f6768641b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:31.599195 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792a865-13f9-4094-bf74-fc3f6768641b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:31.602171 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3893a-f4ec-4eba-96e1-b0c4fa8d2d4c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:31.635281 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f7e35-11d2-4493-ad1c-03ef57e6c3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:31.636691 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f7e35-11d2-4493-ad1c-03ef57e6c3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:31.636980 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f7e35-11d2-4493-ad1c-03ef57e6c3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:31.637259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f7e35-11d2-4493-ad1c-03ef57e6c3e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:31.638045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f7e35-11d2-4493-ad1c-03ef57e6c3e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:31.638354 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f7e35-11d2-4493-ad1c-03ef57e6c3e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:31.639758 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f7e35-11d2-4493-ad1c-03ef57e6c3e0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:31.651433 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 8/15] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:04:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:31.656936 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f7e35-11d2-4493-ad1c-03ef57e6c3e0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:31.668020 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792a865-13f9-4094-bf74-fc3f6768641b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:31.669580 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792a865-13f9-4094-bf74-fc3f6768641b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:31.759239 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f7e35-11d2-4493-ad1c-03ef57e6c3e0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:31.770770 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 8/16] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:04:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:04:31.776823 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792a865-13f9-4094-bf74-fc3f6768641b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:31.795045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077da54c-a67d-497b-b72f-3bed917dffbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:31.795918 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077da54c-a67d-497b-b72f-3bed917dffbb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:31.796200 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077da54c-a67d-497b-b72f-3bed917dffbb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:31.796477 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077da54c-a67d-497b-b72f-3bed917dffbb None admin] PATH_INFO: `/v3/users/f27a0181336c474fa1a80c34325076d1` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:31.797722 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077da54c-a67d-497b-b72f-3bed917dffbb None admin] RBAC: Authorizing `identity:get_user(user_id=f27a0181336c474fa1a80c34325076d1)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:31.799182 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077da54c-a67d-497b-b72f-3bed917dffbb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:31.800983 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 9/17] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:04:31 2022] GET /identity/v3/users/f27a0181336c474fa1a80c34325076d1 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:31.806099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077da54c-a67d-497b-b72f-3bed917dffbb None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:31.874083 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792a865-13f9-4094-bf74-fc3f6768641b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:31.902892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077da54c-a67d-497b-b72f-3bed917dffbb None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:31.906338 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c0865-fec2-44d5-99c5-ac1cb12cae3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:31.907140 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c0865-fec2-44d5-99c5-ac1cb12cae3b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:31.907426 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c0865-fec2-44d5-99c5-ac1cb12cae3b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:31.907703 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c0865-fec2-44d5-99c5-ac1cb12cae3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:31.940836 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6fae6-372d-46ef-94a6-f3b9fc6d1596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:31.941695 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6fae6-372d-46ef-94a6-f3b9fc6d1596 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:31.941980 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6fae6-372d-46ef-94a6-f3b9fc6d1596 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:31.942258 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6fae6-372d-46ef-94a6-f3b9fc6d1596 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:31.943644 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6fae6-372d-46ef-94a6-f3b9fc6d1596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:31.945181 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6fae6-372d-46ef-94a6-f3b9fc6d1596 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:31.947008 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 10/18] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:04:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:31.954006 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6fae6-372d-46ef-94a6-f3b9fc6d1596 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:32.040480 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c0865-fec2-44d5-99c5-ac1cb12cae3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:32.042656 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c0865-fec2-44d5-99c5-ac1cb12cae3b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:32.064980 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6fae6-372d-46ef-94a6-f3b9fc6d1596 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:32.065217 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-6b5c0865-fec2-44d5-99c5-ac1cb12cae3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:04:32.065217 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:32.065217 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:32.065217 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:32.065217 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:32.065217 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:32.065217 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:32.065217 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:32.065217 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:32.065217 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:32.065217 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:32.065217 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:32.065217 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:04:32.065217 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:04:32.065217 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:04:32.066153 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:04:32.066153 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:32.066153 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:32.066153 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:32.066153 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:32.066153 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:32.066153 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:32.066153 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:32.066153 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:04:32.066153 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:32.066153 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:32.066153 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:32.066153 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:32.066153 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:32.066153 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:32.066153 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:32.066153 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:32.067108 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:04:32.067108 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:04:32.067108 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:04:32.067108 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:04:32.067108 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 9/19] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:04:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:04:32.072496 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c0865-fec2-44d5-99c5-ac1cb12cae3b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:32.100794 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b9486-4569-436b-a8e5-c56bdfbffea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:32.101497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b9486-4569-436b-a8e5-c56bdfbffea6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:32.101785 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b9486-4569-436b-a8e5-c56bdfbffea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:32.102065 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b9486-4569-436b-a8e5-c56bdfbffea6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:32.102931 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b9486-4569-436b-a8e5-c56bdfbffea6 None admin] RBAC: Adding query filter params (role.id=3409f00ead9e455182684faa27b1f8f0, scope.domain.id=default, user.id=f27a0181336c474fa1a80c34325076d1) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:32.103247 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b9486-4569-436b-a8e5-c56bdfbffea6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:32.105286 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b9486-4569-436b-a8e5-c56bdfbffea6 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:32.112961 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 11/20] 10.222.0.48 () {56 vars in 1322 bytes} [Mon May 9 15:04:31 2022] GET /identity/v3/role_assignments?user.id=f27a0181336c474fa1a80c34325076d1&scope.domain.id=default&role.id=3409f00ead9e455182684faa27b1f8f0 => generated 233 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:32.187387 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c0865-fec2-44d5-99c5-ac1cb12cae3b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:32.226240 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2d2e8-e947-4c5a-a96c-58744e085308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:32.226932 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2d2e8-e947-4c5a-a96c-58744e085308 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:32.227221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2d2e8-e947-4c5a-a96c-58744e085308 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:32.227500 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2d2e8-e947-4c5a-a96c-58744e085308 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:32.228257 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2d2e8-e947-4c5a-a96c-58744e085308 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:32.228566 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2d2e8-e947-4c5a-a96c-58744e085308 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:32.231377 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2d2e8-e947-4c5a-a96c-58744e085308 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:32.252118 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 10/21] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:34.683334 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e2e19-3acd-4978-8b32-543e2767d8f7 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:34.684545 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e2e19-3acd-4978-8b32-543e2767d8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:34.685062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e2e19-3acd-4978-8b32-543e2767d8f7 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:34.686958 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 12/22] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:34.692990 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa4d02-44e8-4fcd-b29f-0e58e499ebd2 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:34.693806 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa4d02-44e8-4fcd-b29f-0e58e499ebd2 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:34.694227 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa4d02-44e8-4fcd-b29f-0e58e499ebd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:34.722686 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-13aa4d02-44e8-4fcd-b29f-0e58e499ebd2 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:34.724197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-13aa4d02-44e8-4fcd-b29f-0e58e499ebd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:34.815710 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 11/23] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:04:34.860057 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e2e19-3acd-4978-8b32-543e2767d8f7 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:34.975856 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d055065-ab78-4e2d-8170-eac1b4f15f38 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:34.976484 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d055065-ab78-4e2d-8170-eac1b4f15f38 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:34.976973 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d055065-ab78-4e2d-8170-eac1b4f15f38 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:34.978909 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 12/24] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:34.986500 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6cc23-76e1-4b85-94b4-fc3bbef356bc None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:34.987106 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6cc23-76e1-4b85-94b4-fc3bbef356bc None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:34.987670 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6cc23-76e1-4b85-94b4-fc3bbef356bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:35.003077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e2e19-3acd-4978-8b32-543e2767d8f7 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:35.022412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-7ae6cc23-76e1-4b85-94b4-fc3bbef356bc None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:35.023949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-7ae6cc23-76e1-4b85-94b4-fc3bbef356bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:35.066083 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12386a07-12aa-472f-be16-7125e9001820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:35.066903 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12386a07-12aa-472f-be16-7125e9001820 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:35.067194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12386a07-12aa-472f-be16-7125e9001820 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:35.067476 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12386a07-12aa-472f-be16-7125e9001820 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:35.092098 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12386a07-12aa-472f-be16-7125e9001820 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:35.099923 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-12386a07-12aa-472f-be16-7125e9001820 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:35.099923 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:35.099923 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:35.099923 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:35.099923 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:35.099923 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:35.099923 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:35.099923 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:35.099923 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:35.099923 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:35.099923 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:35.099923 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:35.099923 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:35.099923 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:35.099923 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:35.099923 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:35.100776 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:35.100776 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:35.100776 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:35.100776 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:35.100776 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:35.100776 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:35.100776 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:35.100776 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:35.100776 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:35.100776 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:35.100776 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:35.100776 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:04:35.100776 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:35.100776 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:35.100776 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:35.100776 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:35.101588 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:35.101588 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:35.101588 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:35.101588 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:35.101588 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:35.101588 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:35.101588 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:35.101588 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:35.101588 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:35.101588 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:35.101588 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:35.101588 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:04:35.101588 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 13/25] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:04:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:35.109128 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12386a07-12aa-472f-be16-7125e9001820 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:35.167065 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 13/26] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:04:35.216088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6cc23-76e1-4b85-94b4-fc3bbef356bc None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:35.265469 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12386a07-12aa-472f-be16-7125e9001820 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:35.315082 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f273a80-1ab8-4cc3-9d37-0a6e6ca7fd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:35.316061 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f273a80-1ab8-4cc3-9d37-0a6e6ca7fd9d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:35.316519 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f273a80-1ab8-4cc3-9d37-0a6e6ca7fd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:35.316997 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f273a80-1ab8-4cc3-9d37-0a6e6ca7fd9d None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:35.317971 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f273a80-1ab8-4cc3-9d37-0a6e6ca7fd9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:35.318479 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f273a80-1ab8-4cc3-9d37-0a6e6ca7fd9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:35.320069 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f273a80-1ab8-4cc3-9d37-0a6e6ca7fd9d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:35.339053 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 14/27] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:04:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:35.341036 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3331e-b982-4900-90f4-447dd295d42b None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:35.341561 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3331e-b982-4900-90f4-447dd295d42b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:35.342021 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3331e-b982-4900-90f4-447dd295d42b None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:35.343797 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 15/28] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:35.344708 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3331e-b982-4900-90f4-447dd295d42b None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:35.370808 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6cc23-76e1-4b85-94b4-fc3bbef356bc None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:35.441397 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47518889-595f-491d-b5ba-a067a904a3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:35.442207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47518889-595f-491d-b5ba-a067a904a3be None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:35.442495 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47518889-595f-491d-b5ba-a067a904a3be None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:35.442776 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47518889-595f-491d-b5ba-a067a904a3be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:35.467937 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47518889-595f-491d-b5ba-a067a904a3be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:35.469493 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47518889-595f-491d-b5ba-a067a904a3be None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:35.504281 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-47518889-595f-491d-b5ba-a067a904a3be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:04:35.504281 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:35.504281 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:35.504281 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:35.504281 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:35.504281 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:35.504281 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:35.504281 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:35.504281 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:35.504281 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:35.504281 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:35.504281 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:35.504281 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:04:35.504281 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:04:35.504281 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:04:35.505272 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:04:35.505272 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:35.505272 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:35.505272 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:35.505272 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:35.505272 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:35.505272 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:35.505272 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:35.505272 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:04:35.505272 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:35.505272 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:35.505272 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:35.505272 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:35.505272 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:35.505272 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:35.505272 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:35.505272 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:35.506135 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:04:35.506135 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:04:35.506135 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:04:35.506135 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:04:35.516403 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 14/29] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:35.517630 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc20a1-5e96-495f-afa7-89aacd07b76f None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:35.517924 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc20a1-5e96-495f-afa7-89aacd07b76f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:35.518207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc20a1-5e96-495f-afa7-89aacd07b76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:35.542724 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3331e-b982-4900-90f4-447dd295d42b None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:35.554799 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-4bcc20a1-5e96-495f-afa7-89aacd07b76f None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:35.556044 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-4bcc20a1-5e96-495f-afa7-89aacd07b76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:35.618523 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a2532-ce64-4bb6-8349-dd5682ec5eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:35.619433 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a2532-ce64-4bb6-8349-dd5682ec5eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:35.620262 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a2532-ce64-4bb6-8349-dd5682ec5eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:35.620543 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a2532-ce64-4bb6-8349-dd5682ec5eb2 None admin] PATH_INFO: `/v3/users/f27a0181336c474fa1a80c34325076d1` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:35.624175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a2532-ce64-4bb6-8349-dd5682ec5eb2 None admin] RBAC: Authorizing `identity:get_user(user_id=f27a0181336c474fa1a80c34325076d1)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:35.625707 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a2532-ce64-4bb6-8349-dd5682ec5eb2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:35.627660 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 16/30] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:04:35 2022] GET /identity/v3/users/f27a0181336c474fa1a80c34325076d1 => generated 247 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:35.628251 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a2532-ce64-4bb6-8349-dd5682ec5eb2 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:35.741408 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 15/31] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:04:35.742200 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc20a1-5e96-495f-afa7-89aacd07b76f None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:35.743178 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a2532-ce64-4bb6-8349-dd5682ec5eb2 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:35.780823 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29609fb4-9b16-434c-a78a-9920e8b4e8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:35.781441 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29609fb4-9b16-434c-a78a-9920e8b4e8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:35.781892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29609fb4-9b16-434c-a78a-9920e8b4e8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:35.782336 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29609fb4-9b16-434c-a78a-9920e8b4e8a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:35.783211 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29609fb4-9b16-434c-a78a-9920e8b4e8a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:35.783665 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29609fb4-9b16-434c-a78a-9920e8b4e8a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:35.785220 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29609fb4-9b16-434c-a78a-9920e8b4e8a6 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:35.804432 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 17/32] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:35.809649 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29609fb4-9b16-434c-a78a-9920e8b4e8a6 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:35.920068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29609fb4-9b16-434c-a78a-9920e8b4e8a6 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:35.960928 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc20a1-5e96-495f-afa7-89aacd07b76f None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:35.982889 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f1d85-0f14-4245-a091-90d7162be1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:35.983816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f1d85-0f14-4245-a091-90d7162be1dc None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:35.984509 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f1d85-0f14-4245-a091-90d7162be1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:35.984931 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f1d85-0f14-4245-a091-90d7162be1dc None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:35.985859 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f1d85-0f14-4245-a091-90d7162be1dc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:35.987408 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f1d85-0f14-4245-a091-90d7162be1dc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:36.042949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d45aa5-b4ea-46e8-a2a9-e6ac870e78cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:36.044117 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d45aa5-b4ea-46e8-a2a9-e6ac870e78cd None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:36.044545 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d45aa5-b4ea-46e8-a2a9-e6ac870e78cd None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:36.044961 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d45aa5-b4ea-46e8-a2a9-e6ac870e78cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:36.047021 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d45aa5-b4ea-46e8-a2a9-e6ac870e78cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:36.048938 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d45aa5-b4ea-46e8-a2a9-e6ac870e78cd None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:36.051284 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 16/33] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:04:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:36.056600 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d45aa5-b4ea-46e8-a2a9-e6ac870e78cd None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:36.134531 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 18/34] 10.222.0.48 () {60 vars in 1131 bytes} [Mon May 9 15:04:35 2022] POST /identity/v3/roles => generated 219 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:04:36.135543 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f1d85-0f14-4245-a091-90d7162be1dc None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:36.178854 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d45aa5-b4ea-46e8-a2a9-e6ac870e78cd None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:36.240240 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e02a1-30cf-4bc1-9ef0-433c5f906661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:36.241191 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e02a1-30cf-4bc1-9ef0-433c5f906661 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:36.241679 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e02a1-30cf-4bc1-9ef0-433c5f906661 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:36.242289 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e02a1-30cf-4bc1-9ef0-433c5f906661 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:36.243199 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e02a1-30cf-4bc1-9ef0-433c5f906661 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:36.245019 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e02a1-30cf-4bc1-9ef0-433c5f906661 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:36.296823 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f1d85-0f14-4245-a091-90d7162be1dc None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:36.363159 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcae5a1-75c5-4f47-8913-7c7817621784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:36.364043 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcae5a1-75c5-4f47-8913-7c7817621784 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:36.364324 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcae5a1-75c5-4f47-8913-7c7817621784 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:36.364651 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcae5a1-75c5-4f47-8913-7c7817621784 None admin] PATH_INFO: `/v3/domains/default/users/f27a0181336c474fa1a80c34325076d1/roles/3409f00ead9e455182684faa27b1f8f0` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:36.366939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcae5a1-75c5-4f47-8913-7c7817621784 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f27a0181336c474fa1a80c34325076d1, role_id=3409f00ead9e455182684faa27b1f8f0)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:36.368545 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcae5a1-75c5-4f47-8913-7c7817621784 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:36.391213 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 19/35] 10.222.0.48 () {58 vars in 1361 bytes} [Mon May 9 15:04:36 2022] PUT /identity/v3/domains/default/users/f27a0181336c474fa1a80c34325076d1/roles/3409f00ead9e455182684faa27b1f8f0 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:04:36.397427 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c6496-e22b-46e2-8b27-82e2d058d3ec None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:36.397427 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c6496-e22b-46e2-8b27-82e2d058d3ec None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:36.397427 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c6496-e22b-46e2-8b27-82e2d058d3ec None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:36.397427 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 20/36] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:36.401566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e2941-0c4a-4713-bc2f-f727950a3e82 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:36.401916 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e2941-0c4a-4713-bc2f-f727950a3e82 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:36.402134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e2941-0c4a-4713-bc2f-f727950a3e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:36.431541 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 17/37] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:04:36 2022] POST /identity/v3/projects => generated 301 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:04:36.447030 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-c28e2941-0c4a-4713-bc2f-f727950a3e82 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:36.449591 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c28e2941-0c4a-4713-bc2f-f727950a3e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:36.498903 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659383c8-6c59-4fff-b333-9e7fa2fe4ad5 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:36.499374 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659383c8-6c59-4fff-b333-9e7fa2fe4ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:36.499803 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659383c8-6c59-4fff-b333-9e7fa2fe4ad5 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:36.501897 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 18/38] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:04:36.508255 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e93c4d-9103-45fb-a3ef-15475c8426f8 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:36.508597 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e93c4d-9103-45fb-a3ef-15475c8426f8 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:36.508807 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e93c4d-9103-45fb-a3ef-15475c8426f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:36.550662 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-40e93c4d-9103-45fb-a3ef-15475c8426f8 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:36.552157 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-40e93c4d-9103-45fb-a3ef-15475c8426f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:36.552474 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 21/39] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:04:36.603320 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e2941-0c4a-4713-bc2f-f727950a3e82 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:36.680538 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 19/40] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:04:36.686227 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb841358-b461-4413-afb7-855eb55adfd0 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:36.686559 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb841358-b461-4413-afb7-855eb55adfd0 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:36.686803 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb841358-b461-4413-afb7-855eb55adfd0 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:36.697320 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 20/41] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:36.701271 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f30f2-b792-47e9-b9aa-18dda725a8f5 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:36.701597 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f30f2-b792-47e9-b9aa-18dda725a8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:36.701882 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f30f2-b792-47e9-b9aa-18dda725a8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:36.726404 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-0b9f30f2-b792-47e9-b9aa-18dda725a8f5 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:36.727631 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-0b9f30f2-b792-47e9-b9aa-18dda725a8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:36.752660 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e2941-0c4a-4713-bc2f-f727950a3e82 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:36.794196 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ad798-317c-4253-8eba-1b0c79e2685a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:36.795253 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ad798-317c-4253-8eba-1b0c79e2685a None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:36.795253 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ad798-317c-4253-8eba-1b0c79e2685a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:36.795437 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ad798-317c-4253-8eba-1b0c79e2685a None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:36.796177 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ad798-317c-4253-8eba-1b0c79e2685a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:36.797613 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ad798-317c-4253-8eba-1b0c79e2685a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:36.814476 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1131 bytes} [Mon May 9 15:04:36 2022] POST /identity/v3/roles => generated 225 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:04:36.815276 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ad798-317c-4253-8eba-1b0c79e2685a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:36.826367 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 21/43] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:04:36.851338 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f30f2-b792-47e9-b9aa-18dda725a8f5 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:36.976303 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f30f2-b792-47e9-b9aa-18dda725a8f5 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:36.977715 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ad798-317c-4253-8eba-1b0c79e2685a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:37.020396 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b4271-7057-431d-addd-4d7867339028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:37.021175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b4271-7057-431d-addd-4d7867339028 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:37.021541 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b4271-7057-431d-addd-4d7867339028 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:37.021888 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b4271-7057-431d-addd-4d7867339028 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:37.022348 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bf2bb-dad2-4e23-ada3-9b41f721b31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:37.022773 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b4271-7057-431d-addd-4d7867339028 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:37.023548 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bf2bb-dad2-4e23-ada3-9b41f721b31a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:37.024010 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bf2bb-dad2-4e23-ada3-9b41f721b31a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:37.024159 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b4271-7057-431d-addd-4d7867339028 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:37.024615 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bf2bb-dad2-4e23-ada3-9b41f721b31a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:37.026037 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bf2bb-dad2-4e23-ada3-9b41f721b31a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:37.028575 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bf2bb-dad2-4e23-ada3-9b41f721b31a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:37.030539 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 22/44] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:04:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:37.036331 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bf2bb-dad2-4e23-ada3-9b41f721b31a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:37.043096 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 23/45] 10.222.0.48 () {60 vars in 1131 bytes} [Mon May 9 15:04:36 2022] POST /identity/v3/roles => generated 223 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:04:37.152945 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bf2bb-dad2-4e23-ada3-9b41f721b31a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:37.188533 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8a38e-c3ce-4ef6-96f2-2cbc2b6fee9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:37.189217 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8a38e-c3ce-4ef6-96f2-2cbc2b6fee9b None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:37.189533 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8a38e-c3ce-4ef6-96f2-2cbc2b6fee9b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:37.189815 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8a38e-c3ce-4ef6-96f2-2cbc2b6fee9b None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:37.190554 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8a38e-c3ce-4ef6-96f2-2cbc2b6fee9b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:37.192038 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8a38e-c3ce-4ef6-96f2-2cbc2b6fee9b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:37.225423 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 23/46] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:04:37 2022] POST /identity/v3/projects => generated 312 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:04:38.910005 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d053f6-351d-425a-80f6-413a1dcf5dde None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:38.910516 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d053f6-351d-425a-80f6-413a1dcf5dde None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:38.910679 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d053f6-351d-425a-80f6-413a1dcf5dde None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:38.912060 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 24/47] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:38.918530 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5da7be-7409-4c3c-a511-913af6cc7587 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:38.918959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5da7be-7409-4c3c-a511-913af6cc7587 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:38.919187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5da7be-7409-4c3c-a511-913af6cc7587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:38.936768 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-4c5da7be-7409-4c3c-a511-913af6cc7587 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:38.937990 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-4c5da7be-7409-4c3c-a511-913af6cc7587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:39.005530 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 24/48] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:04:39.029328 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d053f6-351d-425a-80f6-413a1dcf5dde None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:39.138181 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d053f6-351d-425a-80f6-413a1dcf5dde None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:39.174010 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be2529-ac30-4ee0-8160-b4fdb9fa4473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:39.174727 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be2529-ac30-4ee0-8160-b4fdb9fa4473 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:39.175011 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be2529-ac30-4ee0-8160-b4fdb9fa4473 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:39.175289 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be2529-ac30-4ee0-8160-b4fdb9fa4473 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:39.187299 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be2529-ac30-4ee0-8160-b4fdb9fa4473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:39.195092 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-a1be2529-ac30-4ee0-8160-b4fdb9fa4473 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:39.195092 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:39.195092 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:39.195092 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:39.195092 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:39.195092 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:39.195092 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:39.195092 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:39.195092 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:39.195092 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:39.195092 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:39.195092 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:39.195092 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:39.195092 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:39.195092 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:39.195092 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:39.196122 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:39.196122 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:39.196122 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:39.196122 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:39.196122 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:39.196122 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:39.196122 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:39.196122 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:39.196122 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:39.196122 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:39.196122 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:39.196122 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:04:39.196122 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:39.196122 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:39.196122 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:39.196122 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:39.196887 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:39.196887 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:39.196887 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:39.196887 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:39.196887 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:39.196887 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:39.196887 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:39.196887 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:39.196887 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:39.196887 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:39.196887 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:39.196887 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:04:39.196887 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 25/49] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:04:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:39.202858 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5da7be-7409-4c3c-a511-913af6cc7587 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:39.308250 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5da7be-7409-4c3c-a511-913af6cc7587 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:39.347914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6950ef-64b8-4a93-8da2-23e77c0baa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:39.348649 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6950ef-64b8-4a93-8da2-23e77c0baa98 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:39.348942 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6950ef-64b8-4a93-8da2-23e77c0baa98 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:39.349224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6950ef-64b8-4a93-8da2-23e77c0baa98 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:39.350070 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6950ef-64b8-4a93-8da2-23e77c0baa98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:39.350391 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6950ef-64b8-4a93-8da2-23e77c0baa98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:39.351810 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6950ef-64b8-4a93-8da2-23e77c0baa98 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:39.365342 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 25/50] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:04:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:39.371516 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be2529-ac30-4ee0-8160-b4fdb9fa4473 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:39.469933 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be2529-ac30-4ee0-8160-b4fdb9fa4473 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:39.504201 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea2a9b-d731-4189-a2e5-e2b260520d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:39.505074 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea2a9b-d731-4189-a2e5-e2b260520d84 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:39.505360 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea2a9b-d731-4189-a2e5-e2b260520d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:39.505734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea2a9b-d731-4189-a2e5-e2b260520d84 None admin] PATH_INFO: `/v3/users/f27a0181336c474fa1a80c34325076d1` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:39.506948 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea2a9b-d731-4189-a2e5-e2b260520d84 None admin] RBAC: Authorizing `identity:get_user(user_id=f27a0181336c474fa1a80c34325076d1)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:39.508418 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea2a9b-d731-4189-a2e5-e2b260520d84 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:39.510072 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 26/51] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:04:39 2022] GET /identity/v3/users/f27a0181336c474fa1a80c34325076d1 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:39.514365 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7851ea-da34-4677-8df4-aff6757176af None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:39.514661 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7851ea-da34-4677-8df4-aff6757176af None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:39.514945 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7851ea-da34-4677-8df4-aff6757176af None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:39.516235 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea2a9b-d731-4189-a2e5-e2b260520d84 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:39.516543 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 26/52] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:39.522021 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fedf9-8deb-47ab-8afc-abe3c84ee2ef None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:39.522391 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fedf9-8deb-47ab-8afc-abe3c84ee2ef None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:39.522754 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fedf9-8deb-47ab-8afc-abe3c84ee2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:39.540088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-b38fedf9-8deb-47ab-8afc-abe3c84ee2ef None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:39.541297 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b38fedf9-8deb-47ab-8afc-abe3c84ee2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:39.607659 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 27/53] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:04:39.612074 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea2a9b-d731-4189-a2e5-e2b260520d84 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:39.631258 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fedf9-8deb-47ab-8afc-abe3c84ee2ef None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:39.645721 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037f55a-a966-4e21-b6e7-4cee41907a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:39.646519 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037f55a-a966-4e21-b6e7-4cee41907a0d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:39.646807 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037f55a-a966-4e21-b6e7-4cee41907a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:39.647087 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037f55a-a966-4e21-b6e7-4cee41907a0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:39.648267 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037f55a-a966-4e21-b6e7-4cee41907a0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:39.649784 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037f55a-a966-4e21-b6e7-4cee41907a0d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:39.656868 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 27/54] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:04:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:39.657918 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037f55a-a966-4e21-b6e7-4cee41907a0d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:39.730877 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fedf9-8deb-47ab-8afc-abe3c84ee2ef None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:39.751040 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037f55a-a966-4e21-b6e7-4cee41907a0d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:39.764307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e3cef-b779-4eca-96e0-e5c3202350a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:39.765106 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e3cef-b779-4eca-96e0-e5c3202350a7 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:39.765417 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e3cef-b779-4eca-96e0-e5c3202350a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:39.765704 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e3cef-b779-4eca-96e0-e5c3202350a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:39.766897 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e3cef-b779-4eca-96e0-e5c3202350a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:39.768341 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e3cef-b779-4eca-96e0-e5c3202350a7 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:39.769997 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 28/55] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:04:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:39.775451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e3cef-b779-4eca-96e0-e5c3202350a7 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:39.784920 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18403a7c-3534-49a3-8b2f-30ff8327d843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:39.785609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18403a7c-3534-49a3-8b2f-30ff8327d843 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:39.785893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18403a7c-3534-49a3-8b2f-30ff8327d843 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:39.786170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18403a7c-3534-49a3-8b2f-30ff8327d843 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:39.787005 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18403a7c-3534-49a3-8b2f-30ff8327d843 None admin] RBAC: Adding query filter params (role.id=3409f00ead9e455182684faa27b1f8f0, scope.domain.id=default, user.id=f27a0181336c474fa1a80c34325076d1) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:39.787311 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18403a7c-3534-49a3-8b2f-30ff8327d843 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:39.788741 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18403a7c-3534-49a3-8b2f-30ff8327d843 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:39.794615 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 28/56] 10.222.0.48 () {56 vars in 1322 bytes} [Mon May 9 15:04:39 2022] GET /identity/v3/role_assignments?user.id=f27a0181336c474fa1a80c34325076d1&scope.domain.id=default&role.id=3409f00ead9e455182684faa27b1f8f0 => generated 530 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:39.884747 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e3cef-b779-4eca-96e0-e5c3202350a7 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:39.921212 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43de3f5-4b12-44c9-b75a-f99d54421b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:39.921957 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43de3f5-4b12-44c9-b75a-f99d54421b1e None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:39.922202 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43de3f5-4b12-44c9-b75a-f99d54421b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:39.922484 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43de3f5-4b12-44c9-b75a-f99d54421b1e None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:39.923215 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43de3f5-4b12-44c9-b75a-f99d54421b1e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:39.924695 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43de3f5-4b12-44c9-b75a-f99d54421b1e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:39.952907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 29/57] 10.222.0.48 () {60 vars in 1140 bytes} [Mon May 9 15:04:39 2022] POST /identity/v3/projects => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:04:42.296690 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b7b20-4472-4360-b216-4c410054c81e None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:42.297263 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b7b20-4472-4360-b216-4c410054c81e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:42.297263 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b7b20-4472-4360-b216-4c410054c81e None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:42.298705 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 29/58] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:42.304722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5d415-cc62-43f7-b150-ccc1fb8f95dc None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:42.305241 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5d415-cc62-43f7-b150-ccc1fb8f95dc None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:42.305328 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5d415-cc62-43f7-b150-ccc1fb8f95dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:42.324273 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-46c5d415-cc62-43f7-b150-ccc1fb8f95dc None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:42.325531 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-46c5d415-cc62-43f7-b150-ccc1fb8f95dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:42.395650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 30/59] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:04:42.419739 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b7b20-4472-4360-b216-4c410054c81e None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:42.519428 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b7b20-4472-4360-b216-4c410054c81e None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:42.552471 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011a739-c4c2-4d60-90a6-705ccc78aa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:42.553182 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011a739-c4c2-4d60-90a6-705ccc78aa7a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:42.553500 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011a739-c4c2-4d60-90a6-705ccc78aa7a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:42.553780 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011a739-c4c2-4d60-90a6-705ccc78aa7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:42.554952 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011a739-c4c2-4d60-90a6-705ccc78aa7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:42.556396 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011a739-c4c2-4d60-90a6-705ccc78aa7a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:42.558682 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 30/60] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:04:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:42.564414 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5d415-cc62-43f7-b150-ccc1fb8f95dc None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:42.656922 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5d415-cc62-43f7-b150-ccc1fb8f95dc None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:42.689319 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8c5ee-1f4e-464a-a9a0-e8059157ddb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:42.690016 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8c5ee-1f4e-464a-a9a0-e8059157ddb8 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:42.690300 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8c5ee-1f4e-464a-a9a0-e8059157ddb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:42.690578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8c5ee-1f4e-464a-a9a0-e8059157ddb8 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:42.691288 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8c5ee-1f4e-464a-a9a0-e8059157ddb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:42.692707 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8c5ee-1f4e-464a-a9a0-e8059157ddb8 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:42.718055 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 31/61] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:04:42 2022] POST /identity/v3/users => generated 275 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:04:46.176789 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210b28e-67c8-401f-a829-9b82f86d006b None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:46.176789 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210b28e-67c8-401f-a829-9b82f86d006b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:46.176789 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210b28e-67c8-401f-a829-9b82f86d006b None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:46.177739 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 31/62] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:46.182800 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6fe1d-15f8-41ab-8ad9-73034d003726 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:46.183576 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6fe1d-15f8-41ab-8ad9-73034d003726 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:46.184029 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6fe1d-15f8-41ab-8ad9-73034d003726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:46.214673 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-36b6fe1d-15f8-41ab-8ad9-73034d003726 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:46.216133 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-36b6fe1d-15f8-41ab-8ad9-73034d003726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:46.236488 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75786d-35c8-4110-9eae-3b1f99f46ad4 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:46.237351 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75786d-35c8-4110-9eae-3b1f99f46ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:46.238164 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75786d-35c8-4110-9eae-3b1f99f46ad4 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:46.241462 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 32/63] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:04:46.255051 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f3a66-77f0-48e9-8574-e28eb9c5359e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:46.255618 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f3a66-77f0-48e9-8574-e28eb9c5359e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:46.256071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f3a66-77f0-48e9-8574-e28eb9c5359e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:46.289344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-9f3f3a66-77f0-48e9-8574-e28eb9c5359e None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:46.290872 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9f3f3a66-77f0-48e9-8574-e28eb9c5359e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:46.329193 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 32/64] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:04:46.351919 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6fe1d-15f8-41ab-8ad9-73034d003726 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:46.414675 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 33/65] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:04:46.416031 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9381c-15b2-4baa-8d04-6b3538c321b7 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:46.417029 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9381c-15b2-4baa-8d04-6b3538c321b7 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:46.417491 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9381c-15b2-4baa-8d04-6b3538c321b7 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:46.423914 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 34/66] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:46.425480 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31facc3a-552a-4da3-9288-2973a7c8994b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:46.425935 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31facc3a-552a-4da3-9288-2973a7c8994b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:46.426969 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31facc3a-552a-4da3-9288-2973a7c8994b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:46.444899 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-31facc3a-552a-4da3-9288-2973a7c8994b None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:46.446422 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-31facc3a-552a-4da3-9288-2973a7c8994b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:46.494329 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6fe1d-15f8-41ab-8ad9-73034d003726 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:46.530047 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 35/67] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:04:46.530935 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31facc3a-552a-4da3-9288-2973a7c8994b None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:46.531087 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac6420-9671-49c2-b947-8dbd2086d44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:46.532033 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac6420-9671-49c2-b947-8dbd2086d44e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:46.532475 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac6420-9671-49c2-b947-8dbd2086d44e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:46.532886 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac6420-9671-49c2-b947-8dbd2086d44e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:46.546124 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac6420-9671-49c2-b947-8dbd2086d44e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:46.555332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-deac6420-9671-49c2-b947-8dbd2086d44e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:04:46.555332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:46.555332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:46.555332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:46.555332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:46.555332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:46.555332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:46.555332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:46.555332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:46.555332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:46.555332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:46.555332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:46.555332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:46.555332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:46.555332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:46.555332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:46.556499 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:46.556499 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:46.556499 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:46.556499 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:46.556499 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:46.556499 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:46.556499 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:46.556499 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:46.556499 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:46.556499 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:46.556499 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:46.556499 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:04:46.556499 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:46.556499 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:46.556499 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:46.556499 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:46.557533 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:46.557533 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:46.557533 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:46.557533 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:46.557533 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:46.557533 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:46.557533 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:46.557533 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:46.557533 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:46.557533 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:46.557533 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:04:46.557533 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:04:46.559765 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 33/68] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:04:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:04:46.565511 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac6420-9671-49c2-b947-8dbd2086d44e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:46.642682 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31facc3a-552a-4da3-9288-2973a7c8994b None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:46.681236 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac6420-9671-49c2-b947-8dbd2086d44e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:46.682467 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fc5d6-a887-4ee1-840d-010c6bafdf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:46.683283 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fc5d6-a887-4ee1-840d-010c6bafdf44 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:46.683571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fc5d6-a887-4ee1-840d-010c6bafdf44 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:46.683852 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fc5d6-a887-4ee1-840d-010c6bafdf44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:46.695977 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fc5d6-a887-4ee1-840d-010c6bafdf44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:46.703842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-c25fc5d6-a887-4ee1-840d-010c6bafdf44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:46.703842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:46.703842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:46.703842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:46.703842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:46.703842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:46.703842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:46.703842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:46.703842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:46.703842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:46.703842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:46.703842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:46.703842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:46.703842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:46.703842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:46.703842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:46.704808 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:46.704808 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:46.704808 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:46.704808 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:46.704808 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:46.704808 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:46.704808 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:46.704808 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:46.704808 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:46.704808 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:46.704808 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:46.704808 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:04:46.704808 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:46.704808 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:46.704808 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:46.704808 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:46.705950 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:46.705950 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:46.705950 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:46.705950 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:46.705950 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:46.705950 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:46.705950 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:46.705950 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:46.705950 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:46.705950 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:46.705950 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:46.705950 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:04:46.705950 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 36/69] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:04:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:46.705950 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fc5d6-a887-4ee1-840d-010c6bafdf44 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:46.721568 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec880bd3-f7b4-4715-9bdd-6595cceb0e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:46.722256 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec880bd3-f7b4-4715-9bdd-6595cceb0e08 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:46.722549 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec880bd3-f7b4-4715-9bdd-6595cceb0e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:46.722826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec880bd3-f7b4-4715-9bdd-6595cceb0e08 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:46.723679 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec880bd3-f7b4-4715-9bdd-6595cceb0e08 None admin] RBAC: Adding query filter params (name=member) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:46.723891 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec880bd3-f7b4-4715-9bdd-6595cceb0e08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:46.725286 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec880bd3-f7b4-4715-9bdd-6595cceb0e08 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:46.742373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 34/70] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:04:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:46.742373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44224901-6565-48c3-a2c2-8449c0ad1f87 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:46.742373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44224901-6565-48c3-a2c2-8449c0ad1f87 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:46.742373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44224901-6565-48c3-a2c2-8449c0ad1f87 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:46.742373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 35/71] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:46.742373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44224901-6565-48c3-a2c2-8449c0ad1f87 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:46.819140 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fc5d6-a887-4ee1-840d-010c6bafdf44 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:46.845574 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44224901-6565-48c3-a2c2-8449c0ad1f87 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:46.855000 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661db55d-4950-462b-8a94-16ff07abe77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:46.855841 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661db55d-4950-462b-8a94-16ff07abe77e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:46.856126 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661db55d-4950-462b-8a94-16ff07abe77e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:46.856400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661db55d-4950-462b-8a94-16ff07abe77e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:46.868849 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661db55d-4950-462b-8a94-16ff07abe77e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:46.878074 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-661db55d-4950-462b-8a94-16ff07abe77e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:04:46.878074 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:46.878074 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:46.878074 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:46.878074 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:46.878074 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:46.878074 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:46.878074 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:46.878074 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:46.878074 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:46.878074 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:46.878074 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:46.878074 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:46.878074 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:46.878074 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:46.878074 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:46.879005 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:46.879005 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:46.879005 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:46.879005 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:46.879005 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:46.879005 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:46.879005 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:46.879005 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:46.879005 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:46.879005 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:46.879005 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:46.879005 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:04:46.879005 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:46.879005 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:46.879005 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:46.879005 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:46.879768 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:46.879768 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:46.879768 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:46.879768 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:46.879768 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:46.879768 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:46.879768 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:46.879768 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:46.879768 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:46.879768 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:46.879768 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:04:46.879768 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:04:46.879768 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 37/72] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:04:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:46.880399 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661db55d-4950-462b-8a94-16ff07abe77e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:46.890350 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f2c47-704d-4418-97cd-4b1901ef1649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:46.891309 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f2c47-704d-4418-97cd-4b1901ef1649 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:46.891774 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f2c47-704d-4418-97cd-4b1901ef1649 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:46.892261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f2c47-704d-4418-97cd-4b1901ef1649 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:46.893187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f2c47-704d-4418-97cd-4b1901ef1649 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:46.893674 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f2c47-704d-4418-97cd-4b1901ef1649 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:46.895198 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f2c47-704d-4418-97cd-4b1901ef1649 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:46.911694 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:04:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:46.911694 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ce626-5e56-46f5-a879-815a4c8a55cd None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:46.911694 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ce626-5e56-46f5-a879-815a4c8a55cd None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:46.911694 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ce626-5e56-46f5-a879-815a4c8a55cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:46.925690 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-586ce626-5e56-46f5-a879-815a4c8a55cd None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:46.926882 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-586ce626-5e56-46f5-a879-815a4c8a55cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:46.989225 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661db55d-4950-462b-8a94-16ff07abe77e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:47.001736 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 37/74] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:04:47.001736 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ce626-5e56-46f5-a879-815a4c8a55cd None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:47.032783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce99d32-3681-46ba-9108-8d4251873df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:47.033694 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce99d32-3681-46ba-9108-8d4251873df7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:47.034175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce99d32-3681-46ba-9108-8d4251873df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:47.034459 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce99d32-3681-46ba-9108-8d4251873df7 None admin] PATH_INFO: `/v3/users/e919023b70fc4d738d1bb03b30464081` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:47.048923 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce99d32-3681-46ba-9108-8d4251873df7 None admin] RBAC: Authorizing `identity:get_user(user_id=e919023b70fc4d738d1bb03b30464081)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:47.050436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce99d32-3681-46ba-9108-8d4251873df7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:47.052147 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 38/75] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:04:46 2022] GET /identity/v3/users/e919023b70fc4d738d1bb03b30464081 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:47.052962 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce99d32-3681-46ba-9108-8d4251873df7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:47.101465 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ce626-5e56-46f5-a879-815a4c8a55cd None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:47.134929 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3326299-844a-4b08-a1de-d3ab7eec9ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:47.135621 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3326299-844a-4b08-a1de-d3ab7eec9ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:47.135909 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3326299-844a-4b08-a1de-d3ab7eec9ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:47.136216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3326299-844a-4b08-a1de-d3ab7eec9ed7 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:47.136925 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3326299-844a-4b08-a1de-d3ab7eec9ed7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:47.137231 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3326299-844a-4b08-a1de-d3ab7eec9ed7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:47.138638 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3326299-844a-4b08-a1de-d3ab7eec9ed7 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:47.146353 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 38/76] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:04:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:47.147153 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3326299-844a-4b08-a1de-d3ab7eec9ed7 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:47.153037 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce99d32-3681-46ba-9108-8d4251873df7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:47.185886 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f389e6-c760-4866-b136-616ba87d2d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:47.186754 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f389e6-c760-4866-b136-616ba87d2d4f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:47.187037 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f389e6-c760-4866-b136-616ba87d2d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:47.187310 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f389e6-c760-4866-b136-616ba87d2d4f None admin] PATH_INFO: `/v3/users/f27a0181336c474fa1a80c34325076d1` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:47.188503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f389e6-c760-4866-b136-616ba87d2d4f None admin] RBAC: Authorizing `identity:get_user(user_id=f27a0181336c474fa1a80c34325076d1)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:47.189974 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f389e6-c760-4866-b136-616ba87d2d4f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:47.191936 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 39/77] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:04:47 2022] GET /identity/v3/users/f27a0181336c474fa1a80c34325076d1 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:47.193124 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35456e6-35cb-4b36-9e49-b745b1e287f2 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:47.193430 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35456e6-35cb-4b36-9e49-b745b1e287f2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:47.193712 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35456e6-35cb-4b36-9e49-b745b1e287f2 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:47.197422 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 40/78] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:47.197422 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35456e6-35cb-4b36-9e49-b745b1e287f2 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:47.242475 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3326299-844a-4b08-a1de-d3ab7eec9ed7 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:47.275114 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c97a1-c816-4d87-8231-73bb76ae2bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:47.276104 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c97a1-c816-4d87-8231-73bb76ae2bda None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:47.276396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c97a1-c816-4d87-8231-73bb76ae2bda None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:47.276673 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c97a1-c816-4d87-8231-73bb76ae2bda None admin] PATH_INFO: `/v3/roles/member` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:47.286541 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c97a1-c816-4d87-8231-73bb76ae2bda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:47.293115 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35456e6-35cb-4b36-9e49-b745b1e287f2 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:47.295083 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-019c97a1-c816-4d87-8231-73bb76ae2bda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:04:47.295083 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:47.295083 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:47.295083 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:47.295083 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:47.295083 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:47.295083 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:47.295083 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:47.295083 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:47.295083 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:47.295083 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:47.295083 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:47.295083 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:47.295083 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:47.295083 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:47.295083 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:47.296278 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:47.296278 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:47.296278 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:47.296278 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:47.296278 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:47.296278 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:47.296278 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:47.296278 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:47.296278 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:47.296278 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:47.296278 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:47.296278 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:04:47.296278 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:47.296278 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:47.296278 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:47.296278 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:47.297098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:47.297098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:47.297098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:47.297098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:47.297098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:47.297098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:47.297098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:47.297098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:47.297098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:47.297098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:47.297098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:04:47.297098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:04:47.297098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 39/79] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:04:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:47.297098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c97a1-c816-4d87-8231-73bb76ae2bda None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:47.327760 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11286379-e425-4f1a-ac8a-18b85e87691e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:47.328539 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11286379-e425-4f1a-ac8a-18b85e87691e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:47.328911 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11286379-e425-4f1a-ac8a-18b85e87691e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:47.329278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11286379-e425-4f1a-ac8a-18b85e87691e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:47.393049 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c97a1-c816-4d87-8231-73bb76ae2bda None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:47.394261 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11286379-e425-4f1a-ac8a-18b85e87691e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:47.395768 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11286379-e425-4f1a-ac8a-18b85e87691e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:47.427724 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7f3a6-105f-4115-b19e-59256b03e603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:47.428597 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7f3a6-105f-4115-b19e-59256b03e603 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:47.428884 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7f3a6-105f-4115-b19e-59256b03e603 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:47.429163 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7f3a6-105f-4115-b19e-59256b03e603 None admin] PATH_INFO: `/v3/users/e919023b70fc4d738d1bb03b30464081` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:47.430663 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7f3a6-105f-4115-b19e-59256b03e603 None admin] RBAC: Authorizing `identity:get_user(user_id=e919023b70fc4d738d1bb03b30464081)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:47.432303 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7f3a6-105f-4115-b19e-59256b03e603 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:47.438427 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 40/80] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:04:47 2022] GET /identity/v3/users/e919023b70fc4d738d1bb03b30464081 => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:47.438427 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7f3a6-105f-4115-b19e-59256b03e603 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:47.503025 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 41/81] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:04:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:04:47.504605 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b8146-2297-45ed-825a-19b0fe7948a4 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:47.505092 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b8146-2297-45ed-825a-19b0fe7948a4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:47.505396 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b8146-2297-45ed-825a-19b0fe7948a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:47.523710 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e95b8146-2297-45ed-825a-19b0fe7948a4 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:47.524927 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e95b8146-2297-45ed-825a-19b0fe7948a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:47.538896 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7f3a6-105f-4115-b19e-59256b03e603 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:47.571895 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3139e4-eaee-431e-b069-5783b2b4b2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:47.573172 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3139e4-eaee-431e-b069-5783b2b4b2be None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:47.573450 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3139e4-eaee-431e-b069-5783b2b4b2be None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:47.573733 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3139e4-eaee-431e-b069-5783b2b4b2be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:47.591120 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 42/82] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:04:47.594685 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b8146-2297-45ed-825a-19b0fe7948a4 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:47.640261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3139e4-eaee-431e-b069-5783b2b4b2be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:47.641754 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3139e4-eaee-431e-b069-5783b2b4b2be None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:47.687216 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b8146-2297-45ed-825a-19b0fe7948a4 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:47.722834 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cb527-c8e1-42bc-8f45-8bac37b9ba21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:47.723517 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cb527-c8e1-42bc-8f45-8bac37b9ba21 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:47.723806 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cb527-c8e1-42bc-8f45-8bac37b9ba21 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:47.724076 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cb527-c8e1-42bc-8f45-8bac37b9ba21 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:47.724841 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4cb527-c8e1-42bc-8f45-8bac37b9ba21 None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:47.725148 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4cb527-c8e1-42bc-8f45-8bac37b9ba21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:47.726593 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4cb527-c8e1-42bc-8f45-8bac37b9ba21 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:47.736309 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 43/83] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:04:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:47.737199 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cb527-c8e1-42bc-8f45-8bac37b9ba21 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:47.745907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 41/84] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:04:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:04:47.745907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3139e4-eaee-431e-b069-5783b2b4b2be None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:47.840088 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cb527-c8e1-42bc-8f45-8bac37b9ba21 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:47.844881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3139e4-eaee-431e-b069-5783b2b4b2be None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:47.875177 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e245add-abaa-49b2-b40b-dcc318eeb118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:47.875841 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e245add-abaa-49b2-b40b-dcc318eeb118 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:47.876134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e245add-abaa-49b2-b40b-dcc318eeb118 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:47.876420 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e245add-abaa-49b2-b40b-dcc318eeb118 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:47.880900 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84480b7e-0ab1-407b-a2a5-24ef9ae514b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:47.881845 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84480b7e-0ab1-407b-a2a5-24ef9ae514b9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:47.882131 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84480b7e-0ab1-407b-a2a5-24ef9ae514b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:47.882411 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84480b7e-0ab1-407b-a2a5-24ef9ae514b9 None admin] PATH_INFO: `/v3/projects/a5b903cafe374448928e686036261566` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:47.883676 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84480b7e-0ab1-407b-a2a5-24ef9ae514b9 None admin] RBAC: Authorizing `identity:get_project(project_id=a5b903cafe374448928e686036261566)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:47.885351 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84480b7e-0ab1-407b-a2a5-24ef9ae514b9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:47.887261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 42/85] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:04:47 2022] GET /identity/v3/projects/a5b903cafe374448928e686036261566 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:47.888083 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84480b7e-0ab1-407b-a2a5-24ef9ae514b9 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:47.945307 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e245add-abaa-49b2-b40b-dcc318eeb118 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:47.946800 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e245add-abaa-49b2-b40b-dcc318eeb118 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:47.987265 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84480b7e-0ab1-407b-a2a5-24ef9ae514b9 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:48.021640 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f13a88-231d-41ca-bdbf-a61b196893d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:48.022448 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f13a88-231d-41ca-bdbf-a61b196893d7 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:48.022737 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f13a88-231d-41ca-bdbf-a61b196893d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:48.023020 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f13a88-231d-41ca-bdbf-a61b196893d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:48.024232 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f13a88-231d-41ca-bdbf-a61b196893d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:48.025739 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f13a88-231d-41ca-bdbf-a61b196893d7 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:48.027394 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 43/86] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:04:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:48.028181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f13a88-231d-41ca-bdbf-a61b196893d7 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:48.045416 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 44/87] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:04:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:04:48.046273 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e245add-abaa-49b2-b40b-dcc318eeb118 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:48.127747 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f13a88-231d-41ca-bdbf-a61b196893d7 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:48.140187 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e245add-abaa-49b2-b40b-dcc318eeb118 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:48.160726 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d35a2c-2e7d-4963-9c7a-ab50fb921b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:48.161639 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d35a2c-2e7d-4963-9c7a-ab50fb921b36 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:48.161928 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d35a2c-2e7d-4963-9c7a-ab50fb921b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:48.162207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d35a2c-2e7d-4963-9c7a-ab50fb921b36 None admin] PATH_INFO: `/v3/users/e919023b70fc4d738d1bb03b30464081` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:48.163403 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d35a2c-2e7d-4963-9c7a-ab50fb921b36 None admin] RBAC: Authorizing `identity:get_user(user_id=e919023b70fc4d738d1bb03b30464081)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:48.164833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d35a2c-2e7d-4963-9c7a-ab50fb921b36 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:48.167047 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 44/88] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:04:48 2022] GET /identity/v3/users/e919023b70fc4d738d1bb03b30464081 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:48.167868 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d35a2c-2e7d-4963-9c7a-ab50fb921b36 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:48.174012 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2420e-817c-458e-b1e9-bf1db44347d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:48.174872 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2420e-817c-458e-b1e9-bf1db44347d4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:48.175156 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2420e-817c-458e-b1e9-bf1db44347d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:48.175432 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2420e-817c-458e-b1e9-bf1db44347d4 None admin] PATH_INFO: `/v3/projects/a5b903cafe374448928e686036261566` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:48.176610 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2420e-817c-458e-b1e9-bf1db44347d4 None admin] RBAC: Authorizing `identity:get_project(project_id=a5b903cafe374448928e686036261566)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:48.178102 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2420e-817c-458e-b1e9-bf1db44347d4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:48.179765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 45/89] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:04:48 2022] GET /identity/v3/projects/a5b903cafe374448928e686036261566 => generated 298 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:48.180505 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2420e-817c-458e-b1e9-bf1db44347d4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:48.264295 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d35a2c-2e7d-4963-9c7a-ab50fb921b36 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:48.274629 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2420e-817c-458e-b1e9-bf1db44347d4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:48.298518 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bf6bd-ee29-489f-a095-c8efbb0644a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:48.299180 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bf6bd-ee29-489f-a095-c8efbb0644a7 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:48.299472 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bf6bd-ee29-489f-a095-c8efbb0644a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:48.299753 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bf6bd-ee29-489f-a095-c8efbb0644a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:48.300591 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686bf6bd-ee29-489f-a095-c8efbb0644a7 None admin] RBAC: Adding query filter params (role.id=003cb0d66fec412dbbffb071206075d5, scope.project.id=a5b903cafe374448928e686036261566, user.id=e919023b70fc4d738d1bb03b30464081) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:48.300906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686bf6bd-ee29-489f-a095-c8efbb0644a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:48.302377 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686bf6bd-ee29-489f-a095-c8efbb0644a7 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:48.308970 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbc983-4f2b-493d-a8b5-227baab6adb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:48.309674 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbc983-4f2b-493d-a8b5-227baab6adb3 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:48.309959 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbc983-4f2b-493d-a8b5-227baab6adb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:48.310237 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbc983-4f2b-493d-a8b5-227baab6adb3 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:48.310950 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bbc983-4f2b-493d-a8b5-227baab6adb3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:48.311115 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 45/90] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:04:48 2022] GET /identity/v3/role_assignments?user.id=e919023b70fc4d738d1bb03b30464081&scope.project.id=a5b903cafe374448928e686036261566&role.id=003cb0d66fec412dbbffb071206075d5 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:48.311896 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bf6bd-ee29-489f-a095-c8efbb0644a7 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:48.313660 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bbc983-4f2b-493d-a8b5-227baab6adb3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:48.342614 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 46/91] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:04:48 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:04:48.343513 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbc983-4f2b-493d-a8b5-227baab6adb3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:48.450706 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bf6bd-ee29-489f-a095-c8efbb0644a7 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:48.471126 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbc983-4f2b-493d-a8b5-227baab6adb3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:48.493208 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248e015-2afe-4912-952b-5573349fc800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:48.495160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248e015-2afe-4912-952b-5573349fc800 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:48.495967 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248e015-2afe-4912-952b-5573349fc800 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:48.496499 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248e015-2afe-4912-952b-5573349fc800 None admin] PATH_INFO: `/v3/projects/a5b903cafe374448928e686036261566` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:48.498179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248e015-2afe-4912-952b-5573349fc800 None admin] RBAC: Authorizing `identity:get_project(project_id=a5b903cafe374448928e686036261566)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:48.500065 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248e015-2afe-4912-952b-5573349fc800 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:48.502735 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 46/92] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:04:48 2022] GET /identity/v3/projects/a5b903cafe374448928e686036261566 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:48.503997 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248e015-2afe-4912-952b-5573349fc800 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:48.512529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe74e63-b2d6-4551-8cb5-f3eeee64c8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:48.513219 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe74e63-b2d6-4551-8cb5-f3eeee64c8bd None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:48.513565 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe74e63-b2d6-4551-8cb5-f3eeee64c8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:48.513852 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe74e63-b2d6-4551-8cb5-f3eeee64c8bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:48.596599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe74e63-b2d6-4551-8cb5-f3eeee64c8bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:48.598107 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe74e63-b2d6-4551-8cb5-f3eeee64c8bd None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:48.639041 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248e015-2afe-4912-952b-5573349fc800 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:48.684166 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d49d5-5475-4b17-bd6f-32692240e27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:48.684978 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d49d5-5475-4b17-bd6f-32692240e27a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:48.685107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d49d5-5475-4b17-bd6f-32692240e27a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:48.688992 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d49d5-5475-4b17-bd6f-32692240e27a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:48.688992 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d49d5-5475-4b17-bd6f-32692240e27a None admin] RBAC: Adding query filter params (role.id=3409f00ead9e455182684faa27b1f8f0, scope.project.id=a5b903cafe374448928e686036261566, user.id=f27a0181336c474fa1a80c34325076d1) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:48.688992 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d49d5-5475-4b17-bd6f-32692240e27a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:48.688992 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d49d5-5475-4b17-bd6f-32692240e27a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:48.694638 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 47/93] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:04:48 2022] GET /identity/v3/role_assignments?user.id=f27a0181336c474fa1a80c34325076d1&scope.project.id=a5b903cafe374448928e686036261566&role.id=3409f00ead9e455182684faa27b1f8f0 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:48.695322 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d49d5-5475-4b17-bd6f-32692240e27a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:48.716595 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 47/94] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:04:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:04:48.722413 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe74e63-b2d6-4551-8cb5-f3eeee64c8bd None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:48.808697 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d49d5-5475-4b17-bd6f-32692240e27a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:48.833461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe74e63-b2d6-4551-8cb5-f3eeee64c8bd None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:48.846503 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba65a2-bd21-485c-b15c-77be7638de3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:48.847265 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba65a2-bd21-485c-b15c-77be7638de3f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:48.847452 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba65a2-bd21-485c-b15c-77be7638de3f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:48.847785 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba65a2-bd21-485c-b15c-77be7638de3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:48.848637 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba65a2-bd21-485c-b15c-77be7638de3f None admin] RBAC: Adding query filter params (role.id=371a69f4478447a2b7170a3078173caa, scope.project.id=a5b903cafe374448928e686036261566, user.id=e919023b70fc4d738d1bb03b30464081) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:48.848985 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba65a2-bd21-485c-b15c-77be7638de3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:48.850437 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba65a2-bd21-485c-b15c-77be7638de3f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:48.857332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 48/95] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:04:48 2022] GET /identity/v3/role_assignments?user.id=e919023b70fc4d738d1bb03b30464081&scope.project.id=a5b903cafe374448928e686036261566&role.id=371a69f4478447a2b7170a3078173caa => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:48.876722 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef43f3-878f-4886-8228-5feff0b69fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:48.878043 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef43f3-878f-4886-8228-5feff0b69fea None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:48.878546 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef43f3-878f-4886-8228-5feff0b69fea None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:48.879021 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef43f3-878f-4886-8228-5feff0b69fea None admin] PATH_INFO: `/v3/projects/5c6fc4d17903433f8efec601a7b4b0a6` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:48.880822 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef43f3-878f-4886-8228-5feff0b69fea None admin] RBAC: Authorizing `identity:get_project(project_id=5c6fc4d17903433f8efec601a7b4b0a6)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:48.882644 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef43f3-878f-4886-8228-5feff0b69fea None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:48.889768 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 48/96] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:04:48 2022] GET /identity/v3/projects/5c6fc4d17903433f8efec601a7b4b0a6 => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:48.892723 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba65a2-bd21-485c-b15c-77be7638de3f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:49.013546 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba65a2-bd21-485c-b15c-77be7638de3f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:49.051619 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568023e8-3151-4928-87cf-d291776c9f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:49.052294 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568023e8-3151-4928-87cf-d291776c9f14 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:49.052581 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568023e8-3151-4928-87cf-d291776c9f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:49.052862 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568023e8-3151-4928-87cf-d291776c9f14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:49.053742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568023e8-3151-4928-87cf-d291776c9f14 None admin] RBAC: Adding query filter params (role.id=003cb0d66fec412dbbffb071206075d5, scope.project.id=5c6fc4d17903433f8efec601a7b4b0a6, user.id=e919023b70fc4d738d1bb03b30464081) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:49.054061 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568023e8-3151-4928-87cf-d291776c9f14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:49.055507 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568023e8-3151-4928-87cf-d291776c9f14 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:49.062306 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 49/97] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:04:48 2022] GET /identity/v3/role_assignments?user.id=e919023b70fc4d738d1bb03b30464081&scope.project.id=5c6fc4d17903433f8efec601a7b4b0a6&role.id=003cb0d66fec412dbbffb071206075d5 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:51.392004 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fa80b-5bc3-4714-ab69-515e541b6dde None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:51.392891 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fa80b-5bc3-4714-ab69-515e541b6dde None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:51.393355 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fa80b-5bc3-4714-ab69-515e541b6dde None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:51.395018 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 49/98] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:51.401605 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591af554-fd1f-401b-beae-70281243cb36 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:51.402142 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591af554-fd1f-401b-beae-70281243cb36 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:51.402460 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591af554-fd1f-401b-beae-70281243cb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:51.434514 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-591af554-fd1f-401b-beae-70281243cb36 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:51.435724 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-591af554-fd1f-401b-beae-70281243cb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:51.527766 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 50/99] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:04:51.560830 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fa80b-5bc3-4714-ab69-515e541b6dde None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:51.683083 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fa80b-5bc3-4714-ab69-515e541b6dde None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:51.729258 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4761e3-2652-4a01-bbf4-585cbc16a0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:51.730224 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4761e3-2652-4a01-bbf4-585cbc16a0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:51.730512 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4761e3-2652-4a01-bbf4-585cbc16a0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:51.730790 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4761e3-2652-4a01-bbf4-585cbc16a0c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:51.747275 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4761e3-2652-4a01-bbf4-585cbc16a0c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:51.755406 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-fb4761e3-2652-4a01-bbf4-585cbc16a0c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:04:51.755406 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:51.755406 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:51.755406 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:51.755406 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:51.755406 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:51.755406 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:51.755406 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:51.755406 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:51.755406 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:51.755406 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:51.755406 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:51.755406 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:51.755406 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:51.755406 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:51.755406 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:51.756340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:51.756340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:51.756340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:51.756340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:51.756340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:51.756340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:51.756340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:51.756340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:51.756340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:51.756340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:51.756340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:51.756340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:04:51.756340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:51.756340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:51.756340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:51.756340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:51.757134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:51.757134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:51.757134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:51.757134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:51.757134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:51.757134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:51.757134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:51.757134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:51.757134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:51.757134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:51.757134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:04:51.757134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:04:51.757134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 50/100] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:04:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:04:51.763429 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591af554-fd1f-401b-beae-70281243cb36 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:51.879502 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591af554-fd1f-401b-beae-70281243cb36 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:51.921007 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423adc1-da5c-40f7-b00d-9e6894bf6dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:51.921712 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423adc1-da5c-40f7-b00d-9e6894bf6dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:51.921997 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423adc1-da5c-40f7-b00d-9e6894bf6dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:51.922274 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423adc1-da5c-40f7-b00d-9e6894bf6dc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:51.923022 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423adc1-da5c-40f7-b00d-9e6894bf6dc9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:51.923331 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423adc1-da5c-40f7-b00d-9e6894bf6dc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:51.924694 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423adc1-da5c-40f7-b00d-9e6894bf6dc9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:51.933412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 51/101] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:04:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:51.939129 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4761e3-2652-4a01-bbf4-585cbc16a0c3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:52.059927 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4761e3-2652-4a01-bbf4-585cbc16a0c3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:52.063398 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b5f8e-f4d5-43f7-99e6-b91599193e74 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:52.063698 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b5f8e-f4d5-43f7-99e6-b91599193e74 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:52.063982 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b5f8e-f4d5-43f7-99e6-b91599193e74 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:52.065524 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 52/102] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:52.079369 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62509df5-c281-4813-8e9e-08a26a7633f2 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:52.079671 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62509df5-c281-4813-8e9e-08a26a7633f2 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:52.079941 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62509df5-c281-4813-8e9e-08a26a7633f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:52.107843 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7928745-05d3-4a8a-8ca7-975c186824be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:52.108731 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7928745-05d3-4a8a-8ca7-975c186824be None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:52.109019 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7928745-05d3-4a8a-8ca7-975c186824be None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:52.109303 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7928745-05d3-4a8a-8ca7-975c186824be None admin] PATH_INFO: `/v3/users/e919023b70fc4d738d1bb03b30464081` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:52.110976 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7928745-05d3-4a8a-8ca7-975c186824be None admin] RBAC: Authorizing `identity:get_user(user_id=e919023b70fc4d738d1bb03b30464081)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:52.112481 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7928745-05d3-4a8a-8ca7-975c186824be None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:52.114204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 51/103] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:04:51 2022] GET /identity/v3/users/e919023b70fc4d738d1bb03b30464081 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:52.115473 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e3a95-7c90-4646-a0b3-a1d086afcf43 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:52.115767 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e3a95-7c90-4646-a0b3-a1d086afcf43 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:52.116050 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e3a95-7c90-4646-a0b3-a1d086afcf43 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:52.125916 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-62509df5-c281-4813-8e9e-08a26a7633f2 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:52.127114 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-62509df5-c281-4813-8e9e-08a26a7633f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:52.129093 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 52/104] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:52 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:52.130020 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e3a95-7c90-4646-a0b3-a1d086afcf43 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:52.211825 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 53/105] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:04:52.213290 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82911e47-c45a-49fa-9def-595e1236ec65 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:52.213679 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82911e47-c45a-49fa-9def-595e1236ec65 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:52.213968 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82911e47-c45a-49fa-9def-595e1236ec65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:52.231365 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-82911e47-c45a-49fa-9def-595e1236ec65 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:52.233215 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-82911e47-c45a-49fa-9def-595e1236ec65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:52.262275 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e3a95-7c90-4646-a0b3-a1d086afcf43 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:52.307915 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de96b5-2532-4774-b1ac-835e77e10c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:52.308947 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de96b5-2532-4774-b1ac-835e77e10c8b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:52.309590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de96b5-2532-4774-b1ac-835e77e10c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:52.309880 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de96b5-2532-4774-b1ac-835e77e10c8b None admin] PATH_INFO: `/v3/projects/a5b903cafe374448928e686036261566` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:52.311546 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de96b5-2532-4774-b1ac-835e77e10c8b None admin] RBAC: Authorizing `identity:get_project(project_id=a5b903cafe374448928e686036261566)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:52.313619 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de96b5-2532-4774-b1ac-835e77e10c8b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:52.315642 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 53/106] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:04:52 2022] GET /identity/v3/projects/a5b903cafe374448928e686036261566 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:52.316972 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb15f0-0bed-4553-a67b-ec346f660168 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:52.317263 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb15f0-0bed-4553-a67b-ec346f660168 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:52.317571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb15f0-0bed-4553-a67b-ec346f660168 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:52.319035 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 54/107] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:52.320271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb15f0-0bed-4553-a67b-ec346f660168 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:52.321486 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 54/108] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:04:52.322804 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82911e47-c45a-49fa-9def-595e1236ec65 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:52.440270 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb15f0-0bed-4553-a67b-ec346f660168 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:52.455798 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82911e47-c45a-49fa-9def-595e1236ec65 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:52.474592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fd529-61b4-4f0e-91aa-0daf5bc329f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:52.475310 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fd529-61b4-4f0e-91aa-0daf5bc329f6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:52.475592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fd529-61b4-4f0e-91aa-0daf5bc329f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:52.475866 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fd529-61b4-4f0e-91aa-0daf5bc329f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:52.489034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fd529-61b4-4f0e-91aa-0daf5bc329f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:52.497698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-d42fd529-61b4-4f0e-91aa-0daf5bc329f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:52.497698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:52.497698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:52.497698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:52.497698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:52.497698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:52.497698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:52.497698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:52.497698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:52.497698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:52.497698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:52.497698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:52.497698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:52.497698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:52.497698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:52.497698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:52.498597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:52.498597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:52.498597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:52.498597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:52.498597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:52.498597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:52.498597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:52.498597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:52.498597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:52.498597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:52.498597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:52.498597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:04:52.498597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:52.498597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:52.498597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:52.498597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:52.499404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:52.499404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:52.499404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:52.499404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:52.499404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:52.499404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:52.499404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:52.499404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:52.499404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:52.499404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:52.499404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:52.499404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:04:52.499404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 55/109] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:04:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:52.500746 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9409b-2099-44e6-9dd4-461b9dfde436 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:52.500746 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9409b-2099-44e6-9dd4-461b9dfde436 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:52.500746 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9409b-2099-44e6-9dd4-461b9dfde436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:52.506339 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f717716-8fca-4859-879b-2770cbb343af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:52.507254 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f717716-8fca-4859-879b-2770cbb343af None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:52.507542 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f717716-8fca-4859-879b-2770cbb343af None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:52.507824 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f717716-8fca-4859-879b-2770cbb343af None admin] PATH_INFO: `/v3/projects/a5b903cafe374448928e686036261566/users/e919023b70fc4d738d1bb03b30464081/roles/003cb0d66fec412dbbffb071206075d5` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:52.510334 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f717716-8fca-4859-879b-2770cbb343af None admin] RBAC: Authorizing `identity:create_grant(project_id=a5b903cafe374448928e686036261566, user_id=e919023b70fc4d738d1bb03b30464081, role_id=003cb0d66fec412dbbffb071206075d5)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:52.512528 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f717716-8fca-4859-879b-2770cbb343af None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:52.518138 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-50a9409b-2099-44e6-9dd4-461b9dfde436 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:52.519730 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-50a9409b-2099-44e6-9dd4-461b9dfde436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:52.531506 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 55/110] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:04:52 2022] PUT /identity/v3/projects/a5b903cafe374448928e686036261566/users/e919023b70fc4d738d1bb03b30464081/roles/003cb0d66fec412dbbffb071206075d5 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:04:52.532357 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f717716-8fca-4859-879b-2770cbb343af None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:52.633876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 56/111] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:04:52.633876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be243a0b-2e80-42fc-9ef8-3b0f00d8f9a1 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:52.633876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be243a0b-2e80-42fc-9ef8-3b0f00d8f9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:52.633876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be243a0b-2e80-42fc-9ef8-3b0f00d8f9a1 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:52.633876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 57/112] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:52.638782 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be243a0b-2e80-42fc-9ef8-3b0f00d8f9a1 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:52.677880 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f717716-8fca-4859-879b-2770cbb343af None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:52.717171 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b453ab5-e607-44bb-a398-702ff5b0558a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:52.718266 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b453ab5-e607-44bb-a398-702ff5b0558a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:52.718890 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b453ab5-e607-44bb-a398-702ff5b0558a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:52.719464 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b453ab5-e607-44bb-a398-702ff5b0558a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:52.721102 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b453ab5-e607-44bb-a398-702ff5b0558a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:52.723148 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b453ab5-e607-44bb-a398-702ff5b0558a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:52.725215 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 56/113] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:04:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:52.726470 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ee216-0480-4da6-b51b-9d86f412dd07 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:52.726928 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ee216-0480-4da6-b51b-9d86f412dd07 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:52.727355 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ee216-0480-4da6-b51b-9d86f412dd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:52.751003 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-fe1ee216-0480-4da6-b51b-9d86f412dd07 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:52.752267 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-fe1ee216-0480-4da6-b51b-9d86f412dd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:52.787443 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be243a0b-2e80-42fc-9ef8-3b0f00d8f9a1 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:52.823902 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ce107-f95a-445e-a1ff-af994a7c103e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:52.825064 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ce107-f95a-445e-a1ff-af994a7c103e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:52.825663 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ce107-f95a-445e-a1ff-af994a7c103e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:52.826162 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ce107-f95a-445e-a1ff-af994a7c103e None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:52.827165 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ce107-f95a-445e-a1ff-af994a7c103e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:52.827754 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ce107-f95a-445e-a1ff-af994a7c103e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:52.830252 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ce107-f95a-445e-a1ff-af994a7c103e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:52.841999 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 58/114] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:04:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:52.843296 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ce107-f95a-445e-a1ff-af994a7c103e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:52.848686 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 57/115] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:04:52.849654 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ee216-0480-4da6-b51b-9d86f412dd07 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:52.950117 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ce107-f95a-445e-a1ff-af994a7c103e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:52.980480 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ee216-0480-4da6-b51b-9d86f412dd07 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:52.990299 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e55a7-8e8d-4ebf-a248-c76b4b2833ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:52.991135 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e55a7-8e8d-4ebf-a248-c76b4b2833ee None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:52.991435 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e55a7-8e8d-4ebf-a248-c76b4b2833ee None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:52.991913 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e55a7-8e8d-4ebf-a248-c76b4b2833ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:53.003883 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e55a7-8e8d-4ebf-a248-c76b4b2833ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:53.012193 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-7d2e55a7-8e8d-4ebf-a248-c76b4b2833ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:04:53.012193 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:53.012193 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:53.012193 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:53.012193 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:53.012193 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:53.012193 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:53.012193 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:53.012193 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:53.012193 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:53.012193 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:53.012193 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:53.012193 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:53.012193 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:53.012193 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:53.012193 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:53.013151 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:53.013151 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:53.013151 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:53.013151 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:53.013151 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:53.013151 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:53.013151 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:53.013151 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:53.013151 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:53.013151 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:53.013151 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:53.013151 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:04:53.013151 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:53.013151 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:53.013151 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:53.013151 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:53.014255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:53.014255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:53.014255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:53.014255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:53.014255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:53.014255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:53.014255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:53.014255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:53.014255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:53.014255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:53.014255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:04:53.014255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:04:53.014255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 59/116] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:04:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:53.014255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e55a7-8e8d-4ebf-a248-c76b4b2833ee None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:53.022412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e639e2-6465-4981-b72f-d947cd30ee0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:53.023094 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e639e2-6465-4981-b72f-d947cd30ee0e None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:53.023383 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e639e2-6465-4981-b72f-d947cd30ee0e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:53.023661 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e639e2-6465-4981-b72f-d947cd30ee0e None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:53.024377 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e639e2-6465-4981-b72f-d947cd30ee0e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:53.025985 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e639e2-6465-4981-b72f-d947cd30ee0e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:53.060053 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 58/117] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:04:52 2022] POST /identity/v3/projects => generated 302 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:04:53.060053 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e639e2-6465-4981-b72f-d947cd30ee0e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:53.135191 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e55a7-8e8d-4ebf-a248-c76b4b2833ee None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:53.179534 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf53ff-6ed1-4487-9a79-0a107d7d78df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:53.180452 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf53ff-6ed1-4487-9a79-0a107d7d78df None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:53.180870 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf53ff-6ed1-4487-9a79-0a107d7d78df None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:53.181158 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf53ff-6ed1-4487-9a79-0a107d7d78df None admin] PATH_INFO: `/v3/users/f27a0181336c474fa1a80c34325076d1` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:53.183040 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf53ff-6ed1-4487-9a79-0a107d7d78df None admin] RBAC: Authorizing `identity:get_user(user_id=f27a0181336c474fa1a80c34325076d1)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:53.184538 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf53ff-6ed1-4487-9a79-0a107d7d78df None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:53.188124 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 60/118] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:04:53 2022] GET /identity/v3/users/f27a0181336c474fa1a80c34325076d1 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:53.189836 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6d672-2060-4e85-897b-cf9a49d8737d None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:53.190901 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6d672-2060-4e85-897b-cf9a49d8737d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:53.191559 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6d672-2060-4e85-897b-cf9a49d8737d None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:53.197942 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 61/119] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:53.197942 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6d672-2060-4e85-897b-cf9a49d8737d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:53.206677 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e639e2-6465-4981-b72f-d947cd30ee0e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:53.245407 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47b150-a2d9-47b8-9385-507b34634525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:53.246545 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47b150-a2d9-47b8-9385-507b34634525 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:53.247008 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47b150-a2d9-47b8-9385-507b34634525 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:53.247445 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47b150-a2d9-47b8-9385-507b34634525 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:53.262361 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47b150-a2d9-47b8-9385-507b34634525 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:53.270814 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-6d47b150-a2d9-47b8-9385-507b34634525 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:04:53.270814 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:53.270814 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:53.270814 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:53.270814 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:53.270814 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:53.270814 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:53.270814 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:53.270814 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:53.270814 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:53.270814 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:53.270814 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:53.270814 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:53.270814 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:53.270814 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:53.270814 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:53.271718 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:53.271718 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:53.271718 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:53.271718 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:53.271718 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:53.271718 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:53.271718 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:53.271718 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:53.271718 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:53.271718 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:53.271718 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:53.271718 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:04:53.271718 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:53.271718 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:53.271718 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:53.271718 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:53.274074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:53.274074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:53.274074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:53.274074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:53.274074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:53.274074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:53.274074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:53.274074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:53.274074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:53.274074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:53.274074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:04:53.274074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:04:53.274074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 59/120] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:04:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:53.274074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47b150-a2d9-47b8-9385-507b34634525 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:53.348822 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6d672-2060-4e85-897b-cf9a49d8737d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:53.390657 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd590ce2-d953-4c15-b197-4199d3a2076c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:53.391693 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd590ce2-d953-4c15-b197-4199d3a2076c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:53.392249 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd590ce2-d953-4c15-b197-4199d3a2076c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:53.392547 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd590ce2-d953-4c15-b197-4199d3a2076c None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:53.393505 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd590ce2-d953-4c15-b197-4199d3a2076c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:53.394145 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd590ce2-d953-4c15-b197-4199d3a2076c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:53.395845 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd590ce2-d953-4c15-b197-4199d3a2076c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:53.399551 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47b150-a2d9-47b8-9385-507b34634525 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:53.406528 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 62/121] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:04:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:53.407599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58633fbf-30e1-4f28-8197-9061072e3731 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:53.407893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58633fbf-30e1-4f28-8197-9061072e3731 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:53.408175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58633fbf-30e1-4f28-8197-9061072e3731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:53.436553 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22f0fe-8817-46f1-9106-d29398f7b94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:53.437488 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22f0fe-8817-46f1-9106-d29398f7b94d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:53.437977 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22f0fe-8817-46f1-9106-d29398f7b94d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:53.438392 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22f0fe-8817-46f1-9106-d29398f7b94d None admin] PATH_INFO: `/v3/projects/a5b903cafe374448928e686036261566` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:53.439885 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22f0fe-8817-46f1-9106-d29398f7b94d None admin] RBAC: Authorizing `identity:get_project(project_id=a5b903cafe374448928e686036261566)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:53.440437 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-58633fbf-30e1-4f28-8197-9061072e3731 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:53.441677 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-58633fbf-30e1-4f28-8197-9061072e3731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:53.442339 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22f0fe-8817-46f1-9106-d29398f7b94d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:53.444275 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 60/122] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:04:53 2022] GET /identity/v3/projects/a5b903cafe374448928e686036261566 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:53.445252 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22f0fe-8817-46f1-9106-d29398f7b94d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:53.519545 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 63/123] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:04:53.520232 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58633fbf-30e1-4f28-8197-9061072e3731 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:53.554518 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22f0fe-8817-46f1-9106-d29398f7b94d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:53.591834 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a044d-3089-4b37-b043-8a3465a6aab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:53.592743 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a044d-3089-4b37-b043-8a3465a6aab8 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:53.593196 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a044d-3089-4b37-b043-8a3465a6aab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:53.593655 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a044d-3089-4b37-b043-8a3465a6aab8 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:53.594593 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a044d-3089-4b37-b043-8a3465a6aab8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:53.595044 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a044d-3089-4b37-b043-8a3465a6aab8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:53.596607 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a044d-3089-4b37-b043-8a3465a6aab8 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:53.605988 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 61/124] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:04:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:53.607088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a044d-3089-4b37-b043-8a3465a6aab8 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:53.637115 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58633fbf-30e1-4f28-8197-9061072e3731 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:53.673275 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9728a9c-ad7b-4b3d-acab-72e791a19300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:53.674270 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9728a9c-ad7b-4b3d-acab-72e791a19300 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:53.674622 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9728a9c-ad7b-4b3d-acab-72e791a19300 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:53.674908 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9728a9c-ad7b-4b3d-acab-72e791a19300 None admin] PATH_INFO: `/v3/users/e919023b70fc4d738d1bb03b30464081` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:53.676230 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9728a9c-ad7b-4b3d-acab-72e791a19300 None admin] RBAC: Authorizing `identity:get_user(user_id=e919023b70fc4d738d1bb03b30464081)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:53.677734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9728a9c-ad7b-4b3d-acab-72e791a19300 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:53.684600 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 64/125] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:04:53 2022] GET /identity/v3/users/e919023b70fc4d738d1bb03b30464081 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:53.685504 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9728a9c-ad7b-4b3d-acab-72e791a19300 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:53.719940 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a044d-3089-4b37-b043-8a3465a6aab8 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:53.759775 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0db02-0905-4911-80b6-a690dde69078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:53.761075 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0db02-0905-4911-80b6-a690dde69078 None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:53.761654 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0db02-0905-4911-80b6-a690dde69078 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:53.762167 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0db02-0905-4911-80b6-a690dde69078 None admin] PATH_INFO: `/v3/projects/a5b903cafe374448928e686036261566/users/f27a0181336c474fa1a80c34325076d1/roles/3409f00ead9e455182684faa27b1f8f0` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:53.764786 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0db02-0905-4911-80b6-a690dde69078 None admin] RBAC: Authorizing `identity:create_grant(project_id=a5b903cafe374448928e686036261566, user_id=f27a0181336c474fa1a80c34325076d1, role_id=3409f00ead9e455182684faa27b1f8f0)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:53.766680 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0db02-0905-4911-80b6-a690dde69078 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:53.786051 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 62/126] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:04:53 2022] PUT /identity/v3/projects/a5b903cafe374448928e686036261566/users/f27a0181336c474fa1a80c34325076d1/roles/3409f00ead9e455182684faa27b1f8f0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:04:53.787301 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0db02-0905-4911-80b6-a690dde69078 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:53.833414 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9728a9c-ad7b-4b3d-acab-72e791a19300 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:53.909816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf13c8-36a0-4ea1-a731-cb7c843894e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:53.911083 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf13c8-36a0-4ea1-a731-cb7c843894e1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:53.912335 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf13c8-36a0-4ea1-a731-cb7c843894e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:53.913000 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf13c8-36a0-4ea1-a731-cb7c843894e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:53.936195 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf13c8-36a0-4ea1-a731-cb7c843894e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:53.947287 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-3bbf13c8-36a0-4ea1-a731-cb7c843894e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:04:53.947287 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:53.947287 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:53.947287 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:53.947287 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:53.947287 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:53.947287 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:53.947287 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:53.947287 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:53.947287 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:53.947287 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:53.947287 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:53.947287 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:53.947287 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:53.947287 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:53.947287 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:53.948832 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:53.948832 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:53.948832 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:53.948832 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:53.948832 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:53.948832 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:53.948832 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:53.948832 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:53.948832 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:53.948832 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:53.948832 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:53.948832 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:04:53.948832 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:53.948832 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:53.948832 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:53.948832 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:53.949635 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:53.949635 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:53.949635 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:53.949635 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:53.949635 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:53.949635 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:53.949635 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:53.949635 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:53.949635 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:53.949635 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:53.949635 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:04:53.949635 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:04:53.952639 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 65/127] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:04:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:53.953886 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf13c8-36a0-4ea1-a731-cb7c843894e1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:54.040163 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0db02-0905-4911-80b6-a690dde69078 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:54.083807 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf13c8-36a0-4ea1-a731-cb7c843894e1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:54.090329 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3183f-ef50-4345-b961-57501696c29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:54.091291 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3183f-ef50-4345-b961-57501696c29d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:54.091627 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3183f-ef50-4345-b961-57501696c29d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:54.091914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3183f-ef50-4345-b961-57501696c29d None admin] PATH_INFO: `/v3/users/cbf538e9a34a48d09586599cac4c7cc6` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:54.116354 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3183f-ef50-4345-b961-57501696c29d None admin] RBAC: Authorizing `identity:get_user(user_id=cbf538e9a34a48d09586599cac4c7cc6)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:54.118249 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3183f-ef50-4345-b961-57501696c29d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:54.121548 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 63/128] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:04:53 2022] GET /identity/v3/users/cbf538e9a34a48d09586599cac4c7cc6 => generated 289 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:54.122788 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3183f-ef50-4345-b961-57501696c29d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:54.134239 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834072d5-174d-4342-9866-59cd2f438a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:54.135248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834072d5-174d-4342-9866-59cd2f438a8d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:54.135729 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834072d5-174d-4342-9866-59cd2f438a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:54.136013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834072d5-174d-4342-9866-59cd2f438a8d None admin] PATH_INFO: `/v3/projects/a5b903cafe374448928e686036261566` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:54.137384 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834072d5-174d-4342-9866-59cd2f438a8d None admin] RBAC: Authorizing `identity:get_project(project_id=a5b903cafe374448928e686036261566)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:54.138922 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834072d5-174d-4342-9866-59cd2f438a8d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:54.140801 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 66/129] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:04:53 2022] GET /identity/v3/projects/a5b903cafe374448928e686036261566 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:54.141659 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834072d5-174d-4342-9866-59cd2f438a8d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:54.250571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834072d5-174d-4342-9866-59cd2f438a8d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:54.297778 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46420d57-927f-4f6f-ba5f-f9b31bf59281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:54.298335 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46420d57-927f-4f6f-ba5f-f9b31bf59281 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:54.298621 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46420d57-927f-4f6f-ba5f-f9b31bf59281 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:54.298898 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46420d57-927f-4f6f-ba5f-f9b31bf59281 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:54.343992 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3183f-ef50-4345-b961-57501696c29d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:54.394414 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa9ba9-7784-43bf-999d-400b835848cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:54.395597 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa9ba9-7784-43bf-999d-400b835848cd None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:54.396077 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa9ba9-7784-43bf-999d-400b835848cd None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:54.396368 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa9ba9-7784-43bf-999d-400b835848cd None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:54.397135 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa9ba9-7784-43bf-999d-400b835848cd None admin] RBAC: Adding query filter params (name=member) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:54.397478 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa9ba9-7784-43bf-999d-400b835848cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:54.398874 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa9ba9-7784-43bf-999d-400b835848cd None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:54.408507 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 64/130] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:04:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:54.414701 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa9ba9-7784-43bf-999d-400b835848cd None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:54.437196 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46420d57-927f-4f6f-ba5f-f9b31bf59281 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:54.438739 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46420d57-927f-4f6f-ba5f-f9b31bf59281 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:54.526625 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa9ba9-7784-43bf-999d-400b835848cd None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:54.564826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5c538-8943-4d76-b31c-7575a935390e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:54.566403 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5c538-8943-4d76-b31c-7575a935390e None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:54.566854 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5c538-8943-4d76-b31c-7575a935390e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:54.567275 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5c538-8943-4d76-b31c-7575a935390e None admin] PATH_INFO: `/v3/projects/a5b903cafe374448928e686036261566/users/e919023b70fc4d738d1bb03b30464081/roles/371a69f4478447a2b7170a3078173caa` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:54.569809 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5c538-8943-4d76-b31c-7575a935390e None admin] RBAC: Authorizing `identity:create_grant(project_id=a5b903cafe374448928e686036261566, user_id=e919023b70fc4d738d1bb03b30464081, role_id=371a69f4478447a2b7170a3078173caa)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:54.571432 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5c538-8943-4d76-b31c-7575a935390e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:54.592964 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 65/131] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:04:54 2022] PUT /identity/v3/projects/a5b903cafe374448928e686036261566/users/e919023b70fc4d738d1bb03b30464081/roles/371a69f4478447a2b7170a3078173caa => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:04:54.594072 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5c538-8943-4d76-b31c-7575a935390e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:54.622102 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 67/132] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:04:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:04:54.625270 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46420d57-927f-4f6f-ba5f-f9b31bf59281 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:54.767086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46420d57-927f-4f6f-ba5f-f9b31bf59281 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:54.797276 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5c538-8943-4d76-b31c-7575a935390e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:54.803920 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384081a-fc1a-483e-824f-d3282df5d783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:54.805197 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384081a-fc1a-483e-824f-d3282df5d783 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:54.805724 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384081a-fc1a-483e-824f-d3282df5d783 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:54.806214 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384081a-fc1a-483e-824f-d3282df5d783 None admin] PATH_INFO: `/v3/projects/a5b903cafe374448928e686036261566` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:54.808485 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384081a-fc1a-483e-824f-d3282df5d783 None admin] RBAC: Authorizing `identity:get_project(project_id=a5b903cafe374448928e686036261566)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:54.810339 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384081a-fc1a-483e-824f-d3282df5d783 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:54.812815 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 68/133] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:04:54 2022] GET /identity/v3/projects/a5b903cafe374448928e686036261566 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:54.839439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384081a-fc1a-483e-824f-d3282df5d783 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:54.867220 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3578b83-e8a9-4fc7-98f0-9b36f7e81abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:54.868445 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3578b83-e8a9-4fc7-98f0-9b36f7e81abf None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:54.868930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3578b83-e8a9-4fc7-98f0-9b36f7e81abf None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:54.870024 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3578b83-e8a9-4fc7-98f0-9b36f7e81abf None admin] PATH_INFO: `/v3/users/e919023b70fc4d738d1bb03b30464081` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:54.874458 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3578b83-e8a9-4fc7-98f0-9b36f7e81abf None admin] RBAC: Authorizing `identity:get_user(user_id=e919023b70fc4d738d1bb03b30464081)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:54.876157 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3578b83-e8a9-4fc7-98f0-9b36f7e81abf None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:54.878567 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 66/134] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:04:54 2022] GET /identity/v3/users/e919023b70fc4d738d1bb03b30464081 => generated 275 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:54.884587 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3578b83-e8a9-4fc7-98f0-9b36f7e81abf None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:54.975415 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384081a-fc1a-483e-824f-d3282df5d783 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:55.014177 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe614142-944a-47c1-b4d8-7f2f4a6641c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:55.014932 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe614142-944a-47c1-b4d8-7f2f4a6641c0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:55.015229 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe614142-944a-47c1-b4d8-7f2f4a6641c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:55.015530 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe614142-944a-47c1-b4d8-7f2f4a6641c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:55.016366 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe614142-944a-47c1-b4d8-7f2f4a6641c0 None admin] RBAC: Adding query filter params (role.id=7d122e00d0544c42b86e283fc846d179, scope.project.id=a5b903cafe374448928e686036261566, user.id=cbf538e9a34a48d09586599cac4c7cc6) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:55.016681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe614142-944a-47c1-b4d8-7f2f4a6641c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:55.018207 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe614142-944a-47c1-b4d8-7f2f4a6641c0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:55.024458 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 69/135] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:04:54 2022] GET /identity/v3/role_assignments?user.id=cbf538e9a34a48d09586599cac4c7cc6&scope.project.id=a5b903cafe374448928e686036261566&role.id=7d122e00d0544c42b86e283fc846d179 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:55.091087 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3578b83-e8a9-4fc7-98f0-9b36f7e81abf None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:55.150348 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82d44b-1932-4881-90d7-81bd65e57799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:55.152602 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82d44b-1932-4881-90d7-81bd65e57799 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:55.152895 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82d44b-1932-4881-90d7-81bd65e57799 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:55.153183 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82d44b-1932-4881-90d7-81bd65e57799 None admin] PATH_INFO: `/v3/projects/5c6fc4d17903433f8efec601a7b4b0a6` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:55.154700 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82d44b-1932-4881-90d7-81bd65e57799 None admin] RBAC: Authorizing `identity:get_project(project_id=5c6fc4d17903433f8efec601a7b4b0a6)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:55.156241 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82d44b-1932-4881-90d7-81bd65e57799 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:55.158498 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 67/136] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:04:54 2022] GET /identity/v3/projects/5c6fc4d17903433f8efec601a7b4b0a6 => generated 312 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:55.164500 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe614142-944a-47c1-b4d8-7f2f4a6641c0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:55.315669 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe614142-944a-47c1-b4d8-7f2f4a6641c0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:55.353173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a711c-7de7-4ee5-a205-34fb03288b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:55.354085 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a711c-7de7-4ee5-a205-34fb03288b89 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:55.354384 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a711c-7de7-4ee5-a205-34fb03288b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:55.354615 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a711c-7de7-4ee5-a205-34fb03288b89 None admin] PATH_INFO: `/v3/projects/5c6fc4d17903433f8efec601a7b4b0a6/users/e919023b70fc4d738d1bb03b30464081/roles/003cb0d66fec412dbbffb071206075d5` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:55.356670 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a711c-7de7-4ee5-a205-34fb03288b89 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c6fc4d17903433f8efec601a7b4b0a6, user_id=e919023b70fc4d738d1bb03b30464081, role_id=003cb0d66fec412dbbffb071206075d5)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:55.358166 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a711c-7de7-4ee5-a205-34fb03288b89 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:55.379414 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 70/137] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:04:55 2022] PUT /identity/v3/projects/5c6fc4d17903433f8efec601a7b4b0a6/users/e919023b70fc4d738d1bb03b30464081/roles/003cb0d66fec412dbbffb071206075d5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:04:55.465435 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667b871-3404-4a26-87ff-24fa0e21a5cd None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:55.465781 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667b871-3404-4a26-87ff-24fa0e21a5cd None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:55.466018 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667b871-3404-4a26-87ff-24fa0e21a5cd None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:55.467786 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 68/138] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:55.479844 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd733685-04ec-4272-987a-6d587c8c33ee None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:55.480181 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd733685-04ec-4272-987a-6d587c8c33ee None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:55.480446 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd733685-04ec-4272-987a-6d587c8c33ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:55.502694 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-cd733685-04ec-4272-987a-6d587c8c33ee None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:55.503973 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-cd733685-04ec-4272-987a-6d587c8c33ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:55.595616 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 71/139] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:04:55.630761 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667b871-3404-4a26-87ff-24fa0e21a5cd None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:55.755641 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667b871-3404-4a26-87ff-24fa0e21a5cd None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:55.797718 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ac18e-c7d2-46b3-9325-0fadba01cf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:55.798580 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ac18e-c7d2-46b3-9325-0fadba01cf09 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:55.798870 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ac18e-c7d2-46b3-9325-0fadba01cf09 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:55.799146 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ac18e-c7d2-46b3-9325-0fadba01cf09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:55.811237 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ac18e-c7d2-46b3-9325-0fadba01cf09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:55.819648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-c62ac18e-c7d2-46b3-9325-0fadba01cf09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:04:55.819648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:55.819648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:55.819648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:55.819648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:55.819648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:55.819648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:55.819648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:55.819648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:55.819648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:55.819648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:55.819648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:55.819648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:55.819648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:55.819648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:55.819648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:55.820557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:55.820557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:55.820557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:55.820557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:55.820557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:55.820557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:55.820557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:55.820557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:55.820557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:55.820557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:55.820557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:55.820557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:04:55.820557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:55.820557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:55.820557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:55.820557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:55.821531 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:55.821531 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:55.821531 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:55.821531 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:55.821531 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:55.821531 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:55.821531 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:55.821531 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:55.821531 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:55.821531 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:55.821531 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:04:55.821531 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:04:55.821531 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 69/140] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:04:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:55.827738 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd733685-04ec-4272-987a-6d587c8c33ee None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:55.951902 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd733685-04ec-4272-987a-6d587c8c33ee None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:55.991851 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4612514-f68d-4b7a-aa3e-950d83995766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:55.992606 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4612514-f68d-4b7a-aa3e-950d83995766 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:55.992907 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4612514-f68d-4b7a-aa3e-950d83995766 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:55.993185 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4612514-f68d-4b7a-aa3e-950d83995766 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:55.994336 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4612514-f68d-4b7a-aa3e-950d83995766 None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:55.995302 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4612514-f68d-4b7a-aa3e-950d83995766 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:55.998072 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4612514-f68d-4b7a-aa3e-950d83995766 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:56.011571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 72/141] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:04:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:56.016864 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ac18e-c7d2-46b3-9325-0fadba01cf09 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:56.151693 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ac18e-c7d2-46b3-9325-0fadba01cf09 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:56.192372 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f826f-9790-4ad7-8b48-4b5994eb922e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:56.193256 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f826f-9790-4ad7-8b48-4b5994eb922e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:56.193637 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f826f-9790-4ad7-8b48-4b5994eb922e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:56.193916 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f826f-9790-4ad7-8b48-4b5994eb922e None admin] PATH_INFO: `/v3/users/e919023b70fc4d738d1bb03b30464081` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:56.198676 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f826f-9790-4ad7-8b48-4b5994eb922e None admin] RBAC: Authorizing `identity:get_user(user_id=e919023b70fc4d738d1bb03b30464081)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:56.200156 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f826f-9790-4ad7-8b48-4b5994eb922e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:56.201885 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 70/142] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:04:56 2022] GET /identity/v3/users/e919023b70fc4d738d1bb03b30464081 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:56.207846 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4612514-f68d-4b7a-aa3e-950d83995766 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:56.320011 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4612514-f68d-4b7a-aa3e-950d83995766 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:56.361331 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18472cf9-36eb-44c3-b806-2debf76de21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:56.362293 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18472cf9-36eb-44c3-b806-2debf76de21a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:56.362740 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18472cf9-36eb-44c3-b806-2debf76de21a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:56.363023 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18472cf9-36eb-44c3-b806-2debf76de21a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:56.461383 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18472cf9-36eb-44c3-b806-2debf76de21a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:56.462800 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18472cf9-36eb-44c3-b806-2debf76de21a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:56.564702 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c2568-c579-4f92-90e3-7acc4379566c None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:56.565025 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c2568-c579-4f92-90e3-7acc4379566c None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:56.565271 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c2568-c579-4f92-90e3-7acc4379566c None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:56.566869 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 71/143] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:04:56.581919 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d702581-7b5a-411b-b1b1-bbe3cd47983e None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:56.582325 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d702581-7b5a-411b-b1b1-bbe3cd47983e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:56.582564 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d702581-7b5a-411b-b1b1-bbe3cd47983e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:56.608038 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-1d702581-7b5a-411b-b1b1-bbe3cd47983e None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:56.609243 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-1d702581-7b5a-411b-b1b1-bbe3cd47983e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:56.622717 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 73/144] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:04:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:04:56.628319 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18472cf9-36eb-44c3-b806-2debf76de21a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:56.746248 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 72/145] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:04:56.786914 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18472cf9-36eb-44c3-b806-2debf76de21a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:56.797662 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d702581-7b5a-411b-b1b1-bbe3cd47983e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:56.884211 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53604f3f-47f4-4f9c-a717-7d38721279b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:56.886300 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53604f3f-47f4-4f9c-a717-7d38721279b2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:56.886755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53604f3f-47f4-4f9c-a717-7d38721279b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:56.887169 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53604f3f-47f4-4f9c-a717-7d38721279b2 None admin] PATH_INFO: `/v3/projects/a5b903cafe374448928e686036261566` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:56.889855 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53604f3f-47f4-4f9c-a717-7d38721279b2 None admin] RBAC: Authorizing `identity:get_project(project_id=a5b903cafe374448928e686036261566)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:56.892278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53604f3f-47f4-4f9c-a717-7d38721279b2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:56.894434 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 74/146] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:04:56 2022] GET /identity/v3/projects/a5b903cafe374448928e686036261566 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:56.900189 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53604f3f-47f4-4f9c-a717-7d38721279b2 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:56.976511 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d702581-7b5a-411b-b1b1-bbe3cd47983e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:57.014971 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae281b5c-32bd-489e-8d99-99bed7634620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:57.016193 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae281b5c-32bd-489e-8d99-99bed7634620 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:57.016767 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae281b5c-32bd-489e-8d99-99bed7634620 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:57.017547 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae281b5c-32bd-489e-8d99-99bed7634620 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:57.019052 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae281b5c-32bd-489e-8d99-99bed7634620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:57.021066 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae281b5c-32bd-489e-8d99-99bed7634620 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:57.023561 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 73/147] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:04:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:57.030787 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae281b5c-32bd-489e-8d99-99bed7634620 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:57.109190 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53604f3f-47f4-4f9c-a717-7d38721279b2 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:57.175050 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e02df-58af-4f0e-a561-0078c553c66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:57.175716 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e02df-58af-4f0e-a561-0078c553c66b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:57.175999 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e02df-58af-4f0e-a561-0078c553c66b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:57.176285 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e02df-58af-4f0e-a561-0078c553c66b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:57.177133 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e02df-58af-4f0e-a561-0078c553c66b None admin] RBAC: Adding query filter params (role.id=003cb0d66fec412dbbffb071206075d5, scope.project.id=a5b903cafe374448928e686036261566, user.id=e919023b70fc4d738d1bb03b30464081) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:57.177470 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e02df-58af-4f0e-a561-0078c553c66b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:57.178921 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e02df-58af-4f0e-a561-0078c553c66b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:57.190588 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 75/148] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:04:56 2022] GET /identity/v3/role_assignments?user.id=e919023b70fc4d738d1bb03b30464081&scope.project.id=a5b903cafe374448928e686036261566&role.id=003cb0d66fec412dbbffb071206075d5 => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:57.191898 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595201b6-c60a-4f06-b03b-44eaced32a60 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:57.192188 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595201b6-c60a-4f06-b03b-44eaced32a60 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:57.192468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595201b6-c60a-4f06-b03b-44eaced32a60 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:57.193842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 76/149] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:57.202350 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92c29a-0ab0-4bc9-b08e-4106fe6c5b84 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:57.202634 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92c29a-0ab0-4bc9-b08e-4106fe6c5b84 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:57.202916 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92c29a-0ab0-4bc9-b08e-4106fe6c5b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:57.216044 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae281b5c-32bd-489e-8d99-99bed7634620 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:57.238452 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ac92c29a-0ab0-4bc9-b08e-4106fe6c5b84 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:57.239648 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ac92c29a-0ab0-4bc9-b08e-4106fe6c5b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:57.278898 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25006e6-7461-4a24-b881-168a03454922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:57.279508 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25006e6-7461-4a24-b881-168a03454922 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:57.279792 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25006e6-7461-4a24-b881-168a03454922 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:57.280067 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25006e6-7461-4a24-b881-168a03454922 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:57.280802 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25006e6-7461-4a24-b881-168a03454922 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:57.282913 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25006e6-7461-4a24-b881-168a03454922 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:57.315722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 74/150] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:04:57 2022] POST /identity/v3/users => generated 283 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:04:57.356115 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 77/151] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:04:57.398077 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25006e6-7461-4a24-b881-168a03454922 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:57.539792 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25006e6-7461-4a24-b881-168a03454922 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:57.582839 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd52c55-da54-4cf5-a4be-4fadd695d46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:57.583645 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd52c55-da54-4cf5-a4be-4fadd695d46f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:57.583931 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd52c55-da54-4cf5-a4be-4fadd695d46f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:57.584210 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd52c55-da54-4cf5-a4be-4fadd695d46f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:57.602582 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd52c55-da54-4cf5-a4be-4fadd695d46f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:57.611296 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-0dd52c55-da54-4cf5-a4be-4fadd695d46f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:57.611296 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:57.611296 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:57.611296 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:57.611296 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:57.611296 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:57.611296 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:57.611296 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:57.611296 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:57.611296 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:57.611296 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:57.611296 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:57.611296 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:57.611296 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:57.611296 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:57.611296 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:57.612160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:57.612160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:57.612160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:57.612160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:57.612160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:57.612160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:57.612160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:57.612160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:57.612160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:57.612160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:57.612160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:57.612160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:04:57.612160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:57.612160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:57.612160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:57.612160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:57.612938 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:57.612938 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:57.612938 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:57.612938 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:57.612938 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:57.612938 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:57.612938 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:57.612938 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:57.612938 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:57.612938 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:57.612938 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:04:57.612938 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:04:57.612938 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 75/152] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:04:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:57.620443 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92c29a-0ab0-4bc9-b08e-4106fe6c5b84 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:57.741702 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92c29a-0ab0-4bc9-b08e-4106fe6c5b84 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:57.777250 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad8513-633d-4467-80f4-8bcd28d96e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:57.778383 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad8513-633d-4467-80f4-8bcd28d96e58 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:57.778874 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad8513-633d-4467-80f4-8bcd28d96e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:57.779351 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad8513-633d-4467-80f4-8bcd28d96e58 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:57.780334 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad8513-633d-4467-80f4-8bcd28d96e58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:57.780861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad8513-633d-4467-80f4-8bcd28d96e58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:57.782476 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad8513-633d-4467-80f4-8bcd28d96e58 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:57.791366 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 78/153] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:04:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:57.796685 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd52c55-da54-4cf5-a4be-4fadd695d46f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:57.907439 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd52c55-da54-4cf5-a4be-4fadd695d46f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:57.944860 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0930e-bcbc-4128-9f02-4f3fa28a0ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:57.946359 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0930e-bcbc-4128-9f02-4f3fa28a0ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:57.946869 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0930e-bcbc-4128-9f02-4f3fa28a0ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:57.947980 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0930e-bcbc-4128-9f02-4f3fa28a0ef1 None admin] PATH_INFO: `/v3/users/f27a0181336c474fa1a80c34325076d1` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:57.949990 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0930e-bcbc-4128-9f02-4f3fa28a0ef1 None admin] RBAC: Authorizing `identity:get_user(user_id=f27a0181336c474fa1a80c34325076d1)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:57.951760 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0930e-bcbc-4128-9f02-4f3fa28a0ef1 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:57.953869 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 76/154] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:04:57 2022] GET /identity/v3/users/f27a0181336c474fa1a80c34325076d1 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:57.962096 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad8513-633d-4467-80f4-8bcd28d96e58 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:58.071790 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad8513-633d-4467-80f4-8bcd28d96e58 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:58.107445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c4a80-9c47-4b1c-8724-fa7bd3f7ae34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:58.108497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c4a80-9c47-4b1c-8724-fa7bd3f7ae34 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:58.108987 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c4a80-9c47-4b1c-8724-fa7bd3f7ae34 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:58.109775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c4a80-9c47-4b1c-8724-fa7bd3f7ae34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:58.161617 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679b16c-e43c-431e-a11c-4d6287edf5fc None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:58.162689 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679b16c-e43c-431e-a11c-4d6287edf5fc None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:58.163463 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679b16c-e43c-431e-a11c-4d6287edf5fc None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:58.165277 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 77/155] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:04:58.177121 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929ac2f-75c5-403b-b111-497cfe8e35af None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:58.177753 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929ac2f-75c5-403b-b111-497cfe8e35af None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:58.178400 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929ac2f-75c5-403b-b111-497cfe8e35af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:58.190940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c4a80-9c47-4b1c-8724-fa7bd3f7ae34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:58.192512 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c4a80-9c47-4b1c-8724-fa7bd3f7ae34 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:58.203648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-3929ac2f-75c5-403b-b111-497cfe8e35af None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:58.204862 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-3929ac2f-75c5-403b-b111-497cfe8e35af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:58.303855 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 78/156] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:04:58.326935 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 79/157] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:04:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:04:58.332779 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929ac2f-75c5-403b-b111-497cfe8e35af None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:58.355799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c4a80-9c47-4b1c-8724-fa7bd3f7ae34 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:58.447998 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929ac2f-75c5-403b-b111-497cfe8e35af None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:58.491501 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df358c6-55da-4d09-88b0-760021012a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:58.492887 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df358c6-55da-4d09-88b0-760021012a0e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:58.493397 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df358c6-55da-4d09-88b0-760021012a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:58.493875 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df358c6-55da-4d09-88b0-760021012a0e None admin] PATH_INFO: `/v3/projects/a5b903cafe374448928e686036261566` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:58.497391 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df358c6-55da-4d09-88b0-760021012a0e None admin] RBAC: Authorizing `identity:get_project(project_id=a5b903cafe374448928e686036261566)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:58.499195 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df358c6-55da-4d09-88b0-760021012a0e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:58.504595 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 79/158] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:04:58 2022] GET /identity/v3/projects/a5b903cafe374448928e686036261566 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:58.512465 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df358c6-55da-4d09-88b0-760021012a0e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:58.540201 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c4a80-9c47-4b1c-8724-fa7bd3f7ae34 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:58.616654 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddd178-4daf-44ce-b57b-8c209e1953f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:58.617886 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddd178-4daf-44ce-b57b-8c209e1953f3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:58.618369 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddd178-4daf-44ce-b57b-8c209e1953f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:58.618836 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddd178-4daf-44ce-b57b-8c209e1953f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:58.640502 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddd178-4daf-44ce-b57b-8c209e1953f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:58.652461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-7dddd178-4daf-44ce-b57b-8c209e1953f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:04:58.652461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:58.652461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:58.652461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:58.652461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:58.652461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:58.652461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:58.652461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:58.652461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:58.652461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:58.652461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:58.652461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:58.652461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:58.652461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:58.652461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:58.652461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:58.653359 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:58.653359 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:58.653359 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:58.653359 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:58.653359 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:58.653359 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:58.653359 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:58.653359 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:58.653359 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:58.653359 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:58.653359 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:58.653359 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:04:58.653359 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:58.653359 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:58.653359 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:58.653359 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:58.654159 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:58.654159 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:58.654159 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:58.654159 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:58.654159 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:58.654159 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:58.654159 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:58.654159 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:58.654159 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:58.654159 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:58.654159 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:04:58.654159 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:04:58.669068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 80/159] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:04:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:58.677684 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddd178-4daf-44ce-b57b-8c209e1953f3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:58.707225 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df358c6-55da-4d09-88b0-760021012a0e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:58.752102 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb23e86-89a9-49d1-9e84-8aab94852791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:58.752771 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb23e86-89a9-49d1-9e84-8aab94852791 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:58.753051 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb23e86-89a9-49d1-9e84-8aab94852791 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:58.753322 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb23e86-89a9-49d1-9e84-8aab94852791 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:58.754212 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb23e86-89a9-49d1-9e84-8aab94852791 None admin] RBAC: Adding query filter params (role.id=3409f00ead9e455182684faa27b1f8f0, scope.project.id=a5b903cafe374448928e686036261566, user.id=f27a0181336c474fa1a80c34325076d1) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:58.754528 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb23e86-89a9-49d1-9e84-8aab94852791 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:58.756131 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb23e86-89a9-49d1-9e84-8aab94852791 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:58.764398 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 80/160] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:04:58 2022] GET /identity/v3/role_assignments?user.id=f27a0181336c474fa1a80c34325076d1&scope.project.id=a5b903cafe374448928e686036261566&role.id=3409f00ead9e455182684faa27b1f8f0 => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:58.765333 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e529e7a-e9ba-48dc-add8-6e3e7e70723f None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:58.765684 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e529e7a-e9ba-48dc-add8-6e3e7e70723f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:58.765966 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e529e7a-e9ba-48dc-add8-6e3e7e70723f None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:58.767256 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 81/161] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:58.768547 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce84fd-b487-43cf-a2fc-7c0fabd23a6b None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:58.768838 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce84fd-b487-43cf-a2fc-7c0fabd23a6b None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:58.769114 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce84fd-b487-43cf-a2fc-7c0fabd23a6b None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:58.770934 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 82/162] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:04:58.778516 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2847e-6e7b-4993-bdd0-e01e7129ad7d None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:58.779248 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2847e-6e7b-4993-bdd0-e01e7129ad7d None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:58.779735 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2847e-6e7b-4993-bdd0-e01e7129ad7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:58.807522 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddd178-4daf-44ce-b57b-8c209e1953f3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:58.809044 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-29d2847e-6e7b-4993-bdd0-e01e7129ad7d None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:58.810934 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-29d2847e-6e7b-4993-bdd0-e01e7129ad7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:58.849963 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf18fbd-0687-4aae-9f32-2deeeadfb87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:58.850649 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf18fbd-0687-4aae-9f32-2deeeadfb87e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:58.850934 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf18fbd-0687-4aae-9f32-2deeeadfb87e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:58.851209 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf18fbd-0687-4aae-9f32-2deeeadfb87e None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:58.851999 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf18fbd-0687-4aae-9f32-2deeeadfb87e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:58.852306 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf18fbd-0687-4aae-9f32-2deeeadfb87e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:58.855337 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf18fbd-0687-4aae-9f32-2deeeadfb87e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:58.869871 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 81/163] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:04:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:04:58.871498 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b3330-1b11-4e90-af06-45b33171c721 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:58.871788 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b3330-1b11-4e90-af06-45b33171c721 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:58.872072 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b3330-1b11-4e90-af06-45b33171c721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:58.893637 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-cb6b3330-1b11-4e90-af06-45b33171c721 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:04:58.894862 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-cb6b3330-1b11-4e90-af06-45b33171c721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:04:58.905792 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 83/164] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:04:58.907043 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2847e-6e7b-4993-bdd0-e01e7129ad7d None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:58.973328 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 82/165] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:04:58.975065 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b3330-1b11-4e90-af06-45b33171c721 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:59.053099 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2847e-6e7b-4993-bdd0-e01e7129ad7d None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:59.084046 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b3330-1b11-4e90-af06-45b33171c721 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:59.127098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d2121-fbb9-4bc8-a6c6-d88e1d6a2b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:59.127278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4946c-e8db-41d8-a04b-2b14a65010ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:59.127917 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d2121-fbb9-4bc8-a6c6-d88e1d6a2b84 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:59.128199 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d2121-fbb9-4bc8-a6c6-d88e1d6a2b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:59.128476 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d2121-fbb9-4bc8-a6c6-d88e1d6a2b84 None admin] PATH_INFO: `/v3/users/e919023b70fc4d738d1bb03b30464081` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:59.129008 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4946c-e8db-41d8-a04b-2b14a65010ed None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:59.129603 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4946c-e8db-41d8-a04b-2b14a65010ed None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:59.130138 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4946c-e8db-41d8-a04b-2b14a65010ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:59.130738 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d2121-fbb9-4bc8-a6c6-d88e1d6a2b84 None admin] RBAC: Authorizing `identity:get_user(user_id=e919023b70fc4d738d1bb03b30464081)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:59.132305 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d2121-fbb9-4bc8-a6c6-d88e1d6a2b84 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:59.141402 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 84/166] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:04:58 2022] GET /identity/v3/users/e919023b70fc4d738d1bb03b30464081 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:59.141402 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d2121-fbb9-4bc8-a6c6-d88e1d6a2b84 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:59.150285 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4946c-e8db-41d8-a04b-2b14a65010ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:59.158374 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-59b4946c-e8db-41d8-a04b-2b14a65010ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:04:59.158374 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:59.158374 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:59.158374 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:59.158374 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:59.158374 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:59.158374 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:59.158374 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:59.158374 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:59.158374 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:59.158374 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:59.158374 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:59.158374 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:59.158374 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:59.158374 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:59.158374 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:59.159341 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:59.159341 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:59.159341 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:59.159341 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:59.159341 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:59.159341 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:59.159341 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:59.159341 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:59.159341 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:59.159341 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:59.159341 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:59.159341 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:04:59.159341 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:59.159341 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:59.159341 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:59.159341 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:59.160291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:59.160291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:59.160291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:59.160291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:59.160291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:59.160291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:59.160291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:59.160291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:59.160291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:59.160291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:59.160291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:04:59.160291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:04:59.162419 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 83/167] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:04:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:59.163360 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4946c-e8db-41d8-a04b-2b14a65010ed None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:59.293491 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d2121-fbb9-4bc8-a6c6-d88e1d6a2b84 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:59.348268 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64751fd4-539b-4db4-b098-4a92d09eee69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:59.349078 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64751fd4-539b-4db4-b098-4a92d09eee69 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:59.349357 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64751fd4-539b-4db4-b098-4a92d09eee69 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:59.349656 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64751fd4-539b-4db4-b098-4a92d09eee69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:59.373229 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64751fd4-539b-4db4-b098-4a92d09eee69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:04:59.381796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-64751fd4-539b-4db4-b098-4a92d09eee69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:04:59.381796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:04:59.381796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:04:59.381796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:04:59.381796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:04:59.381796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:04:59.381796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:04:59.381796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:04:59.381796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:04:59.381796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:04:59.381796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:04:59.381796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:04:59.381796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:04:59.381796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:04:59.381796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:04:59.381796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:04:59.382727 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:04:59.382727 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:04:59.382727 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:04:59.382727 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:04:59.382727 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:04:59.382727 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:04:59.382727 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:04:59.382727 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:04:59.382727 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:04:59.382727 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:04:59.382727 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:04:59.382727 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:04:59.382727 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:04:59.382727 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:04:59.382727 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:04:59.382727 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:04:59.383535 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:04:59.383535 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:04:59.383535 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:04:59.383535 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:04:59.383535 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:04:59.383535 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:04:59.383535 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:04:59.383535 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:04:59.383535 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:04:59.383535 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:04:59.383535 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:04:59.383535 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:04:59.388346 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4946c-e8db-41d8-a04b-2b14a65010ed None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:59.388481 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 85/168] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:04:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:04:59.389277 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64751fd4-539b-4db4-b098-4a92d09eee69 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:59.462660 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548acdf-4054-44ee-aed3-d9336683576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:59.463636 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548acdf-4054-44ee-aed3-d9336683576a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:59.464084 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548acdf-4054-44ee-aed3-d9336683576a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:59.464370 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548acdf-4054-44ee-aed3-d9336683576a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:59.586931 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64751fd4-539b-4db4-b098-4a92d09eee69 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:59.594651 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548acdf-4054-44ee-aed3-d9336683576a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:59.596200 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548acdf-4054-44ee-aed3-d9336683576a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:59.655087 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22627c74-3446-4aee-aa11-53b9cb838030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:59.655685 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22627c74-3446-4aee-aa11-53b9cb838030 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:59.655969 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22627c74-3446-4aee-aa11-53b9cb838030 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:59.656246 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22627c74-3446-4aee-aa11-53b9cb838030 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:59.656997 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22627c74-3446-4aee-aa11-53b9cb838030 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:59.657304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22627c74-3446-4aee-aa11-53b9cb838030 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:59.658698 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22627c74-3446-4aee-aa11-53b9cb838030 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:59.676957 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 86/169] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:04:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:59.677616 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22627c74-3446-4aee-aa11-53b9cb838030 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:59.700116 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 84/170] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:04:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:04:59.700772 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548acdf-4054-44ee-aed3-d9336683576a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:59.797191 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22627c74-3446-4aee-aa11-53b9cb838030 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:59.802179 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548acdf-4054-44ee-aed3-d9336683576a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:04:59.841195 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a63a3-a9c0-4bb3-bb2d-bf5ca43e8561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:59.845430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a63a3-a9c0-4bb3-bb2d-bf5ca43e8561 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:59.845430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a63a3-a9c0-4bb3-bb2d-bf5ca43e8561 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:59.845430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a63a3-a9c0-4bb3-bb2d-bf5ca43e8561 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:59.845430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a63a3-a9c0-4bb3-bb2d-bf5ca43e8561 None admin] RBAC: Adding query filter params (name=member) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:04:59.845430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a63a3-a9c0-4bb3-bb2d-bf5ca43e8561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:59.845430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a63a3-a9c0-4bb3-bb2d-bf5ca43e8561 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:59.846246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd529d6b-12c1-4791-b23b-a954749ef39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:04:59.847084 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd529d6b-12c1-4791-b23b-a954749ef39a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:04:59.847360 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd529d6b-12c1-4791-b23b-a954749ef39a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:04:59.847706 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd529d6b-12c1-4791-b23b-a954749ef39a None admin] PATH_INFO: `/v3/users/cbf538e9a34a48d09586599cac4c7cc6` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:04:59.850461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd529d6b-12c1-4791-b23b-a954749ef39a None admin] RBAC: Authorizing `identity:get_user(user_id=cbf538e9a34a48d09586599cac4c7cc6)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:04:59.852042 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd529d6b-12c1-4791-b23b-a954749ef39a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:04:59.854396 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 85/171] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:04:59 2022] GET /identity/v3/users/cbf538e9a34a48d09586599cac4c7cc6 => generated 289 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:59.855241 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd529d6b-12c1-4791-b23b-a954749ef39a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:04:59.874013 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 87/172] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:04:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:04:59.875100 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a63a3-a9c0-4bb3-bb2d-bf5ca43e8561 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:00.010778 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd529d6b-12c1-4791-b23b-a954749ef39a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:00.058846 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf652856-7fc8-4d3b-b706-7c18af92c0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:00.059722 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf652856-7fc8-4d3b-b706-7c18af92c0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:00.060008 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf652856-7fc8-4d3b-b706-7c18af92c0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:00.060286 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf652856-7fc8-4d3b-b706-7c18af92c0e8 None admin] PATH_INFO: `/v3/projects/a5b903cafe374448928e686036261566` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:00.065249 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf652856-7fc8-4d3b-b706-7c18af92c0e8 None admin] RBAC: Authorizing `identity:get_project(project_id=a5b903cafe374448928e686036261566)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:00.066767 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf652856-7fc8-4d3b-b706-7c18af92c0e8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:00.067822 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a63a3-a9c0-4bb3-bb2d-bf5ca43e8561 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:00.068493 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 86/173] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:04:59 2022] GET /identity/v3/projects/a5b903cafe374448928e686036261566 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:00.069266 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf652856-7fc8-4d3b-b706-7c18af92c0e8 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:00.121408 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825a723-ef0a-4e68-8b6f-65ef5c349d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:00.121408 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825a723-ef0a-4e68-8b6f-65ef5c349d05 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:00.121408 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825a723-ef0a-4e68-8b6f-65ef5c349d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:00.121783 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825a723-ef0a-4e68-8b6f-65ef5c349d05 None admin] PATH_INFO: `/v3/projects/a5b903cafe374448928e686036261566` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:00.123604 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825a723-ef0a-4e68-8b6f-65ef5c349d05 None admin] RBAC: Authorizing `identity:get_project(project_id=a5b903cafe374448928e686036261566)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:00.126255 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825a723-ef0a-4e68-8b6f-65ef5c349d05 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:00.130774 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 88/174] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:04:59 2022] GET /identity/v3/projects/a5b903cafe374448928e686036261566 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:00.135856 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825a723-ef0a-4e68-8b6f-65ef5c349d05 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:00.224330 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf652856-7fc8-4d3b-b706-7c18af92c0e8 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:00.259377 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c3d73-c16b-4d48-a229-7a2150bf6ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:00.260356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c3d73-c16b-4d48-a229-7a2150bf6ebe None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:00.260639 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c3d73-c16b-4d48-a229-7a2150bf6ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:00.260967 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c3d73-c16b-4d48-a229-7a2150bf6ebe None admin] PATH_INFO: `/v3/users/e919023b70fc4d738d1bb03b30464081` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:00.262185 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c3d73-c16b-4d48-a229-7a2150bf6ebe None admin] RBAC: Authorizing `identity:get_user(user_id=e919023b70fc4d738d1bb03b30464081)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:00.263670 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c3d73-c16b-4d48-a229-7a2150bf6ebe None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:00.265872 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 87/175] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:05:00 2022] GET /identity/v3/users/e919023b70fc4d738d1bb03b30464081 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:00.270808 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c3d73-c16b-4d48-a229-7a2150bf6ebe None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:00.371269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c3d73-c16b-4d48-a229-7a2150bf6ebe None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:00.399335 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825a723-ef0a-4e68-8b6f-65ef5c349d05 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:00.406011 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff15749-7f72-4dc2-8d8e-a50198cb90a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:00.406905 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff15749-7f72-4dc2-8d8e-a50198cb90a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:00.407182 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff15749-7f72-4dc2-8d8e-a50198cb90a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:00.407454 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff15749-7f72-4dc2-8d8e-a50198cb90a8 None admin] PATH_INFO: `/v3/projects/a5b903cafe374448928e686036261566/users/cbf538e9a34a48d09586599cac4c7cc6/roles/7d122e00d0544c42b86e283fc846d179` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:00.413396 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff15749-7f72-4dc2-8d8e-a50198cb90a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a5b903cafe374448928e686036261566, user_id=cbf538e9a34a48d09586599cac4c7cc6, role_id=7d122e00d0544c42b86e283fc846d179)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:00.413396 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff15749-7f72-4dc2-8d8e-a50198cb90a8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:00.433417 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 88/176] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:05:00 2022] PUT /identity/v3/projects/a5b903cafe374448928e686036261566/users/cbf538e9a34a48d09586599cac4c7cc6/roles/7d122e00d0544c42b86e283fc846d179 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:05:00.433417 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff15749-7f72-4dc2-8d8e-a50198cb90a8 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:00.482202 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c5f71-d349-4edf-a2f6-76d3fc6ef19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:00.482905 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c5f71-d349-4edf-a2f6-76d3fc6ef19d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:00.483192 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c5f71-d349-4edf-a2f6-76d3fc6ef19d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:00.483470 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c5f71-d349-4edf-a2f6-76d3fc6ef19d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:00.484651 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c5f71-d349-4edf-a2f6-76d3fc6ef19d None admin] RBAC: Adding query filter params (role.id=371a69f4478447a2b7170a3078173caa, scope.project.id=a5b903cafe374448928e686036261566, user.id=e919023b70fc4d738d1bb03b30464081) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:00.485021 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c5f71-d349-4edf-a2f6-76d3fc6ef19d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:00.486663 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c5f71-d349-4edf-a2f6-76d3fc6ef19d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:00.502309 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 89/177] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:05:00 2022] GET /identity/v3/role_assignments?user.id=e919023b70fc4d738d1bb03b30464081&scope.project.id=a5b903cafe374448928e686036261566&role.id=371a69f4478447a2b7170a3078173caa => generated 608 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:00.550401 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff15749-7f72-4dc2-8d8e-a50198cb90a8 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:00.590485 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773180b-2ee4-4f2a-9426-37f903c10317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:00.591151 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773180b-2ee4-4f2a-9426-37f903c10317 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:00.591477 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773180b-2ee4-4f2a-9426-37f903c10317 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:00.591761 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773180b-2ee4-4f2a-9426-37f903c10317 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:00.670339 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773180b-2ee4-4f2a-9426-37f903c10317 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:00.671908 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773180b-2ee4-4f2a-9426-37f903c10317 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:00.782965 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 89/178] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:05:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:05:00.790642 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c5f71-d349-4edf-a2f6-76d3fc6ef19d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:00.913490 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c5f71-d349-4edf-a2f6-76d3fc6ef19d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:00.949616 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f946f-a45f-40de-a74b-5edd29c99a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:00.950493 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f946f-a45f-40de-a74b-5edd29c99a20 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:00.950777 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f946f-a45f-40de-a74b-5edd29c99a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:00.951056 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f946f-a45f-40de-a74b-5edd29c99a20 None admin] PATH_INFO: `/v3/projects/5c6fc4d17903433f8efec601a7b4b0a6` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:00.952299 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f946f-a45f-40de-a74b-5edd29c99a20 None admin] RBAC: Authorizing `identity:get_project(project_id=5c6fc4d17903433f8efec601a7b4b0a6)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:00.953847 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f946f-a45f-40de-a74b-5edd29c99a20 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:00.955604 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 90/179] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:00 2022] GET /identity/v3/projects/5c6fc4d17903433f8efec601a7b4b0a6 => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:00.961534 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773180b-2ee4-4f2a-9426-37f903c10317 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:01.071427 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773180b-2ee4-4f2a-9426-37f903c10317 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:01.106949 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfa482-039c-48bb-b11f-2d92c9583159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:01.107686 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfa482-039c-48bb-b11f-2d92c9583159 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:01.107969 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfa482-039c-48bb-b11f-2d92c9583159 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:01.108294 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfa482-039c-48bb-b11f-2d92c9583159 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:01.109149 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfa482-039c-48bb-b11f-2d92c9583159 None admin] RBAC: Adding query filter params (role.id=003cb0d66fec412dbbffb071206075d5, scope.project.id=5c6fc4d17903433f8efec601a7b4b0a6, user.id=e919023b70fc4d738d1bb03b30464081) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:01.109741 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfa482-039c-48bb-b11f-2d92c9583159 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:01.111189 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfa482-039c-48bb-b11f-2d92c9583159 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:01.117860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 90/180] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:05:00 2022] GET /identity/v3/role_assignments?user.id=e919023b70fc4d738d1bb03b30464081&scope.project.id=5c6fc4d17903433f8efec601a7b4b0a6&role.id=003cb0d66fec412dbbffb071206075d5 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:01.227885 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f27b78-8815-4fe4-831b-f76d59ec6c03 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:01.228238 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f27b78-8815-4fe4-831b-f76d59ec6c03 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:01.228957 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f27b78-8815-4fe4-831b-f76d59ec6c03 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:01.230720 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 91/181] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:01.236457 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff2604-03e7-4845-a606-a0901ace7a80 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:01.236743 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff2604-03e7-4845-a606-a0901ace7a80 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:01.237008 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff2604-03e7-4845-a606-a0901ace7a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:01.257888 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-2bff2604-03e7-4845-a606-a0901ace7a80 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:01.259107 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2bff2604-03e7-4845-a606-a0901ace7a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:01.342608 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 91/182] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:01.371231 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f27b78-8815-4fe4-831b-f76d59ec6c03 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:01.493460 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f27b78-8815-4fe4-831b-f76d59ec6c03 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:01.531793 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3de19a-b508-41b4-89cf-21bfd7f25460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:01.532600 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3de19a-b508-41b4-89cf-21bfd7f25460 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:01.532889 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3de19a-b508-41b4-89cf-21bfd7f25460 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:01.533171 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3de19a-b508-41b4-89cf-21bfd7f25460 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:01.545064 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3de19a-b508-41b4-89cf-21bfd7f25460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:01.553221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-da3de19a-b508-41b4-89cf-21bfd7f25460 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:05:01.553221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:01.553221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:01.553221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:01.553221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:01.553221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:01.553221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:01.553221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:01.553221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:01.553221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:01.553221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:01.553221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:01.553221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:01.553221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:01.553221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:01.553221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:01.554216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:01.554216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:01.554216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:01.554216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:01.554216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:01.554216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:01.554216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:01.554216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:01.554216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:01.554216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:01.554216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:01.554216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:01.554216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:01.554216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:01.554216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:01.554216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:01.555014 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:01.555014 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:01.555014 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:01.555014 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:01.555014 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:01.555014 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:01.555014 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:01.555014 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:01.555014 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:01.555014 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:01.555014 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:05:01.555014 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:01.555014 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 92/183] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:05:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:01.561407 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff2604-03e7-4845-a606-a0901ace7a80 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:01.565624 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fa275-9276-4583-a381-9b4bd73aeae1 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:01.566143 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fa275-9276-4583-a381-9b4bd73aeae1 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:01.566593 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fa275-9276-4583-a381-9b4bd73aeae1 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:01.568152 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 93/184] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:05:01.576114 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bef67b-a4ba-4e03-965d-0cbdc8575c0e None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:01.576654 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bef67b-a4ba-4e03-965d-0cbdc8575c0e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:01.577099 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bef67b-a4ba-4e03-965d-0cbdc8575c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:01.594447 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-56bef67b-a4ba-4e03-965d-0cbdc8575c0e None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:01.595903 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-56bef67b-a4ba-4e03-965d-0cbdc8575c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:01.664843 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 94/185] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:01.689657 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff2604-03e7-4845-a606-a0901ace7a80 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:01.690129 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bef67b-a4ba-4e03-965d-0cbdc8575c0e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:01.738038 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e962685-e84c-4713-9fb7-8f66f3425518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:01.739024 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e962685-e84c-4713-9fb7-8f66f3425518 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:01.739506 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e962685-e84c-4713-9fb7-8f66f3425518 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:01.739954 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e962685-e84c-4713-9fb7-8f66f3425518 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:01.740879 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e962685-e84c-4713-9fb7-8f66f3425518 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:01.741358 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e962685-e84c-4713-9fb7-8f66f3425518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:01.742931 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e962685-e84c-4713-9fb7-8f66f3425518 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:01.751961 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 92/186] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:01.757815 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e962685-e84c-4713-9fb7-8f66f3425518 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:01.800339 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bef67b-a4ba-4e03-965d-0cbdc8575c0e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:01.837406 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236f310-6ee9-4d56-958f-24483e1078be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:01.838545 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236f310-6ee9-4d56-958f-24483e1078be None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:01.839029 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236f310-6ee9-4d56-958f-24483e1078be None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:01.839471 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236f310-6ee9-4d56-958f-24483e1078be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:01.850421 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236f310-6ee9-4d56-958f-24483e1078be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:01.858909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e962685-e84c-4713-9fb7-8f66f3425518 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:01.859187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-2236f310-6ee9-4d56-958f-24483e1078be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:05:01.859187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:01.859187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:01.859187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:01.859187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:01.859187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:01.859187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:01.859187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:01.859187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:01.859187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:01.859187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:01.859187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:01.859187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:01.859187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:01.859187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:01.859187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:01.860304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:01.860304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:01.860304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:01.860304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:01.860304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:01.860304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:01.860304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:01.860304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:01.860304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:01.860304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:01.860304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:01.860304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:01.860304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:01.860304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:01.860304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:01.860304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:01.861102 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:01.861102 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:01.861102 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:01.861102 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:01.861102 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:01.861102 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:01.861102 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:01.861102 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:01.861102 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:01.861102 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:01.861102 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:05:01.861102 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:01.864051 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 95/187] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:05:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:01.865563 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec079388-8f74-46ff-b293-25b8651c359b None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:01.866023 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec079388-8f74-46ff-b293-25b8651c359b None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:01.866467 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec079388-8f74-46ff-b293-25b8651c359b None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:01.868230 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 96/188] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:01.872343 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec079388-8f74-46ff-b293-25b8651c359b None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:01.893719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65682a-bf5d-4c15-82d4-f716633128f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:01.894592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65682a-bf5d-4c15-82d4-f716633128f7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:01.894875 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65682a-bf5d-4c15-82d4-f716633128f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:01.895146 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65682a-bf5d-4c15-82d4-f716633128f7 None admin] PATH_INFO: `/v3/users/f7d3be15542c4f4eb1c32c52c0a3ca15` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:01.909140 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65682a-bf5d-4c15-82d4-f716633128f7 None admin] RBAC: Authorizing `identity:get_user(user_id=f7d3be15542c4f4eb1c32c52c0a3ca15)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:01.910641 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65682a-bf5d-4c15-82d4-f716633128f7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:01.912341 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 93/189] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:05:01 2022] GET /identity/v3/users/f7d3be15542c4f4eb1c32c52c0a3ca15 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:01.914787 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42718b7-3fd5-4945-a352-5660a38e438d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:01.915077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42718b7-3fd5-4945-a352-5660a38e438d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:01.915357 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42718b7-3fd5-4945-a352-5660a38e438d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:01.934062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f42718b7-3fd5-4945-a352-5660a38e438d None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:01.935244 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f42718b7-3fd5-4945-a352-5660a38e438d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:01.979751 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec079388-8f74-46ff-b293-25b8651c359b None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:02.001316 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 94/190] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:02.002590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42718b7-3fd5-4945-a352-5660a38e438d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:02.021225 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a664a-52d8-4e7b-a4ff-f2e17c85afb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:02.021952 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a664a-52d8-4e7b-a4ff-f2e17c85afb6 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:02.022238 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a664a-52d8-4e7b-a4ff-f2e17c85afb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:02.022566 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a664a-52d8-4e7b-a4ff-f2e17c85afb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:02.023450 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a664a-52d8-4e7b-a4ff-f2e17c85afb6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:02.023763 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a664a-52d8-4e7b-a4ff-f2e17c85afb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:02.026033 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a664a-52d8-4e7b-a4ff-f2e17c85afb6 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:02.035138 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 97/191] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:05:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:02.036014 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a664a-52d8-4e7b-a4ff-f2e17c85afb6 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:02.121698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42718b7-3fd5-4945-a352-5660a38e438d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:02.148028 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a664a-52d8-4e7b-a4ff-f2e17c85afb6 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:02.161160 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d74637-342c-491c-944c-58635967f1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:02.162146 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d74637-342c-491c-944c-58635967f1eb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:02.162146 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d74637-342c-491c-944c-58635967f1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:02.163665 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d74637-342c-491c-944c-58635967f1eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:02.188545 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc3bc7-3e69-4f87-9b57-11ae18473d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:02.189356 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc3bc7-3e69-4f87-9b57-11ae18473d6d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:02.189791 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc3bc7-3e69-4f87-9b57-11ae18473d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:02.190082 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc3bc7-3e69-4f87-9b57-11ae18473d6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:02.191321 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc3bc7-3e69-4f87-9b57-11ae18473d6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:02.192844 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc3bc7-3e69-4f87-9b57-11ae18473d6d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:02.201658 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 98/192] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:02.201658 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc3bc7-3e69-4f87-9b57-11ae18473d6d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:02.249417 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d74637-342c-491c-944c-58635967f1eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:02.250822 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d74637-342c-491c-944c-58635967f1eb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:02.314316 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc3bc7-3e69-4f87-9b57-11ae18473d6d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:02.349021 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b1d78-03a8-4496-a5d6-de7a4e9a7a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:02.350372 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b1d78-03a8-4496-a5d6-de7a4e9a7a4e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:02.350857 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b1d78-03a8-4496-a5d6-de7a4e9a7a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:02.351340 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b1d78-03a8-4496-a5d6-de7a4e9a7a4e None admin] PATH_INFO: `/v3/users/f7d3be15542c4f4eb1c32c52c0a3ca15` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:02.352650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b1d78-03a8-4496-a5d6-de7a4e9a7a4e None admin] RBAC: Authorizing `identity:get_user(user_id=f7d3be15542c4f4eb1c32c52c0a3ca15)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:02.354281 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b1d78-03a8-4496-a5d6-de7a4e9a7a4e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:02.359345 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 99/193] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:05:02 2022] GET /identity/v3/users/f7d3be15542c4f4eb1c32c52c0a3ca15 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:02.359854 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 95/194] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:05:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:05:02.359993 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b1d78-03a8-4496-a5d6-de7a4e9a7a4e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:02.362134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d74637-342c-491c-944c-58635967f1eb None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:02.462782 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d74637-342c-491c-944c-58635967f1eb None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:02.467439 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b1d78-03a8-4496-a5d6-de7a4e9a7a4e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:02.499974 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb255953-10e2-4608-88b1-14876a33c624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:02.500627 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb255953-10e2-4608-88b1-14876a33c624 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:02.500909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb255953-10e2-4608-88b1-14876a33c624 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:02.501008 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff2c11-3e4c-4b22-994d-c182c8f2ccd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:02.501198 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb255953-10e2-4608-88b1-14876a33c624 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:02.501716 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff2c11-3e4c-4b22-994d-c182c8f2ccd9 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:02.502000 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff2c11-3e4c-4b22-994d-c182c8f2ccd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:02.502280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff2c11-3e4c-4b22-994d-c182c8f2ccd9 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:02.503005 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff2c11-3e4c-4b22-994d-c182c8f2ccd9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:02.504394 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff2c11-3e4c-4b22-994d-c182c8f2ccd9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:02.529419 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 100/195] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:05:02 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:05:02.529419 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff2c11-3e4c-4b22-994d-c182c8f2ccd9 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:02.581515 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb255953-10e2-4608-88b1-14876a33c624 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:02.582947 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb255953-10e2-4608-88b1-14876a33c624 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:02.652300 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff2c11-3e4c-4b22-994d-c182c8f2ccd9 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:02.696226 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18aef2-23ad-4528-a2bf-df4d46e96dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:02.697835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18aef2-23ad-4528-a2bf-df4d46e96dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:02.698299 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18aef2-23ad-4528-a2bf-df4d46e96dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:02.698814 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18aef2-23ad-4528-a2bf-df4d46e96dd2 None admin] PATH_INFO: `/v3/projects/610acb294db6480e82d07e198f888163` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:02.700386 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18aef2-23ad-4528-a2bf-df4d46e96dd2 None admin] RBAC: Authorizing `identity:get_project(project_id=610acb294db6480e82d07e198f888163)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:02.701954 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18aef2-23ad-4528-a2bf-df4d46e96dd2 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:02.703824 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 101/196] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:02 2022] GET /identity/v3/projects/610acb294db6480e82d07e198f888163 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:02.710471 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18aef2-23ad-4528-a2bf-df4d46e96dd2 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:02.729340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 96/197] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:05:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:05:02.731631 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb255953-10e2-4608-88b1-14876a33c624 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:02.832473 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18aef2-23ad-4528-a2bf-df4d46e96dd2 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:02.844716 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb255953-10e2-4608-88b1-14876a33c624 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:02.871511 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07f5a8-e5af-4497-9d45-74a96941f359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:02.872197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07f5a8-e5af-4497-9d45-74a96941f359 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:02.872490 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07f5a8-e5af-4497-9d45-74a96941f359 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:02.872766 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07f5a8-e5af-4497-9d45-74a96941f359 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:02.873752 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07f5a8-e5af-4497-9d45-74a96941f359 None admin] RBAC: Adding query filter params (role.id=3409f00ead9e455182684faa27b1f8f0, scope.project.id=610acb294db6480e82d07e198f888163, user.id=f7d3be15542c4f4eb1c32c52c0a3ca15) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:02.874070 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07f5a8-e5af-4497-9d45-74a96941f359 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:02.875638 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07f5a8-e5af-4497-9d45-74a96941f359 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:02.882523 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 102/198] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:05:02 2022] GET /identity/v3/role_assignments?user.id=f7d3be15542c4f4eb1c32c52c0a3ca15&scope.project.id=610acb294db6480e82d07e198f888163&role.id=3409f00ead9e455182684faa27b1f8f0 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:02.887442 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972b31f-0ff5-4df5-bcd4-d744862f85c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:02.888415 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972b31f-0ff5-4df5-bcd4-d744862f85c2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:02.888707 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972b31f-0ff5-4df5-bcd4-d744862f85c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:02.889033 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972b31f-0ff5-4df5-bcd4-d744862f85c2 None admin] PATH_INFO: `/v3/projects/610acb294db6480e82d07e198f888163` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:02.890470 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972b31f-0ff5-4df5-bcd4-d744862f85c2 None admin] RBAC: Authorizing `identity:get_project(project_id=610acb294db6480e82d07e198f888163)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:02.892098 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972b31f-0ff5-4df5-bcd4-d744862f85c2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:02.894457 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 97/199] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:02 2022] GET /identity/v3/projects/610acb294db6480e82d07e198f888163 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:02.901027 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07f5a8-e5af-4497-9d45-74a96941f359 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:03.026657 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07f5a8-e5af-4497-9d45-74a96941f359 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:03.083667 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067128a-941f-4524-98db-10cd917e7a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:03.084264 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067128a-941f-4524-98db-10cd917e7a77 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:03.084548 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067128a-941f-4524-98db-10cd917e7a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:03.084827 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067128a-941f-4524-98db-10cd917e7a77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:03.085734 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067128a-941f-4524-98db-10cd917e7a77 None admin] RBAC: Adding query filter params (role.id=371a69f4478447a2b7170a3078173caa, scope.project.id=610acb294db6480e82d07e198f888163, user.id=f7d3be15542c4f4eb1c32c52c0a3ca15) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:03.086049 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067128a-941f-4524-98db-10cd917e7a77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:03.087522 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067128a-941f-4524-98db-10cd917e7a77 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:03.095198 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 103/200] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:05:02 2022] GET /identity/v3/role_assignments?user.id=f7d3be15542c4f4eb1c32c52c0a3ca15&scope.project.id=610acb294db6480e82d07e198f888163&role.id=371a69f4478447a2b7170a3078173caa => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:03.453327 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ab03b-6cf4-4b31-8be9-b03a18879e63 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:03.453864 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ab03b-6cf4-4b31-8be9-b03a18879e63 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:03.453945 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ab03b-6cf4-4b31-8be9-b03a18879e63 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:03.455270 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 98/201] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:03.461090 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c61e1-017d-42df-90ce-c7c45f615724 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:03.461410 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c61e1-017d-42df-90ce-c7c45f615724 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:03.461710 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c61e1-017d-42df-90ce-c7c45f615724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:03.480935 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-174c61e1-017d-42df-90ce-c7c45f615724 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:03.482199 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-174c61e1-017d-42df-90ce-c7c45f615724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:03.554711 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 104/202] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:03.581623 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ab03b-6cf4-4b31-8be9-b03a18879e63 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:03.728238 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ab03b-6cf4-4b31-8be9-b03a18879e63 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:03.779026 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d511e5-d8b6-44f3-82dc-6d2fe6753757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:03.779829 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d511e5-d8b6-44f3-82dc-6d2fe6753757 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:03.780110 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d511e5-d8b6-44f3-82dc-6d2fe6753757 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:03.780384 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d511e5-d8b6-44f3-82dc-6d2fe6753757 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:03.799492 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d511e5-d8b6-44f3-82dc-6d2fe6753757 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:03.807590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-85d511e5-d8b6-44f3-82dc-6d2fe6753757 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:05:03.807590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:03.807590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:03.807590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:03.807590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:03.807590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:03.807590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:03.807590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:03.807590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:03.807590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:03.807590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:03.807590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:03.807590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:03.807590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:03.807590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:03.807590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:03.808544 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:03.808544 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:03.808544 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:03.808544 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:03.808544 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:03.808544 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:03.808544 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:03.808544 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:03.808544 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:03.808544 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:03.808544 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:03.808544 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:03.808544 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:03.808544 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:03.808544 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:03.808544 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:03.809333 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:03.809333 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:03.809333 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:03.809333 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:03.809333 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:03.809333 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:03.809333 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:03.809333 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:03.809333 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:03.809333 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:03.809333 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:05:03.809333 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:03.809333 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 99/203] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:03.814656 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c61e1-017d-42df-90ce-c7c45f615724 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:03.970246 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c61e1-017d-42df-90ce-c7c45f615724 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:04.012817 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3edbbf-2fa6-4a37-82ac-d8dfe337791f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:04.013441 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3edbbf-2fa6-4a37-82ac-d8dfe337791f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:04.013725 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3edbbf-2fa6-4a37-82ac-d8dfe337791f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:04.014001 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3edbbf-2fa6-4a37-82ac-d8dfe337791f None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:04.014756 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3edbbf-2fa6-4a37-82ac-d8dfe337791f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:04.015062 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3edbbf-2fa6-4a37-82ac-d8dfe337791f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:04.016441 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3edbbf-2fa6-4a37-82ac-d8dfe337791f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:04.029491 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 105/204] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:05:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:04.034464 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d511e5-d8b6-44f3-82dc-6d2fe6753757 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:04.164759 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d511e5-d8b6-44f3-82dc-6d2fe6753757 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:04.204945 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf7737-cc03-47ce-afb2-7b45b19d6f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:04.205856 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf7737-cc03-47ce-afb2-7b45b19d6f96 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:04.206137 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf7737-cc03-47ce-afb2-7b45b19d6f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:04.206411 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf7737-cc03-47ce-afb2-7b45b19d6f96 None admin] PATH_INFO: `/v3/users/cbf538e9a34a48d09586599cac4c7cc6` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:04.207629 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf7737-cc03-47ce-afb2-7b45b19d6f96 None admin] RBAC: Authorizing `identity:get_user(user_id=cbf538e9a34a48d09586599cac4c7cc6)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:04.209086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf7737-cc03-47ce-afb2-7b45b19d6f96 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:04.210815 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 100/205] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:05:04 2022] GET /identity/v3/users/cbf538e9a34a48d09586599cac4c7cc6 => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:04.216982 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3edbbf-2fa6-4a37-82ac-d8dfe337791f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:04.376937 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3edbbf-2fa6-4a37-82ac-d8dfe337791f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:04.438848 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b52f4-5349-428b-87fc-dab05f31f86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:04.439833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b52f4-5349-428b-87fc-dab05f31f86c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:04.440323 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b52f4-5349-428b-87fc-dab05f31f86c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:04.440823 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b52f4-5349-428b-87fc-dab05f31f86c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:04.532706 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b52f4-5349-428b-87fc-dab05f31f86c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:04.534553 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b52f4-5349-428b-87fc-dab05f31f86c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:04.660754 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 106/206] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:05:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:05:04.666679 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf7737-cc03-47ce-afb2-7b45b19d6f96 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:04.786220 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf7737-cc03-47ce-afb2-7b45b19d6f96 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:04.825625 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c04ccf-d404-4922-be65-e07f026d928b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:04.826499 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c04ccf-d404-4922-be65-e07f026d928b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:04.826781 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c04ccf-d404-4922-be65-e07f026d928b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:04.827054 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c04ccf-d404-4922-be65-e07f026d928b None admin] PATH_INFO: `/v3/projects/a5b903cafe374448928e686036261566` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:04.834180 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c04ccf-d404-4922-be65-e07f026d928b None admin] RBAC: Authorizing `identity:get_project(project_id=a5b903cafe374448928e686036261566)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:04.835714 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c04ccf-d404-4922-be65-e07f026d928b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:04.838380 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 101/207] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:04 2022] GET /identity/v3/projects/a5b903cafe374448928e686036261566 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:04.843776 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b52f4-5349-428b-87fc-dab05f31f86c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:05.007318 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b52f4-5349-428b-87fc-dab05f31f86c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:05.058350 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c324fea-4df3-4b40-acd7-72c6c9e03df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:05.059821 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c324fea-4df3-4b40-acd7-72c6c9e03df5 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:05.060306 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c324fea-4df3-4b40-acd7-72c6c9e03df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:05.060803 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c324fea-4df3-4b40-acd7-72c6c9e03df5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:05.061893 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c324fea-4df3-4b40-acd7-72c6c9e03df5 None admin] RBAC: Adding query filter params (role.id=7d122e00d0544c42b86e283fc846d179, scope.project.id=a5b903cafe374448928e686036261566, user.id=cbf538e9a34a48d09586599cac4c7cc6) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:05.062408 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c324fea-4df3-4b40-acd7-72c6c9e03df5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:05.064051 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c324fea-4df3-4b40-acd7-72c6c9e03df5 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:05.070686 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 107/208] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:05:04 2022] GET /identity/v3/role_assignments?user.id=cbf538e9a34a48d09586599cac4c7cc6&scope.project.id=a5b903cafe374448928e686036261566&role.id=7d122e00d0544c42b86e283fc846d179 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:05.571389 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36afa59-dfd6-4ca2-b513-64c856c227e8 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:05.571777 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36afa59-dfd6-4ca2-b513-64c856c227e8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:05.571953 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36afa59-dfd6-4ca2-b513-64c856c227e8 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:05.574224 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 102/209] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:05.580039 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8432b-7451-479e-949b-7f28197de82d None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:05.580324 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8432b-7451-479e-949b-7f28197de82d None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:05.580598 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8432b-7451-479e-949b-7f28197de82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:05.600431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-35f8432b-7451-479e-949b-7f28197de82d None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:05.601660 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-35f8432b-7451-479e-949b-7f28197de82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:05.700369 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 108/210] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:05.724801 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f42f3-bcf7-495e-bdba-4cccabc43591 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:05.725330 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f42f3-bcf7-495e-bdba-4cccabc43591 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:05.725330 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f42f3-bcf7-495e-bdba-4cccabc43591 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:05.726769 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 103/211] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:05.729360 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8432b-7451-479e-949b-7f28197de82d None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:05.736215 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef2276-64b1-4d10-9c35-47a60d51d43a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:05.736519 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef2276-64b1-4d10-9c35-47a60d51d43a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:05.736764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef2276-64b1-4d10-9c35-47a60d51d43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:05.758508 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-16ef2276-64b1-4d10-9c35-47a60d51d43a None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:05.760239 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-16ef2276-64b1-4d10-9c35-47a60d51d43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:05.840493 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8432b-7451-479e-949b-7f28197de82d None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:05.846192 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 104/212] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:05:05.868736 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef2276-64b1-4d10-9c35-47a60d51d43a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:05.881598 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bec3a4-3d80-417b-8fa8-2d68d3d4ce96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:05.882396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bec3a4-3d80-417b-8fa8-2d68d3d4ce96 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:05.882677 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bec3a4-3d80-417b-8fa8-2d68d3d4ce96 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:05.883207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bec3a4-3d80-417b-8fa8-2d68d3d4ce96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:05.884186 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bec3a4-3d80-417b-8fa8-2d68d3d4ce96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:05.886296 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bec3a4-3d80-417b-8fa8-2d68d3d4ce96 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:05.888021 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 109/213] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:05.889104 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb43a1b-5096-409a-a3ea-0fdc0b2a7cd7 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:05.889405 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb43a1b-5096-409a-a3ea-0fdc0b2a7cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:05.889688 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb43a1b-5096-409a-a3ea-0fdc0b2a7cd7 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:05.890919 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 110/214] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:05.895111 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb43a1b-5096-409a-a3ea-0fdc0b2a7cd7 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:05.968831 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef2276-64b1-4d10-9c35-47a60d51d43a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:05.992876 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb43a1b-5096-409a-a3ea-0fdc0b2a7cd7 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:06.000266 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af1892-1bf0-4be6-8bfa-8ab285544caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:06.001049 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af1892-1bf0-4be6-8bfa-8ab285544caa None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:06.001328 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af1892-1bf0-4be6-8bfa-8ab285544caa None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:06.001627 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af1892-1bf0-4be6-8bfa-8ab285544caa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:06.012828 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af1892-1bf0-4be6-8bfa-8ab285544caa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:06.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f0af1892-1bf0-4be6-8bfa-8ab285544caa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:05:06.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:06.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:06.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:06.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:06.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:06.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:06.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:06.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:06.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:06.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:06.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:06.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:06.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:06.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:06.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:06.021558 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:06.021558 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:06.021558 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:06.021558 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:06.021558 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:06.021558 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:06.021558 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:06.021558 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:06.021558 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:06.021558 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:06.021558 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:06.021558 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:06.021558 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:06.021558 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:06.021558 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:06.021558 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:06.022382 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:06.022382 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:06.022382 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:06.022382 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:06.022382 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:06.022382 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:06.022382 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:06.022382 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:06.022382 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:06.022382 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:06.022382 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:05:06.022382 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:06.022382 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 105/215] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:05:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:06.023602 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91923e9a-7e36-4fbe-b20f-9076efeec654 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:06.023602 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91923e9a-7e36-4fbe-b20f-9076efeec654 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:06.023769 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91923e9a-7e36-4fbe-b20f-9076efeec654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:06.027278 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a2176-67f3-4ac7-b2a4-b2124bfbd6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:06.027957 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a2176-67f3-4ac7-b2a4-b2124bfbd6d4 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:06.028239 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a2176-67f3-4ac7-b2a4-b2124bfbd6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:06.028514 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a2176-67f3-4ac7-b2a4-b2124bfbd6d4 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:06.029218 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a2176-67f3-4ac7-b2a4-b2124bfbd6d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:06.030694 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a2176-67f3-4ac7-b2a4-b2124bfbd6d4 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:06.040499 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-91923e9a-7e36-4fbe-b20f-9076efeec654 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:06.041988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-91923e9a-7e36-4fbe-b20f-9076efeec654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:06.050190 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 111/216] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:05:05 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:05:06.054913 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d55ef-b5bf-4a61-938b-1cb303201137 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:06.055202 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d55ef-b5bf-4a61-938b-1cb303201137 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:06.055536 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d55ef-b5bf-4a61-938b-1cb303201137 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:06.056928 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 112/217] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:06.057751 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d55ef-b5bf-4a61-938b-1cb303201137 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:06.120555 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 106/218] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:06.122367 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed05046-b9f9-4d27-a97c-a906ed70082d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:06.122866 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed05046-b9f9-4d27-a97c-a906ed70082d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:06.123341 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed05046-b9f9-4d27-a97c-a906ed70082d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:06.151498 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3ed05046-b9f9-4d27-a97c-a906ed70082d None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:06.152766 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3ed05046-b9f9-4d27-a97c-a906ed70082d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:06.172387 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d55ef-b5bf-4a61-938b-1cb303201137 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:06.210374 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7c961-bc89-45e9-8319-d33405b4151b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:06.211058 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7c961-bc89-45e9-8319-d33405b4151b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:06.211395 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7c961-bc89-45e9-8319-d33405b4151b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:06.211731 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7c961-bc89-45e9-8319-d33405b4151b None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:06.212488 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7c961-bc89-45e9-8319-d33405b4151b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:06.213419 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7c961-bc89-45e9-8319-d33405b4151b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:06.215014 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7c961-bc89-45e9-8319-d33405b4151b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:06.230125 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 113/219] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:06.230125 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7c961-bc89-45e9-8319-d33405b4151b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:06.233178 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 107/220] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:06.233959 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed05046-b9f9-4d27-a97c-a906ed70082d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:06.355600 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed05046-b9f9-4d27-a97c-a906ed70082d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:06.357205 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7c961-bc89-45e9-8319-d33405b4151b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:06.404742 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7da422-8aa1-41ea-8997-accec19ed9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:06.405207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c07965-4d22-4317-8b2d-42ca247d54d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:06.405677 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7da422-8aa1-41ea-8997-accec19ed9fc None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:06.405954 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7da422-8aa1-41ea-8997-accec19ed9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:06.406224 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7da422-8aa1-41ea-8997-accec19ed9fc None admin] PATH_INFO: `/v3/users/f7d3be15542c4f4eb1c32c52c0a3ca15` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:06.406879 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c07965-4d22-4317-8b2d-42ca247d54d5 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:06.407160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c07965-4d22-4317-8b2d-42ca247d54d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:06.407416 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7da422-8aa1-41ea-8997-accec19ed9fc None admin] RBAC: Authorizing `identity:get_user(user_id=f7d3be15542c4f4eb1c32c52c0a3ca15)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:06.407524 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c07965-4d22-4317-8b2d-42ca247d54d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:06.408866 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7da422-8aa1-41ea-8997-accec19ed9fc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:06.410708 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 108/221] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:05:06 2022] GET /identity/v3/users/f7d3be15542c4f4eb1c32c52c0a3ca15 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:06.411324 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7da422-8aa1-41ea-8997-accec19ed9fc None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:06.420165 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c07965-4d22-4317-8b2d-42ca247d54d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:06.428160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-f1c07965-4d22-4317-8b2d-42ca247d54d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:05:06.428160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:06.428160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:06.428160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:06.428160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:06.428160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:06.428160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:06.428160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:06.428160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:06.428160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:06.428160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:06.428160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:06.428160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:06.428160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:06.428160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:06.428160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:06.429261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:06.429261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:06.429261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:06.429261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:06.429261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:06.429261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:06.429261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:06.429261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:06.429261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:06.429261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:06.429261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:06.429261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:06.429261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:06.429261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:06.429261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:06.429261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:06.430123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:06.430123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:06.430123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:06.430123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:06.430123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:06.430123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:06.430123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:06.430123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:06.430123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:06.430123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:06.430123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:05:06.430123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:06.430123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 114/222] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:06.431274 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c07965-4d22-4317-8b2d-42ca247d54d5 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:06.532537 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7da422-8aa1-41ea-8997-accec19ed9fc None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:06.547608 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c07965-4d22-4317-8b2d-42ca247d54d5 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:06.565807 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d775e41-4640-4b4a-b40f-180aa4f87acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:06.566621 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d775e41-4640-4b4a-b40f-180aa4f87acd None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:06.566898 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d775e41-4640-4b4a-b40f-180aa4f87acd None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:06.567169 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d775e41-4640-4b4a-b40f-180aa4f87acd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:06.578451 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d775e41-4640-4b4a-b40f-180aa4f87acd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:06.582797 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0062c26-1c93-4579-a29b-978b37aad517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:06.583660 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0062c26-1c93-4579-a29b-978b37aad517 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:06.584002 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0062c26-1c93-4579-a29b-978b37aad517 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:06.584281 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0062c26-1c93-4579-a29b-978b37aad517 None admin] PATH_INFO: `/v3/projects/610acb294db6480e82d07e198f888163` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:06.585551 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0062c26-1c93-4579-a29b-978b37aad517 None admin] RBAC: Authorizing `identity:get_project(project_id=610acb294db6480e82d07e198f888163)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:06.586995 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-8d775e41-4640-4b4a-b40f-180aa4f87acd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:05:06.586995 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:06.586995 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:06.586995 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:06.586995 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:06.586995 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:06.586995 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:06.586995 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:06.586995 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:06.586995 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:06.586995 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:06.586995 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:06.586995 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:06.586995 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:06.586995 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:06.586995 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:06.588436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:06.588436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:06.588436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:06.588436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:06.588436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:06.588436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:06.588436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:06.588436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:06.588436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:06.588436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:06.588436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:06.588436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:06.588436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:06.588436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:06.588436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:06.588436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:06.589323 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:06.589323 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:06.589323 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:06.589323 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:06.589323 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:06.589323 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:06.589323 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:06.589323 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:06.589323 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:06.589323 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:06.589323 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:05:06.589323 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:06.590491 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0062c26-1c93-4579-a29b-978b37aad517 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:06.590574 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 109/223] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:05:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:06.590660 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 115/224] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:06 2022] GET /identity/v3/projects/610acb294db6480e82d07e198f888163 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:06.590740 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d775e41-4640-4b4a-b40f-180aa4f87acd None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:06.597275 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0062c26-1c93-4579-a29b-978b37aad517 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:06.715717 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0062c26-1c93-4579-a29b-978b37aad517 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:06.718940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d775e41-4640-4b4a-b40f-180aa4f87acd None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:06.753978 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293f31b-a2c0-464e-89e4-46e5499abd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:06.754602 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bcaba-dff6-4dc7-99ba-aeba4230a524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:06.754706 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293f31b-a2c0-464e-89e4-46e5499abd88 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:06.754908 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293f31b-a2c0-464e-89e4-46e5499abd88 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:06.755183 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293f31b-a2c0-464e-89e4-46e5499abd88 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:06.755770 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bcaba-dff6-4dc7-99ba-aeba4230a524 None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:06.755930 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293f31b-a2c0-464e-89e4-46e5499abd88 None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:06.756233 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293f31b-a2c0-464e-89e4-46e5499abd88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:06.756333 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bcaba-dff6-4dc7-99ba-aeba4230a524 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:06.756673 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bcaba-dff6-4dc7-99ba-aeba4230a524 None admin] PATH_INFO: `/v3/projects/610acb294db6480e82d07e198f888163/users/f7d3be15542c4f4eb1c32c52c0a3ca15/roles/3409f00ead9e455182684faa27b1f8f0` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:06.757630 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293f31b-a2c0-464e-89e4-46e5499abd88 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:06.758986 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bcaba-dff6-4dc7-99ba-aeba4230a524 None admin] RBAC: Authorizing `identity:create_grant(project_id=610acb294db6480e82d07e198f888163, user_id=f7d3be15542c4f4eb1c32c52c0a3ca15, role_id=3409f00ead9e455182684faa27b1f8f0)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:06.761188 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bcaba-dff6-4dc7-99ba-aeba4230a524 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:06.767682 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 110/225] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:05:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:06.768652 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293f31b-a2c0-464e-89e4-46e5499abd88 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:06.781489 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 116/226] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:05:06 2022] PUT /identity/v3/projects/610acb294db6480e82d07e198f888163/users/f7d3be15542c4f4eb1c32c52c0a3ca15/roles/3409f00ead9e455182684faa27b1f8f0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:05:06.782431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bcaba-dff6-4dc7-99ba-aeba4230a524 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:06.902127 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293f31b-a2c0-464e-89e4-46e5499abd88 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:06.906922 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bcaba-dff6-4dc7-99ba-aeba4230a524 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:06.940334 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9a56c-26ce-45dd-b72b-9ab72f921b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:06.941015 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9a56c-26ce-45dd-b72b-9ab72f921b7e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:06.941301 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9a56c-26ce-45dd-b72b-9ab72f921b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:06.941661 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9a56c-26ce-45dd-b72b-9ab72f921b7e None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:06.942550 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9a56c-26ce-45dd-b72b-9ab72f921b7e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:06.942956 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9a56c-26ce-45dd-b72b-9ab72f921b7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:06.944482 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9a56c-26ce-45dd-b72b-9ab72f921b7e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:06.945255 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c3ec1-35e6-4e34-95a7-a84eb6d8e77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:06.946277 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c3ec1-35e6-4e34-95a7-a84eb6d8e77c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:06.946662 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c3ec1-35e6-4e34-95a7-a84eb6d8e77c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:06.947666 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c3ec1-35e6-4e34-95a7-a84eb6d8e77c None admin] PATH_INFO: `/v3/users/b8f2f7f86a4e4adfb14c71084b0e989c` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:06.955112 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 111/227] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:05:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:06.960729 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9a56c-26ce-45dd-b72b-9ab72f921b7e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:06.978578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c3ec1-35e6-4e34-95a7-a84eb6d8e77c None admin] RBAC: Authorizing `identity:get_user(user_id=b8f2f7f86a4e4adfb14c71084b0e989c)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:06.983356 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c3ec1-35e6-4e34-95a7-a84eb6d8e77c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:06.985517 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 117/228] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:05:06 2022] GET /identity/v3/users/b8f2f7f86a4e4adfb14c71084b0e989c => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:06.995037 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c3ec1-35e6-4e34-95a7-a84eb6d8e77c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:07.125657 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9a56c-26ce-45dd-b72b-9ab72f921b7e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:07.173272 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023b3ea-f937-4c11-98e1-64fd28a54370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:07.174143 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023b3ea-f937-4c11-98e1-64fd28a54370 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:07.174430 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023b3ea-f937-4c11-98e1-64fd28a54370 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:07.174803 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023b3ea-f937-4c11-98e1-64fd28a54370 None admin] PATH_INFO: `/v3/users/f7d3be15542c4f4eb1c32c52c0a3ca15` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:07.177734 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c3ec1-35e6-4e34-95a7-a84eb6d8e77c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:07.180503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023b3ea-f937-4c11-98e1-64fd28a54370 None admin] RBAC: Authorizing `identity:get_user(user_id=f7d3be15542c4f4eb1c32c52c0a3ca15)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:07.183296 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023b3ea-f937-4c11-98e1-64fd28a54370 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:07.191890 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 112/229] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:05:06 2022] GET /identity/v3/users/f7d3be15542c4f4eb1c32c52c0a3ca15 => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:07.192884 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023b3ea-f937-4c11-98e1-64fd28a54370 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:07.246076 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641e6db-1290-4a8a-80d7-db5383e250b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:07.246738 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641e6db-1290-4a8a-80d7-db5383e250b8 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:07.247027 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641e6db-1290-4a8a-80d7-db5383e250b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:07.247308 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641e6db-1290-4a8a-80d7-db5383e250b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:07.351847 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641e6db-1290-4a8a-80d7-db5383e250b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:07.353901 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641e6db-1290-4a8a-80d7-db5383e250b8 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:07.446877 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023b3ea-f937-4c11-98e1-64fd28a54370 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:07.470763 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 118/230] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:05:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:05:07.482546 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641e6db-1290-4a8a-80d7-db5383e250b8 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:07.512689 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8012ea-91b6-47d1-a9c8-dd5c9c30e82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:07.513604 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8012ea-91b6-47d1-a9c8-dd5c9c30e82e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:07.513889 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8012ea-91b6-47d1-a9c8-dd5c9c30e82e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:07.514173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8012ea-91b6-47d1-a9c8-dd5c9c30e82e None admin] PATH_INFO: `/v3/projects/610acb294db6480e82d07e198f888163` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:07.516933 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8012ea-91b6-47d1-a9c8-dd5c9c30e82e None admin] RBAC: Authorizing `identity:get_project(project_id=610acb294db6480e82d07e198f888163)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:07.518482 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8012ea-91b6-47d1-a9c8-dd5c9c30e82e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:07.521639 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 113/231] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:07 2022] GET /identity/v3/projects/610acb294db6480e82d07e198f888163 => generated 302 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:07.540202 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8012ea-91b6-47d1-a9c8-dd5c9c30e82e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:07.620726 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641e6db-1290-4a8a-80d7-db5383e250b8 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:07.658512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9705a-3fac-4267-a10c-7ebeb52d97b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:07.659416 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9705a-3fac-4267-a10c-7ebeb52d97b1 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:07.659702 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9705a-3fac-4267-a10c-7ebeb52d97b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:07.659983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9705a-3fac-4267-a10c-7ebeb52d97b1 None admin] PATH_INFO: `/v3/projects/610acb294db6480e82d07e198f888163` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:07.661353 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9705a-3fac-4267-a10c-7ebeb52d97b1 None admin] RBAC: Authorizing `identity:get_project(project_id=610acb294db6480e82d07e198f888163)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:07.662847 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9705a-3fac-4267-a10c-7ebeb52d97b1 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:07.669504 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 119/232] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:07 2022] GET /identity/v3/projects/610acb294db6480e82d07e198f888163 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:07.671445 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9705a-3fac-4267-a10c-7ebeb52d97b1 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:07.770943 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8012ea-91b6-47d1-a9c8-dd5c9c30e82e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:07.810187 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa8f95-90e5-4d48-ad9c-2b31d98afbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:07.811097 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa8f95-90e5-4d48-ad9c-2b31d98afbfd None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:07.811382 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa8f95-90e5-4d48-ad9c-2b31d98afbfd None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:07.811657 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa8f95-90e5-4d48-ad9c-2b31d98afbfd None admin] PATH_INFO: `/v3/projects/610acb294db6480e82d07e198f888163/users/f7d3be15542c4f4eb1c32c52c0a3ca15/roles/371a69f4478447a2b7170a3078173caa` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:07.813939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa8f95-90e5-4d48-ad9c-2b31d98afbfd None admin] RBAC: Authorizing `identity:create_grant(project_id=610acb294db6480e82d07e198f888163, user_id=f7d3be15542c4f4eb1c32c52c0a3ca15, role_id=371a69f4478447a2b7170a3078173caa)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:07.815548 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa8f95-90e5-4d48-ad9c-2b31d98afbfd None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:07.822860 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9705a-3fac-4267-a10c-7ebeb52d97b1 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:07.839432 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 114/233] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:05:07 2022] PUT /identity/v3/projects/610acb294db6480e82d07e198f888163/users/f7d3be15542c4f4eb1c32c52c0a3ca15/roles/371a69f4478447a2b7170a3078173caa => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:05:07.872556 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a769e55-8bb1-4215-85b1-8c02b64bd68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:07.873233 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a769e55-8bb1-4215-85b1-8c02b64bd68d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:07.873550 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a769e55-8bb1-4215-85b1-8c02b64bd68d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:07.873831 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a769e55-8bb1-4215-85b1-8c02b64bd68d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:07.874733 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a769e55-8bb1-4215-85b1-8c02b64bd68d None admin] RBAC: Adding query filter params (role.id=003cb0d66fec412dbbffb071206075d5, scope.project.id=610acb294db6480e82d07e198f888163, user.id=b8f2f7f86a4e4adfb14c71084b0e989c) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:07.875054 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a769e55-8bb1-4215-85b1-8c02b64bd68d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:07.876503 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a769e55-8bb1-4215-85b1-8c02b64bd68d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:07.882971 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 120/234] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:05:07 2022] GET /identity/v3/role_assignments?user.id=b8f2f7f86a4e4adfb14c71084b0e989c&scope.project.id=610acb294db6480e82d07e198f888163&role.id=003cb0d66fec412dbbffb071206075d5 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:08.748891 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231031ca-6832-467d-a71f-ea0d7bc3f9e8 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:08.749627 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231031ca-6832-467d-a71f-ea0d7bc3f9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:08.750145 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231031ca-6832-467d-a71f-ea0d7bc3f9e8 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:08.751698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 115/235] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:08.757081 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d339ea-cafd-4431-8b16-b2c8649143be None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:08.757945 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d339ea-cafd-4431-8b16-b2c8649143be None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:08.758415 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d339ea-cafd-4431-8b16-b2c8649143be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:08.782444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-e7d339ea-cafd-4431-8b16-b2c8649143be None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:08.783635 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e7d339ea-cafd-4431-8b16-b2c8649143be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:08.821553 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d21526-2634-499f-94c1-710712c4be6e None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:08.823018 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d21526-2634-499f-94c1-710712c4be6e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:08.823501 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d21526-2634-499f-94c1-710712c4be6e None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:08.825066 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 116/236] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:05:08.830924 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5d9e2-a0cf-4ebc-bcfe-c37b772c18e6 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:08.831489 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5d9e2-a0cf-4ebc-bcfe-c37b772c18e6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:08.832255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5d9e2-a0cf-4ebc-bcfe-c37b772c18e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:08.850429 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-21c5d9e2-a0cf-4ebc-bcfe-c37b772c18e6 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:08.851921 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-21c5d9e2-a0cf-4ebc-bcfe-c37b772c18e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:08.880074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 121/237] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:08.922722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d339ea-cafd-4431-8b16-b2c8649143be None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:08.952906 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 117/238] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:05:09.008537 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5d9e2-a0cf-4ebc-bcfe-c37b772c18e6 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:09.116187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d339ea-cafd-4431-8b16-b2c8649143be None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:09.118577 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5d9e2-a0cf-4ebc-bcfe-c37b772c18e6 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:09.159042 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773857eb-5ec4-4510-87e3-449f4d7b4b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:09.159841 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773857eb-5ec4-4510-87e3-449f4d7b4b25 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:09.160116 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773857eb-5ec4-4510-87e3-449f4d7b4b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:09.160385 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773857eb-5ec4-4510-87e3-449f4d7b4b25 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:09.177792 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773857eb-5ec4-4510-87e3-449f4d7b4b25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:09.186315 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-773857eb-5ec4-4510-87e3-449f4d7b4b25 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:05:09.186315 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:09.186315 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:09.186315 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:09.186315 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:09.186315 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:09.186315 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:09.186315 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:09.186315 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:09.186315 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:09.186315 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:09.186315 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:09.186315 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:09.186315 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:09.186315 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:09.186315 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:09.187219 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:09.187219 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:09.187219 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:09.187219 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:09.187219 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:09.187219 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:09.187219 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:09.187219 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:09.187219 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:09.187219 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:09.187219 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:09.187219 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:09.187219 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:09.187219 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:09.187219 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:09.187219 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:09.188016 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:09.188016 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:09.188016 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:09.188016 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:09.188016 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:09.188016 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:09.188016 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:09.188016 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:09.188016 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:09.188016 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:09.188016 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:05:09.188016 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:09.188016 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 118/239] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:09.192172 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b50e3-58b2-42c8-8ffe-f3bd9cd4fe64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:09.193585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b50e3-58b2-42c8-8ffe-f3bd9cd4fe64 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:09.194067 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b50e3-58b2-42c8-8ffe-f3bd9cd4fe64 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:09.194534 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b50e3-58b2-42c8-8ffe-f3bd9cd4fe64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:09.195915 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b50e3-58b2-42c8-8ffe-f3bd9cd4fe64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:09.198253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b50e3-58b2-42c8-8ffe-f3bd9cd4fe64 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:09.198610 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773857eb-5ec4-4510-87e3-449f4d7b4b25 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:09.200357 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 122/240] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:09.205763 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b50e3-58b2-42c8-8ffe-f3bd9cd4fe64 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:09.333017 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773857eb-5ec4-4510-87e3-449f4d7b4b25 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:09.369747 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00293309-0718-4212-a488-d619e841e148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:09.370790 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00293309-0718-4212-a488-d619e841e148 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:09.371301 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00293309-0718-4212-a488-d619e841e148 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:09.371772 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00293309-0718-4212-a488-d619e841e148 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:09.372715 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00293309-0718-4212-a488-d619e841e148 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:09.373213 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00293309-0718-4212-a488-d619e841e148 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:09.374841 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00293309-0718-4212-a488-d619e841e148 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:09.385144 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 119/241] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:05:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:09.388869 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b50e3-58b2-42c8-8ffe-f3bd9cd4fe64 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:09.393472 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00293309-0718-4212-a488-d619e841e148 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:09.434385 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1e39a-999e-4bd4-9295-7ad61139c01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:09.435066 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1e39a-999e-4bd4-9295-7ad61139c01e None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:09.435349 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1e39a-999e-4bd4-9295-7ad61139c01e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:09.435622 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1e39a-999e-4bd4-9295-7ad61139c01e None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:09.436340 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1e39a-999e-4bd4-9295-7ad61139c01e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:09.437813 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1e39a-999e-4bd4-9295-7ad61139c01e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:09.471626 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 123/242] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:05:09 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:05:09.541999 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00293309-0718-4212-a488-d619e841e148 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:09.588134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccecb00-dfb2-4612-b49c-1e1565ce047a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:09.589072 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccecb00-dfb2-4612-b49c-1e1565ce047a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:09.589357 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccecb00-dfb2-4612-b49c-1e1565ce047a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:09.589656 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccecb00-dfb2-4612-b49c-1e1565ce047a None admin] PATH_INFO: `/v3/users/3736e70bd0084deda71a931df22c3ba7` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:09.610521 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccecb00-dfb2-4612-b49c-1e1565ce047a None admin] RBAC: Authorizing `identity:get_user(user_id=3736e70bd0084deda71a931df22c3ba7)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:09.612024 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccecb00-dfb2-4612-b49c-1e1565ce047a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:09.614232 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 120/243] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:05:09 2022] GET /identity/v3/users/3736e70bd0084deda71a931df22c3ba7 => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:09.620133 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1e39a-999e-4bd4-9295-7ad61139c01e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:09.746535 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1e39a-999e-4bd4-9295-7ad61139c01e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:09.766489 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a3991-2d15-45a3-b8da-3c471ee2f05b None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:09.767119 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a3991-2d15-45a3-b8da-3c471ee2f05b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:09.767591 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a3991-2d15-45a3-b8da-3c471ee2f05b None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:09.769228 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 121/244] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:05:09.774729 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a5bea-6fa5-4f70-a1eb-e152ca6fd2f9 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:09.775818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a5bea-6fa5-4f70-a1eb-e152ca6fd2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:09.776305 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a5bea-6fa5-4f70-a1eb-e152ca6fd2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:09.783794 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3c352-8646-4b7f-9a1d-3ae26013a50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:09.784463 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3c352-8646-4b7f-9a1d-3ae26013a50e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:09.784752 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3c352-8646-4b7f-9a1d-3ae26013a50e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:09.785034 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3c352-8646-4b7f-9a1d-3ae26013a50e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:09.818503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6d8a5bea-6fa5-4f70-a1eb-e152ca6fd2f9 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:09.820035 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6d8a5bea-6fa5-4f70-a1eb-e152ca6fd2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:09.864053 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3c352-8646-4b7f-9a1d-3ae26013a50e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:09.865864 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3c352-8646-4b7f-9a1d-3ae26013a50e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:09.906487 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 122/245] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:05:09.930930 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a5bea-6fa5-4f70-a1eb-e152ca6fd2f9 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:09.986748 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 124/246] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:05:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:05:09.995679 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3c352-8646-4b7f-9a1d-3ae26013a50e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:10.061929 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a5bea-6fa5-4f70-a1eb-e152ca6fd2f9 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:10.106343 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbcb39-c12d-4b57-bd68-647257d0e947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:10.107602 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbcb39-c12d-4b57-bd68-647257d0e947 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:10.108079 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbcb39-c12d-4b57-bd68-647257d0e947 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:10.108701 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbcb39-c12d-4b57-bd68-647257d0e947 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:10.130480 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbcb39-c12d-4b57-bd68-647257d0e947 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:10.132823 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3c352-8646-4b7f-9a1d-3ae26013a50e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:10.138842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-43dbcb39-c12d-4b57-bd68-647257d0e947 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:05:10.138842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:10.138842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:10.138842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:10.138842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:10.138842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:10.138842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:10.138842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:10.138842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:10.138842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:10.138842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:10.138842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:10.138842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:10.138842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:10.138842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:10.138842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:10.140028 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:10.140028 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:10.140028 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:10.140028 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:10.140028 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:10.140028 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:10.140028 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:10.140028 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:10.140028 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:10.140028 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:10.140028 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:10.140028 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:10.140028 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:10.140028 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:10.140028 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:10.140028 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:10.141119 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:10.141119 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:10.141119 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:10.141119 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:10.141119 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:10.141119 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:10.141119 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:10.141119 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:10.141119 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:10.141119 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:10.141119 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:05:10.141119 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:10.141119 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 123/247] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:05:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:05:10.146012 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbcb39-c12d-4b57-bd68-647257d0e947 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:10.186926 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a5259-3037-4b62-ab05-b28a0f6f482c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:10.188225 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a5259-3037-4b62-ab05-b28a0f6f482c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:10.188870 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a5259-3037-4b62-ab05-b28a0f6f482c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:10.190238 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a5259-3037-4b62-ab05-b28a0f6f482c None admin] PATH_INFO: `/v3/projects/610acb294db6480e82d07e198f888163` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:10.191725 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a5259-3037-4b62-ab05-b28a0f6f482c None admin] RBAC: Authorizing `identity:get_project(project_id=610acb294db6480e82d07e198f888163)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:10.193433 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a5259-3037-4b62-ab05-b28a0f6f482c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:10.195910 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 125/248] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:09 2022] GET /identity/v3/projects/610acb294db6480e82d07e198f888163 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:10.202460 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a5259-3037-4b62-ab05-b28a0f6f482c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:10.281699 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbcb39-c12d-4b57-bd68-647257d0e947 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:10.325225 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a5259-3037-4b62-ab05-b28a0f6f482c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:10.326643 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7bef8-cb90-4d44-aeaa-2480ae8ae4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:10.327417 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7bef8-cb90-4d44-aeaa-2480ae8ae4da None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:10.327651 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7bef8-cb90-4d44-aeaa-2480ae8ae4da None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:10.327933 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7bef8-cb90-4d44-aeaa-2480ae8ae4da None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:10.328726 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7bef8-cb90-4d44-aeaa-2480ae8ae4da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:10.329783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7bef8-cb90-4d44-aeaa-2480ae8ae4da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:10.330503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7bef8-cb90-4d44-aeaa-2480ae8ae4da None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:10.342554 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 124/249] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:10.348975 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7bef8-cb90-4d44-aeaa-2480ae8ae4da None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:10.367246 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfd0b1-2696-44c5-865e-8d0fa7a1f22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:10.368486 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfd0b1-2696-44c5-865e-8d0fa7a1f22d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:10.369758 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfd0b1-2696-44c5-865e-8d0fa7a1f22d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:10.370473 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfd0b1-2696-44c5-865e-8d0fa7a1f22d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:10.371871 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfd0b1-2696-44c5-865e-8d0fa7a1f22d None admin] RBAC: Adding query filter params (role.id=7d122e00d0544c42b86e283fc846d179, scope.project.id=610acb294db6480e82d07e198f888163, user.id=3736e70bd0084deda71a931df22c3ba7) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:10.372608 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfd0b1-2696-44c5-865e-8d0fa7a1f22d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:10.375402 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfd0b1-2696-44c5-865e-8d0fa7a1f22d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:10.382305 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 126/250] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:05:10 2022] GET /identity/v3/role_assignments?user.id=3736e70bd0084deda71a931df22c3ba7&scope.project.id=610acb294db6480e82d07e198f888163&role.id=7d122e00d0544c42b86e283fc846d179 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:10.499386 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7bef8-cb90-4d44-aeaa-2480ae8ae4da None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:10.542961 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a0a36-5723-4ef2-8f9c-73e5d7c72963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:10.543861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a0a36-5723-4ef2-8f9c-73e5d7c72963 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:10.544142 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a0a36-5723-4ef2-8f9c-73e5d7c72963 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:10.544419 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a0a36-5723-4ef2-8f9c-73e5d7c72963 None admin] PATH_INFO: `/v3/users/f7d3be15542c4f4eb1c32c52c0a3ca15` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:10.545775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a0a36-5723-4ef2-8f9c-73e5d7c72963 None admin] RBAC: Authorizing `identity:get_user(user_id=f7d3be15542c4f4eb1c32c52c0a3ca15)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:10.547284 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a0a36-5723-4ef2-8f9c-73e5d7c72963 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:10.549515 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 125/251] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:05:10 2022] GET /identity/v3/users/f7d3be15542c4f4eb1c32c52c0a3ca15 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:10.555598 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfd0b1-2696-44c5-865e-8d0fa7a1f22d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:10.695511 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfd0b1-2696-44c5-865e-8d0fa7a1f22d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:10.745950 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca48d22-b3bc-4004-962f-8b3fe58852d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:10.746620 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca48d22-b3bc-4004-962f-8b3fe58852d7 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:10.746907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca48d22-b3bc-4004-962f-8b3fe58852d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:10.747184 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca48d22-b3bc-4004-962f-8b3fe58852d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:10.812061 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffbbcd-ab8a-44fd-9460-fb05b441c6e5 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:10.812383 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffbbcd-ab8a-44fd-9460-fb05b441c6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:10.812624 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffbbcd-ab8a-44fd-9460-fb05b441c6e5 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:10.814277 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 126/252] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:05:10.823587 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3463bf-3ef0-4e47-b891-4c7276b0b420 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:10.823928 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3463bf-3ef0-4e47-b891-4c7276b0b420 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:10.824144 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3463bf-3ef0-4e47-b891-4c7276b0b420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:10.840877 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca48d22-b3bc-4004-962f-8b3fe58852d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:10.842409 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca48d22-b3bc-4004-962f-8b3fe58852d7 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:10.851108 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3c3463bf-3ef0-4e47-b891-4c7276b0b420 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:10.852317 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3c3463bf-3ef0-4e47-b891-4c7276b0b420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:11.000441 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 127/253] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:05:11.044133 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3463bf-3ef0-4e47-b891-4c7276b0b420 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:11.074004 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 127/254] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:05:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:05:11.076343 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50e3a7-cf0d-4e21-8ae4-c235d822c811 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:11.076634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50e3a7-cf0d-4e21-8ae4-c235d822c811 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:11.076913 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50e3a7-cf0d-4e21-8ae4-c235d822c811 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:11.080634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 128/255] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:11.081540 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50e3a7-cf0d-4e21-8ae4-c235d822c811 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:11.246833 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3463bf-3ef0-4e47-b891-4c7276b0b420 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:11.276565 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50e3a7-cf0d-4e21-8ae4-c235d822c811 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:11.314786 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516b527-b590-4fae-9149-67d2fc651547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:11.316606 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516b527-b590-4fae-9149-67d2fc651547 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:11.317365 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516b527-b590-4fae-9149-67d2fc651547 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:11.318097 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516b527-b590-4fae-9149-67d2fc651547 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:11.333905 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388de44d-10c8-4b44-b23f-f09be7d04a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:11.335880 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388de44d-10c8-4b44-b23f-f09be7d04a64 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:11.336631 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388de44d-10c8-4b44-b23f-f09be7d04a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:11.337410 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388de44d-10c8-4b44-b23f-f09be7d04a64 None admin] PATH_INFO: `/v3/projects/610acb294db6480e82d07e198f888163` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:11.340883 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388de44d-10c8-4b44-b23f-f09be7d04a64 None admin] RBAC: Authorizing `identity:get_project(project_id=610acb294db6480e82d07e198f888163)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:11.344106 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388de44d-10c8-4b44-b23f-f09be7d04a64 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:11.348554 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 129/256] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:11 2022] GET /identity/v3/projects/610acb294db6480e82d07e198f888163 => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:11.349895 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516b527-b590-4fae-9149-67d2fc651547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:11.351611 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3f2e8-d48a-4675-9b80-2259ce095b66 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:11.352397 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3f2e8-d48a-4675-9b80-2259ce095b66 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:11.353746 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3f2e8-d48a-4675-9b80-2259ce095b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:11.363278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-2516b527-b590-4fae-9149-67d2fc651547 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:05:11.363278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:11.363278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:11.363278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:11.363278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:11.363278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:11.363278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:11.363278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:11.363278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:11.363278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:11.363278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:11.363278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:11.363278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:11.363278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:11.363278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:11.363278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:11.365027 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:11.365027 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:11.365027 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:11.365027 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:11.365027 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:11.365027 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:11.365027 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:11.365027 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:11.365027 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:11.365027 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:11.365027 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:11.365027 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:11.365027 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:11.365027 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:11.365027 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:11.365027 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:11.366672 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:11.366672 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:11.366672 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:11.366672 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:11.366672 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:11.366672 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:11.366672 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:11.366672 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:11.366672 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:11.366672 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:11.366672 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:05:11.366672 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:11.366672 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 128/257] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:05:11.366672 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516b527-b590-4fae-9149-67d2fc651547 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:11.404933 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-a0c3f2e8-d48a-4675-9b80-2259ce095b66 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:11.408213 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a0c3f2e8-d48a-4675-9b80-2259ce095b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:11.562563 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516b527-b590-4fae-9149-67d2fc651547 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:11.577636 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 130/258] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:11.578607 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3f2e8-d48a-4675-9b80-2259ce095b66 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:11.664904 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d10b9-c7ff-46ff-a9cd-89a3bcbc7ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:11.665626 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d10b9-c7ff-46ff-a9cd-89a3bcbc7ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:11.666638 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d10b9-c7ff-46ff-a9cd-89a3bcbc7ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:11.667063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d10b9-c7ff-46ff-a9cd-89a3bcbc7ef2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:11.668063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d10b9-c7ff-46ff-a9cd-89a3bcbc7ef2 None admin] RBAC: Adding query filter params (role.id=3409f00ead9e455182684faa27b1f8f0, scope.project.id=610acb294db6480e82d07e198f888163, user.id=f7d3be15542c4f4eb1c32c52c0a3ca15) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:11.668546 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d10b9-c7ff-46ff-a9cd-89a3bcbc7ef2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:11.670195 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d10b9-c7ff-46ff-a9cd-89a3bcbc7ef2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:11.691806 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 129/259] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:05:11 2022] GET /identity/v3/role_assignments?user.id=f7d3be15542c4f4eb1c32c52c0a3ca15&scope.project.id=610acb294db6480e82d07e198f888163&role.id=3409f00ead9e455182684faa27b1f8f0 => generated 608 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:11.692935 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d10b9-c7ff-46ff-a9cd-89a3bcbc7ef2 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:11.728012 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3f2e8-d48a-4675-9b80-2259ce095b66 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:11.771379 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759b929-ca75-4216-bcde-2c3e3bf60f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:11.772966 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759b929-ca75-4216-bcde-2c3e3bf60f99 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:11.773492 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759b929-ca75-4216-bcde-2c3e3bf60f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:11.773970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759b929-ca75-4216-bcde-2c3e3bf60f99 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:11.774974 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759b929-ca75-4216-bcde-2c3e3bf60f99 None admin] RBAC: Adding query filter params (name=member) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:11.776107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759b929-ca75-4216-bcde-2c3e3bf60f99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:11.778246 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759b929-ca75-4216-bcde-2c3e3bf60f99 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:11.789219 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 131/260] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:05:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:11.798491 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759b929-ca75-4216-bcde-2c3e3bf60f99 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:11.912900 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d10b9-c7ff-46ff-a9cd-89a3bcbc7ef2 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:11.916138 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759b929-ca75-4216-bcde-2c3e3bf60f99 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:11.948942 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4d0dd-0cd1-4696-876c-143535e9ef85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:11.949675 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4d0dd-0cd1-4696-876c-143535e9ef85 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:11.949958 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4d0dd-0cd1-4696-876c-143535e9ef85 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:11.950233 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4d0dd-0cd1-4696-876c-143535e9ef85 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:11.954798 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380da600-3bd8-4cac-af93-8c296f5560e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:11.956055 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380da600-3bd8-4cac-af93-8c296f5560e2 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:11.956547 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380da600-3bd8-4cac-af93-8c296f5560e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:11.957025 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380da600-3bd8-4cac-af93-8c296f5560e2 None admin] PATH_INFO: `/v3/users/b8f2f7f86a4e4adfb14c71084b0e989c` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:11.958809 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380da600-3bd8-4cac-af93-8c296f5560e2 None admin] RBAC: Authorizing `identity:get_user(user_id=b8f2f7f86a4e4adfb14c71084b0e989c)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:11.960492 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380da600-3bd8-4cac-af93-8c296f5560e2 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:11.961946 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4d0dd-0cd1-4696-876c-143535e9ef85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:11.963322 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 132/261] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:05:11 2022] GET /identity/v3/users/b8f2f7f86a4e4adfb14c71084b0e989c => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:11.969236 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380da600-3bd8-4cac-af93-8c296f5560e2 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:11.970939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-3da4d0dd-0cd1-4696-876c-143535e9ef85 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:05:11.970939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:11.970939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:11.970939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:11.970939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:11.970939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:11.970939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:11.970939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:11.970939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:11.970939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:11.970939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:11.970939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:11.970939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:11.970939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:11.970939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:11.970939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:11.971804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:11.971804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:11.971804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:11.971804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:11.971804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:11.971804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:11.971804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:11.971804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:11.971804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:11.971804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:11.971804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:11.971804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:11.971804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:11.971804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:11.971804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:11.971804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:11.972606 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:11.972606 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:11.972606 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:11.972606 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:11.972606 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:11.972606 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:11.972606 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:11.972606 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:11.972606 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:11.972606 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:11.972606 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:05:11.972606 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:11.972606 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 130/262] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:05:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:11.980723 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4d0dd-0cd1-4696-876c-143535e9ef85 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:12.144671 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4d0dd-0cd1-4696-876c-143535e9ef85 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:12.152548 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380da600-3bd8-4cac-af93-8c296f5560e2 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:12.181614 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2686946-f4d9-40da-a8e1-1bc46fee53b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:12.182314 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2686946-f4d9-40da-a8e1-1bc46fee53b3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:12.182713 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2686946-f4d9-40da-a8e1-1bc46fee53b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:12.183321 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2686946-f4d9-40da-a8e1-1bc46fee53b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:12.183779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2686946-f4d9-40da-a8e1-1bc46fee53b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:12.184088 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2686946-f4d9-40da-a8e1-1bc46fee53b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:12.185547 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2686946-f4d9-40da-a8e1-1bc46fee53b3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:12.193087 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5164d-1a48-4dbe-8dbf-4bccc0836ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:12.194390 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5164d-1a48-4dbe-8dbf-4bccc0836ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:12.194875 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 131/263] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:05:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:12.195124 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5164d-1a48-4dbe-8dbf-4bccc0836ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:12.195601 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5164d-1a48-4dbe-8dbf-4bccc0836ea9 None admin] PATH_INFO: `/v3/projects/610acb294db6480e82d07e198f888163` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:12.197291 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5164d-1a48-4dbe-8dbf-4bccc0836ea9 None admin] RBAC: Authorizing `identity:get_project(project_id=610acb294db6480e82d07e198f888163)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:12.199127 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5164d-1a48-4dbe-8dbf-4bccc0836ea9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:12.200990 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2686946-f4d9-40da-a8e1-1bc46fee53b3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:12.202048 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 133/264] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:11 2022] GET /identity/v3/projects/610acb294db6480e82d07e198f888163 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:12.208113 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5164d-1a48-4dbe-8dbf-4bccc0836ea9 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:12.318128 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5164d-1a48-4dbe-8dbf-4bccc0836ea9 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:12.362563 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abffc65-37bc-4e07-a2d4-18bbd8ef3303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:12.363840 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abffc65-37bc-4e07-a2d4-18bbd8ef3303 None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:12.364328 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abffc65-37bc-4e07-a2d4-18bbd8ef3303 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:12.364848 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abffc65-37bc-4e07-a2d4-18bbd8ef3303 None admin] PATH_INFO: `/v3/projects/610acb294db6480e82d07e198f888163/users/b8f2f7f86a4e4adfb14c71084b0e989c/roles/003cb0d66fec412dbbffb071206075d5` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:12.368075 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abffc65-37bc-4e07-a2d4-18bbd8ef3303 None admin] RBAC: Authorizing `identity:create_grant(project_id=610acb294db6480e82d07e198f888163, user_id=b8f2f7f86a4e4adfb14c71084b0e989c, role_id=003cb0d66fec412dbbffb071206075d5)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:12.370626 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abffc65-37bc-4e07-a2d4-18bbd8ef3303 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:12.387391 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2686946-f4d9-40da-a8e1-1bc46fee53b3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:12.395122 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 134/265] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:05:12 2022] PUT /identity/v3/projects/610acb294db6480e82d07e198f888163/users/b8f2f7f86a4e4adfb14c71084b0e989c/roles/003cb0d66fec412dbbffb071206075d5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:05:12.467936 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2ca6c-02ef-4ea2-841a-64e4f30e19bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:12.468854 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2ca6c-02ef-4ea2-841a-64e4f30e19bb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:12.469143 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2ca6c-02ef-4ea2-841a-64e4f30e19bb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:12.469446 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2ca6c-02ef-4ea2-841a-64e4f30e19bb None admin] PATH_INFO: `/v3/users/f7d3be15542c4f4eb1c32c52c0a3ca15` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:12.474481 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2ca6c-02ef-4ea2-841a-64e4f30e19bb None admin] RBAC: Authorizing `identity:get_user(user_id=f7d3be15542c4f4eb1c32c52c0a3ca15)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:12.476013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2ca6c-02ef-4ea2-841a-64e4f30e19bb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:12.478008 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 132/266] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:05:12 2022] GET /identity/v3/users/f7d3be15542c4f4eb1c32c52c0a3ca15 => generated 283 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:12.486375 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abffc65-37bc-4e07-a2d4-18bbd8ef3303 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:12.653397 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abffc65-37bc-4e07-a2d4-18bbd8ef3303 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:12.746022 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dac978-be3e-42d1-aadb-0a4569fd4f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:12.747121 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dac978-be3e-42d1-aadb-0a4569fd4f7f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:12.747662 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dac978-be3e-42d1-aadb-0a4569fd4f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:12.749564 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dac978-be3e-42d1-aadb-0a4569fd4f7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:12.896342 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dac978-be3e-42d1-aadb-0a4569fd4f7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:12.899083 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dac978-be3e-42d1-aadb-0a4569fd4f7f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:13.079141 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 135/267] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:05:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:05:13.088136 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2ca6c-02ef-4ea2-841a-64e4f30e19bb None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:13.280397 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2ca6c-02ef-4ea2-841a-64e4f30e19bb None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:13.341933 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eba56e-19f8-4af5-9f39-8f2e794b7937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:13.343253 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eba56e-19f8-4af5-9f39-8f2e794b7937 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:13.343704 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eba56e-19f8-4af5-9f39-8f2e794b7937 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:13.344145 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eba56e-19f8-4af5-9f39-8f2e794b7937 None admin] PATH_INFO: `/v3/projects/610acb294db6480e82d07e198f888163` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:13.346214 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eba56e-19f8-4af5-9f39-8f2e794b7937 None admin] RBAC: Authorizing `identity:get_project(project_id=610acb294db6480e82d07e198f888163)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:13.348804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eba56e-19f8-4af5-9f39-8f2e794b7937 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:13.351783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 133/268] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:13 2022] GET /identity/v3/projects/610acb294db6480e82d07e198f888163 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:13.361766 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dac978-be3e-42d1-aadb-0a4569fd4f7f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:13.553085 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dac978-be3e-42d1-aadb-0a4569fd4f7f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:13.580303 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38fd9e-2c21-483b-85eb-09ba65266174 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:13.580748 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38fd9e-2c21-483b-85eb-09ba65266174 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:13.581169 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38fd9e-2c21-483b-85eb-09ba65266174 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:13.583429 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 134/269] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:13.590956 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ff964-92f4-45a4-a05d-6be7aba0ae4b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:13.591396 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ff964-92f4-45a4-a05d-6be7aba0ae4b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:13.591837 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ff964-92f4-45a4-a05d-6be7aba0ae4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:13.628051 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-305ff964-92f4-45a4-a05d-6be7aba0ae4b None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:13.629946 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-305ff964-92f4-45a4-a05d-6be7aba0ae4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:13.633305 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee66ca7-12ae-489c-8a6d-cc13cb2840a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:13.634036 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee66ca7-12ae-489c-8a6d-cc13cb2840a1 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:13.634354 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee66ca7-12ae-489c-8a6d-cc13cb2840a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:13.634637 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee66ca7-12ae-489c-8a6d-cc13cb2840a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:13.635512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee66ca7-12ae-489c-8a6d-cc13cb2840a1 None admin] RBAC: Adding query filter params (role.id=371a69f4478447a2b7170a3078173caa, scope.project.id=610acb294db6480e82d07e198f888163, user.id=f7d3be15542c4f4eb1c32c52c0a3ca15) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:13.635832 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee66ca7-12ae-489c-8a6d-cc13cb2840a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:13.637346 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee66ca7-12ae-489c-8a6d-cc13cb2840a1 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:13.654269 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 136/270] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:05:13 2022] GET /identity/v3/role_assignments?user.id=f7d3be15542c4f4eb1c32c52c0a3ca15&scope.project.id=610acb294db6480e82d07e198f888163&role.id=371a69f4478447a2b7170a3078173caa => generated 608 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:13.700557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca675a-5897-4327-aea4-343f26cc452e None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:13.701029 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca675a-5897-4327-aea4-343f26cc452e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:13.701282 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca675a-5897-4327-aea4-343f26cc452e None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:13.703934 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 137/271] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:13.715097 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909aa2c-4b5c-4459-b70d-eaa5bc935adc None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:13.715515 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909aa2c-4b5c-4459-b70d-eaa5bc935adc None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:13.715796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909aa2c-4b5c-4459-b70d-eaa5bc935adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:13.754613 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-2909aa2c-4b5c-4459-b70d-eaa5bc935adc None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:13.755874 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-2909aa2c-4b5c-4459-b70d-eaa5bc935adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:13.779825 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 135/272] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:13.822217 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ff964-92f4-45a4-a05d-6be7aba0ae4b None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:13.910692 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 138/273] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:05:13.988207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909aa2c-4b5c-4459-b70d-eaa5bc935adc None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:14.013722 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ff964-92f4-45a4-a05d-6be7aba0ae4b None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:14.078356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1de00-43cd-4312-9cee-969623ed7e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:14.079677 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1de00-43cd-4312-9cee-969623ed7e23 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:14.080184 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1de00-43cd-4312-9cee-969623ed7e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:14.080653 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1de00-43cd-4312-9cee-969623ed7e23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:14.082785 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1de00-43cd-4312-9cee-969623ed7e23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:14.085553 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1de00-43cd-4312-9cee-969623ed7e23 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:14.089084 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 136/274] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:14.096948 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1de00-43cd-4312-9cee-969623ed7e23 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:14.195348 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909aa2c-4b5c-4459-b70d-eaa5bc935adc None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:14.250158 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1de00-43cd-4312-9cee-969623ed7e23 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:14.251115 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cd0ef-e4fd-47ee-9496-d95a8f637705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:14.252287 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cd0ef-e4fd-47ee-9496-d95a8f637705 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:14.252567 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cd0ef-e4fd-47ee-9496-d95a8f637705 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:14.252894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cd0ef-e4fd-47ee-9496-d95a8f637705 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:14.266678 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cd0ef-e4fd-47ee-9496-d95a8f637705 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:14.275468 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-4e7cd0ef-e4fd-47ee-9496-d95a8f637705 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:05:14.275468 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:14.275468 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:14.275468 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:14.275468 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:14.275468 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:14.275468 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:14.275468 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:14.275468 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:14.275468 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:14.275468 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:14.275468 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:14.275468 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:14.275468 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:14.275468 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:14.275468 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:14.277123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:14.277123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:14.277123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:14.277123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:14.277123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:14.277123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:14.277123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:14.277123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:14.277123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:14.277123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:14.277123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:14.277123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:14.277123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:14.277123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:14.277123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:14.277123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:14.278729 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:14.278729 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:14.278729 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:14.278729 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:14.278729 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:14.278729 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:14.278729 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:14.278729 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:14.278729 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:14.278729 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:14.278729 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:05:14.278729 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:14.278729 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 139/275] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:14.283543 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a74187-88ee-4427-9b4d-162c9366be33 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:14.284031 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a74187-88ee-4427-9b4d-162c9366be33 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:14.285573 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a74187-88ee-4427-9b4d-162c9366be33 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:14.287946 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 140/276] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:14.289007 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a74187-88ee-4427-9b4d-162c9366be33 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:14.320898 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eeb574-3dbe-4619-a375-94e457dc3082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:14.322587 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeb574-3dbe-4619-a375-94e457dc3082 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:14.322935 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeb574-3dbe-4619-a375-94e457dc3082 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:14.323256 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeb574-3dbe-4619-a375-94e457dc3082 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:14.324365 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eeb574-3dbe-4619-a375-94e457dc3082 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:14.325864 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eeb574-3dbe-4619-a375-94e457dc3082 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:14.353625 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 137/277] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:05:14 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:05:14.355298 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74852ad-6f43-4e7e-891b-6875bb5394d8 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:14.355941 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74852ad-6f43-4e7e-891b-6875bb5394d8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:14.355941 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74852ad-6f43-4e7e-891b-6875bb5394d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:14.375918 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-c74852ad-6f43-4e7e-891b-6875bb5394d8 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:14.377194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c74852ad-6f43-4e7e-891b-6875bb5394d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:14.461104 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 138/278] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:14.476333 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a74187-88ee-4427-9b4d-162c9366be33 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:14.486511 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74852ad-6f43-4e7e-891b-6875bb5394d8 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:14.553411 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aaae67-38a8-49ab-96af-9aca9cce0dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:14.554587 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aaae67-38a8-49ab-96af-9aca9cce0dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:14.555359 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aaae67-38a8-49ab-96af-9aca9cce0dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:14.555836 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aaae67-38a8-49ab-96af-9aca9cce0dd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:14.557362 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aaae67-38a8-49ab-96af-9aca9cce0dd8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:14.558141 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aaae67-38a8-49ab-96af-9aca9cce0dd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:14.561219 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aaae67-38a8-49ab-96af-9aca9cce0dd8 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:14.581044 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 141/279] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:05:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:14.592114 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aaae67-38a8-49ab-96af-9aca9cce0dd8 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:14.687681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74852ad-6f43-4e7e-891b-6875bb5394d8 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:14.745414 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51dea6-ccd1-4e03-b9e8-f77029b610a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:14.746158 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51dea6-ccd1-4e03-b9e8-f77029b610a0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:14.746449 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51dea6-ccd1-4e03-b9e8-f77029b610a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:14.746792 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51dea6-ccd1-4e03-b9e8-f77029b610a0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:14.760699 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51dea6-ccd1-4e03-b9e8-f77029b610a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:14.769034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-7f51dea6-ccd1-4e03-b9e8-f77029b610a0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:05:14.769034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:14.769034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:14.769034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:14.769034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:14.769034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:14.769034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:14.769034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:14.769034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:14.769034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:14.769034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:14.769034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:14.769034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:14.769034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:14.769034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:14.769034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:14.770877 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:14.770877 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:14.770877 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:14.770877 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:14.770877 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:14.770877 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:14.770877 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:14.770877 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:14.770877 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:14.770877 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:14.770877 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:14.770877 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:14.770877 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:14.770877 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:14.770877 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:14.770877 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:14.772463 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:14.772463 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:14.772463 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:14.772463 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:14.772463 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:14.772463 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:14.772463 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:14.772463 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:14.772463 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:14.772463 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:14.772463 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:05:14.772463 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:14.772463 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 139/280] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:14.775025 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aaae67-38a8-49ab-96af-9aca9cce0dd8 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:14.786518 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51dea6-ccd1-4e03-b9e8-f77029b610a0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:14.852451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c279d5-7d01-4aa1-9521-3e72b5f1b95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:14.852451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c279d5-7d01-4aa1-9521-3e72b5f1b95f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:14.852451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c279d5-7d01-4aa1-9521-3e72b5f1b95f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:14.852451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c279d5-7d01-4aa1-9521-3e72b5f1b95f None admin] PATH_INFO: `/v3/users/a2e0dc9c2ce34d53831778243ef26415` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:14.873218 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c279d5-7d01-4aa1-9521-3e72b5f1b95f None admin] RBAC: Authorizing `identity:get_user(user_id=a2e0dc9c2ce34d53831778243ef26415)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:14.876002 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c279d5-7d01-4aa1-9521-3e72b5f1b95f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:14.879694 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 142/281] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:05:14 2022] GET /identity/v3/users/a2e0dc9c2ce34d53831778243ef26415 => generated 293 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:14.891561 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c279d5-7d01-4aa1-9521-3e72b5f1b95f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:15.001031 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51dea6-ccd1-4e03-b9e8-f77029b610a0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:15.073695 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96dd26-1228-4385-9b82-571f28b5f4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:15.074928 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96dd26-1228-4385-9b82-571f28b5f4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:15.075410 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96dd26-1228-4385-9b82-571f28b5f4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:15.075903 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96dd26-1228-4385-9b82-571f28b5f4b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:15.077636 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96dd26-1228-4385-9b82-571f28b5f4b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:15.078213 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96dd26-1228-4385-9b82-571f28b5f4b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:15.081144 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96dd26-1228-4385-9b82-571f28b5f4b6 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:15.100524 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 140/282] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:05:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:15.111399 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96dd26-1228-4385-9b82-571f28b5f4b6 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:15.119593 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c279d5-7d01-4aa1-9521-3e72b5f1b95f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:15.248836 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacad8a9-9422-4f5c-b639-3a61c2e4c4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:15.250023 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacad8a9-9422-4f5c-b639-3a61c2e4c4ec None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:15.250508 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacad8a9-9422-4f5c-b639-3a61c2e4c4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:15.251197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacad8a9-9422-4f5c-b639-3a61c2e4c4ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:15.252829 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacad8a9-9422-4f5c-b639-3a61c2e4c4ec None admin] RBAC: Adding query filter params (role.id=003cb0d66fec412dbbffb071206075d5, user.id=a2e0dc9c2ce34d53831778243ef26415, scope.system=all) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:15.253419 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacad8a9-9422-4f5c-b639-3a61c2e4c4ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:15.256340 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacad8a9-9422-4f5c-b639-3a61c2e4c4ec None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:15.277412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 143/283] 10.222.0.48 () {56 vars in 1308 bytes} [Mon May 9 15:05:14 2022] GET /identity/v3/role_assignments?user.id=a2e0dc9c2ce34d53831778243ef26415&scope.system=all&role.id=003cb0d66fec412dbbffb071206075d5 => generated 226 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:15.372830 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96dd26-1228-4385-9b82-571f28b5f4b6 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:15.427995 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51931d4f-5a5e-4960-a7cf-4a1e29ac5b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:15.429352 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51931d4f-5a5e-4960-a7cf-4a1e29ac5b76 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:15.429902 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51931d4f-5a5e-4960-a7cf-4a1e29ac5b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:15.430493 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51931d4f-5a5e-4960-a7cf-4a1e29ac5b76 None admin] PATH_INFO: `/v3/users/3736e70bd0084deda71a931df22c3ba7` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:15.442513 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51931d4f-5a5e-4960-a7cf-4a1e29ac5b76 None admin] RBAC: Authorizing `identity:get_user(user_id=3736e70bd0084deda71a931df22c3ba7)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:15.442513 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51931d4f-5a5e-4960-a7cf-4a1e29ac5b76 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:15.442513 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 141/284] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:05:15 2022] GET /identity/v3/users/3736e70bd0084deda71a931df22c3ba7 => generated 297 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:15.454428 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacad8a9-9422-4f5c-b639-3a61c2e4c4ec None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:15.627270 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacad8a9-9422-4f5c-b639-3a61c2e4c4ec None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:15.680103 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27810d3b-6e1d-49ec-b460-9fd19260f5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:15.680991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27810d3b-6e1d-49ec-b460-9fd19260f5cb None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:15.681331 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27810d3b-6e1d-49ec-b460-9fd19260f5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:15.682153 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27810d3b-6e1d-49ec-b460-9fd19260f5cb None admin] PATH_INFO: `/v3/projects/610acb294db6480e82d07e198f888163` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:15.683526 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27810d3b-6e1d-49ec-b460-9fd19260f5cb None admin] RBAC: Authorizing `identity:get_project(project_id=610acb294db6480e82d07e198f888163)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:15.685025 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27810d3b-6e1d-49ec-b460-9fd19260f5cb None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:15.687245 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 144/285] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:15 2022] GET /identity/v3/projects/610acb294db6480e82d07e198f888163 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:15.693170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51931d4f-5a5e-4960-a7cf-4a1e29ac5b76 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:15.848309 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51931d4f-5a5e-4960-a7cf-4a1e29ac5b76 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:15.903133 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7978e-06ab-440d-a53d-3faef14eca77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:15.903981 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7978e-06ab-440d-a53d-3faef14eca77 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:15.904268 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7978e-06ab-440d-a53d-3faef14eca77 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:15.904545 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7978e-06ab-440d-a53d-3faef14eca77 None admin] PATH_INFO: `/v3/projects/610acb294db6480e82d07e198f888163/users/3736e70bd0084deda71a931df22c3ba7/roles/7d122e00d0544c42b86e283fc846d179` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:15.911132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7978e-06ab-440d-a53d-3faef14eca77 None admin] RBAC: Authorizing `identity:create_grant(project_id=610acb294db6480e82d07e198f888163, user_id=3736e70bd0084deda71a931df22c3ba7, role_id=7d122e00d0544c42b86e283fc846d179)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:15.912647 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7978e-06ab-440d-a53d-3faef14eca77 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:15.938013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 142/286] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:05:15 2022] PUT /identity/v3/projects/610acb294db6480e82d07e198f888163/users/3736e70bd0084deda71a931df22c3ba7/roles/7d122e00d0544c42b86e283fc846d179 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:05:15.983195 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be595f95-188f-43a9-9d02-83b60409c2fc None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:15.983752 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be595f95-188f-43a9-9d02-83b60409c2fc None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:15.984235 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be595f95-188f-43a9-9d02-83b60409c2fc None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:15.987594 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 145/287] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:15.994455 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6713b5c-f347-4e0e-aeb7-0de132199a68 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:15.994824 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6713b5c-f347-4e0e-aeb7-0de132199a68 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:15.995127 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6713b5c-f347-4e0e-aeb7-0de132199a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:16.023970 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f6713b5c-f347-4e0e-aeb7-0de132199a68 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:16.025348 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f6713b5c-f347-4e0e-aeb7-0de132199a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:16.186320 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 143/288] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:16.236001 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be595f95-188f-43a9-9d02-83b60409c2fc None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:16.479385 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be595f95-188f-43a9-9d02-83b60409c2fc None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:16.560596 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada07b99-9694-4828-8dda-b27a96974756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:16.561924 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada07b99-9694-4828-8dda-b27a96974756 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:16.562441 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada07b99-9694-4828-8dda-b27a96974756 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:16.562932 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada07b99-9694-4828-8dda-b27a96974756 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:16.594356 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada07b99-9694-4828-8dda-b27a96974756 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:16.610508 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-ada07b99-9694-4828-8dda-b27a96974756 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:05:16.610508 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:16.610508 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:16.610508 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:16.610508 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:16.610508 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:16.610508 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:16.610508 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:16.610508 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:16.610508 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:16.610508 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:16.610508 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:16.610508 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:16.610508 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:16.610508 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:16.610508 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:16.611923 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:16.611923 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:16.611923 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:16.611923 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:16.611923 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:16.611923 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:16.611923 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:16.611923 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:16.611923 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:16.611923 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:16.611923 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:16.611923 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:16.611923 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:16.611923 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:16.611923 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:16.611923 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:16.614181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:16.614181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:16.614181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:16.614181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:16.614181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:16.614181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:16.614181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:16.614181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:16.614181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:16.614181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:16.614181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:05:16.614181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:16.614181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 146/289] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:16.620580 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6713b5c-f347-4e0e-aeb7-0de132199a68 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:16.847751 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6713b5c-f347-4e0e-aeb7-0de132199a68 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:16.927997 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d97598-b022-4183-8896-9891bffdfec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:16.929132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d97598-b022-4183-8896-9891bffdfec4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:16.929661 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d97598-b022-4183-8896-9891bffdfec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:16.930151 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d97598-b022-4183-8896-9891bffdfec4 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:16.932575 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d97598-b022-4183-8896-9891bffdfec4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:16.933150 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d97598-b022-4183-8896-9891bffdfec4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:16.935804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d97598-b022-4183-8896-9891bffdfec4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:16.959408 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 144/290] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:05:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:16.965624 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada07b99-9694-4828-8dda-b27a96974756 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:17.166170 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada07b99-9694-4828-8dda-b27a96974756 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:17.230772 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe938db0-2f7c-4c66-b53d-619c84ebbafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:17.232594 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe938db0-2f7c-4c66-b53d-619c84ebbafa None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:17.233179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe938db0-2f7c-4c66-b53d-619c84ebbafa None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:17.233680 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe938db0-2f7c-4c66-b53d-619c84ebbafa None admin] PATH_INFO: `/v3/users/b8f2f7f86a4e4adfb14c71084b0e989c` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:17.238734 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe938db0-2f7c-4c66-b53d-619c84ebbafa None admin] RBAC: Authorizing `identity:get_user(user_id=b8f2f7f86a4e4adfb14c71084b0e989c)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:17.242172 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe938db0-2f7c-4c66-b53d-619c84ebbafa None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:17.246933 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 147/291] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:05:16 2022] GET /identity/v3/users/b8f2f7f86a4e4adfb14c71084b0e989c => generated 297 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:17.253043 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d97598-b022-4183-8896-9891bffdfec4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:17.440633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d97598-b022-4183-8896-9891bffdfec4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:17.484101 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96a108-9e64-4b80-8255-c6c93e0b4c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:17.485482 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96a108-9e64-4b80-8255-c6c93e0b4c49 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:17.485965 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96a108-9e64-4b80-8255-c6c93e0b4c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:17.486461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96a108-9e64-4b80-8255-c6c93e0b4c49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:17.633910 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96a108-9e64-4b80-8255-c6c93e0b4c49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:17.636450 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96a108-9e64-4b80-8255-c6c93e0b4c49 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:17.796248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 145/292] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:05:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:05:17.802807 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe938db0-2f7c-4c66-b53d-619c84ebbafa None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:17.933771 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe938db0-2f7c-4c66-b53d-619c84ebbafa None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:17.972964 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb02062-1a91-449b-8205-cac3826c82d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:17.974231 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb02062-1a91-449b-8205-cac3826c82d8 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:17.974737 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb02062-1a91-449b-8205-cac3826c82d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:17.975202 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb02062-1a91-449b-8205-cac3826c82d8 None admin] PATH_INFO: `/v3/projects/610acb294db6480e82d07e198f888163` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:17.982418 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb02062-1a91-449b-8205-cac3826c82d8 None admin] RBAC: Authorizing `identity:get_project(project_id=610acb294db6480e82d07e198f888163)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:17.984338 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb02062-1a91-449b-8205-cac3826c82d8 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:17.986747 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 148/293] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:17 2022] GET /identity/v3/projects/610acb294db6480e82d07e198f888163 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:17.993349 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96a108-9e64-4b80-8255-c6c93e0b4c49 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:18.061884 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bcec2-c789-4393-a113-d2406c79aac8 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:18.062509 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bcec2-c789-4393-a113-d2406c79aac8 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:18.063120 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bcec2-c789-4393-a113-d2406c79aac8 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:18.065636 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 149/294] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:05:18.078639 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a3f9f-644b-44f1-85ad-65383f0a5e13 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:18.079729 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a3f9f-644b-44f1-85ad-65383f0a5e13 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:18.080216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a3f9f-644b-44f1-85ad-65383f0a5e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:18.112962 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-904a3f9f-644b-44f1-85ad-65383f0a5e13 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:18.114527 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-904a3f9f-644b-44f1-85ad-65383f0a5e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:18.192528 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 150/295] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:18.236049 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96a108-9e64-4b80-8255-c6c93e0b4c49 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:18.247277 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a3f9f-644b-44f1-85ad-65383f0a5e13 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:18.321520 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d76d17-038a-4042-a275-313c69bf6f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:18.324138 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d76d17-038a-4042-a275-313c69bf6f10 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:18.324637 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d76d17-038a-4042-a275-313c69bf6f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:18.325135 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d76d17-038a-4042-a275-313c69bf6f10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:18.326875 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d76d17-038a-4042-a275-313c69bf6f10 None admin] RBAC: Adding query filter params (role.id=003cb0d66fec412dbbffb071206075d5, scope.project.id=610acb294db6480e82d07e198f888163, user.id=b8f2f7f86a4e4adfb14c71084b0e989c) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:18.327442 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d76d17-038a-4042-a275-313c69bf6f10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:18.330256 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d76d17-038a-4042-a275-313c69bf6f10 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:18.343092 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 146/296] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:05:17 2022] GET /identity/v3/role_assignments?user.id=b8f2f7f86a4e4adfb14c71084b0e989c&scope.project.id=610acb294db6480e82d07e198f888163&role.id=003cb0d66fec412dbbffb071206075d5 => generated 608 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:18.345466 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bc50f-41ee-4d84-8bc2-b60788e949a6 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:18.346244 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bc50f-41ee-4d84-8bc2-b60788e949a6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:18.346457 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bc50f-41ee-4d84-8bc2-b60788e949a6 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:18.357122 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 147/297] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:18.359880 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ec65b-8f41-4473-a4a0-e7be01fab5e3 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:18.360877 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ec65b-8f41-4473-a4a0-e7be01fab5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:18.360877 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ec65b-8f41-4473-a4a0-e7be01fab5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:18.387268 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a3f9f-644b-44f1-85ad-65383f0a5e13 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:18.390996 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ed1ec65b-8f41-4473-a4a0-e7be01fab5e3 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:18.392152 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ed1ec65b-8f41-4473-a4a0-e7be01fab5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:18.427267 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef3344-7316-4727-acdc-2cb612eb7a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:18.428393 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef3344-7316-4727-acdc-2cb612eb7a46 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:18.428914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef3344-7316-4727-acdc-2cb612eb7a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:18.429455 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef3344-7316-4727-acdc-2cb612eb7a46 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:18.442039 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef3344-7316-4727-acdc-2cb612eb7a46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:18.451008 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-0fef3344-7316-4727-acdc-2cb612eb7a46 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:05:18.451008 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:18.451008 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:18.451008 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:18.451008 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:18.451008 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:18.451008 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:18.451008 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:18.451008 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:18.451008 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:18.451008 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:18.451008 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:18.451008 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:18.451008 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:18.451008 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:18.451008 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:18.451975 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:18.451975 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:18.451975 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:18.451975 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:18.451975 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:18.451975 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:18.451975 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:18.451975 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:18.451975 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:18.451975 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:18.451975 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:18.451975 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:18.451975 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:18.451975 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:18.451975 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:18.451975 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:18.452770 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:18.452770 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:18.452770 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:18.452770 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:18.452770 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:18.452770 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:18.452770 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:18.452770 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:18.452770 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:18.452770 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:18.452770 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:05:18.452770 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:18.455911 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 151/298] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:18.466502 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef3344-7316-4727-acdc-2cb612eb7a46 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:18.583303 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 148/299] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:18.588101 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef3344-7316-4727-acdc-2cb612eb7a46 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:18.626919 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb563fc-1e74-419e-8a82-e4d1a1e1e719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:18.628025 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb563fc-1e74-419e-8a82-e4d1a1e1e719 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:18.628613 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb563fc-1e74-419e-8a82-e4d1a1e1e719 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:18.629120 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb563fc-1e74-419e-8a82-e4d1a1e1e719 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:18.630145 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb563fc-1e74-419e-8a82-e4d1a1e1e719 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:18.630676 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb563fc-1e74-419e-8a82-e4d1a1e1e719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:18.632335 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb563fc-1e74-419e-8a82-e4d1a1e1e719 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:18.643431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 152/300] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:05:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:18.648951 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ec65b-8f41-4473-a4a0-e7be01fab5e3 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:18.650749 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb563fc-1e74-419e-8a82-e4d1a1e1e719 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:18.772731 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb563fc-1e74-419e-8a82-e4d1a1e1e719 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:18.814924 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0390e-3c62-4db5-8818-03f6d3b44370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:18.815845 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0390e-3c62-4db5-8818-03f6d3b44370 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:18.816134 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0390e-3c62-4db5-8818-03f6d3b44370 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:18.816426 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0390e-3c62-4db5-8818-03f6d3b44370 None admin] PATH_INFO: `/v3/users/133cf52ca05540c6a61d58b6175bed02` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:18.865069 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0390e-3c62-4db5-8818-03f6d3b44370 None admin] RBAC: Authorizing `identity:get_user(user_id=133cf52ca05540c6a61d58b6175bed02)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:18.867620 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0390e-3c62-4db5-8818-03f6d3b44370 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:18.871697 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 153/301] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:05:18 2022] GET /identity/v3/users/133cf52ca05540c6a61d58b6175bed02 => generated 293 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:18.877605 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0390e-3c62-4db5-8818-03f6d3b44370 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:18.899054 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ec65b-8f41-4473-a4a0-e7be01fab5e3 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:18.962967 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b2f40-19c6-4a06-b4fe-6daa532bdcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:18.964398 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b2f40-19c6-4a06-b4fe-6daa532bdcdd None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:18.964915 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b2f40-19c6-4a06-b4fe-6daa532bdcdd None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:18.965504 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b2f40-19c6-4a06-b4fe-6daa532bdcdd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:18.967740 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b2f40-19c6-4a06-b4fe-6daa532bdcdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:18.970348 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b2f40-19c6-4a06-b4fe-6daa532bdcdd None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:18.974259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 149/302] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:18.983418 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b2f40-19c6-4a06-b4fe-6daa532bdcdd None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:19.016012 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0390e-3c62-4db5-8818-03f6d3b44370 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:19.061286 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e38af7-220b-42bb-b1a6-559c55f128a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:19.062086 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e38af7-220b-42bb-b1a6-559c55f128a4 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:19.062371 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e38af7-220b-42bb-b1a6-559c55f128a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:19.062643 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e38af7-220b-42bb-b1a6-559c55f128a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:19.063485 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e38af7-220b-42bb-b1a6-559c55f128a4 None admin] RBAC: Adding query filter params (role.id=7d122e00d0544c42b86e283fc846d179, user.id=133cf52ca05540c6a61d58b6175bed02, scope.system=all) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:19.063794 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e38af7-220b-42bb-b1a6-559c55f128a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:19.065363 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e38af7-220b-42bb-b1a6-559c55f128a4 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:19.071324 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 154/303] 10.222.0.48 () {56 vars in 1308 bytes} [Mon May 9 15:05:18 2022] GET /identity/v3/role_assignments?user.id=133cf52ca05540c6a61d58b6175bed02&scope.system=all&role.id=7d122e00d0544c42b86e283fc846d179 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:19.162033 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b2f40-19c6-4a06-b4fe-6daa532bdcdd None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:19.223671 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5859e0-295f-428e-87f8-6035bea51e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:19.225004 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5859e0-295f-428e-87f8-6035bea51e59 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:19.225538 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5859e0-295f-428e-87f8-6035bea51e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:19.226025 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5859e0-295f-428e-87f8-6035bea51e59 None admin] PATH_INFO: `/v3/groups` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:19.227408 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5859e0-295f-428e-87f8-6035bea51e59 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:19.231708 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5859e0-295f-428e-87f8-6035bea51e59 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:19.257197 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 150/304] 10.222.0.48 () {60 vars in 1134 bytes} [Mon May 9 15:05:18 2022] POST /identity/v3/groups => generated 229 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:05:19.549925 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e98b0a-a9db-4eaf-9be8-e2b6e55257b8 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:19.550434 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e98b0a-a9db-4eaf-9be8-e2b6e55257b8 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:19.550931 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e98b0a-a9db-4eaf-9be8-e2b6e55257b8 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:19.555274 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 155/305] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:19.560500 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11331298-5dbb-46f3-9b54-5bb9812f8350 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:19.560849 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11331298-5dbb-46f3-9b54-5bb9812f8350 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:19.561057 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11331298-5dbb-46f3-9b54-5bb9812f8350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:19.580249 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-11331298-5dbb-46f3-9b54-5bb9812f8350 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:19.581529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-11331298-5dbb-46f3-9b54-5bb9812f8350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:19.669303 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 151/306] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:19.692206 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e98b0a-a9db-4eaf-9be8-e2b6e55257b8 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:19.818071 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e98b0a-a9db-4eaf-9be8-e2b6e55257b8 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:19.860632 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6952a1c-792b-4109-acdb-ec5222d8735e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:19.861462 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6952a1c-792b-4109-acdb-ec5222d8735e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:19.861899 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6952a1c-792b-4109-acdb-ec5222d8735e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:19.862168 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6952a1c-792b-4109-acdb-ec5222d8735e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:19.876112 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6952a1c-792b-4109-acdb-ec5222d8735e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:19.886151 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-a6952a1c-792b-4109-acdb-ec5222d8735e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:05:19.886151 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:19.886151 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:19.886151 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:19.886151 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:19.886151 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:19.886151 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:19.886151 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:19.886151 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:19.886151 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:19.886151 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:19.886151 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:19.886151 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:19.886151 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:19.886151 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:19.886151 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:19.888665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:19.888665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:19.888665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:19.888665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:19.888665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:19.888665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:19.888665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:19.888665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:19.888665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:19.888665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:19.888665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:19.888665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:19.888665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:19.888665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:19.888665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:19.888665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:19.890792 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:19.890792 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:19.890792 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:19.890792 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:19.890792 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:19.890792 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:19.890792 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:19.890792 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:19.890792 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:19.890792 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:19.890792 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:05:19.890792 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:19.890792 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 156/307] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:19.894479 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11331298-5dbb-46f3-9b54-5bb9812f8350 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:19.930069 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e227bb-7798-455b-a370-66a2f9c3e6f1 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:19.930780 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e227bb-7798-455b-a370-66a2f9c3e6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:19.931977 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e227bb-7798-455b-a370-66a2f9c3e6f1 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:19.934556 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 157/308] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:05:19.941406 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0757b-c500-4cea-ac5d-420fa70ea724 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:19.941753 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0757b-c500-4cea-ac5d-420fa70ea724 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:19.941971 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0757b-c500-4cea-ac5d-420fa70ea724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:19.964446 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-e9b0757b-c500-4cea-ac5d-420fa70ea724 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:19.965747 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e9b0757b-c500-4cea-ac5d-420fa70ea724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:20.015792 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11331298-5dbb-46f3-9b54-5bb9812f8350 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:20.044853 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 158/309] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:05:20.054430 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6adf6b6-ca80-42b6-83c1-f71c3ae24911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:20.055370 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adf6b6-ca80-42b6-83c1-f71c3ae24911 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:20.055797 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adf6b6-ca80-42b6-83c1-f71c3ae24911 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:20.056286 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adf6b6-ca80-42b6-83c1-f71c3ae24911 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:20.057213 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6adf6b6-ca80-42b6-83c1-f71c3ae24911 None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:20.057696 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6adf6b6-ca80-42b6-83c1-f71c3ae24911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:20.059232 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6adf6b6-ca80-42b6-83c1-f71c3ae24911 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:20.068658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 152/310] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:05:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:20.074726 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0757b-c500-4cea-ac5d-420fa70ea724 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:20.075935 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6adf6b6-ca80-42b6-83c1-f71c3ae24911 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:20.200272 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6adf6b6-ca80-42b6-83c1-f71c3ae24911 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:20.203157 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0757b-c500-4cea-ac5d-420fa70ea724 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:20.251271 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da457941-3f29-40d3-a572-7202e3d27962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:20.252204 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da457941-3f29-40d3-a572-7202e3d27962 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:20.252579 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da457941-3f29-40d3-a572-7202e3d27962 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:20.253108 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da457941-3f29-40d3-a572-7202e3d27962 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:20.253961 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375e587-6d62-4d99-85cf-5b564079d009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:20.255740 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375e587-6d62-4d99-85cf-5b564079d009 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:20.256523 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375e587-6d62-4d99-85cf-5b564079d009 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:20.257270 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375e587-6d62-4d99-85cf-5b564079d009 None admin] PATH_INFO: `/v3/users/a2e0dc9c2ce34d53831778243ef26415` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:20.260604 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375e587-6d62-4d99-85cf-5b564079d009 None admin] RBAC: Authorizing `identity:get_user(user_id=a2e0dc9c2ce34d53831778243ef26415)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:20.262800 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375e587-6d62-4d99-85cf-5b564079d009 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:20.270634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da457941-3f29-40d3-a572-7202e3d27962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:20.271358 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 153/311] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:05:20 2022] GET /identity/v3/users/a2e0dc9c2ce34d53831778243ef26415 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:20.272559 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375e587-6d62-4d99-85cf-5b564079d009 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:20.275570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-da457941-3f29-40d3-a572-7202e3d27962 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:05:20.275570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:20.275570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:20.275570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:20.275570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:20.275570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:20.275570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:20.275570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:20.275570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:20.275570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:20.275570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:20.275570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:20.275570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:20.275570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:20.275570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:20.275570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:20.277574 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:20.277574 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:20.277574 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:20.277574 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:20.277574 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:20.277574 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:20.277574 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:20.277574 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:20.277574 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:20.277574 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:20.277574 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:20.277574 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:20.277574 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:20.277574 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:20.277574 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:20.277574 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:20.279205 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:20.279205 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:20.279205 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:20.279205 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:20.279205 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:20.279205 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:20.279205 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:20.279205 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:20.279205 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:20.279205 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:20.279205 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:05:20.279205 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:20.279205 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 159/312] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:05:20.288978 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da457941-3f29-40d3-a572-7202e3d27962 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:20.426103 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375e587-6d62-4d99-85cf-5b564079d009 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:20.443294 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da457941-3f29-40d3-a572-7202e3d27962 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:20.472735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241145a-67b9-449d-9754-76c6d63c8f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:20.474643 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241145a-67b9-449d-9754-76c6d63c8f21 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:20.474956 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241145a-67b9-449d-9754-76c6d63c8f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:20.475215 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241145a-67b9-449d-9754-76c6d63c8f21 None admin] PATH_INFO: `/v3/system/users/a2e0dc9c2ce34d53831778243ef26415/roles/003cb0d66fec412dbbffb071206075d5` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:20.476924 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241145a-67b9-449d-9754-76c6d63c8f21 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a2e0dc9c2ce34d53831778243ef26415, role_id=003cb0d66fec412dbbffb071206075d5)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:20.479029 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241145a-67b9-449d-9754-76c6d63c8f21 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:20.491246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 154/313] 10.222.0.48 () {58 vars in 1334 bytes} [Mon May 9 15:05:20 2022] PUT /identity/v3/system/users/a2e0dc9c2ce34d53831778243ef26415/roles/003cb0d66fec412dbbffb071206075d5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:05:20.508656 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c195a4-379e-4b20-b331-a072c9e3fa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:20.510374 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c195a4-379e-4b20-b331-a072c9e3fa19 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:20.510374 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c195a4-379e-4b20-b331-a072c9e3fa19 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:20.510374 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c195a4-379e-4b20-b331-a072c9e3fa19 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:20.511434 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c195a4-379e-4b20-b331-a072c9e3fa19 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:20.511803 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c195a4-379e-4b20-b331-a072c9e3fa19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:20.513798 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c195a4-379e-4b20-b331-a072c9e3fa19 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:20.526981 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 160/314] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:05:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:20.538711 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241145a-67b9-449d-9754-76c6d63c8f21 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:20.670893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241145a-67b9-449d-9754-76c6d63c8f21 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:20.717944 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5577062-eb4d-419b-8c78-a3cf25ff9a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:20.719298 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5577062-eb4d-419b-8c78-a3cf25ff9a51 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:20.719769 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5577062-eb4d-419b-8c78-a3cf25ff9a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:20.720059 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5577062-eb4d-419b-8c78-a3cf25ff9a51 None admin] PATH_INFO: `/v3/users/3736e70bd0084deda71a931df22c3ba7` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:20.721756 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5577062-eb4d-419b-8c78-a3cf25ff9a51 None admin] RBAC: Authorizing `identity:get_user(user_id=3736e70bd0084deda71a931df22c3ba7)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:20.723533 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5577062-eb4d-419b-8c78-a3cf25ff9a51 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:20.725454 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 155/315] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:05:20 2022] GET /identity/v3/users/3736e70bd0084deda71a931df22c3ba7 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:20.732173 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c195a4-379e-4b20-b331-a072c9e3fa19 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:20.878605 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c195a4-379e-4b20-b331-a072c9e3fa19 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:20.928480 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f787c61-fcf2-41a9-bd4a-81c569113f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:20.929608 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f787c61-fcf2-41a9-bd4a-81c569113f54 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:20.930141 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f787c61-fcf2-41a9-bd4a-81c569113f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:20.930672 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f787c61-fcf2-41a9-bd4a-81c569113f54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:21.021544 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f787c61-fcf2-41a9-bd4a-81c569113f54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:21.023386 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f787c61-fcf2-41a9-bd4a-81c569113f54 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:21.146059 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 161/316] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:05:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:05:21.153741 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5577062-eb4d-419b-8c78-a3cf25ff9a51 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:21.308661 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5577062-eb4d-419b-8c78-a3cf25ff9a51 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:21.352039 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cac3d-238e-456d-9117-51081e7a9628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:21.353481 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cac3d-238e-456d-9117-51081e7a9628 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:21.353781 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cac3d-238e-456d-9117-51081e7a9628 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:21.354059 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cac3d-238e-456d-9117-51081e7a9628 None admin] PATH_INFO: `/v3/projects/610acb294db6480e82d07e198f888163` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:21.355389 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cac3d-238e-456d-9117-51081e7a9628 None admin] RBAC: Authorizing `identity:get_project(project_id=610acb294db6480e82d07e198f888163)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:21.356896 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cac3d-238e-456d-9117-51081e7a9628 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:21.358755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 156/317] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:21 2022] GET /identity/v3/projects/610acb294db6480e82d07e198f888163 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:21.366273 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f787c61-fcf2-41a9-bd4a-81c569113f54 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:21.510612 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f787c61-fcf2-41a9-bd4a-81c569113f54 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:21.551652 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861d6d5-4fe5-4482-87ad-0863ca936e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:21.552320 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861d6d5-4fe5-4482-87ad-0863ca936e1d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:21.552606 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861d6d5-4fe5-4482-87ad-0863ca936e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:21.552887 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861d6d5-4fe5-4482-87ad-0863ca936e1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:21.553853 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861d6d5-4fe5-4482-87ad-0863ca936e1d None admin] RBAC: Adding query filter params (role.id=7d122e00d0544c42b86e283fc846d179, scope.project.id=610acb294db6480e82d07e198f888163, user.id=3736e70bd0084deda71a931df22c3ba7) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:21.554172 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861d6d5-4fe5-4482-87ad-0863ca936e1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:21.555715 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861d6d5-4fe5-4482-87ad-0863ca936e1d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:21.563596 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 162/318] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:05:21 2022] GET /identity/v3/role_assignments?user.id=3736e70bd0084deda71a931df22c3ba7&scope.project.id=610acb294db6480e82d07e198f888163&role.id=7d122e00d0544c42b86e283fc846d179 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:21.610937 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e5f5a-6114-46d8-bb38-ac9c44e6937c None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:21.611208 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e5f5a-6114-46d8-bb38-ac9c44e6937c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:21.611501 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e5f5a-6114-46d8-bb38-ac9c44e6937c None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:21.613406 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 157/319] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:21.620315 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b33e08-d0d6-4ffe-8d6f-d4e155bd744f None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:21.620751 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b33e08-d0d6-4ffe-8d6f-d4e155bd744f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:21.621009 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b33e08-d0d6-4ffe-8d6f-d4e155bd744f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:21.640536 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-63b33e08-d0d6-4ffe-8d6f-d4e155bd744f None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:21.641898 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-63b33e08-d0d6-4ffe-8d6f-d4e155bd744f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:21.724351 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 163/320] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:21.749908 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e5f5a-6114-46d8-bb38-ac9c44e6937c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:21.871283 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e5f5a-6114-46d8-bb38-ac9c44e6937c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:21.912009 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d3382-79d4-403e-bfad-342c5856b979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:21.912954 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d3382-79d4-403e-bfad-342c5856b979 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:21.913243 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d3382-79d4-403e-bfad-342c5856b979 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:21.913562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d3382-79d4-403e-bfad-342c5856b979 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:21.925550 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d3382-79d4-403e-bfad-342c5856b979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:21.935133 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-fc0d3382-79d4-403e-bfad-342c5856b979 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:05:21.935133 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:21.935133 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:21.935133 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:21.935133 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:21.935133 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:21.935133 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:21.935133 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:21.935133 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:21.935133 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:21.935133 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:21.935133 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:21.935133 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:21.935133 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:21.935133 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:21.935133 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:21.938045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:21.938045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:21.938045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:21.938045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:21.938045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:21.938045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:21.938045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:21.938045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:21.938045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:21.938045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:21.938045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:21.938045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:21.938045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:21.938045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:21.938045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:21.938045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:21.939977 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:21.939977 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:21.939977 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:21.939977 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:21.939977 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:21.939977 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:21.939977 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:21.939977 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:21.939977 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:21.939977 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:21.939977 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:05:21.939977 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:21.939977 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 158/321] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:21.944145 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b33e08-d0d6-4ffe-8d6f-d4e155bd744f None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:22.059784 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b33e08-d0d6-4ffe-8d6f-d4e155bd744f None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:22.067701 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353376b-9607-48a5-ba96-4823d7563a0d None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:22.067982 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353376b-9607-48a5-ba96-4823d7563a0d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:22.068270 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353376b-9607-48a5-ba96-4823d7563a0d None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:22.069826 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 159/322] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:05:22.075745 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5eea8-dd9f-4998-9a22-6c1068d4a542 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:22.076028 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5eea8-dd9f-4998-9a22-6c1068d4a542 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:22.076395 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5eea8-dd9f-4998-9a22-6c1068d4a542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:22.094777 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-1ba5eea8-dd9f-4998-9a22-6c1068d4a542 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:22.096151 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1ba5eea8-dd9f-4998-9a22-6c1068d4a542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:22.105020 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310c8b6-ee23-4b40-a4e0-e9c68f27512d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:22.106147 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310c8b6-ee23-4b40-a4e0-e9c68f27512d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:22.106626 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310c8b6-ee23-4b40-a4e0-e9c68f27512d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:22.107123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310c8b6-ee23-4b40-a4e0-e9c68f27512d None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:22.108550 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310c8b6-ee23-4b40-a4e0-e9c68f27512d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:22.109053 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310c8b6-ee23-4b40-a4e0-e9c68f27512d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:22.110929 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310c8b6-ee23-4b40-a4e0-e9c68f27512d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:22.125131 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 164/323] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:05:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:22.132272 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310c8b6-ee23-4b40-a4e0-e9c68f27512d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:22.181666 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 160/324] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:05:22.203051 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5eea8-dd9f-4998-9a22-6c1068d4a542 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:22.268861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310c8b6-ee23-4b40-a4e0-e9c68f27512d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:22.315237 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334e032-9f92-41ac-b8dc-b39ae0bb8265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:22.316153 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334e032-9f92-41ac-b8dc-b39ae0bb8265 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:22.316510 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334e032-9f92-41ac-b8dc-b39ae0bb8265 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:22.316790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334e032-9f92-41ac-b8dc-b39ae0bb8265 None admin] PATH_INFO: `/v3/users/133cf52ca05540c6a61d58b6175bed02` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:22.318043 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334e032-9f92-41ac-b8dc-b39ae0bb8265 None admin] RBAC: Authorizing `identity:get_user(user_id=133cf52ca05540c6a61d58b6175bed02)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:22.319706 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334e032-9f92-41ac-b8dc-b39ae0bb8265 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:22.329657 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 165/325] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:05:22 2022] GET /identity/v3/users/133cf52ca05540c6a61d58b6175bed02 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:22.331254 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334e032-9f92-41ac-b8dc-b39ae0bb8265 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:22.350063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5eea8-dd9f-4998-9a22-6c1068d4a542 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:22.407641 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7676e9-9224-45b5-894d-424d6a914c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:22.408783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7676e9-9224-45b5-894d-424d6a914c20 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:22.409257 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7676e9-9224-45b5-894d-424d6a914c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:22.413106 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7676e9-9224-45b5-894d-424d6a914c20 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:22.413928 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7676e9-9224-45b5-894d-424d6a914c20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:22.416061 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7676e9-9224-45b5-894d-424d6a914c20 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:22.418760 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 161/326] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:22.427099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7676e9-9224-45b5-894d-424d6a914c20 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:22.497867 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334e032-9f92-41ac-b8dc-b39ae0bb8265 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:22.551867 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c708786-07c6-4591-8d71-f8ff6fd994cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:22.552878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c708786-07c6-4591-8d71-f8ff6fd994cc None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:22.553248 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c708786-07c6-4591-8d71-f8ff6fd994cc None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:22.554077 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c708786-07c6-4591-8d71-f8ff6fd994cc None admin] PATH_INFO: `/v3/system/users/133cf52ca05540c6a61d58b6175bed02/roles/7d122e00d0544c42b86e283fc846d179` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:22.556825 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c708786-07c6-4591-8d71-f8ff6fd994cc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=133cf52ca05540c6a61d58b6175bed02, role_id=7d122e00d0544c42b86e283fc846d179)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:22.560651 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c708786-07c6-4591-8d71-f8ff6fd994cc None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:22.574440 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7676e9-9224-45b5-894d-424d6a914c20 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:22.585401 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 166/327] 10.222.0.48 () {58 vars in 1334 bytes} [Mon May 9 15:05:22 2022] PUT /identity/v3/system/users/133cf52ca05540c6a61d58b6175bed02/roles/7d122e00d0544c42b86e283fc846d179 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:05:22.636307 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6e528-292e-45a1-818d-ebfdf28b77af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:22.637307 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6e528-292e-45a1-818d-ebfdf28b77af None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:22.637640 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6e528-292e-45a1-818d-ebfdf28b77af None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:22.637925 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6e528-292e-45a1-818d-ebfdf28b77af None admin] PATH_INFO: `/v3/groups` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:22.639076 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6e528-292e-45a1-818d-ebfdf28b77af None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:22.641044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6e528-292e-45a1-818d-ebfdf28b77af None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:22.667562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 162/328] 10.222.0.48 () {60 vars in 1134 bytes} [Mon May 9 15:05:22 2022] POST /identity/v3/groups => generated 226 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:05:23.491174 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186321f-28b6-46b4-947b-d316faf93ce2 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:23.491716 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186321f-28b6-46b4-947b-d316faf93ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:23.492185 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186321f-28b6-46b4-947b-d316faf93ce2 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:23.495400 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 167/329] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:23.505614 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354e180-89e6-48de-aa36-5febc32178c9 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:23.507044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354e180-89e6-48de-aa36-5febc32178c9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:23.507863 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354e180-89e6-48de-aa36-5febc32178c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:23.534464 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-1354e180-89e6-48de-aa36-5febc32178c9 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:23.536908 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1354e180-89e6-48de-aa36-5febc32178c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:23.655967 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 163/330] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:23.684439 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186321f-28b6-46b4-947b-d316faf93ce2 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:23.905441 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186321f-28b6-46b4-947b-d316faf93ce2 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:23.971211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f550b-61ae-4f34-8bbd-a77e66b0da63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:23.972546 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f550b-61ae-4f34-8bbd-a77e66b0da63 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:23.973000 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f550b-61ae-4f34-8bbd-a77e66b0da63 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:23.973557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f550b-61ae-4f34-8bbd-a77e66b0da63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:23.998196 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f550b-61ae-4f34-8bbd-a77e66b0da63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:24.013921 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-d66f550b-61ae-4f34-8bbd-a77e66b0da63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:05:24.013921 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:24.013921 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:24.013921 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:24.013921 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:24.013921 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:24.013921 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:24.013921 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:24.013921 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:24.013921 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:24.013921 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:24.013921 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:24.013921 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:24.013921 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:24.013921 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:24.013921 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:24.014974 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:24.014974 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:24.014974 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:24.014974 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:24.014974 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:24.014974 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:24.014974 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:24.014974 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:24.014974 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:24.014974 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:24.014974 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:24.014974 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:24.014974 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:24.014974 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:24.014974 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:24.014974 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:24.015772 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:24.015772 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:24.015772 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:24.015772 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:24.015772 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:24.015772 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:24.015772 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:24.015772 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:24.015772 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:24.015772 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:24.015772 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:05:24.015772 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:24.016882 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 168/331] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:05:24.029404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354e180-89e6-48de-aa36-5febc32178c9 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:24.166258 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354e180-89e6-48de-aa36-5febc32178c9 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:24.219411 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2df92b-3340-4408-9aaa-335480c30615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:24.220423 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2df92b-3340-4408-9aaa-335480c30615 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:24.220869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2df92b-3340-4408-9aaa-335480c30615 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:24.221394 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2df92b-3340-4408-9aaa-335480c30615 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:24.222402 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2df92b-3340-4408-9aaa-335480c30615 None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:24.222886 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2df92b-3340-4408-9aaa-335480c30615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:24.224541 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2df92b-3340-4408-9aaa-335480c30615 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:24.240510 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 164/332] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:05:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:24.248194 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f550b-61ae-4f34-8bbd-a77e66b0da63 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:24.492500 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f550b-61ae-4f34-8bbd-a77e66b0da63 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:24.548469 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5dc388-62b1-4463-8b70-861ee0944d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:24.549845 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5dc388-62b1-4463-8b70-861ee0944d3b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:24.550349 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5dc388-62b1-4463-8b70-861ee0944d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:24.550841 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5dc388-62b1-4463-8b70-861ee0944d3b None admin] PATH_INFO: `/v3/users/a2e0dc9c2ce34d53831778243ef26415` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:24.552418 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5dc388-62b1-4463-8b70-861ee0944d3b None admin] RBAC: Authorizing `identity:get_user(user_id=a2e0dc9c2ce34d53831778243ef26415)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:24.554156 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5dc388-62b1-4463-8b70-861ee0944d3b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:24.556792 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 169/333] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:05:24 2022] GET /identity/v3/users/a2e0dc9c2ce34d53831778243ef26415 => generated 293 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:24.563988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2df92b-3340-4408-9aaa-335480c30615 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:24.697533 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2df92b-3340-4408-9aaa-335480c30615 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:24.741137 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a4b77-5f4b-45a9-b11e-2a9c63a666dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:24.742253 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a4b77-5f4b-45a9-b11e-2a9c63a666dc None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:24.742882 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a4b77-5f4b-45a9-b11e-2a9c63a666dc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:24.743421 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a4b77-5f4b-45a9-b11e-2a9c63a666dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:24.744699 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a4b77-5f4b-45a9-b11e-2a9c63a666dc None admin] RBAC: Adding query filter params (role.id=003cb0d66fec412dbbffb071206075d5, user.id=a2e0dc9c2ce34d53831778243ef26415, scope.system=all) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:24.745232 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a4b77-5f4b-45a9-b11e-2a9c63a666dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:24.746947 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a4b77-5f4b-45a9-b11e-2a9c63a666dc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:24.765403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 165/334] 10.222.0.48 () {56 vars in 1308 bytes} [Mon May 9 15:05:24 2022] GET /identity/v3/role_assignments?user.id=a2e0dc9c2ce34d53831778243ef26415&scope.system=all&role.id=003cb0d66fec412dbbffb071206075d5 => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:25.993050 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6d847-3949-4091-9963-9e3275da761a None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:25.995223 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6d847-3949-4091-9963-9e3275da761a None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:25.995966 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6d847-3949-4091-9963-9e3275da761a None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:25.999488 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 170/335] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:05:26.004646 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e7ed2-3014-4b2f-8968-18b682bbcbd3 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:26.005642 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e7ed2-3014-4b2f-8968-18b682bbcbd3 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:26.006142 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e7ed2-3014-4b2f-8968-18b682bbcbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:26.034669 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e37e7ed2-3014-4b2f-8968-18b682bbcbd3 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:26.036257 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e37e7ed2-3014-4b2f-8968-18b682bbcbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:26.151357 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 166/336] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:26.208651 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6d847-3949-4091-9963-9e3275da761a None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:26.333527 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6d847-3949-4091-9963-9e3275da761a None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:26.377024 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f93e3-a677-466f-b261-59e824da80ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:26.377867 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f93e3-a677-466f-b261-59e824da80ec None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:26.378149 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f93e3-a677-466f-b261-59e824da80ec None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:26.378483 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f93e3-a677-466f-b261-59e824da80ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:26.392054 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f93e3-a677-466f-b261-59e824da80ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:26.401184 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-818f93e3-a677-466f-b261-59e824da80ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:05:26.401184 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:26.401184 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:26.401184 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:26.401184 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:26.401184 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:26.401184 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:26.401184 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:26.401184 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:26.401184 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:26.401184 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:26.401184 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:26.401184 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:26.401184 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:26.401184 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:26.401184 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:26.402393 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:26.402393 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:26.402393 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:26.402393 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:26.402393 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:26.402393 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:26.402393 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:26.402393 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:26.402393 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:26.402393 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:26.402393 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:26.402393 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:26.402393 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:26.402393 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:26.402393 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:26.402393 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:26.403565 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:26.403565 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:26.403565 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:26.403565 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:26.403565 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:26.403565 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:26.403565 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:26.403565 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:26.403565 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:26.403565 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:26.403565 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:05:26.403565 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:26.403565 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 171/337] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:26.416721 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e7ed2-3014-4b2f-8968-18b682bbcbd3 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:26.575436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e7ed2-3014-4b2f-8968-18b682bbcbd3 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:26.617320 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba498e-f3f4-4b03-90b9-e3c1c056f162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:26.618450 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba498e-f3f4-4b03-90b9-e3c1c056f162 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:26.619582 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba498e-f3f4-4b03-90b9-e3c1c056f162 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:26.620000 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba498e-f3f4-4b03-90b9-e3c1c056f162 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:26.620947 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba498e-f3f4-4b03-90b9-e3c1c056f162 None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:26.621553 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba498e-f3f4-4b03-90b9-e3c1c056f162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:26.623275 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba498e-f3f4-4b03-90b9-e3c1c056f162 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:26.638301 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 167/338] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:05:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:26.646682 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f93e3-a677-466f-b261-59e824da80ec None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:26.804288 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f93e3-a677-466f-b261-59e824da80ec None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:26.849358 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdcf39-f3b3-4247-b489-1567ff748fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:26.850428 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdcf39-f3b3-4247-b489-1567ff748fea None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:26.850717 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdcf39-f3b3-4247-b489-1567ff748fea None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:26.851093 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdcf39-f3b3-4247-b489-1567ff748fea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:26.939098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdcf39-f3b3-4247-b489-1567ff748fea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:26.940663 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdcf39-f3b3-4247-b489-1567ff748fea None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:26.970682 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875360e-7898-4f41-a497-407822bdb713 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:26.971350 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875360e-7898-4f41-a497-407822bdb713 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:26.971831 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875360e-7898-4f41-a497-407822bdb713 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:26.973611 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 168/339] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:26.982816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887be935-225e-4d8e-8b31-dcec8f1aba2b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:26.983432 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887be935-225e-4d8e-8b31-dcec8f1aba2b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:26.983952 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887be935-225e-4d8e-8b31-dcec8f1aba2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:27.022611 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-887be935-225e-4d8e-8b31-dcec8f1aba2b None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:27.024688 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-887be935-225e-4d8e-8b31-dcec8f1aba2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:27.050244 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 172/340] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:05:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:05:27.056696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdcf39-f3b3-4247-b489-1567ff748fea None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:27.160363 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 169/341] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:27.171873 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdcf39-f3b3-4247-b489-1567ff748fea None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:27.210998 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af656d2-6be6-4022-9e34-fa247d131a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:27.212227 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af656d2-6be6-4022-9e34-fa247d131a31 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:27.213154 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af656d2-6be6-4022-9e34-fa247d131a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:27.213718 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af656d2-6be6-4022-9e34-fa247d131a31 None admin] PATH_INFO: `/v3/projects/a5b903cafe374448928e686036261566` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:27.215267 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af656d2-6be6-4022-9e34-fa247d131a31 None admin] RBAC: Authorizing `identity:get_project(project_id=a5b903cafe374448928e686036261566)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:27.217035 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af656d2-6be6-4022-9e34-fa247d131a31 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:27.219209 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 173/342] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:27 2022] GET /identity/v3/projects/a5b903cafe374448928e686036261566 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:27.224957 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887be935-225e-4d8e-8b31-dcec8f1aba2b None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:27.237935 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af656d2-6be6-4022-9e34-fa247d131a31 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:27.351486 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887be935-225e-4d8e-8b31-dcec8f1aba2b None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:27.353825 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af656d2-6be6-4022-9e34-fa247d131a31 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:27.393575 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd342f-685d-4f07-86fa-bb8088714602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:27.394666 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd342f-685d-4f07-86fa-bb8088714602 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:27.395203 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd342f-685d-4f07-86fa-bb8088714602 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:27.395769 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd342f-685d-4f07-86fa-bb8088714602 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:27.398167 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b22636-c49b-45bd-8cc2-469398ec4529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:27.399026 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b22636-c49b-45bd-8cc2-469398ec4529 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:27.399309 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b22636-c49b-45bd-8cc2-469398ec4529 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:27.399607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b22636-c49b-45bd-8cc2-469398ec4529 None admin] PATH_INFO: `/v3/groups/98299ae4d24c4267ac7b14efdc38e78b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:27.409823 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd342f-685d-4f07-86fa-bb8088714602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:27.419428 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-6afd342f-685d-4f07-86fa-bb8088714602 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:05:27.419428 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:27.419428 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:27.419428 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:27.419428 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:27.419428 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:27.419428 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:27.419428 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:27.419428 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:27.419428 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:27.419428 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:27.419428 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:27.419428 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:27.419428 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:27.419428 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:27.419428 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:27.420429 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:27.420429 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:27.420429 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:27.420429 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:27.420429 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:27.420429 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:27.420429 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:27.420429 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:27.420429 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:27.420429 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:27.420429 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:27.420429 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:27.420429 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:27.420429 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:27.420429 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:27.420429 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:27.421444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:27.421444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:27.421444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:27.421444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:27.421444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:27.421444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:27.421444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:27.421444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:27.421444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:27.421444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:27.421444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:05:27.421444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:27.424109 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 174/343] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:05:27.427781 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b22636-c49b-45bd-8cc2-469398ec4529 None admin] RBAC: Authorizing `identity:get_group(group_id=98299ae4d24c4267ac7b14efdc38e78b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:27.429980 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b22636-c49b-45bd-8cc2-469398ec4529 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:27.433697 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 170/344] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:05:27 2022] GET /identity/v3/groups/98299ae4d24c4267ac7b14efdc38e78b => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:27.437325 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd342f-685d-4f07-86fa-bb8088714602 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:27.438724 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b22636-c49b-45bd-8cc2-469398ec4529 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:27.581728 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd342f-685d-4f07-86fa-bb8088714602 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:27.594433 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b22636-c49b-45bd-8cc2-469398ec4529 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:27.642064 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63328e7f-4e80-45eb-913a-e4d6b2134b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:27.642868 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63328e7f-4e80-45eb-913a-e4d6b2134b99 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:27.643154 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63328e7f-4e80-45eb-913a-e4d6b2134b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:27.643431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63328e7f-4e80-45eb-913a-e4d6b2134b99 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:27.646038 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63328e7f-4e80-45eb-913a-e4d6b2134b99 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:27.646038 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63328e7f-4e80-45eb-913a-e4d6b2134b99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:27.646734 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63328e7f-4e80-45eb-913a-e4d6b2134b99 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:27.654087 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8c0c2-539e-47a0-9684-30fbcfc0c3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:27.655313 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8c0c2-539e-47a0-9684-30fbcfc0c3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:27.655817 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8c0c2-539e-47a0-9684-30fbcfc0c3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:27.656451 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8c0c2-539e-47a0-9684-30fbcfc0c3a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:27.657637 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8c0c2-539e-47a0-9684-30fbcfc0c3a2 None admin] RBAC: Adding query filter params (group.id=98299ae4d24c4267ac7b14efdc38e78b, role.id=003cb0d66fec412dbbffb071206075d5, scope.project.id=a5b903cafe374448928e686036261566) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:27.657981 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8c0c2-539e-47a0-9684-30fbcfc0c3a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:27.659461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8c0c2-539e-47a0-9684-30fbcfc0c3a2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:27.671545 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 175/345] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:05:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:27.680248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 171/346] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:05:27 2022] GET /identity/v3/role_assignments?group.id=98299ae4d24c4267ac7b14efdc38e78b&scope.project.id=a5b903cafe374448928e686036261566&role.id=003cb0d66fec412dbbffb071206075d5 => generated 260 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:27.681649 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63328e7f-4e80-45eb-913a-e4d6b2134b99 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:27.846454 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63328e7f-4e80-45eb-913a-e4d6b2134b99 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:27.893742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63c7eb-0066-47a7-ba69-78f53def4153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:27.894683 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63c7eb-0066-47a7-ba69-78f53def4153 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:27.894970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63c7eb-0066-47a7-ba69-78f53def4153 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:27.895292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63c7eb-0066-47a7-ba69-78f53def4153 None admin] PATH_INFO: `/v3/users/133cf52ca05540c6a61d58b6175bed02` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:27.901101 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63c7eb-0066-47a7-ba69-78f53def4153 None admin] RBAC: Authorizing `identity:get_user(user_id=133cf52ca05540c6a61d58b6175bed02)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:27.902900 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63c7eb-0066-47a7-ba69-78f53def4153 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:27.905125 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 176/347] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:05:27 2022] GET /identity/v3/users/133cf52ca05540c6a61d58b6175bed02 => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:27.911953 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8c0c2-539e-47a0-9684-30fbcfc0c3a2 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:28.079185 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8c0c2-539e-47a0-9684-30fbcfc0c3a2 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:28.129468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fb902-6b30-441a-b5b5-ec392179e9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:28.130282 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fb902-6b30-441a-b5b5-ec392179e9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:28.130576 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fb902-6b30-441a-b5b5-ec392179e9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:28.130852 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fb902-6b30-441a-b5b5-ec392179e9a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:28.131730 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fb902-6b30-441a-b5b5-ec392179e9a7 None admin] RBAC: Adding query filter params (role.id=7d122e00d0544c42b86e283fc846d179, user.id=133cf52ca05540c6a61d58b6175bed02, scope.system=all) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:28.132085 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fb902-6b30-441a-b5b5-ec392179e9a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:28.133716 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fb902-6b30-441a-b5b5-ec392179e9a7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:28.153855 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 172/348] 10.222.0.48 () {56 vars in 1308 bytes} [Mon May 9 15:05:27 2022] GET /identity/v3/role_assignments?user.id=133cf52ca05540c6a61d58b6175bed02&scope.system=all&role.id=7d122e00d0544c42b86e283fc846d179 => generated 510 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:28.435930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79fdff-8f54-4536-ae89-5bcba3f8fa06 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:28.436465 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79fdff-8f54-4536-ae89-5bcba3f8fa06 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:28.436465 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79fdff-8f54-4536-ae89-5bcba3f8fa06 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:28.438092 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 177/349] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:28.456451 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae6b27-c0f5-49e4-b078-b83ff64aaca4 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:28.456765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae6b27-c0f5-49e4-b078-b83ff64aaca4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:28.457035 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae6b27-c0f5-49e4-b078-b83ff64aaca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:28.499254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a9ae6b27-c0f5-49e4-b078-b83ff64aaca4 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:28.501782 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a9ae6b27-c0f5-49e4-b078-b83ff64aaca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:28.590527 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651458e-92e2-4757-be39-7603e8a24e51 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:28.590865 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651458e-92e2-4757-be39-7603e8a24e51 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:28.591070 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651458e-92e2-4757-be39-7603e8a24e51 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:28.592790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 178/350] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:28.599501 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476e1fe-76ad-44ae-963c-acaf7e9c2107 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:28.600002 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476e1fe-76ad-44ae-963c-acaf7e9c2107 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:28.600494 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476e1fe-76ad-44ae-963c-acaf7e9c2107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:28.646881 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 173/351] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:28.649746 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad98124-009f-4bd8-b477-f108efe9cb45 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:28.649746 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad98124-009f-4bd8-b477-f108efe9cb45 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:28.649746 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad98124-009f-4bd8-b477-f108efe9cb45 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:28.651253 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 174/352] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:28.658331 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfc7e7-7c61-47b7-9c28-920c10097ce9 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:28.658672 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfc7e7-7c61-47b7-9c28-920c10097ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:28.658971 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfc7e7-7c61-47b7-9c28-920c10097ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:28.667551 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-f476e1fe-76ad-44ae-963c-acaf7e9c2107 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:28.670071 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-f476e1fe-76ad-44ae-963c-acaf7e9c2107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:28.690578 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-63dfc7e7-7c61-47b7-9c28-920c10097ce9 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:28.691806 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-63dfc7e7-7c61-47b7-9c28-920c10097ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:28.779746 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 175/353] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:05:28.780650 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfc7e7-7c61-47b7-9c28-920c10097ce9 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:28.879827 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 179/354] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:28.881851 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476e1fe-76ad-44ae-963c-acaf7e9c2107 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:28.992523 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfc7e7-7c61-47b7-9c28-920c10097ce9 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:29.062022 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476e1fe-76ad-44ae-963c-acaf7e9c2107 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:29.071459 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfa0e1-e8a1-4e84-83cb-5592b732b6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:29.073629 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfa0e1-e8a1-4e84-83cb-5592b732b6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:29.074227 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfa0e1-e8a1-4e84-83cb-5592b732b6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:29.074717 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfa0e1-e8a1-4e84-83cb-5592b732b6c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:29.091816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dfa0e1-e8a1-4e84-83cb-5592b732b6c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:29.109034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-d6dfa0e1-e8a1-4e84-83cb-5592b732b6c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:05:29.109034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:29.109034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:29.109034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:29.109034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:29.109034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:29.109034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:29.109034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:29.109034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:29.109034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:29.109034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:29.109034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:29.109034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:29.109034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:29.109034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:29.109034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:29.110384 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:29.110384 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:29.110384 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:29.110384 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:29.110384 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:29.110384 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:29.110384 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:29.110384 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:29.110384 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:29.110384 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:29.110384 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:29.110384 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:29.110384 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:29.110384 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:29.110384 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:29.110384 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:29.111471 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:29.111471 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:29.111471 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:29.111471 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:29.111471 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:29.111471 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:29.111471 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:29.111471 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:29.111471 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:29.111471 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:29.111471 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:05:29.111471 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:29.114467 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 176/355] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:05:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:29.114467 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfa0e1-e8a1-4e84-83cb-5592b732b6c4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:29.121418 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a934dd-8c20-4ead-a003-c25592a3089a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:29.123922 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a934dd-8c20-4ead-a003-c25592a3089a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:29.124286 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a934dd-8c20-4ead-a003-c25592a3089a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:29.124622 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a934dd-8c20-4ead-a003-c25592a3089a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:29.156759 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a934dd-8c20-4ead-a003-c25592a3089a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:29.157018 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-51a934dd-8c20-4ead-a003-c25592a3089a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:05:29.157018 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:29.157018 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:29.157018 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:29.157018 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:29.157018 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:29.157018 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:29.157018 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:29.157018 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:29.157018 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:29.157018 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:29.157018 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:29.157018 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:29.157018 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:29.157018 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:29.157018 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:29.158705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:29.158705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:29.158705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:29.158705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:29.158705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:29.158705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:29.158705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:29.158705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:29.158705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:29.158705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:29.158705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:29.158705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:29.158705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:29.158705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:29.158705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:29.158705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:29.160389 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:29.160389 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:29.160389 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:29.160389 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:29.160389 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:29.160389 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:29.160389 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:29.160389 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:29.160389 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:29.160389 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:29.160389 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:05:29.160389 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:29.160389 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 180/356] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:29.160389 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a934dd-8c20-4ead-a003-c25592a3089a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:29.334966 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfa0e1-e8a1-4e84-83cb-5592b732b6c4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:29.359143 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a934dd-8c20-4ead-a003-c25592a3089a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:29.381025 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bda54-605e-4e73-b8a1-04250e53d068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:29.381979 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bda54-605e-4e73-b8a1-04250e53d068 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:29.382322 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bda54-605e-4e73-b8a1-04250e53d068 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:29.382652 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bda54-605e-4e73-b8a1-04250e53d068 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:29.399480 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836bda54-605e-4e73-b8a1-04250e53d068 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:29.407864 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-836bda54-605e-4e73-b8a1-04250e53d068 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:05:29.407864 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:29.407864 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:29.407864 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:29.407864 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:29.407864 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:29.407864 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:29.407864 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:29.407864 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:29.407864 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:29.407864 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:29.407864 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:29.407864 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:29.407864 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:29.407864 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:29.407864 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:29.409764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:29.409764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:29.409764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:29.409764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:29.409764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:29.409764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:29.409764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:29.409764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:29.409764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:29.409764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:29.409764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:29.409764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:29.409764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:29.409764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:29.409764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:29.409764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:29.411409 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:29.411409 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:29.411409 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:29.411409 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:29.411409 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:29.411409 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:29.411409 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:29.411409 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:29.411409 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:29.411409 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:29.411409 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:05:29.411409 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:29.411409 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 177/357] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:05:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:29.416869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bda54-605e-4e73-b8a1-04250e53d068 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:29.435902 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a540c2-9a8d-4f76-a912-26f74fe90efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:29.436826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a540c2-9a8d-4f76-a912-26f74fe90efd None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:29.437462 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a540c2-9a8d-4f76-a912-26f74fe90efd None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:29.437691 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a540c2-9a8d-4f76-a912-26f74fe90efd None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:29.442027 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a540c2-9a8d-4f76-a912-26f74fe90efd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:29.442027 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a540c2-9a8d-4f76-a912-26f74fe90efd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:29.442999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a540c2-9a8d-4f76-a912-26f74fe90efd None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:29.456703 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 181/358] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:05:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:29.458221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a540c2-9a8d-4f76-a912-26f74fe90efd None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:29.618438 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bda54-605e-4e73-b8a1-04250e53d068 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:29.643097 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a540c2-9a8d-4f76-a912-26f74fe90efd None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:29.666749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba39282-9f0a-455c-adc0-1e2c828b0009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:29.667443 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba39282-9f0a-455c-adc0-1e2c828b0009 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:29.667726 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba39282-9f0a-455c-adc0-1e2c828b0009 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:29.668000 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba39282-9f0a-455c-adc0-1e2c828b0009 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:29.668877 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba39282-9f0a-455c-adc0-1e2c828b0009 None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:29.669185 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba39282-9f0a-455c-adc0-1e2c828b0009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:29.670712 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba39282-9f0a-455c-adc0-1e2c828b0009 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:29.683141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 178/359] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:05:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:29.683911 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba39282-9f0a-455c-adc0-1e2c828b0009 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:29.707500 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc84ca3-c68e-4bca-bfe5-dadec98c0ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:29.708344 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc84ca3-c68e-4bca-bfe5-dadec98c0ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:29.708836 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc84ca3-c68e-4bca-bfe5-dadec98c0ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:29.709333 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc84ca3-c68e-4bca-bfe5-dadec98c0ec9 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:29.711471 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc84ca3-c68e-4bca-bfe5-dadec98c0ec9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:29.711787 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc84ca3-c68e-4bca-bfe5-dadec98c0ec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:29.713869 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc84ca3-c68e-4bca-bfe5-dadec98c0ec9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:29.725701 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 182/360] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:05:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:29.726662 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc84ca3-c68e-4bca-bfe5-dadec98c0ec9 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:29.877474 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc84ca3-c68e-4bca-bfe5-dadec98c0ec9 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:29.884164 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba39282-9f0a-455c-adc0-1e2c828b0009 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:29.930103 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b10b8-fb4f-470e-b409-1ca125268592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:29.931702 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b10b8-fb4f-470e-b409-1ca125268592 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:29.932128 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b10b8-fb4f-470e-b409-1ca125268592 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:29.932409 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b10b8-fb4f-470e-b409-1ca125268592 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:29.942127 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d211c-2331-4390-a9de-85d9db433d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:29.943170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d211c-2331-4390-a9de-85d9db433d58 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:29.943663 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d211c-2331-4390-a9de-85d9db433d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:29.944151 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d211c-2331-4390-a9de-85d9db433d58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:30.032291 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b10b8-fb4f-470e-b409-1ca125268592 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:30.033907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b10b8-fb4f-470e-b409-1ca125268592 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:30.050146 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d211c-2331-4390-a9de-85d9db433d58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:30.051699 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d211c-2331-4390-a9de-85d9db433d58 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:30.201966 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 183/361] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:05:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:05:30.203064 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b10b8-fb4f-470e-b409-1ca125268592 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:30.217785 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 179/362] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:05:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:05:30.220272 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef9588-489e-4318-bc5d-9bcf0f16f7df None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:30.220777 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef9588-489e-4318-bc5d-9bcf0f16f7df None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:30.221268 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef9588-489e-4318-bc5d-9bcf0f16f7df None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:30.226783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 180/363] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:30.228732 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef9588-489e-4318-bc5d-9bcf0f16f7df None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:30.379876 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b10b8-fb4f-470e-b409-1ca125268592 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:30.414040 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef9588-489e-4318-bc5d-9bcf0f16f7df None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:30.457702 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ff40f-8a31-414c-9aba-2ad188aed9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:30.458447 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ff40f-8a31-414c-9aba-2ad188aed9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:30.458669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e559bbf-af3d-4979-9be2-28827061dbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:30.459153 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ff40f-8a31-414c-9aba-2ad188aed9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:30.459153 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ff40f-8a31-414c-9aba-2ad188aed9a9 None admin] PATH_INFO: `/v3/projects/610acb294db6480e82d07e198f888163` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:30.459946 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e559bbf-af3d-4979-9be2-28827061dbb6 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:30.460217 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ff40f-8a31-414c-9aba-2ad188aed9a9 None admin] RBAC: Authorizing `identity:get_project(project_id=610acb294db6480e82d07e198f888163)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:30.460450 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e559bbf-af3d-4979-9be2-28827061dbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:30.460955 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e559bbf-af3d-4979-9be2-28827061dbb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:30.461733 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ff40f-8a31-414c-9aba-2ad188aed9a9 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:30.464656 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 181/364] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:30 2022] GET /identity/v3/projects/610acb294db6480e82d07e198f888163 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:30.465223 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ff40f-8a31-414c-9aba-2ad188aed9a9 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:30.575862 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e559bbf-af3d-4979-9be2-28827061dbb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:30.578514 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e559bbf-af3d-4979-9be2-28827061dbb6 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:30.637970 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ff40f-8a31-414c-9aba-2ad188aed9a9 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:30.698636 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615dbd1-93c3-411c-84a0-ee4bb13b74e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:30.701913 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615dbd1-93c3-411c-84a0-ee4bb13b74e1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:30.702460 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615dbd1-93c3-411c-84a0-ee4bb13b74e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:30.703159 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615dbd1-93c3-411c-84a0-ee4bb13b74e1 None admin] PATH_INFO: `/v3/projects/610acb294db6480e82d07e198f888163` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:30.705479 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615dbd1-93c3-411c-84a0-ee4bb13b74e1 None admin] RBAC: Authorizing `identity:get_project(project_id=610acb294db6480e82d07e198f888163)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:30.707189 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615dbd1-93c3-411c-84a0-ee4bb13b74e1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:30.709196 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 182/365] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:30 2022] GET /identity/v3/projects/610acb294db6480e82d07e198f888163 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:30.710778 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070f4f9-b2b5-44be-9bb6-15b5cc01736c None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:30.711061 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070f4f9-b2b5-44be-9bb6-15b5cc01736c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:30.711334 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070f4f9-b2b5-44be-9bb6-15b5cc01736c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:30.726800 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 184/366] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:05:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:05:30.728603 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e559bbf-af3d-4979-9be2-28827061dbb6 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:30.730073 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6070f4f9-b2b5-44be-9bb6-15b5cc01736c None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:30.731272 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6070f4f9-b2b5-44be-9bb6-15b5cc01736c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:30.818985 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 183/367] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:30.819823 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070f4f9-b2b5-44be-9bb6-15b5cc01736c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:30.861526 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e559bbf-af3d-4979-9be2-28827061dbb6 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:30.908243 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a7555-3497-415c-8089-85f9ef1bd6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:30.909560 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a7555-3497-415c-8089-85f9ef1bd6de None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:30.910064 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a7555-3497-415c-8089-85f9ef1bd6de None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:30.910347 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a7555-3497-415c-8089-85f9ef1bd6de None admin] PATH_INFO: `/v3/groups/98299ae4d24c4267ac7b14efdc38e78b` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:30.911667 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a7555-3497-415c-8089-85f9ef1bd6de None admin] RBAC: Authorizing `identity:get_group(group_id=98299ae4d24c4267ac7b14efdc38e78b)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:30.913101 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a7555-3497-415c-8089-85f9ef1bd6de None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:30.915003 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 185/368] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:05:30 2022] GET /identity/v3/groups/98299ae4d24c4267ac7b14efdc38e78b => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:30.921225 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a7555-3497-415c-8089-85f9ef1bd6de None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:30.986942 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070f4f9-b2b5-44be-9bb6-15b5cc01736c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:31.052467 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b149d3-64d5-4600-8a62-85ea14f54272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:31.054610 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b149d3-64d5-4600-8a62-85ea14f54272 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:31.055086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b149d3-64d5-4600-8a62-85ea14f54272 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:31.056517 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b149d3-64d5-4600-8a62-85ea14f54272 None admin] PATH_INFO: `/v3/groups/98299ae4d24c4267ac7b14efdc38e78b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:31.060494 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b149d3-64d5-4600-8a62-85ea14f54272 None admin] RBAC: Authorizing `identity:get_group(group_id=98299ae4d24c4267ac7b14efdc38e78b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:31.064195 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b149d3-64d5-4600-8a62-85ea14f54272 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:31.067478 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 184/369] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:05:30 2022] GET /identity/v3/groups/98299ae4d24c4267ac7b14efdc38e78b => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:31.068998 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b149d3-64d5-4600-8a62-85ea14f54272 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:31.071852 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a7555-3497-415c-8089-85f9ef1bd6de None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:31.141191 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57e927-9b0a-47da-8abb-91849aee438b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:31.142261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57e927-9b0a-47da-8abb-91849aee438b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:31.142565 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57e927-9b0a-47da-8abb-91849aee438b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:31.142849 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57e927-9b0a-47da-8abb-91849aee438b None admin] PATH_INFO: `/v3/projects/a5b903cafe374448928e686036261566` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:31.144610 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57e927-9b0a-47da-8abb-91849aee438b None admin] RBAC: Authorizing `identity:get_project(project_id=a5b903cafe374448928e686036261566)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:31.148298 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57e927-9b0a-47da-8abb-91849aee438b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:31.148298 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 186/370] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:30 2022] GET /identity/v3/projects/a5b903cafe374448928e686036261566 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:31.149055 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57e927-9b0a-47da-8abb-91849aee438b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:31.244744 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b149d3-64d5-4600-8a62-85ea14f54272 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:31.288662 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46159f55-3e86-4890-88dd-4f9e1da56c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:31.289671 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46159f55-3e86-4890-88dd-4f9e1da56c28 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:31.290776 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46159f55-3e86-4890-88dd-4f9e1da56c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:31.291271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46159f55-3e86-4890-88dd-4f9e1da56c28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:31.298637 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57e927-9b0a-47da-8abb-91849aee438b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:31.303598 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46159f55-3e86-4890-88dd-4f9e1da56c28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:31.313068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-46159f55-3e86-4890-88dd-4f9e1da56c28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:05:31.313068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:31.313068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:31.313068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:31.313068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:31.313068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:31.313068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:31.313068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:31.313068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:31.313068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:31.313068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:31.313068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:31.313068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:31.313068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:31.313068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:31.313068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:31.314666 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:31.314666 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:31.314666 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:31.314666 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:31.314666 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:31.314666 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:31.314666 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:31.314666 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:31.314666 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:31.314666 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:31.314666 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:31.314666 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:31.314666 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:31.314666 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:31.314666 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:31.314666 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:31.315719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:31.315719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:31.315719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:31.315719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:31.315719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:31.315719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:31.315719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:31.315719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:31.315719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:31.315719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:31.315719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:05:31.315719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:31.318335 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 185/371] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:05:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:31.319825 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46159f55-3e86-4890-88dd-4f9e1da56c28 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:31.363234 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c263a-5a8c-4b61-ade2-7143e4731cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:31.363902 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c263a-5a8c-4b61-ade2-7143e4731cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:31.364190 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c263a-5a8c-4b61-ade2-7143e4731cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:31.364462 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c263a-5a8c-4b61-ade2-7143e4731cb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:31.365307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c263a-5a8c-4b61-ade2-7143e4731cb4 None admin] RBAC: Adding query filter params (group.id=98299ae4d24c4267ac7b14efdc38e78b, role.id=003cb0d66fec412dbbffb071206075d5, scope.project.id=610acb294db6480e82d07e198f888163) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:31.365705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c263a-5a8c-4b61-ade2-7143e4731cb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:31.367161 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c263a-5a8c-4b61-ade2-7143e4731cb4 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:31.375696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 187/372] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:05:31 2022] GET /identity/v3/role_assignments?group.id=98299ae4d24c4267ac7b14efdc38e78b&scope.project.id=610acb294db6480e82d07e198f888163&role.id=003cb0d66fec412dbbffb071206075d5 => generated 260 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:31.376122 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c263a-5a8c-4b61-ade2-7143e4731cb4 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:31.479040 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46159f55-3e86-4890-88dd-4f9e1da56c28 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:31.525506 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08f6ae-8c84-4882-ac8b-9413f5b59100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:31.526209 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08f6ae-8c84-4882-ac8b-9413f5b59100 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:31.526496 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08f6ae-8c84-4882-ac8b-9413f5b59100 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:31.526773 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08f6ae-8c84-4882-ac8b-9413f5b59100 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:31.527665 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08f6ae-8c84-4882-ac8b-9413f5b59100 None admin] RBAC: Adding query filter params (group.id=98299ae4d24c4267ac7b14efdc38e78b, role.id=371a69f4478447a2b7170a3078173caa, scope.project.id=610acb294db6480e82d07e198f888163) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:31.527979 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08f6ae-8c84-4882-ac8b-9413f5b59100 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:31.529507 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08f6ae-8c84-4882-ac8b-9413f5b59100 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:31.535701 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c263a-5a8c-4b61-ade2-7143e4731cb4 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:31.536391 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 186/373] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:05:31 2022] GET /identity/v3/role_assignments?group.id=98299ae4d24c4267ac7b14efdc38e78b&scope.project.id=610acb294db6480e82d07e198f888163&role.id=371a69f4478447a2b7170a3078173caa => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:31.537965 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4be14-5e2e-4299-897a-dc7089a387ee None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:31.538248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4be14-5e2e-4299-897a-dc7089a387ee None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:31.538614 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4be14-5e2e-4299-897a-dc7089a387ee None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:31.541015 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 187/374] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:31.541751 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4be14-5e2e-4299-897a-dc7089a387ee None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:31.579522 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6c50a-878a-4af9-bb9b-30883972ddc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:31.580973 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6c50a-878a-4af9-bb9b-30883972ddc8 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:31.581495 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6c50a-878a-4af9-bb9b-30883972ddc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:31.581908 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6c50a-878a-4af9-bb9b-30883972ddc8 None admin] PATH_INFO: `/v3/groups/98299ae4d24c4267ac7b14efdc38e78b` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:31.583613 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6c50a-878a-4af9-bb9b-30883972ddc8 None admin] RBAC: Authorizing `identity:get_group(group_id=98299ae4d24c4267ac7b14efdc38e78b)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:31.585746 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6c50a-878a-4af9-bb9b-30883972ddc8 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:31.588986 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 188/375] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:05:31 2022] GET /identity/v3/groups/98299ae4d24c4267ac7b14efdc38e78b => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:31.590461 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea45d53-3392-4fa8-9333-f90dae8e4647 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:31.590751 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea45d53-3392-4fa8-9333-f90dae8e4647 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:31.591032 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea45d53-3392-4fa8-9333-f90dae8e4647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:31.615306 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-cea45d53-3392-4fa8-9333-f90dae8e4647 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:31.616952 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-cea45d53-3392-4fa8-9333-f90dae8e4647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:31.707804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4be14-5e2e-4299-897a-dc7089a387ee None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:31.720491 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 189/376] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:31.721942 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea45d53-3392-4fa8-9333-f90dae8e4647 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:31.757533 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302dba8f-2ce7-4c54-ba9b-cef13391d639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:31.758235 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dba8f-2ce7-4c54-ba9b-cef13391d639 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:31.758524 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dba8f-2ce7-4c54-ba9b-cef13391d639 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:31.759729 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dba8f-2ce7-4c54-ba9b-cef13391d639 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:31.760773 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302dba8f-2ce7-4c54-ba9b-cef13391d639 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:31.761096 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302dba8f-2ce7-4c54-ba9b-cef13391d639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:31.763471 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302dba8f-2ce7-4c54-ba9b-cef13391d639 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:31.784974 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 188/377] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:31.789420 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302dba8f-2ce7-4c54-ba9b-cef13391d639 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:31.883357 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea45d53-3392-4fa8-9333-f90dae8e4647 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:31.926380 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302dba8f-2ce7-4c54-ba9b-cef13391d639 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:31.938322 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c5df7-224b-4b6d-b2e8-2481e9934613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:31.939324 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c5df7-224b-4b6d-b2e8-2481e9934613 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:31.939919 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c5df7-224b-4b6d-b2e8-2481e9934613 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:31.940437 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c5df7-224b-4b6d-b2e8-2481e9934613 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:31.941664 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c5df7-224b-4b6d-b2e8-2481e9934613 None admin] RBAC: Adding query filter params (group.id=98299ae4d24c4267ac7b14efdc38e78b, role.id=371a69f4478447a2b7170a3078173caa, scope.project.id=a5b903cafe374448928e686036261566) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:31.942143 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c5df7-224b-4b6d-b2e8-2481e9934613 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:31.944095 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c5df7-224b-4b6d-b2e8-2481e9934613 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:31.953231 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 190/378] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:05:31 2022] GET /identity/v3/role_assignments?group.id=98299ae4d24c4267ac7b14efdc38e78b&scope.project.id=a5b903cafe374448928e686036261566&role.id=371a69f4478447a2b7170a3078173caa => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:31.954343 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c5df7-224b-4b6d-b2e8-2481e9934613 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:31.973640 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68d86c-5c14-422f-beba-4bad347ca663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:31.974526 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68d86c-5c14-422f-beba-4bad347ca663 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:31.974959 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68d86c-5c14-422f-beba-4bad347ca663 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:31.975375 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68d86c-5c14-422f-beba-4bad347ca663 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:31.997462 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68d86c-5c14-422f-beba-4bad347ca663 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:32.007077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-2a68d86c-5c14-422f-beba-4bad347ca663 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:05:32.007077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:32.007077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:32.007077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:32.007077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:32.007077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:32.007077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:32.007077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:32.007077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:32.007077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:32.007077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:32.007077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:32.007077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:32.007077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:32.007077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:32.007077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:32.008042 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:32.008042 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:32.008042 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:32.008042 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:32.008042 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:32.008042 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:32.008042 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:32.008042 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:32.008042 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:32.008042 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:32.008042 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:32.008042 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:32.008042 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:32.008042 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:32.008042 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:32.008042 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:32.009445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:32.009445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:32.009445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:32.009445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:32.009445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:32.009445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:32.009445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:32.009445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:32.009445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:32.009445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:32.009445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:05:32.009445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:32.012432 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 189/379] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:32.019168 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68d86c-5c14-422f-beba-4bad347ca663 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:32.180617 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c5df7-224b-4b6d-b2e8-2481e9934613 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:32.195400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68d86c-5c14-422f-beba-4bad347ca663 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:32.245431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72b15c-a230-4ae9-8d9b-f2672bd3da57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:32.246209 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72b15c-a230-4ae9-8d9b-f2672bd3da57 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:32.246502 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72b15c-a230-4ae9-8d9b-f2672bd3da57 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:32.246828 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72b15c-a230-4ae9-8d9b-f2672bd3da57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:32.248647 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2f1be-798d-4b13-87b3-97d641e682fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:32.249448 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2f1be-798d-4b13-87b3-97d641e682fc None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:32.249767 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2f1be-798d-4b13-87b3-97d641e682fc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:32.250344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2f1be-798d-4b13-87b3-97d641e682fc None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:32.251248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2f1be-798d-4b13-87b3-97d641e682fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:32.252619 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2f1be-798d-4b13-87b3-97d641e682fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:32.254227 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2f1be-798d-4b13-87b3-97d641e682fc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:32.267473 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 190/380] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:05:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:32.275606 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2f1be-798d-4b13-87b3-97d641e682fc None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:32.429408 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2f1be-798d-4b13-87b3-97d641e682fc None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:32.453199 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72b15c-a230-4ae9-8d9b-f2672bd3da57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:32.454767 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72b15c-a230-4ae9-8d9b-f2672bd3da57 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:32.467086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34376d2c-a5e4-4aad-8431-cafe915d61da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:32.467959 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34376d2c-a5e4-4aad-8431-cafe915d61da None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:32.468242 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34376d2c-a5e4-4aad-8431-cafe915d61da None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:32.468514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34376d2c-a5e4-4aad-8431-cafe915d61da None admin] PATH_INFO: `/v3/groups/98299ae4d24c4267ac7b14efdc38e78b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:32.469891 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34376d2c-a5e4-4aad-8431-cafe915d61da None admin] RBAC: Authorizing `identity:get_group(group_id=98299ae4d24c4267ac7b14efdc38e78b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:32.471500 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34376d2c-a5e4-4aad-8431-cafe915d61da None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:32.473786 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 191/381] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:05:32 2022] GET /identity/v3/groups/98299ae4d24c4267ac7b14efdc38e78b => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:32.485140 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34376d2c-a5e4-4aad-8431-cafe915d61da None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:32.604168 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34376d2c-a5e4-4aad-8431-cafe915d61da None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:32.607256 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 191/382] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:05:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:05:32.614269 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72b15c-a230-4ae9-8d9b-f2672bd3da57 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:32.644157 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817da00b-031c-4656-b5f5-8b23345ade7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:32.645072 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817da00b-031c-4656-b5f5-8b23345ade7c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:32.645397 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817da00b-031c-4656-b5f5-8b23345ade7c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:32.645795 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817da00b-031c-4656-b5f5-8b23345ade7c None admin] PATH_INFO: `/v3/projects/a5b903cafe374448928e686036261566` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:32.651518 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817da00b-031c-4656-b5f5-8b23345ade7c None admin] RBAC: Authorizing `identity:get_project(project_id=a5b903cafe374448928e686036261566)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:32.653162 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817da00b-031c-4656-b5f5-8b23345ade7c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:32.660460 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 192/383] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:32 2022] GET /identity/v3/projects/a5b903cafe374448928e686036261566 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:32.669170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817da00b-031c-4656-b5f5-8b23345ade7c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:32.788540 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817da00b-031c-4656-b5f5-8b23345ade7c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:32.833995 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe641346-f44b-4a39-a40b-e4d17bc71851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:32.835264 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe641346-f44b-4a39-a40b-e4d17bc71851 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:32.835579 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe641346-f44b-4a39-a40b-e4d17bc71851 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:32.835887 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe641346-f44b-4a39-a40b-e4d17bc71851 None admin] PATH_INFO: `/v3/projects/a5b903cafe374448928e686036261566/groups/98299ae4d24c4267ac7b14efdc38e78b/roles/003cb0d66fec412dbbffb071206075d5` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:32.840078 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe641346-f44b-4a39-a40b-e4d17bc71851 None admin] RBAC: Authorizing `identity:create_grant(project_id=a5b903cafe374448928e686036261566, group_id=98299ae4d24c4267ac7b14efdc38e78b, role_id=003cb0d66fec412dbbffb071206075d5)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:32.841806 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe641346-f44b-4a39-a40b-e4d17bc71851 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:32.858481 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 193/384] 10.222.0.48 () {58 vars in 1442 bytes} [Mon May 9 15:05:32 2022] PUT /identity/v3/projects/a5b903cafe374448928e686036261566/groups/98299ae4d24c4267ac7b14efdc38e78b/roles/003cb0d66fec412dbbffb071206075d5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:05:32.902275 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72b15c-a230-4ae9-8d9b-f2672bd3da57 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:32.972959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e803ff0-fcba-45a0-98fe-5dfb21f146a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:32.974537 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e803ff0-fcba-45a0-98fe-5dfb21f146a5 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:32.975031 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e803ff0-fcba-45a0-98fe-5dfb21f146a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:32.975514 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e803ff0-fcba-45a0-98fe-5dfb21f146a5 None admin] PATH_INFO: `/v3/projects/5cfee729a9d442518d1002c1b9a42feb` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:32.978017 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e803ff0-fcba-45a0-98fe-5dfb21f146a5 None admin] RBAC: Authorizing `identity:get_project(project_id=5cfee729a9d442518d1002c1b9a42feb)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:32.981003 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e803ff0-fcba-45a0-98fe-5dfb21f146a5 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:32.984862 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 192/385] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:32 2022] GET /identity/v3/projects/5cfee729a9d442518d1002c1b9a42feb => generated 344 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:32.990930 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe641346-f44b-4a39-a40b-e4d17bc71851 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:33.157880 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe641346-f44b-4a39-a40b-e4d17bc71851 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:33.207319 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b8dc0-fc58-4226-88bc-7f4693379fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:33.208306 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b8dc0-fc58-4226-88bc-7f4693379fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:33.208592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b8dc0-fc58-4226-88bc-7f4693379fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:33.208869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b8dc0-fc58-4226-88bc-7f4693379fb0 None admin] PATH_INFO: `/v3/groups/8ba6a2ab16fa4c238e636089309b1598` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:33.215476 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b8dc0-fc58-4226-88bc-7f4693379fb0 None admin] RBAC: Authorizing `identity:get_group(group_id=8ba6a2ab16fa4c238e636089309b1598)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:33.216958 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b8dc0-fc58-4226-88bc-7f4693379fb0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:33.219013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 194/386] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:05:32 2022] GET /identity/v3/groups/8ba6a2ab16fa4c238e636089309b1598 => generated 229 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:33.224792 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e803ff0-fcba-45a0-98fe-5dfb21f146a5 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:33.388254 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e803ff0-fcba-45a0-98fe-5dfb21f146a5 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:33.452885 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357919de-b5c6-4088-83b0-83b97d1c35cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:33.453571 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357919de-b5c6-4088-83b0-83b97d1c35cf None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:33.453854 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357919de-b5c6-4088-83b0-83b97d1c35cf None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:33.454125 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357919de-b5c6-4088-83b0-83b97d1c35cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:33.455028 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357919de-b5c6-4088-83b0-83b97d1c35cf None admin] RBAC: Adding query filter params (group.id=8ba6a2ab16fa4c238e636089309b1598, role.id=3409f00ead9e455182684faa27b1f8f0, scope.project.id=5cfee729a9d442518d1002c1b9a42feb) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:33.455339 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357919de-b5c6-4088-83b0-83b97d1c35cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:33.456775 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357919de-b5c6-4088-83b0-83b97d1c35cf None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:33.463117 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 193/387] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:05:33 2022] GET /identity/v3/role_assignments?group.id=8ba6a2ab16fa4c238e636089309b1598&scope.project.id=5cfee729a9d442518d1002c1b9a42feb&role.id=3409f00ead9e455182684faa27b1f8f0 => generated 260 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:34.597769 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f2971-0002-44ce-bede-02f8d73b66b8 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:34.598811 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f2971-0002-44ce-bede-02f8d73b66b8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:34.599338 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f2971-0002-44ce-bede-02f8d73b66b8 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:34.601669 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 195/388] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:34.608226 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3ae08-52f9-4c13-a11e-527d51eeb6bf None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:34.609357 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3ae08-52f9-4c13-a11e-527d51eeb6bf None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:34.610278 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3ae08-52f9-4c13-a11e-527d51eeb6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:34.639393 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-5bb3ae08-52f9-4c13-a11e-527d51eeb6bf None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:34.641771 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5bb3ae08-52f9-4c13-a11e-527d51eeb6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:34.655921 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589fa2f-39f2-4977-8f22-806d209112e0 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:34.656892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589fa2f-39f2-4977-8f22-806d209112e0 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:34.657692 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589fa2f-39f2-4977-8f22-806d209112e0 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:34.660685 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 196/389] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:34.668322 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b3d5e-126b-46fc-98a4-59d85499a78a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:34.669273 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b3d5e-126b-46fc-98a4-59d85499a78a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:34.669905 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b3d5e-126b-46fc-98a4-59d85499a78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:34.707053 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-9d6b3d5e-126b-46fc-98a4-59d85499a78a None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:34.710214 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9d6b3d5e-126b-46fc-98a4-59d85499a78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:34.801895 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 194/390] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:34.839997 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3ae08-52f9-4c13-a11e-527d51eeb6bf None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:34.859296 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 197/391] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:34.925607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b3d5e-126b-46fc-98a4-59d85499a78a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:34.950468 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3ae08-52f9-4c13-a11e-527d51eeb6bf None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:35.000396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb3149-e15e-43be-8770-d21105a63d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:35.001941 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb3149-e15e-43be-8770-d21105a63d42 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:35.002675 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb3149-e15e-43be-8770-d21105a63d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:35.003135 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb3149-e15e-43be-8770-d21105a63d42 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:35.016955 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb3149-e15e-43be-8770-d21105a63d42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:35.028802 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-21fb3149-e15e-43be-8770-d21105a63d42 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:05:35.028802 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:35.028802 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:35.028802 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:35.028802 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:35.028802 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:35.028802 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:35.028802 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:35.028802 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:35.028802 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:35.028802 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:35.028802 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:35.028802 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:35.028802 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:35.028802 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:35.028802 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:35.029849 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:35.029849 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:35.029849 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:35.029849 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:35.029849 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:35.029849 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:35.029849 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:35.029849 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:35.029849 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:35.029849 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:35.029849 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:35.029849 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:35.029849 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:35.029849 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:35.029849 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:35.029849 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:35.030662 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:35.030662 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:35.030662 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:35.030662 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:35.030662 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:35.030662 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:35.030662 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:35.030662 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:35.030662 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:35.030662 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:35.030662 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:05:35.030662 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:35.033459 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 195/392] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:05:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:05:35.035604 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453da795-a2d1-4e0f-ab0b-d5bd4f86a741 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:35.036068 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453da795-a2d1-4e0f-ab0b-d5bd4f86a741 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:35.036511 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453da795-a2d1-4e0f-ab0b-d5bd4f86a741 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:35.038036 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 196/393] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:35.043033 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453da795-a2d1-4e0f-ab0b-d5bd4f86a741 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:35.107471 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b3d5e-126b-46fc-98a4-59d85499a78a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:35.154814 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0da7e-90e7-41a1-a0b0-293191a500d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:35.156582 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0da7e-90e7-41a1-a0b0-293191a500d1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:35.157407 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0da7e-90e7-41a1-a0b0-293191a500d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:35.158180 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0da7e-90e7-41a1-a0b0-293191a500d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:35.175482 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0da7e-90e7-41a1-a0b0-293191a500d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:35.182931 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453da795-a2d1-4e0f-ab0b-d5bd4f86a741 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:35.185250 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-55f0da7e-90e7-41a1-a0b0-293191a500d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:05:35.185250 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:35.185250 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:35.185250 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:35.185250 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:35.185250 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:35.185250 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:35.185250 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:35.185250 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:35.185250 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:35.185250 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:35.185250 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:35.185250 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:35.185250 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:35.185250 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:35.185250 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:35.186269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:35.186269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:35.186269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:35.186269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:35.186269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:35.186269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:35.186269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:35.186269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:35.186269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:35.186269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:35.186269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:35.186269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:35.186269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:35.186269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:35.186269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:35.186269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:35.187080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:35.187080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:35.187080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:35.187080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:35.187080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:35.187080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:35.187080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:35.187080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:35.187080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:35.187080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:35.187080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:05:35.187080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:35.195288 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 198/394] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:05:35.195288 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daaf0c-bcff-494d-9580-eddc6e05bd4c None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:35.195288 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daaf0c-bcff-494d-9580-eddc6e05bd4c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:35.195288 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daaf0c-bcff-494d-9580-eddc6e05bd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:35.214398 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-b1daaf0c-bcff-494d-9580-eddc6e05bd4c None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:35.216508 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b1daaf0c-bcff-494d-9580-eddc6e05bd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:35.220021 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457b5c5-a90e-4157-ac4d-243d426b96cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:35.220875 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457b5c5-a90e-4157-ac4d-243d426b96cd None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:35.221275 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457b5c5-a90e-4157-ac4d-243d426b96cd None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:35.221662 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457b5c5-a90e-4157-ac4d-243d426b96cd None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:35.222551 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457b5c5-a90e-4157-ac4d-243d426b96cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:35.222996 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457b5c5-a90e-4157-ac4d-243d426b96cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:35.224574 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457b5c5-a90e-4157-ac4d-243d426b96cd None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:35.234257 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 197/395] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:05:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:35.239806 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457b5c5-a90e-4157-ac4d-243d426b96cd None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:35.319237 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 199/396] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:35.326214 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1daaf0c-bcff-494d-9580-eddc6e05bd4c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:35.361681 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457b5c5-a90e-4157-ac4d-243d426b96cd None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:35.417075 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89547718-5c11-4436-bb9c-0b2d5aa1abc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:35.422009 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89547718-5c11-4436-bb9c-0b2d5aa1abc8 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:35.422009 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89547718-5c11-4436-bb9c-0b2d5aa1abc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:35.422556 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89547718-5c11-4436-bb9c-0b2d5aa1abc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:35.423102 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89547718-5c11-4436-bb9c-0b2d5aa1abc8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:35.423412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89547718-5c11-4436-bb9c-0b2d5aa1abc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:35.424856 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89547718-5c11-4436-bb9c-0b2d5aa1abc8 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:35.442615 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 198/397] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:05:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:35.444521 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89547718-5c11-4436-bb9c-0b2d5aa1abc8 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:35.479217 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1daaf0c-bcff-494d-9580-eddc6e05bd4c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:35.528920 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c74e5f-0fc6-47ac-bdb1-5099c433348b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:35.529849 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c74e5f-0fc6-47ac-bdb1-5099c433348b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:35.530135 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c74e5f-0fc6-47ac-bdb1-5099c433348b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:35.530409 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c74e5f-0fc6-47ac-bdb1-5099c433348b None admin] PATH_INFO: `/v3/groups/98299ae4d24c4267ac7b14efdc38e78b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:35.532523 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c74e5f-0fc6-47ac-bdb1-5099c433348b None admin] RBAC: Authorizing `identity:get_group(group_id=98299ae4d24c4267ac7b14efdc38e78b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:35.534601 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c74e5f-0fc6-47ac-bdb1-5099c433348b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:35.536938 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 200/398] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:05:35 2022] GET /identity/v3/groups/98299ae4d24c4267ac7b14efdc38e78b => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:35.538157 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c74e5f-0fc6-47ac-bdb1-5099c433348b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:35.599899 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89547718-5c11-4436-bb9c-0b2d5aa1abc8 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:35.652200 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde851e-88f5-4731-a907-b9cb83d6782b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:35.654029 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde851e-88f5-4731-a907-b9cb83d6782b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:35.654526 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde851e-88f5-4731-a907-b9cb83d6782b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:35.655531 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde851e-88f5-4731-a907-b9cb83d6782b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:35.668820 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c74e5f-0fc6-47ac-bdb1-5099c433348b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:35.673297 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde851e-88f5-4731-a907-b9cb83d6782b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:35.685441 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-acde851e-88f5-4731-a907-b9cb83d6782b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:05:35.685441 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:35.685441 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:35.685441 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:35.685441 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:35.685441 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:35.685441 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:35.685441 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:35.685441 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:35.685441 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:35.685441 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:35.685441 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:35.685441 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:35.685441 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:35.685441 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:35.685441 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:35.686859 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:35.686859 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:35.686859 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:35.686859 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:35.686859 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:35.686859 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:35.686859 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:35.686859 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:35.686859 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:35.686859 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:35.686859 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:35.686859 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:35.686859 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:35.686859 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:35.686859 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:35.686859 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:35.687815 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:35.687815 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:35.687815 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:35.687815 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:35.687815 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:35.687815 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:35.687815 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:35.687815 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:35.687815 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:35.687815 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:35.687815 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:05:35.687815 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:35.690888 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 199/399] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:05:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:35.694089 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde851e-88f5-4731-a907-b9cb83d6782b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:35.718033 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07497db5-98c0-484e-b9e3-5e6c73902264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:35.718642 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07497db5-98c0-484e-b9e3-5e6c73902264 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:35.718970 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07497db5-98c0-484e-b9e3-5e6c73902264 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:35.719431 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07497db5-98c0-484e-b9e3-5e6c73902264 None admin] PATH_INFO: `/v3/groups/98299ae4d24c4267ac7b14efdc38e78b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:35.720683 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07497db5-98c0-484e-b9e3-5e6c73902264 None admin] RBAC: Authorizing `identity:get_group(group_id=98299ae4d24c4267ac7b14efdc38e78b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:35.722233 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07497db5-98c0-484e-b9e3-5e6c73902264 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:35.724275 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 201/400] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:05:35 2022] GET /identity/v3/groups/98299ae4d24c4267ac7b14efdc38e78b => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:35.725186 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07497db5-98c0-484e-b9e3-5e6c73902264 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:35.842090 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde851e-88f5-4731-a907-b9cb83d6782b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:35.851539 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07497db5-98c0-484e-b9e3-5e6c73902264 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:35.885869 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251615b7-6c0e-4a62-8fe6-8dc625295fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:35.886809 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251615b7-6c0e-4a62-8fe6-8dc625295fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:35.887095 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251615b7-6c0e-4a62-8fe6-8dc625295fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:35.887373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251615b7-6c0e-4a62-8fe6-8dc625295fa2 None admin] PATH_INFO: `/v3/projects/610acb294db6480e82d07e198f888163` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:35.888720 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251615b7-6c0e-4a62-8fe6-8dc625295fa2 None admin] RBAC: Authorizing `identity:get_project(project_id=610acb294db6480e82d07e198f888163)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:35.890246 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251615b7-6c0e-4a62-8fe6-8dc625295fa2 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:35.897498 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 200/401] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:35 2022] GET /identity/v3/projects/610acb294db6480e82d07e198f888163 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:35.897498 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251615b7-6c0e-4a62-8fe6-8dc625295fa2 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:35.907552 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0479d6-fa39-40b1-8353-467df8ad6b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:35.909315 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0479d6-fa39-40b1-8353-467df8ad6b9a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:35.909823 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0479d6-fa39-40b1-8353-467df8ad6b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:35.910240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0479d6-fa39-40b1-8353-467df8ad6b9a None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:35.911254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0479d6-fa39-40b1-8353-467df8ad6b9a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:35.911687 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0479d6-fa39-40b1-8353-467df8ad6b9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:35.913970 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0479d6-fa39-40b1-8353-467df8ad6b9a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:35.927863 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 202/402] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:05:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:35.933461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0479d6-fa39-40b1-8353-467df8ad6b9a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:36.022536 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251615b7-6c0e-4a62-8fe6-8dc625295fa2 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:36.042352 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0479d6-fa39-40b1-8353-467df8ad6b9a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:36.064852 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0205d1-0def-4b4a-8018-8947f447e7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:36.065909 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0205d1-0def-4b4a-8018-8947f447e7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:36.066241 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0205d1-0def-4b4a-8018-8947f447e7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:36.066574 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0205d1-0def-4b4a-8018-8947f447e7a8 None admin] PATH_INFO: `/v3/projects/610acb294db6480e82d07e198f888163` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:36.068450 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0205d1-0def-4b4a-8018-8947f447e7a8 None admin] RBAC: Authorizing `identity:get_project(project_id=610acb294db6480e82d07e198f888163)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:36.069962 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0205d1-0def-4b4a-8018-8947f447e7a8 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:36.072857 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 201/403] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:35 2022] GET /identity/v3/projects/610acb294db6480e82d07e198f888163 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:36.073884 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0205d1-0def-4b4a-8018-8947f447e7a8 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:36.084152 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570233e-449f-46c2-8ad4-08fc62b91b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:36.085440 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570233e-449f-46c2-8ad4-08fc62b91b47 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:36.085928 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570233e-449f-46c2-8ad4-08fc62b91b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:36.086401 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570233e-449f-46c2-8ad4-08fc62b91b47 None admin] PATH_INFO: `/v3/projects/610acb294db6480e82d07e198f888163/groups/98299ae4d24c4267ac7b14efdc38e78b/roles/371a69f4478447a2b7170a3078173caa` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:36.089592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570233e-449f-46c2-8ad4-08fc62b91b47 None admin] RBAC: Authorizing `identity:create_grant(project_id=610acb294db6480e82d07e198f888163, group_id=98299ae4d24c4267ac7b14efdc38e78b, role_id=371a69f4478447a2b7170a3078173caa)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:36.091359 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570233e-449f-46c2-8ad4-08fc62b91b47 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:36.106782 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 203/404] 10.222.0.48 () {58 vars in 1442 bytes} [Mon May 9 15:05:35 2022] PUT /identity/v3/projects/610acb294db6480e82d07e198f888163/groups/98299ae4d24c4267ac7b14efdc38e78b/roles/371a69f4478447a2b7170a3078173caa => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:05:36.107960 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570233e-449f-46c2-8ad4-08fc62b91b47 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:36.226285 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0205d1-0def-4b4a-8018-8947f447e7a8 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:36.230612 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570233e-449f-46c2-8ad4-08fc62b91b47 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:36.271534 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fba68d-221f-4a9b-9fe9-a72e8a3ee53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:36.272908 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fba68d-221f-4a9b-9fe9-a72e8a3ee53f None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:36.273094 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa565a-159e-483c-9159-acab0040d36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:36.273636 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fba68d-221f-4a9b-9fe9-a72e8a3ee53f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:36.274139 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fba68d-221f-4a9b-9fe9-a72e8a3ee53f None admin] PATH_INFO: `/v3/projects/610acb294db6480e82d07e198f888163/groups/98299ae4d24c4267ac7b14efdc38e78b/roles/003cb0d66fec412dbbffb071206075d5` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:36.274372 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa565a-159e-483c-9159-acab0040d36e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:36.275329 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa565a-159e-483c-9159-acab0040d36e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:36.275808 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa565a-159e-483c-9159-acab0040d36e None admin] PATH_INFO: `/v3/groups/98299ae4d24c4267ac7b14efdc38e78b` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:36.277512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa565a-159e-483c-9159-acab0040d36e None admin] RBAC: Authorizing `identity:get_group(group_id=98299ae4d24c4267ac7b14efdc38e78b)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:36.278589 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fba68d-221f-4a9b-9fe9-a72e8a3ee53f None admin] RBAC: Authorizing `identity:create_grant(project_id=610acb294db6480e82d07e198f888163, group_id=98299ae4d24c4267ac7b14efdc38e78b, role_id=003cb0d66fec412dbbffb071206075d5)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:36.279722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa565a-159e-483c-9159-acab0040d36e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:36.280582 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fba68d-221f-4a9b-9fe9-a72e8a3ee53f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:36.282144 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 202/405] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:05:36 2022] GET /identity/v3/groups/98299ae4d24c4267ac7b14efdc38e78b => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:36.287970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74866cc3-da24-4438-aa2b-d7953473e826 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:36.287970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74866cc3-da24-4438-aa2b-d7953473e826 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:36.287970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74866cc3-da24-4438-aa2b-d7953473e826 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:36.287970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 203/406] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:36.290174 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74866cc3-da24-4438-aa2b-d7953473e826 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:36.306208 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 204/407] 10.222.0.48 () {58 vars in 1442 bytes} [Mon May 9 15:05:36 2022] PUT /identity/v3/projects/610acb294db6480e82d07e198f888163/groups/98299ae4d24c4267ac7b14efdc38e78b/roles/003cb0d66fec412dbbffb071206075d5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:05:36.308942 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3814092-e084-46ca-89cb-f6d15790ad2a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:36.309629 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3814092-e084-46ca-89cb-f6d15790ad2a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:36.310261 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3814092-e084-46ca-89cb-f6d15790ad2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:36.338951 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-c3814092-e084-46ca-89cb-f6d15790ad2a None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:36.341962 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c3814092-e084-46ca-89cb-f6d15790ad2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:36.438156 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74866cc3-da24-4438-aa2b-d7953473e826 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:36.453092 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 205/408] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:36.480359 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3814092-e084-46ca-89cb-f6d15790ad2a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:36.480667 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51223c37-9bf3-49e7-b2f6-8966d3429cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:36.481598 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51223c37-9bf3-49e7-b2f6-8966d3429cbe None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:36.481957 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51223c37-9bf3-49e7-b2f6-8966d3429cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:36.482241 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51223c37-9bf3-49e7-b2f6-8966d3429cbe None admin] PATH_INFO: `/v3/projects/a5b903cafe374448928e686036261566` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:36.483626 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51223c37-9bf3-49e7-b2f6-8966d3429cbe None admin] RBAC: Authorizing `identity:get_project(project_id=a5b903cafe374448928e686036261566)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:36.485388 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51223c37-9bf3-49e7-b2f6-8966d3429cbe None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:36.487648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 204/409] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:36 2022] GET /identity/v3/projects/a5b903cafe374448928e686036261566 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:36.493796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51223c37-9bf3-49e7-b2f6-8966d3429cbe None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:36.643661 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3814092-e084-46ca-89cb-f6d15790ad2a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:36.679888 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51223c37-9bf3-49e7-b2f6-8966d3429cbe None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:36.692766 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4679f0-3a09-4acd-a119-1912488629fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:36.694834 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4679f0-3a09-4acd-a119-1912488629fa None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:36.695292 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4679f0-3a09-4acd-a119-1912488629fa None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:36.695829 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4679f0-3a09-4acd-a119-1912488629fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:36.726057 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4679f0-3a09-4acd-a119-1912488629fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:36.733833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59dcee-30e0-45d4-b2a4-3f1a6cdba09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:36.735391 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59dcee-30e0-45d4-b2a4-3f1a6cdba09e None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:36.735877 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59dcee-30e0-45d4-b2a4-3f1a6cdba09e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:36.736360 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59dcee-30e0-45d4-b2a4-3f1a6cdba09e None admin] PATH_INFO: `/v3/projects/a5b903cafe374448928e686036261566/groups/98299ae4d24c4267ac7b14efdc38e78b/roles/371a69f4478447a2b7170a3078173caa` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:36.737892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-0a4679f0-3a09-4acd-a119-1912488629fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:05:36.737892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:36.737892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:36.737892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:36.737892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:36.737892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:36.737892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:36.737892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:36.737892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:36.737892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:36.737892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:36.737892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:36.737892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:36.737892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:36.737892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:36.737892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:36.738790 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:36.738790 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:36.738790 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:36.738790 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:36.738790 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:36.738790 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:36.738790 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:36.738790 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:36.738790 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:36.738790 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:36.738790 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:36.738790 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:36.738790 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:36.738790 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:36.738790 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:36.738790 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:36.739586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:36.739586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:36.739586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:36.739586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:36.739586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:36.739586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:36.739586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:36.739586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:36.739586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:36.739586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:36.739586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:05:36.739586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:36.740200 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 206/410] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:36.741512 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b899e-a32c-4783-b591-a8c928867d46 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:36.741808 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b899e-a32c-4783-b591-a8c928867d46 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:36.742102 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b899e-a32c-4783-b591-a8c928867d46 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:36.742906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59dcee-30e0-45d4-b2a4-3f1a6cdba09e None admin] RBAC: Authorizing `identity:create_grant(project_id=a5b903cafe374448928e686036261566, group_id=98299ae4d24c4267ac7b14efdc38e78b, role_id=371a69f4478447a2b7170a3078173caa)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:36.744731 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 207/411] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:36.746193 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59dcee-30e0-45d4-b2a4-3f1a6cdba09e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:36.749066 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b899e-a32c-4783-b591-a8c928867d46 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:36.764363 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 205/412] 10.222.0.48 () {58 vars in 1442 bytes} [Mon May 9 15:05:36 2022] PUT /identity/v3/projects/a5b903cafe374448928e686036261566/groups/98299ae4d24c4267ac7b14efdc38e78b/roles/371a69f4478447a2b7170a3078173caa => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:05:36.771030 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b8d55-fc1d-4aca-9a50-123000793e72 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:36.771728 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b8d55-fc1d-4aca-9a50-123000793e72 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:36.772227 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b8d55-fc1d-4aca-9a50-123000793e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:36.812852 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-cb5b8d55-fc1d-4aca-9a50-123000793e72 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:36.814479 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-cb5b8d55-fc1d-4aca-9a50-123000793e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:36.876719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b899e-a32c-4783-b591-a8c928867d46 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:36.926553 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291f96a-f385-46f7-b724-b3f6cffd1e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:36.927252 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291f96a-f385-46f7-b724-b3f6cffd1e74 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:36.927532 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291f96a-f385-46f7-b724-b3f6cffd1e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:36.927808 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291f96a-f385-46f7-b724-b3f6cffd1e74 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:36.928594 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291f96a-f385-46f7-b724-b3f6cffd1e74 None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:36.928905 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291f96a-f385-46f7-b724-b3f6cffd1e74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:36.934653 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291f96a-f385-46f7-b724-b3f6cffd1e74 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:36.946913 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 206/413] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:36.952931 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 208/414] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:05:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:36.958809 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b8d55-fc1d-4aca-9a50-123000793e72 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:37.000616 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291f96a-f385-46f7-b724-b3f6cffd1e74 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:37.114224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b8d55-fc1d-4aca-9a50-123000793e72 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:37.140599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291f96a-f385-46f7-b724-b3f6cffd1e74 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:37.154229 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef566b-cca4-4949-af9f-7c9caafd36b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:37.155348 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef566b-cca4-4949-af9f-7c9caafd36b3 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:37.155862 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef566b-cca4-4949-af9f-7c9caafd36b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:37.156339 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef566b-cca4-4949-af9f-7c9caafd36b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:37.194400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874dea9-0f74-4a0f-bb19-37bb6e119056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:37.195491 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874dea9-0f74-4a0f-bb19-37bb6e119056 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:37.195803 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874dea9-0f74-4a0f-bb19-37bb6e119056 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:37.196081 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874dea9-0f74-4a0f-bb19-37bb6e119056 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:37.215412 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874dea9-0f74-4a0f-bb19-37bb6e119056 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:37.230375 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-8874dea9-0f74-4a0f-bb19-37bb6e119056 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:05:37.230375 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:37.230375 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:37.230375 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:37.230375 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:37.230375 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:37.230375 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:37.230375 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:37.230375 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:37.230375 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:37.230375 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:37.230375 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:37.230375 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:37.230375 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:37.230375 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:37.230375 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:37.231422 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:37.231422 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:37.231422 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:37.231422 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:37.231422 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:37.231422 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:37.231422 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:37.231422 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:37.231422 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:37.231422 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:37.231422 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:37.231422 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:37.231422 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:37.231422 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:37.231422 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:37.231422 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:37.232221 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:37.232221 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:37.232221 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:37.232221 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:37.232221 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:37.232221 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:37.232221 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:37.232221 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:37.232221 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:37.232221 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:37.232221 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:05:37.232221 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:37.232221 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 209/415] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:05:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:05:37.237960 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874dea9-0f74-4a0f-bb19-37bb6e119056 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:37.242603 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef566b-cca4-4949-af9f-7c9caafd36b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:37.245673 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef566b-cca4-4949-af9f-7c9caafd36b3 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:37.359049 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 207/416] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:05:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:05:37.366550 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef566b-cca4-4949-af9f-7c9caafd36b3 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:37.428159 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874dea9-0f74-4a0f-bb19-37bb6e119056 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:37.468881 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c8018-5d66-4f0f-b84f-85b39c1fa950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:37.469507 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c8018-5d66-4f0f-b84f-85b39c1fa950 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:37.469794 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c8018-5d66-4f0f-b84f-85b39c1fa950 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:37.470068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c8018-5d66-4f0f-b84f-85b39c1fa950 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:37.470842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c8018-5d66-4f0f-b84f-85b39c1fa950 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:37.471147 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c8018-5d66-4f0f-b84f-85b39c1fa950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:37.472566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c8018-5d66-4f0f-b84f-85b39c1fa950 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:37.500250 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 210/417] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:37.506354 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c8018-5d66-4f0f-b84f-85b39c1fa950 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:37.622507 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef566b-cca4-4949-af9f-7c9caafd36b3 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:37.669665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925ffec-0e8b-4dfd-b0cc-2eb9850556fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:37.670936 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925ffec-0e8b-4dfd-b0cc-2eb9850556fa None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:37.674118 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925ffec-0e8b-4dfd-b0cc-2eb9850556fa None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:37.674619 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925ffec-0e8b-4dfd-b0cc-2eb9850556fa None admin] PATH_INFO: `/v3/projects/a5b903cafe374448928e686036261566` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:37.676332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925ffec-0e8b-4dfd-b0cc-2eb9850556fa None admin] RBAC: Authorizing `identity:get_project(project_id=a5b903cafe374448928e686036261566)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:37.678304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925ffec-0e8b-4dfd-b0cc-2eb9850556fa None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:37.681408 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 208/418] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:37 2022] GET /identity/v3/projects/a5b903cafe374448928e686036261566 => generated 298 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:37.687529 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925ffec-0e8b-4dfd-b0cc-2eb9850556fa None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:37.709574 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c8018-5d66-4f0f-b84f-85b39c1fa950 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:37.753821 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0f551-2bb7-461a-ae68-18409c2e3787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:37.755044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0f551-2bb7-461a-ae68-18409c2e3787 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:37.755532 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0f551-2bb7-461a-ae68-18409c2e3787 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:37.756006 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0f551-2bb7-461a-ae68-18409c2e3787 None admin] PATH_INFO: `/v3/groups/8ba6a2ab16fa4c238e636089309b1598` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:37.757662 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0f551-2bb7-461a-ae68-18409c2e3787 None admin] RBAC: Authorizing `identity:get_group(group_id=8ba6a2ab16fa4c238e636089309b1598)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:37.760156 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0f551-2bb7-461a-ae68-18409c2e3787 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:37.762674 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 211/419] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:05:37 2022] GET /identity/v3/groups/8ba6a2ab16fa4c238e636089309b1598 => generated 229 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:37.768509 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0f551-2bb7-461a-ae68-18409c2e3787 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:37.912111 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925ffec-0e8b-4dfd-b0cc-2eb9850556fa None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:37.953879 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d366b-e0b6-4449-b032-60ada6b7b445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:37.955121 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d366b-e0b6-4449-b032-60ada6b7b445 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:37.955769 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d366b-e0b6-4449-b032-60ada6b7b445 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:37.956249 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d366b-e0b6-4449-b032-60ada6b7b445 None admin] PATH_INFO: `/v3/groups/98299ae4d24c4267ac7b14efdc38e78b` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:37.958754 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d366b-e0b6-4449-b032-60ada6b7b445 None admin] RBAC: Authorizing `identity:get_group(group_id=98299ae4d24c4267ac7b14efdc38e78b)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:37.960531 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d366b-e0b6-4449-b032-60ada6b7b445 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:37.963159 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 209/420] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:05:37 2022] GET /identity/v3/groups/98299ae4d24c4267ac7b14efdc38e78b => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:37.970155 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d366b-e0b6-4449-b032-60ada6b7b445 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:38.025273 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0f551-2bb7-461a-ae68-18409c2e3787 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:38.109903 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d366b-e0b6-4449-b032-60ada6b7b445 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:38.148540 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ef532-c6f5-4241-92b5-ab514f295086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:38.148747 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad2930-de5a-4c60-90b8-153584ba064b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:38.150040 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad2930-de5a-4c60-90b8-153584ba064b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:38.150325 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad2930-de5a-4c60-90b8-153584ba064b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:38.150608 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad2930-de5a-4c60-90b8-153584ba064b None admin] PATH_INFO: `/v3/projects/5cfee729a9d442518d1002c1b9a42feb` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:38.151181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ef532-c6f5-4241-92b5-ab514f295086 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:38.151677 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ef532-c6f5-4241-92b5-ab514f295086 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:38.151868 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad2930-de5a-4c60-90b8-153584ba064b None admin] RBAC: Authorizing `identity:get_project(project_id=5cfee729a9d442518d1002c1b9a42feb)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:38.152343 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ef532-c6f5-4241-92b5-ab514f295086 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:38.153321 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad2930-de5a-4c60-90b8-153584ba064b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:38.153667 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ef532-c6f5-4241-92b5-ab514f295086 None admin] RBAC: Adding query filter params (group.id=98299ae4d24c4267ac7b14efdc38e78b, role.id=003cb0d66fec412dbbffb071206075d5, scope.project.id=a5b903cafe374448928e686036261566) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:38.154183 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ef532-c6f5-4241-92b5-ab514f295086 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:38.155843 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ef532-c6f5-4241-92b5-ab514f295086 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:38.161982 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 212/421] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:37 2022] GET /identity/v3/projects/5cfee729a9d442518d1002c1b9a42feb => generated 344 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:38.163186 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 210/422] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:05:37 2022] GET /identity/v3/role_assignments?group.id=98299ae4d24c4267ac7b14efdc38e78b&scope.project.id=a5b903cafe374448928e686036261566&role.id=003cb0d66fec412dbbffb071206075d5 => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:38.172150 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad2930-de5a-4c60-90b8-153584ba064b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:38.348495 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad2930-de5a-4c60-90b8-153584ba064b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:38.392779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0074f6f-1e27-4cd7-954d-1b0ffcca3dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:38.394269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0074f6f-1e27-4cd7-954d-1b0ffcca3dfa None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:38.395007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0074f6f-1e27-4cd7-954d-1b0ffcca3dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:38.395497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0074f6f-1e27-4cd7-954d-1b0ffcca3dfa None admin] PATH_INFO: `/v3/projects/5cfee729a9d442518d1002c1b9a42feb/groups/8ba6a2ab16fa4c238e636089309b1598/roles/3409f00ead9e455182684faa27b1f8f0` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:38.397961 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0074f6f-1e27-4cd7-954d-1b0ffcca3dfa None admin] RBAC: Authorizing `identity:create_grant(project_id=5cfee729a9d442518d1002c1b9a42feb, group_id=8ba6a2ab16fa4c238e636089309b1598, role_id=3409f00ead9e455182684faa27b1f8f0)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:38.399815 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0074f6f-1e27-4cd7-954d-1b0ffcca3dfa None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:38.428155 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 213/423] 10.222.0.48 () {58 vars in 1442 bytes} [Mon May 9 15:05:38 2022] PUT /identity/v3/projects/5cfee729a9d442518d1002c1b9a42feb/groups/8ba6a2ab16fa4c238e636089309b1598/roles/3409f00ead9e455182684faa27b1f8f0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:05:38.995489 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc725bf-7bb3-49ef-bdc7-db5b1798797e None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:38.996104 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc725bf-7bb3-49ef-bdc7-db5b1798797e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:38.996104 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc725bf-7bb3-49ef-bdc7-db5b1798797e None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:38.997654 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 211/424] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:39.004113 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8cba7-f3af-431b-ab9a-4dcb79f2e271 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:39.004745 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8cba7-f3af-431b-ab9a-4dcb79f2e271 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:39.004745 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8cba7-f3af-431b-ab9a-4dcb79f2e271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:39.023327 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-cba8cba7-f3af-431b-ab9a-4dcb79f2e271 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:39.025284 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-cba8cba7-f3af-431b-ab9a-4dcb79f2e271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:39.111973 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 214/425] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:39.140520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc725bf-7bb3-49ef-bdc7-db5b1798797e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:39.172380 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716a0f8-a45c-45e0-8d3c-be3174ba6584 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:39.172816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716a0f8-a45c-45e0-8d3c-be3174ba6584 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:39.173472 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716a0f8-a45c-45e0-8d3c-be3174ba6584 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:39.176904 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 215/426] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:39.193565 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fc0cf-7388-48c9-96af-60bbf40c5372 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:39.195207 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fc0cf-7388-48c9-96af-60bbf40c5372 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:39.195531 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fc0cf-7388-48c9-96af-60bbf40c5372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:39.225946 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-0e4fc0cf-7388-48c9-96af-60bbf40c5372 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:39.228730 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0e4fc0cf-7388-48c9-96af-60bbf40c5372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:39.307760 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc725bf-7bb3-49ef-bdc7-db5b1798797e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:39.332645 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 216/427] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:39.360442 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4bc28-da5e-4f5c-80ae-e986949e2081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:39.361277 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4bc28-da5e-4f5c-80ae-e986949e2081 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:39.361604 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4bc28-da5e-4f5c-80ae-e986949e2081 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:39.361929 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4bc28-da5e-4f5c-80ae-e986949e2081 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:39.367570 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fc0cf-7388-48c9-96af-60bbf40c5372 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:39.384774 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4bc28-da5e-4f5c-80ae-e986949e2081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:39.393169 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-57e4bc28-da5e-4f5c-80ae-e986949e2081 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:05:39.393169 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:39.393169 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:39.393169 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:39.393169 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:39.393169 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:39.393169 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:39.393169 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:39.393169 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:39.393169 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:39.393169 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:39.393169 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:39.393169 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:39.393169 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:39.393169 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:39.393169 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:39.394212 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:39.394212 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:39.394212 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:39.394212 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:39.394212 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:39.394212 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:39.394212 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:39.394212 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:39.394212 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:39.394212 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:39.394212 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:39.394212 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:39.394212 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:39.394212 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:39.394212 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:39.394212 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:39.395035 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:39.395035 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:39.395035 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:39.395035 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:39.395035 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:39.395035 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:39.395035 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:39.395035 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:39.395035 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:39.395035 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:39.395035 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:05:39.395035 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:39.395035 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 212/428] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:05:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:39.401267 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4bc28-da5e-4f5c-80ae-e986949e2081 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:39.515839 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fc0cf-7388-48c9-96af-60bbf40c5372 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:39.546438 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4bc28-da5e-4f5c-80ae-e986949e2081 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:39.561448 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed797e-42d9-4ba7-98b8-bf623af98332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:39.562629 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed797e-42d9-4ba7-98b8-bf623af98332 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:39.563483 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed797e-42d9-4ba7-98b8-bf623af98332 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:39.563954 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed797e-42d9-4ba7-98b8-bf623af98332 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:39.579111 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed797e-42d9-4ba7-98b8-bf623af98332 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:39.589764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-04ed797e-42d9-4ba7-98b8-bf623af98332 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:05:39.589764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:39.589764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:39.589764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:39.589764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:39.589764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:39.589764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:39.589764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:39.589764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:39.589764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:39.589764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:39.589764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:39.589764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:39.589764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:39.589764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:39.589764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:39.590735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:39.590735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:39.590735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:39.590735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:39.590735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:39.590735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:39.590735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:39.590735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:39.590735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:39.590735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:39.590735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:39.590735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:39.590735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:39.590735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:39.590735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:39.590735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:39.591552 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:39.591552 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:39.591552 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:39.591552 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:39.591552 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:39.591552 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:39.591552 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:39.591552 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:39.591552 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:39.591552 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:39.591552 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:05:39.591552 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:39.593848 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 217/429] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:05:39.598266 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a1ea8-23ab-471b-bafb-f7d66fa37f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:39.599253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a1ea8-23ab-471b-bafb-f7d66fa37f2b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:39.599569 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed797e-42d9-4ba7-98b8-bf623af98332 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:39.600172 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a1ea8-23ab-471b-bafb-f7d66fa37f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:39.600655 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a1ea8-23ab-471b-bafb-f7d66fa37f2b None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:39.602154 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a1ea8-23ab-471b-bafb-f7d66fa37f2b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:39.602844 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a1ea8-23ab-471b-bafb-f7d66fa37f2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:39.604695 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a1ea8-23ab-471b-bafb-f7d66fa37f2b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:39.615875 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 213/430] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:05:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:39.622501 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a1ea8-23ab-471b-bafb-f7d66fa37f2b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:39.724851 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed797e-42d9-4ba7-98b8-bf623af98332 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:39.747533 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a1ea8-23ab-471b-bafb-f7d66fa37f2b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:39.768908 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337ebd3-a151-492d-800b-58e40da62ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:39.769612 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337ebd3-a151-492d-800b-58e40da62ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:39.769896 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337ebd3-a151-492d-800b-58e40da62ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:39.770169 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337ebd3-a151-492d-800b-58e40da62ab1 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:39.771512 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337ebd3-a151-492d-800b-58e40da62ab1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:39.771824 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337ebd3-a151-492d-800b-58e40da62ab1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:39.773583 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337ebd3-a151-492d-800b-58e40da62ab1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:39.790604 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 218/431] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:05:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:39.792965 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5dc875-4d93-4be7-9974-1762b214bf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:39.793261 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337ebd3-a151-492d-800b-58e40da62ab1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:39.794210 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dc875-4d93-4be7-9974-1762b214bf4c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:39.794800 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dc875-4d93-4be7-9974-1762b214bf4c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:39.795265 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dc875-4d93-4be7-9974-1762b214bf4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:39.896225 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5dc875-4d93-4be7-9974-1762b214bf4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:39.897789 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5dc875-4d93-4be7-9974-1762b214bf4c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:39.924377 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337ebd3-a151-492d-800b-58e40da62ab1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:39.960150 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1d853-520b-4b0d-be35-0d287806bddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:39.960806 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1d853-520b-4b0d-be35-0d287806bddb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:39.961087 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1d853-520b-4b0d-be35-0d287806bddb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:39.961657 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1d853-520b-4b0d-be35-0d287806bddb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:40.011189 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 214/432] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:05:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:05:40.019895 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5dc875-4d93-4be7-9974-1762b214bf4c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:40.038443 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1d853-520b-4b0d-be35-0d287806bddb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:40.040501 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1d853-520b-4b0d-be35-0d287806bddb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:40.150962 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5dc875-4d93-4be7-9974-1762b214bf4c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:40.161896 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 219/433] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:05:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:05:40.164075 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7236a7-b7cb-4419-94e3-0742b97cdeca None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:40.165505 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7236a7-b7cb-4419-94e3-0742b97cdeca None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:40.166066 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7236a7-b7cb-4419-94e3-0742b97cdeca None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:40.169734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 220/434] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:40.170693 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7236a7-b7cb-4419-94e3-0742b97cdeca None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:40.197453 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f3d86-27d7-4ef5-a899-1ee796af84d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:40.198322 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f3d86-27d7-4ef5-a899-1ee796af84d0 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:40.198607 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f3d86-27d7-4ef5-a899-1ee796af84d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:40.198878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f3d86-27d7-4ef5-a899-1ee796af84d0 None admin] PATH_INFO: `/v3/projects/610acb294db6480e82d07e198f888163` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:40.200096 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f3d86-27d7-4ef5-a899-1ee796af84d0 None admin] RBAC: Authorizing `identity:get_project(project_id=610acb294db6480e82d07e198f888163)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:40.201570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f3d86-27d7-4ef5-a899-1ee796af84d0 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:40.203273 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 215/435] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:40 2022] GET /identity/v3/projects/610acb294db6480e82d07e198f888163 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:40.204458 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e55af-41b3-4259-bbd4-4b0734f10c89 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:40.204823 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e55af-41b3-4259-bbd4-4b0734f10c89 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:40.205110 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e55af-41b3-4259-bbd4-4b0734f10c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:40.223519 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-015e55af-41b3-4259-bbd4-4b0734f10c89 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:40.224714 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-015e55af-41b3-4259-bbd4-4b0734f10c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:40.301132 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 216/436] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:40.302308 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e55af-41b3-4259-bbd4-4b0734f10c89 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:40.324012 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7236a7-b7cb-4419-94e3-0742b97cdeca None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:40.366813 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c6499-1842-4f8a-8b3f-ea92ee966927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:40.367669 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c6499-1842-4f8a-8b3f-ea92ee966927 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:40.367956 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c6499-1842-4f8a-8b3f-ea92ee966927 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:40.368739 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c6499-1842-4f8a-8b3f-ea92ee966927 None admin] PATH_INFO: `/v3/projects/610acb294db6480e82d07e198f888163` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:40.370601 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c6499-1842-4f8a-8b3f-ea92ee966927 None admin] RBAC: Authorizing `identity:get_project(project_id=610acb294db6480e82d07e198f888163)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:40.372067 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c6499-1842-4f8a-8b3f-ea92ee966927 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:40.374052 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 221/437] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:40 2022] GET /identity/v3/projects/610acb294db6480e82d07e198f888163 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:40.374679 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c6499-1842-4f8a-8b3f-ea92ee966927 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:40.451675 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e55af-41b3-4259-bbd4-4b0734f10c89 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:40.492275 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcded6-566e-41bd-8d45-5e2911e13f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:40.493729 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcded6-566e-41bd-8d45-5e2911e13f01 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:40.494010 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcded6-566e-41bd-8d45-5e2911e13f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:40.494279 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcded6-566e-41bd-8d45-5e2911e13f01 None admin] PATH_INFO: `/v3/groups/98299ae4d24c4267ac7b14efdc38e78b` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:40.495591 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fcded6-566e-41bd-8d45-5e2911e13f01 None admin] RBAC: Authorizing `identity:get_group(group_id=98299ae4d24c4267ac7b14efdc38e78b)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:40.497180 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fcded6-566e-41bd-8d45-5e2911e13f01 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:40.499218 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 217/438] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:05:40 2022] GET /identity/v3/groups/98299ae4d24c4267ac7b14efdc38e78b => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:40.500086 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcded6-566e-41bd-8d45-5e2911e13f01 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:40.513316 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c6499-1842-4f8a-8b3f-ea92ee966927 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:40.554394 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff8265-3fb6-498e-8a7a-b753399cfc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:40.555302 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff8265-3fb6-498e-8a7a-b753399cfc67 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:40.556152 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff8265-3fb6-498e-8a7a-b753399cfc67 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:40.556540 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff8265-3fb6-498e-8a7a-b753399cfc67 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:40.571301 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff8265-3fb6-498e-8a7a-b753399cfc67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:40.580439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-6aff8265-3fb6-498e-8a7a-b753399cfc67 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:05:40.580439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:40.580439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:40.580439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:40.580439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:40.580439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:40.580439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:40.580439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:40.580439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:40.580439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:40.580439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:40.580439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:40.580439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:40.580439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:40.580439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:40.580439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:40.581529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:40.581529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:40.581529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:40.581529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:40.581529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:40.581529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:40.581529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:40.581529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:40.581529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:40.581529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:40.581529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:40.581529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:40.581529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:40.581529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:40.581529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:40.581529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:40.582424 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:40.582424 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:40.582424 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:40.582424 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:40.582424 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:40.582424 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:40.582424 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:40.582424 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:40.582424 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:40.582424 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:40.582424 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:05:40.582424 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:40.582424 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 222/439] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:05:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:40.583162 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff8265-3fb6-498e-8a7a-b753399cfc67 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:40.641953 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcded6-566e-41bd-8d45-5e2911e13f01 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:40.690129 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f037a3-ad7a-4c34-b211-c0e8460a4b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:40.691372 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f037a3-ad7a-4c34-b211-c0e8460a4b1d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:40.691742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f037a3-ad7a-4c34-b211-c0e8460a4b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:40.692106 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f037a3-ad7a-4c34-b211-c0e8460a4b1d None admin] PATH_INFO: `/v3/groups/98299ae4d24c4267ac7b14efdc38e78b` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:40.693439 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f037a3-ad7a-4c34-b211-c0e8460a4b1d None admin] RBAC: Authorizing `identity:get_group(group_id=98299ae4d24c4267ac7b14efdc38e78b)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:40.694961 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f037a3-ad7a-4c34-b211-c0e8460a4b1d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:40.701408 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 218/440] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:05:40 2022] GET /identity/v3/groups/98299ae4d24c4267ac7b14efdc38e78b => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:40.701408 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f037a3-ad7a-4c34-b211-c0e8460a4b1d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:40.738497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff8265-3fb6-498e-8a7a-b753399cfc67 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:40.785555 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e633a-eb5f-46b4-870a-dd23586fb3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:40.786321 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e633a-eb5f-46b4-870a-dd23586fb3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:40.786613 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e633a-eb5f-46b4-870a-dd23586fb3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:40.786893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e633a-eb5f-46b4-870a-dd23586fb3d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:40.787717 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e633a-eb5f-46b4-870a-dd23586fb3d0 None admin] RBAC: Adding query filter params (group.id=98299ae4d24c4267ac7b14efdc38e78b, role.id=371a69f4478447a2b7170a3078173caa, scope.project.id=610acb294db6480e82d07e198f888163) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:40.788029 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e633a-eb5f-46b4-870a-dd23586fb3d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:40.789661 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e633a-eb5f-46b4-870a-dd23586fb3d0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:40.796864 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 223/441] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:05:40 2022] GET /identity/v3/role_assignments?group.id=98299ae4d24c4267ac7b14efdc38e78b&scope.project.id=610acb294db6480e82d07e198f888163&role.id=371a69f4478447a2b7170a3078173caa => generated 611 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:40.797671 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e633a-eb5f-46b4-870a-dd23586fb3d0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:40.847020 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f037a3-ad7a-4c34-b211-c0e8460a4b1d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:40.901669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e375d4-d80d-439d-9542-7799bfb3a225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:40.902753 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e375d4-d80d-439d-9542-7799bfb3a225 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:40.903246 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e375d4-d80d-439d-9542-7799bfb3a225 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:40.903726 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e375d4-d80d-439d-9542-7799bfb3a225 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:40.904814 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e375d4-d80d-439d-9542-7799bfb3a225 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:40.905990 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e375d4-d80d-439d-9542-7799bfb3a225 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:40.907615 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e375d4-d80d-439d-9542-7799bfb3a225 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:40.919418 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 219/442] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:05:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:40.929534 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e375d4-d80d-439d-9542-7799bfb3a225 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:40.951648 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e633a-eb5f-46b4-870a-dd23586fb3d0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:41.001147 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8cae6-6782-48e8-b780-9f14070703ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:41.002335 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8cae6-6782-48e8-b780-9f14070703ee None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:41.002863 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8cae6-6782-48e8-b780-9f14070703ee None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:41.003293 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8cae6-6782-48e8-b780-9f14070703ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:41.004411 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8cae6-6782-48e8-b780-9f14070703ee None admin] RBAC: Adding query filter params (group.id=98299ae4d24c4267ac7b14efdc38e78b, role.id=003cb0d66fec412dbbffb071206075d5, scope.project.id=610acb294db6480e82d07e198f888163) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:41.005012 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8cae6-6782-48e8-b780-9f14070703ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:41.006891 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8cae6-6782-48e8-b780-9f14070703ee None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:41.015942 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 224/443] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:05:40 2022] GET /identity/v3/role_assignments?group.id=98299ae4d24c4267ac7b14efdc38e78b&scope.project.id=610acb294db6480e82d07e198f888163&role.id=003cb0d66fec412dbbffb071206075d5 => generated 611 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:41.050516 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a302f-08b6-4f84-90a6-f413f00184ae None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:41.051444 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a302f-08b6-4f84-90a6-f413f00184ae None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:41.051444 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a302f-08b6-4f84-90a6-f413f00184ae None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:41.052741 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 225/444] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:05:41.058875 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc566a4-11cd-4ea9-82f7-7b126cb48ee4 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:41.059194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc566a4-11cd-4ea9-82f7-7b126cb48ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:41.059485 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc566a4-11cd-4ea9-82f7-7b126cb48ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:41.077259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e375d4-d80d-439d-9542-7799bfb3a225 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:41.086559 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3dc566a4-11cd-4ea9-82f7-7b126cb48ee4 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:41.088664 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3dc566a4-11cd-4ea9-82f7-7b126cb48ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:41.129846 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ef7a2-b719-48bb-8a3c-a4ab519394f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:41.130937 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ef7a2-b719-48bb-8a3c-a4ab519394f4 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:41.131394 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ef7a2-b719-48bb-8a3c-a4ab519394f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:41.131836 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ef7a2-b719-48bb-8a3c-a4ab519394f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:41.199741 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 226/445] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:05:41.226556 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc566a4-11cd-4ea9-82f7-7b126cb48ee4 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:41.230035 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ef7a2-b719-48bb-8a3c-a4ab519394f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:41.232164 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ef7a2-b719-48bb-8a3c-a4ab519394f4 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:41.357972 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc566a4-11cd-4ea9-82f7-7b126cb48ee4 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:41.366292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 220/446] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:05:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:05:41.373114 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ef7a2-b719-48bb-8a3c-a4ab519394f4 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:41.401099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55644472-79c1-4852-ae65-b65d8d387c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:41.401915 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55644472-79c1-4852-ae65-b65d8d387c17 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:41.402195 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55644472-79c1-4852-ae65-b65d8d387c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:41.402466 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55644472-79c1-4852-ae65-b65d8d387c17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:41.414112 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55644472-79c1-4852-ae65-b65d8d387c17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:41.423175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-55644472-79c1-4852-ae65-b65d8d387c17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:05:41.423175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:41.423175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:41.423175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:41.423175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:41.423175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:41.423175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:41.423175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:41.423175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:41.423175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:41.423175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:41.423175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:41.423175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:41.423175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:41.423175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:41.423175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:41.424739 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:41.424739 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:41.424739 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:41.424739 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:41.424739 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:41.424739 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:41.424739 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:41.424739 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:41.424739 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:41.424739 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:41.424739 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:41.424739 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:41.424739 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:41.424739 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:41.424739 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:41.424739 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:41.426462 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:41.426462 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:41.426462 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:41.426462 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:41.426462 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:41.426462 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:41.426462 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:41.426462 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:41.426462 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:41.426462 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:41.426462 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:05:41.426462 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:41.426462 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 227/447] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:05:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:05:41.430401 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55644472-79c1-4852-ae65-b65d8d387c17 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:41.489357 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ef7a2-b719-48bb-8a3c-a4ab519394f4 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:41.525277 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b282f44-43e3-4a2a-91be-08e03fc1bd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:41.526202 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b282f44-43e3-4a2a-91be-08e03fc1bd32 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:41.526491 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b282f44-43e3-4a2a-91be-08e03fc1bd32 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:41.526766 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b282f44-43e3-4a2a-91be-08e03fc1bd32 None admin] PATH_INFO: `/v3/projects/a5b903cafe374448928e686036261566` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:41.528013 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b282f44-43e3-4a2a-91be-08e03fc1bd32 None admin] RBAC: Authorizing `identity:get_project(project_id=a5b903cafe374448928e686036261566)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:41.529479 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b282f44-43e3-4a2a-91be-08e03fc1bd32 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:41.531203 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 221/448] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:41 2022] GET /identity/v3/projects/a5b903cafe374448928e686036261566 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:41.535086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55644472-79c1-4852-ae65-b65d8d387c17 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:41.536694 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b282f44-43e3-4a2a-91be-08e03fc1bd32 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:41.571638 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af90d1-80e6-42f2-b4c6-87abaf297c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:41.572432 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af90d1-80e6-42f2-b4c6-87abaf297c87 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:41.572734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af90d1-80e6-42f2-b4c6-87abaf297c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:41.573007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af90d1-80e6-42f2-b4c6-87abaf297c87 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:41.573802 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af90d1-80e6-42f2-b4c6-87abaf297c87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:41.574178 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af90d1-80e6-42f2-b4c6-87abaf297c87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:41.575576 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af90d1-80e6-42f2-b4c6-87abaf297c87 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:41.589424 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 228/449] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:41.595177 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af90d1-80e6-42f2-b4c6-87abaf297c87 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:41.650923 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b282f44-43e3-4a2a-91be-08e03fc1bd32 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:41.686528 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82928488-ff10-41d8-9f96-211e96d0f0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:41.687549 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82928488-ff10-41d8-9f96-211e96d0f0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:41.687912 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82928488-ff10-41d8-9f96-211e96d0f0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:41.688179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82928488-ff10-41d8-9f96-211e96d0f0b8 None admin] PATH_INFO: `/v3/groups/98299ae4d24c4267ac7b14efdc38e78b` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:41.689554 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82928488-ff10-41d8-9f96-211e96d0f0b8 None admin] RBAC: Authorizing `identity:get_group(group_id=98299ae4d24c4267ac7b14efdc38e78b)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:41.690991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82928488-ff10-41d8-9f96-211e96d0f0b8 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:41.692742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 222/450] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:05:41 2022] GET /identity/v3/groups/98299ae4d24c4267ac7b14efdc38e78b => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:41.700076 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82928488-ff10-41d8-9f96-211e96d0f0b8 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:41.731892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af90d1-80e6-42f2-b4c6-87abaf297c87 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:41.769225 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c1b55-aca7-4e36-9faf-10cd2ec24d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:41.769832 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c1b55-aca7-4e36-9faf-10cd2ec24d28 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:41.770099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c1b55-aca7-4e36-9faf-10cd2ec24d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:41.770372 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c1b55-aca7-4e36-9faf-10cd2ec24d28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:41.819809 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82928488-ff10-41d8-9f96-211e96d0f0b8 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:41.849815 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c1b55-aca7-4e36-9faf-10cd2ec24d28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:41.851531 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c1b55-aca7-4e36-9faf-10cd2ec24d28 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:41.858877 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc14bee-33bb-465a-91f2-a5dfe5eb5215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:41.860258 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc14bee-33bb-465a-91f2-a5dfe5eb5215 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:41.860790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc14bee-33bb-465a-91f2-a5dfe5eb5215 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:41.861233 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc14bee-33bb-465a-91f2-a5dfe5eb5215 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:41.862684 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc14bee-33bb-465a-91f2-a5dfe5eb5215 None admin] RBAC: Adding query filter params (group.id=98299ae4d24c4267ac7b14efdc38e78b, role.id=371a69f4478447a2b7170a3078173caa, scope.project.id=a5b903cafe374448928e686036261566) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:41.863221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc14bee-33bb-465a-91f2-a5dfe5eb5215 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:41.865663 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc14bee-33bb-465a-91f2-a5dfe5eb5215 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:41.875613 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 223/451] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:05:41 2022] GET /identity/v3/role_assignments?group.id=98299ae4d24c4267ac7b14efdc38e78b&scope.project.id=a5b903cafe374448928e686036261566&role.id=371a69f4478447a2b7170a3078173caa => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:41.970407 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 229/452] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:05:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:05:41.976629 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc14bee-33bb-465a-91f2-a5dfe5eb5215 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:42.103420 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc14bee-33bb-465a-91f2-a5dfe5eb5215 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:42.146143 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeccd56-e803-4460-8d93-2ee06996010b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:42.147019 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeccd56-e803-4460-8d93-2ee06996010b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:42.147303 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeccd56-e803-4460-8d93-2ee06996010b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:42.147587 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeccd56-e803-4460-8d93-2ee06996010b None admin] PATH_INFO: `/v3/projects/5cfee729a9d442518d1002c1b9a42feb` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:42.148810 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeccd56-e803-4460-8d93-2ee06996010b None admin] RBAC: Authorizing `identity:get_project(project_id=5cfee729a9d442518d1002c1b9a42feb)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:42.151122 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeccd56-e803-4460-8d93-2ee06996010b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:42.152895 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 224/453] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:05:41 2022] GET /identity/v3/projects/5cfee729a9d442518d1002c1b9a42feb => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:42.158819 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c1b55-aca7-4e36-9faf-10cd2ec24d28 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:42.285852 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c1b55-aca7-4e36-9faf-10cd2ec24d28 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:42.340220 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92328b-1b1c-4b44-b255-3c79150c67cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:42.341179 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92328b-1b1c-4b44-b255-3c79150c67cf None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:42.341609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92328b-1b1c-4b44-b255-3c79150c67cf None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:42.342003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92328b-1b1c-4b44-b255-3c79150c67cf None admin] PATH_INFO: `/v3/groups/8ba6a2ab16fa4c238e636089309b1598` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:42.343506 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92328b-1b1c-4b44-b255-3c79150c67cf None admin] RBAC: Authorizing `identity:get_group(group_id=8ba6a2ab16fa4c238e636089309b1598)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:42.345101 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92328b-1b1c-4b44-b255-3c79150c67cf None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:42.346904 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 230/454] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:05:42 2022] GET /identity/v3/groups/8ba6a2ab16fa4c238e636089309b1598 => generated 229 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:42.354449 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeccd56-e803-4460-8d93-2ee06996010b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:42.500687 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeccd56-e803-4460-8d93-2ee06996010b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:42.542794 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8fb34-dd64-48ac-aa08-006c9de2327c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:42.543458 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8fb34-dd64-48ac-aa08-006c9de2327c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:42.543737 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8fb34-dd64-48ac-aa08-006c9de2327c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:42.544014 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8fb34-dd64-48ac-aa08-006c9de2327c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:42.544864 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8fb34-dd64-48ac-aa08-006c9de2327c None admin] RBAC: Adding query filter params (group.id=8ba6a2ab16fa4c238e636089309b1598, role.id=3409f00ead9e455182684faa27b1f8f0, scope.project.id=5cfee729a9d442518d1002c1b9a42feb) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:42.545167 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8fb34-dd64-48ac-aa08-006c9de2327c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:42.546723 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8fb34-dd64-48ac-aa08-006c9de2327c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:42.553512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 225/455] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:05:42 2022] GET /identity/v3/role_assignments?group.id=8ba6a2ab16fa4c238e636089309b1598&scope.project.id=5cfee729a9d442518d1002c1b9a42feb&role.id=3409f00ead9e455182684faa27b1f8f0 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:45.591431 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acae194-9496-416c-b098-49c3422b2696 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:45.592425 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acae194-9496-416c-b098-49c3422b2696 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:45.592919 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acae194-9496-416c-b098-49c3422b2696 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:45.594793 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 231/456] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:45.603292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc186d-cebf-4658-9d67-ecd23ab3d567 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:45.603292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc186d-cebf-4658-9d67-ecd23ab3d567 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:45.603292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc186d-cebf-4658-9d67-ecd23ab3d567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:45.630664 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-05cc186d-cebf-4658-9d67-ecd23ab3d567 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:45.632258 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-05cc186d-cebf-4658-9d67-ecd23ab3d567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:45.732225 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 226/457] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:45.783279 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acae194-9496-416c-b098-49c3422b2696 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:45.853920 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d3097-a1c8-4961-aeca-34b96be886f8 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:45.854219 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d3097-a1c8-4961-aeca-34b96be886f8 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:45.854697 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d3097-a1c8-4961-aeca-34b96be886f8 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:45.856523 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 227/458] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:45.862617 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba86c16-ed8e-4c87-80c7-e7cd22c607c4 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:45.863196 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba86c16-ed8e-4c87-80c7-e7cd22c607c4 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:45.863698 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba86c16-ed8e-4c87-80c7-e7cd22c607c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:45.889844 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-3ba86c16-ed8e-4c87-80c7-e7cd22c607c4 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:45.891478 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-3ba86c16-ed8e-4c87-80c7-e7cd22c607c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:45.917388 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acae194-9496-416c-b098-49c3422b2696 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:45.952152 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16b598-311e-47df-827a-71e3a5d79f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:45.952934 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16b598-311e-47df-827a-71e3a5d79f4a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:45.953421 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16b598-311e-47df-827a-71e3a5d79f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:45.953849 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16b598-311e-47df-827a-71e3a5d79f4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:45.964568 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16b598-311e-47df-827a-71e3a5d79f4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:45.966325 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16b598-311e-47df-827a-71e3a5d79f4a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:45.971425 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 228/459] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:45.973169 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382cd58-b2ca-4b00-b54f-6d45a92ed6ec None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:45.973690 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382cd58-b2ca-4b00-b54f-6d45a92ed6ec None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:45.974180 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382cd58-b2ca-4b00-b54f-6d45a92ed6ec None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:45.975911 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 229/460] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:45.982892 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae3b8a-84c7-4b47-b2bf-d86e1ebaad01 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:45.983271 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae3b8a-84c7-4b47-b2bf-d86e1ebaad01 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:45.983387 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae3b8a-84c7-4b47-b2bf-d86e1ebaad01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:45.994311 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-fb16b598-311e-47df-827a-71e3a5d79f4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:45.994311 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:45.994311 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:45.994311 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:45.994311 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:45.994311 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:45.994311 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:45.994311 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:45.994311 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:45.994311 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:45.994311 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:45.994311 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:45.994311 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:05:45.994311 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:05:45.994311 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:05:45.995256 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:05:45.995256 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:45.995256 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:45.995256 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:45.995256 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:45.995256 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:45.995256 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:45.995256 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:45.995256 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:45.995256 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:45.995256 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:45.995256 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:45.995256 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:45.995256 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:45.995256 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:45.995256 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:45.995256 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:45.996527 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:05:45.996527 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:05:45.996527 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:45.996527 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:46.000741 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 232/461] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:46.001669 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16b598-311e-47df-827a-71e3a5d79f4a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:46.011648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-79ae3b8a-84c7-4b47-b2bf-d86e1ebaad01 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:46.012878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-79ae3b8a-84c7-4b47-b2bf-d86e1ebaad01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:46.127012 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 230/462] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:46.127012 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae3b8a-84c7-4b47-b2bf-d86e1ebaad01 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:46.132433 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16b598-311e-47df-827a-71e3a5d79f4a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:46.178942 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2800c-cd31-4174-b73c-6f803b526691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:46.179972 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2800c-cd31-4174-b73c-6f803b526691 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:46.180525 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2800c-cd31-4174-b73c-6f803b526691 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:46.182159 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2800c-cd31-4174-b73c-6f803b526691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:46.193266 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2800c-cd31-4174-b73c-6f803b526691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:46.195017 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2800c-cd31-4174-b73c-6f803b526691 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:46.218946 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-29a2800c-cd31-4174-b73c-6f803b526691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:46.218946 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:46.218946 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:46.218946 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:46.218946 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:46.218946 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:46.218946 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:46.218946 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:46.218946 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:46.218946 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:46.218946 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:46.218946 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:46.218946 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:05:46.218946 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:05:46.218946 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:05:46.220106 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:05:46.220106 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:46.220106 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:46.220106 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:46.220106 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:46.220106 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:46.220106 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:46.220106 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:46.220106 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:46.220106 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:46.220106 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:46.220106 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:46.220106 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:46.220106 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:46.220106 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:46.220106 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:46.220106 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:46.221201 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:05:46.221201 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:05:46.221201 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:46.221201 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:46.229611 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 233/463] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:46.229611 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2800c-cd31-4174-b73c-6f803b526691 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:46.267363 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae3b8a-84c7-4b47-b2bf-d86e1ebaad01 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:46.304939 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b479ba0-221f-473b-921b-f99275da8209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:46.306627 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b479ba0-221f-473b-921b-f99275da8209 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:46.307140 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b479ba0-221f-473b-921b-f99275da8209 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:46.307631 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b479ba0-221f-473b-921b-f99275da8209 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:46.308585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b479ba0-221f-473b-921b-f99275da8209 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:46.309171 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b479ba0-221f-473b-921b-f99275da8209 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:46.310873 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b479ba0-221f-473b-921b-f99275da8209 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:46.329018 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 231/464] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:46.330323 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b479ba0-221f-473b-921b-f99275da8209 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:46.334995 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2800c-cd31-4174-b73c-6f803b526691 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:46.372907 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d056543-749f-46e4-a05f-10a0b8424285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:46.373738 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d056543-749f-46e4-a05f-10a0b8424285 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:46.374020 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d056543-749f-46e4-a05f-10a0b8424285 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:46.374296 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d056543-749f-46e4-a05f-10a0b8424285 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:46.387160 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d056543-749f-46e4-a05f-10a0b8424285 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:46.388635 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d056543-749f-46e4-a05f-10a0b8424285 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:46.407246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-9d056543-749f-46e4-a05f-10a0b8424285 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:46.407246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:46.407246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:46.407246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:46.407246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:46.407246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:46.407246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:46.407246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:46.407246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:46.407246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:46.407246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:46.407246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:46.407246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:05:46.407246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:05:46.407246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:05:46.408170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:05:46.408170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:46.408170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:46.408170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:46.408170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:46.408170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:46.408170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:46.408170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:46.408170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:46.408170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:46.408170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:46.408170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:46.408170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:46.408170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:46.408170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:46.408170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:46.408170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:46.409062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:05:46.409062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:05:46.409062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:46.409062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:46.414075 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 234/465] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:46.415061 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d056543-749f-46e4-a05f-10a0b8424285 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:46.448187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b479ba0-221f-473b-921b-f99275da8209 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:46.485233 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40cfa0-6d4a-46c4-befc-7ee8035ad575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:46.485962 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40cfa0-6d4a-46c4-befc-7ee8035ad575 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:46.486243 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40cfa0-6d4a-46c4-befc-7ee8035ad575 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:46.486515 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40cfa0-6d4a-46c4-befc-7ee8035ad575 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:46.487247 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40cfa0-6d4a-46c4-befc-7ee8035ad575 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:46.487558 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40cfa0-6d4a-46c4-befc-7ee8035ad575 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:46.488939 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40cfa0-6d4a-46c4-befc-7ee8035ad575 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:46.502731 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 232/466] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:46.503701 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40cfa0-6d4a-46c4-befc-7ee8035ad575 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:46.535069 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d056543-749f-46e4-a05f-10a0b8424285 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:46.569616 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbdcf8-a7a2-4b41-bef6-fd95c2fa4895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:46.570256 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbdcf8-a7a2-4b41-bef6-fd95c2fa4895 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:46.570541 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbdcf8-a7a2-4b41-bef6-fd95c2fa4895 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:46.570825 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbdcf8-a7a2-4b41-bef6-fd95c2fa4895 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:46.572079 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbdcf8-a7a2-4b41-bef6-fd95c2fa4895 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:46.573531 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbdcf8-a7a2-4b41-bef6-fd95c2fa4895 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:46.605410 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 235/467] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:05:46 2022] POST /identity/v3/users => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:05:46.605410 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd37815-5372-4e04-87d8-7192ed7fcece None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:46.605410 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd37815-5372-4e04-87d8-7192ed7fcece None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:46.605410 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd37815-5372-4e04-87d8-7192ed7fcece None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:46.605410 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 236/468] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:46.605410 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd37815-5372-4e04-87d8-7192ed7fcece None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:46.669950 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40cfa0-6d4a-46c4-befc-7ee8035ad575 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:46.707779 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e495c8-18e4-4274-a64a-d62f96be14e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:46.708456 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e495c8-18e4-4274-a64a-d62f96be14e0 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:46.708737 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e495c8-18e4-4274-a64a-d62f96be14e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:46.709014 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e495c8-18e4-4274-a64a-d62f96be14e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:46.709780 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e495c8-18e4-4274-a64a-d62f96be14e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:46.710091 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e495c8-18e4-4274-a64a-d62f96be14e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:46.711521 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e495c8-18e4-4274-a64a-d62f96be14e0 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:46.724530 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 233/469] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:46.725978 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168c62e-87ae-42fb-a2d6-1acb620b684f None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:46.726268 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168c62e-87ae-42fb-a2d6-1acb620b684f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:46.726546 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168c62e-87ae-42fb-a2d6-1acb620b684f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:46.730029 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd37815-5372-4e04-87d8-7192ed7fcece None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:46.745495 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-b168c62e-87ae-42fb-a2d6-1acb620b684f None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:46.746765 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b168c62e-87ae-42fb-a2d6-1acb620b684f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:46.769194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280b4b9-87ce-41d7-b38f-3c44502fdb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:46.769913 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280b4b9-87ce-41d7-b38f-3c44502fdb67 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:46.770199 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280b4b9-87ce-41d7-b38f-3c44502fdb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:46.770477 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280b4b9-87ce-41d7-b38f-3c44502fdb67 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:46.771207 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280b4b9-87ce-41d7-b38f-3c44502fdb67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:46.772680 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280b4b9-87ce-41d7-b38f-3c44502fdb67 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:46.801991 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 237/470] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:05:46 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:05:46.802895 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280b4b9-87ce-41d7-b38f-3c44502fdb67 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:46.831810 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 234/471] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:46.885683 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168c62e-87ae-42fb-a2d6-1acb620b684f None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:46.935086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280b4b9-87ce-41d7-b38f-3c44502fdb67 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:46.972988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712434ee-6e0c-4e9d-8b73-1566499d7f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:46.973765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712434ee-6e0c-4e9d-8b73-1566499d7f20 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:46.974052 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712434ee-6e0c-4e9d-8b73-1566499d7f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:46.974331 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712434ee-6e0c-4e9d-8b73-1566499d7f20 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:46.975063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712434ee-6e0c-4e9d-8b73-1566499d7f20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:46.976550 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712434ee-6e0c-4e9d-8b73-1566499d7f20 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:47.004927 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 238/472] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:05:46 2022] POST /identity/v3/users => generated 248 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:05:47.074367 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1026a-4a11-43a7-ad65-e8115c7d3d28 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:47.074677 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1026a-4a11-43a7-ad65-e8115c7d3d28 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:47.074940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1026a-4a11-43a7-ad65-e8115c7d3d28 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:47.077283 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 239/473] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:47.088426 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168c62e-87ae-42fb-a2d6-1acb620b684f None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:47.092375 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20813d5-3a5b-4ec4-98a9-938f2752e44a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:47.093143 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20813d5-3a5b-4ec4-98a9-938f2752e44a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:47.093817 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20813d5-3a5b-4ec4-98a9-938f2752e44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:47.127905 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-b20813d5-3a5b-4ec4-98a9-938f2752e44a None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:47.132488 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b20813d5-3a5b-4ec4-98a9-938f2752e44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:47.162266 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d51e34-c558-4846-a971-7ba1d82cf0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:47.164373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d51e34-c558-4846-a971-7ba1d82cf0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:47.166359 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d51e34-c558-4846-a971-7ba1d82cf0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:47.167443 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d51e34-c558-4846-a971-7ba1d82cf0f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:47.195690 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d51e34-c558-4846-a971-7ba1d82cf0f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:47.200188 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d51e34-c558-4846-a971-7ba1d82cf0f9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:47.232674 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 240/474] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:47.244705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-96d51e34-c558-4846-a971-7ba1d82cf0f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:47.244705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:47.244705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:47.244705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:47.244705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:47.244705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:47.244705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:47.244705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:47.244705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:47.244705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:47.244705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:47.244705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:47.244705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:05:47.244705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:05:47.244705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:05:47.246532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:05:47.246532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:47.246532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:47.246532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:47.246532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:47.246532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:47.246532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:47.246532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:47.246532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:47.246532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:47.246532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:47.246532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:47.246532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:47.246532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:47.246532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:47.246532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:47.246532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:47.247753 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:05:47.247753 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:05:47.247753 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:47.247753 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:47.251848 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 235/475] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:47.257711 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20813d5-3a5b-4ec4-98a9-938f2752e44a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:47.259989 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d51e34-c558-4846-a971-7ba1d82cf0f9 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:47.380170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20813d5-3a5b-4ec4-98a9-938f2752e44a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:47.380919 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d51e34-c558-4846-a971-7ba1d82cf0f9 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:47.426721 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f817c4d-3197-4a5f-8dda-9b53e98eef55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:47.427417 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f817c4d-3197-4a5f-8dda-9b53e98eef55 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:47.427746 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f817c4d-3197-4a5f-8dda-9b53e98eef55 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:47.428287 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f817c4d-3197-4a5f-8dda-9b53e98eef55 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:47.429107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f817c4d-3197-4a5f-8dda-9b53e98eef55 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:47.430567 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f817c4d-3197-4a5f-8dda-9b53e98eef55 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:47.432235 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7fe37-2434-401f-af0d-71b01bd9ba99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:47.432901 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7fe37-2434-401f-af0d-71b01bd9ba99 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:47.433180 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7fe37-2434-401f-af0d-71b01bd9ba99 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:47.433494 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7fe37-2434-401f-af0d-71b01bd9ba99 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:47.434229 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7fe37-2434-401f-af0d-71b01bd9ba99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:47.434532 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7fe37-2434-401f-af0d-71b01bd9ba99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:47.436013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7fe37-2434-401f-af0d-71b01bd9ba99 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:47.440095 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.sql.core [None req-7f817c4d-3197-4a5f-8dda-9b53e98eef55 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 15:05:47.440095 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 09 15:05:47.440095 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [parameters: {'id': 'ed342ab18b4c48d7b41dfd4b75213135', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 09 15:05:47.440095 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80165) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 15:05:47.457749 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-7f817c4d-3197-4a5f-8dda-9b53e98eef55 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 09 15:05:47.457749 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:47.457749 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:05:47.457749 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:05:47.457749 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:05:47.457749 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:05:47.457749 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:05:47.457749 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:05:47.457749 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:05:47.457749 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application conn.query(q) May 09 15:05:47.457749 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:05:47.457749 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:05:47.457749 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:05:47.457749 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application result.read() May 09 15:05:47.457749 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:05:47.458685 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:05:47.458685 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:05:47.458685 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:05:47.458685 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:05:47.458685 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:05:47.458685 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:05:47.458685 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:05:47.458685 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 15:05:47.458685 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:47.458685 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 15:05:47.458685 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:47.458685 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:47.458685 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 15:05:47.458685 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 15:05:47.458685 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 09 15:05:47.458685 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return ref.to_dict() May 09 15:05:47.458685 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:05:47.458685 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application next(self.gen) May 09 15:05:47.459660 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 15:05:47.459660 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application yield resource May 09 15:05:47.459660 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:05:47.459660 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application next(self.gen) May 09 15:05:47.459660 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 15:05:47.459660 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self.session.rollback() May 09 15:05:47.459660 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 15:05:47.459660 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self.force_reraise() May 09 15:05:47.459660 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 15:05:47.459660 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise self.value May 09 15:05:47.459660 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 15:05:47.459660 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 15:05:47.459660 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 15:05:47.459660 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application session.commit() May 09 15:05:47.459660 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 15:05:47.459660 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 15:05:47.459660 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 15:05:47.460591 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._prepare_impl() May 09 15:05:47.460591 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 15:05:47.460591 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self.session.flush() May 09 15:05:47.460591 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 15:05:47.460591 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._flush(objects) May 09 15:05:47.460591 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 15:05:47.460591 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 15:05:47.460591 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 15:05:47.460591 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application compat.raise_( May 09 15:05:47.460591 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:05:47.460591 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception May 09 15:05:47.460591 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 15:05:47.460591 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application flush_context.execute() May 09 15:05:47.460591 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 15:05:47.460591 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rec.execute(self) May 09 15:05:47.460591 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 15:05:47.460591 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 15:05:47.461583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 15:05:47.461583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 15:05:47.461583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 09 15:05:47.461583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application c = connection._execute_20( May 09 15:05:47.461583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 15:05:47.461583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 15:05:47.461583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 15:05:47.461583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 15:05:47.461583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 15:05:47.461583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 15:05:47.461583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 15:05:47.461583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 15:05:47.461583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 15:05:47.461583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 15:05:47.461583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:05:47.461583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception May 09 15:05:47.463211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:05:47.463211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:05:47.463211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:05:47.463211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:05:47.463211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:05:47.463211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:05:47.463211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:05:47.463211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application conn.query(q) May 09 15:05:47.463211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:05:47.463211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:05:47.463211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:05:47.463211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application result.read() May 09 15:05:47.463211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:05:47.463211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:05:47.463211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:05:47.463211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:05:47.464023 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:05:47.464023 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:05:47.464023 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:05:47.464023 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:05:47.464023 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 15:05:47.464023 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 09 15:05:47.464023 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [parameters: {'id': 'ed342ab18b4c48d7b41dfd4b75213135', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 09 15:05:47.464023 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 15:05:47.464023 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:47.464023 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:05:47.464023 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:47.464023 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:47.464023 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:47.464023 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:47.464023 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:47.464023 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:47.464888 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:47.464888 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:47.464888 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:47.464888 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:47.464888 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:47.464888 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:47.464888 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 09 15:05:47.464888 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 09 15:05:47.464888 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:47.464888 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:47.464888 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 09 15:05:47.464888 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 09 15:05:47.464888 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 15:05:47.464888 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 15:05:47.464888 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 09 15:05:47.464888 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:47.470267 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 236/476] 10.222.0.48 () {60 vars in 1131 bytes} [Mon May 9 15:05:47 2022] POST /identity/v3/roles => generated 144 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 09 15:05:47.470267 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f817c4d-3197-4a5f-8dda-9b53e98eef55 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:47.470825 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 241/477] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:47.472929 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7fe37-2434-401f-af0d-71b01bd9ba99 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:47.631303 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f817c4d-3197-4a5f-8dda-9b53e98eef55 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:47.638808 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7fe37-2434-401f-af0d-71b01bd9ba99 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:47.674460 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad2a54-045b-4bb5-a232-7a5e98ac1436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:47.675986 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad2a54-045b-4bb5-a232-7a5e98ac1436 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:47.676499 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad2a54-045b-4bb5-a232-7a5e98ac1436 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:47.676988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad2a54-045b-4bb5-a232-7a5e98ac1436 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:47.690272 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad2a54-045b-4bb5-a232-7a5e98ac1436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:47.700817 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-ffad2a54-045b-4bb5-a232-7a5e98ac1436 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:05:47.700817 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:47.700817 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:47.700817 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:47.700817 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:47.700817 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:47.700817 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:47.700817 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:47.700817 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:47.700817 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:47.700817 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:47.700817 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:47.700817 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:47.700817 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:47.700817 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:47.700817 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:47.701869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:47.701869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:47.701869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:47.701869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:47.701869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:47.701869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:47.701869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:47.701869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:47.701869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:47.701869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:47.701869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:47.701869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:47.701869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:47.701869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:47.701869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:47.701869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:47.702681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:47.702681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:47.702681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:47.702681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:47.702681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:47.702681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:47.702681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:47.702681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:47.702681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:47.702681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:47.702681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:05:47.702681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:47.709555 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 242/478] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:05:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:05:47.711603 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad2a54-045b-4bb5-a232-7a5e98ac1436 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:47.747471 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0938e-a44c-461e-900f-e065d49a4be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:47.748173 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0938e-a44c-461e-900f-e065d49a4be1 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:47.748450 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0938e-a44c-461e-900f-e065d49a4be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:47.748733 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0938e-a44c-461e-900f-e065d49a4be1 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:47.749500 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0938e-a44c-461e-900f-e065d49a4be1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:47.750983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0938e-a44c-461e-900f-e065d49a4be1 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:47.796331 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 237/479] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:05:47 2022] POST /identity/v3/users => generated 249 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:05:47.829954 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad2a54-045b-4bb5-a232-7a5e98ac1436 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:47.870269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773467a1-65f3-403b-96cb-124cbe5d8bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:47.871368 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773467a1-65f3-403b-96cb-124cbe5d8bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:47.871859 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773467a1-65f3-403b-96cb-124cbe5d8bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:47.872386 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773467a1-65f3-403b-96cb-124cbe5d8bc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:47.873471 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773467a1-65f3-403b-96cb-124cbe5d8bc4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:47.873998 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773467a1-65f3-403b-96cb-124cbe5d8bc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:47.875701 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773467a1-65f3-403b-96cb-124cbe5d8bc4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:47.886418 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 243/480] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:05:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:50.079226 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37204a76-5a7a-461f-8afa-26b2690b5b68 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:50.079929 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37204a76-5a7a-461f-8afa-26b2690b5b68 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:50.079929 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37204a76-5a7a-461f-8afa-26b2690b5b68 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:50.081400 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 238/481] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:50.087458 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a714367-0ab0-42a1-88c1-52c5fafad62a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:50.087984 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a714367-0ab0-42a1-88c1-52c5fafad62a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:50.087984 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a714367-0ab0-42a1-88c1-52c5fafad62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:50.105793 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-7a714367-0ab0-42a1-88c1-52c5fafad62a None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:50.108012 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51403fa8-6142-4447-80a3-5268ce727e53 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:50.108304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51403fa8-6142-4447-80a3-5268ce727e53 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:50.108585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51403fa8-6142-4447-80a3-5268ce727e53 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:50.110470 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 239/482] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:50.111333 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7a714367-0ab0-42a1-88c1-52c5fafad62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:50.115406 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c432fd-6ba6-4273-92ea-a0ac0a8f1035 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:50.115706 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c432fd-6ba6-4273-92ea-a0ac0a8f1035 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:50.115990 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c432fd-6ba6-4273-92ea-a0ac0a8f1035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:50.146306 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-06c432fd-6ba6-4273-92ea-a0ac0a8f1035 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:50.147619 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-06c432fd-6ba6-4273-92ea-a0ac0a8f1035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:50.181302 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 244/483] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:05:50.205568 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a714367-0ab0-42a1-88c1-52c5fafad62a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:50.256526 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 240/484] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:50.266023 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963f30e-fb36-413a-b71d-592283155200 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:50.266317 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963f30e-fb36-413a-b71d-592283155200 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:50.266604 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963f30e-fb36-413a-b71d-592283155200 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:50.267982 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 241/485] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:50 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:50.277606 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6266b-3a05-4f79-a1e8-c514a74a05c9 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:50.277891 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6266b-3a05-4f79-a1e8-c514a74a05c9 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:50.278169 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6266b-3a05-4f79-a1e8-c514a74a05c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:50.306482 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a714367-0ab0-42a1-88c1-52c5fafad62a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:50.307970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-72e6266b-3a05-4f79-a1e8-c514a74a05c9 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:50.309897 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-72e6266b-3a05-4f79-a1e8-c514a74a05c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:50.346324 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cb4e9-581e-4509-8a08-7172a1670a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:50.347038 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cb4e9-581e-4509-8a08-7172a1670a55 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:50.347323 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cb4e9-581e-4509-8a08-7172a1670a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:50.347599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cb4e9-581e-4509-8a08-7172a1670a55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:50.359459 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cb4e9-581e-4509-8a08-7172a1670a55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:50.367599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-e98cb4e9-581e-4509-8a08-7172a1670a55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:05:50.367599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:50.367599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:50.367599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:50.367599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:50.367599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:50.367599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:50.367599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:50.367599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:50.367599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:50.367599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:50.367599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:50.367599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:50.367599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:50.367599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:50.367599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:50.368577 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:50.368577 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:50.368577 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:50.368577 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:50.368577 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:50.368577 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:50.368577 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:50.368577 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:50.368577 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:50.368577 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:50.368577 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:50.368577 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:50.368577 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:50.368577 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:50.368577 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:50.368577 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:50.369908 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:50.369908 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:50.369908 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:50.369908 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:50.369908 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:50.369908 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:50.369908 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:50.369908 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:50.369908 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:50.369908 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:50.369908 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:05:50.369908 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:50.369908 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 245/486] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:05:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:05:50.370833 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cb4e9-581e-4509-8a08-7172a1670a55 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:50.396984 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 242/487] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:05:50.397959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6266b-3a05-4f79-a1e8-c514a74a05c9 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:50.505330 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cb4e9-581e-4509-8a08-7172a1670a55 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:50.521155 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6266b-3a05-4f79-a1e8-c514a74a05c9 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:50.542818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab38eff-b2c7-4a20-880a-69d11609124f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:50.543714 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab38eff-b2c7-4a20-880a-69d11609124f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:50.544060 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab38eff-b2c7-4a20-880a-69d11609124f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:50.544427 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab38eff-b2c7-4a20-880a-69d11609124f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:50.558456 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab38eff-b2c7-4a20-880a-69d11609124f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:50.566587 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-2ab38eff-b2c7-4a20-880a-69d11609124f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:05:50.566587 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:50.566587 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:50.566587 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:50.566587 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:50.566587 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:50.566587 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:50.566587 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:50.566587 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:50.566587 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:50.566587 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:50.566587 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:50.566587 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:50.566587 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:50.566587 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:50.566587 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:50.567571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:50.567571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:50.567571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:50.567571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:50.567571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:50.567571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:50.567571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:50.567571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:50.567571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:50.567571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:50.567571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:50.567571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:50.567571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:50.567571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:50.567571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:50.567571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:50.568369 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:50.568369 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:50.568369 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:50.568369 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:50.568369 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:50.568369 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:50.568369 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:50.568369 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:50.568369 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:50.568369 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:50.568369 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:05:50.568369 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:50.569561 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dc1d2-bcba-4ca6-931b-da424b580be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:50.569561 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dc1d2-bcba-4ca6-931b-da424b580be6 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:50.569561 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dc1d2-bcba-4ca6-931b-da424b580be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:50.569561 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dc1d2-bcba-4ca6-931b-da424b580be6 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:50.569979 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27dc1d2-bcba-4ca6-931b-da424b580be6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:50.569979 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27dc1d2-bcba-4ca6-931b-da424b580be6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:50.572106 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27dc1d2-bcba-4ca6-931b-da424b580be6 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:50.573109 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 246/488] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:05:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:50.574172 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab38eff-b2c7-4a20-880a-69d11609124f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:50.583107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 243/489] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:05:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:50.584002 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dc1d2-bcba-4ca6-931b-da424b580be6 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:50.695187 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab38eff-b2c7-4a20-880a-69d11609124f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:50.705025 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dc1d2-bcba-4ca6-931b-da424b580be6 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:50.743255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211231b-a2fc-425a-930e-dacf9ca0aec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:50.744318 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211231b-a2fc-425a-930e-dacf9ca0aec6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:50.744726 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211231b-a2fc-425a-930e-dacf9ca0aec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:50.745109 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211231b-a2fc-425a-930e-dacf9ca0aec6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:50.750191 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515657c-d6bc-4389-a259-cb3fd9b591b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:50.750878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515657c-d6bc-4389-a259-cb3fd9b591b6 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:50.751165 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515657c-d6bc-4389-a259-cb3fd9b591b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:50.751444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515657c-d6bc-4389-a259-cb3fd9b591b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:50.752199 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515657c-d6bc-4389-a259-cb3fd9b591b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:50.752511 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515657c-d6bc-4389-a259-cb3fd9b591b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:50.753928 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515657c-d6bc-4389-a259-cb3fd9b591b6 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:50.757257 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211231b-a2fc-425a-930e-dacf9ca0aec6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:50.763383 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 244/490] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:05:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:50.764053 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515657c-d6bc-4389-a259-cb3fd9b591b6 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:50.768095 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-c211231b-a2fc-425a-930e-dacf9ca0aec6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:05:50.768095 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:50.768095 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:50.768095 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:50.768095 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:50.768095 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:50.768095 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:50.768095 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:50.768095 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:50.768095 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:50.768095 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:50.768095 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:50.768095 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:50.768095 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:50.768095 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:50.768095 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:50.769282 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:50.769282 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:50.769282 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:50.769282 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:50.769282 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:50.769282 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:50.769282 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:50.769282 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:50.769282 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:50.769282 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:50.769282 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:50.769282 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:50.769282 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:50.769282 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:50.769282 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:50.769282 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:50.770131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:50.770131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:50.770131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:50.770131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:50.770131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:50.770131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:50.770131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:50.770131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:50.770131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:50.770131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:50.770131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:05:50.770131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:50.770131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 247/491] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:05:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:50.770821 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89b316-e286-455e-90b7-42b0f9148fd7 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:50.770895 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89b316-e286-455e-90b7-42b0f9148fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:50.771114 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89b316-e286-455e-90b7-42b0f9148fd7 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:50.772485 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 248/492] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:50.774403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89b316-e286-455e-90b7-42b0f9148fd7 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:50.879889 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515657c-d6bc-4389-a259-cb3fd9b591b6 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:50.880298 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89b316-e286-455e-90b7-42b0f9148fd7 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:50.914019 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648528fe-c709-4c3c-b56a-d0313752fe16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:50.915034 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648528fe-c709-4c3c-b56a-d0313752fe16 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:50.915348 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648528fe-c709-4c3c-b56a-d0313752fe16 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:50.915527 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e38f90-56a8-47a8-a758-2ed91b15a06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:50.915708 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648528fe-c709-4c3c-b56a-d0313752fe16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:50.916375 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e38f90-56a8-47a8-a758-2ed91b15a06e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:50.916793 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e38f90-56a8-47a8-a758-2ed91b15a06e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:50.917000 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e38f90-56a8-47a8-a758-2ed91b15a06e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:50.926957 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648528fe-c709-4c3c-b56a-d0313752fe16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:50.928419 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648528fe-c709-4c3c-b56a-d0313752fe16 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:50.928534 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e38f90-56a8-47a8-a758-2ed91b15a06e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:50.930099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e38f90-56a8-47a8-a758-2ed91b15a06e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:50.947502 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-648528fe-c709-4c3c-b56a-d0313752fe16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:50.947502 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:50.947502 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:50.947502 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:50.947502 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:50.947502 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:50.947502 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:50.947502 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:50.947502 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:50.947502 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:50.947502 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:50.947502 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:50.947502 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:05:50.947502 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:05:50.947502 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:05:50.948506 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:05:50.948506 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:50.948506 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:50.948506 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:50.948506 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:50.948506 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:50.948506 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:50.948506 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:50.948506 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:50.948506 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:50.948506 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:50.948506 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:50.948506 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:50.948506 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:50.948506 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:50.948506 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:50.948506 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:50.949358 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:05:50.949358 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:05:50.949358 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:50.949358 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:50.950084 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-11e38f90-56a8-47a8-a758-2ed91b15a06e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:50.950084 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:50.950084 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:50.950084 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:50.950084 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:50.950084 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:50.950084 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:50.950084 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:50.950084 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:50.950084 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:50.950084 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:50.950084 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:50.950084 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:05:50.950084 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:05:50.950084 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:05:50.950860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:05:50.950860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:50.950860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:50.950860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:50.950860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:50.950860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:50.950860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:50.950860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:50.950860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:50.950860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:50.950860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:50.950860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:50.950860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:50.950860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:50.950860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:50.950860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:50.950860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:50.951716 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:05:50.951716 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:05:50.951716 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:50.951716 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:50.951933 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 245/493] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:50.951933 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648528fe-c709-4c3c-b56a-d0313752fe16 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:50.956750 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 249/494] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:50.956750 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c770a-fb12-42c9-85e5-34c8b99f3aeb None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:50.956750 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c770a-fb12-42c9-85e5-34c8b99f3aeb None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:50.956750 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c770a-fb12-42c9-85e5-34c8b99f3aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:50.972035 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f35c770a-fb12-42c9-85e5-34c8b99f3aeb None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:50.973477 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f35c770a-fb12-42c9-85e5-34c8b99f3aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:51.069637 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 250/495] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:51.071118 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c770a-fb12-42c9-85e5-34c8b99f3aeb None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:51.090207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648528fe-c709-4c3c-b56a-d0313752fe16 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:51.132605 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9260bc-9daa-4028-a534-f19f933c1326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:51.134199 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9260bc-9daa-4028-a534-f19f933c1326 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:51.135160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9260bc-9daa-4028-a534-f19f933c1326 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:51.135160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9260bc-9daa-4028-a534-f19f933c1326 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:51.136239 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9260bc-9daa-4028-a534-f19f933c1326 None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:51.136766 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9260bc-9daa-4028-a534-f19f933c1326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:51.138568 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9260bc-9daa-4028-a534-f19f933c1326 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:51.157203 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 246/496] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:05:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:51.157203 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9260bc-9daa-4028-a534-f19f933c1326 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:51.239990 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c770a-fb12-42c9-85e5-34c8b99f3aeb None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:51.280411 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8d867-2d5c-49b7-b2c7-86a9e010147b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:51.281110 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8d867-2d5c-49b7-b2c7-86a9e010147b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:51.281414 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8d867-2d5c-49b7-b2c7-86a9e010147b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:51.281694 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8d867-2d5c-49b7-b2c7-86a9e010147b None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:51.282433 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8d867-2d5c-49b7-b2c7-86a9e010147b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:51.282733 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8d867-2d5c-49b7-b2c7-86a9e010147b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:51.284116 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8d867-2d5c-49b7-b2c7-86a9e010147b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:51.291581 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9260bc-9daa-4028-a534-f19f933c1326 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:51.295658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 251/497] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:51.296543 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8d867-2d5c-49b7-b2c7-86a9e010147b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:51.328583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80991f3d-4a9c-4ee0-a4a2-73457eb94a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:51.329248 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80991f3d-4a9c-4ee0-a4a2-73457eb94a4d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:51.329558 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80991f3d-4a9c-4ee0-a4a2-73457eb94a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:51.329841 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80991f3d-4a9c-4ee0-a4a2-73457eb94a4d None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:51.330568 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80991f3d-4a9c-4ee0-a4a2-73457eb94a4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:51.330871 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80991f3d-4a9c-4ee0-a4a2-73457eb94a4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:51.332255 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80991f3d-4a9c-4ee0-a4a2-73457eb94a4d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:51.345100 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 247/498] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:51.345989 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80991f3d-4a9c-4ee0-a4a2-73457eb94a4d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:51.404366 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8d867-2d5c-49b7-b2c7-86a9e010147b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:51.448139 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80991f3d-4a9c-4ee0-a4a2-73457eb94a4d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:51.448855 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8dfb3c-6cff-4b64-8b88-d75854630cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:51.449685 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dfb3c-6cff-4b64-8b88-d75854630cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:51.449966 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dfb3c-6cff-4b64-8b88-d75854630cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:51.450236 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dfb3c-6cff-4b64-8b88-d75854630cc5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:51.460380 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8dfb3c-6cff-4b64-8b88-d75854630cc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:51.468655 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-ef8dfb3c-6cff-4b64-8b88-d75854630cc5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:05:51.468655 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:51.468655 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:51.468655 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:51.468655 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:51.468655 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:51.468655 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:51.468655 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:51.468655 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:51.468655 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:51.468655 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:51.468655 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:51.468655 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:51.468655 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:51.468655 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:51.468655 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:51.469688 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:51.469688 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:51.469688 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:51.469688 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:51.469688 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:51.469688 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:51.469688 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:51.469688 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:51.469688 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:51.469688 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:51.469688 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:51.469688 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:51.469688 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:51.469688 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:51.469688 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:51.469688 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:51.470649 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:51.470649 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:51.470649 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:51.470649 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:51.470649 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:51.470649 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:51.470649 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:51.470649 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:51.470649 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:51.470649 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:51.470649 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:05:51.470649 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:51.473721 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 252/499] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:05:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:51.475245 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622a35f-d9a9-4529-bd21-f347f1a89e52 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:51.475589 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622a35f-d9a9-4529-bd21-f347f1a89e52 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:51.475927 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622a35f-d9a9-4529-bd21-f347f1a89e52 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:51.482521 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 253/500] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:51.482521 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622a35f-d9a9-4529-bd21-f347f1a89e52 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:51.488387 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905831bf-3854-4692-a51c-4157e0802e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:51.489179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905831bf-3854-4692-a51c-4157e0802e94 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:51.489489 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905831bf-3854-4692-a51c-4157e0802e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:51.489770 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905831bf-3854-4692-a51c-4157e0802e94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:51.501142 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905831bf-3854-4692-a51c-4157e0802e94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:51.502567 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905831bf-3854-4692-a51c-4157e0802e94 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:51.520679 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-905831bf-3854-4692-a51c-4157e0802e94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:51.520679 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:51.520679 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:51.520679 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:51.520679 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:51.520679 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:51.520679 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:51.520679 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:51.520679 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:51.520679 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:51.520679 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:51.520679 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:51.520679 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:05:51.520679 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:05:51.520679 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:05:51.521607 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:05:51.521607 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:51.521607 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:51.521607 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:51.521607 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:51.521607 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:51.521607 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:51.521607 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:51.521607 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:51.521607 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:51.521607 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:51.521607 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:51.521607 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:51.521607 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:51.521607 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:51.521607 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:51.521607 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:51.522472 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:05:51.522472 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:05:51.522472 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:51.522472 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:51.522472 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 248/501] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:51.522753 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905831bf-3854-4692-a51c-4157e0802e94 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:51.603113 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622a35f-d9a9-4529-bd21-f347f1a89e52 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:51.627031 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905831bf-3854-4692-a51c-4157e0802e94 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:51.635428 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a9c6a-c64c-4de2-8bd1-4625fd60222a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:51.636219 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a9c6a-c64c-4de2-8bd1-4625fd60222a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:51.636497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a9c6a-c64c-4de2-8bd1-4625fd60222a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:51.636777 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a9c6a-c64c-4de2-8bd1-4625fd60222a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:51.644340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a9c6a-c64c-4de2-8bd1-4625fd60222a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:51.645803 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a9c6a-c64c-4de2-8bd1-4625fd60222a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:51.660959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413bec8-30fc-4aea-92ba-6ca29d0137a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:51.661405 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-c94a9c6a-c64c-4de2-8bd1-4625fd60222a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:05:51.661405 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:51.661405 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:51.661405 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:51.661405 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:51.661405 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:51.661405 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:51.661405 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:51.661405 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:51.661405 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:51.661405 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:51.661405 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:51.661405 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:05:51.661405 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:05:51.661405 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:05:51.661405 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:05:51.662523 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:51.662523 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:51.662523 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:05:51.662523 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:05:51.662523 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:05:51.662523 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:05:51.662523 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:51.662523 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:51.662523 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:51.662523 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:51.662523 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:51.662523 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:51.662523 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:51.662523 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:51.662523 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:51.662523 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:51.662523 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:51.662523 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:51.663689 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:51.663689 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:51.663689 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:05:51.663689 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:05:51.663689 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:05:51.663689 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:05:51.663689 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:05:51.663689 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:05:51.663689 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:05:51.663689 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:51.664353 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413bec8-30fc-4aea-92ba-6ca29d0137a9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:51.664353 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413bec8-30fc-4aea-92ba-6ca29d0137a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:51.664353 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413bec8-30fc-4aea-92ba-6ca29d0137a9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:51.664663 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 254/502] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:05:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:51.664663 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a9c6a-c64c-4de2-8bd1-4625fd60222a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:51.674180 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413bec8-30fc-4aea-92ba-6ca29d0137a9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:51.675865 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413bec8-30fc-4aea-92ba-6ca29d0137a9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:51.692678 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-8413bec8-30fc-4aea-92ba-6ca29d0137a9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 15:05:51.692678 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:51.692678 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:51.692678 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:51.692678 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:51.692678 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:51.692678 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:51.692678 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:51.692678 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:51.692678 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:51.692678 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:51.692678 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:51.692678 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:05:51.692678 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:05:51.692678 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:05:51.692678 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:05:51.693728 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:51.693728 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:51.693728 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:05:51.693728 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:05:51.693728 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:05:51.693728 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:05:51.693728 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:51.693728 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:51.693728 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:51.693728 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:51.693728 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:51.693728 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:51.693728 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:51.693728 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:51.693728 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:51.693728 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:51.693728 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:51.693728 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:51.694648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:51.694648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:51.694648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:05:51.694648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:05:51.694648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:05:51.694648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:05:51.694648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:05:51.694648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:05:51.694648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 15:05:51.694648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:51.694648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 249/503] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:51.695464 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d45c8-1113-487a-8a11-f0215c67fc96 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:51.695816 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d45c8-1113-487a-8a11-f0215c67fc96 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:51.696052 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d45c8-1113-487a-8a11-f0215c67fc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:51.713395 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-df7d45c8-1113-487a-8a11-f0215c67fc96 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:51.714591 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-df7d45c8-1113-487a-8a11-f0215c67fc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:51.766056 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a9c6a-c64c-4de2-8bd1-4625fd60222a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:51.784006 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 250/504] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:51.784006 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d45c8-1113-487a-8a11-f0215c67fc96 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:51.809067 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e0a50-78b8-4a6c-9b60-a3c1f1c95648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:51.809776 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e0a50-78b8-4a6c-9b60-a3c1f1c95648 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:51.810062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e0a50-78b8-4a6c-9b60-a3c1f1c95648 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:51.810337 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e0a50-78b8-4a6c-9b60-a3c1f1c95648 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:51.811089 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e0a50-78b8-4a6c-9b60-a3c1f1c95648 None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:51.811394 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e0a50-78b8-4a6c-9b60-a3c1f1c95648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:51.812770 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e0a50-78b8-4a6c-9b60-a3c1f1c95648 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:51.820922 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 255/505] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:05:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:51.822308 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e0a50-78b8-4a6c-9b60-a3c1f1c95648 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:51.887272 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d45c8-1113-487a-8a11-f0215c67fc96 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:51.921449 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f42799-173e-4502-af0d-bfdc09016cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:51.922138 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f42799-173e-4502-af0d-bfdc09016cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:51.922421 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f42799-173e-4502-af0d-bfdc09016cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:51.922700 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f42799-173e-4502-af0d-bfdc09016cd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:51.922865 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e0a50-78b8-4a6c-9b60-a3c1f1c95648 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:51.923419 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f42799-173e-4502-af0d-bfdc09016cd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:51.923724 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f42799-173e-4502-af0d-bfdc09016cd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:51.925103 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f42799-173e-4502-af0d-bfdc09016cd3 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:51.936885 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 251/506] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:51.937778 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f42799-173e-4502-af0d-bfdc09016cd3 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:51.959380 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f646c7-e37f-4483-9439-99015fbdf054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:51.960042 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f646c7-e37f-4483-9439-99015fbdf054 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:51.960320 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f646c7-e37f-4483-9439-99015fbdf054 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:51.960591 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f646c7-e37f-4483-9439-99015fbdf054 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:51.961601 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f646c7-e37f-4483-9439-99015fbdf054 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:51.962596 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f646c7-e37f-4483-9439-99015fbdf054 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:51.964159 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f646c7-e37f-4483-9439-99015fbdf054 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:52.000985 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 256/507] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:05:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:52.001860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f646c7-e37f-4483-9439-99015fbdf054 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:52.041392 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f42799-173e-4502-af0d-bfdc09016cd3 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:52.075643 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45ebc8-e899-4111-92ad-71a3454c2649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:52.076360 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45ebc8-e899-4111-92ad-71a3454c2649 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:52.076695 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45ebc8-e899-4111-92ad-71a3454c2649 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:52.077025 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45ebc8-e899-4111-92ad-71a3454c2649 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:52.078057 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45ebc8-e899-4111-92ad-71a3454c2649 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:52.078414 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45ebc8-e899-4111-92ad-71a3454c2649 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:52.080060 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45ebc8-e899-4111-92ad-71a3454c2649 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:52.099640 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f646c7-e37f-4483-9439-99015fbdf054 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:52.118415 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 252/508] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 9 15:05:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:52.119315 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45ebc8-e899-4111-92ad-71a3454c2649 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:52.136342 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c48ba1-0c76-42da-ad69-765bcc6e44de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:52.137134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c48ba1-0c76-42da-ad69-765bcc6e44de None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:52.137437 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c48ba1-0c76-42da-ad69-765bcc6e44de None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:52.137709 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c48ba1-0c76-42da-ad69-765bcc6e44de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:52.147398 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c48ba1-0c76-42da-ad69-765bcc6e44de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:52.148846 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c48ba1-0c76-42da-ad69-765bcc6e44de None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:52.166572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-b7c48ba1-0c76-42da-ad69-765bcc6e44de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:52.166572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:52.166572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:52.166572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:52.166572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:52.166572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:52.166572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:52.166572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:52.166572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:52.166572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:52.166572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:52.166572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:52.166572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:05:52.166572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:05:52.166572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:05:52.167468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:05:52.167468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:52.167468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:52.167468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:52.167468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:52.167468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:52.167468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:52.167468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:52.167468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:52.167468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:52.167468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:52.167468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:52.167468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:52.167468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:52.167468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:52.167468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:52.167468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:52.168333 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:05:52.168333 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:05:52.168333 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:52.168333 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:52.168333 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 257/509] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:52.168608 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c48ba1-0c76-42da-ad69-765bcc6e44de None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:52.218318 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45ebc8-e899-4111-92ad-71a3454c2649 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:52.253992 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d6c5d-e9ed-42b9-a755-b33aafa5f684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:52.254790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d6c5d-e9ed-42b9-a755-b33aafa5f684 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:52.255077 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d6c5d-e9ed-42b9-a755-b33aafa5f684 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:52.255354 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d6c5d-e9ed-42b9-a755-b33aafa5f684 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:52.266925 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d6c5d-e9ed-42b9-a755-b33aafa5f684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:52.267512 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c48ba1-0c76-42da-ad69-765bcc6e44de None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:52.268386 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d6c5d-e9ed-42b9-a755-b33aafa5f684 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:52.286791 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-754d6c5d-e9ed-42b9-a755-b33aafa5f684 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:52.286791 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:52.286791 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:52.286791 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:52.286791 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:52.286791 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:52.286791 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:52.286791 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:52.286791 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:52.286791 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:52.286791 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:52.286791 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:52.286791 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:05:52.286791 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:05:52.286791 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:05:52.287737 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:05:52.287737 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:52.287737 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:52.287737 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:52.287737 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:52.287737 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:52.287737 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:52.287737 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:52.287737 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:52.287737 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:52.287737 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:52.287737 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:52.287737 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:52.287737 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:52.287737 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:52.287737 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:52.287737 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:52.288664 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:05:52.288664 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:05:52.288664 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:52.288664 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:52.288664 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 253/510] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:52.289132 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d6c5d-e9ed-42b9-a755-b33aafa5f684 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:52.307095 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2036b73-a3f4-4fef-875f-343e578f6190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:52.307812 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2036b73-a3f4-4fef-875f-343e578f6190 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:52.308087 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2036b73-a3f4-4fef-875f-343e578f6190 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:52.308354 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2036b73-a3f4-4fef-875f-343e578f6190 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:52.316265 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2036b73-a3f4-4fef-875f-343e578f6190 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:52.317761 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2036b73-a3f4-4fef-875f-343e578f6190 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:52.332860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f2036b73-a3f4-4fef-875f-343e578f6190 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:05:52.332860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:52.332860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:52.332860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:52.332860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:52.332860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:52.332860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:52.332860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:52.332860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:52.332860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:52.332860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:52.332860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:52.332860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:05:52.332860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:05:52.332860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:05:52.332860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:05:52.333940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:52.333940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:52.333940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:05:52.333940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:05:52.333940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:05:52.333940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:05:52.333940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:52.333940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:52.333940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:52.333940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:52.333940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:52.333940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:52.333940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:52.333940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:52.333940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:52.333940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:52.333940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:52.333940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:52.334931 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:52.334931 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:52.334931 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:05:52.334931 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:05:52.334931 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:05:52.334931 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:05:52.334931 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:05:52.334931 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:05:52.334931 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:05:52.334931 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:52.334931 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 258/511] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:52.334931 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2036b73-a3f4-4fef-875f-343e578f6190 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:52.394938 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d6c5d-e9ed-42b9-a755-b33aafa5f684 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:52.432822 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83bb62-6895-4c0d-8554-fe1f4b3b60ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:52.433508 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83bb62-6895-4c0d-8554-fe1f4b3b60ec None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:52.433797 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83bb62-6895-4c0d-8554-fe1f4b3b60ec None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:52.434082 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83bb62-6895-4c0d-8554-fe1f4b3b60ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:52.448554 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2036b73-a3f4-4fef-875f-343e578f6190 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:52.483498 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74b2e7-15e3-45f1-9069-f99b212b18c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:52.484521 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74b2e7-15e3-45f1-9069-f99b212b18c7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:52.484521 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74b2e7-15e3-45f1-9069-f99b212b18c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:52.484973 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74b2e7-15e3-45f1-9069-f99b212b18c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:52.502060 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83bb62-6895-4c0d-8554-fe1f4b3b60ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:52.503527 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83bb62-6895-4c0d-8554-fe1f4b3b60ec None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:52.553868 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74b2e7-15e3-45f1-9069-f99b212b18c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:52.555875 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74b2e7-15e3-45f1-9069-f99b212b18c7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:52.605986 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 254/512] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:05:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:05:52.606646 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83bb62-6895-4c0d-8554-fe1f4b3b60ec None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:52.657182 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 259/513] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:05:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:05:52.658062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74b2e7-15e3-45f1-9069-f99b212b18c7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:52.706157 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83bb62-6895-4c0d-8554-fe1f4b3b60ec None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:52.747431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d253c64-d377-4397-af76-f4e0ae395fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:52.748368 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d253c64-d377-4397-af76-f4e0ae395fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:52.748655 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d253c64-d377-4397-af76-f4e0ae395fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:52.748930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d253c64-d377-4397-af76-f4e0ae395fd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:52.749694 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d253c64-d377-4397-af76-f4e0ae395fd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:52.750001 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d253c64-d377-4397-af76-f4e0ae395fd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:52.751357 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d253c64-d377-4397-af76-f4e0ae395fd9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:52.763464 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 255/514] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:52.764146 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d253c64-d377-4397-af76-f4e0ae395fd9 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:52.771875 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74b2e7-15e3-45f1-9069-f99b212b18c7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:52.808354 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba14376-c2b0-48f4-9149-26a75921cc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:52.809080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba14376-c2b0-48f4-9149-26a75921cc88 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:52.809386 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba14376-c2b0-48f4-9149-26a75921cc88 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:52.809665 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba14376-c2b0-48f4-9149-26a75921cc88 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:52.810392 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba14376-c2b0-48f4-9149-26a75921cc88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:52.810723 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba14376-c2b0-48f4-9149-26a75921cc88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:52.812110 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba14376-c2b0-48f4-9149-26a75921cc88 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:52.824220 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 260/515] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:52.825064 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba14376-c2b0-48f4-9149-26a75921cc88 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:52.878640 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d253c64-d377-4397-af76-f4e0ae395fd9 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:52.913754 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a17de2-93d7-4115-9a33-3573a8f731cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:52.914423 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a17de2-93d7-4115-9a33-3573a8f731cc None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:52.914805 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a17de2-93d7-4115-9a33-3573a8f731cc None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:52.915113 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a17de2-93d7-4115-9a33-3573a8f731cc None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:52.916085 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a17de2-93d7-4115-9a33-3573a8f731cc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:52.916401 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a17de2-93d7-4115-9a33-3573a8f731cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:52.917851 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a17de2-93d7-4115-9a33-3573a8f731cc None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:52.922473 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba14376-c2b0-48f4-9149-26a75921cc88 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:52.935511 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 256/516] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 9 15:05:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:52.936356 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a17de2-93d7-4115-9a33-3573a8f731cc None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:52.960553 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fadc0-116e-4aee-bf2e-d6aa30f86dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:52.961341 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fadc0-116e-4aee-bf2e-d6aa30f86dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:52.962255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fadc0-116e-4aee-bf2e-d6aa30f86dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:52.962535 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fadc0-116e-4aee-bf2e-d6aa30f86dd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:52.973582 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898fadc0-116e-4aee-bf2e-d6aa30f86dd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:52.975045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898fadc0-116e-4aee-bf2e-d6aa30f86dd0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:52.991898 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-898fadc0-116e-4aee-bf2e-d6aa30f86dd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:52.991898 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:52.991898 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:52.991898 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:52.991898 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:52.991898 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:52.991898 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:52.991898 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:52.991898 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:52.991898 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:52.991898 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:52.991898 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:52.991898 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:05:52.991898 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:05:52.991898 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:05:52.993420 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:05:52.993420 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:52.993420 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:52.993420 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:52.993420 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:52.993420 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:52.993420 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:52.993420 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:52.993420 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:52.993420 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:52.993420 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:52.993420 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:52.993420 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:52.993420 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:52.993420 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:52.993420 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:52.993420 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:52.999131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:05:52.999131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:05:52.999131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:52.999131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:52.999131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 261/517] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:52.999131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fadc0-116e-4aee-bf2e-d6aa30f86dd0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:53.036754 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a17de2-93d7-4115-9a33-3573a8f731cc None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:53.074969 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767270a6-72f3-465b-a7b6-0fc87f036bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:53.075756 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767270a6-72f3-465b-a7b6-0fc87f036bbf None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:53.076046 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767270a6-72f3-465b-a7b6-0fc87f036bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:53.076322 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767270a6-72f3-465b-a7b6-0fc87f036bbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:53.086539 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767270a6-72f3-465b-a7b6-0fc87f036bbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:53.088004 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767270a6-72f3-465b-a7b6-0fc87f036bbf None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:53.099408 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fadc0-116e-4aee-bf2e-d6aa30f86dd0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:53.105818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-767270a6-72f3-465b-a7b6-0fc87f036bbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:53.105818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:53.105818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:53.105818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:53.105818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:53.105818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:53.105818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:53.105818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:53.105818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:53.105818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:53.105818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:53.105818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:53.105818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:05:53.105818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:05:53.105818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:05:53.106912 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:05:53.106912 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:53.106912 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:53.106912 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:53.106912 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:53.106912 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:53.106912 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:53.106912 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:53.106912 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:53.106912 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:53.106912 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:53.106912 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:53.106912 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:53.106912 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:53.106912 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:53.106912 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:53.106912 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:53.108111 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:05:53.108111 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:05:53.108111 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:53.108111 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:53.108111 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 257/518] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:53.109513 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767270a6-72f3-465b-a7b6-0fc87f036bbf None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:53.140160 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4687e5c-3c56-4bc7-a3b9-617f8a6b41b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:53.140723 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4687e5c-3c56-4bc7-a3b9-617f8a6b41b1 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:53.141001 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4687e5c-3c56-4bc7-a3b9-617f8a6b41b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:53.141271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4687e5c-3c56-4bc7-a3b9-617f8a6b41b1 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:53.142004 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4687e5c-3c56-4bc7-a3b9-617f8a6b41b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:53.143427 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4687e5c-3c56-4bc7-a3b9-617f8a6b41b1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:53.162901 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 262/519] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:05:52 2022] POST /identity/v3/users => generated 247 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:05:53.163733 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4687e5c-3c56-4bc7-a3b9-617f8a6b41b1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:53.222179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767270a6-72f3-465b-a7b6-0fc87f036bbf None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:53.260851 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f08c7-79d8-41a0-a3cf-56be677b1d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:53.261706 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f08c7-79d8-41a0-a3cf-56be677b1d08 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:53.261996 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f08c7-79d8-41a0-a3cf-56be677b1d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:53.262273 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f08c7-79d8-41a0-a3cf-56be677b1d08 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:53.270414 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f08c7-79d8-41a0-a3cf-56be677b1d08 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:53.271911 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f08c7-79d8-41a0-a3cf-56be677b1d08 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:53.279017 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4687e5c-3c56-4bc7-a3b9-617f8a6b41b1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:53.288944 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-e90f08c7-79d8-41a0-a3cf-56be677b1d08 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:05:53.288944 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:53.288944 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:53.288944 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:53.288944 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:53.288944 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:53.288944 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:53.288944 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:53.288944 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:53.288944 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:53.288944 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:53.288944 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:53.288944 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:05:53.288944 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:05:53.288944 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:05:53.288944 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:05:53.290181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:53.290181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:53.290181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:05:53.290181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:05:53.290181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:05:53.290181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:05:53.290181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:53.290181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:53.290181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:53.290181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:53.290181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:53.290181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:53.290181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:53.290181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:53.290181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:53.290181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:53.290181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:53.290181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:53.291207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:53.291207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:53.291207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:05:53.291207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:05:53.291207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:05:53.291207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:05:53.291207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:05:53.291207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:05:53.291207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:05:53.291207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:53.295245 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 258/520] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:05:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:53.296222 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f08c7-79d8-41a0-a3cf-56be677b1d08 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:53.323926 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e734766-cb1b-46d1-b834-870c0b5ae975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:53.325018 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e734766-cb1b-46d1-b834-870c0b5ae975 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:53.325928 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e734766-cb1b-46d1-b834-870c0b5ae975 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:53.326426 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e734766-cb1b-46d1-b834-870c0b5ae975 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:53.413632 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f08c7-79d8-41a0-a3cf-56be677b1d08 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:53.420155 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e734766-cb1b-46d1-b834-870c0b5ae975 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:53.421716 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e734766-cb1b-46d1-b834-870c0b5ae975 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:53.454921 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58350e7-adee-4821-a704-76aa768f98f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:53.455602 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58350e7-adee-4821-a704-76aa768f98f9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:53.455885 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58350e7-adee-4821-a704-76aa768f98f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:53.456159 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58350e7-adee-4821-a704-76aa768f98f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:53.456905 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58350e7-adee-4821-a704-76aa768f98f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:53.457220 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58350e7-adee-4821-a704-76aa768f98f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:53.458676 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58350e7-adee-4821-a704-76aa768f98f9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:53.472117 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 259/521] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:53.473334 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58350e7-adee-4821-a704-76aa768f98f9 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:53.540023 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 263/522] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:05:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:05:53.541430 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e734766-cb1b-46d1-b834-870c0b5ae975 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:53.585774 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58350e7-adee-4821-a704-76aa768f98f9 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:53.619675 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91816786-1df6-4e1a-a641-9851538db207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:53.620623 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91816786-1df6-4e1a-a641-9851538db207 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:53.620903 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91816786-1df6-4e1a-a641-9851538db207 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:53.621175 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91816786-1df6-4e1a-a641-9851538db207 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:53.621944 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91816786-1df6-4e1a-a641-9851538db207 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:53.622249 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91816786-1df6-4e1a-a641-9851538db207 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:53.623619 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91816786-1df6-4e1a-a641-9851538db207 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:53.640213 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 260/523] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:53.640213 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91816786-1df6-4e1a-a641-9851538db207 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:53.641191 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e734766-cb1b-46d1-b834-870c0b5ae975 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:53.676059 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e7b94-fc50-4de4-b82d-3940893dab96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:53.676735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e7b94-fc50-4de4-b82d-3940893dab96 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:53.677050 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e7b94-fc50-4de4-b82d-3940893dab96 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:53.677360 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e7b94-fc50-4de4-b82d-3940893dab96 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:53.678411 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e7b94-fc50-4de4-b82d-3940893dab96 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:53.678777 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e7b94-fc50-4de4-b82d-3940893dab96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:53.680454 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e7b94-fc50-4de4-b82d-3940893dab96 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:53.700417 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 264/524] 10.222.0.48 () {56 vars in 1139 bytes} [Mon May 9 15:05:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:53.701662 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e7b94-fc50-4de4-b82d-3940893dab96 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:53.741965 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91816786-1df6-4e1a-a641-9851538db207 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:53.776666 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd17070-2d49-4e96-a3fb-bfff79ef33d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:53.777488 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd17070-2d49-4e96-a3fb-bfff79ef33d0 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:53.777774 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd17070-2d49-4e96-a3fb-bfff79ef33d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:53.778046 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd17070-2d49-4e96-a3fb-bfff79ef33d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:53.784707 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd17070-2d49-4e96-a3fb-bfff79ef33d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:53.786170 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd17070-2d49-4e96-a3fb-bfff79ef33d0 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:53.801009 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-ddd17070-2d49-4e96-a3fb-bfff79ef33d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:05:53.801009 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:53.801009 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:53.801009 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:53.801009 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:53.801009 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:53.801009 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:53.801009 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:53.801009 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:53.801009 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:53.801009 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:53.801009 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:53.801009 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:05:53.801009 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:05:53.801009 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:05:53.801948 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:05:53.801948 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:53.801948 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:53.801948 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:53.801948 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:53.801948 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:53.801948 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:53.801948 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:53.801948 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:53.801948 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:53.801948 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:53.801948 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:53.801948 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:53.801948 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:53.801948 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:53.801948 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:53.801948 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:53.802824 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:05:53.802824 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:05:53.802824 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:05:53.802824 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:05:53.802824 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:05:53.802824 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:05:53.802824 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:05:53.802824 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:53.803818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e7b94-fc50-4de4-b82d-3940893dab96 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:53.806919 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 261/525] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:05:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:53.807765 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd17070-2d49-4e96-a3fb-bfff79ef33d0 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:53.838791 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd77af2-01bb-4294-b4c3-94c24acdc03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:53.839871 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd77af2-01bb-4294-b4c3-94c24acdc03f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:53.840149 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd77af2-01bb-4294-b4c3-94c24acdc03f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:53.840523 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd77af2-01bb-4294-b4c3-94c24acdc03f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:53.851162 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd77af2-01bb-4294-b4c3-94c24acdc03f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:53.853260 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd77af2-01bb-4294-b4c3-94c24acdc03f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:53.871194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-7cd77af2-01bb-4294-b4c3-94c24acdc03f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:53.871194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:53.871194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:53.871194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:53.871194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:53.871194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:53.871194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:53.871194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:53.871194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:53.871194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:53.871194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:53.871194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:53.871194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:05:53.871194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:05:53.871194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:05:53.872132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:05:53.872132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:53.872132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:53.872132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:53.872132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:53.872132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:53.872132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:53.872132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:53.872132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:53.872132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:53.872132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:53.872132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:53.872132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:53.872132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:53.872132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:53.872132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:53.872132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:53.873013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:05:53.873013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:05:53.873013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:53.873013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:53.873013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 265/526] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:53.873276 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd77af2-01bb-4294-b4c3-94c24acdc03f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:53.907650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd17070-2d49-4e96-a3fb-bfff79ef33d0 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:53.944822 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee15933-bf46-4b47-a801-adb26af08b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:53.945652 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee15933-bf46-4b47-a801-adb26af08b24 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:53.946727 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee15933-bf46-4b47-a801-adb26af08b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:53.947060 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee15933-bf46-4b47-a801-adb26af08b24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:53.954412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee15933-bf46-4b47-a801-adb26af08b24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:53.955875 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee15933-bf46-4b47-a801-adb26af08b24 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:53.972355 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-aee15933-bf46-4b47-a801-adb26af08b24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:05:53.972355 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:53.972355 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:53.972355 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:53.972355 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:53.972355 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:53.972355 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:53.972355 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:53.972355 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:53.972355 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:53.972355 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:53.972355 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:53.972355 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:05:53.972355 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:05:53.972355 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:05:53.973286 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:05:53.973286 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:53.973286 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:53.973286 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:53.973286 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:53.973286 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:53.973286 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:53.973286 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:53.973286 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:53.973286 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:53.973286 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:53.973286 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:53.973286 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:53.973286 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:53.973286 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:53.973286 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:53.973286 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:53.974483 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:05:53.974483 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:05:53.974483 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:05:53.974483 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:05:53.974483 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:05:53.974483 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:05:53.974483 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:05:53.974483 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:53.976917 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 262/527] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:05:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:53.977045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd77af2-01bb-4294-b4c3-94c24acdc03f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:53.978181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee15933-bf46-4b47-a801-adb26af08b24 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:54.014122 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a197b-f88c-4517-bd1d-ab589fb8a53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:54.014780 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a197b-f88c-4517-bd1d-ab589fb8a53a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:54.015065 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a197b-f88c-4517-bd1d-ab589fb8a53a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:54.015340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a197b-f88c-4517-bd1d-ab589fb8a53a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:54.081471 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee15933-bf46-4b47-a801-adb26af08b24 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:54.088132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a197b-f88c-4517-bd1d-ab589fb8a53a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:54.089611 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a197b-f88c-4517-bd1d-ab589fb8a53a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:54.120047 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a0c38-d9df-4680-9dc1-76d8014b6a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:54.120704 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a0c38-d9df-4680-9dc1-76d8014b6a70 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:54.120988 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a0c38-d9df-4680-9dc1-76d8014b6a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:54.121261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a0c38-d9df-4680-9dc1-76d8014b6a70 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:54.122085 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a0c38-d9df-4680-9dc1-76d8014b6a70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:54.122388 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a0c38-d9df-4680-9dc1-76d8014b6a70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:54.123826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a0c38-d9df-4680-9dc1-76d8014b6a70 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:54.146979 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 263/528] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:05:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:54.146979 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a0c38-d9df-4680-9dc1-76d8014b6a70 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:54.186472 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 266/529] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:05:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:05:54.187004 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a197b-f88c-4517-bd1d-ab589fb8a53a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:54.248736 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a0c38-d9df-4680-9dc1-76d8014b6a70 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:54.284270 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959aa435-a003-427a-8685-e76d395dfcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:54.285032 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959aa435-a003-427a-8685-e76d395dfcbc None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:54.285258 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a197b-f88c-4517-bd1d-ab589fb8a53a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:54.285693 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959aa435-a003-427a-8685-e76d395dfcbc None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:54.285693 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959aa435-a003-427a-8685-e76d395dfcbc None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:54.286441 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959aa435-a003-427a-8685-e76d395dfcbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:54.286811 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959aa435-a003-427a-8685-e76d395dfcbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:54.288366 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959aa435-a003-427a-8685-e76d395dfcbc None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:54.305042 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 264/530] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:54.305042 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959aa435-a003-427a-8685-e76d395dfcbc None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:54.319611 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7798ca-5ebd-4eb6-9cd2-180932a7fce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:54.320347 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7798ca-5ebd-4eb6-9cd2-180932a7fce8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:54.320703 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7798ca-5ebd-4eb6-9cd2-180932a7fce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:54.321732 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7798ca-5ebd-4eb6-9cd2-180932a7fce8 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:54.322521 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7798ca-5ebd-4eb6-9cd2-180932a7fce8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:54.322828 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7798ca-5ebd-4eb6-9cd2-180932a7fce8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:54.324256 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7798ca-5ebd-4eb6-9cd2-180932a7fce8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:54.342574 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 267/531] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:05:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:54.343416 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7798ca-5ebd-4eb6-9cd2-180932a7fce8 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:54.410119 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959aa435-a003-427a-8685-e76d395dfcbc None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:54.450602 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7798ca-5ebd-4eb6-9cd2-180932a7fce8 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:54.465417 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526db2a2-dfd3-4d66-bee7-5ac1778e9dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:54.466001 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526db2a2-dfd3-4d66-bee7-5ac1778e9dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:54.466287 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526db2a2-dfd3-4d66-bee7-5ac1778e9dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:54.466564 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526db2a2-dfd3-4d66-bee7-5ac1778e9dd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:54.467409 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526db2a2-dfd3-4d66-bee7-5ac1778e9dd5 None admin] RBAC: Adding query filter params (role.id=d8aa93d29788400a97d04db10d8fb8d5, scope.project.id=4fcadeae44cc4547905b83bfebec79c7, user.id=65e7a4e661ef4425b24844c3500b0b58) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:54.467727 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526db2a2-dfd3-4d66-bee7-5ac1778e9dd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:54.469426 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526db2a2-dfd3-4d66-bee7-5ac1778e9dd5 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:54.481764 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 265/532] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:05:54 2022] GET /identity/v3/role_assignments?user.id=65e7a4e661ef4425b24844c3500b0b58&scope.project.id=4fcadeae44cc4547905b83bfebec79c7&role.id=d8aa93d29788400a97d04db10d8fb8d5 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:54.481764 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526db2a2-dfd3-4d66-bee7-5ac1778e9dd5 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:54.491606 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820bc07-3b02-408b-beb6-5f60480349ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:54.492429 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820bc07-3b02-408b-beb6-5f60480349ee None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:54.493324 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820bc07-3b02-408b-beb6-5f60480349ee None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:54.494309 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820bc07-3b02-408b-beb6-5f60480349ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:54.506422 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820bc07-3b02-408b-beb6-5f60480349ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:54.507867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820bc07-3b02-408b-beb6-5f60480349ee None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:54.530284 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-b820bc07-3b02-408b-beb6-5f60480349ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:54.530284 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:54.530284 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:54.530284 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:54.530284 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:54.530284 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:54.530284 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:54.530284 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:54.530284 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:54.530284 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:54.530284 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:54.530284 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:54.530284 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:05:54.530284 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:05:54.530284 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:05:54.531218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:05:54.531218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:54.531218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:54.531218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:54.531218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:54.531218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:54.531218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:54.531218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:54.531218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:54.531218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:54.531218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:54.531218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:54.531218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:54.531218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:54.531218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:54.531218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:54.531218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:54.532395 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:05:54.532395 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:05:54.532395 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:54.532395 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:54.532395 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 268/533] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:54.532781 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820bc07-3b02-408b-beb6-5f60480349ee None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:54.600402 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526db2a2-dfd3-4d66-bee7-5ac1778e9dd5 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:54.636603 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dbed6-c26c-4883-b94e-ff5a4c2c9d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:54.637754 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dbed6-c26c-4883-b94e-ff5a4c2c9d1b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:54.638249 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dbed6-c26c-4883-b94e-ff5a4c2c9d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:54.638977 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dbed6-c26c-4883-b94e-ff5a4c2c9d1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:54.646522 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53dbed6-c26c-4883-b94e-ff5a4c2c9d1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:54.647824 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820bc07-3b02-408b-beb6-5f60480349ee None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:54.648526 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53dbed6-c26c-4883-b94e-ff5a4c2c9d1b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:54.664289 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-c53dbed6-c26c-4883-b94e-ff5a4c2c9d1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:05:54.664289 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:54.664289 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:54.664289 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:54.664289 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:54.664289 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:54.664289 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:54.664289 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:54.664289 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:54.664289 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:54.664289 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:54.664289 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:54.664289 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:05:54.664289 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:05:54.664289 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:05:54.665783 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:05:54.665783 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:54.665783 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:54.665783 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:54.665783 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:54.665783 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:54.665783 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:54.665783 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:54.665783 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:54.665783 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:54.665783 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:54.665783 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:54.665783 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:54.665783 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:54.665783 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:54.665783 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:54.665783 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:54.666633 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:05:54.666633 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:05:54.666633 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:05:54.666633 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:05:54.666633 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:05:54.666633 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:05:54.666633 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:05:54.666633 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:54.673675 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 266/534] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:05:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:54.674875 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dbed6-c26c-4883-b94e-ff5a4c2c9d1b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:54.688410 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f3f3b-0b07-4193-8f7c-0bac9750db86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:54.689131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f3f3b-0b07-4193-8f7c-0bac9750db86 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:54.689441 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f3f3b-0b07-4193-8f7c-0bac9750db86 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:54.689747 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f3f3b-0b07-4193-8f7c-0bac9750db86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:54.690575 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f3f3b-0b07-4193-8f7c-0bac9750db86 None admin] RBAC: Adding query filter params (role.id=d8aa93d29788400a97d04db10d8fb8d5, scope.project.id=4fcadeae44cc4547905b83bfebec79c7, user.id=6dcdf3e1a44d4475882c1af71e933312) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:54.690888 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f3f3b-0b07-4193-8f7c-0bac9750db86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:54.692485 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f3f3b-0b07-4193-8f7c-0bac9750db86 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:54.699921 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 269/535] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:05:54 2022] GET /identity/v3/role_assignments?user.id=6dcdf3e1a44d4475882c1af71e933312&scope.project.id=4fcadeae44cc4547905b83bfebec79c7&role.id=d8aa93d29788400a97d04db10d8fb8d5 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:54.700872 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f3f3b-0b07-4193-8f7c-0bac9750db86 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:54.808857 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dbed6-c26c-4883-b94e-ff5a4c2c9d1b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:54.815922 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f3f3b-0b07-4193-8f7c-0bac9750db86 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:54.857517 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e748a4-441f-45e1-80dd-8cdff89644e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:54.858212 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e748a4-441f-45e1-80dd-8cdff89644e2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:54.858502 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e748a4-441f-45e1-80dd-8cdff89644e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:54.858778 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e748a4-441f-45e1-80dd-8cdff89644e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:54.859849 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e748a4-441f-45e1-80dd-8cdff89644e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:54.860157 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e748a4-441f-45e1-80dd-8cdff89644e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:54.861663 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e748a4-441f-45e1-80dd-8cdff89644e2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:54.875435 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 270/536] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:05:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:54.881350 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e748a4-441f-45e1-80dd-8cdff89644e2 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:54.890364 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab64506-0957-47df-8b29-65bfedd0022a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:54.891634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab64506-0957-47df-8b29-65bfedd0022a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:54.892218 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab64506-0957-47df-8b29-65bfedd0022a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:54.892810 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab64506-0957-47df-8b29-65bfedd0022a None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:54.893980 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab64506-0957-47df-8b29-65bfedd0022a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:54.901406 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab64506-0957-47df-8b29-65bfedd0022a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:54.903627 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab64506-0957-47df-8b29-65bfedd0022a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:54.924804 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 267/537] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:54.929868 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab64506-0957-47df-8b29-65bfedd0022a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:54.998168 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e748a4-441f-45e1-80dd-8cdff89644e2 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:55.033947 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d247468-1a3e-423d-b889-e8f3e3ce1651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:55.034612 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d247468-1a3e-423d-b889-e8f3e3ce1651 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:55.034898 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d247468-1a3e-423d-b889-e8f3e3ce1651 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:55.035178 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d247468-1a3e-423d-b889-e8f3e3ce1651 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:55.036023 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d247468-1a3e-423d-b889-e8f3e3ce1651 None admin] RBAC: Adding query filter params (role.id=d8aa93d29788400a97d04db10d8fb8d5, scope.project.id=4fcadeae44cc4547905b83bfebec79c7, user.id=221e55f84f66471794e82fec1b18c87c) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:55.036340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d247468-1a3e-423d-b889-e8f3e3ce1651 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:55.037812 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d247468-1a3e-423d-b889-e8f3e3ce1651 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:55.045149 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 271/538] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:05:54 2022] GET /identity/v3/role_assignments?user.id=221e55f84f66471794e82fec1b18c87c&scope.project.id=4fcadeae44cc4547905b83bfebec79c7&role.id=d8aa93d29788400a97d04db10d8fb8d5 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:55.080074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab64506-0957-47df-8b29-65bfedd0022a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:55.145288 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eab153-6aea-461b-939f-9905b861a7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:55.146152 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eab153-6aea-461b-939f-9905b861a7ca None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:55.146441 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eab153-6aea-461b-939f-9905b861a7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:55.146722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eab153-6aea-461b-939f-9905b861a7ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:55.161739 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eab153-6aea-461b-939f-9905b861a7ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:55.163249 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eab153-6aea-461b-939f-9905b861a7ca None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:55.185986 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-b7eab153-6aea-461b-939f-9905b861a7ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:05:55.185986 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:55.185986 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:55.185986 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:55.185986 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:55.185986 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:55.185986 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:55.185986 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:55.185986 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:55.185986 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:55.185986 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:55.185986 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:55.185986 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:05:55.185986 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:05:55.185986 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:05:55.186927 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:05:55.186927 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:55.186927 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:55.186927 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:55.186927 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:55.186927 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:55.186927 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:55.186927 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:55.186927 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:55.186927 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:55.186927 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:55.186927 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:55.186927 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:55.186927 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:55.186927 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:55.186927 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:55.186927 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:55.188700 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:05:55.188700 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:05:55.188700 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:05:55.188700 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:05:55.188700 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:05:55.188700 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:05:55.188700 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:05:55.188700 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:55.188700 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 268/539] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:05:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:55.197763 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d247468-1a3e-423d-b889-e8f3e3ce1651 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:55.370083 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d247468-1a3e-423d-b889-e8f3e3ce1651 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:55.416781 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9863c10-a3ef-4276-90a2-432b278bb9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:55.417479 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9863c10-a3ef-4276-90a2-432b278bb9fa None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:55.417767 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9863c10-a3ef-4276-90a2-432b278bb9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:55.418043 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9863c10-a3ef-4276-90a2-432b278bb9fa None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:55.419125 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9863c10-a3ef-4276-90a2-432b278bb9fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:55.419244 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9863c10-a3ef-4276-90a2-432b278bb9fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:55.420670 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9863c10-a3ef-4276-90a2-432b278bb9fa None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:55.438034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 272/540] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:05:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:55.443753 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eab153-6aea-461b-939f-9905b861a7ca None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:55.543132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd102c88-6765-49b4-b2dc-0bba9f788948 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:55.543458 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd102c88-6765-49b4-b2dc-0bba9f788948 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:55.543676 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd102c88-6765-49b4-b2dc-0bba9f788948 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:55.545347 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 273/541] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:55.550797 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3374e-47ab-4217-b8da-e1436bc3f48a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:55.551077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3374e-47ab-4217-b8da-e1436bc3f48a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:55.551354 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3374e-47ab-4217-b8da-e1436bc3f48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:55.574750 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eab153-6aea-461b-939f-9905b861a7ca None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:55.586693 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-10f3374e-47ab-4217-b8da-e1436bc3f48a None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:55.588074 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-10f3374e-47ab-4217-b8da-e1436bc3f48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:55.614422 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ef7be-2f82-4363-9a54-f0fa696e3dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:55.615068 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ef7be-2f82-4363-9a54-f0fa696e3dec None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:55.615355 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ef7be-2f82-4363-9a54-f0fa696e3dec None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:55.615635 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ef7be-2f82-4363-9a54-f0fa696e3dec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:55.616478 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ef7be-2f82-4363-9a54-f0fa696e3dec None admin] RBAC: Adding query filter params (role.id=d8aa93d29788400a97d04db10d8fb8d5, scope.project.id=4fcadeae44cc4547905b83bfebec79c7, user.id=4cd76a442c2f4c759e7438031d5d6aca) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:55.616793 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ef7be-2f82-4363-9a54-f0fa696e3dec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:55.619106 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ef7be-2f82-4363-9a54-f0fa696e3dec None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:55.625920 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 269/542] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:05:55 2022] GET /identity/v3/role_assignments?user.id=4cd76a442c2f4c759e7438031d5d6aca&scope.project.id=4fcadeae44cc4547905b83bfebec79c7&role.id=d8aa93d29788400a97d04db10d8fb8d5 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:55.759723 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 274/543] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:05:55.804035 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ef7be-2f82-4363-9a54-f0fa696e3dec None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:55.912893 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ef7be-2f82-4363-9a54-f0fa696e3dec None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:55.959453 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12053e54-e42a-43ae-be23-8fcdc9c19373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:55.960260 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12053e54-e42a-43ae-be23-8fcdc9c19373 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:55.960540 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12053e54-e42a-43ae-be23-8fcdc9c19373 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:55.960811 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12053e54-e42a-43ae-be23-8fcdc9c19373 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:55.975746 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12053e54-e42a-43ae-be23-8fcdc9c19373 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:55.983505 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-12053e54-e42a-43ae-be23-8fcdc9c19373 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:05:55.983505 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:55.983505 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:55.983505 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:55.983505 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:55.983505 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:55.983505 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:55.983505 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:55.983505 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:55.983505 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:55.983505 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:55.983505 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:55.983505 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:55.983505 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:55.983505 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:55.983505 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:55.984478 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:55.984478 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:55.984478 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:55.984478 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:55.984478 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:55.984478 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:55.984478 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:55.984478 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:55.984478 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:55.984478 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:55.984478 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:55.984478 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:55.984478 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:55.984478 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:55.984478 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:55.984478 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:55.986221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:55.986221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:55.986221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:55.986221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:55.986221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:55.986221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:55.986221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:55.986221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:55.986221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:55.986221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:55.986221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:05:55.986221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:55.986221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 270/544] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:05:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:55.994530 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3374e-47ab-4217-b8da-e1436bc3f48a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:56.145776 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3374e-47ab-4217-b8da-e1436bc3f48a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:56.182389 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92db48-72da-44bf-b5e5-ab857ee33459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:56.183405 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92db48-72da-44bf-b5e5-ab857ee33459 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:56.183885 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92db48-72da-44bf-b5e5-ab857ee33459 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:56.184377 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92db48-72da-44bf-b5e5-ab857ee33459 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:56.185323 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92db48-72da-44bf-b5e5-ab857ee33459 None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:56.185850 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92db48-72da-44bf-b5e5-ab857ee33459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:56.187431 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92db48-72da-44bf-b5e5-ab857ee33459 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:56.196478 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 275/545] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:05:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:56.205517 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12053e54-e42a-43ae-be23-8fcdc9c19373 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:56.410855 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12053e54-e42a-43ae-be23-8fcdc9c19373 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:56.455174 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0596b-5223-4df7-badf-733b739a0897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:56.455912 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0596b-5223-4df7-badf-733b739a0897 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:56.456179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0596b-5223-4df7-badf-733b739a0897 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:56.456450 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0596b-5223-4df7-badf-733b739a0897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:56.469681 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0596b-5223-4df7-badf-733b739a0897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:56.471175 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0596b-5223-4df7-badf-733b739a0897 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:56.490198 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-d6c0596b-5223-4df7-badf-733b739a0897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:56.490198 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:56.490198 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:56.490198 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:56.490198 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:56.490198 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:56.490198 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:56.490198 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:56.490198 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:56.490198 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:56.490198 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:56.490198 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:56.490198 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:05:56.490198 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:05:56.490198 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:05:56.491229 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:05:56.491229 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:56.491229 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:56.491229 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:56.491229 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:56.491229 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:56.491229 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:56.491229 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:56.491229 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:56.491229 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:56.491229 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:56.491229 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:56.491229 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:56.491229 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:56.491229 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:56.491229 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:56.491229 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:56.493552 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:05:56.493552 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:05:56.493552 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:56.493552 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:56.493552 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 271/546] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:56.497410 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92db48-72da-44bf-b5e5-ab857ee33459 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:56.608465 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92db48-72da-44bf-b5e5-ab857ee33459 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:56.646236 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf16eb-c243-4089-af2f-2c3a3ee02c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:56.646909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf16eb-c243-4089-af2f-2c3a3ee02c6f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:56.647189 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf16eb-c243-4089-af2f-2c3a3ee02c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:56.647462 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf16eb-c243-4089-af2f-2c3a3ee02c6f None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:56.648193 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf16eb-c243-4089-af2f-2c3a3ee02c6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:56.648497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf16eb-c243-4089-af2f-2c3a3ee02c6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:56.650696 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf16eb-c243-4089-af2f-2c3a3ee02c6f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:56.663482 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 276/547] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:56.669117 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0596b-5223-4df7-badf-733b739a0897 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:56.774955 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0596b-5223-4df7-badf-733b739a0897 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:56.810093 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28275b13-9343-4130-8d4d-e741186c8edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:56.810884 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28275b13-9343-4130-8d4d-e741186c8edb None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:56.811167 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28275b13-9343-4130-8d4d-e741186c8edb None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:56.811440 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28275b13-9343-4130-8d4d-e741186c8edb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:56.819679 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28275b13-9343-4130-8d4d-e741186c8edb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:56.821170 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28275b13-9343-4130-8d4d-e741186c8edb None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:56.835696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-28275b13-9343-4130-8d4d-e741186c8edb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:05:56.835696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:56.835696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:56.835696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:56.835696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:56.835696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:56.835696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:56.835696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:56.835696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:56.835696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:56.835696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:56.835696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:56.835696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:05:56.835696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:05:56.835696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:05:56.835696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:05:56.838796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:56.838796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:56.838796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:05:56.838796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:05:56.838796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:05:56.838796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:05:56.838796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:56.838796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:56.838796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:56.838796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:56.838796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:56.838796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:56.838796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:56.838796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:56.838796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:56.838796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:56.838796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:56.838796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:56.841051 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:56.841051 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:56.841051 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:05:56.841051 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:05:56.841051 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:05:56.841051 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:05:56.841051 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:05:56.841051 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:05:56.841051 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:05:56.841051 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:56.841051 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 272/548] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:05:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:56.849500 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf16eb-c243-4089-af2f-2c3a3ee02c6f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:56.968480 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf16eb-c243-4089-af2f-2c3a3ee02c6f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:57.006959 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb18dd-11f8-4f05-ae9b-5f79319a3d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:57.007635 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb18dd-11f8-4f05-ae9b-5f79319a3d02 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:57.007917 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb18dd-11f8-4f05-ae9b-5f79319a3d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:57.008246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb18dd-11f8-4f05-ae9b-5f79319a3d02 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:57.009766 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb18dd-11f8-4f05-ae9b-5f79319a3d02 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:57.010076 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb18dd-11f8-4f05-ae9b-5f79319a3d02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:57.011495 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb18dd-11f8-4f05-ae9b-5f79319a3d02 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:57.029252 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 277/549] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 9 15:05:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:57.034567 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28275b13-9343-4130-8d4d-e741186c8edb None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:57.139549 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28275b13-9343-4130-8d4d-e741186c8edb None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:57.174066 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac7418-b339-49b9-9cd7-8112be76a007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:57.174713 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac7418-b339-49b9-9cd7-8112be76a007 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:57.174989 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac7418-b339-49b9-9cd7-8112be76a007 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:57.175260 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac7418-b339-49b9-9cd7-8112be76a007 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:57.244863 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac7418-b339-49b9-9cd7-8112be76a007 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:57.246351 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac7418-b339-49b9-9cd7-8112be76a007 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:57.348152 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 273/550] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:05:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:05:57.354249 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb18dd-11f8-4f05-ae9b-5f79319a3d02 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:57.454948 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb18dd-11f8-4f05-ae9b-5f79319a3d02 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:57.465027 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e8489-872f-4ea4-8f2b-6672a525dfe8 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:57.465645 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e8489-872f-4ea4-8f2b-6672a525dfe8 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:57.465645 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e8489-872f-4ea4-8f2b-6672a525dfe8 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:57.466929 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 274/551] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:05:57.472258 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a33e6-f66e-4fac-b81a-1065f96350e1 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:57.472837 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a33e6-f66e-4fac-b81a-1065f96350e1 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:57.473321 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a33e6-f66e-4fac-b81a-1065f96350e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:57.501904 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-570a33e6-f66e-4fac-b81a-1065f96350e1 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:57.503120 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-570a33e6-f66e-4fac-b81a-1065f96350e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:57.505865 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c2514-cb72-40c3-aeff-cead7d703fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:57.506770 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c2514-cb72-40c3-aeff-cead7d703fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:57.507046 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c2514-cb72-40c3-aeff-cead7d703fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:57.507312 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c2514-cb72-40c3-aeff-cead7d703fa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:57.525176 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c2514-cb72-40c3-aeff-cead7d703fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:57.526747 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c2514-cb72-40c3-aeff-cead7d703fa9 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:57.546955 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-cb0c2514-cb72-40c3-aeff-cead7d703fa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:57.546955 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:57.546955 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:57.546955 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:57.546955 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:57.546955 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:57.546955 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:57.546955 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:57.546955 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:57.546955 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:57.546955 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:57.546955 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:57.546955 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:05:57.546955 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:05:57.546955 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:05:57.548071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:05:57.548071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:57.548071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:57.548071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:57.548071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:57.548071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:57.548071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:57.548071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:57.548071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:57.548071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:57.548071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:57.548071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:57.548071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:57.548071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:57.548071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:57.548071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:57.548071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:57.549783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:05:57.549783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:05:57.549783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:57.549783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:57.549783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 278/552] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:57.554270 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c2514-cb72-40c3-aeff-cead7d703fa9 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:57.666323 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c2514-cb72-40c3-aeff-cead7d703fa9 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:57.705241 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bb0ee-a024-4ebb-925d-7fa8419a629d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:57.706068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bb0ee-a024-4ebb-925d-7fa8419a629d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:57.706348 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bb0ee-a024-4ebb-925d-7fa8419a629d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:57.706681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bb0ee-a024-4ebb-925d-7fa8419a629d None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:57.707419 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bb0ee-a024-4ebb-925d-7fa8419a629d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:57.707722 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bb0ee-a024-4ebb-925d-7fa8419a629d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:57.709095 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bb0ee-a024-4ebb-925d-7fa8419a629d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:57.715047 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 275/553] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:57.721677 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 279/554] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:05:57.727574 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a33e6-f66e-4fac-b81a-1065f96350e1 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:57.758380 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bb0ee-a024-4ebb-925d-7fa8419a629d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:57.925180 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bb0ee-a024-4ebb-925d-7fa8419a629d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:57.932379 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a33e6-f66e-4fac-b81a-1065f96350e1 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:57.982805 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d544eac-8bfd-40b1-92fd-58e53ce1293b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:57.983974 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d544eac-8bfd-40b1-92fd-58e53ce1293b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:57.984429 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d544eac-8bfd-40b1-92fd-58e53ce1293b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:57.985120 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d544eac-8bfd-40b1-92fd-58e53ce1293b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:57.986608 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a1525-3c96-4d7b-8131-9dd1d021da19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:57.987502 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a1525-3c96-4d7b-8131-9dd1d021da19 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:57.987688 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a1525-3c96-4d7b-8131-9dd1d021da19 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:57.987962 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a1525-3c96-4d7b-8131-9dd1d021da19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:57.995876 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d544eac-8bfd-40b1-92fd-58e53ce1293b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:57.997658 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d544eac-8bfd-40b1-92fd-58e53ce1293b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:58.013914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-2d544eac-8bfd-40b1-92fd-58e53ce1293b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:05:58.013914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:58.013914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:58.013914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:58.013914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:58.013914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:58.013914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:58.013914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:58.013914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:58.013914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:58.013914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:58.013914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:58.013914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:05:58.013914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:05:58.013914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:05:58.014818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:05:58.014818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:58.014818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:58.014818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:58.014818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:58.014818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:58.014818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:58.014818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:58.014818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:58.014818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:58.014818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:58.014818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:58.014818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:58.014818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:58.014818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:58.014818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:58.014818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:58.015687 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:05:58.015687 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:05:58.015687 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:05:58.015687 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:05:58.015687 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:05:58.015687 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:05:58.015687 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:05:58.015687 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:58.016093 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a1525-3c96-4d7b-8131-9dd1d021da19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:58.018235 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 276/555] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:05:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:58.026168 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-180a1525-3c96-4d7b-8131-9dd1d021da19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:05:58.026168 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:58.026168 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:58.026168 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:58.026168 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:58.026168 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:58.026168 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:58.026168 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:58.026168 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:58.026168 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:58.026168 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:58.026168 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:58.026168 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:58.026168 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:58.026168 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:58.026168 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:58.027086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:58.027086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:58.027086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:58.027086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:58.027086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:58.027086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:58.027086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:58.027086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:58.027086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:58.027086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:58.027086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:58.027086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:58.027086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:58.027086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:58.027086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:58.027086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:58.027882 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:58.027882 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:58.027882 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:58.027882 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:58.027882 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:58.027882 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:58.027882 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:58.027882 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:58.027882 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:58.027882 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:58.027882 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:05:58.027882 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:58.030651 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d544eac-8bfd-40b1-92fd-58e53ce1293b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:58.032066 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 280/556] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:05:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:05:58.038398 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a1525-3c96-4d7b-8131-9dd1d021da19 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:58.140973 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d544eac-8bfd-40b1-92fd-58e53ce1293b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:58.174314 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378fb99-d3b1-46ff-b6de-2de3fc295c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:58.174976 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378fb99-d3b1-46ff-b6de-2de3fc295c51 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:58.175308 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378fb99-d3b1-46ff-b6de-2de3fc295c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:58.175537 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378fb99-d3b1-46ff-b6de-2de3fc295c51 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:58.176317 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378fb99-d3b1-46ff-b6de-2de3fc295c51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:58.176625 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378fb99-d3b1-46ff-b6de-2de3fc295c51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:58.177700 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a1525-3c96-4d7b-8131-9dd1d021da19 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:58.178131 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378fb99-d3b1-46ff-b6de-2de3fc295c51 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:58.192386 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 277/557] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:05:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:58.197316 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06357db-d4f9-42a1-a90a-f92102ad1f55 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:58.197316 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06357db-d4f9-42a1-a90a-f92102ad1f55 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:58.197316 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06357db-d4f9-42a1-a90a-f92102ad1f55 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:58.197316 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 278/558] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:58.199443 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b388f0-dc8f-4cbd-965c-f53c2f27b199 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:58.199945 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b388f0-dc8f-4cbd-965c-f53c2f27b199 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:58.200231 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b388f0-dc8f-4cbd-965c-f53c2f27b199 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:58.201889 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 279/559] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:58.206102 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b388f0-dc8f-4cbd-965c-f53c2f27b199 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:58.220989 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d64af4-fda7-4bfe-80fd-5125d67f3650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:58.221701 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d64af4-fda7-4bfe-80fd-5125d67f3650 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:58.221981 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d64af4-fda7-4bfe-80fd-5125d67f3650 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:58.222244 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d64af4-fda7-4bfe-80fd-5125d67f3650 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:58.222984 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d64af4-fda7-4bfe-80fd-5125d67f3650 None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:58.223284 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d64af4-fda7-4bfe-80fd-5125d67f3650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:58.224647 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d64af4-fda7-4bfe-80fd-5125d67f3650 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:58.233612 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 281/560] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:05:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:58.235226 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a97824-8f80-41ff-a038-970c42d5a751 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:58.235509 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a97824-8f80-41ff-a038-970c42d5a751 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:58.235778 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a97824-8f80-41ff-a038-970c42d5a751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:58.252205 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-83a97824-8f80-41ff-a038-970c42d5a751 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:58.253422 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-83a97824-8f80-41ff-a038-970c42d5a751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:58.314253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b388f0-dc8f-4cbd-965c-f53c2f27b199 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:58.329564 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 282/561] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:58.329564 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea425c-5787-430b-b2cb-bb97188dedc5 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:58.329564 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea425c-5787-430b-b2cb-bb97188dedc5 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:58.329564 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea425c-5787-430b-b2cb-bb97188dedc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:58.346177 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-7dea425c-5787-430b-b2cb-bb97188dedc5 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:58.347345 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7dea425c-5787-430b-b2cb-bb97188dedc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:58.360690 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b790b1f-5d9d-4122-a4cf-9e2d6f5999de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:58.361349 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b790b1f-5d9d-4122-a4cf-9e2d6f5999de None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:58.361739 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b790b1f-5d9d-4122-a4cf-9e2d6f5999de None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:58.362025 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b790b1f-5d9d-4122-a4cf-9e2d6f5999de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:58.362863 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b790b1f-5d9d-4122-a4cf-9e2d6f5999de None admin] RBAC: Adding query filter params (role.id=d8aa93d29788400a97d04db10d8fb8d5, scope.project.id=4fcadeae44cc4547905b83bfebec79c7, user.id=0b1f03accd91471ea1fe78073c86a97f) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:58.363179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b790b1f-5d9d-4122-a4cf-9e2d6f5999de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:58.364614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b790b1f-5d9d-4122-a4cf-9e2d6f5999de None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:58.371021 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 280/562] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:05:58 2022] GET /identity/v3/role_assignments?user.id=0b1f03accd91471ea1fe78073c86a97f&scope.project.id=4fcadeae44cc4547905b83bfebec79c7&role.id=d8aa93d29788400a97d04db10d8fb8d5 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:58.371694 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b790b1f-5d9d-4122-a4cf-9e2d6f5999de None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:58.467521 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 283/563] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:58.468801 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea425c-5787-430b-b2cb-bb97188dedc5 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:58.527124 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b790b1f-5d9d-4122-a4cf-9e2d6f5999de None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:58.579325 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d0437-f8a5-4530-a728-40ee53492621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:58.580428 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d0437-f8a5-4530-a728-40ee53492621 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:58.580717 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d0437-f8a5-4530-a728-40ee53492621 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:58.580996 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d0437-f8a5-4530-a728-40ee53492621 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:58.593412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d0437-f8a5-4530-a728-40ee53492621 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:58.594881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d0437-f8a5-4530-a728-40ee53492621 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:58.604935 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea425c-5787-430b-b2cb-bb97188dedc5 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:58.615374 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-0d3d0437-f8a5-4530-a728-40ee53492621 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:58.615374 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:58.615374 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:58.615374 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:58.615374 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:58.615374 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:58.615374 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:58.615374 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:58.615374 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:58.615374 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:58.615374 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:58.615374 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:58.615374 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:05:58.615374 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:05:58.615374 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:05:58.616292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:05:58.616292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:58.616292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:58.616292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:58.616292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:58.616292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:58.616292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:58.616292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:58.616292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:58.616292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:58.616292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:58.616292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:58.616292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:58.616292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:58.616292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:58.616292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:58.616292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:58.617140 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:05:58.617140 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:05:58.617140 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:58.617140 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:58.617140 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 281/564] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:58.619149 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d0437-f8a5-4530-a728-40ee53492621 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:58.646027 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71fbf4-8971-47b3-ba74-f3fbf3fb1958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:58.646825 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71fbf4-8971-47b3-ba74-f3fbf3fb1958 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:58.647112 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71fbf4-8971-47b3-ba74-f3fbf3fb1958 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:58.647388 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71fbf4-8971-47b3-ba74-f3fbf3fb1958 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:58.657877 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71fbf4-8971-47b3-ba74-f3fbf3fb1958 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:58.666503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-7e71fbf4-8971-47b3-ba74-f3fbf3fb1958 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:05:58.666503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:58.666503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:58.666503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:58.666503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:58.666503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:58.666503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:58.666503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:58.666503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:58.666503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:58.666503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:58.666503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:58.666503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:58.666503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:58.666503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:58.666503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:58.667645 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:58.667645 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:58.667645 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:58.667645 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:58.667645 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:58.667645 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:58.667645 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:58.667645 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:58.667645 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:58.667645 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:58.667645 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:58.667645 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:58.667645 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:58.667645 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:58.667645 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:58.667645 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:58.668476 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:58.668476 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:58.668476 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:58.668476 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:58.668476 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:58.668476 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:58.668476 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:58.668476 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:58.668476 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:58.668476 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:58.668476 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:05:58.668476 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:58.668476 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 284/565] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:05:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:58.669161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71fbf4-8971-47b3-ba74-f3fbf3fb1958 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:58.723094 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d0437-f8a5-4530-a728-40ee53492621 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:58.761020 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17687672-92ca-4081-a259-a9da430eb248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:58.761854 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17687672-92ca-4081-a259-a9da430eb248 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:58.762139 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17687672-92ca-4081-a259-a9da430eb248 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:58.762411 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17687672-92ca-4081-a259-a9da430eb248 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:58.773928 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17687672-92ca-4081-a259-a9da430eb248 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:58.781229 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71fbf4-8971-47b3-ba74-f3fbf3fb1958 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:58.782094 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-17687672-92ca-4081-a259-a9da430eb248 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:05:58.782094 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:58.782094 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:58.782094 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:58.782094 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:58.782094 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:58.782094 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:58.782094 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:58.782094 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:58.782094 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:58.782094 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:58.782094 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:58.782094 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:58.782094 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:58.782094 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:58.782094 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:58.783099 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:58.783099 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:58.783099 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:58.783099 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:58.783099 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:58.783099 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:58.783099 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:58.783099 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:58.783099 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:58.783099 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:58.783099 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:58.783099 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:58.783099 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:58.783099 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:58.783099 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:58.783099 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:58.784267 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:58.784267 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:58.784267 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:58.784267 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:58.784267 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:58.784267 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:58.784267 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:58.784267 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:58.784267 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:58.784267 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:58.784267 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:05:58.784267 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:58.784267 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 282/566] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:05:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:58.785036 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795ac8d-deba-4f8b-8c83-cd08812b50ec None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:58.785036 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795ac8d-deba-4f8b-8c83-cd08812b50ec None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:58.785200 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795ac8d-deba-4f8b-8c83-cd08812b50ec None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:58.786647 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 283/567] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:05:58.787255 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795ac8d-deba-4f8b-8c83-cd08812b50ec None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:58.828840 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70832c96-9834-4743-bbd7-0d0c7ce5e761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:58.829535 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70832c96-9834-4743-bbd7-0d0c7ce5e761 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:58.829823 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70832c96-9834-4743-bbd7-0d0c7ce5e761 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:58.830105 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70832c96-9834-4743-bbd7-0d0c7ce5e761 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:58.830901 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70832c96-9834-4743-bbd7-0d0c7ce5e761 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:58.831269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70832c96-9834-4743-bbd7-0d0c7ce5e761 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:58.832673 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70832c96-9834-4743-bbd7-0d0c7ce5e761 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:58.845172 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 285/568] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:58.846214 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70832c96-9834-4743-bbd7-0d0c7ce5e761 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:58.920376 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795ac8d-deba-4f8b-8c83-cd08812b50ec None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:58.949883 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70832c96-9834-4743-bbd7-0d0c7ce5e761 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:58.954957 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d274f-d736-4b62-8508-4f02e0743ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:58.955632 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d274f-d736-4b62-8508-4f02e0743ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:58.955921 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d274f-d736-4b62-8508-4f02e0743ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:58.956196 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d274f-d736-4b62-8508-4f02e0743ee2 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:58.956952 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d274f-d736-4b62-8508-4f02e0743ee2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:58.957260 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d274f-d736-4b62-8508-4f02e0743ee2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:58.958683 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d274f-d736-4b62-8508-4f02e0743ee2 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:58.967340 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 284/569] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:05:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:58.968635 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6437804-f659-423c-9a10-fad1ef15d93d None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:58.968924 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6437804-f659-423c-9a10-fad1ef15d93d None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:58.969209 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6437804-f659-423c-9a10-fad1ef15d93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:58.986918 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-c6437804-f659-423c-9a10-fad1ef15d93d None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:05:58.988033 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-c6437804-f659-423c-9a10-fad1ef15d93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:05:58.996442 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34223c-79fa-4881-9a34-b6d74645792d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:58.997124 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34223c-79fa-4881-9a34-b6d74645792d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:58.997431 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34223c-79fa-4881-9a34-b6d74645792d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:58.997719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34223c-79fa-4881-9a34-b6d74645792d None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:58.998478 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34223c-79fa-4881-9a34-b6d74645792d None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:58.998786 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34223c-79fa-4881-9a34-b6d74645792d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:59.000176 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34223c-79fa-4881-9a34-b6d74645792d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:59.013735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 286/570] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:05:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:59.014080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34223c-79fa-4881-9a34-b6d74645792d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:59.063808 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 285/571] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:05:59.065036 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6437804-f659-423c-9a10-fad1ef15d93d None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:59.148284 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34223c-79fa-4881-9a34-b6d74645792d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:59.191095 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95c860-cec8-487b-a450-5c4cb65df2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:59.192161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95c860-cec8-487b-a450-5c4cb65df2fb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:59.192650 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95c860-cec8-487b-a450-5c4cb65df2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:59.193099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95c860-cec8-487b-a450-5c4cb65df2fb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:59.195715 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6437804-f659-423c-9a10-fad1ef15d93d None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:59.202250 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95c860-cec8-487b-a450-5c4cb65df2fb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:59.203976 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95c860-cec8-487b-a450-5c4cb65df2fb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:59.224775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-ce95c860-cec8-487b-a450-5c4cb65df2fb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:05:59.224775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:59.224775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:59.224775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:59.224775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:59.224775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:59.224775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:59.224775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:59.224775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:59.224775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:59.224775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:59.224775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:59.224775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:05:59.224775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:05:59.224775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:05:59.224775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:05:59.226044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:59.226044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:59.226044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:05:59.226044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:05:59.226044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:05:59.226044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:05:59.226044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:59.226044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:59.226044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:59.226044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:59.226044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:59.226044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:59.226044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:59.226044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:59.226044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:59.226044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:59.226044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:59.226044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:59.228461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:59.228461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:59.228461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:05:59.228461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:05:59.228461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:05:59.228461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:05:59.228461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:05:59.228461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:05:59.228461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:05:59.228461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:59.230572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 287/572] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:05:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:59.231607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95c860-cec8-487b-a450-5c4cb65df2fb None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:59.238793 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f2132-9400-4d7b-83ae-b94de1cdb8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:59.239518 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f2132-9400-4d7b-83ae-b94de1cdb8ef None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:59.239806 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f2132-9400-4d7b-83ae-b94de1cdb8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:59.240083 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f2132-9400-4d7b-83ae-b94de1cdb8ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:59.251173 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f2132-9400-4d7b-83ae-b94de1cdb8ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:59.252660 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f2132-9400-4d7b-83ae-b94de1cdb8ef None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:59.272207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-fe6f2132-9400-4d7b-83ae-b94de1cdb8ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:59.272207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:59.272207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:59.272207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:59.272207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:59.272207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:59.272207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:59.272207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:59.272207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:59.272207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:59.272207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:59.272207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:59.272207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:05:59.272207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:05:59.272207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:05:59.274254 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:05:59.274254 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:59.274254 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:59.274254 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:59.274254 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:59.274254 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:59.274254 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:59.274254 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:59.274254 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:59.274254 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:59.274254 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:59.274254 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:59.274254 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:59.274254 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:59.274254 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:59.274254 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:59.274254 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:59.275416 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:05:59.275416 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:05:59.275416 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:59.275416 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:59.275416 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 286/573] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:59.275864 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f2132-9400-4d7b-83ae-b94de1cdb8ef None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:59.341601 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95c860-cec8-487b-a450-5c4cb65df2fb None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:59.376952 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c89a5-0569-4f1f-b341-24cd6a5a4004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:59.377767 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c89a5-0569-4f1f-b341-24cd6a5a4004 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:59.378048 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c89a5-0569-4f1f-b341-24cd6a5a4004 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:59.378326 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c89a5-0569-4f1f-b341-24cd6a5a4004 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:59.386605 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f2132-9400-4d7b-83ae-b94de1cdb8ef None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:59.390743 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c89a5-0569-4f1f-b341-24cd6a5a4004 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:59.392227 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c89a5-0569-4f1f-b341-24cd6a5a4004 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:59.412597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-d57c89a5-0569-4f1f-b341-24cd6a5a4004 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:59.412597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:59.412597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:59.412597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:59.412597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:59.412597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:59.412597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:59.412597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:59.412597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:59.412597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:59.412597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:59.412597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:59.412597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:05:59.412597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:05:59.412597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:05:59.413596 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:05:59.413596 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:59.413596 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:59.413596 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:59.413596 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:59.413596 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:59.413596 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:59.413596 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:59.413596 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:59.413596 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:59.413596 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:59.413596 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:59.413596 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:59.413596 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:59.413596 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:59.413596 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:59.413596 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:59.415235 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:05:59.415235 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:05:59.415235 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:59.415235 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:59.418846 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 288/574] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:59.421941 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c89a5-0569-4f1f-b341-24cd6a5a4004 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:59.426926 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70c9b2-a069-4cb6-b609-216ece67b281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:59.427735 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70c9b2-a069-4cb6-b609-216ece67b281 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:59.428021 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70c9b2-a069-4cb6-b609-216ece67b281 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:59.428299 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70c9b2-a069-4cb6-b609-216ece67b281 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:59.439650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70c9b2-a069-4cb6-b609-216ece67b281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:05:59.447894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-db70c9b2-a069-4cb6-b609-216ece67b281 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:05:59.447894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:59.447894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:59.447894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:59.447894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:59.447894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:59.447894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:59.447894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:59.447894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:59.447894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:59.447894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:59.447894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:59.447894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:05:59.447894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:05:59.447894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:05:59.447894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:05:59.449088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:05:59.449088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:05:59.449088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:05:59.449088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:05:59.449088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:59.449088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:59.449088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:59.449088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:59.449088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:59.449088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:59.449088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:59.449088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:59.449088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:59.449088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:59.449088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:59.449088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:59.450003 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:59.450003 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:59.450003 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:59.450003 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:59.450003 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:05:59.450003 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:05:59.450003 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:05:59.450003 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:05:59.450003 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:05:59.450003 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:05:59.450003 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:05:59.450003 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:59.450003 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 287/575] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:05:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:59.454674 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70c9b2-a069-4cb6-b609-216ece67b281 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:59.529970 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c89a5-0569-4f1f-b341-24cd6a5a4004 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:59.566838 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799ab52-248b-460d-9639-4d72616ed87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:59.567076 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70c9b2-a069-4cb6-b609-216ece67b281 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:59.567715 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799ab52-248b-460d-9639-4d72616ed87c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:59.567942 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799ab52-248b-460d-9639-4d72616ed87c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:59.568231 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799ab52-248b-460d-9639-4d72616ed87c None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:59.569069 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799ab52-248b-460d-9639-4d72616ed87c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:59.569393 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799ab52-248b-460d-9639-4d72616ed87c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:59.570935 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799ab52-248b-460d-9639-4d72616ed87c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:59.590149 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 289/576] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:05:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:59.591016 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799ab52-248b-460d-9639-4d72616ed87c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:59.604815 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ff893-1811-48a7-a8f4-96872517fcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:59.605521 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ff893-1811-48a7-a8f4-96872517fcc8 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:59.605813 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ff893-1811-48a7-a8f4-96872517fcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:59.606092 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ff893-1811-48a7-a8f4-96872517fcc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:59.606826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ff893-1811-48a7-a8f4-96872517fcc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:59.607136 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ff893-1811-48a7-a8f4-96872517fcc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:59.608499 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ff893-1811-48a7-a8f4-96872517fcc8 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:59.621863 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 288/577] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:59.622711 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ff893-1811-48a7-a8f4-96872517fcc8 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:59.697805 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799ab52-248b-460d-9639-4d72616ed87c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:59.721460 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ff893-1811-48a7-a8f4-96872517fcc8 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:59.732253 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d284e-ff0d-4a41-b3e3-d21adf242d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:59.732918 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d284e-ff0d-4a41-b3e3-d21adf242d28 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:59.733206 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d284e-ff0d-4a41-b3e3-d21adf242d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:59.733511 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d284e-ff0d-4a41-b3e3-d21adf242d28 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:59.734234 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d284e-ff0d-4a41-b3e3-d21adf242d28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:59.734539 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d284e-ff0d-4a41-b3e3-d21adf242d28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:59.736158 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d284e-ff0d-4a41-b3e3-d21adf242d28 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:59.748467 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 290/578] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:59.749613 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d284e-ff0d-4a41-b3e3-d21adf242d28 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:59.756696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a82cee-a5d8-45c1-b117-04583bea7c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:59.757838 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a82cee-a5d8-45c1-b117-04583bea7c5c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:59.758989 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a82cee-a5d8-45c1-b117-04583bea7c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:59.759528 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a82cee-a5d8-45c1-b117-04583bea7c5c None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:59.760664 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a82cee-a5d8-45c1-b117-04583bea7c5c None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:05:59.761269 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a82cee-a5d8-45c1-b117-04583bea7c5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:59.762936 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a82cee-a5d8-45c1-b117-04583bea7c5c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:59.777068 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 289/579] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:05:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:05:59.777068 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a82cee-a5d8-45c1-b117-04583bea7c5c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:59.858810 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d284e-ff0d-4a41-b3e3-d21adf242d28 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:59.880637 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a82cee-a5d8-45c1-b117-04583bea7c5c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:05:59.892997 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab0223-f585-4fa0-8d0e-269c8413d0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:59.893822 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab0223-f585-4fa0-8d0e-269c8413d0e4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:59.894113 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab0223-f585-4fa0-8d0e-269c8413d0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:59.894387 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab0223-f585-4fa0-8d0e-269c8413d0e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:59.906269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab0223-f585-4fa0-8d0e-269c8413d0e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:59.907731 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab0223-f585-4fa0-8d0e-269c8413d0e4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:59.917766 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0ca11-9087-4186-8bed-51e9c61a26a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:05:59.918572 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0ca11-9087-4186-8bed-51e9c61a26a4 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:05:59.918860 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0ca11-9087-4186-8bed-51e9c61a26a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:05:59.919143 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0ca11-9087-4186-8bed-51e9c61a26a4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:05:59.925356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-e3ab0223-f585-4fa0-8d0e-269c8413d0e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:59.925356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:59.925356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:59.925356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:59.925356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:59.925356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:59.925356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:59.925356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:59.925356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:59.925356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:59.925356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:59.925356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:59.925356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:05:59.925356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:05:59.925356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:05:59.926267 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:05:59.926267 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:59.926267 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:59.926267 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:59.926267 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:59.926267 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:59.926267 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:59.926267 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:59.926267 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:05:59.926267 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:59.926267 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:59.926267 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:59.926267 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:59.926267 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:59.926267 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:59.926267 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:59.926267 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:59.927181 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:05:59.927181 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:05:59.927181 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:05:59.927181 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:05:59.927181 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 291/580] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:59.927469 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab0223-f585-4fa0-8d0e-269c8413d0e4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:05:59.931546 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0ca11-9087-4186-8bed-51e9c61a26a4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:05:59.933364 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0ca11-9087-4186-8bed-51e9c61a26a4 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:05:59.948644 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-3df0ca11-9087-4186-8bed-51e9c61a26a4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:05:59.948644 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:05:59.948644 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:05:59.948644 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:05:59.948644 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:05:59.948644 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:05:59.948644 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:05:59.948644 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:05:59.948644 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:05:59.948644 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:05:59.948644 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:05:59.948644 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:05:59.948644 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:05:59.948644 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:05:59.948644 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:05:59.948644 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:05:59.949934 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:05:59.949934 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:05:59.949934 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:05:59.949934 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:05:59.949934 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:05:59.949934 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:05:59.949934 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:05:59.949934 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:05:59.949934 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:05:59.949934 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:05:59.949934 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:05:59.949934 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:05:59.949934 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:05:59.949934 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:05:59.949934 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:05:59.949934 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:05:59.949934 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:05:59.949934 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:05:59.950917 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:05:59.950917 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:05:59.950917 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:05:59.950917 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:05:59.950917 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:05:59.950917 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:05:59.950917 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:05:59.950917 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:05:59.950917 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:05:59.950917 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:05:59.950917 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 290/581] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:05:59.950917 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0ca11-9087-4186-8bed-51e9c61a26a4 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:00.028325 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab0223-f585-4fa0-8d0e-269c8413d0e4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:00.061127 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0ca11-9087-4186-8bed-51e9c61a26a4 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:00.063381 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a0705-b144-4024-a63d-23785177505b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:00.064246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a0705-b144-4024-a63d-23785177505b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:00.064533 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a0705-b144-4024-a63d-23785177505b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:00.064809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a0705-b144-4024-a63d-23785177505b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:00.072561 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a0705-b144-4024-a63d-23785177505b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:00.074039 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a0705-b144-4024-a63d-23785177505b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:00.088609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-025a0705-b144-4024-a63d-23785177505b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 15:06:00.088609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:00.088609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:00.088609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:00.088609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:00.088609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:00.088609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:00.088609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:00.088609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:00.088609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:00.088609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:00.088609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:00.088609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:00.088609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:00.088609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:00.088609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:00.089802 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:00.089802 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:00.089802 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:00.089802 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:00.089802 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:00.089802 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:00.089802 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:00.089802 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:00.089802 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:00.089802 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:00.089802 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:00.089802 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:00.089802 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:00.089802 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:00.089802 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:00.089802 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:00.089802 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:00.089802 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:00.090769 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:00.090769 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:00.090769 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:00.090769 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:00.090769 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:00.090769 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:00.090769 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:00.090769 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:00.090769 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 15:06:00.090769 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:00.090769 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 292/582] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:05:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:00.091367 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a0705-b144-4024-a63d-23785177505b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:00.105101 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad200d99-0d51-4489-b97c-20039a3a4985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:00.106154 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad200d99-0d51-4489-b97c-20039a3a4985 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:00.106279 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad200d99-0d51-4489-b97c-20039a3a4985 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:00.106460 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad200d99-0d51-4489-b97c-20039a3a4985 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:00.118227 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad200d99-0d51-4489-b97c-20039a3a4985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:00.119034 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad200d99-0d51-4489-b97c-20039a3a4985 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:00.136853 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-ad200d99-0d51-4489-b97c-20039a3a4985 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:00.136853 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:00.136853 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:00.136853 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:00.136853 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:00.136853 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:00.136853 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:00.136853 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:00.136853 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:00.136853 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:00.136853 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:00.136853 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:00.136853 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:00.136853 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:00.136853 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:00.137861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:00.137861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:00.137861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:00.137861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:00.137861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:00.137861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:00.137861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:00.137861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:00.137861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:00.137861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:00.137861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:00.137861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:00.137861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:00.137861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:00.137861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:00.137861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:00.137861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:00.138790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:00.138790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:00.138790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:00.138790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:00.138790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 291/583] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:00.139583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad200d99-0d51-4489-b97c-20039a3a4985 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:00.204516 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a0705-b144-4024-a63d-23785177505b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:00.241643 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1d440-06c1-4090-b228-c776f0593ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:00.242272 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1d440-06c1-4090-b228-c776f0593ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:00.242620 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1d440-06c1-4090-b228-c776f0593ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:00.243280 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1d440-06c1-4090-b228-c776f0593ce2 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:00.243767 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1d440-06c1-4090-b228-c776f0593ce2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:00.244076 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1d440-06c1-4090-b228-c776f0593ce2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:00.245521 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1d440-06c1-4090-b228-c776f0593ce2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:00.248489 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad200d99-0d51-4489-b97c-20039a3a4985 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:00.257090 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 293/584] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:00.258748 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1d440-06c1-4090-b228-c776f0593ce2 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:00.286069 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c7723-1695-4977-bb19-6cc659de2104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:00.287118 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c7723-1695-4977-bb19-6cc659de2104 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:00.287647 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c7723-1695-4977-bb19-6cc659de2104 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:00.288110 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c7723-1695-4977-bb19-6cc659de2104 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:00.289142 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c7723-1695-4977-bb19-6cc659de2104 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:00.289654 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c7723-1695-4977-bb19-6cc659de2104 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:00.291694 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c7723-1695-4977-bb19-6cc659de2104 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:00.310315 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 292/585] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 9 15:06:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:00.311510 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c7723-1695-4977-bb19-6cc659de2104 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:00.366727 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1d440-06c1-4090-b228-c776f0593ce2 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:00.404413 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d8561-8a0e-4d91-bfb0-4306076d32d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:00.404413 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d8561-8a0e-4d91-bfb0-4306076d32d1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:00.404413 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d8561-8a0e-4d91-bfb0-4306076d32d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:00.404413 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d8561-8a0e-4d91-bfb0-4306076d32d1 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:00.404841 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d8561-8a0e-4d91-bfb0-4306076d32d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:00.404841 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d8561-8a0e-4d91-bfb0-4306076d32d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:00.406165 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d8561-8a0e-4d91-bfb0-4306076d32d1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:00.421489 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c7723-1695-4977-bb19-6cc659de2104 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:00.427407 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 294/586] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 9 15:06:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:00.428159 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d8561-8a0e-4d91-bfb0-4306076d32d1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:00.459616 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbc721-2fe8-414a-9eb9-c13cf857958a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:00.460308 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbc721-2fe8-414a-9eb9-c13cf857958a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:00.460588 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbc721-2fe8-414a-9eb9-c13cf857958a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:00.460863 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbc721-2fe8-414a-9eb9-c13cf857958a None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:00.461650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbc721-2fe8-414a-9eb9-c13cf857958a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:00.461962 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbc721-2fe8-414a-9eb9-c13cf857958a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:00.463388 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbc721-2fe8-414a-9eb9-c13cf857958a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:00.476302 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 293/587] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:00.478121 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbc721-2fe8-414a-9eb9-c13cf857958a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:00.542397 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d8561-8a0e-4d91-bfb0-4306076d32d1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:00.576855 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fea13-1556-43c5-960d-aa2778af2ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:00.577689 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fea13-1556-43c5-960d-aa2778af2ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:00.577968 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fea13-1556-43c5-960d-aa2778af2ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:00.578248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fea13-1556-43c5-960d-aa2778af2ee1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:00.583767 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbc721-2fe8-414a-9eb9-c13cf857958a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:00.585951 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fea13-1556-43c5-960d-aa2778af2ee1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:00.588483 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fea13-1556-43c5-960d-aa2778af2ee1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:00.606111 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-352fea13-1556-43c5-960d-aa2778af2ee1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:00.606111 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:00.606111 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:00.606111 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:00.606111 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:00.606111 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:00.606111 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:00.606111 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:00.606111 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:00.606111 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:00.606111 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:00.606111 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:00.606111 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:00.606111 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:00.606111 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:00.607254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:00.607254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:00.607254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:00.607254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:00.607254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:00.607254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:00.607254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:00.607254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:00.607254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:00.607254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:00.607254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:00.607254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:00.607254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:00.607254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:00.607254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:00.607254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:00.607254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:00.608390 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:00.608390 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:00.608390 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:00.608390 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:00.608390 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:00.608390 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:00.608390 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:00.608390 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:00.609958 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 295/588] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:00.610933 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fea13-1556-43c5-960d-aa2778af2ee1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:00.622910 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58d15d-4078-4793-ac99-af11d36bc5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:00.623861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58d15d-4078-4793-ac99-af11d36bc5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:00.624258 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58d15d-4078-4793-ac99-af11d36bc5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:00.624640 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58d15d-4078-4793-ac99-af11d36bc5e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:00.638483 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58d15d-4078-4793-ac99-af11d36bc5e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:00.640080 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58d15d-4078-4793-ac99-af11d36bc5e5 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:00.658650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-2e58d15d-4078-4793-ac99-af11d36bc5e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:00.658650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:00.658650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:00.658650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:00.658650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:00.658650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:00.658650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:00.658650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:00.658650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:00.658650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:00.658650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:00.658650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:00.658650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:00.658650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:00.658650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:00.659588 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:00.659588 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:00.659588 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:00.659588 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:00.659588 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:00.659588 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:00.659588 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:00.659588 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:00.659588 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:00.659588 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:00.659588 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:00.659588 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:00.659588 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:00.659588 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:00.659588 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:00.659588 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:00.659588 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:00.666736 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:00.666736 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:00.666736 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:00.666736 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:00.666736 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 294/589] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:00.666736 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58d15d-4078-4793-ac99-af11d36bc5e5 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:00.715948 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fea13-1556-43c5-960d-aa2778af2ee1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:00.748747 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d285a-85ee-4de3-ad3f-fe3d18249baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:00.749574 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d285a-85ee-4de3-ad3f-fe3d18249baf None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:00.749860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d285a-85ee-4de3-ad3f-fe3d18249baf None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:00.750131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d285a-85ee-4de3-ad3f-fe3d18249baf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:00.758966 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58d15d-4078-4793-ac99-af11d36bc5e5 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:00.761312 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d285a-85ee-4de3-ad3f-fe3d18249baf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:00.763055 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d285a-85ee-4de3-ad3f-fe3d18249baf None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:00.786775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-4c8d285a-85ee-4de3-ad3f-fe3d18249baf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:00.786775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:00.786775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:00.786775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:00.786775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:00.786775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:00.786775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:00.786775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:00.786775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:00.786775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:00.786775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:00.786775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:00.786775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:00.786775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:00.786775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:00.787861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:00.787861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:00.787861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:00.787861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:00.787861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:00.787861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:00.787861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:00.787861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:00.787861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:00.787861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:00.787861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:00.787861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:00.787861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:00.787861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:00.787861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:00.787861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:00.787861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:00.788734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:00.788734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:00.788734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:00.788734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:00.790638 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 296/590] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:00.792693 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d285a-85ee-4de3-ad3f-fe3d18249baf None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:00.794944 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59bc1b-831b-450c-b75b-c349a414f0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:00.795783 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59bc1b-831b-450c-b75b-c349a414f0b1 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:00.796068 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59bc1b-831b-450c-b75b-c349a414f0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:00.796341 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59bc1b-831b-450c-b75b-c349a414f0b1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:00.804490 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59bc1b-831b-450c-b75b-c349a414f0b1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:00.806029 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59bc1b-831b-450c-b75b-c349a414f0b1 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:00.820207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-0f59bc1b-831b-450c-b75b-c349a414f0b1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:06:00.820207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:00.820207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:00.820207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:00.820207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:00.820207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:00.820207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:00.820207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:00.820207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:00.820207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:00.820207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:00.820207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:00.820207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:00.820207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:00.820207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:00.820207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:00.821197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:00.821197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:00.821197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:00.821197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:00.821197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:00.821197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:00.821197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:00.821197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:00.821197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:00.821197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:00.821197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:00.821197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:00.821197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:00.821197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:00.821197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:00.821197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:00.821197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:00.821197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:00.822338 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:00.822338 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:00.822338 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:00.822338 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:00.822338 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:00.822338 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:00.822338 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:00.822338 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:00.822338 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:06:00.822338 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:00.822338 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 295/591] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:06:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:00.822930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59bc1b-831b-450c-b75b-c349a414f0b1 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:00.908139 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d285a-85ee-4de3-ad3f-fe3d18249baf None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:00.929097 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59bc1b-831b-450c-b75b-c349a414f0b1 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:00.940073 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125e2fe-5272-4230-a2af-8e3fb6fe6385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:00.940836 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125e2fe-5272-4230-a2af-8e3fb6fe6385 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:00.941125 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125e2fe-5272-4230-a2af-8e3fb6fe6385 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:00.941427 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125e2fe-5272-4230-a2af-8e3fb6fe6385 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:00.942220 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125e2fe-5272-4230-a2af-8e3fb6fe6385 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:00.942527 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125e2fe-5272-4230-a2af-8e3fb6fe6385 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:00.943952 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125e2fe-5272-4230-a2af-8e3fb6fe6385 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:00.956463 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 297/592] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:06:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:00.957868 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b8e00-793a-4916-b965-c375923be53e None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:00.958162 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b8e00-793a-4916-b965-c375923be53e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:00.958447 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b8e00-793a-4916-b965-c375923be53e None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:00.964956 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 298/593] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:00.964956 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b8e00-793a-4916-b965-c375923be53e None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:00.968703 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774df295-a6ad-48fe-9a41-8ae49198774e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:00.969540 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774df295-a6ad-48fe-9a41-8ae49198774e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:00.969876 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774df295-a6ad-48fe-9a41-8ae49198774e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:00.970206 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774df295-a6ad-48fe-9a41-8ae49198774e None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:00.971061 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774df295-a6ad-48fe-9a41-8ae49198774e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:00.971423 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774df295-a6ad-48fe-9a41-8ae49198774e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:00.973013 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774df295-a6ad-48fe-9a41-8ae49198774e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:00.987086 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 296/594] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:00.987903 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774df295-a6ad-48fe-9a41-8ae49198774e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:01.064272 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b8e00-793a-4916-b965-c375923be53e None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:01.084822 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774df295-a6ad-48fe-9a41-8ae49198774e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:01.097168 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163eaf9c-fac8-43a0-b030-f05d2c927768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:01.097851 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163eaf9c-fac8-43a0-b030-f05d2c927768 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:01.098135 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163eaf9c-fac8-43a0-b030-f05d2c927768 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:01.098404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163eaf9c-fac8-43a0-b030-f05d2c927768 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:01.099117 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163eaf9c-fac8-43a0-b030-f05d2c927768 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:01.099418 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163eaf9c-fac8-43a0-b030-f05d2c927768 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:01.100784 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163eaf9c-fac8-43a0-b030-f05d2c927768 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:01.112471 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 299/595] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:01.113263 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163eaf9c-fac8-43a0-b030-f05d2c927768 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:01.120445 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9be722-f511-4161-a301-2240e461aa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:01.121199 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9be722-f511-4161-a301-2240e461aa1c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:01.121522 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9be722-f511-4161-a301-2240e461aa1c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:01.121799 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9be722-f511-4161-a301-2240e461aa1c None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:01.122635 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9be722-f511-4161-a301-2240e461aa1c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:01.122944 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9be722-f511-4161-a301-2240e461aa1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:01.124357 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9be722-f511-4161-a301-2240e461aa1c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:01.141661 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 297/596] 10.222.0.48 () {56 vars in 1139 bytes} [Mon May 9 15:06:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:01.143007 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7da27-888f-4370-920a-2b5489293a03 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:01.143302 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7da27-888f-4370-920a-2b5489293a03 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:01.143582 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7da27-888f-4370-920a-2b5489293a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:01.161519 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-dfc7da27-888f-4370-920a-2b5489293a03 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:01.162885 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-dfc7da27-888f-4370-920a-2b5489293a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:01.216330 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163eaf9c-fac8-43a0-b030-f05d2c927768 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:01.236391 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 298/597] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:06:01.237241 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7da27-888f-4370-920a-2b5489293a03 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:01.252851 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941a440-6ea3-4ea4-9524-554e9d5cf523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:01.253778 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941a440-6ea3-4ea4-9524-554e9d5cf523 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:01.254065 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941a440-6ea3-4ea4-9524-554e9d5cf523 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:01.254339 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941a440-6ea3-4ea4-9524-554e9d5cf523 None admin] PATH_INFO: `/v3/projects/4fcadeae44cc4547905b83bfebec79c7/users/65e7a4e661ef4425b24844c3500b0b58/roles/d8aa93d29788400a97d04db10d8fb8d5` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:01.269255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941a440-6ea3-4ea4-9524-554e9d5cf523 None admin] RBAC: Authorizing `identity:create_grant(project_id=4fcadeae44cc4547905b83bfebec79c7, user_id=65e7a4e661ef4425b24844c3500b0b58, role_id=d8aa93d29788400a97d04db10d8fb8d5)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:01.270646 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941a440-6ea3-4ea4-9524-554e9d5cf523 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:01.284072 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 300/598] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:06:01 2022] PUT /identity/v3/projects/4fcadeae44cc4547905b83bfebec79c7/users/65e7a4e661ef4425b24844c3500b0b58/roles/d8aa93d29788400a97d04db10d8fb8d5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:06:01.284888 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941a440-6ea3-4ea4-9524-554e9d5cf523 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:01.344457 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7da27-888f-4370-920a-2b5489293a03 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:01.388368 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade4d87-5d32-4b1a-a804-55a2e40e3f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:01.389276 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade4d87-5d32-4b1a-a804-55a2e40e3f60 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:01.389639 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade4d87-5d32-4b1a-a804-55a2e40e3f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:01.389968 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade4d87-5d32-4b1a-a804-55a2e40e3f60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:01.397711 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941a440-6ea3-4ea4-9524-554e9d5cf523 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:01.399502 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade4d87-5d32-4b1a-a804-55a2e40e3f60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:01.401563 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade4d87-5d32-4b1a-a804-55a2e40e3f60 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:01.422088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-fade4d87-5d32-4b1a-a804-55a2e40e3f60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:01.422088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:01.422088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:01.422088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:01.422088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:01.422088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:01.422088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:01.422088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:01.422088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:01.422088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:01.422088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:01.422088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:01.422088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:01.422088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:01.422088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:01.423056 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:01.423056 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:01.423056 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:01.423056 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:01.423056 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:01.423056 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:01.423056 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:01.423056 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:01.423056 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:01.423056 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:01.423056 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:01.423056 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:01.423056 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:01.423056 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:01.423056 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:01.423056 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:01.423056 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:01.423987 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:01.423987 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:01.423987 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:01.423987 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:01.423987 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:01.423987 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:01.423987 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:01.423987 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:01.423987 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 299/599] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:01.423987 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade4d87-5d32-4b1a-a804-55a2e40e3f60 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:01.441389 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bd460-c596-4703-aa41-fdfdb5920758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:01.442308 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bd460-c596-4703-aa41-fdfdb5920758 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:01.442591 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bd460-c596-4703-aa41-fdfdb5920758 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:01.442860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bd460-c596-4703-aa41-fdfdb5920758 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:01.451259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36bd460-c596-4703-aa41-fdfdb5920758 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:01.452734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36bd460-c596-4703-aa41-fdfdb5920758 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:01.467642 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-e36bd460-c596-4703-aa41-fdfdb5920758 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:01.467642 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:01.467642 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:01.467642 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:01.467642 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:01.467642 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:01.467642 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:01.467642 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:01.467642 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:01.467642 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:01.467642 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:01.467642 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:01.467642 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:01.467642 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:01.467642 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:01.468575 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:01.468575 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:01.468575 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:01.468575 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:01.468575 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:01.468575 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:01.468575 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:01.468575 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:01.468575 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:01.468575 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:01.468575 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:01.468575 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:01.468575 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:01.468575 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:01.468575 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:01.468575 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:01.468575 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:01.469607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:01.469607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:01.469607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:01.469607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:01.469607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:01.469607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:01.469607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:01.469607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:01.473857 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 301/600] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:01.474824 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bd460-c596-4703-aa41-fdfdb5920758 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:01.541399 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade4d87-5d32-4b1a-a804-55a2e40e3f60 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:01.576292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d7aad-9577-46a8-ad94-50a39b93c08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:01.577339 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d7aad-9577-46a8-ad94-50a39b93c08a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:01.577645 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d7aad-9577-46a8-ad94-50a39b93c08a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:01.577924 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d7aad-9577-46a8-ad94-50a39b93c08a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:01.578187 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bd460-c596-4703-aa41-fdfdb5920758 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:01.588913 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d7aad-9577-46a8-ad94-50a39b93c08a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:01.590394 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d7aad-9577-46a8-ad94-50a39b93c08a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:01.607907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-371d7aad-9577-46a8-ad94-50a39b93c08a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:01.607907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:01.607907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:01.607907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:01.607907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:01.607907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:01.607907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:01.607907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:01.607907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:01.607907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:01.607907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:01.607907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:01.607907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:01.607907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:01.607907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:01.617224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:01.617224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:01.617224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:01.617224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:01.617224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:01.617224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:01.617224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:01.617224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:01.617224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:01.617224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:01.617224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:01.617224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:01.617224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:01.617224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:01.617224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:01.617224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:01.617224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:01.621175 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:01.621175 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:01.621175 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:01.621175 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:01.621175 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 300/601] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:01.621175 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d7aad-9577-46a8-ad94-50a39b93c08a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:01.622471 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cd820-64ff-497c-93c2-d58631c8b934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:01.622471 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cd820-64ff-497c-93c2-d58631c8b934 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:01.622471 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cd820-64ff-497c-93c2-d58631c8b934 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:01.622471 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cd820-64ff-497c-93c2-d58631c8b934 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:01.636904 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832cd820-64ff-497c-93c2-d58631c8b934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:06:01.653154 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-832cd820-64ff-497c-93c2-d58631c8b934 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:06:01.653154 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:01.653154 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:01.653154 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:01.653154 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:01.653154 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:01.653154 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:01.653154 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:01.653154 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:01.653154 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:01.653154 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:01.653154 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:01.653154 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:06:01.653154 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:06:01.653154 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:06:01.653154 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:06:01.655041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:06:01.655041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:06:01.655041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:06:01.655041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:06:01.655041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:01.655041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:01.655041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:01.655041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:01.655041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:01.655041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:01.655041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:01.655041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:01.655041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:01.655041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:01.655041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:01.655041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:01.657445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:01.657445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:01.657445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:01.657445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:01.657445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:06:01.657445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:06:01.657445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:06:01.657445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:06:01.657445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:06:01.657445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:06:01.657445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:06:01.657445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:01.657445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 302/602] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:06:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:01.657445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cd820-64ff-497c-93c2-d58631c8b934 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:01.726657 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d7aad-9577-46a8-ad94-50a39b93c08a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:01.763334 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2355608-9798-4964-9faa-b2c89c87bade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:01.764001 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2355608-9798-4964-9faa-b2c89c87bade None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:01.764288 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2355608-9798-4964-9faa-b2c89c87bade None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:01.764568 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2355608-9798-4964-9faa-b2c89c87bade None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:01.765363 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2355608-9798-4964-9faa-b2c89c87bade None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:01.765711 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2355608-9798-4964-9faa-b2c89c87bade None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:01.766100 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cd820-64ff-497c-93c2-d58631c8b934 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:01.767155 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2355608-9798-4964-9faa-b2c89c87bade None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:01.781599 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 301/603] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:06:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:01.782682 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2355608-9798-4964-9faa-b2c89c87bade None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:01.804335 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fe6f9-c5da-4929-80fa-b3c627dbc72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:01.806133 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fe6f9-c5da-4929-80fa-b3c627dbc72d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:01.806592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fe6f9-c5da-4929-80fa-b3c627dbc72d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:01.806882 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fe6f9-c5da-4929-80fa-b3c627dbc72d None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:01.807694 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fe6f9-c5da-4929-80fa-b3c627dbc72d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:01.808010 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fe6f9-c5da-4929-80fa-b3c627dbc72d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:01.809505 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fe6f9-c5da-4929-80fa-b3c627dbc72d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:01.823084 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 303/604] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:06:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:01.823953 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fe6f9-c5da-4929-80fa-b3c627dbc72d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:01.895660 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2355608-9798-4964-9faa-b2c89c87bade None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:01.926161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fe6f9-c5da-4929-80fa-b3c627dbc72d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:01.932591 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbe49a-d77b-48cd-8282-9e48bea024ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:01.933258 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbe49a-d77b-48cd-8282-9e48bea024ff None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:01.933565 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbe49a-d77b-48cd-8282-9e48bea024ff None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:01.933843 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbe49a-d77b-48cd-8282-9e48bea024ff None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:01.934560 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfbe49a-d77b-48cd-8282-9e48bea024ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:01.934865 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfbe49a-d77b-48cd-8282-9e48bea024ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:01.936216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfbe49a-d77b-48cd-8282-9e48bea024ff None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:01.952865 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 302/605] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:01.952865 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbe49a-d77b-48cd-8282-9e48bea024ff None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:01.964117 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29329c9-0758-4ac2-a30c-381927199214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:01.964789 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29329c9-0758-4ac2-a30c-381927199214 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:01.965067 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29329c9-0758-4ac2-a30c-381927199214 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:01.965340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29329c9-0758-4ac2-a30c-381927199214 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:01.966120 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29329c9-0758-4ac2-a30c-381927199214 None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:01.966424 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29329c9-0758-4ac2-a30c-381927199214 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:01.967812 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29329c9-0758-4ac2-a30c-381927199214 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:01.976127 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 304/606] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:06:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:01.977314 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29329c9-0758-4ac2-a30c-381927199214 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:02.064307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbe49a-d77b-48cd-8282-9e48bea024ff None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:02.095225 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29329c9-0758-4ac2-a30c-381927199214 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:02.098976 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785534f0-45b7-4f38-b961-334d6325d8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:02.100115 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785534f0-45b7-4f38-b961-334d6325d8ba None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:02.100601 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785534f0-45b7-4f38-b961-334d6325d8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:02.101159 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785534f0-45b7-4f38-b961-334d6325d8ba None admin] PATH_INFO: `/v3/projects/4fcadeae44cc4547905b83bfebec79c7/users/221e55f84f66471794e82fec1b18c87c/roles/d8aa93d29788400a97d04db10d8fb8d5` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:02.117734 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785534f0-45b7-4f38-b961-334d6325d8ba None admin] RBAC: Authorizing `identity:create_grant(project_id=4fcadeae44cc4547905b83bfebec79c7, user_id=221e55f84f66471794e82fec1b18c87c, role_id=d8aa93d29788400a97d04db10d8fb8d5)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:02.119680 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785534f0-45b7-4f38-b961-334d6325d8ba None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:02.132038 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de5472-70c4-462f-ac96-c6a35b0149dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:02.132934 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de5472-70c4-462f-ac96-c6a35b0149dc None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:02.133245 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de5472-70c4-462f-ac96-c6a35b0149dc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:02.133557 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de5472-70c4-462f-ac96-c6a35b0149dc None admin] PATH_INFO: `/v3/projects/4fcadeae44cc4547905b83bfebec79c7/users/6dcdf3e1a44d4475882c1af71e933312/roles/d8aa93d29788400a97d04db10d8fb8d5` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:02.134138 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 303/607] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:06:01 2022] PUT /identity/v3/projects/4fcadeae44cc4547905b83bfebec79c7/users/221e55f84f66471794e82fec1b18c87c/roles/d8aa93d29788400a97d04db10d8fb8d5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:06:02.135307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785534f0-45b7-4f38-b961-334d6325d8ba None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:02.160136 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de5472-70c4-462f-ac96-c6a35b0149dc None admin] RBAC: Authorizing `identity:create_grant(project_id=4fcadeae44cc4547905b83bfebec79c7, user_id=6dcdf3e1a44d4475882c1af71e933312, role_id=d8aa93d29788400a97d04db10d8fb8d5)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:02.162114 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de5472-70c4-462f-ac96-c6a35b0149dc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:02.189830 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 305/608] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:06:01 2022] PUT /identity/v3/projects/4fcadeae44cc4547905b83bfebec79c7/users/6dcdf3e1a44d4475882c1af71e933312/roles/d8aa93d29788400a97d04db10d8fb8d5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:06:02.191168 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de5472-70c4-462f-ac96-c6a35b0149dc None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:02.373843 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785534f0-45b7-4f38-b961-334d6325d8ba None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:02.385890 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de5472-70c4-462f-ac96-c6a35b0149dc None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:02.434094 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa06e9-16b2-4a47-b071-40f1d4825f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:02.435037 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa06e9-16b2-4a47-b071-40f1d4825f57 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:02.435324 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa06e9-16b2-4a47-b071-40f1d4825f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:02.435601 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa06e9-16b2-4a47-b071-40f1d4825f57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:02.442845 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52f790-6ef6-46f6-862d-aa079923b797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:02.443967 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52f790-6ef6-46f6-862d-aa079923b797 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:02.444077 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa06e9-16b2-4a47-b071-40f1d4825f57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:02.444552 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52f790-6ef6-46f6-862d-aa079923b797 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:02.445049 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52f790-6ef6-46f6-862d-aa079923b797 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:02.446065 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa06e9-16b2-4a47-b071-40f1d4825f57 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:02.458434 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52f790-6ef6-46f6-862d-aa079923b797 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:02.460229 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52f790-6ef6-46f6-862d-aa079923b797 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:02.463566 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-43fa06e9-16b2-4a47-b071-40f1d4825f57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:02.463566 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:02.463566 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:02.463566 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:02.463566 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:02.463566 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:02.463566 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:02.463566 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:02.463566 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:02.463566 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:02.463566 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:02.463566 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:02.463566 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:02.463566 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:02.463566 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:02.464480 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:02.464480 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:02.464480 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:02.464480 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:02.464480 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:02.464480 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:02.464480 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:02.464480 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:02.464480 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:02.464480 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:02.464480 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:02.464480 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:02.464480 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:02.464480 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:02.464480 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:02.464480 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:02.464480 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:02.465460 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:02.465460 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:02.465460 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:02.465460 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:02.465460 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:02.465460 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:02.465460 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:02.465460 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:02.465460 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 304/609] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:02.474565 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa06e9-16b2-4a47-b071-40f1d4825f57 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:02.489194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-1c52f790-6ef6-46f6-862d-aa079923b797 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:02.489194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:02.489194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:02.489194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:02.489194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:02.489194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:02.489194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:02.489194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:02.489194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:02.489194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:02.489194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:02.489194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:02.489194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:02.489194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:02.489194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:02.490175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:02.490175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:02.490175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:02.490175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:02.490175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:02.490175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:02.490175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:02.490175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:02.490175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:02.490175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:02.490175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:02.490175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:02.490175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:02.490175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:02.490175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:02.490175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:02.490175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:02.491103 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:02.491103 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:02.491103 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:02.491103 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:02.498119 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 306/610] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:02.505408 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52f790-6ef6-46f6-862d-aa079923b797 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:02.628896 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa06e9-16b2-4a47-b071-40f1d4825f57 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:02.657148 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52f790-6ef6-46f6-862d-aa079923b797 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:02.666597 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c79b6c-5a2c-4e2d-99c3-20b1cf206988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:02.667596 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c79b6c-5a2c-4e2d-99c3-20b1cf206988 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:02.668088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c79b6c-5a2c-4e2d-99c3-20b1cf206988 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:02.668592 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c79b6c-5a2c-4e2d-99c3-20b1cf206988 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:02.669625 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c79b6c-5a2c-4e2d-99c3-20b1cf206988 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:02.670163 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c79b6c-5a2c-4e2d-99c3-20b1cf206988 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:02.671821 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c79b6c-5a2c-4e2d-99c3-20b1cf206988 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:02.685721 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 305/611] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:06:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:02.700846 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c79b6c-5a2c-4e2d-99c3-20b1cf206988 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:02.703271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48645744-5bfa-453a-8157-3b78bbf5e4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:02.703946 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48645744-5bfa-453a-8157-3b78bbf5e4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:02.704229 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48645744-5bfa-453a-8157-3b78bbf5e4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:02.704657 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48645744-5bfa-453a-8157-3b78bbf5e4f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:02.705246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48645744-5bfa-453a-8157-3b78bbf5e4f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:02.705593 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48645744-5bfa-453a-8157-3b78bbf5e4f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:02.707060 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48645744-5bfa-453a-8157-3b78bbf5e4f7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:02.724422 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 307/612] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:02.725754 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48645744-5bfa-453a-8157-3b78bbf5e4f7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:02.811113 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c79b6c-5a2c-4e2d-99c3-20b1cf206988 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:02.848743 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f637ba9-8522-49ef-ac6a-67c1ee66391c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:02.850081 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f637ba9-8522-49ef-ac6a-67c1ee66391c None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:02.850574 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f637ba9-8522-49ef-ac6a-67c1ee66391c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:02.851129 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f637ba9-8522-49ef-ac6a-67c1ee66391c None admin] PATH_INFO: `/v3/projects/4fcadeae44cc4547905b83bfebec79c7/users/4cd76a442c2f4c759e7438031d5d6aca/roles/d8aa93d29788400a97d04db10d8fb8d5` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:02.860974 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48645744-5bfa-453a-8157-3b78bbf5e4f7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:02.869418 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f637ba9-8522-49ef-ac6a-67c1ee66391c None admin] RBAC: Authorizing `identity:create_grant(project_id=4fcadeae44cc4547905b83bfebec79c7, user_id=4cd76a442c2f4c759e7438031d5d6aca, role_id=d8aa93d29788400a97d04db10d8fb8d5)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:02.871161 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f637ba9-8522-49ef-ac6a-67c1ee66391c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:02.885920 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 306/613] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:06:02 2022] PUT /identity/v3/projects/4fcadeae44cc4547905b83bfebec79c7/users/4cd76a442c2f4c759e7438031d5d6aca/roles/d8aa93d29788400a97d04db10d8fb8d5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:06:02.916168 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fac978-6659-44b8-b9f9-f7ae9758e670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:02.916991 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fac978-6659-44b8-b9f9-f7ae9758e670 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:02.917322 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fac978-6659-44b8-b9f9-f7ae9758e670 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:02.917622 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fac978-6659-44b8-b9f9-f7ae9758e670 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:02.928549 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fac978-6659-44b8-b9f9-f7ae9758e670 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:02.930823 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fac978-6659-44b8-b9f9-f7ae9758e670 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:02.954297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-c4fac978-6659-44b8-b9f9-f7ae9758e670 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:06:02.954297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:02.954297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:02.954297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:02.954297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:02.954297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:02.954297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:02.954297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:02.954297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:02.954297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:02.954297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:02.954297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:02.954297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:02.954297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:02.954297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:02.954297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:02.955397 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:02.955397 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:02.955397 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:02.955397 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:02.955397 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:02.955397 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:02.955397 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:02.955397 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:02.955397 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:02.955397 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:02.955397 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:02.955397 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:02.955397 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:02.955397 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:02.955397 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:02.955397 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:02.955397 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:02.955397 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:02.956348 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:02.956348 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:02.956348 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:02.956348 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:02.956348 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:02.956348 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:02.956348 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:02.956348 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:02.956348 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:06:02.956348 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:02.956886 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 308/614] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:06:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:02.961822 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f637ba9-8522-49ef-ac6a-67c1ee66391c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:03.086988 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f637ba9-8522-49ef-ac6a-67c1ee66391c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:03.126506 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8ecd1-509c-4738-9e6d-54a123016b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:03.127561 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8ecd1-509c-4738-9e6d-54a123016b48 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:03.128053 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8ecd1-509c-4738-9e6d-54a123016b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:03.128553 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8ecd1-509c-4738-9e6d-54a123016b48 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:03.129659 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8ecd1-509c-4738-9e6d-54a123016b48 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:03.130190 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8ecd1-509c-4738-9e6d-54a123016b48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:03.131894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8ecd1-509c-4738-9e6d-54a123016b48 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:03.153878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 307/615] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 9 15:06:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:03.158958 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fac978-6659-44b8-b9f9-f7ae9758e670 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:03.266316 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fac978-6659-44b8-b9f9-f7ae9758e670 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:03.302539 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58692518-4d50-486c-9562-f73bf2c6537e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:03.303720 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58692518-4d50-486c-9562-f73bf2c6537e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:03.304240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58692518-4d50-486c-9562-f73bf2c6537e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:03.304717 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58692518-4d50-486c-9562-f73bf2c6537e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:03.317026 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58692518-4d50-486c-9562-f73bf2c6537e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:03.318887 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58692518-4d50-486c-9562-f73bf2c6537e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:03.337576 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-58692518-4d50-486c-9562-f73bf2c6537e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:03.337576 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:03.337576 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:03.337576 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:03.337576 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:03.337576 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:03.337576 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:03.337576 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:03.337576 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:03.337576 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:03.337576 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:03.337576 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:03.337576 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:03.337576 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:03.337576 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:03.338562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:03.338562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:03.338562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:03.338562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:03.338562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:03.338562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:03.338562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:03.338562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:03.338562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:03.338562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:03.338562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:03.338562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:03.338562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:03.338562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:03.338562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:03.338562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:03.338562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:03.339462 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:03.339462 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:03.339462 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:03.339462 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:03.341841 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 309/616] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:03.350667 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8ecd1-509c-4738-9e6d-54a123016b48 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:03.500281 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8ecd1-509c-4738-9e6d-54a123016b48 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:03.541608 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f3c16-ff2e-4d79-9a8e-cf8743c9026b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:03.542302 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f3c16-ff2e-4d79-9a8e-cf8743c9026b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:03.542586 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f3c16-ff2e-4d79-9a8e-cf8743c9026b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:03.542862 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f3c16-ff2e-4d79-9a8e-cf8743c9026b None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:03.543603 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f3c16-ff2e-4d79-9a8e-cf8743c9026b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:03.543912 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f3c16-ff2e-4d79-9a8e-cf8743c9026b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:03.545274 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f3c16-ff2e-4d79-9a8e-cf8743c9026b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:03.563823 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 308/617] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:03.569608 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58692518-4d50-486c-9562-f73bf2c6537e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:03.691270 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58692518-4d50-486c-9562-f73bf2c6537e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:03.731077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c746af-5159-457d-b8f3-87d081b1a52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:03.731879 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c746af-5159-457d-b8f3-87d081b1a52f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:03.732164 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c746af-5159-457d-b8f3-87d081b1a52f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:03.732442 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c746af-5159-457d-b8f3-87d081b1a52f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:03.739733 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c746af-5159-457d-b8f3-87d081b1a52f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:03.741177 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c746af-5159-457d-b8f3-87d081b1a52f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:03.760610 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-68c746af-5159-457d-b8f3-87d081b1a52f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:03.760610 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:03.760610 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:03.760610 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:03.760610 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:03.760610 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:03.760610 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:03.760610 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:03.760610 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:03.760610 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:03.760610 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:03.760610 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:03.760610 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:03.760610 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:03.760610 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:03.761614 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:03.761614 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:03.761614 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:03.761614 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:03.761614 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:03.761614 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:03.761614 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:03.761614 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:03.761614 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:03.761614 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:03.761614 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:03.761614 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:03.761614 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:03.761614 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:03.761614 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:03.761614 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:03.761614 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:03.762524 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:03.762524 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:03.762524 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:03.762524 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:03.762524 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:03.762524 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:03.762524 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:03.762524 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:03.766602 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 310/618] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:03.772408 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f3c16-ff2e-4d79-9a8e-cf8743c9026b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:03.971792 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f3c16-ff2e-4d79-9a8e-cf8743c9026b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:04.046121 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c78280-4274-4ea9-914f-bce666e97387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:04.047174 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c78280-4274-4ea9-914f-bce666e97387 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:04.047691 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c78280-4274-4ea9-914f-bce666e97387 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:04.048168 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c78280-4274-4ea9-914f-bce666e97387 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:04.049183 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c78280-4274-4ea9-914f-bce666e97387 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:04.049727 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c78280-4274-4ea9-914f-bce666e97387 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:04.051362 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c78280-4274-4ea9-914f-bce666e97387 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:04.070496 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 309/619] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:06:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:04.078440 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c746af-5159-457d-b8f3-87d081b1a52f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:04.213131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c746af-5159-457d-b8f3-87d081b1a52f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:04.229990 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774f5af-71f0-49c5-93a5-8d92db1f91d0 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:04.230584 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774f5af-71f0-49c5-93a5-8d92db1f91d0 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:04.231088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774f5af-71f0-49c5-93a5-8d92db1f91d0 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:04.232901 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 310/620] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:04.238528 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6d413-e2b7-4e00-b087-10d33b7d471b None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:04.239059 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6d413-e2b7-4e00-b087-10d33b7d471b None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:04.239544 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6d413-e2b7-4e00-b087-10d33b7d471b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:04.264465 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-1dd6d413-e2b7-4e00-b087-10d33b7d471b None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:04.266563 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-1dd6d413-e2b7-4e00-b087-10d33b7d471b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:04.272666 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaaf43b-43b4-4c5e-b2d4-5a1b747e0a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:04.274384 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaaf43b-43b4-4c5e-b2d4-5a1b747e0a07 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:04.274885 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaaf43b-43b4-4c5e-b2d4-5a1b747e0a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:04.275474 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaaf43b-43b4-4c5e-b2d4-5a1b747e0a07 None admin] PATH_INFO: `/v3/projects/4fcadeae44cc4547905b83bfebec79c7/users/0b1f03accd91471ea1fe78073c86a97f/roles/d8aa93d29788400a97d04db10d8fb8d5` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:04.303862 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaaf43b-43b4-4c5e-b2d4-5a1b747e0a07 None admin] RBAC: Authorizing `identity:create_grant(project_id=4fcadeae44cc4547905b83bfebec79c7, user_id=0b1f03accd91471ea1fe78073c86a97f, role_id=d8aa93d29788400a97d04db10d8fb8d5)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:04.312962 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaaf43b-43b4-4c5e-b2d4-5a1b747e0a07 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:04.331967 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 311/621] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:06:04 2022] PUT /identity/v3/projects/4fcadeae44cc4547905b83bfebec79c7/users/0b1f03accd91471ea1fe78073c86a97f/roles/d8aa93d29788400a97d04db10d8fb8d5 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:06:04.380928 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 311/622] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:06:04.407096 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaaf43b-43b4-4c5e-b2d4-5a1b747e0a07 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:04.561287 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaaf43b-43b4-4c5e-b2d4-5a1b747e0a07 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:04.597721 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c591b7-38a2-47fe-aeee-52747ca4b0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:04.598565 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c591b7-38a2-47fe-aeee-52747ca4b0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:04.598850 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c591b7-38a2-47fe-aeee-52747ca4b0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:04.599128 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c591b7-38a2-47fe-aeee-52747ca4b0d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:04.611149 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c591b7-38a2-47fe-aeee-52747ca4b0d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:06:04.620099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-83c591b7-38a2-47fe-aeee-52747ca4b0d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:06:04.620099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:04.620099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:04.620099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:04.620099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:04.620099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:04.620099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:04.620099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:04.620099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:04.620099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:04.620099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:04.620099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:04.620099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:06:04.620099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:06:04.620099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:06:04.620099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:06:04.621255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:06:04.621255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:06:04.621255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:06:04.621255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:06:04.621255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:04.621255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:04.621255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:04.621255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:04.621255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:04.621255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:04.621255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:04.621255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:04.621255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:04.621255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:04.621255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:04.621255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:04.622184 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:04.622184 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:04.622184 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:04.622184 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:04.622184 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:06:04.622184 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:06:04.622184 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:06:04.622184 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:06:04.622184 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:06:04.622184 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:06:04.622184 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:06:04.622184 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:04.622184 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 312/623] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:06:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:04.628207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6d413-e2b7-4e00-b087-10d33b7d471b None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:04.738388 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6d413-e2b7-4e00-b087-10d33b7d471b None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:04.774472 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e8423-27ff-4138-b7ac-5182d9bdc120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:04.775100 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e8423-27ff-4138-b7ac-5182d9bdc120 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:04.775100 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e8423-27ff-4138-b7ac-5182d9bdc120 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:04.775521 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e8423-27ff-4138-b7ac-5182d9bdc120 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:04.776136 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e8423-27ff-4138-b7ac-5182d9bdc120 None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:04.776502 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e8423-27ff-4138-b7ac-5182d9bdc120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:04.777893 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e8423-27ff-4138-b7ac-5182d9bdc120 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:04.787215 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 312/624] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:06:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:04.793566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c591b7-38a2-47fe-aeee-52747ca4b0d2 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:04.952434 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c591b7-38a2-47fe-aeee-52747ca4b0d2 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:04.997330 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe45419-06e8-400d-a8cc-62604892226a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:04.998163 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe45419-06e8-400d-a8cc-62604892226a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:04.998444 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe45419-06e8-400d-a8cc-62604892226a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:04.998720 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe45419-06e8-400d-a8cc-62604892226a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:05.017741 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150278e-1153-48a7-ac5a-1e09a513fa13 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:05.018098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150278e-1153-48a7-ac5a-1e09a513fa13 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:05.018316 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150278e-1153-48a7-ac5a-1e09a513fa13 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:05.020553 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 313/625] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:05.022538 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe45419-06e8-400d-a8cc-62604892226a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:05.025263 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe45419-06e8-400d-a8cc-62604892226a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:05.026820 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4056d3-6f9c-4f97-9393-c0f3e36a1c25 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:05.027115 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4056d3-6f9c-4f97-9393-c0f3e36a1c25 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:05.027463 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4056d3-6f9c-4f97-9393-c0f3e36a1c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:05.046589 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-abe45419-06e8-400d-a8cc-62604892226a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:05.046589 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:05.046589 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:05.046589 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:05.046589 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:05.046589 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:05.046589 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:05.046589 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:05.046589 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:05.046589 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:05.046589 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:05.046589 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:05.046589 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:05.046589 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:05.046589 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:05.049003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:05.049003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:05.049003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:05.049003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:05.049003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:05.049003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:05.049003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:05.049003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:05.049003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:05.049003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:05.049003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:05.049003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:05.049003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:05.049003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:05.049003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:05.049003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:05.049003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:05.051335 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:05.051335 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:05.051335 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:05.051335 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:05.051335 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 313/626] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:05.057606 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe45419-06e8-400d-a8cc-62604892226a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:05.064221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-5d4056d3-6f9c-4f97-9393-c0f3e36a1c25 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:05.066260 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5d4056d3-6f9c-4f97-9393-c0f3e36a1c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:05.190758 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 314/627] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:06:05.190758 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e7c05-c8a8-4157-a8e7-20a5fd9437aa None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:05.190758 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e7c05-c8a8-4157-a8e7-20a5fd9437aa None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:05.190758 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e7c05-c8a8-4157-a8e7-20a5fd9437aa None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:05.190758 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 315/628] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:05.215374 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165228d-2d8f-4a78-8d28-47d97de4125c None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:05.215666 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165228d-2d8f-4a78-8d28-47d97de4125c None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:05.215859 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165228d-2d8f-4a78-8d28-47d97de4125c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:05.219714 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe45419-06e8-400d-a8cc-62604892226a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:05.236242 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-3165228d-2d8f-4a78-8d28-47d97de4125c None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:05.237496 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-3165228d-2d8f-4a78-8d28-47d97de4125c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:05.271976 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab373096-dbc5-49e9-95c9-90be4efaef29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:05.273215 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab373096-dbc5-49e9-95c9-90be4efaef29 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:05.274539 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab373096-dbc5-49e9-95c9-90be4efaef29 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:05.275229 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab373096-dbc5-49e9-95c9-90be4efaef29 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:05.276558 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab373096-dbc5-49e9-95c9-90be4efaef29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:05.278129 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab373096-dbc5-49e9-95c9-90be4efaef29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:05.279921 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab373096-dbc5-49e9-95c9-90be4efaef29 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:05.298364 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 314/629] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:05.299751 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab373096-dbc5-49e9-95c9-90be4efaef29 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:05.325521 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 316/630] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:06:05.329638 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165228d-2d8f-4a78-8d28-47d97de4125c None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:05.462328 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab373096-dbc5-49e9-95c9-90be4efaef29 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:05.467847 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165228d-2d8f-4a78-8d28-47d97de4125c None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:05.510893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c213c-39c2-4178-ae94-ecf62529406b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:05.512101 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c213c-39c2-4178-ae94-ecf62529406b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:05.512481 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c213c-39c2-4178-ae94-ecf62529406b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:05.512943 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c213c-39c2-4178-ae94-ecf62529406b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:05.513541 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d190f86-0bff-40f9-a187-708325db309a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:05.514591 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d190f86-0bff-40f9-a187-708325db309a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:05.515337 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d190f86-0bff-40f9-a187-708325db309a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:05.515818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d190f86-0bff-40f9-a187-708325db309a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:05.526149 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d190f86-0bff-40f9-a187-708325db309a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:05.526450 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c213c-39c2-4178-ae94-ecf62529406b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:06:05.528257 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d190f86-0bff-40f9-a187-708325db309a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:05.535700 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-1f7c213c-39c2-4178-ae94-ecf62529406b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:06:05.535700 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:05.535700 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:05.535700 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:05.535700 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:05.535700 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:05.535700 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:05.535700 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:05.535700 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:05.535700 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:05.535700 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:05.535700 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:05.535700 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:06:05.535700 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:06:05.535700 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:06:05.535700 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:06:05.536710 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:06:05.536710 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:06:05.536710 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:06:05.536710 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:06:05.536710 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:05.536710 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:05.536710 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:05.536710 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:05.536710 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:05.536710 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:05.536710 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:05.536710 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:05.536710 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:05.536710 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:05.536710 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:05.536710 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:05.537770 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:05.537770 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:05.537770 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:05.537770 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:05.537770 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:06:05.537770 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:06:05.537770 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:06:05.537770 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:06:05.537770 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:06:05.537770 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:06:05.537770 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:06:05.537770 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:05.542506 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 315/631] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:06:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:05.543487 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c213c-39c2-4178-ae94-ecf62529406b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:05.549433 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-9d190f86-0bff-40f9-a187-708325db309a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:06:05.549433 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:05.549433 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:05.549433 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:05.549433 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:05.549433 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:05.549433 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:05.549433 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:05.549433 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:05.549433 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:05.549433 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:05.549433 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:05.549433 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:05.549433 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:05.549433 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:05.549433 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:05.550431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:05.550431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:05.550431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:05.550431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:05.550431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:05.550431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:05.550431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:05.550431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:05.550431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:05.550431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:05.550431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:05.550431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:05.550431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:05.550431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:05.550431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:05.550431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:05.550431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:05.550431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:05.551417 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:05.551417 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:05.551417 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:05.551417 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:05.551417 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:05.551417 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:05.551417 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:05.551417 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:05.551417 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:06:05.551417 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:05.554726 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 317/632] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:06:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:05.560533 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d190f86-0bff-40f9-a187-708325db309a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:05.655250 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c213c-39c2-4178-ae94-ecf62529406b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:05.675038 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d190f86-0bff-40f9-a187-708325db309a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:05.691318 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46cd84-2584-4ec9-9027-a5b9dd1fd52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:05.692527 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46cd84-2584-4ec9-9027-a5b9dd1fd52b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:05.693033 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46cd84-2584-4ec9-9027-a5b9dd1fd52b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:05.693547 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46cd84-2584-4ec9-9027-a5b9dd1fd52b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:05.705710 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46cd84-2584-4ec9-9027-a5b9dd1fd52b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:06:05.714572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-0f46cd84-2584-4ec9-9027-a5b9dd1fd52b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:06:05.714572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:05.714572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:05.714572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:05.714572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:05.714572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:05.714572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:05.714572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:05.714572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:05.714572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:05.714572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:05.714572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:05.714572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:06:05.714572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:06:05.714572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:06:05.714572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:06:05.715586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:06:05.715586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:06:05.715586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:06:05.715586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:06:05.715586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:05.715586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:05.715586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:05.715586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:05.715586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:05.715586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:05.715586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:05.715586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:05.715586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:05.715586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:05.715586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:05.715586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:05.716444 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:05.716444 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:05.716444 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:05.716444 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:05.716444 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:06:05.716444 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:06:05.716444 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:06:05.716444 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:06:05.716444 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:06:05.716444 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:06:05.716444 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:06:05.716444 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:05.717093 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42d371-b901-4654-86fc-cd744b27ff30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:05.717093 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42d371-b901-4654-86fc-cd744b27ff30 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:05.717093 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42d371-b901-4654-86fc-cd744b27ff30 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:05.717093 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42d371-b901-4654-86fc-cd744b27ff30 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:05.717476 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42d371-b901-4654-86fc-cd744b27ff30 None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:05.718148 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42d371-b901-4654-86fc-cd744b27ff30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:05.723752 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 316/633] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:06:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:05.723752 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46cd84-2584-4ec9-9027-a5b9dd1fd52b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:05.723995 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42d371-b901-4654-86fc-cd744b27ff30 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:05.733791 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 318/634] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:06:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:05.738288 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42d371-b901-4654-86fc-cd744b27ff30 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:05.841633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46cd84-2584-4ec9-9027-a5b9dd1fd52b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:05.858900 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42d371-b901-4654-86fc-cd744b27ff30 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:05.879975 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec802b7-d34c-4b6c-8f94-fd7427c8470c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:05.881130 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec802b7-d34c-4b6c-8f94-fd7427c8470c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:05.881688 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec802b7-d34c-4b6c-8f94-fd7427c8470c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:05.882190 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec802b7-d34c-4b6c-8f94-fd7427c8470c None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:05.883817 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec802b7-d34c-4b6c-8f94-fd7427c8470c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:05.884360 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec802b7-d34c-4b6c-8f94-fd7427c8470c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:05.886080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec802b7-d34c-4b6c-8f94-fd7427c8470c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:05.901105 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c06106-7e71-400e-89ca-18c731870b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:05.901873 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c06106-7e71-400e-89ca-18c731870b03 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:05.902176 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c06106-7e71-400e-89ca-18c731870b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:05.902976 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c06106-7e71-400e-89ca-18c731870b03 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:05.903248 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c06106-7e71-400e-89ca-18c731870b03 None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:05.903561 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c06106-7e71-400e-89ca-18c731870b03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:05.904947 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c06106-7e71-400e-89ca-18c731870b03 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:05.912238 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 317/635] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:06:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:05.913545 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec802b7-d34c-4b6c-8f94-fd7427c8470c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:05.915038 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 319/636] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:06:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:05.915910 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c06106-7e71-400e-89ca-18c731870b03 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:06.024713 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c06106-7e71-400e-89ca-18c731870b03 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:06.027196 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec802b7-d34c-4b6c-8f94-fd7427c8470c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:06.064326 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a67d32-ddcc-4389-bbad-2d2fd865638b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:06.065207 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a67d32-ddcc-4389-bbad-2d2fd865638b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:06.065507 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f83a3-274d-4efd-8f4d-b40588736819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:06.065663 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a67d32-ddcc-4389-bbad-2d2fd865638b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:06.065890 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a67d32-ddcc-4389-bbad-2d2fd865638b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:06.066198 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f83a3-274d-4efd-8f4d-b40588736819 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:06.066558 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f83a3-274d-4efd-8f4d-b40588736819 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:06.066793 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f83a3-274d-4efd-8f4d-b40588736819 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:06.078659 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a67d32-ddcc-4389-bbad-2d2fd865638b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:06.080162 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a67d32-ddcc-4389-bbad-2d2fd865638b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:06.100500 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-d1a67d32-ddcc-4389-bbad-2d2fd865638b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:06.100500 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:06.100500 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:06.100500 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:06.100500 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:06.100500 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:06.100500 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:06.100500 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:06.100500 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:06.100500 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:06.100500 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:06.100500 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:06.100500 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:06.100500 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:06.100500 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:06.102357 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:06.102357 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:06.102357 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:06.102357 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:06.102357 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:06.102357 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:06.102357 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:06.102357 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:06.102357 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:06.102357 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:06.102357 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:06.102357 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:06.102357 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:06.102357 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:06.102357 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:06.102357 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:06.102357 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:06.103260 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:06.103260 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:06.103260 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:06.103260 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:06.107369 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 318/637] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:06.107906 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a67d32-ddcc-4389-bbad-2d2fd865638b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:06.151139 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f83a3-274d-4efd-8f4d-b40588736819 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:06.152573 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f83a3-274d-4efd-8f4d-b40588736819 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:06.235686 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a67d32-ddcc-4389-bbad-2d2fd865638b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:06.281145 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef174107-d8d1-4431-9b68-6039420a5064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:06.282005 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef174107-d8d1-4431-9b68-6039420a5064 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:06.282320 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef174107-d8d1-4431-9b68-6039420a5064 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:06.282626 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef174107-d8d1-4431-9b68-6039420a5064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:06.288601 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 320/638] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:06:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:06:06.288601 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6671c26-6bdb-4e56-b776-187717511b78 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:06.288601 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6671c26-6bdb-4e56-b776-187717511b78 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:06.288601 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6671c26-6bdb-4e56-b776-187717511b78 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:06.288601 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 321/639] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:06.288601 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6671c26-6bdb-4e56-b776-187717511b78 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:06.300834 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef174107-d8d1-4431-9b68-6039420a5064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:06.302337 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef174107-d8d1-4431-9b68-6039420a5064 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:06.320277 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-ef174107-d8d1-4431-9b68-6039420a5064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:06.320277 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:06.320277 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:06.320277 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:06.320277 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:06.320277 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:06.320277 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:06.320277 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:06.320277 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:06.320277 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:06.320277 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:06.320277 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:06.320277 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:06.320277 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:06.320277 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:06.322210 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:06.322210 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:06.322210 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:06.322210 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:06.322210 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:06.322210 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:06.322210 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:06.322210 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:06.322210 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:06.322210 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:06.322210 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:06.322210 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:06.322210 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:06.322210 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:06.322210 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:06.322210 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:06.322210 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:06.323155 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:06.323155 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:06.323155 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:06.323155 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:06.325542 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 319/640] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:06.326873 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef174107-d8d1-4431-9b68-6039420a5064 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:06.438063 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6671c26-6bdb-4e56-b776-187717511b78 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:06.469901 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef174107-d8d1-4431-9b68-6039420a5064 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:06.481053 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a438b0-25c9-4b18-b4ce-ef1585c1d64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:06.481761 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a438b0-25c9-4b18-b4ce-ef1585c1d64f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:06.482040 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a438b0-25c9-4b18-b4ce-ef1585c1d64f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:06.482312 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a438b0-25c9-4b18-b4ce-ef1585c1d64f None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:06.483046 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a438b0-25c9-4b18-b4ce-ef1585c1d64f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:06.483349 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a438b0-25c9-4b18-b4ce-ef1585c1d64f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:06.485002 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a438b0-25c9-4b18-b4ce-ef1585c1d64f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:06.503717 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 322/641] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:06.505183 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf10b39-53e1-4e7f-a7ef-0dd9eb6fcadc None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:06.505742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf10b39-53e1-4e7f-a7ef-0dd9eb6fcadc None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:06.505868 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf10b39-53e1-4e7f-a7ef-0dd9eb6fcadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:06.522698 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-5bf10b39-53e1-4e7f-a7ef-0dd9eb6fcadc None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:06.522901 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e241a-b63f-4778-8c29-ec4f853cf738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:06.524495 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5bf10b39-53e1-4e7f-a7ef-0dd9eb6fcadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:06.524713 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e241a-b63f-4778-8c29-ec4f853cf738 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:06.525198 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e241a-b63f-4778-8c29-ec4f853cf738 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:06.525726 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e241a-b63f-4778-8c29-ec4f853cf738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:06.543851 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e241a-b63f-4778-8c29-ec4f853cf738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:06.546457 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e241a-b63f-4778-8c29-ec4f853cf738 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:06.566953 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-ec5e241a-b63f-4778-8c29-ec4f853cf738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:06.566953 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:06.566953 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:06.566953 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:06.566953 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:06.566953 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:06.566953 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:06.566953 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:06.566953 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:06.566953 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:06.566953 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:06.566953 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:06.566953 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:06.566953 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:06.566953 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:06.567984 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:06.567984 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:06.567984 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:06.567984 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:06.567984 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:06.567984 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:06.567984 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:06.567984 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:06.567984 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:06.567984 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:06.567984 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:06.567984 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:06.567984 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:06.567984 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:06.567984 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:06.567984 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:06.567984 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:06.569141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:06.569141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:06.569141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:06.569141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:06.573039 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 320/642] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:06.573972 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e241a-b63f-4778-8c29-ec4f853cf738 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:06.619223 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 323/643] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:06:06.620716 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf10b39-53e1-4e7f-a7ef-0dd9eb6fcadc None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:06.688644 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e241a-b63f-4778-8c29-ec4f853cf738 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:06.732834 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb57604-9390-4e02-871d-57b187ff5b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:06.733542 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb57604-9390-4e02-871d-57b187ff5b97 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:06.733809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb57604-9390-4e02-871d-57b187ff5b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:06.734082 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb57604-9390-4e02-871d-57b187ff5b97 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:06.735143 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb57604-9390-4e02-871d-57b187ff5b97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:06.735450 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb57604-9390-4e02-871d-57b187ff5b97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:06.736836 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb57604-9390-4e02-871d-57b187ff5b97 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:06.752189 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 321/644] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:06.752940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb57604-9390-4e02-871d-57b187ff5b97 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:06.760679 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf10b39-53e1-4e7f-a7ef-0dd9eb6fcadc None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:06.811669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32797ab8-fc11-4c73-b17d-b48013c8b88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:06.812878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32797ab8-fc11-4c73-b17d-b48013c8b88f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:06.813347 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32797ab8-fc11-4c73-b17d-b48013c8b88f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:06.813845 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32797ab8-fc11-4c73-b17d-b48013c8b88f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:06.826853 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32797ab8-fc11-4c73-b17d-b48013c8b88f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:06.829233 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32797ab8-fc11-4c73-b17d-b48013c8b88f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:06.851498 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-32797ab8-fc11-4c73-b17d-b48013c8b88f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:06:06.851498 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:06.851498 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:06.851498 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:06.851498 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:06.851498 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:06.851498 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:06.851498 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:06.851498 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:06.851498 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:06.851498 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:06.851498 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:06.851498 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:06.851498 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:06.851498 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:06.851498 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:06.854211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:06.854211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:06.854211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:06.854211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:06.854211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:06.854211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:06.854211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:06.854211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:06.854211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:06.854211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:06.854211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:06.854211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:06.854211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:06.854211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:06.854211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:06.854211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:06.854211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:06.854211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:06.864782 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:06.864782 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:06.864782 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:06.864782 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:06.864782 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:06.864782 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:06.864782 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:06.864782 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:06.864782 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:06:06.864782 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:06.864782 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 324/645] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:06:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:06.864782 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32797ab8-fc11-4c73-b17d-b48013c8b88f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:06.892072 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb57604-9390-4e02-871d-57b187ff5b97 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:06.932908 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7387ecb-09dd-4c08-8292-ee27dc2cab43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:06.934072 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7387ecb-09dd-4c08-8292-ee27dc2cab43 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:06.934560 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7387ecb-09dd-4c08-8292-ee27dc2cab43 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:06.935063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7387ecb-09dd-4c08-8292-ee27dc2cab43 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:06.936554 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7387ecb-09dd-4c08-8292-ee27dc2cab43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:06.937108 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7387ecb-09dd-4c08-8292-ee27dc2cab43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:06.939709 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7387ecb-09dd-4c08-8292-ee27dc2cab43 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:06.954577 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 322/646] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:06.955538 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7387ecb-09dd-4c08-8292-ee27dc2cab43 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:07.000614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32797ab8-fc11-4c73-b17d-b48013c8b88f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:07.059961 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13fc9c-75ae-44a1-bf8b-25974c4ba30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:07.060763 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13fc9c-75ae-44a1-bf8b-25974c4ba30f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:07.061041 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13fc9c-75ae-44a1-bf8b-25974c4ba30f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:07.061310 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13fc9c-75ae-44a1-bf8b-25974c4ba30f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:07.068661 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7387ecb-09dd-4c08-8292-ee27dc2cab43 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:07.073151 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13fc9c-75ae-44a1-bf8b-25974c4ba30f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:06:07.080901 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-3c13fc9c-75ae-44a1-bf8b-25974c4ba30f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:06:07.080901 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:07.080901 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:07.080901 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:07.080901 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:07.080901 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:07.080901 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:07.080901 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:07.080901 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:07.080901 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:07.080901 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:07.080901 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:07.080901 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:06:07.080901 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:06:07.080901 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:06:07.080901 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:06:07.082082 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:06:07.082082 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:06:07.082082 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:06:07.082082 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:06:07.082082 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:07.082082 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:07.082082 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:07.082082 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:07.082082 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:07.082082 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:07.082082 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:07.082082 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:07.082082 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:07.082082 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:07.082082 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:07.082082 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:07.083121 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:07.083121 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:07.083121 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:07.083121 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:07.083121 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:06:07.083121 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:06:07.083121 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:06:07.083121 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:06:07.083121 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:06:07.083121 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:06:07.083121 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:06:07.083121 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:07.083121 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 325/647] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:06:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:07.084001 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13fc9c-75ae-44a1-bf8b-25974c4ba30f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:07.117343 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe287be-414b-4d59-bf71-e8e6c91c5aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:07.119030 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe287be-414b-4d59-bf71-e8e6c91c5aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:07.119402 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe287be-414b-4d59-bf71-e8e6c91c5aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:07.119689 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe287be-414b-4d59-bf71-e8e6c91c5aa7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:07.127735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe287be-414b-4d59-bf71-e8e6c91c5aa7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:07.129194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe287be-414b-4d59-bf71-e8e6c91c5aa7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:07.145291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-5fe287be-414b-4d59-bf71-e8e6c91c5aa7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 15:06:07.145291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:07.145291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:07.145291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:07.145291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:07.145291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:07.145291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:07.145291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:07.145291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:07.145291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:07.145291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:07.145291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:07.145291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:07.145291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:07.145291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:07.145291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:07.147123 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:07.147123 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:07.147123 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:07.147123 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:07.147123 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:07.147123 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:07.147123 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:07.147123 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:07.147123 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:07.147123 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:07.147123 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:07.147123 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:07.147123 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:07.147123 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:07.147123 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:07.147123 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:07.147123 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:07.147123 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:07.148231 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:07.148231 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:07.148231 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:07.148231 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:07.148231 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:07.148231 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:07.148231 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:07.148231 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:07.148231 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 15:06:07.148231 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:07.148231 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 323/648] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:06:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:07.148231 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe287be-414b-4d59-bf71-e8e6c91c5aa7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:07.194819 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13fc9c-75ae-44a1-bf8b-25974c4ba30f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:07.230740 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bc3da-1b25-4217-ac52-bdf8621b44d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:07.231412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bc3da-1b25-4217-ac52-bdf8621b44d9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:07.231697 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bc3da-1b25-4217-ac52-bdf8621b44d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:07.231973 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bc3da-1b25-4217-ac52-bdf8621b44d9 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:07.232817 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bc3da-1b25-4217-ac52-bdf8621b44d9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:07.233124 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bc3da-1b25-4217-ac52-bdf8621b44d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:07.234588 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bc3da-1b25-4217-ac52-bdf8621b44d9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:07.252966 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 326/649] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 9 15:06:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:07.254322 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309e664-ae11-415d-af3d-5bd988756b82 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:07.254603 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309e664-ae11-415d-af3d-5bd988756b82 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:07.254876 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309e664-ae11-415d-af3d-5bd988756b82 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:07.256154 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 327/650] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:07.256911 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309e664-ae11-415d-af3d-5bd988756b82 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:07.262345 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe287be-414b-4d59-bf71-e8e6c91c5aa7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:07.299562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80730941-0ea4-4d6d-8bf0-2e755d17b2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:07.300428 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80730941-0ea4-4d6d-8bf0-2e755d17b2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:07.300766 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80730941-0ea4-4d6d-8bf0-2e755d17b2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:07.301097 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80730941-0ea4-4d6d-8bf0-2e755d17b2c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:07.308779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80730941-0ea4-4d6d-8bf0-2e755d17b2c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:07.310876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80730941-0ea4-4d6d-8bf0-2e755d17b2c1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:07.325783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-80730941-0ea4-4d6d-8bf0-2e755d17b2c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:07.325783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:07.325783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:07.325783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:07.325783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:07.325783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:07.325783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:07.325783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:07.325783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:07.325783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:07.325783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:07.325783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:07.325783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:07.325783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:07.325783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:07.327218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:07.327218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:07.327218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:07.327218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:07.327218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:07.327218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:07.327218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:07.327218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:07.327218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:07.327218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:07.327218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:07.327218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:07.327218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:07.327218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:07.327218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:07.327218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:07.327218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:07.329006 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:07.329006 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:07.329006 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:07.329006 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:07.329006 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:07.329006 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:07.329006 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:07.329006 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:07.329006 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 324/651] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:07.329006 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80730941-0ea4-4d6d-8bf0-2e755d17b2c1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:07.379157 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309e664-ae11-415d-af3d-5bd988756b82 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:07.421268 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7f743-c589-4e92-9b80-d1feffd0919e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:07.422674 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7f743-c589-4e92-9b80-d1feffd0919e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:07.423047 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7f743-c589-4e92-9b80-d1feffd0919e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:07.423492 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7f743-c589-4e92-9b80-d1feffd0919e None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:07.424722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7f743-c589-4e92-9b80-d1feffd0919e None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:07.425222 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7f743-c589-4e92-9b80-d1feffd0919e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:07.427486 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7f743-c589-4e92-9b80-d1feffd0919e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:07.445545 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 328/652] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:06:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:07.445545 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7f743-c589-4e92-9b80-d1feffd0919e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:07.460650 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80730941-0ea4-4d6d-8bf0-2e755d17b2c1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:07.512431 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491a92b-46b7-40a2-b962-b76ba0c719e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:07.513493 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491a92b-46b7-40a2-b962-b76ba0c719e1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:07.513944 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491a92b-46b7-40a2-b962-b76ba0c719e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:07.514354 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491a92b-46b7-40a2-b962-b76ba0c719e1 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:07.515768 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491a92b-46b7-40a2-b962-b76ba0c719e1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:07.516267 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491a92b-46b7-40a2-b962-b76ba0c719e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:07.518748 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491a92b-46b7-40a2-b962-b76ba0c719e1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:07.537353 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 325/653] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 9 15:06:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:07.539667 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70183920-2e55-487c-80f3-b42c259c0ad7 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:07.540156 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70183920-2e55-487c-80f3-b42c259c0ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:07.540639 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70183920-2e55-487c-80f3-b42c259c0ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:07.559525 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-70183920-2e55-487c-80f3-b42c259c0ad7 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:07.560779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-70183920-2e55-487c-80f3-b42c259c0ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:07.571144 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7f743-c589-4e92-9b80-d1feffd0919e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:07.608183 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434c09a-0c38-4265-ba79-36f85dfbc149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:07.608759 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434c09a-0c38-4265-ba79-36f85dfbc149 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:07.609046 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434c09a-0c38-4265-ba79-36f85dfbc149 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:07.609325 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434c09a-0c38-4265-ba79-36f85dfbc149 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:07.629826 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 326/654] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:06:07.630686 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70183920-2e55-487c-80f3-b42c259c0ad7 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:07.682527 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434c09a-0c38-4265-ba79-36f85dfbc149 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:07.683991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434c09a-0c38-4265-ba79-36f85dfbc149 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:07.730738 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70183920-2e55-487c-80f3-b42c259c0ad7 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:07.765982 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1834c-3c38-4c89-9840-159b22932ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:07.766652 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1834c-3c38-4c89-9840-159b22932ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:07.766929 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1834c-3c38-4c89-9840-159b22932ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:07.767203 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1834c-3c38-4c89-9840-159b22932ed4 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:07.768001 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1834c-3c38-4c89-9840-159b22932ed4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:07.768305 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1834c-3c38-4c89-9840-159b22932ed4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:07.769783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1834c-3c38-4c89-9840-159b22932ed4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:07.781656 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 327/655] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:06:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:07.782563 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1834c-3c38-4c89-9840-159b22932ed4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:07.794046 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 329/656] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:06:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:06:07.795449 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434c09a-0c38-4265-ba79-36f85dfbc149 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:07.886433 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1834c-3c38-4c89-9840-159b22932ed4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:07.923388 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085f076-25b5-4bba-870a-251a743bb13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:07.924269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085f076-25b5-4bba-870a-251a743bb13f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:07.924605 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085f076-25b5-4bba-870a-251a743bb13f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:07.924936 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085f076-25b5-4bba-870a-251a743bb13f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:07.925687 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434c09a-0c38-4265-ba79-36f85dfbc149 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:07.936790 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085f076-25b5-4bba-870a-251a743bb13f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:07.938273 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085f076-25b5-4bba-870a-251a743bb13f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:07.955749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-8085f076-25b5-4bba-870a-251a743bb13f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:07.955749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:07.955749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:07.955749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:07.955749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:07.955749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:07.955749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:07.955749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:07.955749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:07.955749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:07.955749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:07.955749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:07.955749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:07.955749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:07.955749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:07.957685 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:07.957685 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:07.957685 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:07.957685 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:07.957685 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:07.957685 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:07.957685 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:07.957685 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:07.957685 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:07.957685 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:07.957685 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:07.957685 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:07.957685 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:07.957685 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:07.957685 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:07.957685 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:07.957685 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:07.959177 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:07.959177 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:07.959177 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:07.959177 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:07.961927 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 328/657] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:07.962189 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99864e12-293d-495f-bfd2-7a3e2df8b23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:07.962853 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99864e12-293d-495f-bfd2-7a3e2df8b23f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:07.963132 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99864e12-293d-495f-bfd2-7a3e2df8b23f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:07.963281 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085f076-25b5-4bba-870a-251a743bb13f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:07.963466 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99864e12-293d-495f-bfd2-7a3e2df8b23f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:08.040319 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99864e12-293d-495f-bfd2-7a3e2df8b23f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:08.041799 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99864e12-293d-495f-bfd2-7a3e2df8b23f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:08.134051 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085f076-25b5-4bba-870a-251a743bb13f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:08.153702 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 330/658] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:06:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:06:08.154531 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99864e12-293d-495f-bfd2-7a3e2df8b23f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:08.197028 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048edfc-9de0-4ad3-a347-20c75297c885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:08.198455 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048edfc-9de0-4ad3-a347-20c75297c885 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:08.198996 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048edfc-9de0-4ad3-a347-20c75297c885 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:08.199417 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048edfc-9de0-4ad3-a347-20c75297c885 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:08.219658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048edfc-9de0-4ad3-a347-20c75297c885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:06:08.236779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-1048edfc-9de0-4ad3-a347-20c75297c885 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:06:08.236779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:08.236779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:08.236779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:08.236779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:08.236779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:08.236779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:08.236779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:08.236779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:08.236779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:08.236779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:08.236779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:08.236779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:06:08.236779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:06:08.236779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:06:08.236779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:06:08.238131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:06:08.238131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:06:08.238131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:06:08.238131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:06:08.238131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:08.238131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:08.238131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:08.238131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:08.238131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:08.238131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:08.238131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:08.238131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:08.238131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:08.238131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:08.238131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:08.238131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:08.239192 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:08.239192 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:08.239192 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:08.239192 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:08.239192 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:06:08.239192 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:06:08.239192 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:06:08.239192 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:06:08.239192 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:06:08.239192 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:06:08.239192 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:06:08.239192 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:08.239192 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 329/659] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:06:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:08.240843 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048edfc-9de0-4ad3-a347-20c75297c885 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:08.264289 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99864e12-293d-495f-bfd2-7a3e2df8b23f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:08.297635 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d586a8-3a37-46af-834b-fc90370efac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:08.298321 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d586a8-3a37-46af-834b-fc90370efac6 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:08.298575 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d586a8-3a37-46af-834b-fc90370efac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:08.298832 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d586a8-3a37-46af-834b-fc90370efac6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:08.299747 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d586a8-3a37-46af-834b-fc90370efac6 None admin] RBAC: Adding query filter params (role.id=d8aa93d29788400a97d04db10d8fb8d5, scope.project.id=4fcadeae44cc4547905b83bfebec79c7, user.id=65e7a4e661ef4425b24844c3500b0b58) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:08.300058 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d586a8-3a37-46af-834b-fc90370efac6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:08.301532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d586a8-3a37-46af-834b-fc90370efac6 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:08.308163 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 331/660] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:06:08 2022] GET /identity/v3/role_assignments?user.id=65e7a4e661ef4425b24844c3500b0b58&scope.project.id=4fcadeae44cc4547905b83bfebec79c7&role.id=d8aa93d29788400a97d04db10d8fb8d5 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:08.308989 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d586a8-3a37-46af-834b-fc90370efac6 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:08.406171 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048edfc-9de0-4ad3-a347-20c75297c885 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:08.447456 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d586a8-3a37-46af-834b-fc90370efac6 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:08.464085 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cad76-b0ac-4b25-a454-41ece387e4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:08.465755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cad76-b0ac-4b25-a454-41ece387e4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:08.465966 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cad76-b0ac-4b25-a454-41ece387e4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:08.466471 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cad76-b0ac-4b25-a454-41ece387e4d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:08.484483 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21cad76-b0ac-4b25-a454-41ece387e4d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:08.487466 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21cad76-b0ac-4b25-a454-41ece387e4d3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:08.494423 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542dbcb-b6d7-48ed-ad35-02bb9b4dd821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:08.495228 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542dbcb-b6d7-48ed-ad35-02bb9b4dd821 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:08.495356 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542dbcb-b6d7-48ed-ad35-02bb9b4dd821 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:08.495642 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542dbcb-b6d7-48ed-ad35-02bb9b4dd821 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:08.496363 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542dbcb-b6d7-48ed-ad35-02bb9b4dd821 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:08.496666 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542dbcb-b6d7-48ed-ad35-02bb9b4dd821 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:08.498099 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542dbcb-b6d7-48ed-ad35-02bb9b4dd821 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:08.515710 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 332/661] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:08.515710 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542dbcb-b6d7-48ed-ad35-02bb9b4dd821 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:08.519822 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f21cad76-b0ac-4b25-a454-41ece387e4d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:08.519822 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:08.519822 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:08.519822 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:08.519822 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:08.519822 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:08.519822 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:08.519822 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:08.519822 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:08.519822 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:08.519822 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:08.519822 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:08.519822 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:08.519822 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:08.519822 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:08.521007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:08.521007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:08.521007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:08.521007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:08.521007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:08.521007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:08.521007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:08.521007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:08.521007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:08.521007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:08.521007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:08.521007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:08.521007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:08.521007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:08.521007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:08.521007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:08.521007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:08.522171 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:08.522171 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:08.522171 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:08.522171 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:08.529561 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 330/662] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:08.529561 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cad76-b0ac-4b25-a454-41ece387e4d3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:08.642289 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542dbcb-b6d7-48ed-ad35-02bb9b4dd821 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:08.653213 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cad76-b0ac-4b25-a454-41ece387e4d3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:08.686694 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e389084-c1eb-429c-9603-9f4c7db57dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:08.687781 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e389084-c1eb-429c-9603-9f4c7db57dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:08.688069 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e389084-c1eb-429c-9603-9f4c7db57dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:08.688437 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e389084-c1eb-429c-9603-9f4c7db57dc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:08.691781 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0785c1-8edf-4927-a003-ec3f4a52ed68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:08.692457 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0785c1-8edf-4927-a003-ec3f4a52ed68 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:08.692743 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0785c1-8edf-4927-a003-ec3f4a52ed68 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:08.693009 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0785c1-8edf-4927-a003-ec3f4a52ed68 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:08.693888 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0785c1-8edf-4927-a003-ec3f4a52ed68 None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:08.694189 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0785c1-8edf-4927-a003-ec3f4a52ed68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:08.696140 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0785c1-8edf-4927-a003-ec3f4a52ed68 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:08.701866 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e389084-c1eb-429c-9603-9f4c7db57dc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:08.704703 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e389084-c1eb-429c-9603-9f4c7db57dc7 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:08.705325 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 331/663] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:06:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:08.706549 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0785c1-8edf-4927-a003-ec3f4a52ed68 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:08.738897 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-9e389084-c1eb-429c-9603-9f4c7db57dc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:08.738897 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:08.738897 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:08.738897 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:08.738897 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:08.738897 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:08.738897 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:08.738897 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:08.738897 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:08.738897 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:08.738897 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:08.738897 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:08.738897 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:08.738897 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:08.738897 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:08.740665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:08.740665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:08.740665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:08.740665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:08.740665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:08.740665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:08.740665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:08.740665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:08.740665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:08.740665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:08.740665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:08.740665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:08.740665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:08.740665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:08.740665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:08.740665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:08.740665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:08.743263 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:08.743263 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:08.743263 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:08.743263 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:08.744782 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 333/664] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:08.749417 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e389084-c1eb-429c-9603-9f4c7db57dc7 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:08.851085 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0785c1-8edf-4927-a003-ec3f4a52ed68 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:08.863701 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e389084-c1eb-429c-9603-9f4c7db57dc7 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:08.903296 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0eeb5-4afe-45f3-8739-5f9e1ef118ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:08.903838 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbfa5a1-5536-4f03-a783-90df646d473e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:08.904052 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0eeb5-4afe-45f3-8739-5f9e1ef118ac None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:08.904287 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0eeb5-4afe-45f3-8739-5f9e1ef118ac None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:08.904562 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0eeb5-4afe-45f3-8739-5f9e1ef118ac None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:08.905176 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbfa5a1-5536-4f03-a783-90df646d473e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:08.905292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0eeb5-4afe-45f3-8739-5f9e1ef118ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:08.905634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0eeb5-4afe-45f3-8739-5f9e1ef118ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:08.905729 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbfa5a1-5536-4f03-a783-90df646d473e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:08.906173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbfa5a1-5536-4f03-a783-90df646d473e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:08.907007 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0eeb5-4afe-45f3-8739-5f9e1ef118ac None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:08.923988 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 334/665] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:08.924211 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbfa5a1-5536-4f03-a783-90df646d473e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:08.924299 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0eeb5-4afe-45f3-8739-5f9e1ef118ac None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:08.924373 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbfa5a1-5536-4f03-a783-90df646d473e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:08.939675 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-7bbfa5a1-5536-4f03-a783-90df646d473e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:06:08.939675 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:08.939675 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:08.939675 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:08.939675 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:08.939675 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:08.939675 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:08.939675 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:08.939675 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:08.939675 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:08.939675 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:08.939675 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:08.939675 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:08.939675 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:08.939675 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:08.939675 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:08.940719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:08.940719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:08.940719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:08.940719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:08.940719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:08.940719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:08.940719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:08.940719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:08.940719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:08.940719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:08.940719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:08.940719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:08.940719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:08.940719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:08.940719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:08.940719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:08.940719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:08.940719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:08.942128 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:08.942128 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:08.942128 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:08.942128 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:08.942128 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:08.942128 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:08.942128 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:08.942128 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:08.942128 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:06:08.942128 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:08.946124 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 332/666] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:06:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:08.947035 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbfa5a1-5536-4f03-a783-90df646d473e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:09.064956 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbfa5a1-5536-4f03-a783-90df646d473e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:09.078214 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0eeb5-4afe-45f3-8739-5f9e1ef118ac None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:09.104594 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b035385-12ea-41e8-b2cc-0719c914d44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:09.105696 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b035385-12ea-41e8-b2cc-0719c914d44d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:09.106144 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b035385-12ea-41e8-b2cc-0719c914d44d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:09.106560 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b035385-12ea-41e8-b2cc-0719c914d44d None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:09.107579 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b035385-12ea-41e8-b2cc-0719c914d44d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:09.108024 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b035385-12ea-41e8-b2cc-0719c914d44d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:09.110172 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b035385-12ea-41e8-b2cc-0719c914d44d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:09.121087 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2955cc-bc7d-44ea-b56c-cf9e2e2dce59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:09.122043 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2955cc-bc7d-44ea-b56c-cf9e2e2dce59 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:09.122392 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2955cc-bc7d-44ea-b56c-cf9e2e2dce59 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:09.122769 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2955cc-bc7d-44ea-b56c-cf9e2e2dce59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:09.139163 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 333/667] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:09.139163 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b035385-12ea-41e8-b2cc-0719c914d44d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:09.142443 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2955cc-bc7d-44ea-b56c-cf9e2e2dce59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:09.143917 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2955cc-bc7d-44ea-b56c-cf9e2e2dce59 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:09.163925 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-db2955cc-bc7d-44ea-b56c-cf9e2e2dce59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:09.163925 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:09.163925 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:09.163925 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:09.163925 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:09.163925 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:09.163925 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:09.163925 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:09.163925 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:09.163925 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:09.163925 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:09.163925 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:09.163925 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:09.163925 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:09.163925 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:09.165570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:09.165570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:09.165570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:09.165570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:09.165570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:09.165570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:09.165570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:09.165570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:09.165570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:09.165570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:09.165570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:09.165570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:09.165570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:09.165570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:09.165570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:09.165570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:09.165570 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:09.166548 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:09.166548 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:09.166548 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:09.166548 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:09.170478 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 335/668] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:09.171408 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2955cc-bc7d-44ea-b56c-cf9e2e2dce59 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:09.283132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b035385-12ea-41e8-b2cc-0719c914d44d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:09.296532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2955cc-bc7d-44ea-b56c-cf9e2e2dce59 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:09.322671 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0915d59-08b8-4ac7-aa04-18b3f6f0bb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:09.323533 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0915d59-08b8-4ac7-aa04-18b3f6f0bb46 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:09.323810 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0915d59-08b8-4ac7-aa04-18b3f6f0bb46 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:09.324079 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0915d59-08b8-4ac7-aa04-18b3f6f0bb46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:09.331999 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0915d59-08b8-4ac7-aa04-18b3f6f0bb46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:09.333579 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0915d59-08b8-4ac7-aa04-18b3f6f0bb46 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:09.346840 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa56ead-06ea-41fa-be4c-2775520af319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:09.347788 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa56ead-06ea-41fa-be4c-2775520af319 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:09.348267 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa56ead-06ea-41fa-be4c-2775520af319 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:09.348386 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-c0915d59-08b8-4ac7-aa04-18b3f6f0bb46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:09.348386 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:09.348386 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:09.348386 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:09.348386 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:09.348386 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:09.348386 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:09.348386 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:09.348386 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:09.348386 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:09.348386 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:09.348386 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:09.348386 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:09.348386 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:09.348386 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:09.349225 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:09.349225 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:09.349225 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:09.349225 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:09.349225 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:09.349225 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:09.349225 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:09.349225 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:09.349225 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:09.349225 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:09.349225 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:09.349225 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:09.349225 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:09.349225 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:09.349225 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:09.349225 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:09.349225 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:09.350178 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:09.350178 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:09.350178 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:09.350178 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:09.350178 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:09.350178 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:09.350178 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:09.350178 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:09.350178 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 334/669] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:09.350741 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0915d59-08b8-4ac7-aa04-18b3f6f0bb46 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:09.351801 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa56ead-06ea-41fa-be4c-2775520af319 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:09.352670 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa56ead-06ea-41fa-be4c-2775520af319 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:09.352983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa56ead-06ea-41fa-be4c-2775520af319 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:09.354436 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa56ead-06ea-41fa-be4c-2775520af319 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:09.376223 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 336/670] 10.222.0.48 () {56 vars in 1139 bytes} [Mon May 9 15:06:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:09.384107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa56ead-06ea-41fa-be4c-2775520af319 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:09.469244 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0915d59-08b8-4ac7-aa04-18b3f6f0bb46 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:09.509232 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee7fad-aefc-4aa1-905e-94662c2d2a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:09.510075 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee7fad-aefc-4aa1-905e-94662c2d2a04 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:09.510374 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee7fad-aefc-4aa1-905e-94662c2d2a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:09.510657 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee7fad-aefc-4aa1-905e-94662c2d2a04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:09.518965 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee7fad-aefc-4aa1-905e-94662c2d2a04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:09.520536 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee7fad-aefc-4aa1-905e-94662c2d2a04 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:09.529837 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa56ead-06ea-41fa-be4c-2775520af319 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:09.536816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-3aee7fad-aefc-4aa1-905e-94662c2d2a04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:09.536816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:09.536816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:09.536816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:09.536816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:09.536816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:09.536816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:09.536816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:09.536816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:09.536816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:09.536816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:09.536816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:09.536816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:09.536816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:09.536816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:09.538772 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:09.538772 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:09.538772 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:09.538772 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:09.538772 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:09.538772 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:09.538772 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:09.538772 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:09.538772 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:09.538772 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:09.538772 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:09.538772 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:09.538772 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:09.538772 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:09.538772 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:09.538772 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:09.538772 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:09.540992 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:09.540992 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:09.540992 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:09.540992 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:09.540992 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:09.540992 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:09.540992 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:09.540992 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:09.543321 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 335/671] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:09.544283 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee7fad-aefc-4aa1-905e-94662c2d2a04 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:09.577237 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632403a9-c903-4440-b3e7-f11b0bad3bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:09.578237 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632403a9-c903-4440-b3e7-f11b0bad3bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:09.578661 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632403a9-c903-4440-b3e7-f11b0bad3bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:09.579070 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632403a9-c903-4440-b3e7-f11b0bad3bb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:09.580026 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632403a9-c903-4440-b3e7-f11b0bad3bb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:09.580544 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632403a9-c903-4440-b3e7-f11b0bad3bb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:09.582382 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632403a9-c903-4440-b3e7-f11b0bad3bb6 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:09.603805 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 337/672] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:09.604606 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632403a9-c903-4440-b3e7-f11b0bad3bb6 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:09.669573 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee7fad-aefc-4aa1-905e-94662c2d2a04 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:09.716690 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ed7de-3ffb-4741-9daa-401cedae7b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:09.717561 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ed7de-3ffb-4741-9daa-401cedae7b96 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:09.717931 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ed7de-3ffb-4741-9daa-401cedae7b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:09.718306 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ed7de-3ffb-4741-9daa-401cedae7b96 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:09.719283 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ed7de-3ffb-4741-9daa-401cedae7b96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:09.719808 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ed7de-3ffb-4741-9daa-401cedae7b96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:09.722392 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ed7de-3ffb-4741-9daa-401cedae7b96 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:09.728251 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632403a9-c903-4440-b3e7-f11b0bad3bb6 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:09.748565 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 336/673] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:06:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:09.748565 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ed7de-3ffb-4741-9daa-401cedae7b96 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:09.780109 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e0a15-d2e4-4dbb-b18a-b92f9bdb0aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:09.780828 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e0a15-d2e4-4dbb-b18a-b92f9bdb0aff None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:09.781128 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e0a15-d2e4-4dbb-b18a-b92f9bdb0aff None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:09.781432 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e0a15-d2e4-4dbb-b18a-b92f9bdb0aff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:09.854164 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e0a15-d2e4-4dbb-b18a-b92f9bdb0aff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:09.855529 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e0a15-d2e4-4dbb-b18a-b92f9bdb0aff None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:09.888984 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ed7de-3ffb-4741-9daa-401cedae7b96 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:09.947976 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73688b2-604e-4c6e-b72e-cbec1a583958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:09.948976 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73688b2-604e-4c6e-b72e-cbec1a583958 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:09.949433 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73688b2-604e-4c6e-b72e-cbec1a583958 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:09.949861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73688b2-604e-4c6e-b72e-cbec1a583958 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:09.951149 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73688b2-604e-4c6e-b72e-cbec1a583958 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:09.951622 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73688b2-604e-4c6e-b72e-cbec1a583958 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:09.954173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73688b2-604e-4c6e-b72e-cbec1a583958 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:09.960791 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 338/674] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:06:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:06:09.960791 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e0a15-d2e4-4dbb-b18a-b92f9bdb0aff None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:09.981862 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 337/675] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:06:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:09.981862 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73688b2-604e-4c6e-b72e-cbec1a583958 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:10.094153 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73688b2-604e-4c6e-b72e-cbec1a583958 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:10.099715 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e0a15-d2e4-4dbb-b18a-b92f9bdb0aff None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:10.137446 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035c6ce-bd0b-40cc-860d-8ec5b915dcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:10.138066 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035c6ce-bd0b-40cc-860d-8ec5b915dcad None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:10.138352 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035c6ce-bd0b-40cc-860d-8ec5b915dcad None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:10.138630 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035c6ce-bd0b-40cc-860d-8ec5b915dcad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:10.139545 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035c6ce-bd0b-40cc-860d-8ec5b915dcad None admin] RBAC: Adding query filter params (role.id=d8aa93d29788400a97d04db10d8fb8d5, scope.project.id=4fcadeae44cc4547905b83bfebec79c7, user.id=221e55f84f66471794e82fec1b18c87c) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:10.139866 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035c6ce-bd0b-40cc-860d-8ec5b915dcad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:10.141512 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035c6ce-bd0b-40cc-860d-8ec5b915dcad None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:10.148641 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 338/676] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:06:09 2022] GET /identity/v3/role_assignments?user.id=221e55f84f66471794e82fec1b18c87c&scope.project.id=4fcadeae44cc4547905b83bfebec79c7&role.id=d8aa93d29788400a97d04db10d8fb8d5 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:10.153661 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035c6ce-bd0b-40cc-860d-8ec5b915dcad None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:10.175594 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d35552-62fa-4220-b6fa-3dcc360c5711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:10.177026 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d35552-62fa-4220-b6fa-3dcc360c5711 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:10.177796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d35552-62fa-4220-b6fa-3dcc360c5711 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:10.178321 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d35552-62fa-4220-b6fa-3dcc360c5711 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:10.188829 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d35552-62fa-4220-b6fa-3dcc360c5711 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:10.190983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d35552-62fa-4220-b6fa-3dcc360c5711 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:10.209332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-c3d35552-62fa-4220-b6fa-3dcc360c5711 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:06:10.209332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:10.209332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:10.209332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:10.209332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:10.209332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:10.209332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:10.209332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:10.209332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:10.209332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:10.209332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:10.209332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:10.209332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:10.209332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:10.209332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:10.209332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:10.210412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:10.210412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:10.210412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:10.210412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:10.210412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:10.210412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:10.210412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:10.210412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:10.210412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:10.210412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:10.210412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:10.210412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:10.210412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:10.210412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:10.210412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:10.210412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:10.210412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:10.210412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:10.211804 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:10.211804 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:10.211804 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:10.211804 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:10.211804 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:10.211804 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:10.211804 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:10.211804 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:10.211804 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:06:10.211804 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:10.219424 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 339/677] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:06:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:10.220760 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d35552-62fa-4220-b6fa-3dcc360c5711 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:10.275919 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035c6ce-bd0b-40cc-860d-8ec5b915dcad None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:10.313643 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d04650-5f5f-4e46-b7c9-f7cb57301425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:10.314388 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d04650-5f5f-4e46-b7c9-f7cb57301425 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:10.314787 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d04650-5f5f-4e46-b7c9-f7cb57301425 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:10.315063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d04650-5f5f-4e46-b7c9-f7cb57301425 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:10.326459 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d04650-5f5f-4e46-b7c9-f7cb57301425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:10.327965 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d04650-5f5f-4e46-b7c9-f7cb57301425 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:10.336739 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d35552-62fa-4220-b6fa-3dcc360c5711 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:10.347799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-b2d04650-5f5f-4e46-b7c9-f7cb57301425 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:10.347799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:10.347799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:10.347799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:10.347799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:10.347799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:10.347799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:10.347799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:10.347799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:10.347799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:10.347799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:10.347799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:10.347799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:10.347799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:10.347799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:10.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:10.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:10.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:10.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:10.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:10.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:10.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:10.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:10.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:10.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:10.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:10.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:10.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:10.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:10.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:10.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:10.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:10.349835 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:10.349835 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:10.349835 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:10.349835 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:10.355365 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 339/678] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:10.356356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d04650-5f5f-4e46-b7c9-f7cb57301425 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:10.380104 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5672da-7918-4b53-ac5e-d49583f66be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:10.381232 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5672da-7918-4b53-ac5e-d49583f66be0 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:10.381753 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5672da-7918-4b53-ac5e-d49583f66be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:10.382290 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5672da-7918-4b53-ac5e-d49583f66be0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:10.383790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5672da-7918-4b53-ac5e-d49583f66be0 None admin] RBAC: Adding query filter params (role.id=d8aa93d29788400a97d04db10d8fb8d5, scope.project.id=4fcadeae44cc4547905b83bfebec79c7, user.id=6dcdf3e1a44d4475882c1af71e933312) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:10.384423 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5672da-7918-4b53-ac5e-d49583f66be0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:10.386251 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5672da-7918-4b53-ac5e-d49583f66be0 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:10.394116 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 340/679] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:06:10 2022] GET /identity/v3/role_assignments?user.id=6dcdf3e1a44d4475882c1af71e933312&scope.project.id=4fcadeae44cc4547905b83bfebec79c7&role.id=d8aa93d29788400a97d04db10d8fb8d5 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:10.395370 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5672da-7918-4b53-ac5e-d49583f66be0 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:10.530739 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d04650-5f5f-4e46-b7c9-f7cb57301425 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:10.571664 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531d3f0-ea25-482f-93ed-aeedaa178d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:10.572805 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531d3f0-ea25-482f-93ed-aeedaa178d35 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:10.573532 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531d3f0-ea25-482f-93ed-aeedaa178d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:10.574177 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531d3f0-ea25-482f-93ed-aeedaa178d35 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:10.575342 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531d3f0-ea25-482f-93ed-aeedaa178d35 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:10.575909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531d3f0-ea25-482f-93ed-aeedaa178d35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:10.577669 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531d3f0-ea25-482f-93ed-aeedaa178d35 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:10.584929 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5672da-7918-4b53-ac5e-d49583f66be0 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:10.600349 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 340/680] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 9 15:06:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:10.607319 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531d3f0-ea25-482f-93ed-aeedaa178d35 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:10.657184 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c52bd7-3fc0-461a-a15b-d75ac781316f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:10.658213 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c52bd7-3fc0-461a-a15b-d75ac781316f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:10.659061 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c52bd7-3fc0-461a-a15b-d75ac781316f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:10.659199 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c52bd7-3fc0-461a-a15b-d75ac781316f None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:10.660542 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c52bd7-3fc0-461a-a15b-d75ac781316f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:10.661142 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c52bd7-3fc0-461a-a15b-d75ac781316f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:10.663803 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c52bd7-3fc0-461a-a15b-d75ac781316f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:10.688368 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 341/681] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:10.694182 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c52bd7-3fc0-461a-a15b-d75ac781316f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:10.745300 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531d3f0-ea25-482f-93ed-aeedaa178d35 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:10.804743 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c52bd7-3fc0-461a-a15b-d75ac781316f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:10.804985 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0291bfb-118b-4b75-a9c2-496862315ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:10.806139 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0291bfb-118b-4b75-a9c2-496862315ebe None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:10.806643 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0291bfb-118b-4b75-a9c2-496862315ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:10.807141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0291bfb-118b-4b75-a9c2-496862315ebe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:10.846742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33706a-022c-4f78-a233-94da16d28ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:10.847551 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33706a-022c-4f78-a233-94da16d28ded None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:10.848388 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33706a-022c-4f78-a233-94da16d28ded None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:10.848388 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33706a-022c-4f78-a233-94da16d28ded None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:10.857813 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c33706a-022c-4f78-a233-94da16d28ded None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:10.860191 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c33706a-022c-4f78-a233-94da16d28ded None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:10.879396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-7c33706a-022c-4f78-a233-94da16d28ded None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:10.879396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:10.879396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:10.879396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:10.879396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:10.879396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:10.879396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:10.879396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:10.879396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:10.879396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:10.879396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:10.879396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:10.879396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:10.879396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:10.879396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:10.881288 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:10.881288 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:10.881288 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:10.881288 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:10.881288 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:10.881288 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:10.881288 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:10.881288 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:10.881288 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:10.881288 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:10.881288 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:10.881288 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:10.881288 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:10.881288 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:10.881288 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:10.881288 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:10.881288 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:10.883639 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:10.883639 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:10.883639 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:10.883639 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:10.883639 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:10.883639 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:10.883639 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:10.883639 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:10.888122 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 342/682] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:10.897541 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33706a-022c-4f78-a233-94da16d28ded None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:10.918540 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0291bfb-118b-4b75-a9c2-496862315ebe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:10.919945 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0291bfb-118b-4b75-a9c2-496862315ebe None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:11.027807 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 341/683] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:06:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:06:11.034226 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0291bfb-118b-4b75-a9c2-496862315ebe None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:11.088900 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33706a-022c-4f78-a233-94da16d28ded None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:11.160279 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d49533-1e1c-46d6-87e2-0ce3b51ad2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:11.160962 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d49533-1e1c-46d6-87e2-0ce3b51ad2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:11.161224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d49533-1e1c-46d6-87e2-0ce3b51ad2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:11.165396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d49533-1e1c-46d6-87e2-0ce3b51ad2b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:11.165396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d49533-1e1c-46d6-87e2-0ce3b51ad2b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:11.165396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d49533-1e1c-46d6-87e2-0ce3b51ad2b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:11.165396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d49533-1e1c-46d6-87e2-0ce3b51ad2b9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:11.198003 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 343/684] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:06:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:11.204379 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d49533-1e1c-46d6-87e2-0ce3b51ad2b9 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:11.207335 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0291bfb-118b-4b75-a9c2-496862315ebe None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:11.271360 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484c168-d592-4490-abc6-9c0bbfd19a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:11.272165 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484c168-d592-4490-abc6-9c0bbfd19a0d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:11.272451 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484c168-d592-4490-abc6-9c0bbfd19a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:11.272733 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484c168-d592-4490-abc6-9c0bbfd19a0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:11.288765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4484c168-d592-4490-abc6-9c0bbfd19a0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:11.291003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4484c168-d592-4490-abc6-9c0bbfd19a0d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:11.326071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-4484c168-d592-4490-abc6-9c0bbfd19a0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:11.326071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:11.326071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:11.326071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:11.326071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:11.326071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:11.326071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:11.326071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:11.326071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:11.326071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:11.326071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:11.326071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:11.326071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:11.326071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:11.326071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:11.327053 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:11.327053 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:11.327053 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:11.327053 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:11.327053 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:11.327053 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:11.327053 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:11.327053 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:11.327053 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:11.327053 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:11.327053 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:11.327053 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:11.327053 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:11.327053 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:11.327053 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:11.327053 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:11.327053 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:11.327969 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:11.327969 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:11.327969 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:11.327969 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:11.327969 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 342/685] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:11.333215 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484c168-d592-4490-abc6-9c0bbfd19a0d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:11.455771 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484c168-d592-4490-abc6-9c0bbfd19a0d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:11.458418 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d49533-1e1c-46d6-87e2-0ce3b51ad2b9 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:11.496504 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690100b-42d8-4493-b579-6b8060aff7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:11.497180 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690100b-42d8-4493-b579-6b8060aff7ad None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:11.497511 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690100b-42d8-4493-b579-6b8060aff7ad None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:11.497794 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690100b-42d8-4493-b579-6b8060aff7ad None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:11.498586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690100b-42d8-4493-b579-6b8060aff7ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:11.498934 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690100b-42d8-4493-b579-6b8060aff7ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:11.500289 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690100b-42d8-4493-b579-6b8060aff7ad None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:11.514759 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 343/686] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:11.520434 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690100b-42d8-4493-b579-6b8060aff7ad None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:11.548978 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19e88d-4072-44a7-bea2-c173d456d2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:11.550165 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19e88d-4072-44a7-bea2-c173d456d2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:11.550728 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19e88d-4072-44a7-bea2-c173d456d2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:11.551461 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19e88d-4072-44a7-bea2-c173d456d2c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:11.552915 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19e88d-4072-44a7-bea2-c173d456d2c8 None admin] RBAC: Adding query filter params (role.id=d8aa93d29788400a97d04db10d8fb8d5, scope.project.id=4fcadeae44cc4547905b83bfebec79c7, user.id=4cd76a442c2f4c759e7438031d5d6aca) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:11.553568 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19e88d-4072-44a7-bea2-c173d456d2c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:11.556152 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19e88d-4072-44a7-bea2-c173d456d2c8 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:11.580156 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 344/687] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:06:11 2022] GET /identity/v3/role_assignments?user.id=4cd76a442c2f4c759e7438031d5d6aca&scope.project.id=4fcadeae44cc4547905b83bfebec79c7&role.id=d8aa93d29788400a97d04db10d8fb8d5 => generated 608 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:11.690038 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690100b-42d8-4493-b579-6b8060aff7ad None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:11.750422 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad321c12-5224-4654-a253-0cbce0292f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:11.751179 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad321c12-5224-4654-a253-0cbce0292f62 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:11.751463 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad321c12-5224-4654-a253-0cbce0292f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:11.751738 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad321c12-5224-4654-a253-0cbce0292f62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:11.766934 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad321c12-5224-4654-a253-0cbce0292f62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:11.768512 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad321c12-5224-4654-a253-0cbce0292f62 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:11.786773 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128608b-ca23-4f78-bb01-d751bec87fd5 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:11.787090 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128608b-ca23-4f78-bb01-d751bec87fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:11.787341 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128608b-ca23-4f78-bb01-d751bec87fd5 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:11.789097 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 345/688] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:06:11.790928 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-ad321c12-5224-4654-a253-0cbce0292f62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:11.790928 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:11.790928 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:11.790928 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:11.790928 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:11.790928 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:11.790928 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:11.790928 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:11.790928 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:11.790928 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:11.790928 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:11.790928 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:11.790928 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:11.790928 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:11.790928 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:11.791893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:11.791893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:11.791893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:11.791893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:11.791893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:11.791893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:11.791893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:11.791893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:11.791893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:11.791893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:11.791893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:11.791893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:11.791893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:11.791893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:11.791893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:11.791893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:11.791893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:11.792805 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:11.792805 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:11.792805 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:11.792805 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:11.792805 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:11.792805 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:11.792805 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:11.792805 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:11.792805 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 344/689] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:11.798051 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128608b-ca23-4f78-bb01-d751bec87fd5 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:11.802145 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f9533-992f-44d7-b0b2-9438dd04b31d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:11.802772 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f9533-992f-44d7-b0b2-9438dd04b31d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:11.803060 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f9533-992f-44d7-b0b2-9438dd04b31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:11.828793 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a65f9533-992f-44d7-b0b2-9438dd04b31d None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:11.830465 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a65f9533-992f-44d7-b0b2-9438dd04b31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:11.923095 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 345/690] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:06:11.932042 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128608b-ca23-4f78-bb01-d751bec87fd5 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:11.962655 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f9533-992f-44d7-b0b2-9438dd04b31d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:11.971839 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a75ae-cecf-4adc-b9a8-8dfadf69e01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:11.972516 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a75ae-cecf-4adc-b9a8-8dfadf69e01d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:11.972862 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a75ae-cecf-4adc-b9a8-8dfadf69e01d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:11.973143 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a75ae-cecf-4adc-b9a8-8dfadf69e01d None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:11.974101 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a75ae-cecf-4adc-b9a8-8dfadf69e01d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:11.974420 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a75ae-cecf-4adc-b9a8-8dfadf69e01d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:11.975898 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a75ae-cecf-4adc-b9a8-8dfadf69e01d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:11.991641 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 346/691] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:06:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:11.998511 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a75ae-cecf-4adc-b9a8-8dfadf69e01d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:12.097150 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f9533-992f-44d7-b0b2-9438dd04b31d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:12.114084 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a75ae-cecf-4adc-b9a8-8dfadf69e01d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:12.153418 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b2eed-534e-4d2a-84c5-bd5d2f2ef56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:12.155388 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b2eed-534e-4d2a-84c5-bd5d2f2ef56c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:12.156149 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b2eed-534e-4d2a-84c5-bd5d2f2ef56c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:12.156874 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b2eed-534e-4d2a-84c5-bd5d2f2ef56c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:12.157461 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0c8e4-29e6-4d52-9dbb-63e18916816c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:12.158276 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0c8e4-29e6-4d52-9dbb-63e18916816c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:12.158751 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0c8e4-29e6-4d52-9dbb-63e18916816c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:12.159224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0c8e4-29e6-4d52-9dbb-63e18916816c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:12.160254 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0c8e4-29e6-4d52-9dbb-63e18916816c None admin] RBAC: Adding query filter params (role.id=d8aa93d29788400a97d04db10d8fb8d5, scope.project.id=4fcadeae44cc4547905b83bfebec79c7, user.id=0b1f03accd91471ea1fe78073c86a97f) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:12.160743 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0c8e4-29e6-4d52-9dbb-63e18916816c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:12.163106 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0c8e4-29e6-4d52-9dbb-63e18916816c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:12.171684 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 347/692] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:06:11 2022] GET /identity/v3/role_assignments?user.id=0b1f03accd91471ea1fe78073c86a97f&scope.project.id=4fcadeae44cc4547905b83bfebec79c7&role.id=d8aa93d29788400a97d04db10d8fb8d5 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:12.178020 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b2eed-534e-4d2a-84c5-bd5d2f2ef56c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:06:12.193240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-6e8b2eed-534e-4d2a-84c5-bd5d2f2ef56c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:06:12.193240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:12.193240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:12.193240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:12.193240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:12.193240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:12.193240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:12.193240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:12.193240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:12.193240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:12.193240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:12.193240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:12.193240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:06:12.193240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:06:12.193240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:06:12.193240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:06:12.194453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:06:12.194453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:06:12.194453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:06:12.194453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:06:12.194453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:12.194453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:12.194453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:12.194453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:12.194453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:12.194453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:12.194453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:12.194453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:12.194453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:12.194453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:12.194453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:12.194453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:12.195383 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:12.195383 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:12.195383 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:12.195383 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:12.195383 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:06:12.195383 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:06:12.195383 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:06:12.195383 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:06:12.195383 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:06:12.195383 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:06:12.195383 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:06:12.195383 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:12.197662 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 346/693] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:06:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:12.205458 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0c8e4-29e6-4d52-9dbb-63e18916816c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:12.354304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0c8e4-29e6-4d52-9dbb-63e18916816c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:12.402272 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbce15-5b52-473b-b9c9-a1bc195a990e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:12.403508 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbce15-5b52-473b-b9c9-a1bc195a990e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:12.404045 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbce15-5b52-473b-b9c9-a1bc195a990e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:12.404575 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbce15-5b52-473b-b9c9-a1bc195a990e None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:12.405639 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbce15-5b52-473b-b9c9-a1bc195a990e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:12.406211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbce15-5b52-473b-b9c9-a1bc195a990e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:12.408007 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbce15-5b52-473b-b9c9-a1bc195a990e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:12.432977 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 348/694] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:06:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:12.439690 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b2eed-534e-4d2a-84c5-bd5d2f2ef56c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:12.620443 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b2eed-534e-4d2a-84c5-bd5d2f2ef56c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:12.665078 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14e4bd-c6bf-413c-b890-c171544f1632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:12.665962 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14e4bd-c6bf-413c-b890-c171544f1632 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:12.666246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14e4bd-c6bf-413c-b890-c171544f1632 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:12.666532 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14e4bd-c6bf-413c-b890-c171544f1632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:12.681066 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14e4bd-c6bf-413c-b890-c171544f1632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:12.682688 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14e4bd-c6bf-413c-b890-c171544f1632 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:12.705439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-dc14e4bd-c6bf-413c-b890-c171544f1632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:12.705439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:12.705439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:12.705439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:12.705439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:12.705439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:12.705439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:12.705439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:12.705439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:12.705439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:12.705439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:12.705439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:12.705439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:12.705439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:12.705439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:12.706823 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:12.706823 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:12.706823 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:12.706823 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:12.706823 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:12.706823 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:12.706823 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:12.706823 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:12.706823 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:12.706823 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:12.706823 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:12.706823 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:12.706823 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:12.706823 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:12.706823 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:12.706823 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:12.706823 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:12.707747 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:12.707747 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:12.707747 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:12.707747 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:12.707747 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 347/695] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:12.713864 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbce15-5b52-473b-b9c9-a1bc195a990e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:12.839625 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbce15-5b52-473b-b9c9-a1bc195a990e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:12.880984 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826746e3-c271-469e-baa4-20e42f9e2eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:12.882054 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826746e3-c271-469e-baa4-20e42f9e2eee None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:12.882603 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826746e3-c271-469e-baa4-20e42f9e2eee None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:12.884335 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826746e3-c271-469e-baa4-20e42f9e2eee None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:12.885516 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826746e3-c271-469e-baa4-20e42f9e2eee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:12.886046 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826746e3-c271-469e-baa4-20e42f9e2eee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:12.887705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826746e3-c271-469e-baa4-20e42f9e2eee None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:12.903183 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 349/696] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:12.909185 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14e4bd-c6bf-413c-b890-c171544f1632 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:13.029659 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14e4bd-c6bf-413c-b890-c171544f1632 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:13.073956 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccd54d-0680-4303-9a50-7574419b13f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:13.074816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccd54d-0680-4303-9a50-7574419b13f9 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:13.075096 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccd54d-0680-4303-9a50-7574419b13f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:13.075413 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccd54d-0680-4303-9a50-7574419b13f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:13.084147 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccd54d-0680-4303-9a50-7574419b13f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:13.085654 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccd54d-0680-4303-9a50-7574419b13f9 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:13.102839 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-d6ccd54d-0680-4303-9a50-7574419b13f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:06:13.102839 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:13.102839 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:13.102839 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:13.102839 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:13.102839 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:13.102839 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:13.102839 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:13.102839 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:13.102839 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:13.102839 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:13.102839 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:13.102839 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:13.102839 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:13.102839 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:13.102839 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:13.103993 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:13.103993 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:13.103993 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:13.103993 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:13.103993 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:13.103993 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:13.103993 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:13.103993 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:13.103993 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:13.103993 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:13.103993 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:13.103993 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:13.103993 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:13.103993 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:13.103993 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:13.103993 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:13.103993 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:13.103993 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:13.104980 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:13.104980 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:13.104980 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:13.104980 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:13.104980 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:13.104980 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:13.104980 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:13.104980 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:13.104980 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:06:13.104980 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:13.104980 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 348/697] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:06:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:13.110561 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826746e3-c271-469e-baa4-20e42f9e2eee None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:13.251911 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826746e3-c271-469e-baa4-20e42f9e2eee None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:13.301413 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b69bb-64b8-4c22-bb2a-acb0c553335b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:13.302165 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b69bb-64b8-4c22-bb2a-acb0c553335b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:13.302460 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b69bb-64b8-4c22-bb2a-acb0c553335b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:13.302794 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b69bb-64b8-4c22-bb2a-acb0c553335b None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:13.303745 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b69bb-64b8-4c22-bb2a-acb0c553335b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:13.304137 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b69bb-64b8-4c22-bb2a-acb0c553335b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:13.307088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b69bb-64b8-4c22-bb2a-acb0c553335b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:13.331171 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 350/698] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:06:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:13.336945 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccd54d-0680-4303-9a50-7574419b13f9 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:13.519513 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccd54d-0680-4303-9a50-7574419b13f9 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:13.553529 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45609ebf-cfde-4f82-8971-69924424007d None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:13.554135 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45609ebf-cfde-4f82-8971-69924424007d None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:13.554442 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45609ebf-cfde-4f82-8971-69924424007d None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:13.557209 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 351/699] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:13.563641 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d048e-469f-468a-a8d8-ea41093f261e None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:13.564052 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d048e-469f-468a-a8d8-ea41093f261e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:13.564332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d048e-469f-468a-a8d8-ea41093f261e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:13.590599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a22ef-5f24-4ca8-974e-65f4dbbbb2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:13.591638 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a22ef-5f24-4ca8-974e-65f4dbbbb2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:13.592120 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a22ef-5f24-4ca8-974e-65f4dbbbb2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:13.592589 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a22ef-5f24-4ca8-974e-65f4dbbbb2f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:13.594732 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-877d048e-469f-468a-a8d8-ea41093f261e None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:13.597963 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-877d048e-469f-468a-a8d8-ea41093f261e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:13.717767 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 352/700] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:06:13.718500 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a22ef-5f24-4ca8-974e-65f4dbbbb2f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:13.720430 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a22ef-5f24-4ca8-974e-65f4dbbbb2f7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:13.753042 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d048e-469f-468a-a8d8-ea41093f261e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:13.877145 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d048e-469f-468a-a8d8-ea41093f261e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:13.920020 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31e9d8-9673-4d14-a961-f6a79dde935e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:13.921803 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31e9d8-9673-4d14-a961-f6a79dde935e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:13.922373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31e9d8-9673-4d14-a961-f6a79dde935e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:13.922873 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31e9d8-9673-4d14-a961-f6a79dde935e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:13.923734 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31e9d8-9673-4d14-a961-f6a79dde935e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:13.925399 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31e9d8-9673-4d14-a961-f6a79dde935e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:13.942405 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-9e31e9d8-9673-4d14-a961-f6a79dde935e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:06:13.942405 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:13.942405 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:06:13.942405 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:06:13.942405 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:06:13.942405 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:06:13.942405 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:06:13.942405 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:13.942405 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:06:13.942405 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:13.942405 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:13.942405 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:13.942405 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:13.942405 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:13.942405 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:13.942405 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:13.943604 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:13.943604 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:13.943604 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:13.943604 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:13.943604 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:13.943604 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:13.943604 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:13.943604 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:06:13.943604 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:06:13.943604 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:06:13.943604 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:06:13.943604 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:13.943604 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:13.943604 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:13.943604 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:13.943604 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:13.944497 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:13.944497 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:13.944497 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:13.944497 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:13.944497 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:13.944497 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:13.944497 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:13.944497 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:13.944497 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:13.944497 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:13.944497 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:13.944497 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:06:13.944497 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:13.944497 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:06:13.944497 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:13.947199 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 353/701] 10.222.0.48 () {56 vars in 1129 bytes} [Mon May 9 15:06:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:13.954357 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31e9d8-9673-4d14-a961-f6a79dde935e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:13.956289 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 349/702] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:06:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:06:13.967959 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a22ef-5f24-4ca8-974e-65f4dbbbb2f7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:14.100586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a22ef-5f24-4ca8-974e-65f4dbbbb2f7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:14.152000 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72271758-bcc1-47c0-a9b5-46a4e6823728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:14.153804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72271758-bcc1-47c0-a9b5-46a4e6823728 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:14.154342 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72271758-bcc1-47c0-a9b5-46a4e6823728 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:14.155302 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72271758-bcc1-47c0-a9b5-46a4e6823728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:14.158051 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31e9d8-9673-4d14-a961-f6a79dde935e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:14.184039 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72271758-bcc1-47c0-a9b5-46a4e6823728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:14.185727 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72271758-bcc1-47c0-a9b5-46a4e6823728 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:14.204947 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-72271758-bcc1-47c0-a9b5-46a4e6823728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:14.204947 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:14.204947 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:14.204947 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:14.204947 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:14.204947 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:14.204947 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:14.204947 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:14.204947 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:14.204947 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:14.204947 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:14.204947 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:14.204947 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:14.204947 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:14.204947 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:14.206139 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:14.206139 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:14.206139 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:14.206139 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:14.206139 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:14.206139 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:14.206139 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:14.206139 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:14.206139 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:14.206139 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:14.206139 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:14.206139 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:14.206139 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:14.206139 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:14.206139 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:14.206139 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:14.206139 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:14.207269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:14.207269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:14.207269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:14.207269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:14.208197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61b125-fe41-4c6d-a668-1b55371a791e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:14.209071 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61b125-fe41-4c6d-a668-1b55371a791e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:14.209521 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61b125-fe41-4c6d-a668-1b55371a791e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:14.209930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61b125-fe41-4c6d-a668-1b55371a791e None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:14.210772 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61b125-fe41-4c6d-a668-1b55371a791e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:14.211711 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61b125-fe41-4c6d-a668-1b55371a791e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:14.213251 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61b125-fe41-4c6d-a668-1b55371a791e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:14.214375 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 350/703] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:14.216140 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739bcee-24ff-4b1b-ada4-6cdcbdfa9c13 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:14.216571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739bcee-24ff-4b1b-ada4-6cdcbdfa9c13 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:14.216980 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739bcee-24ff-4b1b-ada4-6cdcbdfa9c13 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:14.218757 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 351/704] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:14.220627 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 354/705] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 9 15:06:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:14.226041 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61b125-fe41-4c6d-a668-1b55371a791e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:14.227374 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739bcee-24ff-4b1b-ada4-6cdcbdfa9c13 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:14.365952 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739bcee-24ff-4b1b-ada4-6cdcbdfa9c13 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:14.394215 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61b125-fe41-4c6d-a668-1b55371a791e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:14.413905 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a0cc4-ba92-4701-8cbf-419b9003a537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:14.414778 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a0cc4-ba92-4701-8cbf-419b9003a537 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:14.415263 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a0cc4-ba92-4701-8cbf-419b9003a537 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:14.415617 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a0cc4-ba92-4701-8cbf-419b9003a537 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:14.416495 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a0cc4-ba92-4701-8cbf-419b9003a537 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:14.416878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a0cc4-ba92-4701-8cbf-419b9003a537 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:14.418485 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a0cc4-ba92-4701-8cbf-419b9003a537 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:14.435360 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 352/706] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:14.441605 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aebcbb-7a3d-405b-b5d0-e33658f55f10 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:14.441850 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aebcbb-7a3d-405b-b5d0-e33658f55f10 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:14.442241 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aebcbb-7a3d-405b-b5d0-e33658f55f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:14.462041 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226c1f7-2ba4-461a-9e65-48ba4dcc44b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:14.463216 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-00aebcbb-7a3d-405b-b5d0-e33658f55f10 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:14.464162 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226c1f7-2ba4-461a-9e65-48ba4dcc44b0 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:14.464656 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-00aebcbb-7a3d-405b-b5d0-e33658f55f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:14.465343 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226c1f7-2ba4-461a-9e65-48ba4dcc44b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:14.465920 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226c1f7-2ba4-461a-9e65-48ba4dcc44b0 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:14.467665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226c1f7-2ba4-461a-9e65-48ba4dcc44b0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:14.469808 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226c1f7-2ba4-461a-9e65-48ba4dcc44b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:14.471353 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226c1f7-2ba4-461a-9e65-48ba4dcc44b0 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:14.488610 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 355/707] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 9 15:06:14 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:14.490085 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226c1f7-2ba4-461a-9e65-48ba4dcc44b0 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:14.672270 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226c1f7-2ba4-461a-9e65-48ba4dcc44b0 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:14.676171 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 353/708] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:06:14.733246 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2b33e-b0ae-4fbc-a613-038b104c303e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:14.734602 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2b33e-b0ae-4fbc-a613-038b104c303e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:14.735378 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2b33e-b0ae-4fbc-a613-038b104c303e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:14.735783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aebcbb-7a3d-405b-b5d0-e33658f55f10 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:14.736442 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2b33e-b0ae-4fbc-a613-038b104c303e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:14.754420 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2b33e-b0ae-4fbc-a613-038b104c303e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:14.756090 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2b33e-b0ae-4fbc-a613-038b104c303e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:14.776949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-19e2b33e-b0ae-4fbc-a613-038b104c303e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:14.776949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:14.776949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:14.776949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:14.776949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:14.776949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:14.776949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:14.776949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:14.776949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:14.776949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:14.776949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:14.776949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:14.776949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:14.776949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:14.776949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:14.777970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:14.777970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:14.777970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:14.777970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:14.777970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:14.777970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:14.777970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:14.777970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:14.777970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:14.777970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:14.777970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:14.777970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:14.777970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:14.777970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:14.777970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:14.777970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:14.777970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:14.778878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:14.778878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:14.778878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:14.778878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:14.778878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:14.778878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:14.778878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:14.778878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:14.778878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 356/709] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:14.791294 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2b33e-b0ae-4fbc-a613-038b104c303e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:14.868909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aebcbb-7a3d-405b-b5d0-e33658f55f10 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:14.921588 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084b269-9002-485b-9865-7aa47a1822c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:14.922506 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084b269-9002-485b-9865-7aa47a1822c1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:14.922741 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084b269-9002-485b-9865-7aa47a1822c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:14.923013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084b269-9002-485b-9865-7aa47a1822c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:14.942453 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2b33e-b0ae-4fbc-a613-038b104c303e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:14.947076 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084b269-9002-485b-9865-7aa47a1822c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:14.948719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084b269-9002-485b-9865-7aa47a1822c1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:14.979400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-c084b269-9002-485b-9865-7aa47a1822c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:14.979400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:14.979400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:14.979400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:14.979400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:14.979400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:14.979400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:14.979400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:14.979400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:14.979400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:14.979400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:14.979400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:14.979400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:14.979400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:14.979400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:14.981047 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:14.981047 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:14.981047 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:14.981047 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:14.981047 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:14.981047 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:14.981047 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:14.981047 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:14.981047 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:14.981047 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:14.981047 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:14.981047 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:14.981047 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:14.981047 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:14.981047 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:14.981047 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:14.981047 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:14.981996 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:14.981996 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:14.981996 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:14.981996 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:14.990282 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 354/710] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:14.993821 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3147e3-bbe1-45dc-9e81-c1cb23434446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:14.994508 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3147e3-bbe1-45dc-9e81-c1cb23434446 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:14.994788 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3147e3-bbe1-45dc-9e81-c1cb23434446 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:14.995060 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3147e3-bbe1-45dc-9e81-c1cb23434446 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:14.995863 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3147e3-bbe1-45dc-9e81-c1cb23434446 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:14.996168 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3147e3-bbe1-45dc-9e81-c1cb23434446 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:14.997645 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3147e3-bbe1-45dc-9e81-c1cb23434446 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:15.010322 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084b269-9002-485b-9865-7aa47a1822c1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:15.020503 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 357/711] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:06:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:15.028936 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3147e3-bbe1-45dc-9e81-c1cb23434446 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:15.152960 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084b269-9002-485b-9865-7aa47a1822c1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:15.184153 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3147e3-bbe1-45dc-9e81-c1cb23434446 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:15.193989 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c48647-497d-4164-9ab1-f4d5e702b8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:15.194696 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c48647-497d-4164-9ab1-f4d5e702b8cb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:15.195005 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c48647-497d-4164-9ab1-f4d5e702b8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:15.195469 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c48647-497d-4164-9ab1-f4d5e702b8cb None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:15.197359 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c48647-497d-4164-9ab1-f4d5e702b8cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:15.198380 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c48647-497d-4164-9ab1-f4d5e702b8cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:15.202198 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c48647-497d-4164-9ab1-f4d5e702b8cb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:15.222755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 355/712] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:15.225493 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29b675-86bf-4d5d-99c1-70f23ccc8d91 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:15.226162 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29b675-86bf-4d5d-99c1-70f23ccc8d91 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:15.227287 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29b675-86bf-4d5d-99c1-70f23ccc8d91 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:15.229630 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 356/713] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:15.233677 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29b675-86bf-4d5d-99c1-70f23ccc8d91 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:15.236026 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3e47d-01f2-4b4a-82be-e9deca2346f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:15.236695 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3e47d-01f2-4b4a-82be-e9deca2346f7 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:15.237011 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3e47d-01f2-4b4a-82be-e9deca2346f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:15.237246 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3e47d-01f2-4b4a-82be-e9deca2346f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:15.238099 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3e47d-01f2-4b4a-82be-e9deca2346f7 None admin] RBAC: Adding query filter params (role.id=3409f00ead9e455182684faa27b1f8f0, scope.project.id=4fcadeae44cc4547905b83bfebec79c7, user.id=65e7a4e661ef4425b24844c3500b0b58) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:15.238406 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3e47d-01f2-4b4a-82be-e9deca2346f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:15.239838 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3e47d-01f2-4b4a-82be-e9deca2346f7 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:15.247513 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 358/714] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:06:15 2022] GET /identity/v3/role_assignments?user.id=65e7a4e661ef4425b24844c3500b0b58&scope.project.id=4fcadeae44cc4547905b83bfebec79c7&role.id=3409f00ead9e455182684faa27b1f8f0 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:15.248930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2073e4-d9c3-4fab-96d6-ee72becda65f None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:15.249227 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2073e4-d9c3-4fab-96d6-ee72becda65f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:15.249526 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2073e4-d9c3-4fab-96d6-ee72becda65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:15.287529 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-fc2073e4-d9c3-4fab-96d6-ee72becda65f None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:15.288801 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-fc2073e4-d9c3-4fab-96d6-ee72becda65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:15.429472 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 359/715] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:06:15.443219 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29b675-86bf-4d5d-99c1-70f23ccc8d91 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:15.470286 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2073e4-d9c3-4fab-96d6-ee72becda65f None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:15.534236 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf17214-d546-4bac-a8f1-a07c32e8f327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:15.535003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf17214-d546-4bac-a8f1-a07c32e8f327 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:15.535307 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf17214-d546-4bac-a8f1-a07c32e8f327 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:15.535614 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf17214-d546-4bac-a8f1-a07c32e8f327 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:15.536420 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf17214-d546-4bac-a8f1-a07c32e8f327 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:15.538086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf17214-d546-4bac-a8f1-a07c32e8f327 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:15.585321 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 357/716] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:06:15 2022] POST /identity/v3/users => generated 254 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:06:15.618877 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2073e4-d9c3-4fab-96d6-ee72becda65f None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:15.681705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b080c0-ac8d-4054-a8c4-a732552830b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:15.682737 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b080c0-ac8d-4054-a8c4-a732552830b8 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:15.683105 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b080c0-ac8d-4054-a8c4-a732552830b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:15.683450 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b080c0-ac8d-4054-a8c4-a732552830b8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:15.684257 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b080c0-ac8d-4054-a8c4-a732552830b8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:15.685928 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b080c0-ac8d-4054-a8c4-a732552830b8 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:15.706194 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-d4b080c0-ac8d-4054-a8c4-a732552830b8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:06:15.706194 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:15.706194 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:06:15.706194 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:06:15.706194 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:06:15.706194 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:06:15.706194 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:06:15.706194 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:15.706194 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:06:15.706194 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:15.706194 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:15.706194 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:15.706194 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:15.706194 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:15.706194 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:15.706194 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:15.706194 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:15.707257 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:15.707257 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:15.707257 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:15.707257 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:15.707257 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:15.707257 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:15.707257 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:06:15.707257 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:06:15.707257 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:06:15.707257 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:06:15.707257 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:15.707257 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:15.707257 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:15.707257 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:15.707257 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:15.707257 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:15.708167 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:15.708167 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:15.708167 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:15.708167 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:15.708167 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:15.708167 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:15.708167 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:15.708167 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:15.708167 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:15.708167 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:15.708167 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:06:15.708167 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:15.708167 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:06:15.708167 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:15.711434 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 360/717] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:15 2022] GET /identity/v3/services/network => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:15.718764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf17214-d546-4bac-a8f1-a07c32e8f327 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:15.898426 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf17214-d546-4bac-a8f1-a07c32e8f327 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:15.944659 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4c450-05af-400c-94ed-c012b3312181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:15.945437 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4c450-05af-400c-94ed-c012b3312181 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:15.946468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4c450-05af-400c-94ed-c012b3312181 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:15.946760 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4c450-05af-400c-94ed-c012b3312181 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:15.947487 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4c450-05af-400c-94ed-c012b3312181 None admin] RBAC: Adding query filter params (name=network) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:15.947804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4c450-05af-400c-94ed-c012b3312181 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:15.949203 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4c450-05af-400c-94ed-c012b3312181 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:15.955240 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee75e10-bff5-4f72-9e6d-d82ce247996d None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:15.955623 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee75e10-bff5-4f72-9e6d-d82ce247996d None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:15.955868 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 358/718] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:06:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:15.956024 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee75e10-bff5-4f72-9e6d-d82ce247996d None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:15.960517 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 361/719] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:06:15.962157 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4c450-05af-400c-94ed-c012b3312181 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:15.965388 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fb7a5-c648-4cca-aaa5-67171c301940 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:15.965688 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fb7a5-c648-4cca-aaa5-67171c301940 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:15.965971 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fb7a5-c648-4cca-aaa5-67171c301940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:15.988970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-498fb7a5-c648-4cca-aaa5-67171c301940 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:15.990198 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-498fb7a5-c648-4cca-aaa5-67171c301940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:16.079242 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 362/720] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:06:16.105179 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4c450-05af-400c-94ed-c012b3312181 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:16.115133 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fb7a5-c648-4cca-aaa5-67171c301940 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:16.165540 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f0e5a-10bf-4eac-a9b7-825ce0538549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:16.167581 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f0e5a-10bf-4eac-a9b7-825ce0538549 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:16.168132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f0e5a-10bf-4eac-a9b7-825ce0538549 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:16.169143 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f0e5a-10bf-4eac-a9b7-825ce0538549 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:16.170802 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f0e5a-10bf-4eac-a9b7-825ce0538549 None admin] RBAC: Adding query filter params (type=network) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:16.171690 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f0e5a-10bf-4eac-a9b7-825ce0538549 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:16.174364 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f0e5a-10bf-4eac-a9b7-825ce0538549 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:16.183700 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 359/721] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:06:15 2022] GET /identity/v3/services?type=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:16.267260 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fb7a5-c648-4cca-aaa5-67171c301940 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:16.320645 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0779a38-0d72-40d9-977f-5c5f6366b771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:16.322291 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0779a38-0d72-40d9-977f-5c5f6366b771 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:16.322896 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0779a38-0d72-40d9-977f-5c5f6366b771 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:16.323480 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0779a38-0d72-40d9-977f-5c5f6366b771 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:16.338577 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0779a38-0d72-40d9-977f-5c5f6366b771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:06:16.348295 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-a0779a38-0d72-40d9-977f-5c5f6366b771 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:06:16.348295 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:16.348295 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:16.348295 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:16.348295 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:16.348295 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:16.348295 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:16.348295 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:16.348295 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:16.348295 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:16.348295 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:16.348295 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:16.348295 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:06:16.348295 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:06:16.348295 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:06:16.348295 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:06:16.349686 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:06:16.349686 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:06:16.349686 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:06:16.349686 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:06:16.349686 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:16.349686 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:16.349686 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:16.349686 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:16.349686 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:16.349686 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:16.349686 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:16.349686 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:16.349686 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:16.349686 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:16.349686 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:16.349686 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:16.350769 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:16.350769 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:16.350769 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:16.350769 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:16.350769 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:06:16.350769 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:06:16.350769 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:06:16.350769 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:06:16.350769 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:06:16.350769 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:06:16.350769 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:06:16.350769 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:16.361088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 363/722] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:06:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:16.362988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f0e5a-10bf-4eac-a9b7-825ce0538549 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:16.500410 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f0e5a-10bf-4eac-a9b7-825ce0538549 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:16.548258 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5938963-0d22-4c6f-80df-238d220f91e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:16.548891 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5938963-0d22-4c6f-80df-238d220f91e2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:16.549173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5938963-0d22-4c6f-80df-238d220f91e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:16.549481 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5938963-0d22-4c6f-80df-238d220f91e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:16.550255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5938963-0d22-4c6f-80df-238d220f91e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:16.550572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5938963-0d22-4c6f-80df-238d220f91e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:16.552123 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5938963-0d22-4c6f-80df-238d220f91e2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:16.568715 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 360/723] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:06:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:16.571642 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0779a38-0d72-40d9-977f-5c5f6366b771 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:16.693764 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0779a38-0d72-40d9-977f-5c5f6366b771 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:16.742740 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de08eb0-12df-4d73-a0c4-8728acf97cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:16.743793 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de08eb0-12df-4d73-a0c4-8728acf97cfb None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:16.744106 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de08eb0-12df-4d73-a0c4-8728acf97cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:16.744446 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de08eb0-12df-4d73-a0c4-8728acf97cfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:16.762607 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de08eb0-12df-4d73-a0c4-8728acf97cfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:16.764155 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de08eb0-12df-4d73-a0c4-8728acf97cfb None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:16.784260 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-1de08eb0-12df-4d73-a0c4-8728acf97cfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:16.784260 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:16.784260 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:16.784260 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:16.784260 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:16.784260 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:16.784260 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:16.784260 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:16.784260 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:16.784260 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:16.784260 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:16.784260 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:16.784260 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:16.784260 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:16.784260 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:16.785268 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:16.785268 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:16.785268 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:16.785268 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:16.785268 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:16.785268 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:16.785268 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:16.785268 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:16.785268 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:16.785268 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:16.785268 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:16.785268 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:16.785268 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:16.785268 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:16.785268 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:16.785268 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:16.785268 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:16.786245 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:16.786245 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:16.786245 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:16.786245 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:16.789520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 364/724] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:16.794013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5938963-0d22-4c6f-80df-238d220f91e2 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:16.993428 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5938963-0d22-4c6f-80df-238d220f91e2 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:17.046200 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a62073-412c-485a-9670-a2877cd2cb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:17.047289 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a62073-412c-485a-9670-a2877cd2cb0f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:17.047798 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a62073-412c-485a-9670-a2877cd2cb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:17.048276 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a62073-412c-485a-9670-a2877cd2cb0f None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:17.049233 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a62073-412c-485a-9670-a2877cd2cb0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:17.049786 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a62073-412c-485a-9670-a2877cd2cb0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:17.051407 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a62073-412c-485a-9670-a2877cd2cb0f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:17.072597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 361/725] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:17.079005 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de08eb0-12df-4d73-a0c4-8728acf97cfb None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:17.224661 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de08eb0-12df-4d73-a0c4-8728acf97cfb None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:17.269548 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca30fa2-53dd-4466-a660-efad5054e4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:17.270719 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca30fa2-53dd-4466-a660-efad5054e4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:17.271032 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca30fa2-53dd-4466-a660-efad5054e4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:17.271401 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca30fa2-53dd-4466-a660-efad5054e4a9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:17.281284 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca30fa2-53dd-4466-a660-efad5054e4a9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:17.282873 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca30fa2-53dd-4466-a660-efad5054e4a9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:17.299831 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-4ca30fa2-53dd-4466-a660-efad5054e4a9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:06:17.299831 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:17.299831 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:17.299831 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:17.299831 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:17.299831 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:17.299831 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:17.299831 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:17.299831 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:17.299831 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:17.299831 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:17.299831 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:17.299831 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:17.299831 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:17.299831 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:17.299831 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:17.300878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:17.300878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:17.300878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:17.300878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:17.300878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:17.300878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:17.300878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:17.300878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:17.300878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:17.300878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:17.300878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:17.300878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:17.300878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:17.300878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:17.300878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:17.300878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:17.300878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:17.300878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:17.301950 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:17.301950 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:17.301950 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:17.301950 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:17.301950 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:17.301950 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:17.301950 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:17.301950 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:17.301950 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:06:17.301950 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:17.305788 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 365/726] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:06:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:17.308875 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a62073-412c-485a-9670-a2877cd2cb0f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:17.505337 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a62073-412c-485a-9670-a2877cd2cb0f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:17.551160 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0705e7-8e82-4976-bdb9-d2954ed251d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:17.552250 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0705e7-8e82-4976-bdb9-d2954ed251d7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:17.552750 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0705e7-8e82-4976-bdb9-d2954ed251d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:17.553255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0705e7-8e82-4976-bdb9-d2954ed251d7 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:17.554371 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0705e7-8e82-4976-bdb9-d2954ed251d7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:17.555677 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0705e7-8e82-4976-bdb9-d2954ed251d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:17.557452 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0705e7-8e82-4976-bdb9-d2954ed251d7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:17.579607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 362/727] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 9 15:06:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:17.586421 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca30fa2-53dd-4466-a660-efad5054e4a9 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:17.735579 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca30fa2-53dd-4466-a660-efad5054e4a9 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:17.786736 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400caca9-1d86-4b03-b065-d80dd050b7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:17.787867 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400caca9-1d86-4b03-b065-d80dd050b7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:17.788373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400caca9-1d86-4b03-b065-d80dd050b7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:17.789165 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400caca9-1d86-4b03-b065-d80dd050b7d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:17.813245 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9f806-5842-4161-9325-bad7907a561d None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:17.813876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9f806-5842-4161-9325-bad7907a561d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:17.814375 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9f806-5842-4161-9325-bad7907a561d None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:17.816203 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 363/728] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:17.823138 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c30a5b-1457-4753-8b26-9376b824560c None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:17.823757 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c30a5b-1457-4753-8b26-9376b824560c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:17.824237 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c30a5b-1457-4753-8b26-9376b824560c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:17.859432 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-23c30a5b-1457-4753-8b26-9376b824560c None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:17.861288 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-23c30a5b-1457-4753-8b26-9376b824560c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:17.892361 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400caca9-1d86-4b03-b065-d80dd050b7d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:17.894017 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400caca9-1d86-4b03-b065-d80dd050b7d4 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:18.020469 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 366/729] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:06:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:06:18.041031 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400caca9-1d86-4b03-b065-d80dd050b7d4 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:18.085162 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 364/730] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:06:18.122480 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c30a5b-1457-4753-8b26-9376b824560c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:18.185070 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400caca9-1d86-4b03-b065-d80dd050b7d4 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:18.249647 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63d530-87bb-4618-b0a5-9ee5e92bf86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:18.250926 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63d530-87bb-4618-b0a5-9ee5e92bf86c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:18.251357 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63d530-87bb-4618-b0a5-9ee5e92bf86c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:18.251856 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63d530-87bb-4618-b0a5-9ee5e92bf86c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:18.286267 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63d530-87bb-4618-b0a5-9ee5e92bf86c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:18.288473 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63d530-87bb-4618-b0a5-9ee5e92bf86c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:18.354907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-5b63d530-87bb-4618-b0a5-9ee5e92bf86c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:18.354907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:18.354907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:18.354907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:18.354907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:18.354907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:18.354907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:18.354907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:18.354907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:18.354907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:18.354907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:18.354907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:18.354907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:18.354907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:18.354907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:18.355861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:18.355861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:18.355861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:18.355861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:18.355861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:18.355861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:18.355861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:18.355861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:18.355861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:18.355861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:18.355861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:18.355861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:18.355861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:18.355861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:18.355861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:18.355861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:18.355861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:18.356803 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:18.356803 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:18.356803 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:18.356803 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:18.359228 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 367/731] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:18.366545 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63d530-87bb-4618-b0a5-9ee5e92bf86c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:18.407009 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c30a5b-1457-4753-8b26-9376b824560c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:18.454825 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce01a1d-459e-45c9-9c47-083333b8e09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:18.455686 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce01a1d-459e-45c9-9c47-083333b8e09b None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:18.456091 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce01a1d-459e-45c9-9c47-083333b8e09b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:18.456393 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce01a1d-459e-45c9-9c47-083333b8e09b None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:18.457253 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce01a1d-459e-45c9-9c47-083333b8e09b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:18.460071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce01a1d-459e-45c9-9c47-083333b8e09b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:18.494240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 365/732] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:06:18 2022] POST /identity/v3/services => generated 251 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:06:18.560690 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63d530-87bb-4618-b0a5-9ee5e92bf86c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:18.600910 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ba064-52aa-4123-ab32-1bf091b0b24b None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:18.601230 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ba064-52aa-4123-ab32-1bf091b0b24b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:18.602135 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ba064-52aa-4123-ab32-1bf091b0b24b None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:18.603956 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 366/733] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:06:18.610586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722ac20-6e7a-4505-a1ec-45c27fd0779e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:18.611201 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722ac20-6e7a-4505-a1ec-45c27fd0779e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:18.611681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7722ac20-6e7a-4505-a1ec-45c27fd0779e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:18.630913 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e829e-5b4e-4340-a84e-8cd76f6f3633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:18.631675 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e829e-5b4e-4340-a84e-8cd76f6f3633 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:18.631873 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e829e-5b4e-4340-a84e-8cd76f6f3633 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:18.632157 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e829e-5b4e-4340-a84e-8cd76f6f3633 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:18.633560 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-7722ac20-6e7a-4505-a1ec-45c27fd0779e None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:18.635199 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7722ac20-6e7a-4505-a1ec-45c27fd0779e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:18.637761 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e829e-5b4e-4340-a84e-8cd76f6f3633 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:18.638256 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e829e-5b4e-4340-a84e-8cd76f6f3633 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:18.639651 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e829e-5b4e-4340-a84e-8cd76f6f3633 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:18.658401 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 368/734] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:18.664646 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e829e-5b4e-4340-a84e-8cd76f6f3633 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:18.803457 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e829e-5b4e-4340-a84e-8cd76f6f3633 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:18.806780 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 367/735] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:06:18.834937 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722ac20-6e7a-4505-a1ec-45c27fd0779e None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:18.850542 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919ab86-7dc6-43d1-8f61-357e29a01464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:18.853261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919ab86-7dc6-43d1-8f61-357e29a01464 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:18.853749 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919ab86-7dc6-43d1-8f61-357e29a01464 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:18.854250 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919ab86-7dc6-43d1-8f61-357e29a01464 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:18.873076 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919ab86-7dc6-43d1-8f61-357e29a01464 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:18.877123 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919ab86-7dc6-43d1-8f61-357e29a01464 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:18.906721 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-c919ab86-7dc6-43d1-8f61-357e29a01464 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:18.906721 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:18.906721 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:18.906721 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:18.906721 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:18.906721 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:18.906721 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:18.906721 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:18.906721 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:18.906721 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:18.906721 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:18.906721 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:18.906721 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:18.906721 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:18.906721 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:18.908328 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:18.908328 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:18.908328 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:18.908328 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:18.908328 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:18.908328 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:18.908328 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:18.908328 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:18.908328 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:18.908328 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:18.908328 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:18.908328 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:18.908328 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:18.908328 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:18.908328 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:18.908328 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:18.908328 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:18.909856 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:18.909856 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:18.909856 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:18.909856 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:18.909856 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:18.909856 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:18.909856 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:18.909856 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:18.911101 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 369/736] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:18.918757 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919ab86-7dc6-43d1-8f61-357e29a01464 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:18.978561 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7722ac20-6e7a-4505-a1ec-45c27fd0779e None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:19.035303 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed7997-2af4-429c-a046-93c14b53dc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:19.036170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed7997-2af4-429c-a046-93c14b53dc37 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:19.036454 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed7997-2af4-429c-a046-93c14b53dc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:19.036729 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed7997-2af4-429c-a046-93c14b53dc37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:19.060265 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed7997-2af4-429c-a046-93c14b53dc37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:06:19.077297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-92ed7997-2af4-429c-a046-93c14b53dc37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:06:19.077297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:19.077297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:19.077297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:19.077297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:19.077297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:19.077297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:19.077297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:19.077297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:19.077297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:19.077297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:19.077297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:19.077297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:06:19.077297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:06:19.077297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:06:19.077297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:06:19.078664 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:06:19.078664 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:06:19.078664 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:06:19.078664 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:06:19.078664 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:19.078664 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:19.078664 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:19.078664 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:19.078664 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:19.078664 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:19.078664 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:19.078664 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:19.078664 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:19.078664 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:19.078664 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:19.078664 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:19.079668 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:19.079668 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:19.079668 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:19.079668 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:19.079668 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:06:19.079668 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:06:19.079668 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:06:19.079668 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:06:19.079668 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:06:19.079668 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:06:19.079668 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:06:19.079668 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:19.079668 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 368/737] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:06:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:19.086625 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed7997-2af4-429c-a046-93c14b53dc37 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:19.113727 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919ab86-7dc6-43d1-8f61-357e29a01464 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:19.164656 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7282266-a839-4c3e-933a-bcf8fd610557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:19.167494 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7282266-a839-4c3e-933a-bcf8fd610557 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:19.168203 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7282266-a839-4c3e-933a-bcf8fd610557 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:19.169299 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7282266-a839-4c3e-933a-bcf8fd610557 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:19.170441 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7282266-a839-4c3e-933a-bcf8fd610557 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:19.171490 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7282266-a839-4c3e-933a-bcf8fd610557 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:19.174963 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7282266-a839-4c3e-933a-bcf8fd610557 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:19.206859 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 370/738] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:06:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:19.215807 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7282266-a839-4c3e-933a-bcf8fd610557 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:19.291988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed7997-2af4-429c-a046-93c14b53dc37 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:19.329446 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548b9cd-49b7-46fe-ad3d-a87b583ad6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:19.330127 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548b9cd-49b7-46fe-ad3d-a87b583ad6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:19.330405 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548b9cd-49b7-46fe-ad3d-a87b583ad6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:19.330679 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548b9cd-49b7-46fe-ad3d-a87b583ad6f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:19.331435 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548b9cd-49b7-46fe-ad3d-a87b583ad6f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:19.331738 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548b9cd-49b7-46fe-ad3d-a87b583ad6f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:19.333218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548b9cd-49b7-46fe-ad3d-a87b583ad6f9 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:19.343600 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 369/739] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:06:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:19.349123 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548b9cd-49b7-46fe-ad3d-a87b583ad6f9 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:19.388981 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7282266-a839-4c3e-933a-bcf8fd610557 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:19.463528 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331de33b-8f7e-4e67-a6f5-a5a461ad9353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:19.464636 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331de33b-8f7e-4e67-a6f5-a5a461ad9353 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:19.465125 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331de33b-8f7e-4e67-a6f5-a5a461ad9353 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:19.465569 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331de33b-8f7e-4e67-a6f5-a5a461ad9353 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:19.466875 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331de33b-8f7e-4e67-a6f5-a5a461ad9353 None admin] RBAC: Adding query filter params (role.id=3409f00ead9e455182684faa27b1f8f0, scope.project.id=4fcadeae44cc4547905b83bfebec79c7, user.id=0b1f03accd91471ea1fe78073c86a97f) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:19.467436 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331de33b-8f7e-4e67-a6f5-a5a461ad9353 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:19.470247 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331de33b-8f7e-4e67-a6f5-a5a461ad9353 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:19.476391 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548b9cd-49b7-46fe-ad3d-a87b583ad6f9 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:19.479027 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 371/740] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:06:19 2022] GET /identity/v3/role_assignments?user.id=0b1f03accd91471ea1fe78073c86a97f&scope.project.id=4fcadeae44cc4547905b83bfebec79c7&role.id=3409f00ead9e455182684faa27b1f8f0 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:19.481272 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cc77b-4feb-4f4a-b218-1c52e73e6790 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:19.481771 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cc77b-4feb-4f4a-b218-1c52e73e6790 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:19.482092 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cc77b-4feb-4f4a-b218-1c52e73e6790 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:19.490601 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 372/741] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:19.494429 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03cedc-ea7e-4e69-aa32-72ac81b04d96 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:19.494838 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03cedc-ea7e-4e69-aa32-72ac81b04d96 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:19.495170 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03cedc-ea7e-4e69-aa32-72ac81b04d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:19.523101 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-7e03cedc-ea7e-4e69-aa32-72ac81b04d96 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:19.523351 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c339c3a-fb61-48d0-bd13-d238935ae82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:19.524162 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c339c3a-fb61-48d0-bd13-d238935ae82a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:19.524443 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c339c3a-fb61-48d0-bd13-d238935ae82a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:19.524713 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c339c3a-fb61-48d0-bd13-d238935ae82a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:19.525444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-7e03cedc-ea7e-4e69-aa32-72ac81b04d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:19.539706 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c339c3a-fb61-48d0-bd13-d238935ae82a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:19.541982 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c339c3a-fb61-48d0-bd13-d238935ae82a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:19.565786 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-3c339c3a-fb61-48d0-bd13-d238935ae82a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:19.565786 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:19.565786 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:19.565786 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:19.565786 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:19.565786 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:19.565786 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:19.565786 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:19.565786 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:19.565786 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:19.565786 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:19.565786 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:19.565786 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:19.565786 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:19.565786 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:19.567609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:19.567609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:19.567609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:19.567609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:19.567609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:19.567609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:19.567609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:19.567609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:19.567609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:19.567609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:19.567609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:19.567609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:19.567609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:19.567609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:19.567609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:19.567609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:19.567609 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:19.568531 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:19.568531 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:19.568531 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:19.568531 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:19.568531 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 370/742] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:19.580204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c339c3a-fb61-48d0-bd13-d238935ae82a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:19.639121 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 373/743] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:06:19.640861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8589506-0f7d-40b2-854c-25beca75b907 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:19.641155 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8589506-0f7d-40b2-854c-25beca75b907 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:19.641456 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8589506-0f7d-40b2-854c-25beca75b907 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:19.643175 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 374/744] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:19.654352 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d2f00-96cd-45d1-b029-7dc9661ea54d None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:19.657041 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d2f00-96cd-45d1-b029-7dc9661ea54d None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:19.657588 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d2f00-96cd-45d1-b029-7dc9661ea54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:19.686027 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-228d2f00-96cd-45d1-b029-7dc9661ea54d None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:19.687647 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-228d2f00-96cd-45d1-b029-7dc9661ea54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:19.742733 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c339c3a-fb61-48d0-bd13-d238935ae82a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:19.788247 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466610fd-247f-4c70-abd0-d794aaf9759d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:19.790240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466610fd-247f-4c70-abd0-d794aaf9759d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:19.790831 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466610fd-247f-4c70-abd0-d794aaf9759d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:19.791317 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466610fd-247f-4c70-abd0-d794aaf9759d None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:19.792312 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466610fd-247f-4c70-abd0-d794aaf9759d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:19.792805 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466610fd-247f-4c70-abd0-d794aaf9759d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:19.794853 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466610fd-247f-4c70-abd0-d794aaf9759d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:19.817546 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 371/745] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:19.818480 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466610fd-247f-4c70-abd0-d794aaf9759d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:19.822446 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 375/746] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:06:19.830524 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d2f00-96cd-45d1-b029-7dc9661ea54d None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:19.952319 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466610fd-247f-4c70-abd0-d794aaf9759d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:19.970761 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d2f00-96cd-45d1-b029-7dc9661ea54d None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:19.999551 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305873a-9284-410a-beef-3b51e913129f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:20.000370 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305873a-9284-410a-beef-3b51e913129f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:20.000652 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305873a-9284-410a-beef-3b51e913129f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:20.000968 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305873a-9284-410a-beef-3b51e913129f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:20.011424 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9373a7d-7f00-4616-98eb-fd9bf7020f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:20.012238 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9373a7d-7f00-4616-98eb-fd9bf7020f74 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:20.012528 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9373a7d-7f00-4616-98eb-fd9bf7020f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:20.012809 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9373a7d-7f00-4616-98eb-fd9bf7020f74 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:20.015614 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305873a-9284-410a-beef-3b51e913129f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:06:20.023066 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9373a7d-7f00-4616-98eb-fd9bf7020f74 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:20.024592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-4305873a-9284-410a-beef-3b51e913129f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:06:20.024592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:20.024592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:20.024592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:20.024592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:20.024592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:20.024592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:20.024592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:20.024592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:20.024592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:20.024592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:20.024592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:20.024592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:06:20.024592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:06:20.024592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:06:20.024592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:06:20.025728 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:06:20.025728 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:06:20.025728 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:06:20.025728 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:06:20.025728 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:20.025728 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:20.025728 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:20.025728 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:20.025728 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:20.025728 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:20.025728 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:20.025728 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:20.025728 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:20.025728 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:20.025728 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:20.025728 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:20.027818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:20.027818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:20.027818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:20.027818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:20.027818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:06:20.027818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:06:20.027818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:06:20.027818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:06:20.027818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:06:20.027818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:06:20.027818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:06:20.027818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:20.029527 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9373a7d-7f00-4616-98eb-fd9bf7020f74 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:20.029702 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 372/747] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:06:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:20.029702 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305873a-9284-410a-beef-3b51e913129f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:20.042959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-b9373a7d-7f00-4616-98eb-fd9bf7020f74 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:06:20.042959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:20.042959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:20.042959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:20.042959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:20.042959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:20.042959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:20.042959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:20.042959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:20.042959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:20.042959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:20.042959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:20.042959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:20.042959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:20.042959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:20.042959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:20.046107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:20.046107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:20.046107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:20.046107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:20.046107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:20.046107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:20.046107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:20.046107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:20.046107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:20.046107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:20.046107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:20.046107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:20.046107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:20.046107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:20.046107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:20.046107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:20.046107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:20.046107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:20.048777 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:20.048777 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:20.048777 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:20.048777 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:20.048777 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:20.048777 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:20.048777 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:20.048777 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:20.048777 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:06:20.048777 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:20.048777 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 376/748] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:06:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:20.048777 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9373a7d-7f00-4616-98eb-fd9bf7020f74 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:20.163217 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9373a7d-7f00-4616-98eb-fd9bf7020f74 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:20.165739 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305873a-9284-410a-beef-3b51e913129f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:20.208386 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea1e99-c7ef-44ec-83cc-e242108e0676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:20.208962 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea1e99-c7ef-44ec-83cc-e242108e0676 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:20.209248 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea1e99-c7ef-44ec-83cc-e242108e0676 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:20.209586 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea1e99-c7ef-44ec-83cc-e242108e0676 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:20.210358 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea1e99-c7ef-44ec-83cc-e242108e0676 None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:20.211202 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea1e99-c7ef-44ec-83cc-e242108e0676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:20.213038 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea1e99-c7ef-44ec-83cc-e242108e0676 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:20.220955 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10c9f2-21bf-46c7-9e7c-c223974056fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:20.222293 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10c9f2-21bf-46c7-9e7c-c223974056fc None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:20.228018 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 377/749] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:06:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:20.228018 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea1e99-c7ef-44ec-83cc-e242108e0676 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:20.228417 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10c9f2-21bf-46c7-9e7c-c223974056fc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:20.228417 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10c9f2-21bf-46c7-9e7c-c223974056fc None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:20.228417 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10c9f2-21bf-46c7-9e7c-c223974056fc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:20.230175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10c9f2-21bf-46c7-9e7c-c223974056fc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:20.253507 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 373/750] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:06:20 2022] POST /identity/v3/services => generated 240 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:06:20.254563 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10c9f2-21bf-46c7-9e7c-c223974056fc None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:20.440095 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea1e99-c7ef-44ec-83cc-e242108e0676 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:20.513920 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10c9f2-21bf-46c7-9e7c-c223974056fc None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:20.532788 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332ba99-2741-415a-85e9-6a6cd835cb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:20.533970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332ba99-2741-415a-85e9-6a6cd835cb2f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:20.534537 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332ba99-2741-415a-85e9-6a6cd835cb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:20.535075 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332ba99-2741-415a-85e9-6a6cd835cb2f None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:20.536276 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332ba99-2741-415a-85e9-6a6cd835cb2f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:20.536803 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332ba99-2741-415a-85e9-6a6cd835cb2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:20.539234 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332ba99-2741-415a-85e9-6a6cd835cb2f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:20.575391 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 378/751] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:06:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:20.586562 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332ba99-2741-415a-85e9-6a6cd835cb2f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:20.592265 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9956a-c294-4780-ab96-fd1e42dea899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:20.592886 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9956a-c294-4780-ab96-fd1e42dea899 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:20.593170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9956a-c294-4780-ab96-fd1e42dea899 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:20.593488 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9956a-c294-4780-ab96-fd1e42dea899 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:20.607296 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9956a-c294-4780-ab96-fd1e42dea899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:20.610189 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9956a-c294-4780-ab96-fd1e42dea899 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:20.636483 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-d7d9956a-c294-4780-ab96-fd1e42dea899 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:20.636483 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:20.636483 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:20.636483 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:20.636483 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:20.636483 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:20.636483 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:20.636483 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:20.636483 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:20.636483 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:20.636483 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:20.636483 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:20.636483 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:20.636483 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:20.636483 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:20.637658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:20.637658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:20.637658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:20.637658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:20.637658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:20.637658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:20.637658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:20.637658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:20.637658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:20.637658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:20.637658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:20.637658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:20.637658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:20.637658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:20.637658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:20.637658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:20.637658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:20.638618 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:20.638618 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:20.638618 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:20.638618 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:20.645823 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 374/752] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:20.648976 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9956a-c294-4780-ab96-fd1e42dea899 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:20.718032 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332ba99-2741-415a-85e9-6a6cd835cb2f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:20.755459 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0963ce-c25d-48b3-8c23-8b879763feb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:20.756212 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0963ce-c25d-48b3-8c23-8b879763feb3 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:20.756501 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0963ce-c25d-48b3-8c23-8b879763feb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:20.756781 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0963ce-c25d-48b3-8c23-8b879763feb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:20.768881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0963ce-c25d-48b3-8c23-8b879763feb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:20.770413 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0963ce-c25d-48b3-8c23-8b879763feb3 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:20.780958 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9956a-c294-4780-ab96-fd1e42dea899 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:20.795614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-ae0963ce-c25d-48b3-8c23-8b879763feb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:20.795614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:20.795614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:20.795614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:20.795614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:20.795614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:20.795614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:20.795614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:20.795614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:20.795614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:20.795614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:20.795614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:20.795614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:20.795614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:20.795614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:20.796669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:20.796669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:20.796669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:20.796669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:20.796669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:20.796669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:20.796669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:20.796669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:20.796669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:20.796669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:20.796669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:20.796669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:20.796669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:20.796669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:20.796669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:20.796669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:20.796669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:20.798844 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:20.798844 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:20.798844 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:20.798844 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:20.798844 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 379/753] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:20.802514 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0963ce-c25d-48b3-8c23-8b879763feb3 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:20.829415 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887d82f-e5bb-42f7-87c0-5dbbb5d5fc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:20.830552 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887d82f-e5bb-42f7-87c0-5dbbb5d5fc7f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:20.831076 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887d82f-e5bb-42f7-87c0-5dbbb5d5fc7f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:20.831583 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887d82f-e5bb-42f7-87c0-5dbbb5d5fc7f None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:20.832687 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887d82f-e5bb-42f7-87c0-5dbbb5d5fc7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:20.833333 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887d82f-e5bb-42f7-87c0-5dbbb5d5fc7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:20.835085 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887d82f-e5bb-42f7-87c0-5dbbb5d5fc7f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:20.857521 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 375/754] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:20.859491 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887d82f-e5bb-42f7-87c0-5dbbb5d5fc7f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:20.926835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0963ce-c25d-48b3-8c23-8b879763feb3 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:20.967402 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546382e-43f3-4892-a4dd-6cb8ddbf949d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:20.968231 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546382e-43f3-4892-a4dd-6cb8ddbf949d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:20.968913 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546382e-43f3-4892-a4dd-6cb8ddbf949d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:20.969207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546382e-43f3-4892-a4dd-6cb8ddbf949d None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:20.970291 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546382e-43f3-4892-a4dd-6cb8ddbf949d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:20.970291 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546382e-43f3-4892-a4dd-6cb8ddbf949d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:20.971681 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546382e-43f3-4892-a4dd-6cb8ddbf949d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:20.985193 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 380/755] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:20.990141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887d82f-e5bb-42f7-87c0-5dbbb5d5fc7f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:20.990735 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546382e-43f3-4892-a4dd-6cb8ddbf949d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:21.034361 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f4343-cec9-4475-8adb-10d8b1fafb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:21.035639 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f4343-cec9-4475-8adb-10d8b1fafb44 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:21.036173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f4343-cec9-4475-8adb-10d8b1fafb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:21.036753 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f4343-cec9-4475-8adb-10d8b1fafb44 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:21.047501 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f4343-cec9-4475-8adb-10d8b1fafb44 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:21.049879 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f4343-cec9-4475-8adb-10d8b1fafb44 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:21.069048 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-cb1f4343-cec9-4475-8adb-10d8b1fafb44 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:06:21.069048 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:21.069048 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:21.069048 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:21.069048 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:21.069048 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:21.069048 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:21.069048 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:21.069048 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:21.069048 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:21.069048 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:21.069048 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:21.069048 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:21.069048 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:21.069048 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:21.069048 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:21.070503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:21.070503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:21.070503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:21.070503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:21.070503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:21.070503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:21.070503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:21.070503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:21.070503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:21.070503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:21.070503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:21.070503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:21.070503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:21.070503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:21.070503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:21.070503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:21.070503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:21.070503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:21.071735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:21.071735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:21.071735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:21.071735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:21.071735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:21.071735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:21.071735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:21.071735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:21.071735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:06:21.071735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:21.081174 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 376/756] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:06:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:21.087428 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f4343-cec9-4475-8adb-10d8b1fafb44 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:21.240997 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f4343-cec9-4475-8adb-10d8b1fafb44 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:21.263539 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546382e-43f3-4892-a4dd-6cb8ddbf949d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:21.287610 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b5ce2-1acb-489d-a63a-bbd855d056db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:21.288649 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b5ce2-1acb-489d-a63a-bbd855d056db None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:21.289704 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b5ce2-1acb-489d-a63a-bbd855d056db None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:21.290198 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b5ce2-1acb-489d-a63a-bbd855d056db None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:21.291617 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b5ce2-1acb-489d-a63a-bbd855d056db None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:21.292171 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b5ce2-1acb-489d-a63a-bbd855d056db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:21.295581 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b5ce2-1acb-489d-a63a-bbd855d056db None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:21.336047 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a1307-6961-48cf-8527-9f88770c8958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:21.341419 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 377/757] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 9 15:06:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:21.342020 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a1307-6961-48cf-8527-9f88770c8958 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:21.342697 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a1307-6961-48cf-8527-9f88770c8958 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:21.343330 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a1307-6961-48cf-8527-9f88770c8958 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:21.345851 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b5ce2-1acb-489d-a63a-bbd855d056db None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:21.361536 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a1307-6961-48cf-8527-9f88770c8958 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:21.366132 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a1307-6961-48cf-8527-9f88770c8958 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:21.397648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-9d7a1307-6961-48cf-8527-9f88770c8958 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:21.397648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:21.397648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:21.397648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:21.397648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:21.397648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:21.397648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:21.397648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:21.397648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:21.397648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:21.397648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:21.397648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:21.397648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:21.397648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:21.397648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:21.399280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:21.399280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:21.399280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:21.399280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:21.399280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:21.399280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:21.399280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:21.399280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:21.399280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:21.399280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:21.399280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:21.399280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:21.399280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:21.399280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:21.399280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:21.399280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:21.399280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:21.400170 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:21.400170 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:21.400170 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:21.400170 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:21.400170 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:21.400170 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:21.400170 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:21.400170 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:21.410055 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 381/758] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 420 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:21.413997 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a1307-6961-48cf-8527-9f88770c8958 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:21.612584 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a1307-6961-48cf-8527-9f88770c8958 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:21.639754 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b5ce2-1acb-489d-a63a-bbd855d056db None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:21.660495 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07faeb7-1d13-42a2-bcb0-edb012fbb1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:21.661248 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07faeb7-1d13-42a2-bcb0-edb012fbb1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:21.661603 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07faeb7-1d13-42a2-bcb0-edb012fbb1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:21.661886 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07faeb7-1d13-42a2-bcb0-edb012fbb1f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:21.662747 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07faeb7-1d13-42a2-bcb0-edb012fbb1f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:21.663065 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07faeb7-1d13-42a2-bcb0-edb012fbb1f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:21.665523 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07faeb7-1d13-42a2-bcb0-edb012fbb1f7 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:21.682205 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 382/759] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:06:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:21.687964 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07faeb7-1d13-42a2-bcb0-edb012fbb1f7 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:21.716071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cfc8b7-f735-433e-b72f-fda91b1e8f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:21.716762 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfc8b7-f735-433e-b72f-fda91b1e8f1a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:21.717041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfc8b7-f735-433e-b72f-fda91b1e8f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:21.717318 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfc8b7-f735-433e-b72f-fda91b1e8f1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:21.796248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cfc8b7-f735-433e-b72f-fda91b1e8f1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:21.797835 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cfc8b7-f735-433e-b72f-fda91b1e8f1a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:21.843235 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07faeb7-1d13-42a2-bcb0-edb012fbb1f7 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:21.884904 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed967a-10c7-4ffc-b2c2-ad4f80360ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:21.885762 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed967a-10c7-4ffc-b2c2-ad4f80360ac4 None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:21.886046 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed967a-10c7-4ffc-b2c2-ad4f80360ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:21.886324 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed967a-10c7-4ffc-b2c2-ad4f80360ac4 None admin] PATH_INFO: `/v3/projects/4fcadeae44cc4547905b83bfebec79c7/users/65e7a4e661ef4425b24844c3500b0b58/roles/3409f00ead9e455182684faa27b1f8f0` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:21.888677 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed967a-10c7-4ffc-b2c2-ad4f80360ac4 None admin] RBAC: Authorizing `identity:create_grant(project_id=4fcadeae44cc4547905b83bfebec79c7, user_id=65e7a4e661ef4425b24844c3500b0b58, role_id=3409f00ead9e455182684faa27b1f8f0)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:21.890320 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed967a-10c7-4ffc-b2c2-ad4f80360ac4 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:21.906572 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 383/760] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:06:21 2022] PUT /identity/v3/projects/4fcadeae44cc4547905b83bfebec79c7/users/65e7a4e661ef4425b24844c3500b0b58/roles/3409f00ead9e455182684faa27b1f8f0 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:06:21.908192 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72f6d6-999b-436e-8e52-ac7a428e60eb None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:21.908484 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72f6d6-999b-436e-8e52-ac7a428e60eb None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:21.908821 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72f6d6-999b-436e-8e52-ac7a428e60eb None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:21.915988 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 384/761] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:21.917558 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19633997-83de-46fe-89e5-ac47a69b896a None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:21.917846 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19633997-83de-46fe-89e5-ac47a69b896a None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:21.918179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19633997-83de-46fe-89e5-ac47a69b896a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:21.936239 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 378/762] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:06:21 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:06:21.937844 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cfc8b7-f735-433e-b72f-fda91b1e8f1a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:21.939341 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-19633997-83de-46fe-89e5-ac47a69b896a None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:21.941068 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-19633997-83de-46fe-89e5-ac47a69b896a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:22.028278 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 385/763] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:22.057909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cfc8b7-f735-433e-b72f-fda91b1e8f1a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:22.067578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19633997-83de-46fe-89e5-ac47a69b896a None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:22.104498 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63e90a-e799-4eea-8660-2aa907df0d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:22.105336 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63e90a-e799-4eea-8660-2aa907df0d82 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:22.105654 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63e90a-e799-4eea-8660-2aa907df0d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:22.105960 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63e90a-e799-4eea-8660-2aa907df0d82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:22.131902 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63e90a-e799-4eea-8660-2aa907df0d82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:22.133815 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63e90a-e799-4eea-8660-2aa907df0d82 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:22.174566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-ed63e90a-e799-4eea-8660-2aa907df0d82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:22.174566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:22.174566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:22.174566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:22.174566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:22.174566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:22.174566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:22.174566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:22.174566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:22.174566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:22.174566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:22.174566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:22.174566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:22.174566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:22.174566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:22.175501 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:22.175501 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:22.175501 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:22.175501 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:22.175501 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:22.175501 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:22.175501 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:22.175501 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:22.175501 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:22.175501 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:22.175501 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:22.175501 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:22.175501 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:22.175501 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:22.175501 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:22.175501 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:22.175501 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:22.176404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:22.176404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:22.176404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:22.176404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:22.176404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 379/764] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:22.182866 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63e90a-e799-4eea-8660-2aa907df0d82 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:22.271138 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19633997-83de-46fe-89e5-ac47a69b896a None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:22.337469 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53288a51-a550-486f-be52-378327e1c808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:22.338299 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53288a51-a550-486f-be52-378327e1c808 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:22.338584 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53288a51-a550-486f-be52-378327e1c808 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:22.338860 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53288a51-a550-486f-be52-378327e1c808 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:22.339524 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53288a51-a550-486f-be52-378327e1c808 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:22.341985 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53288a51-a550-486f-be52-378327e1c808 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:22.360883 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-53288a51-a550-486f-be52-378327e1c808 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:06:22.360883 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:22.360883 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:06:22.360883 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:06:22.360883 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:06:22.360883 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:06:22.360883 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:06:22.360883 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:22.360883 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:06:22.360883 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:22.360883 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:22.360883 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:22.360883 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:22.360883 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:22.360883 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:22.360883 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:22.362059 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:22.362059 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:22.362059 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:22.362059 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:22.362059 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:22.362059 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:22.362059 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:22.362059 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:06:22.362059 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:06:22.362059 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:06:22.362059 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:06:22.362059 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:22.362059 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:22.362059 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:22.362059 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:22.362059 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:22.362914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:22.362914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:22.362914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:22.362914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:22.362914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:22.362914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:22.362914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:22.362914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:22.362914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:22.362914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:22.362914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:22.362914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:06:22.362914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:22.362914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:06:22.362914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:22.363731 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63e90a-e799-4eea-8660-2aa907df0d82 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:22.372726 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 386/765] 10.222.0.48 () {56 vars in 1129 bytes} [Mon May 9 15:06:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:22.373710 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53288a51-a550-486f-be52-378327e1c808 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:22.436755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b48ea5-bda3-401d-8a73-eedb2456ec4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:22.437464 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b48ea5-bda3-401d-8a73-eedb2456ec4a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:22.437752 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b48ea5-bda3-401d-8a73-eedb2456ec4a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:22.438026 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b48ea5-bda3-401d-8a73-eedb2456ec4a None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:22.438769 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b48ea5-bda3-401d-8a73-eedb2456ec4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:22.439075 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b48ea5-bda3-401d-8a73-eedb2456ec4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:22.442334 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b48ea5-bda3-401d-8a73-eedb2456ec4a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:22.469655 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 380/766] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:22.475056 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b48ea5-bda3-401d-8a73-eedb2456ec4a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:22.542539 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53288a51-a550-486f-be52-378327e1c808 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:22.584572 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc287a-8ea7-4507-a266-a0e67f10473a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:22.585258 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc287a-8ea7-4507-a266-a0e67f10473a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:22.586386 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc287a-8ea7-4507-a266-a0e67f10473a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:22.586386 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc287a-8ea7-4507-a266-a0e67f10473a None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:22.587538 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc287a-8ea7-4507-a266-a0e67f10473a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:22.587852 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc287a-8ea7-4507-a266-a0e67f10473a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:22.589220 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc287a-8ea7-4507-a266-a0e67f10473a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:22.603211 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 387/767] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 9 15:06:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:22.604720 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707217ac-f20c-4e32-bf50-99de4a7bde97 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:22.605021 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707217ac-f20c-4e32-bf50-99de4a7bde97 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:22.605300 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707217ac-f20c-4e32-bf50-99de4a7bde97 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:22.606696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 388/768] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:22.612669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707217ac-f20c-4e32-bf50-99de4a7bde97 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:22.736649 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707217ac-f20c-4e32-bf50-99de4a7bde97 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:22.744517 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b48ea5-bda3-401d-8a73-eedb2456ec4a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:22.772332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf5ce5-280c-4968-acb9-8863f7772a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:22.773141 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf5ce5-280c-4968-acb9-8863f7772a37 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:22.773560 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf5ce5-280c-4968-acb9-8863f7772a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:22.774070 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf5ce5-280c-4968-acb9-8863f7772a37 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:22.774880 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf5ce5-280c-4968-acb9-8863f7772a37 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:22.775193 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf5ce5-280c-4968-acb9-8863f7772a37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:22.776898 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf5ce5-280c-4968-acb9-8863f7772a37 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:22.778955 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd3858-881e-4e59-9cc9-0c0614bcf4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:22.779751 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd3858-881e-4e59-9cc9-0c0614bcf4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:22.780035 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd3858-881e-4e59-9cc9-0c0614bcf4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:22.780315 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd3858-881e-4e59-9cc9-0c0614bcf4a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:22.787522 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 389/769] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 9 15:06:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:22.787813 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd3858-881e-4e59-9cc9-0c0614bcf4a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:22.789664 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f95a5c-80cc-44d2-b404-9086f127639c None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:22.789964 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd3858-881e-4e59-9cc9-0c0614bcf4a5 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:22.790187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f95a5c-80cc-44d2-b404-9086f127639c None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:22.790748 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f95a5c-80cc-44d2-b404-9086f127639c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:22.804566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-aabd3858-881e-4e59-9cc9-0c0614bcf4a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:22.804566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:22.804566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:22.804566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:22.804566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:22.804566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:22.804566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:22.804566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:22.804566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:22.804566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:22.804566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:22.804566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:22.804566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:22.804566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:22.804566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:22.806799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:22.806799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:22.806799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:22.806799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:22.806799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:22.806799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:22.806799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:22.806799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:22.806799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:22.806799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:22.806799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:22.806799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:22.806799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:22.806799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:22.806799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:22.806799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:22.806799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:22.809015 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:22.809015 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:22.809015 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:22.809015 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:22.809015 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:22.809015 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:22.809015 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:22.809015 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:22.809015 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 381/770] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:22.809015 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd3858-881e-4e59-9cc9-0c0614bcf4a5 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:22.810393 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-94f95a5c-80cc-44d2-b404-9086f127639c None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:22.810393 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-94f95a5c-80cc-44d2-b404-9086f127639c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:22.887703 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 390/771] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:22.889440 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f95a5c-80cc-44d2-b404-9086f127639c None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:22.912210 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd3858-881e-4e59-9cc9-0c0614bcf4a5 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:22.948697 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c1162-4042-47ab-95fb-5bdf355d1fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:22.949365 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c1162-4042-47ab-95fb-5bdf355d1fbd None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:22.949669 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c1162-4042-47ab-95fb-5bdf355d1fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:22.949944 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c1162-4042-47ab-95fb-5bdf355d1fbd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:22.950795 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c1162-4042-47ab-95fb-5bdf355d1fbd None admin] RBAC: Adding query filter params (interface=public, service_id=70aee10084c0408a94ffe6fccfbf95b7, region_id=RegionOne) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:22.951106 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c1162-4042-47ab-95fb-5bdf355d1fbd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:22.952539 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c1162-4042-47ab-95fb-5bdf355d1fbd None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:22.960478 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 382/772] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:06:22 2022] GET /identity/v3/endpoints?service_id=70aee10084c0408a94ffe6fccfbf95b7&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:22.961671 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c1162-4042-47ab-95fb-5bdf355d1fbd None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:23.030800 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f95a5c-80cc-44d2-b404-9086f127639c None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:23.069040 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31241391-2677-40ca-8c4e-651e3c0e69b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:23.069774 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31241391-2677-40ca-8c4e-651e3c0e69b2 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:23.070039 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31241391-2677-40ca-8c4e-651e3c0e69b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:23.070382 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31241391-2677-40ca-8c4e-651e3c0e69b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:23.071542 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31241391-2677-40ca-8c4e-651e3c0e69b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:23.071855 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31241391-2677-40ca-8c4e-651e3c0e69b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:23.073361 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31241391-2677-40ca-8c4e-651e3c0e69b2 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:23.080413 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c1162-4042-47ab-95fb-5bdf355d1fbd None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:23.086712 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 391/773] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:06:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:23.087806 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31241391-2677-40ca-8c4e-651e3c0e69b2 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:23.125751 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727689d-2514-4f90-abfe-26f35fb34519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:23.126634 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727689d-2514-4f90-abfe-26f35fb34519 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:23.126916 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727689d-2514-4f90-abfe-26f35fb34519 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:23.127247 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727689d-2514-4f90-abfe-26f35fb34519 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:23.138290 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727689d-2514-4f90-abfe-26f35fb34519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:06:23.145952 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-4727689d-2514-4f90-abfe-26f35fb34519 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:06:23.145952 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:23.145952 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:23.145952 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:23.145952 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:23.145952 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:23.145952 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:23.145952 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:23.145952 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:23.145952 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:23.145952 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:23.145952 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:23.145952 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:06:23.145952 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:06:23.145952 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:06:23.145952 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:06:23.148788 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:06:23.148788 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:06:23.148788 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:06:23.148788 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:06:23.148788 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:23.148788 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:23.148788 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:23.148788 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:23.148788 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:23.148788 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:23.148788 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:23.148788 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:23.148788 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:23.148788 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:23.148788 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:23.148788 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:23.150985 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:23.150985 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:23.150985 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:23.150985 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:23.150985 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:06:23.150985 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:06:23.150985 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:06:23.150985 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:06:23.150985 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:06:23.150985 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:06:23.150985 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:06:23.150985 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:23.150985 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 383/774] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:06:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:23.150985 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727689d-2514-4f90-abfe-26f35fb34519 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:23.266588 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727689d-2514-4f90-abfe-26f35fb34519 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:23.304108 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c305837-f1cb-4672-b90c-24d72c656c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:23.304820 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c305837-f1cb-4672-b90c-24d72c656c1e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:23.305321 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c305837-f1cb-4672-b90c-24d72c656c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:23.305749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c305837-f1cb-4672-b90c-24d72c656c1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:23.306602 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c305837-f1cb-4672-b90c-24d72c656c1e None admin] RBAC: Adding query filter params (role.id=d8aa93d29788400a97d04db10d8fb8d5, scope.project.id=4fcadeae44cc4547905b83bfebec79c7, user.id=057ad64901314362914287aed5b468ea) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:23.306921 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c305837-f1cb-4672-b90c-24d72c656c1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:23.308429 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c305837-f1cb-4672-b90c-24d72c656c1e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:23.315780 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 384/775] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:06:23 2022] GET /identity/v3/role_assignments?user.id=057ad64901314362914287aed5b468ea&scope.project.id=4fcadeae44cc4547905b83bfebec79c7&role.id=d8aa93d29788400a97d04db10d8fb8d5 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:23.316606 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c305837-f1cb-4672-b90c-24d72c656c1e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:23.337846 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31241391-2677-40ca-8c4e-651e3c0e69b2 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:23.380636 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a969c-f137-4a4f-8894-e0f4706c8502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:23.381349 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a969c-f137-4a4f-8894-e0f4706c8502 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:23.381640 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a969c-f137-4a4f-8894-e0f4706c8502 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:23.381916 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a969c-f137-4a4f-8894-e0f4706c8502 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:23.383164 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a969c-f137-4a4f-8894-e0f4706c8502 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:23.385430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a969c-f137-4a4f-8894-e0f4706c8502 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:23.393543 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 392/776] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:06:23 2022] GET /identity/v3/services => generated 772 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:23.394914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d04231-a56f-4f59-980a-8d693ff26ff2 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:23.395197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d04231-a56f-4f59-980a-8d693ff26ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:23.395470 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d04231-a56f-4f59-980a-8d693ff26ff2 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:23.397076 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 393/777] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:23.403328 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6463cd-7c69-4abc-a370-f57c287fbe57 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:23.403697 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6463cd-7c69-4abc-a370-f57c287fbe57 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:23.403882 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6463cd-7c69-4abc-a370-f57c287fbe57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:23.423377 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-7f6463cd-7c69-4abc-a370-f57c287fbe57 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:23.425709 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-7f6463cd-7c69-4abc-a370-f57c287fbe57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:23.527063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c305837-f1cb-4672-b90c-24d72c656c1e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:23.568012 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbef754-b881-4d88-a009-54023daf871f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:23.569085 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbef754-b881-4d88-a009-54023daf871f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:23.570921 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 394/778] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:06:23.571466 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbef754-b881-4d88-a009-54023daf871f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:23.571967 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbef754-b881-4d88-a009-54023daf871f None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:23.572994 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbef754-b881-4d88-a009-54023daf871f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:23.573555 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbef754-b881-4d88-a009-54023daf871f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:23.575185 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbef754-b881-4d88-a009-54023daf871f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:23.587319 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 385/779] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:06:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:23.592791 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6463cd-7c69-4abc-a370-f57c287fbe57 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:23.594587 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbef754-b881-4d88-a009-54023daf871f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:23.721872 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbef754-b881-4d88-a009-54023daf871f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:23.745957 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6463cd-7c69-4abc-a370-f57c287fbe57 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:23.771100 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7439786-4dd4-496d-a562-2253520a7ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:23.771895 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7439786-4dd4-496d-a562-2253520a7ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:23.772170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7439786-4dd4-496d-a562-2253520a7ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:23.772439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7439786-4dd4-496d-a562-2253520a7ac1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:23.773643 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7439786-4dd4-496d-a562-2253520a7ac1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:23.775073 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7439786-4dd4-496d-a562-2253520a7ac1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:23.794697 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82174fe6-1a93-472d-81f2-6a4dcb511c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:23.795479 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82174fe6-1a93-472d-81f2-6a4dcb511c5d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:23.795756 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82174fe6-1a93-472d-81f2-6a4dcb511c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:23.796025 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82174fe6-1a93-472d-81f2-6a4dcb511c5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:23.807259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-e7439786-4dd4-496d-a562-2253520a7ac1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:06:23.807259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:23.807259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:06:23.807259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:06:23.807259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:06:23.807259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:06:23.807259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:06:23.807259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:23.807259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:06:23.807259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:23.807259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:23.807259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:23.807259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:23.807259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:23.807259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:23.807259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:23.807259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:23.808340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:23.808340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:23.808340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:23.808340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:23.808340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:23.808340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:23.808340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:06:23.808340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:06:23.808340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:06:23.808340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:06:23.808340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:23.808340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:23.808340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:23.808340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:23.808340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:23.808340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:23.809180 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:23.809180 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:23.809180 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:23.809180 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:23.809180 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:23.809180 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:23.809180 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:23.809180 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:23.809180 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:23.809180 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:23.809180 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:06:23.809180 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:23.809180 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:06:23.809180 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:23.811405 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82174fe6-1a93-472d-81f2-6a4dcb511c5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:23.811492 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82174fe6-1a93-472d-81f2-6a4dcb511c5d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:23.812610 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 386/780] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:23 2022] GET /identity/v3/services/network => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:23.835400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7439786-4dd4-496d-a562-2253520a7ac1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:23.847851 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-82174fe6-1a93-472d-81f2-6a4dcb511c5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:23.847851 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:23.847851 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:23.847851 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:23.847851 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:23.847851 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:23.847851 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:23.847851 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:23.847851 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:23.847851 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:23.847851 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:23.847851 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:23.847851 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:23.847851 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:23.847851 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:23.849116 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:23.849116 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:23.849116 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:23.849116 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:23.849116 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:23.849116 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:23.849116 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:23.849116 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:23.849116 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:23.849116 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:23.849116 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:23.849116 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:23.849116 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:23.849116 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:23.849116 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:23.849116 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:23.849116 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:23.850248 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:23.850248 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:23.850248 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:23.850248 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:23.853259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 395/781] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:23.861501 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82174fe6-1a93-472d-81f2-6a4dcb511c5d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:23.982923 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7439786-4dd4-496d-a562-2253520a7ac1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:24.023189 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82174fe6-1a93-472d-81f2-6a4dcb511c5d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:24.065399 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560ee0a-6826-466d-99f6-f976ef5e957d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:24.065399 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560ee0a-6826-466d-99f6-f976ef5e957d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:24.065399 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560ee0a-6826-466d-99f6-f976ef5e957d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:24.065399 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560ee0a-6826-466d-99f6-f976ef5e957d None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:24.065914 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560ee0a-6826-466d-99f6-f976ef5e957d None admin] RBAC: Adding query filter params (name=network) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:24.065914 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560ee0a-6826-466d-99f6-f976ef5e957d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:24.065914 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560ee0a-6826-466d-99f6-f976ef5e957d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:24.072119 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 387/782] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:06:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:24.075939 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7d33b-6b66-4cc4-aa8e-46973d34f667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:24.076891 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7d33b-6b66-4cc4-aa8e-46973d34f667 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:24.077437 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7d33b-6b66-4cc4-aa8e-46973d34f667 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:24.077897 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7d33b-6b66-4cc4-aa8e-46973d34f667 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:24.078814 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560ee0a-6826-466d-99f6-f976ef5e957d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:24.079070 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7d33b-6b66-4cc4-aa8e-46973d34f667 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:24.079598 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7d33b-6b66-4cc4-aa8e-46973d34f667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:24.081218 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7d33b-6b66-4cc4-aa8e-46973d34f667 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:24.096320 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 396/783] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:24.102200 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7d33b-6b66-4cc4-aa8e-46973d34f667 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:24.209186 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560ee0a-6826-466d-99f6-f976ef5e957d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:24.249494 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7d33b-6b66-4cc4-aa8e-46973d34f667 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:24.258250 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400cd4e-d24e-4d3d-965a-bfc40aa06fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:24.258957 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400cd4e-d24e-4d3d-965a-bfc40aa06fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:24.259240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400cd4e-d24e-4d3d-965a-bfc40aa06fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:24.259519 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400cd4e-d24e-4d3d-965a-bfc40aa06fb2 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:24.260252 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400cd4e-d24e-4d3d-965a-bfc40aa06fb2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:24.260562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400cd4e-d24e-4d3d-965a-bfc40aa06fb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:24.262335 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400cd4e-d24e-4d3d-965a-bfc40aa06fb2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:24.268234 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 388/784] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:06:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:24.274303 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400cd4e-d24e-4d3d-965a-bfc40aa06fb2 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:24.297110 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6236ba5-ee4d-4991-a15d-04be748d6c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:24.298210 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6236ba5-ee4d-4991-a15d-04be748d6c20 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:24.298703 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6236ba5-ee4d-4991-a15d-04be748d6c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:24.299237 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6236ba5-ee4d-4991-a15d-04be748d6c20 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:24.318617 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6236ba5-ee4d-4991-a15d-04be748d6c20 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:24.320383 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6236ba5-ee4d-4991-a15d-04be748d6c20 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:24.354098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-f6236ba5-ee4d-4991-a15d-04be748d6c20 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:06:24.354098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:24.354098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:24.354098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:24.354098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:24.354098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:24.354098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:24.354098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:24.354098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:24.354098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:24.354098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:24.354098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:24.354098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:24.354098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:24.354098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:24.354098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:24.355259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:24.355259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:24.355259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:24.355259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:24.355259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:24.355259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:24.355259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:24.355259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:24.355259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:24.355259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:24.355259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:24.355259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:24.355259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:24.355259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:24.355259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:24.355259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:24.355259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:24.355259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:24.356291 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:24.356291 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:24.356291 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:24.356291 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:24.356291 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:24.356291 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:24.356291 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:24.356291 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:24.356291 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:06:24.356291 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:24.361127 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 397/785] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:06:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:24.362414 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6236ba5-ee4d-4991-a15d-04be748d6c20 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:24.410949 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400cd4e-d24e-4d3d-965a-bfc40aa06fb2 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:24.454095 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f0a47-2c9d-4033-8752-6aabc95752f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:24.455044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f0a47-2c9d-4033-8752-6aabc95752f5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:24.455487 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f0a47-2c9d-4033-8752-6aabc95752f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:24.455906 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f0a47-2c9d-4033-8752-6aabc95752f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:24.456870 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f0a47-2c9d-4033-8752-6aabc95752f5 None admin] RBAC: Adding query filter params (interface=public, service_id=411aaed3a3c74910ad905ac40f9b91e0, region_id=RegionOne) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:24.461938 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f0a47-2c9d-4033-8752-6aabc95752f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:24.465088 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f0a47-2c9d-4033-8752-6aabc95752f5 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:24.483628 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 389/786] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:06:24 2022] GET /identity/v3/endpoints?service_id=411aaed3a3c74910ad905ac40f9b91e0&interface=public®ion_id=RegionOne => generated 194 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:24.489146 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f0a47-2c9d-4033-8752-6aabc95752f5 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:24.541255 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6236ba5-ee4d-4991-a15d-04be748d6c20 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:24.584546 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568576c-9ded-4b72-b9a5-56aed1929879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:24.585552 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568576c-9ded-4b72-b9a5-56aed1929879 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:24.586013 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568576c-9ded-4b72-b9a5-56aed1929879 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:24.586431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568576c-9ded-4b72-b9a5-56aed1929879 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:24.587483 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568576c-9ded-4b72-b9a5-56aed1929879 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:24.587947 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568576c-9ded-4b72-b9a5-56aed1929879 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:24.589849 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568576c-9ded-4b72-b9a5-56aed1929879 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:24.610977 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 398/787] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 9 15:06:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:24.618452 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568576c-9ded-4b72-b9a5-56aed1929879 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:24.673721 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f0a47-2c9d-4033-8752-6aabc95752f5 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:24.714337 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cc0a6-67d3-4540-9acd-028238566ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:24.715018 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cc0a6-67d3-4540-9acd-028238566ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:24.715299 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cc0a6-67d3-4540-9acd-028238566ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:24.715576 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cc0a6-67d3-4540-9acd-028238566ee7 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:24.716262 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41cc0a6-67d3-4540-9acd-028238566ee7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:24.717648 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41cc0a6-67d3-4540-9acd-028238566ee7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:24.725429 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 390/788] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:06:24 2022] GET /identity/v3/services => generated 772 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:24.727561 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e85c19-bb44-4701-a540-7bbd084283e7 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:24.727849 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e85c19-bb44-4701-a540-7bbd084283e7 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:24.728128 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e85c19-bb44-4701-a540-7bbd084283e7 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:24.729950 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 391/789] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:24.736712 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3476ec-06f8-4e0c-9c91-2357c2f01a21 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:24.737050 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3476ec-06f8-4e0c-9c91-2357c2f01a21 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:24.737267 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3476ec-06f8-4e0c-9c91-2357c2f01a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:24.774696 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-cf3476ec-06f8-4e0c-9c91-2357c2f01a21 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:24.775904 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-cf3476ec-06f8-4e0c-9c91-2357c2f01a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:24.789991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568576c-9ded-4b72-b9a5-56aed1929879 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:24.835423 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d1862-43f5-4c71-bfa6-f0702971e587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:24.838870 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d1862-43f5-4c71-bfa6-f0702971e587 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:24.839192 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d1862-43f5-4c71-bfa6-f0702971e587 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:24.839475 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d1862-43f5-4c71-bfa6-f0702971e587 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:24.852706 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d1862-43f5-4c71-bfa6-f0702971e587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:24.854369 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d1862-43f5-4c71-bfa6-f0702971e587 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:24.875309 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-633d1862-43f5-4c71-bfa6-f0702971e587 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:24.875309 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:24.875309 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:24.875309 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:24.875309 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:24.875309 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:24.875309 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:24.875309 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:24.875309 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:24.875309 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:24.875309 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:24.875309 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:24.875309 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:24.875309 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:24.875309 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:24.877512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:24.877512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:24.877512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:24.877512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:24.877512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:24.877512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:24.877512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:24.877512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:24.877512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:24.877512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:24.877512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:24.877512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:24.877512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:24.877512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:24.877512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:24.877512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:24.877512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:24.879750 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:24.879750 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:24.879750 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:24.879750 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:24.879750 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 399/790] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:24.886783 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d1862-43f5-4c71-bfa6-f0702971e587 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:24.937847 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 392/791] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:24.979061 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3476ec-06f8-4e0c-9c91-2357c2f01a21 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:25.079041 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d1862-43f5-4c71-bfa6-f0702971e587 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:25.129870 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2c384-221a-4f8e-b828-4cec6d3f0a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:25.130467 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2c384-221a-4f8e-b828-4cec6d3f0a35 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:25.130803 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2c384-221a-4f8e-b828-4cec6d3f0a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:25.131080 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2c384-221a-4f8e-b828-4cec6d3f0a35 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:25.131820 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2c384-221a-4f8e-b828-4cec6d3f0a35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:25.132216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2c384-221a-4f8e-b828-4cec6d3f0a35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:25.135739 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2c384-221a-4f8e-b828-4cec6d3f0a35 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:25.139846 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3476ec-06f8-4e0c-9c91-2357c2f01a21 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:25.154902 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 400/792] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:25.156331 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2c384-221a-4f8e-b828-4cec6d3f0a35 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:25.183647 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4767335-a0e4-486e-877b-fca5f9e30cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:25.184454 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4767335-a0e4-486e-877b-fca5f9e30cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:25.184733 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4767335-a0e4-486e-877b-fca5f9e30cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:25.185009 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4767335-a0e4-486e-877b-fca5f9e30cc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:25.209171 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4767335-a0e4-486e-877b-fca5f9e30cc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:06:25.225749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-e4767335-a0e4-486e-877b-fca5f9e30cc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:06:25.225749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:25.225749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:25.225749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:25.225749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:25.225749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:25.225749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:25.225749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:25.225749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:25.225749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:25.225749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:25.225749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:25.225749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:06:25.225749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:06:25.225749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:06:25.225749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:06:25.228633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:06:25.228633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:06:25.228633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:06:25.228633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:06:25.228633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:25.228633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:25.228633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:25.228633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:25.228633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:25.228633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:25.228633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:25.228633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:25.228633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:25.228633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:25.228633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:25.228633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:25.230752 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:25.230752 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:25.230752 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:25.230752 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:25.230752 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:06:25.230752 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:06:25.230752 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:06:25.230752 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:06:25.230752 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:06:25.230752 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:06:25.230752 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:06:25.230752 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:25.230752 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 393/793] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:06:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:25.237411 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4767335-a0e4-486e-877b-fca5f9e30cc4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:25.377099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4767335-a0e4-486e-877b-fca5f9e30cc4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:25.385585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2c384-221a-4f8e-b828-4cec6d3f0a35 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:25.431127 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8a8f9-a932-4c47-a7ed-d79913771dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:25.432105 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8a8f9-a932-4c47-a7ed-d79913771dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:25.432105 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8a8f9-a932-4c47-a7ed-d79913771dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:25.432414 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8a8f9-a932-4c47-a7ed-d79913771dd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:25.437400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8a8f9-a932-4c47-a7ed-d79913771dd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:25.437400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8a8f9-a932-4c47-a7ed-d79913771dd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:25.437400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8a8f9-a932-4c47-a7ed-d79913771dd2 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:25.450355 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 394/794] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:06:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:25.453644 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8a8f9-a932-4c47-a7ed-d79913771dd2 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:25.466642 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a016a-f8f1-480a-83cb-17e9c2b375b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:25.467449 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a016a-f8f1-480a-83cb-17e9c2b375b2 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:25.467733 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a016a-f8f1-480a-83cb-17e9c2b375b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:25.468011 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a016a-f8f1-480a-83cb-17e9c2b375b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:25.480375 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a016a-f8f1-480a-83cb-17e9c2b375b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:25.481900 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a016a-f8f1-480a-83cb-17e9c2b375b2 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:25.511201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-297a016a-f8f1-480a-83cb-17e9c2b375b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:25.511201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:25.511201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:25.511201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:25.511201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:25.511201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:25.511201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:25.511201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:25.511201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:25.511201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:25.511201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:25.511201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:25.511201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:25.511201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:25.511201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:25.513430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:25.513430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:25.513430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:25.513430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:25.513430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:25.513430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:25.513430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:25.513430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:25.513430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:25.513430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:25.513430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:25.513430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:25.513430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:25.513430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:25.513430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:25.513430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:25.513430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:25.515696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:25.515696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:25.515696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:25.515696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:25.515696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:25.515696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:25.515696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:25.515696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:25.529758 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 401/795] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:25.530734 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a016a-f8f1-480a-83cb-17e9c2b375b2 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:25.651530 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8a8f9-a932-4c47-a7ed-d79913771dd2 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:25.693283 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbfe59-e35d-4714-abbe-2eb22bd9ab2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:25.694111 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbfe59-e35d-4714-abbe-2eb22bd9ab2f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:25.694377 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbfe59-e35d-4714-abbe-2eb22bd9ab2f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:25.694648 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbfe59-e35d-4714-abbe-2eb22bd9ab2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:25.718552 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbfe59-e35d-4714-abbe-2eb22bd9ab2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:25.721551 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbfe59-e35d-4714-abbe-2eb22bd9ab2f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:25.753539 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-2ffbfe59-e35d-4714-abbe-2eb22bd9ab2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:25.753539 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:25.753539 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:25.753539 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:25.753539 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:25.753539 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:25.753539 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:25.753539 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:25.753539 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:25.753539 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:25.753539 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:25.753539 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:25.753539 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:25.753539 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:25.753539 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:25.755723 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:25.755723 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:25.755723 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:25.755723 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:25.755723 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:25.755723 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:25.755723 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:25.755723 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:25.755723 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:25.755723 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:25.755723 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:25.755723 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:25.755723 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:25.755723 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:25.755723 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:25.755723 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:25.755723 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:25.757730 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:25.757730 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:25.757730 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:25.757730 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:25.757730 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 395/796] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:25.760848 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbfe59-e35d-4714-abbe-2eb22bd9ab2f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:25.782576 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a016a-f8f1-480a-83cb-17e9c2b375b2 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:25.841825 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91dc1a-b996-485d-beba-1ba26703473e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:25.842513 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91dc1a-b996-485d-beba-1ba26703473e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:25.842804 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91dc1a-b996-485d-beba-1ba26703473e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:25.843090 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91dc1a-b996-485d-beba-1ba26703473e None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:25.843917 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91dc1a-b996-485d-beba-1ba26703473e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:25.844230 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91dc1a-b996-485d-beba-1ba26703473e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:25.845756 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91dc1a-b996-485d-beba-1ba26703473e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:25.877888 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 402/797] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:06:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:25.890453 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91dc1a-b996-485d-beba-1ba26703473e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:25.899804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbfe59-e35d-4714-abbe-2eb22bd9ab2f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:25.946168 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f0a4c-90e3-4f67-a0c7-09ed318549a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:25.946859 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f0a4c-90e3-4f67-a0c7-09ed318549a5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:25.947139 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f0a4c-90e3-4f67-a0c7-09ed318549a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:25.947409 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f0a4c-90e3-4f67-a0c7-09ed318549a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:25.948136 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f0a4c-90e3-4f67-a0c7-09ed318549a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:25.948442 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f0a4c-90e3-4f67-a0c7-09ed318549a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:25.949850 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f0a4c-90e3-4f67-a0c7-09ed318549a5 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:25.972883 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 396/798] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:25.975501 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adacb9-4e2f-4f90-b7f7-2cd93dd0a5e8 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:25.976805 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adacb9-4e2f-4f90-b7f7-2cd93dd0a5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:25.978464 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adacb9-4e2f-4f90-b7f7-2cd93dd0a5e8 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:25.980491 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 397/799] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:25.982110 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adacb9-4e2f-4f90-b7f7-2cd93dd0a5e8 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:26.034024 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91dc1a-b996-485d-beba-1ba26703473e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:26.082223 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fde47-e32d-4c09-8e53-c762dbe8161e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:26.083430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fde47-e32d-4c09-8e53-c762dbe8161e None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:26.083880 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fde47-e32d-4c09-8e53-c762dbe8161e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:26.084365 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fde47-e32d-4c09-8e53-c762dbe8161e None admin] PATH_INFO: `/v3/projects/4fcadeae44cc4547905b83bfebec79c7/users/0b1f03accd91471ea1fe78073c86a97f/roles/3409f00ead9e455182684faa27b1f8f0` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:26.087740 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fde47-e32d-4c09-8e53-c762dbe8161e None admin] RBAC: Authorizing `identity:create_grant(project_id=4fcadeae44cc4547905b83bfebec79c7, user_id=0b1f03accd91471ea1fe78073c86a97f, role_id=3409f00ead9e455182684faa27b1f8f0)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:26.089903 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fde47-e32d-4c09-8e53-c762dbe8161e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:26.118005 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 403/800] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:06:25 2022] PUT /identity/v3/projects/4fcadeae44cc4547905b83bfebec79c7/users/0b1f03accd91471ea1fe78073c86a97f/roles/3409f00ead9e455182684faa27b1f8f0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:06:26.118005 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9527f2-0b5b-405c-9628-c022f12b8771 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:26.118005 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9527f2-0b5b-405c-9628-c022f12b8771 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:26.118005 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9527f2-0b5b-405c-9628-c022f12b8771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:26.138457 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adacb9-4e2f-4f90-b7f7-2cd93dd0a5e8 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:26.158105 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-6c9527f2-0b5b-405c-9628-c022f12b8771 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:26.159315 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-6c9527f2-0b5b-405c-9628-c022f12b8771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:26.195774 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc8140-1223-4f2b-942c-d28da73a393e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:26.196682 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc8140-1223-4f2b-942c-d28da73a393e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:26.196903 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc8140-1223-4f2b-942c-d28da73a393e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:26.197174 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc8140-1223-4f2b-942c-d28da73a393e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:26.207340 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc8140-1223-4f2b-942c-d28da73a393e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:26.209397 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc8140-1223-4f2b-942c-d28da73a393e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:26.230654 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-33cc8140-1223-4f2b-942c-d28da73a393e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:06:26.230654 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:26.230654 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:26.230654 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:26.230654 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:26.230654 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:26.230654 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:26.230654 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:26.230654 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:26.230654 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:26.230654 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:26.230654 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:26.230654 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:26.230654 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:26.230654 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:26.230654 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:26.231909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:26.231909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:26.231909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:26.231909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:26.231909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:26.231909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:26.231909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:26.231909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:26.231909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:26.231909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:26.231909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:26.231909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:26.231909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:26.231909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:26.231909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:26.231909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:26.231909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:26.231909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:26.233942 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:26.233942 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:26.233942 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:26.233942 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:26.233942 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:26.233942 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:26.233942 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:26.233942 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:26.233942 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:06:26.233942 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:26.233942 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 398/801] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:06:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:26.233942 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52818f-cf4c-4e3a-a918-42479a31e980 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:26.233942 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52818f-cf4c-4e3a-a918-42479a31e980 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:26.236397 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52818f-cf4c-4e3a-a918-42479a31e980 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:26.236397 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 399/802] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:26.239412 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52818f-cf4c-4e3a-a918-42479a31e980 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:26.240844 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 404/803] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:26.243224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537cd0e-f5bb-44ec-98ce-0acd0f966529 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:26.243224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537cd0e-f5bb-44ec-98ce-0acd0f966529 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:26.243683 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537cd0e-f5bb-44ec-98ce-0acd0f966529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:26.280252 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-5537cd0e-f5bb-44ec-98ce-0acd0f966529 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:26.281562 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5537cd0e-f5bb-44ec-98ce-0acd0f966529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:26.361015 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52818f-cf4c-4e3a-a918-42479a31e980 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:26.369436 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 405/804] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:26.369436 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537cd0e-f5bb-44ec-98ce-0acd0f966529 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:26.412389 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f3af0-2508-400e-9779-704c19f76abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:26.413072 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f3af0-2508-400e-9779-704c19f76abd None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:26.413355 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f3af0-2508-400e-9779-704c19f76abd None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:26.414308 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f3af0-2508-400e-9779-704c19f76abd None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:26.415897 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f3af0-2508-400e-9779-704c19f76abd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:26.416213 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f3af0-2508-400e-9779-704c19f76abd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:26.417692 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f3af0-2508-400e-9779-704c19f76abd None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:26.437948 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 400/805] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:06:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:26.438887 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f3af0-2508-400e-9779-704c19f76abd None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:26.483271 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5537cd0e-f5bb-44ec-98ce-0acd0f966529 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:26.518880 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c4d17-298b-4fe1-8d21-5953028ba3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:26.519678 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c4d17-298b-4fe1-8d21-5953028ba3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:26.519958 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c4d17-298b-4fe1-8d21-5953028ba3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:26.520231 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c4d17-298b-4fe1-8d21-5953028ba3d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:26.531544 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c4d17-298b-4fe1-8d21-5953028ba3d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:06:26.539906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-8f4c4d17-298b-4fe1-8d21-5953028ba3d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:06:26.539906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:26.539906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:26.539906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:26.539906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:26.539906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:26.539906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:26.539906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:26.539906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:26.539906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:26.539906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:26.539906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:26.539906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:06:26.539906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:06:26.539906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:06:26.539906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:06:26.540983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:06:26.540983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:06:26.540983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:06:26.540983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:06:26.540983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:26.540983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:26.540983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:26.540983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:26.540983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:26.540983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:26.540983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:26.540983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:26.540983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:26.540983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:26.540983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:26.540983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:26.541949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:26.541949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:26.541949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:26.541949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:26.541949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:06:26.541949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:06:26.541949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:06:26.541949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:06:26.541949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:06:26.541949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:06:26.541949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:06:26.541949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:26.541949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 406/806] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:06:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:26.544320 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c4d17-298b-4fe1-8d21-5953028ba3d1 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:26.548563 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f3af0-2508-400e-9779-704c19f76abd None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:26.585473 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3675dcd-f47d-41d8-8e81-4ad6c4cc518a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:26.587038 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3675dcd-f47d-41d8-8e81-4ad6c4cc518a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:26.587324 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3675dcd-f47d-41d8-8e81-4ad6c4cc518a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:26.587601 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3675dcd-f47d-41d8-8e81-4ad6c4cc518a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:26.588269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3675dcd-f47d-41d8-8e81-4ad6c4cc518a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:26.589709 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3675dcd-f47d-41d8-8e81-4ad6c4cc518a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:26.603426 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f3675dcd-f47d-41d8-8e81-4ad6c4cc518a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:06:26.603426 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:26.603426 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:06:26.603426 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:06:26.603426 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:06:26.603426 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:06:26.603426 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:06:26.603426 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:26.603426 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:06:26.603426 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:26.603426 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:26.603426 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:26.603426 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:26.603426 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:26.603426 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:26.603426 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:26.605809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:26.605809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:26.605809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:26.605809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:26.605809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:26.605809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:26.605809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:26.605809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:06:26.605809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:06:26.605809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:06:26.605809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:06:26.605809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:26.605809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:26.605809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:26.605809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:26.605809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:26.608013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:26.608013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:26.608013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:26.608013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:26.608013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:26.608013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:26.608013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:26.608013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:26.608013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:26.608013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:26.608013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:26.608013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:06:26.608013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:26.608013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:06:26.608013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:26.610431 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 401/807] 10.222.0.48 () {56 vars in 1129 bytes} [Mon May 9 15:06:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:26.617439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3675dcd-f47d-41d8-8e81-4ad6c4cc518a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:26.647470 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c4d17-298b-4fe1-8d21-5953028ba3d1 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:26.684410 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee6014-04cb-4fea-9706-619ec23f0b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:26.685070 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee6014-04cb-4fea-9706-619ec23f0b16 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:26.685350 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee6014-04cb-4fea-9706-619ec23f0b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:26.685649 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee6014-04cb-4fea-9706-619ec23f0b16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:26.728575 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3675dcd-f47d-41d8-8e81-4ad6c4cc518a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:26.762235 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee6014-04cb-4fea-9706-619ec23f0b16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:26.763610 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee6014-04cb-4fea-9706-619ec23f0b16 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:26.779789 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b46ab-5643-4564-9941-e8fd6fec324b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:26.780477 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b46ab-5643-4564-9941-e8fd6fec324b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:26.785424 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b46ab-5643-4564-9941-e8fd6fec324b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:26.785424 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b46ab-5643-4564-9941-e8fd6fec324b None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:26.785424 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b46ab-5643-4564-9941-e8fd6fec324b None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:26.785424 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b46ab-5643-4564-9941-e8fd6fec324b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:26.785424 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b46ab-5643-4564-9941-e8fd6fec324b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:26.792954 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 402/808] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:06:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:26.793906 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b46ab-5643-4564-9941-e8fd6fec324b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:26.878599 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 407/809] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:06:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:06:26.879584 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee6014-04cb-4fea-9706-619ec23f0b16 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:26.912528 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b46ab-5643-4564-9941-e8fd6fec324b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:26.951130 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49f26c-b68b-425f-ac46-1648dd315b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:26.951813 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49f26c-b68b-425f-ac46-1648dd315b05 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:26.952095 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49f26c-b68b-425f-ac46-1648dd315b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:26.952378 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49f26c-b68b-425f-ac46-1648dd315b05 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:26.953094 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49f26c-b68b-425f-ac46-1648dd315b05 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:26.953441 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49f26c-b68b-425f-ac46-1648dd315b05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:26.954909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49f26c-b68b-425f-ac46-1648dd315b05 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:26.964872 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 403/810] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 9 15:06:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:26.966691 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49f26c-b68b-425f-ac46-1648dd315b05 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:26.989870 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee6014-04cb-4fea-9706-619ec23f0b16 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:27.027105 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d689f-2b13-409c-bf94-a3e52dccd066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:27.027835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d689f-2b13-409c-bf94-a3e52dccd066 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:27.028110 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d689f-2b13-409c-bf94-a3e52dccd066 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:27.028383 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d689f-2b13-409c-bf94-a3e52dccd066 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:27.039571 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d689f-2b13-409c-bf94-a3e52dccd066 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:27.042452 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d689f-2b13-409c-bf94-a3e52dccd066 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:27.065546 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-da9d689f-2b13-409c-bf94-a3e52dccd066 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:27.065546 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:27.065546 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:27.065546 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:27.065546 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:27.065546 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:27.065546 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:27.065546 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:27.065546 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:27.065546 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:27.065546 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:27.065546 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:27.065546 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:27.065546 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:27.065546 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:27.067881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:27.067881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:27.067881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:27.067881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:27.067881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:27.067881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:27.067881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:27.067881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:27.067881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:27.067881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:27.067881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:27.067881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:27.067881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:27.067881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:27.067881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:27.067881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:27.067881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:27.070488 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:27.070488 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:27.070488 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:27.070488 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:27.070488 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 408/811] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:27.070488 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d689f-2b13-409c-bf94-a3e52dccd066 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:27.085039 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49f26c-b68b-425f-ac46-1648dd315b05 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:27.127439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622664c-eb0f-4d07-9862-a6c58a46dc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:27.128252 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622664c-eb0f-4d07-9862-a6c58a46dc9a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:27.128533 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622664c-eb0f-4d07-9862-a6c58a46dc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:27.128805 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622664c-eb0f-4d07-9862-a6c58a46dc9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:27.153827 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622664c-eb0f-4d07-9862-a6c58a46dc9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:27.157083 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622664c-eb0f-4d07-9862-a6c58a46dc9a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:27.181181 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-2622664c-eb0f-4d07-9862-a6c58a46dc9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:27.181181 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:27.181181 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:27.181181 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:27.181181 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:27.181181 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:27.181181 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:27.181181 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:27.181181 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:27.181181 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:27.181181 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:27.181181 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:27.181181 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:27.181181 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:27.181181 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:27.183059 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:27.183059 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:27.183059 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:27.183059 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:27.183059 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:27.183059 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:27.183059 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:27.183059 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:27.183059 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:27.183059 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:27.183059 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:27.183059 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:27.183059 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:27.183059 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:27.183059 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:27.183059 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:27.183059 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:27.185071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:27.185071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:27.185071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:27.185071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:27.185071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 404/812] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:27.185071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622664c-eb0f-4d07-9862-a6c58a46dc9a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:27.201658 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d689f-2b13-409c-bf94-a3e52dccd066 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:27.240155 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae8ca6-4795-4439-817a-21cffe95cdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:27.240925 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae8ca6-4795-4439-817a-21cffe95cdab None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:27.241280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae8ca6-4795-4439-817a-21cffe95cdab None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:27.241684 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae8ca6-4795-4439-817a-21cffe95cdab None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:27.242471 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae8ca6-4795-4439-817a-21cffe95cdab None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:27.242849 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae8ca6-4795-4439-817a-21cffe95cdab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:27.244290 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae8ca6-4795-4439-817a-21cffe95cdab None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:27.253524 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 409/813] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 9 15:06:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:27.254622 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae8ca6-4795-4439-817a-21cffe95cdab None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:27.314488 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622664c-eb0f-4d07-9862-a6c58a46dc9a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:27.358892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09dc16-f632-4a0a-a362-7bdde3e0d5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:27.359571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09dc16-f632-4a0a-a362-7bdde3e0d5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:27.360004 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae8ca6-4795-4439-817a-21cffe95cdab None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:27.360150 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09dc16-f632-4a0a-a362-7bdde3e0d5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:27.360364 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09dc16-f632-4a0a-a362-7bdde3e0d5d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:27.361094 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09dc16-f632-4a0a-a362-7bdde3e0d5d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:27.361414 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09dc16-f632-4a0a-a362-7bdde3e0d5d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:27.363834 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09dc16-f632-4a0a-a362-7bdde3e0d5d8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:27.378602 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 405/814] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:27.379623 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09dc16-f632-4a0a-a362-7bdde3e0d5d8 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:27.406674 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161638a-443e-4a52-a1df-09df470bf9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:27.407367 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161638a-443e-4a52-a1df-09df470bf9eb None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:27.407864 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161638a-443e-4a52-a1df-09df470bf9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:27.408149 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161638a-443e-4a52-a1df-09df470bf9eb None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:27.409507 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161638a-443e-4a52-a1df-09df470bf9eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:27.410117 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161638a-443e-4a52-a1df-09df470bf9eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:27.411719 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161638a-443e-4a52-a1df-09df470bf9eb None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:27.429892 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 410/815] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:27.431497 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161638a-443e-4a52-a1df-09df470bf9eb None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:27.505918 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09dc16-f632-4a0a-a362-7bdde3e0d5d8 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:27.542133 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c51022-2c6c-4fdf-98e7-7af0bb09fed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:27.543090 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c51022-2c6c-4fdf-98e7-7af0bb09fed8 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:27.543519 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c51022-2c6c-4fdf-98e7-7af0bb09fed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:27.543935 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c51022-2c6c-4fdf-98e7-7af0bb09fed8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:27.544817 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c51022-2c6c-4fdf-98e7-7af0bb09fed8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:27.546359 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c51022-2c6c-4fdf-98e7-7af0bb09fed8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:27.560002 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161638a-443e-4a52-a1df-09df470bf9eb None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:27.577713 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 406/816] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:06:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:06:27.579482 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c51022-2c6c-4fdf-98e7-7af0bb09fed8 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:27.617413 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120f14d-c5f9-46cc-b841-9910aff0a9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:27.618408 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120f14d-c5f9-46cc-b841-9910aff0a9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:27.618704 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120f14d-c5f9-46cc-b841-9910aff0a9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:27.619324 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120f14d-c5f9-46cc-b841-9910aff0a9c3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:27.631096 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120f14d-c5f9-46cc-b841-9910aff0a9c3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:27.633320 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120f14d-c5f9-46cc-b841-9910aff0a9c3 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:27.654785 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-b120f14d-c5f9-46cc-b841-9910aff0a9c3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:06:27.654785 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:27.654785 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:27.654785 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:27.654785 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:27.654785 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:27.654785 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:27.654785 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:27.654785 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:27.654785 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:27.654785 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:27.654785 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:27.654785 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:27.654785 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:27.654785 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:27.654785 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:27.655830 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:27.655830 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:27.655830 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:27.655830 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:27.655830 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:27.655830 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:27.655830 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:27.655830 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:27.655830 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:27.655830 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:27.655830 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:27.655830 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:27.655830 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:27.655830 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:27.655830 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:27.655830 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:27.655830 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:27.655830 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:27.656810 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:27.656810 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:27.656810 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:27.656810 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:27.656810 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:27.656810 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:27.656810 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:27.656810 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:27.656810 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:06:27.656810 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:27.661116 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 411/817] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:06:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:27.662784 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd52ab-1107-4c19-90c8-4d9e5cfd57d2 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:27.664589 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd52ab-1107-4c19-90c8-4d9e5cfd57d2 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:27.664895 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd52ab-1107-4c19-90c8-4d9e5cfd57d2 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:27.666913 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 412/818] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:27.667715 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd52ab-1107-4c19-90c8-4d9e5cfd57d2 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:27.718161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c51022-2c6c-4fdf-98e7-7af0bb09fed8 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:27.759192 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05eb3e-681f-4c8e-b12d-4f11f32f9efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:27.759986 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05eb3e-681f-4c8e-b12d-4f11f32f9efa None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:27.760372 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05eb3e-681f-4c8e-b12d-4f11f32f9efa None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:27.760709 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05eb3e-681f-4c8e-b12d-4f11f32f9efa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:27.769949 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05eb3e-681f-4c8e-b12d-4f11f32f9efa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:27.770490 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05eb3e-681f-4c8e-b12d-4f11f32f9efa None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:27.787507 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-cc05eb3e-681f-4c8e-b12d-4f11f32f9efa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:27.787507 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:27.787507 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:27.787507 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:27.787507 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:27.787507 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:27.787507 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:27.787507 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:27.787507 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:27.787507 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:27.787507 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:27.787507 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:27.787507 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:27.787507 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:27.787507 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:27.791188 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:27.791188 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:27.791188 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:27.791188 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:27.791188 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:27.791188 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:27.791188 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:27.791188 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:27.791188 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:27.791188 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:27.791188 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:27.791188 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:27.791188 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:27.791188 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:27.791188 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:27.791188 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:27.791188 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:27.794131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:27.794131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:27.794131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:27.794131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:27.794131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:27.794131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:27.794131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:27.794131 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:27.796011 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 407/819] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:27.796278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ccc71-555e-4775-a460-09d69bb48203 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:27.796435 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ccc71-555e-4775-a460-09d69bb48203 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:27.797353 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ccc71-555e-4775-a460-09d69bb48203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:27.799595 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd52ab-1107-4c19-90c8-4d9e5cfd57d2 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:27.817959 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-cf2ccc71-555e-4775-a460-09d69bb48203 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:27.819496 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-cf2ccc71-555e-4775-a460-09d69bb48203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:27.846191 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99275ff-4d38-4d34-8f29-8c72c327e7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:27.846776 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99275ff-4d38-4d34-8f29-8c72c327e7fb None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:27.847136 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99275ff-4d38-4d34-8f29-8c72c327e7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:27.847404 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99275ff-4d38-4d34-8f29-8c72c327e7fb None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:27.848224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99275ff-4d38-4d34-8f29-8c72c327e7fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:27.848532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99275ff-4d38-4d34-8f29-8c72c327e7fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:27.849984 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99275ff-4d38-4d34-8f29-8c72c327e7fb None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:27.871616 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 413/820] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 9 15:06:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:27.872889 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99275ff-4d38-4d34-8f29-8c72c327e7fb None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:27.905783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 408/821] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:27.907092 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ccc71-555e-4775-a460-09d69bb48203 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:28.007708 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99275ff-4d38-4d34-8f29-8c72c327e7fb None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:28.015744 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ccc71-555e-4775-a460-09d69bb48203 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:28.048051 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d4362-ec25-4454-97f7-8a574bd2782f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:28.048707 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d4362-ec25-4454-97f7-8a574bd2782f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:28.048990 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d4362-ec25-4454-97f7-8a574bd2782f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:28.049463 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d4362-ec25-4454-97f7-8a574bd2782f None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:28.050649 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d4362-ec25-4454-97f7-8a574bd2782f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:28.051019 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d4362-ec25-4454-97f7-8a574bd2782f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:28.053118 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d4362-ec25-4454-97f7-8a574bd2782f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:28.053975 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b936b4f-1d1f-4d0f-a9ca-9d29d2e3b482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:28.056006 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b936b4f-1d1f-4d0f-a9ca-9d29d2e3b482 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:28.056578 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b936b4f-1d1f-4d0f-a9ca-9d29d2e3b482 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:28.057130 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b936b4f-1d1f-4d0f-a9ca-9d29d2e3b482 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:28.068697 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b936b4f-1d1f-4d0f-a9ca-9d29d2e3b482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:28.070297 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 414/822] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:06:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:28.070988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b936b4f-1d1f-4d0f-a9ca-9d29d2e3b482 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:28.071354 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d4362-ec25-4454-97f7-8a574bd2782f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:28.091332 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-4b936b4f-1d1f-4d0f-a9ca-9d29d2e3b482 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:28.091332 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:28.091332 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:28.091332 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:28.091332 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:28.091332 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:28.091332 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:28.091332 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:28.091332 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:28.091332 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:28.091332 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:28.091332 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:28.091332 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:28.091332 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:28.091332 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:28.092356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:28.092356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:28.092356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:28.092356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:28.092356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:28.092356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:28.092356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:28.092356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:28.092356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:28.092356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:28.092356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:28.092356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:28.092356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:28.092356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:28.092356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:28.092356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:28.092356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:28.093271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:28.093271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:28.093271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:28.093271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:28.100335 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 409/823] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:28.102079 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b936b4f-1d1f-4d0f-a9ca-9d29d2e3b482 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:28.195569 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d4362-ec25-4454-97f7-8a574bd2782f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:28.221427 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b936b4f-1d1f-4d0f-a9ca-9d29d2e3b482 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:28.230831 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672a37e-1baf-4ecc-8c84-c9b6ab94f963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:28.232354 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672a37e-1baf-4ecc-8c84-c9b6ab94f963 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:28.232841 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672a37e-1baf-4ecc-8c84-c9b6ab94f963 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:28.233342 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672a37e-1baf-4ecc-8c84-c9b6ab94f963 None admin] PATH_INFO: `/v3/services/network` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:28.234277 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672a37e-1baf-4ecc-8c84-c9b6ab94f963 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:28.236160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672a37e-1baf-4ecc-8c84-c9b6ab94f963 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:28.249463 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-2672a37e-1baf-4ecc-8c84-c9b6ab94f963 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:06:28.249463 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:28.249463 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:06:28.249463 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:06:28.249463 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:06:28.249463 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:06:28.249463 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:06:28.249463 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:28.249463 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:06:28.249463 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:28.249463 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:28.249463 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:28.249463 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:28.249463 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:28.249463 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:28.249463 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:28.249463 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:28.250547 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:28.250547 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:28.250547 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:28.250547 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:28.250547 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:28.250547 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:28.250547 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:06:28.250547 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:06:28.250547 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:06:28.250547 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:06:28.250547 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:28.250547 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:28.250547 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:28.250547 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:28.250547 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:28.250547 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:28.251401 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:28.251401 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:28.251401 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:28.251401 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:28.251401 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:28.251401 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:28.251401 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:28.251401 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:28.251401 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:28.251401 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:28.251401 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:06:28.251401 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:28.251401 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:06:28.251401 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:28.254391 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 415/824] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:28 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:28.255395 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672a37e-1baf-4ecc-8c84-c9b6ab94f963 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:28.268476 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390443f-b013-4de3-a61f-0bb5061d89de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:28.269617 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390443f-b013-4de3-a61f-0bb5061d89de None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:28.270118 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390443f-b013-4de3-a61f-0bb5061d89de None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:28.270654 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390443f-b013-4de3-a61f-0bb5061d89de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:28.271715 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390443f-b013-4de3-a61f-0bb5061d89de None admin] RBAC: Adding query filter params (role.id=3409f00ead9e455182684faa27b1f8f0, scope.project.id=4fcadeae44cc4547905b83bfebec79c7, user.id=65e7a4e661ef4425b24844c3500b0b58) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:28.272279 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390443f-b013-4de3-a61f-0bb5061d89de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:28.274223 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390443f-b013-4de3-a61f-0bb5061d89de None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:28.281527 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 410/825] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:06:28 2022] GET /identity/v3/role_assignments?user.id=65e7a4e661ef4425b24844c3500b0b58&scope.project.id=4fcadeae44cc4547905b83bfebec79c7&role.id=3409f00ead9e455182684faa27b1f8f0 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:28.282999 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390443f-b013-4de3-a61f-0bb5061d89de None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:28.370790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672a37e-1baf-4ecc-8c84-c9b6ab94f963 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:28.399756 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390443f-b013-4de3-a61f-0bb5061d89de None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:28.434156 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1884925-57c3-4e9b-b654-4bd0832935a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:28.435155 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1884925-57c3-4e9b-b654-4bd0832935a7 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:28.435155 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1884925-57c3-4e9b-b654-4bd0832935a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:28.435431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1884925-57c3-4e9b-b654-4bd0832935a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:28.436120 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1884925-57c3-4e9b-b654-4bd0832935a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:28.436425 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1884925-57c3-4e9b-b654-4bd0832935a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:28.437862 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1884925-57c3-4e9b-b654-4bd0832935a7 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:28.444920 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405c53a-61bd-4ab9-a250-ebad51421716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:28.446910 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405c53a-61bd-4ab9-a250-ebad51421716 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:28.447401 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405c53a-61bd-4ab9-a250-ebad51421716 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:28.447876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405c53a-61bd-4ab9-a250-ebad51421716 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:28.448831 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405c53a-61bd-4ab9-a250-ebad51421716 None admin] RBAC: Adding query filter params (name=network) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:28.449427 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405c53a-61bd-4ab9-a250-ebad51421716 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:28.451035 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405c53a-61bd-4ab9-a250-ebad51421716 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:28.457092 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 411/826] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:06:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:28.468109 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 416/827] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:28.469616 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405c53a-61bd-4ab9-a250-ebad51421716 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:28.490958 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1884925-57c3-4e9b-b654-4bd0832935a7 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:28.583484 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405c53a-61bd-4ab9-a250-ebad51421716 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:28.625297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67100b2c-4aaf-4b0b-b5c2-38a5c4f73c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:28.625954 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67100b2c-4aaf-4b0b-b5c2-38a5c4f73c1c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:28.626215 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67100b2c-4aaf-4b0b-b5c2-38a5c4f73c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:28.626488 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67100b2c-4aaf-4b0b-b5c2-38a5c4f73c1c None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:28.627194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67100b2c-4aaf-4b0b-b5c2-38a5c4f73c1c None admin] RBAC: Adding query filter params (type=network) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:28.627498 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67100b2c-4aaf-4b0b-b5c2-38a5c4f73c1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:28.628854 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67100b2c-4aaf-4b0b-b5c2-38a5c4f73c1c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:28.635850 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 412/828] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:06:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:28.638299 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dd3ac-211c-42de-90c5-a015b032544a None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:28.638804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dd3ac-211c-42de-90c5-a015b032544a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:28.639311 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dd3ac-211c-42de-90c5-a015b032544a None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:28.639449 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1884925-57c3-4e9b-b654-4bd0832935a7 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:28.641404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 413/829] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:28.641996 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591dd3ac-211c-42de-90c5-a015b032544a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:28.686437 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6255789-506e-4555-ab36-2f3e42d79ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:28.688107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6255789-506e-4555-ab36-2f3e42d79ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:28.688394 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6255789-506e-4555-ab36-2f3e42d79ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:28.688675 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6255789-506e-4555-ab36-2f3e42d79ef8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:28.697956 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6255789-506e-4555-ab36-2f3e42d79ef8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:28.699597 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6255789-506e-4555-ab36-2f3e42d79ef8 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:28.718069 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-f6255789-506e-4555-ab36-2f3e42d79ef8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:28.718069 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:28.718069 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:28.718069 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:28.718069 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:28.718069 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:28.718069 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:28.718069 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:28.718069 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:28.718069 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:28.718069 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:28.718069 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:28.718069 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:28.718069 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:28.718069 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:28.719302 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:28.719302 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:28.719302 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:28.719302 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:28.719302 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:28.719302 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:28.719302 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:28.719302 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:28.719302 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:28.719302 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:28.719302 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:28.719302 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:28.719302 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:28.719302 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:28.719302 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:28.719302 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:28.719302 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:28.720444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:28.720444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:28.720444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:28.720444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:28.720444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:28.720444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:28.720444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:28.720444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:28.720444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 417/830] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:28.726565 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd14f6-bfa5-4195-8c06-c06ac08a03bc None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:28.727400 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd14f6-bfa5-4195-8c06-c06ac08a03bc None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:28.727694 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd14f6-bfa5-4195-8c06-c06ac08a03bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:28.749215 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-9dfd14f6-bfa5-4195-8c06-c06ac08a03bc None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:28.750888 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-9dfd14f6-bfa5-4195-8c06-c06ac08a03bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:28.769139 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591dd3ac-211c-42de-90c5-a015b032544a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:28.815246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2740d-9c12-4f5f-9a32-e133f2aa97b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:28.815921 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2740d-9c12-4f5f-9a32-e133f2aa97b8 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:28.816534 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2740d-9c12-4f5f-9a32-e133f2aa97b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:28.816816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2740d-9c12-4f5f-9a32-e133f2aa97b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:28.817895 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2740d-9c12-4f5f-9a32-e133f2aa97b8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:28.820988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2740d-9c12-4f5f-9a32-e133f2aa97b8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:28.825002 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 418/831] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:28.826038 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd14f6-bfa5-4195-8c06-c06ac08a03bc None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:28.860955 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 414/832] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:06:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:06:28.861903 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2740d-9c12-4f5f-9a32-e133f2aa97b8 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:29.057149 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd14f6-bfa5-4195-8c06-c06ac08a03bc None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:29.104444 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2740d-9c12-4f5f-9a32-e133f2aa97b8 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:29.125327 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ed513-5114-4645-bdab-d9f6a707b865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:29.126459 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ed513-5114-4645-bdab-d9f6a707b865 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:29.126970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ed513-5114-4645-bdab-d9f6a707b865 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:29.127470 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ed513-5114-4645-bdab-d9f6a707b865 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:29.128619 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ed513-5114-4645-bdab-d9f6a707b865 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:29.129320 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ed513-5114-4645-bdab-d9f6a707b865 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:29.131077 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ed513-5114-4645-bdab-d9f6a707b865 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:29.145627 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 419/833] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:06:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:29.152069 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ed513-5114-4645-bdab-d9f6a707b865 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:29.170485 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca93b9-5027-4806-8568-7063eca2d654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:29.171903 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca93b9-5027-4806-8568-7063eca2d654 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:29.172372 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca93b9-5027-4806-8568-7063eca2d654 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:29.172982 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca93b9-5027-4806-8568-7063eca2d654 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:29.187407 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca93b9-5027-4806-8568-7063eca2d654 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:06:29.198224 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-9fca93b9-5027-4806-8568-7063eca2d654 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:06:29.198224 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:29.198224 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:29.198224 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:29.198224 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:29.198224 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:29.198224 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:29.198224 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:29.198224 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:29.198224 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:29.198224 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:29.198224 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:29.198224 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:06:29.198224 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:06:29.198224 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:06:29.198224 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:06:29.199238 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:06:29.199238 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:06:29.199238 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:06:29.199238 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:06:29.199238 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:29.199238 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:29.199238 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:29.199238 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:29.199238 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:29.199238 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:29.199238 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:29.199238 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:29.199238 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:29.199238 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:29.199238 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:29.199238 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:29.200099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:29.200099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:29.200099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:29.200099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:29.200099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:06:29.200099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:06:29.200099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:06:29.200099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:06:29.200099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:06:29.200099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:06:29.200099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:06:29.200099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:29.202695 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 415/834] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:06:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:29.209358 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca93b9-5027-4806-8568-7063eca2d654 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:29.272330 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ed513-5114-4645-bdab-d9f6a707b865 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:29.326146 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64304e4e-5cb0-4d3f-9a30-5b99df5f81f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:29.326961 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64304e4e-5cb0-4d3f-9a30-5b99df5f81f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:29.327246 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64304e4e-5cb0-4d3f-9a30-5b99df5f81f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:29.327526 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64304e4e-5cb0-4d3f-9a30-5b99df5f81f2 None admin] PATH_INFO: `/v3/projects/4fcadeae44cc4547905b83bfebec79c7/users/057ad64901314362914287aed5b468ea/roles/d8aa93d29788400a97d04db10d8fb8d5` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:29.339055 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca93b9-5027-4806-8568-7063eca2d654 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:29.349734 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64304e4e-5cb0-4d3f-9a30-5b99df5f81f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4fcadeae44cc4547905b83bfebec79c7, user_id=057ad64901314362914287aed5b468ea, role_id=d8aa93d29788400a97d04db10d8fb8d5)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:29.351727 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64304e4e-5cb0-4d3f-9a30-5b99df5f81f2 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:29.377615 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 420/835] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:06:29 2022] PUT /identity/v3/projects/4fcadeae44cc4547905b83bfebec79c7/users/057ad64901314362914287aed5b468ea/roles/d8aa93d29788400a97d04db10d8fb8d5 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:06:29.379454 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006d996-bbf8-4697-834a-d711ae707ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:29.380203 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006d996-bbf8-4697-834a-d711ae707ffa None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:29.380485 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006d996-bbf8-4697-834a-d711ae707ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:29.380803 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006d996-bbf8-4697-834a-d711ae707ffa None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:29.381741 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006d996-bbf8-4697-834a-d711ae707ffa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:29.382055 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006d996-bbf8-4697-834a-d711ae707ffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:29.384134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006d996-bbf8-4697-834a-d711ae707ffa None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:29.394727 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 416/836] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:06:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:29.400715 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64304e4e-5cb0-4d3f-9a30-5b99df5f81f2 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:29.517831 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64304e4e-5cb0-4d3f-9a30-5b99df5f81f2 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:29.555180 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4044d-8bcb-4f4e-b6a3-50ec80514d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:29.555989 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4044d-8bcb-4f4e-b6a3-50ec80514d17 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:29.556268 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4044d-8bcb-4f4e-b6a3-50ec80514d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:29.556534 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4044d-8bcb-4f4e-b6a3-50ec80514d17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:29.567888 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4044d-8bcb-4f4e-b6a3-50ec80514d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:29.569425 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4044d-8bcb-4f4e-b6a3-50ec80514d17 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:29.588415 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-61e4044d-8bcb-4f4e-b6a3-50ec80514d17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:29.588415 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:29.588415 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:29.588415 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:29.588415 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:29.588415 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:29.588415 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:29.588415 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:29.588415 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:29.588415 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:29.588415 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:29.588415 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:29.588415 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:29.588415 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:29.588415 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:29.590585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:29.590585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:29.590585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:29.590585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:29.590585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:29.590585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:29.590585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:29.590585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:29.590585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:29.590585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:29.590585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:29.590585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:29.590585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:29.590585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:29.590585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:29.590585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:29.590585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:29.592777 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:29.592777 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:29.592777 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:29.592777 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:29.592777 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 421/837] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:29.595872 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006d996-bbf8-4697-834a-d711ae707ffa None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:29.701994 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006d996-bbf8-4697-834a-d711ae707ffa None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:29.736536 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658832cb-6e03-4959-9193-1bf277e8c669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:29.737206 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658832cb-6e03-4959-9193-1bf277e8c669 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:29.737521 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658832cb-6e03-4959-9193-1bf277e8c669 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:29.737796 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658832cb-6e03-4959-9193-1bf277e8c669 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:29.738524 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658832cb-6e03-4959-9193-1bf277e8c669 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:29.738824 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658832cb-6e03-4959-9193-1bf277e8c669 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:29.740183 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658832cb-6e03-4959-9193-1bf277e8c669 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:29.753758 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 417/838] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:29.759030 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4044d-8bcb-4f4e-b6a3-50ec80514d17 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:29.864875 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4044d-8bcb-4f4e-b6a3-50ec80514d17 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:29.903040 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abb09f-82b5-43f2-8317-9e17ff1dde61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:29.903854 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abb09f-82b5-43f2-8317-9e17ff1dde61 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:29.904142 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abb09f-82b5-43f2-8317-9e17ff1dde61 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:29.904423 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abb09f-82b5-43f2-8317-9e17ff1dde61 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:29.913049 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abb09f-82b5-43f2-8317-9e17ff1dde61 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:29.915327 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abb09f-82b5-43f2-8317-9e17ff1dde61 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:29.932515 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-c3abb09f-82b5-43f2-8317-9e17ff1dde61 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:06:29.932515 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:29.932515 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:29.932515 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:29.932515 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:29.932515 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:29.932515 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:29.932515 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:29.932515 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:29.932515 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:29.932515 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:29.932515 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:29.932515 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:29.932515 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:29.932515 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:29.932515 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:29.934846 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:29.934846 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:29.934846 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:29.934846 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:29.934846 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:29.934846 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:29.934846 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:29.934846 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:29.934846 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:29.934846 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:29.934846 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:29.934846 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:29.934846 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:29.934846 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:29.934846 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:29.934846 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:29.934846 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:29.934846 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:29.937307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:29.937307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:29.937307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:29.937307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:29.937307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:29.937307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:29.937307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:29.937307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:29.937307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:06:29.937307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:29.937307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 422/839] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:06:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:29.945400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658832cb-6e03-4959-9193-1bf277e8c669 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:30.050808 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658832cb-6e03-4959-9193-1bf277e8c669 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:30.093655 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591add7a-bd28-417b-883a-6f779e03e81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:30.094398 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591add7a-bd28-417b-883a-6f779e03e81b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:30.094747 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591add7a-bd28-417b-883a-6f779e03e81b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:30.095129 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591add7a-bd28-417b-883a-6f779e03e81b None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:30.096132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591add7a-bd28-417b-883a-6f779e03e81b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:30.096514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591add7a-bd28-417b-883a-6f779e03e81b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:30.098202 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591add7a-bd28-417b-883a-6f779e03e81b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:30.120293 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 418/840] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 9 15:06:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:30.128836 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abb09f-82b5-43f2-8317-9e17ff1dde61 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:30.251432 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abb09f-82b5-43f2-8317-9e17ff1dde61 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:30.251767 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5c7d6-d4a3-490f-b132-1b54202cb118 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:30.251767 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5c7d6-d4a3-490f-b132-1b54202cb118 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:30.251767 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5c7d6-d4a3-490f-b132-1b54202cb118 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:30.252486 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 419/841] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:30.258812 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d6b87-9757-4425-bf97-70e0cb4e7549 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:30.259106 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d6b87-9757-4425-bf97-70e0cb4e7549 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:30.259356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d6b87-9757-4425-bf97-70e0cb4e7549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:30.281472 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-980d6b87-9757-4425-bf97-70e0cb4e7549 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:30.282968 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-980d6b87-9757-4425-bf97-70e0cb4e7549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:30.287178 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d13722-c756-44cb-810e-31871543d6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:30.288951 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d13722-c756-44cb-810e-31871543d6fe None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:30.289665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d13722-c756-44cb-810e-31871543d6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:30.290383 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d13722-c756-44cb-810e-31871543d6fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:30.371955 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d13722-c756-44cb-810e-31871543d6fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:30.372601 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 420/842] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:06:30.373260 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d13722-c756-44cb-810e-31871543d6fe None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:30.390832 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d6b87-9757-4425-bf97-70e0cb4e7549 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:30.494112 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 423/843] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:06:30 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:06:30.499616 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d13722-c756-44cb-810e-31871543d6fe None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:30.507261 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d6b87-9757-4425-bf97-70e0cb4e7549 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:30.544923 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f1f94-43f5-4714-82d6-c5cad4cb495b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:30.545836 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f1f94-43f5-4714-82d6-c5cad4cb495b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:30.546052 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f1f94-43f5-4714-82d6-c5cad4cb495b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:30.546331 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f1f94-43f5-4714-82d6-c5cad4cb495b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:30.546995 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f1f94-43f5-4714-82d6-c5cad4cb495b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:30.548365 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f1f94-43f5-4714-82d6-c5cad4cb495b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:30.561436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-348f1f94-43f5-4714-82d6-c5cad4cb495b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:06:30.561436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:30.561436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:06:30.561436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:06:30.561436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:06:30.561436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:06:30.561436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:06:30.561436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:30.561436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:06:30.561436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:30.561436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:30.561436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:30.561436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:30.561436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:30.561436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:30.561436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:30.561436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:30.562543 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:30.562543 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:30.562543 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:30.562543 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:30.562543 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:30.562543 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:30.562543 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:06:30.562543 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:06:30.562543 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:06:30.562543 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:06:30.562543 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:30.562543 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:30.562543 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:30.562543 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:30.562543 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:30.562543 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:30.563388 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:30.563388 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:30.563388 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:30.563388 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:30.563388 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:30.563388 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:30.563388 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:30.563388 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:30.563388 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:30.563388 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:30.563388 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:06:30.563388 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:30.563388 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:06:30.563388 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:30.567860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 421/844] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:06:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:30.568765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f1f94-43f5-4714-82d6-c5cad4cb495b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:30.611176 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d13722-c756-44cb-810e-31871543d6fe None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:30.649645 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9703d6-82d3-45d9-9066-1a9078cd8b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:30.650869 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9703d6-82d3-45d9-9066-1a9078cd8b42 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:30.651419 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9703d6-82d3-45d9-9066-1a9078cd8b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:30.651941 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9703d6-82d3-45d9-9066-1a9078cd8b42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:30.665980 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9703d6-82d3-45d9-9066-1a9078cd8b42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:30.668041 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9703d6-82d3-45d9-9066-1a9078cd8b42 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:30.678402 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f1f94-43f5-4714-82d6-c5cad4cb495b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:30.693585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-6b9703d6-82d3-45d9-9066-1a9078cd8b42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:30.693585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:30.693585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:30.693585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:30.693585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:30.693585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:30.693585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:30.693585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:30.693585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:30.693585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:30.693585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:30.693585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:30.693585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:30.693585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:30.693585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:30.694576 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:30.694576 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:30.694576 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:30.694576 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:30.694576 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:30.694576 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:30.694576 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:30.694576 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:30.694576 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:30.694576 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:30.694576 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:30.694576 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:30.694576 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:30.694576 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:30.694576 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:30.694576 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:30.694576 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:30.696717 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:30.696717 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:30.696717 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:30.696717 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:30.702009 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 424/845] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:30.710176 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9703d6-82d3-45d9-9066-1a9078cd8b42 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:30.732029 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa00a5-234c-4148-9c4b-42330f00fb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:30.733260 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa00a5-234c-4148-9c4b-42330f00fb31 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:30.734573 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa00a5-234c-4148-9c4b-42330f00fb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:30.735685 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa00a5-234c-4148-9c4b-42330f00fb31 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:30.736874 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa00a5-234c-4148-9c4b-42330f00fb31 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:30.737500 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa00a5-234c-4148-9c4b-42330f00fb31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:30.739883 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa00a5-234c-4148-9c4b-42330f00fb31 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:30.748713 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 422/846] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:06:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:30.755135 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa00a5-234c-4148-9c4b-42330f00fb31 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:30.858162 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9703d6-82d3-45d9-9066-1a9078cd8b42 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:30.859422 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa00a5-234c-4148-9c4b-42330f00fb31 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:30.900053 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd12e2e-747f-43db-b2e0-92baceec1936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:30.900726 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd12e2e-747f-43db-b2e0-92baceec1936 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:30.901013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd12e2e-747f-43db-b2e0-92baceec1936 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:30.901154 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7834543-d617-4ee3-a4e2-12e187ae36f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:30.901343 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd12e2e-747f-43db-b2e0-92baceec1936 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:30.901783 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7834543-d617-4ee3-a4e2-12e187ae36f8 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:30.902045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd12e2e-747f-43db-b2e0-92baceec1936 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:30.902175 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7834543-d617-4ee3-a4e2-12e187ae36f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:30.902358 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd12e2e-747f-43db-b2e0-92baceec1936 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:30.902455 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7834543-d617-4ee3-a4e2-12e187ae36f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:30.903096 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7834543-d617-4ee3-a4e2-12e187ae36f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:30.903412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7834543-d617-4ee3-a4e2-12e187ae36f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:30.903727 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd12e2e-747f-43db-b2e0-92baceec1936 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:30.904757 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7834543-d617-4ee3-a4e2-12e187ae36f8 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:30.917706 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 423/847] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:06:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:30.918951 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98adc19-1b3b-474b-9084-ca2116d0ee21 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:30.919430 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98adc19-1b3b-474b-9084-ca2116d0ee21 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:30.919718 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98adc19-1b3b-474b-9084-ca2116d0ee21 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:30.925902 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 424/848] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:30.926522 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98adc19-1b3b-474b-9084-ca2116d0ee21 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:30.927073 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 425/849] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:30.929091 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca260d3e-d1a2-4f5c-a2d8-ff25d9f5a6bf None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:30.930560 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca260d3e-d1a2-4f5c-a2d8-ff25d9f5a6bf None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:30.931290 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca260d3e-d1a2-4f5c-a2d8-ff25d9f5a6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:30.953403 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-ca260d3e-d1a2-4f5c-a2d8-ff25d9f5a6bf None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:30.955488 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ca260d3e-d1a2-4f5c-a2d8-ff25d9f5a6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:31.057229 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 426/850] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:31.079459 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98adc19-1b3b-474b-9084-ca2116d0ee21 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:31.082788 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca260d3e-d1a2-4f5c-a2d8-ff25d9f5a6bf None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:31.127100 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b26a0c-97dc-4023-b0a4-78259d14a797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:31.128943 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b26a0c-97dc-4023-b0a4-78259d14a797 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:31.129125 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b26a0c-97dc-4023-b0a4-78259d14a797 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:31.129586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b26a0c-97dc-4023-b0a4-78259d14a797 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:31.142072 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b26a0c-97dc-4023-b0a4-78259d14a797 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:31.143561 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b26a0c-97dc-4023-b0a4-78259d14a797 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:31.162014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-86b26a0c-97dc-4023-b0a4-78259d14a797 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:31.162014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:31.162014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:31.162014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:31.162014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:31.162014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:31.162014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:31.162014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:31.162014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:31.162014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:31.162014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:31.162014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:31.162014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:31.162014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:31.162014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:31.163858 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:31.163858 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:31.163858 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:31.163858 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:31.163858 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:31.163858 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:31.163858 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:31.163858 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:31.163858 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:31.163858 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:31.163858 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:31.163858 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:31.163858 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:31.163858 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:31.163858 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:31.163858 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:31.163858 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:31.165046 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:31.165046 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:31.165046 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:31.165046 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:31.165046 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:31.165046 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:31.165046 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:31.165046 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:31.165046 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 425/851] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:31.172072 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b26a0c-97dc-4023-b0a4-78259d14a797 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:31.245835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca260d3e-d1a2-4f5c-a2d8-ff25d9f5a6bf None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:31.303008 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be41689-53c8-4cf3-aa9c-806e60fc4c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:31.304664 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be41689-53c8-4cf3-aa9c-806e60fc4c55 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:31.305243 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be41689-53c8-4cf3-aa9c-806e60fc4c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:31.305698 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be41689-53c8-4cf3-aa9c-806e60fc4c55 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:31.306634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be41689-53c8-4cf3-aa9c-806e60fc4c55 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:31.308572 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be41689-53c8-4cf3-aa9c-806e60fc4c55 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:31.326049 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-8be41689-53c8-4cf3-aa9c-806e60fc4c55 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:06:31.326049 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:31.326049 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:06:31.326049 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:06:31.326049 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:06:31.326049 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:06:31.326049 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:06:31.326049 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:31.326049 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:06:31.326049 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:31.326049 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:31.326049 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:31.326049 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:31.326049 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:31.326049 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:31.326049 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:31.327304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:31.327304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:31.327304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:31.327304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:31.327304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:31.327304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:31.327304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:31.327304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:06:31.327304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:06:31.327304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:06:31.327304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:06:31.327304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:31.327304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:31.327304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:31.327304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:31.327304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:31.334313 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:31.334313 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:31.334313 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:31.334313 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:31.334313 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:31.334313 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:31.334313 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:31.334313 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:31.334313 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:31.334313 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:31.334313 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:31.334313 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:06:31.334313 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:31.334313 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:06:31.334313 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:31.334313 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 427/852] 10.222.0.48 () {56 vars in 1132 bytes} [Mon May 9 15:06:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:31.335779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b26a0c-97dc-4023-b0a4-78259d14a797 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:31.338149 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be41689-53c8-4cf3-aa9c-806e60fc4c55 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:31.386317 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa03a31-767e-4834-bfe6-41c2bafe2270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:31.387632 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa03a31-767e-4834-bfe6-41c2bafe2270 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:31.388103 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa03a31-767e-4834-bfe6-41c2bafe2270 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:31.388556 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa03a31-767e-4834-bfe6-41c2bafe2270 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:31.389759 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa03a31-767e-4834-bfe6-41c2bafe2270 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:31.391146 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa03a31-767e-4834-bfe6-41c2bafe2270 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:31.392871 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa03a31-767e-4834-bfe6-41c2bafe2270 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:31.411208 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 426/853] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:06:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:31.418216 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa03a31-767e-4834-bfe6-41c2bafe2270 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:31.490308 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be41689-53c8-4cf3-aa9c-806e60fc4c55 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:31.539959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b7cc6-9aec-4e72-a297-a3a512d06adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:31.541068 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b7cc6-9aec-4e72-a297-a3a512d06adb None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:31.541697 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b7cc6-9aec-4e72-a297-a3a512d06adb None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:31.542229 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b7cc6-9aec-4e72-a297-a3a512d06adb None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:31.543239 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b7cc6-9aec-4e72-a297-a3a512d06adb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:31.543787 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b7cc6-9aec-4e72-a297-a3a512d06adb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:31.545474 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b7cc6-9aec-4e72-a297-a3a512d06adb None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:31.550730 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa03a31-767e-4834-bfe6-41c2bafe2270 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:31.557507 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 428/854] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:06:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:31.560337 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b7cc6-9aec-4e72-a297-a3a512d06adb None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:31.591568 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f65ba9-1872-482c-bc12-38d52b581e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:31.592525 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f65ba9-1872-482c-bc12-38d52b581e25 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:31.592934 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f65ba9-1872-482c-bc12-38d52b581e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:31.593301 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f65ba9-1872-482c-bc12-38d52b581e25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:31.595980 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f65ba9-1872-482c-bc12-38d52b581e25 None admin] RBAC: Adding query filter params (role.id=3409f00ead9e455182684faa27b1f8f0, scope.project.id=4fcadeae44cc4547905b83bfebec79c7, user.id=0b1f03accd91471ea1fe78073c86a97f) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:31.596304 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f65ba9-1872-482c-bc12-38d52b581e25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:31.597839 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f65ba9-1872-482c-bc12-38d52b581e25 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:31.613952 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 427/855] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:06:31 2022] GET /identity/v3/role_assignments?user.id=0b1f03accd91471ea1fe78073c86a97f&scope.project.id=4fcadeae44cc4547905b83bfebec79c7&role.id=3409f00ead9e455182684faa27b1f8f0 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:31.701795 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b7cc6-9aec-4e72-a297-a3a512d06adb None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:31.762334 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442562a-1ba2-4333-a437-146437cdad98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:31.763035 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442562a-1ba2-4333-a437-146437cdad98 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:31.763320 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442562a-1ba2-4333-a437-146437cdad98 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:31.763598 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442562a-1ba2-4333-a437-146437cdad98 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:31.764414 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442562a-1ba2-4333-a437-146437cdad98 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:31.764726 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442562a-1ba2-4333-a437-146437cdad98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:31.766218 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442562a-1ba2-4333-a437-146437cdad98 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:31.772103 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 429/856] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:06:31 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:31.945980 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320f077-eb53-4020-82ae-05f45d09ef3d None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:31.946440 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320f077-eb53-4020-82ae-05f45d09ef3d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:31.946822 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320f077-eb53-4020-82ae-05f45d09ef3d None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:31.948761 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 428/857] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:31.954989 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c75053-d873-4ca6-8630-2a79400983d2 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:31.955344 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c75053-d873-4ca6-8630-2a79400983d2 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:31.955705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c75053-d873-4ca6-8630-2a79400983d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:31.977959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-57c75053-d873-4ca6-8630-2a79400983d2 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:31.979755 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-57c75053-d873-4ca6-8630-2a79400983d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:32.087838 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 430/858] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:32.122292 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320f077-eb53-4020-82ae-05f45d09ef3d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:32.236417 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320f077-eb53-4020-82ae-05f45d09ef3d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:32.272445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4331e-7154-4d0f-ba4e-15fb14081bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:32.274233 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4331e-7154-4d0f-ba4e-15fb14081bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:32.274513 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4331e-7154-4d0f-ba4e-15fb14081bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:32.274784 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4331e-7154-4d0f-ba4e-15fb14081bf8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:32.287827 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4331e-7154-4d0f-ba4e-15fb14081bf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:06:32.296344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-4fd4331e-7154-4d0f-ba4e-15fb14081bf8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:06:32.296344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:32.296344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:32.296344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:32.296344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:32.296344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:32.296344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:32.296344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:32.296344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:32.296344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:32.296344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:32.296344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:32.296344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:06:32.296344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:06:32.296344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:06:32.296344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:06:32.297344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:06:32.297344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:06:32.297344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:06:32.297344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:06:32.297344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:32.297344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:32.297344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:32.297344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:32.297344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:32.297344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:32.297344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:32.297344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:32.297344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:32.297344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:32.297344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:32.297344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:32.298681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:32.298681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:32.298681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:32.298681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:32.298681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:06:32.298681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:06:32.298681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:06:32.298681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:06:32.298681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:06:32.298681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:06:32.298681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:06:32.298681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:32.298681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 429/859] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:06:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:32.304019 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c75053-d873-4ca6-8630-2a79400983d2 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:32.436978 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c75053-d873-4ca6-8630-2a79400983d2 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:32.485299 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa14c5-9423-4939-ad0b-3594e447fd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:32.486007 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa14c5-9423-4939-ad0b-3594e447fd31 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:32.486291 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa14c5-9423-4939-ad0b-3594e447fd31 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:32.486620 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa14c5-9423-4939-ad0b-3594e447fd31 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:32.487330 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa14c5-9423-4939-ad0b-3594e447fd31 None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:32.487639 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa14c5-9423-4939-ad0b-3594e447fd31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:32.489012 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa14c5-9423-4939-ad0b-3594e447fd31 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:32.498259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 431/860] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:06:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:32.503781 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4331e-7154-4d0f-ba4e-15fb14081bf8 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:32.611183 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4331e-7154-4d0f-ba4e-15fb14081bf8 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:32.647368 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ca0b8-0481-4346-8c15-3d6fb4fc3f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:32.648790 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ca0b8-0481-4346-8c15-3d6fb4fc3f0b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:32.649073 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ca0b8-0481-4346-8c15-3d6fb4fc3f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:32.649348 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ca0b8-0481-4346-8c15-3d6fb4fc3f0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:32.660497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ca0b8-0481-4346-8c15-3d6fb4fc3f0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:32.661993 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ca0b8-0481-4346-8c15-3d6fb4fc3f0b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:32.681073 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-653ca0b8-0481-4346-8c15-3d6fb4fc3f0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:32.681073 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:32.681073 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:32.681073 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:32.681073 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:32.681073 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:32.681073 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:32.681073 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:32.681073 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:32.681073 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:32.681073 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:32.681073 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:32.681073 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:32.681073 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:32.681073 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:32.682070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:32.682070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:32.682070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:32.682070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:32.682070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:32.682070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:32.682070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:32.682070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:32.682070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:32.682070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:32.682070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:32.682070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:32.682070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:32.682070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:32.682070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:32.682070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:32.682070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:32.683403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:32.683403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:32.683403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:32.683403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:32.683403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 430/861] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:32.688233 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa14c5-9423-4939-ad0b-3594e447fd31 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:32.802887 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa14c5-9423-4939-ad0b-3594e447fd31 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:32.838224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a757b5-d101-43aa-bb85-d813970bd759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:32.838898 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a757b5-d101-43aa-bb85-d813970bd759 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:32.839183 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a757b5-d101-43aa-bb85-d813970bd759 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:32.839459 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a757b5-d101-43aa-bb85-d813970bd759 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:32.840197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a757b5-d101-43aa-bb85-d813970bd759 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:32.840504 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a757b5-d101-43aa-bb85-d813970bd759 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:32.841898 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a757b5-d101-43aa-bb85-d813970bd759 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:32.855717 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 432/862] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:32.861518 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ca0b8-0481-4346-8c15-3d6fb4fc3f0b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:32.971302 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ca0b8-0481-4346-8c15-3d6fb4fc3f0b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:33.008923 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf694a-323b-43a1-8f96-0c1270713a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:33.009772 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf694a-323b-43a1-8f96-0c1270713a7a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:33.010052 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf694a-323b-43a1-8f96-0c1270713a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:33.010326 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf694a-323b-43a1-8f96-0c1270713a7a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:33.018564 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf694a-323b-43a1-8f96-0c1270713a7a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:33.020158 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf694a-323b-43a1-8f96-0c1270713a7a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:33.035892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-cacf694a-323b-43a1-8f96-0c1270713a7a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:06:33.035892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:33.035892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:33.035892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:33.035892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:33.035892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:33.035892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:33.035892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:33.035892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:33.035892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:33.035892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:33.035892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:33.035892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:33.035892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:33.035892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:33.035892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:33.038305 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:33.038305 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:33.038305 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:33.038305 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:33.038305 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:33.038305 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:33.038305 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:33.038305 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:33.038305 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:33.038305 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:33.038305 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:33.038305 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:33.038305 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:33.038305 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:33.038305 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:33.038305 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:33.038305 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:33.038305 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:33.041066 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:33.041066 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:33.041066 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:33.041066 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:33.041066 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:33.041066 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:33.041066 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:33.041066 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:33.041066 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:06:33.041066 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:33.042546 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 431/863] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:06:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:33.043449 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a757b5-d101-43aa-bb85-d813970bd759 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:33.159115 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a757b5-d101-43aa-bb85-d813970bd759 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:33.194872 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6186f7-3997-4ba2-b91a-acac689f3999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:33.195666 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6186f7-3997-4ba2-b91a-acac689f3999 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:33.196134 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6186f7-3997-4ba2-b91a-acac689f3999 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:33.196586 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6186f7-3997-4ba2-b91a-acac689f3999 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:33.197647 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6186f7-3997-4ba2-b91a-acac689f3999 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:33.198139 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6186f7-3997-4ba2-b91a-acac689f3999 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:33.199696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6186f7-3997-4ba2-b91a-acac689f3999 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:33.221218 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 433/864] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 9 15:06:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:33.227621 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf694a-323b-43a1-8f96-0c1270713a7a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:33.332681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf694a-323b-43a1-8f96-0c1270713a7a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:33.367914 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ed827-ef99-44f6-a857-34c13e7b57bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:33.368645 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ed827-ef99-44f6-a857-34c13e7b57bb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:33.368928 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ed827-ef99-44f6-a857-34c13e7b57bb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:33.369203 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ed827-ef99-44f6-a857-34c13e7b57bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:33.446652 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ed827-ef99-44f6-a857-34c13e7b57bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:33.448125 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ed827-ef99-44f6-a857-34c13e7b57bb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:33.554497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 432/865] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:06:33 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:06:33.560150 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6186f7-3997-4ba2-b91a-acac689f3999 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:33.592969 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6961f1-d564-4da5-902f-51b0c29173da None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:33.593355 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6961f1-d564-4da5-902f-51b0c29173da None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:33.593742 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6961f1-d564-4da5-902f-51b0c29173da None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:33.595478 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 433/866] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:06:33.601116 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5e770-c0d8-4374-bd75-6a263e87c409 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:33.601588 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5e770-c0d8-4374-bd75-6a263e87c409 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:33.602052 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5e770-c0d8-4374-bd75-6a263e87c409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:33.621319 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-cad5e770-c0d8-4374-bd75-6a263e87c409 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:33.622550 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-cad5e770-c0d8-4374-bd75-6a263e87c409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:33.689073 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6186f7-3997-4ba2-b91a-acac689f3999 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:33.709554 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 434/867] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:33.728252 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6459cf0-318b-45b1-9d8b-1cece0af201d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:33.729205 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6459cf0-318b-45b1-9d8b-1cece0af201d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:33.729627 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6459cf0-318b-45b1-9d8b-1cece0af201d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:33.730019 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6459cf0-318b-45b1-9d8b-1cece0af201d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:33.735984 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5e770-c0d8-4374-bd75-6a263e87c409 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:33.743148 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6459cf0-318b-45b1-9d8b-1cece0af201d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:33.744704 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6459cf0-318b-45b1-9d8b-1cece0af201d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:33.766881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-e6459cf0-318b-45b1-9d8b-1cece0af201d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:33.766881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:33.766881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:33.766881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:33.766881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:33.766881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:33.766881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:33.766881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:33.766881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:33.766881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:33.766881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:33.766881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:33.766881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:33.766881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:33.766881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:33.768036 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:33.768036 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:33.768036 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:33.768036 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:33.768036 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:33.768036 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:33.768036 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:33.768036 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:33.768036 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:33.768036 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:33.768036 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:33.768036 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:33.768036 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:33.768036 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:33.768036 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:33.768036 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:33.768036 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:33.769654 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:33.769654 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:33.769654 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:33.769654 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:33.769654 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 434/868] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:33.775053 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6459cf0-318b-45b1-9d8b-1cece0af201d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:33.864745 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5e770-c0d8-4374-bd75-6a263e87c409 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:33.908568 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6459cf0-318b-45b1-9d8b-1cece0af201d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:33.909069 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2847f8-3535-42d1-9b2a-5e9c272d31de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:33.909991 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2847f8-3535-42d1-9b2a-5e9c272d31de None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:33.910458 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2847f8-3535-42d1-9b2a-5e9c272d31de None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:33.910939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2847f8-3535-42d1-9b2a-5e9c272d31de None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:33.911911 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2847f8-3535-42d1-9b2a-5e9c272d31de None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:33.914263 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2847f8-3535-42d1-9b2a-5e9c272d31de None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:33.942278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 435/869] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:06:33 2022] POST /identity/v3/services => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:06:33.967646 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b76f8-b4c1-4b7c-8fe3-46c206023438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:33.968728 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b76f8-b4c1-4b7c-8fe3-46c206023438 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:33.969177 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b76f8-b4c1-4b7c-8fe3-46c206023438 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:33.969657 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b76f8-b4c1-4b7c-8fe3-46c206023438 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:33.970667 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b76f8-b4c1-4b7c-8fe3-46c206023438 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:33.971144 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b76f8-b4c1-4b7c-8fe3-46c206023438 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:33.972828 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b76f8-b4c1-4b7c-8fe3-46c206023438 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:33.988889 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 435/870] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:33.994970 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2847f8-3535-42d1-9b2a-5e9c272d31de None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:34.088864 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0efe7-b56a-4890-852b-921f176eaf0c None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:34.089566 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0efe7-b56a-4890-852b-921f176eaf0c None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:34.090054 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0efe7-b56a-4890-852b-921f176eaf0c None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:34.092057 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 436/871] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:34.098329 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92676ab1-a8bf-495c-9358-2e0afbc77e81 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:34.099040 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92676ab1-a8bf-495c-9358-2e0afbc77e81 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:34.099765 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92676ab1-a8bf-495c-9358-2e0afbc77e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:34.123361 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-92676ab1-a8bf-495c-9358-2e0afbc77e81 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:34.124852 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-92676ab1-a8bf-495c-9358-2e0afbc77e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:34.143002 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2847f8-3535-42d1-9b2a-5e9c272d31de None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:34.206744 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f9aa2-d084-4cc3-8ab7-3c8033e9cc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:34.207501 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f9aa2-d084-4cc3-8ab7-3c8033e9cc59 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:34.207781 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f9aa2-d084-4cc3-8ab7-3c8033e9cc59 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:34.208396 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f9aa2-d084-4cc3-8ab7-3c8033e9cc59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:34.216369 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 437/872] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:34 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:34.218162 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f9aa2-d084-4cc3-8ab7-3c8033e9cc59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:34.219177 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f9aa2-d084-4cc3-8ab7-3c8033e9cc59 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:34.239080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-aa4f9aa2-d084-4cc3-8ab7-3c8033e9cc59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:34.239080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:34.239080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:34.239080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:34.239080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:34.239080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:34.239080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:34.239080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:34.239080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:34.239080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:34.239080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:34.239080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:34.239080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:34.239080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:34.239080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:34.240487 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:34.240487 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:34.240487 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:34.240487 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:34.240487 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:34.240487 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:34.240487 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:34.240487 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:34.240487 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:34.240487 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:34.240487 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:34.240487 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:34.240487 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:34.240487 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:34.240487 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:34.240487 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:34.240487 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:34.241965 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:34.241965 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:34.241965 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:34.241965 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:34.241965 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:34.241965 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:34.241965 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:34.241965 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:34.241965 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 436/873] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:34.246454 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92676ab1-a8bf-495c-9358-2e0afbc77e81 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:34.247243 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f9aa2-d084-4cc3-8ab7-3c8033e9cc59 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:34.358573 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f9aa2-d084-4cc3-8ab7-3c8033e9cc59 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:34.386452 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92676ab1-a8bf-495c-9358-2e0afbc77e81 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:34.395110 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacb30c-8803-46ab-9a0f-616f163744b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:34.396246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacb30c-8803-46ab-9a0f-616f163744b1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:34.396744 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacb30c-8803-46ab-9a0f-616f163744b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:34.397220 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacb30c-8803-46ab-9a0f-616f163744b1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:34.398715 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacb30c-8803-46ab-9a0f-616f163744b1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:34.400364 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacb30c-8803-46ab-9a0f-616f163744b1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:34.412842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-3dacb30c-8803-46ab-9a0f-616f163744b1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:06:34.412842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:34.412842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:06:34.412842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:06:34.412842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:06:34.412842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:06:34.412842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:06:34.412842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:34.412842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:06:34.412842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:34.412842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:34.412842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:34.412842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:34.412842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:34.412842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:34.412842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:34.412842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:34.418251 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:34.418251 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:34.418251 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:34.418251 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:34.418251 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:34.418251 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:34.418251 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:06:34.418251 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:06:34.418251 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:06:34.418251 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:06:34.418251 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:34.418251 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:34.418251 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:34.418251 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:34.418251 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:34.418251 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:34.423878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:34.423878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:34.423878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:34.423878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:34.423878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:34.423878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:34.423878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:34.423878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:34.423878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:34.423878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:34.423878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:06:34.423878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:34.423878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:06:34.423878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:34.423878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 437/874] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:06:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:34.424716 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06102c2f-22e0-4714-ad4d-770a571f06be None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:34.424716 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06102c2f-22e0-4714-ad4d-770a571f06be None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:34.424716 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06102c2f-22e0-4714-ad4d-770a571f06be None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:34.424716 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 438/875] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:34.424716 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06102c2f-22e0-4714-ad4d-770a571f06be None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:34.442321 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273daea-bc2b-4dec-9157-f5a65d844936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:34.442983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273daea-bc2b-4dec-9157-f5a65d844936 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:34.443267 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273daea-bc2b-4dec-9157-f5a65d844936 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:34.443547 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273daea-bc2b-4dec-9157-f5a65d844936 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:34.444325 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273daea-bc2b-4dec-9157-f5a65d844936 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:34.444748 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273daea-bc2b-4dec-9157-f5a65d844936 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:34.446227 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273daea-bc2b-4dec-9157-f5a65d844936 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:34.473528 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 438/876] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:06:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:34.473528 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ef094-5ed6-4a6c-a45e-4f8b046d3310 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:34.473528 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ef094-5ed6-4a6c-a45e-4f8b046d3310 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:34.473528 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ef094-5ed6-4a6c-a45e-4f8b046d3310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:34.491715 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-b02ef094-5ed6-4a6c-a45e-4f8b046d3310 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:34.493684 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b02ef094-5ed6-4a6c-a45e-4f8b046d3310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:34.568670 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 439/877] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:34 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:34.569553 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06102c2f-22e0-4714-ad4d-770a571f06be None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:34.570698 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ef094-5ed6-4a6c-a45e-4f8b046d3310 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:34.612073 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee471355-c724-48dc-b1ff-1e0d3f55f88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:34.613107 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee471355-c724-48dc-b1ff-1e0d3f55f88c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:34.613632 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee471355-c724-48dc-b1ff-1e0d3f55f88c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:34.614097 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee471355-c724-48dc-b1ff-1e0d3f55f88c None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:34.615314 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee471355-c724-48dc-b1ff-1e0d3f55f88c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:34.615860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee471355-c724-48dc-b1ff-1e0d3f55f88c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:34.619216 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee471355-c724-48dc-b1ff-1e0d3f55f88c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:34.631856 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 439/878] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:06:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:34.631856 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee471355-c724-48dc-b1ff-1e0d3f55f88c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:34.701025 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ef094-5ed6-4a6c-a45e-4f8b046d3310 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:34.742794 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967c58a-00dc-43e1-a473-84cebfe3dac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:34.743369 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967c58a-00dc-43e1-a473-84cebfe3dac6 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:34.743650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967c58a-00dc-43e1-a473-84cebfe3dac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:34.743927 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967c58a-00dc-43e1-a473-84cebfe3dac6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:34.744783 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967c58a-00dc-43e1-a473-84cebfe3dac6 None admin] RBAC: Adding query filter params (role.id=d8aa93d29788400a97d04db10d8fb8d5, scope.project.id=4fcadeae44cc4547905b83bfebec79c7, user.id=057ad64901314362914287aed5b468ea) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:34.745096 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967c58a-00dc-43e1-a473-84cebfe3dac6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:34.746579 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967c58a-00dc-43e1-a473-84cebfe3dac6 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:34.753355 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 440/879] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:06:34 2022] GET /identity/v3/role_assignments?user.id=057ad64901314362914287aed5b468ea&scope.project.id=4fcadeae44cc4547905b83bfebec79c7&role.id=d8aa93d29788400a97d04db10d8fb8d5 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:34.754248 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967c58a-00dc-43e1-a473-84cebfe3dac6 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:34.771884 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee471355-c724-48dc-b1ff-1e0d3f55f88c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:34.840543 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f9b88-3c56-42c7-9318-c88ef87b8849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:34.841229 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f9b88-3c56-42c7-9318-c88ef87b8849 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:34.841561 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f9b88-3c56-42c7-9318-c88ef87b8849 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:34.841837 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f9b88-3c56-42c7-9318-c88ef87b8849 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:34.842838 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f9b88-3c56-42c7-9318-c88ef87b8849 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:34.844956 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f9b88-3c56-42c7-9318-c88ef87b8849 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:34.868766 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 440/880] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:06:34 2022] POST /identity/v3/services => generated 269 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:06:34.890558 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967c58a-00dc-43e1-a473-84cebfe3dac6 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:34.939759 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3fc89-f51b-4535-ac15-92579fa37b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:34.940735 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3fc89-f51b-4535-ac15-92579fa37b72 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:34.941173 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3fc89-f51b-4535-ac15-92579fa37b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:34.941634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3fc89-f51b-4535-ac15-92579fa37b72 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:34.942553 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3fc89-f51b-4535-ac15-92579fa37b72 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:34.943056 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3fc89-f51b-4535-ac15-92579fa37b72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:34.945537 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3fc89-f51b-4535-ac15-92579fa37b72 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:34.951733 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 441/881] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:06:34 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:36.440187 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5539ce-0c47-430b-8c1d-7168a8f33b69 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:36.440699 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5539ce-0c47-430b-8c1d-7168a8f33b69 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:36.440803 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5539ce-0c47-430b-8c1d-7168a8f33b69 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:36.442355 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 441/882] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:36.450589 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fe9ed-0e0c-4945-a85d-2835a1268bdc None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:36.451107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fe9ed-0e0c-4945-a85d-2835a1268bdc None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:36.451335 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fe9ed-0e0c-4945-a85d-2835a1268bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:36.471513 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-b97fe9ed-0e0c-4945-a85d-2835a1268bdc None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:36.473134 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b97fe9ed-0e0c-4945-a85d-2835a1268bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:36.588569 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 442/883] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:36.611717 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5539ce-0c47-430b-8c1d-7168a8f33b69 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:36.777090 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5539ce-0c47-430b-8c1d-7168a8f33b69 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:36.832761 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a54a4f-b6c7-4f67-9425-5cb8fd0d2ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:36.834142 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a54a4f-b6c7-4f67-9425-5cb8fd0d2ffa None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:36.834626 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a54a4f-b6c7-4f67-9425-5cb8fd0d2ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:36.835099 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a54a4f-b6c7-4f67-9425-5cb8fd0d2ffa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:36.836875 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a54a4f-b6c7-4f67-9425-5cb8fd0d2ffa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:36.839416 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a54a4f-b6c7-4f67-9425-5cb8fd0d2ffa None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:36.863356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-e9a54a4f-b6c7-4f67-9425-5cb8fd0d2ffa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:06:36.863356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:36.863356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:06:36.863356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:06:36.863356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:06:36.863356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:06:36.863356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:06:36.863356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:36.863356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:06:36.863356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:36.863356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:36.863356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:36.863356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:36.863356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:36.863356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:36.863356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:36.863356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:36.864440 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:36.864440 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:36.864440 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:36.864440 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:36.864440 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:36.864440 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:36.864440 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:06:36.864440 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:06:36.864440 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:06:36.864440 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:06:36.864440 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:36.864440 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:36.864440 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:36.864440 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:36.864440 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:36.864440 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:36.865291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:36.865291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:36.865291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:36.865291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:36.865291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:36.865291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:36.865291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:36.865291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:36.865291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:36.865291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:36.865291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:06:36.865291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:36.865291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:06:36.865291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:36.866080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 442/884] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:06:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:36.875384 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fe9ed-0e0c-4945-a85d-2835a1268bdc None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:36.977182 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fe9ed-0e0c-4945-a85d-2835a1268bdc None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:37.015359 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637bb8f6-62b4-4684-916e-92356c680d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:37.016947 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bb8f6-62b4-4684-916e-92356c680d9f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:37.017740 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bb8f6-62b4-4684-916e-92356c680d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:37.018487 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bb8f6-62b4-4684-916e-92356c680d9f None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:37.020091 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637bb8f6-62b4-4684-916e-92356c680d9f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:37.020970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637bb8f6-62b4-4684-916e-92356c680d9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:37.023908 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637bb8f6-62b4-4684-916e-92356c680d9f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:37.034229 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 443/885] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:06:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:37.044463 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a54a4f-b6c7-4f67-9425-5cb8fd0d2ffa None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:37.168433 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a54a4f-b6c7-4f67-9425-5cb8fd0d2ffa None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:37.205592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb6d25-9001-4f3e-8b86-5d7990fc3f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:37.206658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb6d25-9001-4f3e-8b86-5d7990fc3f96 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:37.207155 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb6d25-9001-4f3e-8b86-5d7990fc3f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:37.207673 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb6d25-9001-4f3e-8b86-5d7990fc3f96 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:37.208590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb6d25-9001-4f3e-8b86-5d7990fc3f96 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:37.209098 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb6d25-9001-4f3e-8b86-5d7990fc3f96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:37.210952 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb6d25-9001-4f3e-8b86-5d7990fc3f96 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:37.217132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 443/886] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:06:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:37.223423 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637bb8f6-62b4-4684-916e-92356c680d9f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:37.236763 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82593eb8-9142-4b84-a052-c91ecd1d3377 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:37.237095 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82593eb8-9142-4b84-a052-c91ecd1d3377 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:37.237325 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82593eb8-9142-4b84-a052-c91ecd1d3377 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:37.238991 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 444/887] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:06:37.244804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c548874-622d-4362-aa4f-949b7a94ebed None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:37.245107 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c548874-622d-4362-aa4f-949b7a94ebed None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:37.245361 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c548874-622d-4362-aa4f-949b7a94ebed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:37.262653 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-3c548874-622d-4362-aa4f-949b7a94ebed None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:37.263885 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-3c548874-622d-4362-aa4f-949b7a94ebed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:37.342561 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 445/888] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:06:37.344044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a715e-2fc1-418d-b7f6-66089d75121c None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:37.344341 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a715e-2fc1-418d-b7f6-66089d75121c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:37.344625 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a715e-2fc1-418d-b7f6-66089d75121c None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:37.346125 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 446/889] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:37.352551 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f38682-ddd5-4828-8383-e10790d70254 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:37.352786 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f38682-ddd5-4828-8383-e10790d70254 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:37.353126 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f38682-ddd5-4828-8383-e10790d70254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:37.357273 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637bb8f6-62b4-4684-916e-92356c680d9f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:37.371766 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-c1f38682-ddd5-4828-8383-e10790d70254 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:37.373444 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c1f38682-ddd5-4828-8383-e10790d70254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:37.433286 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4deebe-124b-4680-bf9f-16dbc1c1c168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:37.434465 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4deebe-124b-4680-bf9f-16dbc1c1c168 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:37.434946 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4deebe-124b-4680-bf9f-16dbc1c1c168 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:37.435414 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4deebe-124b-4680-bf9f-16dbc1c1c168 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:37.437223 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4deebe-124b-4680-bf9f-16dbc1c1c168 None admin] RBAC: Adding query filter params (interface=public, service_id=9d963a397d564dec8e79a6ae421165b2, region_id=RegionOne) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:37.437480 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4deebe-124b-4680-bf9f-16dbc1c1c168 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:37.439947 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4deebe-124b-4680-bf9f-16dbc1c1c168 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:37.458872 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 444/890] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:06:37 2022] GET /identity/v3/endpoints?service_id=9d963a397d564dec8e79a6ae421165b2&interface=public®ion_id=RegionOne => generated 194 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:37.458872 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4deebe-124b-4680-bf9f-16dbc1c1c168 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:37.489586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 447/891] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:37.489586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f38682-ddd5-4828-8383-e10790d70254 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:37.622796 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f38682-ddd5-4828-8383-e10790d70254 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:37.623012 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4deebe-124b-4680-bf9f-16dbc1c1c168 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:37.657915 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d3d52-80f8-43c7-8f45-03fef043cbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:37.658584 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d3d52-80f8-43c7-8f45-03fef043cbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:37.658870 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d3d52-80f8-43c7-8f45-03fef043cbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:37.659144 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d3d52-80f8-43c7-8f45-03fef043cbe1 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:37.659845 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d3d52-80f8-43c7-8f45-03fef043cbe1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:37.660069 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a56d7b-2763-4179-878f-bd7adb519abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:37.660966 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a56d7b-2763-4179-878f-bd7adb519abb None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:37.661218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d3d52-80f8-43c7-8f45-03fef043cbe1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:37.661509 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a56d7b-2763-4179-878f-bd7adb519abb None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:37.661879 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a56d7b-2763-4179-878f-bd7adb519abb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:37.668062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 448/892] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:06:37 2022] GET /identity/v3/services => generated 1268 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:06:37.668892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d3d52-80f8-43c7-8f45-03fef043cbe1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:37.677399 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a56d7b-2763-4179-878f-bd7adb519abb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:06:37.687118 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-95a56d7b-2763-4179-878f-bd7adb519abb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:06:37.687118 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:37.687118 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:37.687118 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:37.687118 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:37.687118 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:37.687118 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:37.687118 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:37.687118 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:37.687118 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:37.687118 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:37.687118 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:37.687118 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:06:37.687118 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:06:37.687118 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:06:37.687118 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:06:37.688163 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:06:37.688163 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:06:37.688163 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:06:37.688163 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:06:37.688163 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:37.688163 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:37.688163 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:37.688163 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:37.688163 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:37.688163 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:37.688163 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:37.688163 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:37.688163 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:37.688163 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:37.688163 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:37.688163 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:37.689026 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:37.689026 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:37.689026 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:37.689026 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:37.689026 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:06:37.689026 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:06:37.689026 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:06:37.689026 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:06:37.689026 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:06:37.689026 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:06:37.689026 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:06:37.689026 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:37.689026 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 445/893] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 9 15:06:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:37.690306 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea231a7-a646-4e20-9a3a-b94ab8e6d60a None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:37.690415 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea231a7-a646-4e20-9a3a-b94ab8e6d60a None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:37.690697 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea231a7-a646-4e20-9a3a-b94ab8e6d60a None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:37.692098 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 446/894] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:37.699027 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a4fb0-30be-4867-86a7-b623a6304fef None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:37.699027 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a4fb0-30be-4867-86a7-b623a6304fef None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:37.699445 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a4fb0-30be-4867-86a7-b623a6304fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:37.717935 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-355a4fb0-30be-4867-86a7-b623a6304fef None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:37.719253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-355a4fb0-30be-4867-86a7-b623a6304fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:37.803604 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 447/895] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:37.804230 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a4fb0-30be-4867-86a7-b623a6304fef None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:37.830453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d3d52-80f8-43c7-8f45-03fef043cbe1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:37.879403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b02e0-1796-4eb6-9a60-5c117421f31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:37.880599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b02e0-1796-4eb6-9a60-5c117421f31c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:37.881078 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b02e0-1796-4eb6-9a60-5c117421f31c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:37.881355 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b02e0-1796-4eb6-9a60-5c117421f31c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:37.882318 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b02e0-1796-4eb6-9a60-5c117421f31c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:37.884121 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b02e0-1796-4eb6-9a60-5c117421f31c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:37.897186 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-580b02e0-1796-4eb6-9a60-5c117421f31c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:06:37.897186 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:37.897186 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:06:37.897186 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:06:37.897186 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:06:37.897186 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:06:37.897186 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:06:37.897186 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:37.897186 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:06:37.897186 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:37.897186 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:37.897186 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:37.897186 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:37.897186 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:37.897186 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:37.897186 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:37.898302 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:37.898302 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:37.898302 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:37.898302 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:37.898302 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:37.898302 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:37.898302 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:37.898302 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:06:37.898302 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:06:37.898302 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:06:37.898302 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:06:37.898302 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:37.898302 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:37.898302 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:37.898302 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:37.898302 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:37.899143 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:37.899143 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:37.899143 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:37.899143 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:37.899143 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:37.899143 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:37.899143 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:37.899143 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:37.899143 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:37.899143 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:37.899143 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:37.899143 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:06:37.899143 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:37.899143 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:06:37.899143 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:37.899143 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 449/896] 10.222.0.48 () {56 vars in 1132 bytes} [Mon May 9 15:06:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:37.900013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b02e0-1796-4eb6-9a60-5c117421f31c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:37.927599 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a4fb0-30be-4867-86a7-b623a6304fef None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:37.970217 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78102aa7-3c8c-4ab9-8657-fcf3b9a87bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:37.971127 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78102aa7-3c8c-4ab9-8657-fcf3b9a87bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:37.971452 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78102aa7-3c8c-4ab9-8657-fcf3b9a87bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:37.971768 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78102aa7-3c8c-4ab9-8657-fcf3b9a87bc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:37.972489 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78102aa7-3c8c-4ab9-8657-fcf3b9a87bc7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:37.972798 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78102aa7-3c8c-4ab9-8657-fcf3b9a87bc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:37.974218 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78102aa7-3c8c-4ab9-8657-fcf3b9a87bc7 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:37.988798 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 448/897] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:06:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:37.990004 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78102aa7-3c8c-4ab9-8657-fcf3b9a87bc7 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:38.024976 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b02e0-1796-4eb6-9a60-5c117421f31c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:38.060569 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d258155-1b67-4237-937c-8cf134814120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:38.061237 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d258155-1b67-4237-937c-8cf134814120 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:38.061555 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d258155-1b67-4237-937c-8cf134814120 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:38.061835 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d258155-1b67-4237-937c-8cf134814120 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:38.062559 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d258155-1b67-4237-937c-8cf134814120 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:38.063931 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d258155-1b67-4237-937c-8cf134814120 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:38.085716 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 450/898] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:06:37 2022] POST /identity/v3/services => generated 241 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:06:38.085716 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d258155-1b67-4237-937c-8cf134814120 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:38.147588 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78102aa7-3c8c-4ab9-8657-fcf3b9a87bc7 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:38.197345 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b94334-b8a9-4447-9c31-7ec7bb4b7b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:38.198230 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b94334-b8a9-4447-9c31-7ec7bb4b7b1d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:38.198512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b94334-b8a9-4447-9c31-7ec7bb4b7b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:38.198840 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b94334-b8a9-4447-9c31-7ec7bb4b7b1d None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:38.199558 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b94334-b8a9-4447-9c31-7ec7bb4b7b1d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:38.199923 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b94334-b8a9-4447-9c31-7ec7bb4b7b1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:38.201335 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b94334-b8a9-4447-9c31-7ec7bb4b7b1d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:38.212244 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 449/899] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:06:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:38.213331 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b94334-b8a9-4447-9c31-7ec7bb4b7b1d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:38.227456 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d258155-1b67-4237-937c-8cf134814120 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:38.275535 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a70033-2deb-4087-9595-e3ede02f1ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:38.276355 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a70033-2deb-4087-9595-e3ede02f1ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:38.276635 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a70033-2deb-4087-9595-e3ede02f1ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:38.276909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a70033-2deb-4087-9595-e3ede02f1ea7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:38.290522 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a70033-2deb-4087-9595-e3ede02f1ea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:38.291985 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a70033-2deb-4087-9595-e3ede02f1ea7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:38.313435 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-00a70033-2deb-4087-9595-e3ede02f1ea7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:38.313435 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:38.313435 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:38.313435 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:38.313435 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:38.313435 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:38.313435 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:38.313435 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:38.313435 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:38.313435 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:38.313435 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:38.313435 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:38.313435 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:38.313435 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:38.313435 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:38.314529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:38.314529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:38.314529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:38.314529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:38.314529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:38.314529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:38.314529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:38.314529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:38.314529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:38.314529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:38.314529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:38.314529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:38.314529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:38.314529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:38.314529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:38.314529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:38.314529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:38.316558 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:38.316558 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:38.316558 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:38.316558 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:38.316558 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 451/900] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:38.322048 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a70033-2deb-4087-9595-e3ede02f1ea7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:38.342005 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b94334-b8a9-4447-9c31-7ec7bb4b7b1d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:38.385599 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22199d30-c5f0-4169-9488-f51fd3cb4def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:38.386301 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22199d30-c5f0-4169-9488-f51fd3cb4def None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:38.386585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22199d30-c5f0-4169-9488-f51fd3cb4def None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:38.386949 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22199d30-c5f0-4169-9488-f51fd3cb4def None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:38.387705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22199d30-c5f0-4169-9488-f51fd3cb4def None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:38.388060 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22199d30-c5f0-4169-9488-f51fd3cb4def None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:38.389964 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22199d30-c5f0-4169-9488-f51fd3cb4def None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:38.401494 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 450/901] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:06:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:38.403072 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22199d30-c5f0-4169-9488-f51fd3cb4def None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:38.459557 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a70033-2deb-4087-9595-e3ede02f1ea7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:38.504797 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5ff8e-d727-4b62-bd53-f731997ebfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:38.505804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5ff8e-d727-4b62-bd53-f731997ebfdf None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:38.505804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5ff8e-d727-4b62-bd53-f731997ebfdf None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:38.506216 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5ff8e-d727-4b62-bd53-f731997ebfdf None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:38.506808 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5ff8e-d727-4b62-bd53-f731997ebfdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:38.507699 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5ff8e-d727-4b62-bd53-f731997ebfdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:38.509176 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5ff8e-d727-4b62-bd53-f731997ebfdf None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:38.528195 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 452/902] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:38.529282 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5ff8e-d727-4b62-bd53-f731997ebfdf None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:38.548376 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22199d30-c5f0-4169-9488-f51fd3cb4def None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:38.598217 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5aac2-b5c4-4201-8c5c-dfa61420018d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:38.598913 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5aac2-b5c4-4201-8c5c-dfa61420018d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:38.599240 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5aac2-b5c4-4201-8c5c-dfa61420018d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:38.599530 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5aac2-b5c4-4201-8c5c-dfa61420018d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:38.600333 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5aac2-b5c4-4201-8c5c-dfa61420018d None admin] RBAC: Adding query filter params (interface=public, service_id=57048a70db59427bb79cce494436f317, region_id=RegionOne) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:38.600645 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5aac2-b5c4-4201-8c5c-dfa61420018d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:38.602796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5aac2-b5c4-4201-8c5c-dfa61420018d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:38.613453 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 451/903] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:06:38 2022] GET /identity/v3/endpoints?service_id=57048a70db59427bb79cce494436f317&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:38.614424 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5aac2-b5c4-4201-8c5c-dfa61420018d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:38.673843 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5ff8e-d727-4b62-bd53-f731997ebfdf None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:38.725073 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67f522-acfe-459e-b0ad-be12532833f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:38.726930 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67f522-acfe-459e-b0ad-be12532833f6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:38.727524 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67f522-acfe-459e-b0ad-be12532833f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:38.728024 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67f522-acfe-459e-b0ad-be12532833f6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:38.740561 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67f522-acfe-459e-b0ad-be12532833f6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:38.743247 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67f522-acfe-459e-b0ad-be12532833f6 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:38.745009 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5aac2-b5c4-4201-8c5c-dfa61420018d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:38.770403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-bd67f522-acfe-459e-b0ad-be12532833f6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:06:38.770403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:38.770403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:38.770403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:38.770403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:38.770403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:38.770403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:38.770403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:38.770403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:38.770403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:38.770403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:38.770403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:38.770403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:38.770403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:38.770403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:38.770403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:38.771461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:38.771461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:38.771461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:38.771461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:38.771461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:38.771461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:38.771461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:38.771461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:38.771461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:38.771461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:38.771461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:38.771461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:38.771461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:38.771461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:38.771461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:38.771461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:38.771461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:38.771461 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:38.772428 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:38.772428 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:38.772428 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:38.772428 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:38.772428 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:38.772428 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:38.772428 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:38.772428 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:38.772428 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:06:38.772428 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:38.777821 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 453/904] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:06:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:38.781967 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67f522-acfe-459e-b0ad-be12532833f6 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:38.785588 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ee175-1328-4627-baaa-4496d86919aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:38.786681 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ee175-1328-4627-baaa-4496d86919aa None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:38.787192 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ee175-1328-4627-baaa-4496d86919aa None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:38.788534 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ee175-1328-4627-baaa-4496d86919aa None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:38.789582 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ee175-1328-4627-baaa-4496d86919aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:38.791142 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ee175-1328-4627-baaa-4496d86919aa None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:38.798461 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 452/905] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:06:38 2022] GET /identity/v3/services => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:06:38.939505 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67f522-acfe-459e-b0ad-be12532833f6 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:39.005867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e43a4e-0ac8-4656-a1d1-8ae607e9f14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:39.007164 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e43a4e-0ac8-4656-a1d1-8ae607e9f14d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:39.007561 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e43a4e-0ac8-4656-a1d1-8ae607e9f14d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:39.008004 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e43a4e-0ac8-4656-a1d1-8ae607e9f14d None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:39.009484 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e43a4e-0ac8-4656-a1d1-8ae607e9f14d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:39.009985 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e43a4e-0ac8-4656-a1d1-8ae607e9f14d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:39.012448 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e43a4e-0ac8-4656-a1d1-8ae607e9f14d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:39.042457 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 454/906] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 9 15:06:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:39.047769 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ee175-1328-4627-baaa-4496d86919aa None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:39.162118 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ee175-1328-4627-baaa-4496d86919aa None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:39.198589 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f8c5c-7249-4ff0-aaa3-0135cf015316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:39.199153 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f8c5c-7249-4ff0-aaa3-0135cf015316 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:39.199437 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f8c5c-7249-4ff0-aaa3-0135cf015316 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:39.199715 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f8c5c-7249-4ff0-aaa3-0135cf015316 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:39.274373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f8c5c-7249-4ff0-aaa3-0135cf015316 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:39.275826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f8c5c-7249-4ff0-aaa3-0135cf015316 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:39.380834 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 453/907] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:06:39 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:06:39.387098 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e43a4e-0ac8-4656-a1d1-8ae607e9f14d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:39.507665 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e43a4e-0ac8-4656-a1d1-8ae607e9f14d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:39.550559 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03725a8-51c1-45a5-8c59-d923d60df266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:39.551374 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03725a8-51c1-45a5-8c59-d923d60df266 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:39.551657 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03725a8-51c1-45a5-8c59-d923d60df266 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:39.551941 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03725a8-51c1-45a5-8c59-d923d60df266 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:39.565538 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03725a8-51c1-45a5-8c59-d923d60df266 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:39.567842 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03725a8-51c1-45a5-8c59-d923d60df266 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:39.593322 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-a03725a8-51c1-45a5-8c59-d923d60df266 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:39.593322 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:39.593322 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:39.593322 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:39.593322 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:39.593322 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:39.593322 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:39.593322 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:39.593322 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:39.593322 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:39.593322 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:39.593322 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:39.593322 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:39.593322 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:39.593322 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:39.594765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:39.594765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:39.594765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:39.594765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:39.594765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:39.594765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:39.594765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:39.594765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:39.594765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:39.594765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:39.594765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:39.594765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:39.594765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:39.594765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:39.594765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:39.594765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:39.594765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:39.596903 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:39.596903 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:39.596903 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:39.596903 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:39.596903 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 455/908] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:39.600378 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f8c5c-7249-4ff0-aaa3-0135cf015316 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:39.716755 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f8c5c-7249-4ff0-aaa3-0135cf015316 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:39.768408 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674edf6-6d0b-4281-b832-8d4fbf668b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:39.769010 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674edf6-6d0b-4281-b832-8d4fbf668b34 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:39.769466 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674edf6-6d0b-4281-b832-8d4fbf668b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:39.769714 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674edf6-6d0b-4281-b832-8d4fbf668b34 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:39.770459 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674edf6-6d0b-4281-b832-8d4fbf668b34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:39.770764 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674edf6-6d0b-4281-b832-8d4fbf668b34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:39.772162 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674edf6-6d0b-4281-b832-8d4fbf668b34 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:39.785854 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 454/909] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:39.791649 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03725a8-51c1-45a5-8c59-d923d60df266 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:39.898911 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03725a8-51c1-45a5-8c59-d923d60df266 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:39.933615 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d1346-478b-464e-a2cf-b8c00db240eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:39.934417 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d1346-478b-464e-a2cf-b8c00db240eb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:39.934694 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d1346-478b-464e-a2cf-b8c00db240eb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:39.934969 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d1346-478b-464e-a2cf-b8c00db240eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:39.942055 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d1346-478b-464e-a2cf-b8c00db240eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:39.943515 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d1346-478b-464e-a2cf-b8c00db240eb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:39.958447 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-b30d1346-478b-464e-a2cf-b8c00db240eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:39.958447 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:39.958447 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:39.958447 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:39.958447 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:39.958447 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:39.958447 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:39.958447 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:39.958447 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:39.958447 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:39.958447 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:39.958447 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:39.958447 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:39.958447 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:39.958447 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:39.960514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:39.960514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:39.960514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:39.960514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:39.960514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:39.960514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:39.960514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:39.960514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:39.960514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:39.960514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:39.960514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:39.960514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:39.960514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:39.960514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:39.960514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:39.960514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:39.960514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:39.961748 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:39.961748 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:39.961748 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:39.961748 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:39.961748 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:39.961748 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:39.961748 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:39.961748 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:39.961748 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 456/910] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:39.966119 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674edf6-6d0b-4281-b832-8d4fbf668b34 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:40.144296 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674edf6-6d0b-4281-b832-8d4fbf668b34 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:40.205351 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4285dd-37a2-4986-99fc-1a8a9de8255f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:40.206356 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4285dd-37a2-4986-99fc-1a8a9de8255f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:40.206788 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4285dd-37a2-4986-99fc-1a8a9de8255f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:40.207201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4285dd-37a2-4986-99fc-1a8a9de8255f None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:40.208465 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4285dd-37a2-4986-99fc-1a8a9de8255f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:40.208930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4285dd-37a2-4986-99fc-1a8a9de8255f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:40.211403 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4285dd-37a2-4986-99fc-1a8a9de8255f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:40.231904 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 455/911] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:06:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:40.237802 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d1346-478b-464e-a2cf-b8c00db240eb None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:40.383263 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9905095-38f9-4a7b-bf1c-2d41a313cac0 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:40.383800 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9905095-38f9-4a7b-bf1c-2d41a313cac0 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:40.383800 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9905095-38f9-4a7b-bf1c-2d41a313cac0 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:40.385555 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 456/912] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:40.391564 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fd6c9-b2a8-45bc-a256-73f43219257f None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:40.391966 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fd6c9-b2a8-45bc-a256-73f43219257f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:40.392210 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fd6c9-b2a8-45bc-a256-73f43219257f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:40.403005 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d1346-478b-464e-a2cf-b8c00db240eb None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:40.415833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-0a4fd6c9-b2a8-45bc-a256-73f43219257f None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:40.417040 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-0a4fd6c9-b2a8-45bc-a256-73f43219257f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:40.478122 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe9861-8b7e-4ba5-b71b-caa2786f0aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:40.479434 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe9861-8b7e-4ba5-b71b-caa2786f0aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:40.480382 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe9861-8b7e-4ba5-b71b-caa2786f0aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:40.481231 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe9861-8b7e-4ba5-b71b-caa2786f0aa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:40.483606 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe9861-8b7e-4ba5-b71b-caa2786f0aa9 None admin] RBAC: Adding query filter params (role.id=9f1767627c554047835baae35bce7b7c, scope.project.id=4fcadeae44cc4547905b83bfebec79c7, user.id=057ad64901314362914287aed5b468ea) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:40.484569 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe9861-8b7e-4ba5-b71b-caa2786f0aa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:40.488470 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe9861-8b7e-4ba5-b71b-caa2786f0aa9 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:40.497680 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 457/913] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:06:40.499786 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 457/914] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:06:40 2022] GET /identity/v3/role_assignments?user.id=057ad64901314362914287aed5b468ea&scope.project.id=4fcadeae44cc4547905b83bfebec79c7&role.id=9f1767627c554047835baae35bce7b7c => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:40.530549 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fd6c9-b2a8-45bc-a256-73f43219257f None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:40.581314 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfa6a7-4792-4b0a-8ac7-a4406d5330aa None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:40.581874 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfa6a7-4792-4b0a-8ac7-a4406d5330aa None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:40.582297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfa6a7-4792-4b0a-8ac7-a4406d5330aa None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:40.584878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 458/915] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:40.592822 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab99a0-5234-4de3-adcb-786401dc727a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:40.593541 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab99a0-5234-4de3-adcb-786401dc727a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:40.594027 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab99a0-5234-4de3-adcb-786401dc727a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:40.613464 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-90ab99a0-5234-4de3-adcb-786401dc727a None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:40.615128 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-90ab99a0-5234-4de3-adcb-786401dc727a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:40.683759 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fd6c9-b2a8-45bc-a256-73f43219257f None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:40.707870 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 459/916] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:06:40.729030 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fa91b-ecb0-4017-9987-71137660c57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:40.729881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fa91b-ecb0-4017-9987-71137660c57b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:40.730165 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fa91b-ecb0-4017-9987-71137660c57b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:40.730440 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fa91b-ecb0-4017-9987-71137660c57b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:40.731097 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fa91b-ecb0-4017-9987-71137660c57b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:40.732462 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fa91b-ecb0-4017-9987-71137660c57b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:40.738583 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab99a0-5234-4de3-adcb-786401dc727a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:40.746722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-351fa91b-ecb0-4017-9987-71137660c57b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:06:40.746722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:40.746722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:06:40.746722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:06:40.746722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:06:40.746722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:06:40.746722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:06:40.746722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:40.746722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:06:40.746722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:40.746722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:40.746722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:40.746722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:40.746722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:40.746722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:40.746722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:40.746722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:40.748434 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:40.748434 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:40.748434 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:40.748434 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:40.748434 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:40.748434 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:40.748434 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:06:40.748434 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:06:40.748434 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:06:40.748434 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:06:40.748434 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:40.748434 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:40.748434 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:40.748434 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:40.748434 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:40.748434 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:40.749924 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:40.749924 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:40.749924 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:40.749924 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:40.749924 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:40.749924 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:40.749924 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:40.749924 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:40.749924 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:40.749924 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:40.749924 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:06:40.749924 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:40.749924 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:06:40.749924 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:40.749924 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 458/917] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:06:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:40.754103 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fa91b-ecb0-4017-9987-71137660c57b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:40.865591 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab99a0-5234-4de3-adcb-786401dc727a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:40.881405 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fa91b-ecb0-4017-9987-71137660c57b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:40.902972 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d130cc1-9551-4c37-ad5a-d8602997b8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:40.904196 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d130cc1-9551-4c37-ad5a-d8602997b8bb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:40.904687 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d130cc1-9551-4c37-ad5a-d8602997b8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:40.905165 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d130cc1-9551-4c37-ad5a-d8602997b8bb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:40.906160 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d130cc1-9551-4c37-ad5a-d8602997b8bb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:40.907857 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d130cc1-9551-4c37-ad5a-d8602997b8bb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:40.917477 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d7182-764c-49dc-8b01-0f007c0ffc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:40.918138 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d7182-764c-49dc-8b01-0f007c0ffc0d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:40.918476 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d7182-764c-49dc-8b01-0f007c0ffc0d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:40.918759 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d7182-764c-49dc-8b01-0f007c0ffc0d None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:40.919517 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d7182-764c-49dc-8b01-0f007c0ffc0d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:40.919831 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d7182-764c-49dc-8b01-0f007c0ffc0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:40.921181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d7182-764c-49dc-8b01-0f007c0ffc0d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:40.925781 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-4d130cc1-9551-4c37-ad5a-d8602997b8bb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:06:40.925781 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:40.925781 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:06:40.925781 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:06:40.925781 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:06:40.925781 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:06:40.925781 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:06:40.925781 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:40.925781 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:06:40.925781 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:40.925781 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:40.925781 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:40.925781 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:40.925781 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:40.925781 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:40.925781 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:40.925781 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:40.926795 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:40.926795 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:40.926795 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:40.926795 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:40.926795 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:40.926795 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:40.926795 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:06:40.926795 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:06:40.926795 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:06:40.926795 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:06:40.926795 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:40.926795 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:40.926795 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:40.926795 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:40.926795 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:40.926795 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:40.927653 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:40.927653 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:40.927653 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:40.927653 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:40.927653 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:40.927653 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:40.927653 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:40.927653 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:40.927653 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:40.927653 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:40.927653 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:06:40.927653 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:40.927653 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:06:40.927653 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:40.935579 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 459/919] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:06:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:40.935579 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d7182-764c-49dc-8b01-0f007c0ffc0d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:40.936081 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 460/919] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:06:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:40.937208 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d130cc1-9551-4c37-ad5a-d8602997b8bb None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:41.043704 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d7182-764c-49dc-8b01-0f007c0ffc0d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:41.046966 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d130cc1-9551-4c37-ad5a-d8602997b8bb None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:41.081584 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d4e4c-93c9-422f-9773-297ffecd5ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:41.082258 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d4e4c-93c9-422f-9773-297ffecd5ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:41.082540 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d4e4c-93c9-422f-9773-297ffecd5ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:41.082818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d4e4c-93c9-422f-9773-297ffecd5ca1 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:41.083524 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d4e4c-93c9-422f-9773-297ffecd5ca1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:41.083835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d4e4c-93c9-422f-9773-297ffecd5ca1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:41.085991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d4e4c-93c9-422f-9773-297ffecd5ca1 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:41.103317 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 460/920] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:06:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:41.103702 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d4e4c-93c9-422f-9773-297ffecd5ca1 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:41.114257 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35a91a-77b6-44b7-8c4c-cbf77fbdda35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:41.115720 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35a91a-77b6-44b7-8c4c-cbf77fbdda35 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:41.116465 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35a91a-77b6-44b7-8c4c-cbf77fbdda35 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:41.117160 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35a91a-77b6-44b7-8c4c-cbf77fbdda35 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:41.118623 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35a91a-77b6-44b7-8c4c-cbf77fbdda35 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:41.119749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35a91a-77b6-44b7-8c4c-cbf77fbdda35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:41.122684 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35a91a-77b6-44b7-8c4c-cbf77fbdda35 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:41.130661 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 461/921] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:06:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:41.139233 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35a91a-77b6-44b7-8c4c-cbf77fbdda35 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:41.263119 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35a91a-77b6-44b7-8c4c-cbf77fbdda35 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:41.265299 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d4e4c-93c9-422f-9773-297ffecd5ca1 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:41.298449 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a69a2-abe4-4d04-964b-66121bb80ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:41.299306 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a69a2-abe4-4d04-964b-66121bb80ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:41.299589 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a69a2-abe4-4d04-964b-66121bb80ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:41.299864 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a69a2-abe4-4d04-964b-66121bb80ab5 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:41.301011 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a69a2-abe4-4d04-964b-66121bb80ab5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:41.301320 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a69a2-abe4-4d04-964b-66121bb80ab5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:41.303076 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a69a2-abe4-4d04-964b-66121bb80ab5 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:41.311205 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 462/922] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:06:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:41.317272 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a69a2-abe4-4d04-964b-66121bb80ab5 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:41.318796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d4d40-8113-41db-bee9-54bab64a53a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:41.319973 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d4d40-8113-41db-bee9-54bab64a53a1 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:41.320390 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d4d40-8113-41db-bee9-54bab64a53a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:41.320759 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d4d40-8113-41db-bee9-54bab64a53a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:41.321786 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d4d40-8113-41db-bee9-54bab64a53a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:41.323345 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d4d40-8113-41db-bee9-54bab64a53a1 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:41.352661 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 461/923] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:06:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:06:41.358217 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f196997-57fb-4f88-9921-015fe1b0b428 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:41.358926 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f196997-57fb-4f88-9921-015fe1b0b428 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:41.359388 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f196997-57fb-4f88-9921-015fe1b0b428 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:41.362070 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 462/924] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:41.369425 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80291809-ade5-4f2d-8165-939a19c81d68 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:41.370070 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80291809-ade5-4f2d-8165-939a19c81d68 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:41.370834 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80291809-ade5-4f2d-8165-939a19c81d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:41.395404 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-80291809-ade5-4f2d-8165-939a19c81d68 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:41.397469 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-80291809-ade5-4f2d-8165-939a19c81d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:41.494795 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a69a2-abe4-4d04-964b-66121bb80ab5 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:41.529950 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 463/925] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:41.542436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c03d7-0088-4085-a309-68502aff921e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:41.543376 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c03d7-0088-4085-a309-68502aff921e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:41.543807 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c03d7-0088-4085-a309-68502aff921e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:41.544246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c03d7-0088-4085-a309-68502aff921e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:41.545326 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c03d7-0088-4085-a309-68502aff921e None admin] RBAC: Adding query filter params (interface=public, service_id=6d2262575fd340dd84b7f24bed697581, region_id=RegionOne) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:41.545844 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c03d7-0088-4085-a309-68502aff921e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:41.547410 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c03d7-0088-4085-a309-68502aff921e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:41.550601 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80291809-ade5-4f2d-8165-939a19c81d68 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:41.554100 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 463/926] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:06:41 2022] GET /identity/v3/endpoints?service_id=6d2262575fd340dd84b7f24bed697581&interface=public®ion_id=RegionOne => generated 194 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:41.559998 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c03d7-0088-4085-a309-68502aff921e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:41.700955 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80291809-ade5-4f2d-8165-939a19c81d68 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:41.705021 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c03d7-0088-4085-a309-68502aff921e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:41.752668 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42d1de-5eb4-4db1-adbe-9bee25276ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:41.753405 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75295b4-479c-40cb-a692-714f2dc63992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:41.754152 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42d1de-5eb4-4db1-adbe-9bee25276ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:41.754434 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75295b4-479c-40cb-a692-714f2dc63992 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:41.754724 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75295b4-479c-40cb-a692-714f2dc63992 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:41.755002 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75295b4-479c-40cb-a692-714f2dc63992 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:41.755298 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42d1de-5eb4-4db1-adbe-9bee25276ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:41.755698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75295b4-479c-40cb-a692-714f2dc63992 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:41.756160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42d1de-5eb4-4db1-adbe-9bee25276ea3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:41.757316 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75295b4-479c-40cb-a692-714f2dc63992 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:41.757707 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42d1de-5eb4-4db1-adbe-9bee25276ea3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:41.760078 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42d1de-5eb4-4db1-adbe-9bee25276ea3 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:41.765703 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 464/927] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:06:41 2022] GET /identity/v3/services => generated 1497 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 15:06:41.780610 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-cb42d1de-5eb4-4db1-adbe-9bee25276ea3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:06:41.780610 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:41.780610 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:06:41.780610 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:06:41.780610 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:06:41.780610 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:06:41.780610 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:06:41.780610 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:41.780610 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:06:41.780610 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:41.780610 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:41.780610 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:41.780610 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:41.780610 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:41.780610 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:41.780610 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:41.781677 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:41.781677 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:41.781677 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:41.781677 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:41.781677 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:41.781677 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:41.781677 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:41.781677 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:06:41.781677 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:06:41.781677 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:06:41.781677 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:06:41.781677 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:41.781677 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:41.781677 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:41.781677 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:41.781677 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:41.782583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:41.782583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:41.782583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:41.782583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:41.782583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:41.782583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:41.782583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:41.782583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:41.782583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:41.782583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:41.782583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:41.782583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:06:41.782583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:41.782583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:06:41.782583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:41.791254 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 464/928] 10.222.0.48 () {56 vars in 1132 bytes} [Mon May 9 15:06:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:41.793652 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75295b4-479c-40cb-a692-714f2dc63992 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:41.943596 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75295b4-479c-40cb-a692-714f2dc63992 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:42.007538 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ba7d3-72e7-4713-89e1-6875f95c7dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:42.008608 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ba7d3-72e7-4713-89e1-6875f95c7dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:42.009076 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ba7d3-72e7-4713-89e1-6875f95c7dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:42.009570 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ba7d3-72e7-4713-89e1-6875f95c7dc8 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:42.010801 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ba7d3-72e7-4713-89e1-6875f95c7dc8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:42.011306 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ba7d3-72e7-4713-89e1-6875f95c7dc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:42.013640 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ba7d3-72e7-4713-89e1-6875f95c7dc8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:42.022051 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 465/929] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:06:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:42.027831 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42d1de-5eb4-4db1-adbe-9bee25276ea3 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:42.139937 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42d1de-5eb4-4db1-adbe-9bee25276ea3 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:42.175675 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc355995-0bdf-4a8e-9b99-dbc2ae4c0eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:42.176344 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc355995-0bdf-4a8e-9b99-dbc2ae4c0eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:42.176633 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc355995-0bdf-4a8e-9b99-dbc2ae4c0eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:42.176914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc355995-0bdf-4a8e-9b99-dbc2ae4c0eb4 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:42.177669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc355995-0bdf-4a8e-9b99-dbc2ae4c0eb4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:42.177977 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc355995-0bdf-4a8e-9b99-dbc2ae4c0eb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:42.179619 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc355995-0bdf-4a8e-9b99-dbc2ae4c0eb4 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:42.185695 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 465/930] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:06:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:42.191045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ba7d3-72e7-4713-89e1-6875f95c7dc8 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:42.313093 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ba7d3-72e7-4713-89e1-6875f95c7dc8 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:42.361064 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe6e75-841e-4c2b-b8df-6bc34714bb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:42.361766 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe6e75-841e-4c2b-b8df-6bc34714bb57 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:42.362048 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe6e75-841e-4c2b-b8df-6bc34714bb57 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:42.362323 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe6e75-841e-4c2b-b8df-6bc34714bb57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:42.363082 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe6e75-841e-4c2b-b8df-6bc34714bb57 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:42.364501 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe6e75-841e-4c2b-b8df-6bc34714bb57 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:42.393271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 466/931] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:06:42 2022] POST /identity/v3/endpoints => generated 347 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:06:42.954451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beaf422-a1c7-4a8a-a419-e57042704203 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:42.955012 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beaf422-a1c7-4a8a-a419-e57042704203 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:42.955012 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beaf422-a1c7-4a8a-a419-e57042704203 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:42.956492 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 466/932] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:42.962167 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96531c2-8e83-43b4-8b3d-f09e4a031a67 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:42.963003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96531c2-8e83-43b4-8b3d-f09e4a031a67 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:42.963491 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96531c2-8e83-43b4-8b3d-f09e4a031a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:42.981240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-b96531c2-8e83-43b4-8b3d-f09e4a031a67 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:42.982768 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-b96531c2-8e83-43b4-8b3d-f09e4a031a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:43.058901 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 467/933] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:06:43.082487 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beaf422-a1c7-4a8a-a419-e57042704203 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:43.191897 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beaf422-a1c7-4a8a-a419-e57042704203 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:43.229956 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f910079-e10f-4936-8182-c91d398d1b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:43.230695 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f910079-e10f-4936-8182-c91d398d1b8a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:43.230981 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f910079-e10f-4936-8182-c91d398d1b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:43.231257 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f910079-e10f-4936-8182-c91d398d1b8a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:43.243850 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f910079-e10f-4936-8182-c91d398d1b8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:06:43.251940 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-3f910079-e10f-4936-8182-c91d398d1b8a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:06:43.251940 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:43.251940 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:43.251940 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:43.251940 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:43.251940 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:43.251940 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:43.251940 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:43.251940 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:43.251940 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:43.251940 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:43.251940 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:43.251940 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:06:43.251940 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:06:43.251940 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:06:43.251940 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:06:43.252930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:06:43.252930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:06:43.252930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:06:43.252930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:06:43.252930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:43.252930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:43.252930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:43.252930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:43.252930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:43.252930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:43.252930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:43.252930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:43.252930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:43.252930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:43.252930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:43.252930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:43.253833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:43.253833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:43.253833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:43.253833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:43.253833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:06:43.253833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:06:43.253833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:06:43.253833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:06:43.253833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:06:43.253833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:06:43.253833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:06:43.253833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:43.253833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 467/934] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 9 15:06:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:43.261022 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96531c2-8e83-43b4-8b3d-f09e4a031a67 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:43.362423 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96531c2-8e83-43b4-8b3d-f09e4a031a67 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:43.398731 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d2ec3-51d8-468a-b0fc-e4c87d22b37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:43.399395 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d2ec3-51d8-468a-b0fc-e4c87d22b37e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:43.399675 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d2ec3-51d8-468a-b0fc-e4c87d22b37e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:43.399949 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d2ec3-51d8-468a-b0fc-e4c87d22b37e None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:43.400692 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d2ec3-51d8-468a-b0fc-e4c87d22b37e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:43.400996 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d2ec3-51d8-468a-b0fc-e4c87d22b37e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:43.402383 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d2ec3-51d8-468a-b0fc-e4c87d22b37e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:43.410748 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 468/935] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:06:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:43.416596 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f910079-e10f-4936-8182-c91d398d1b8a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:43.519189 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f910079-e10f-4936-8182-c91d398d1b8a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:43.554635 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6047b-cbf6-44a1-834a-ed1507e82bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:43.555424 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6047b-cbf6-44a1-834a-ed1507e82bde None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:43.555702 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6047b-cbf6-44a1-834a-ed1507e82bde None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:43.555970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6047b-cbf6-44a1-834a-ed1507e82bde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:43.567010 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6047b-cbf6-44a1-834a-ed1507e82bde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:43.568510 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6047b-cbf6-44a1-834a-ed1507e82bde None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:43.589603 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-6af6047b-cbf6-44a1-834a-ed1507e82bde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:43.589603 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:43.589603 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:43.589603 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:43.589603 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:43.589603 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:43.589603 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:43.589603 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:43.589603 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:43.589603 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:43.589603 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:43.589603 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:43.589603 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:43.589603 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:43.589603 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:43.590623 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:43.590623 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:43.590623 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:43.590623 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:43.590623 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:43.590623 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:43.590623 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:43.590623 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:43.590623 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:43.590623 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:43.590623 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:43.590623 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:43.590623 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:43.590623 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:43.590623 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:43.590623 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:43.590623 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:43.591540 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:43.591540 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:43.591540 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:43.591540 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:43.591540 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 468/936] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:43.598308 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d2ec3-51d8-468a-b0fc-e4c87d22b37e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:43.711700 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d2ec3-51d8-468a-b0fc-e4c87d22b37e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:43.746535 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c46876-fabc-4fc3-8693-edcaf2dd8add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:43.747200 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c46876-fabc-4fc3-8693-edcaf2dd8add None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:43.747476 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c46876-fabc-4fc3-8693-edcaf2dd8add None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:43.747746 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c46876-fabc-4fc3-8693-edcaf2dd8add None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:43.748475 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c46876-fabc-4fc3-8693-edcaf2dd8add None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:43.748779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c46876-fabc-4fc3-8693-edcaf2dd8add None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:43.750164 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c46876-fabc-4fc3-8693-edcaf2dd8add None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:43.763189 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 469/937] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:43.768796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6047b-cbf6-44a1-834a-ed1507e82bde None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:43.840254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70b488-2e7f-4a39-a1ed-de9a88cc3c0e None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:43.840552 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70b488-2e7f-4a39-a1ed-de9a88cc3c0e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:43.840928 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70b488-2e7f-4a39-a1ed-de9a88cc3c0e None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:43.843262 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 470/938] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:06:43.849880 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e6880-8548-4bba-88e5-b43a96359e55 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:43.850202 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e6880-8548-4bba-88e5-b43a96359e55 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:43.850444 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e6880-8548-4bba-88e5-b43a96359e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:43.876102 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-9b2e6880-8548-4bba-88e5-b43a96359e55 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:43.877735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9b2e6880-8548-4bba-88e5-b43a96359e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:43.889993 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6047b-cbf6-44a1-834a-ed1507e82bde None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:43.931043 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cad916-2df4-4469-bec4-1a9352f80984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:43.932209 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cad916-2df4-4469-bec4-1a9352f80984 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:43.932736 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cad916-2df4-4469-bec4-1a9352f80984 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:43.933216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cad916-2df4-4469-bec4-1a9352f80984 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:43.940823 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cad916-2df4-4469-bec4-1a9352f80984 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:43.942537 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cad916-2df4-4469-bec4-1a9352f80984 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:43.958578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-07cad916-2df4-4469-bec4-1a9352f80984 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:06:43.958578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:43.958578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:43.958578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:43.958578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:43.958578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:43.958578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:43.958578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:43.958578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:43.958578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:43.958578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:43.958578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:43.958578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:43.958578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:43.958578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:43.958578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:43.960091 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:43.960091 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:43.960091 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:43.960091 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:43.960091 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:43.960091 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:43.960091 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:43.960091 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:43.960091 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:43.960091 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:43.960091 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:43.960091 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:43.960091 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:43.960091 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:43.960091 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:43.960091 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:43.960091 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:43.960091 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:43.961243 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:43.961243 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:43.961243 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:43.961243 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:43.961243 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:43.961243 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:43.961243 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:43.961243 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:43.961243 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:06:43.961243 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:43.964017 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 469/939] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:06:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:43.964637 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 471/940] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:06:43.973396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cad916-2df4-4469-bec4-1a9352f80984 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:43.992661 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e6880-8548-4bba-88e5-b43a96359e55 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:44.081319 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cad916-2df4-4469-bec4-1a9352f80984 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:44.145500 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e6880-8548-4bba-88e5-b43a96359e55 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:44.161410 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7d176-5c69-4996-8488-1ce56bec4dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:44.161410 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7d176-5c69-4996-8488-1ce56bec4dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:44.161410 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7d176-5c69-4996-8488-1ce56bec4dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:44.161410 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7d176-5c69-4996-8488-1ce56bec4dc1 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:44.161985 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7d176-5c69-4996-8488-1ce56bec4dc1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:44.161985 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7d176-5c69-4996-8488-1ce56bec4dc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:44.165401 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7d176-5c69-4996-8488-1ce56bec4dc1 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:44.209409 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 470/941] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 9 15:06:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:44.213397 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bb138-5051-4b5b-bb8c-96495f039252 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:44.213397 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bb138-5051-4b5b-bb8c-96495f039252 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:44.213397 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bb138-5051-4b5b-bb8c-96495f039252 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:44.217393 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 471/942] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:44.217393 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bb138-5051-4b5b-bb8c-96495f039252 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:44.237396 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca1978-9022-4fe8-82a3-fd0ff4045dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:44.237396 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca1978-9022-4fe8-82a3-fd0ff4045dc8 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:44.237396 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca1978-9022-4fe8-82a3-fd0ff4045dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:44.237396 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca1978-9022-4fe8-82a3-fd0ff4045dc8 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:44.237820 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca1978-9022-4fe8-82a3-fd0ff4045dc8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:44.237820 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca1978-9022-4fe8-82a3-fd0ff4045dc8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:44.239765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: WARNING keystone.server.flask.common [None req-92ca1978-9022-4fe8-82a3-fd0ff4045dc8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 09 15:06:44.261468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.sql.core [None req-92ca1978-9022-4fe8-82a3-fd0ff4045dc8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 15:06:44.261468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 09 15:06:44.261468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [parameters: {'id': 'bb4efa8f52a74656a53bee62dda2b9dc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 09 15:06:44.261468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80164) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 15:06:44.278967 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-92ca1978-9022-4fe8-82a3-fd0ff4045dc8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bb4efa8f52a74656a53bee62dda2b9dc.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bb4efa8f52a74656a53bee62dda2b9dc. May 09 15:06:44.278967 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:44.278967 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:06:44.278967 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:06:44.278967 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:06:44.278967 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:06:44.278967 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:06:44.278967 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:06:44.278967 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:06:44.278967 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application conn.query(q) May 09 15:06:44.278967 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:06:44.278967 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:06:44.278967 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:06:44.279869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application result.read() May 09 15:06:44.279869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:06:44.279869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:06:44.279869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:06:44.279869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:06:44.279869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:06:44.279869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:06:44.279869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:06:44.279869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:06:44.279869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 15:06:44.279869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:44.279869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 15:06:44.279869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:44.279869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:44.279869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 15:06:44.279869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 15:06:44.279869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 09 15:06:44.279869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return project_ref.to_dict() May 09 15:06:44.280846 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:06:44.280846 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application next(self.gen) May 09 15:06:44.280846 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 15:06:44.280846 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application yield resource May 09 15:06:44.280846 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:06:44.280846 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application next(self.gen) May 09 15:06:44.280846 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 15:06:44.280846 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.session.rollback() May 09 15:06:44.280846 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 15:06:44.280846 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.force_reraise() May 09 15:06:44.280846 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 15:06:44.280846 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise self.value May 09 15:06:44.280846 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 15:06:44.280846 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 15:06:44.280846 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 15:06:44.280846 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application session.commit() May 09 15:06:44.280846 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 15:06:44.281809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 15:06:44.281809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 15:06:44.281809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._prepare_impl() May 09 15:06:44.281809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 15:06:44.281809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.session.flush() May 09 15:06:44.281809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 15:06:44.281809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._flush(objects) May 09 15:06:44.281809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 15:06:44.281809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 15:06:44.281809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 15:06:44.281809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application compat.raise_( May 09 15:06:44.281809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:06:44.281809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception May 09 15:06:44.281809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 15:06:44.281809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application flush_context.execute() May 09 15:06:44.281809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 15:06:44.281809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rec.execute(self) May 09 15:06:44.282736 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 15:06:44.282736 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 15:06:44.282736 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 15:06:44.282736 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 15:06:44.282736 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 09 15:06:44.282736 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application c = connection._execute_20( May 09 15:06:44.282736 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 15:06:44.282736 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 15:06:44.282736 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 15:06:44.282736 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 15:06:44.282736 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 15:06:44.282736 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 15:06:44.282736 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 15:06:44.282736 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 15:06:44.282736 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 15:06:44.284975 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 15:06:44.284975 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:06:44.284975 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception May 09 15:06:44.284975 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:06:44.284975 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:06:44.284975 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:06:44.284975 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:06:44.284975 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:06:44.284975 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:06:44.284975 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:06:44.284975 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application conn.query(q) May 09 15:06:44.284975 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:06:44.284975 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:06:44.284975 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:06:44.284975 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application result.read() May 09 15:06:44.284975 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:06:44.284975 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:06:44.286240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:06:44.286240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:06:44.286240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:06:44.286240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:06:44.286240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:06:44.286240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:06:44.286240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 15:06:44.286240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 09 15:06:44.286240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [parameters: {'id': 'bb4efa8f52a74656a53bee62dda2b9dc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 09 15:06:44.286240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 15:06:44.286240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:44.286240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:44.286240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:44.286240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:44.286240 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 09 15:06:44.288097 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 09 15:06:44.288097 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 15:06:44.288097 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 15:06:44.288097 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 09 15:06:44.288097 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:44.288097 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:44.288097 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:44.288097 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:44.288097 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:44.288097 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:44.288097 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:44.288097 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:44.288097 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:44.288097 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:44.288097 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:44.288097 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:44.288097 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:44.290329 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:44.290329 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 09 15:06:44.290329 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 09 15:06:44.290329 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:44.290329 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:44.290329 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 09 15:06:44.290329 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.Conflict( May 09 15:06:44.290329 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bb4efa8f52a74656a53bee62dda2b9dc. May 09 15:06:44.290329 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:44.290329 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 472/943] 10.222.0.48 () {60 vars in 1140 bytes} [Mon May 9 15:06:43 2022] POST /identity/v3/projects => generated 262 bytes in 288 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:44.290329 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a226cf6-2a44-4a83-aa36-888b4d94367e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:44.290329 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a226cf6-2a44-4a83-aa36-888b4d94367e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:44.291157 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a226cf6-2a44-4a83-aa36-888b4d94367e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:44.307363 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-8a226cf6-2a44-4a83-aa36-888b4d94367e None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:44.309074 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8a226cf6-2a44-4a83-aa36-888b4d94367e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:44.352814 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bb138-5051-4b5b-bb8c-96495f039252 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:44.386154 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 473/944] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:44.386154 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a226cf6-2a44-4a83-aa36-888b4d94367e None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:44.429420 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b002c7b-65df-44b8-9306-f3660e2613fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:44.430599 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b002c7b-65df-44b8-9306-f3660e2613fe None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:44.431128 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b002c7b-65df-44b8-9306-f3660e2613fe None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:44.431609 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b002c7b-65df-44b8-9306-f3660e2613fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:44.442910 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b002c7b-65df-44b8-9306-f3660e2613fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:44.445568 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b002c7b-65df-44b8-9306-f3660e2613fe None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:44.470560 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-6b002c7b-65df-44b8-9306-f3660e2613fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:44.470560 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:44.470560 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:44.470560 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:44.470560 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:44.470560 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:44.470560 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:44.470560 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:44.470560 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:44.470560 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:44.470560 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:44.470560 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:44.470560 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:44.470560 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:44.470560 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:44.471532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:44.471532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:44.471532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:44.471532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:44.471532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:44.471532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:44.471532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:44.471532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:44.471532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:44.471532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:44.471532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:44.471532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:44.471532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:44.471532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:44.471532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:44.471532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:44.471532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:44.473900 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:44.473900 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:44.473900 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:44.473900 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:44.473900 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 472/945] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:44.473900 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b002c7b-65df-44b8-9306-f3660e2613fe None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:44.529214 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a226cf6-2a44-4a83-aa36-888b4d94367e None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:44.563448 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43532195-1f8b-4cf3-bce0-60970ff130cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:44.564259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43532195-1f8b-4cf3-bce0-60970ff130cf None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:44.564537 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43532195-1f8b-4cf3-bce0-60970ff130cf None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:44.564810 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43532195-1f8b-4cf3-bce0-60970ff130cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:44.573198 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43532195-1f8b-4cf3-bce0-60970ff130cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:44.574986 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43532195-1f8b-4cf3-bce0-60970ff130cf None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:44.590254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-43532195-1f8b-4cf3-bce0-60970ff130cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:44.590254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:44.590254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:44.590254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:44.590254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:44.590254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:44.590254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:44.590254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:44.590254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:44.590254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:44.590254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:44.590254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:44.590254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:44.590254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:44.590254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:44.591438 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:44.591438 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:44.591438 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:44.591438 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:44.591438 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:44.591438 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:44.591438 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:44.591438 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:44.591438 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:44.591438 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:44.591438 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:44.591438 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:44.591438 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:44.591438 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:44.591438 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:44.591438 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:44.591438 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:44.592373 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:44.592373 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:44.592373 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:44.592373 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:44.592373 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:44.592373 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:44.592373 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:44.592373 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:44.596651 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 474/946] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:44.597401 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b002c7b-65df-44b8-9306-f3660e2613fe None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:44.597544 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43532195-1f8b-4cf3-bce0-60970ff130cf None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:44.632368 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a034f7c-ecea-4441-afeb-ef8c2e0ead65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:44.633160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a034f7c-ecea-4441-afeb-ef8c2e0ead65 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:44.633476 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a034f7c-ecea-4441-afeb-ef8c2e0ead65 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:44.633752 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a034f7c-ecea-4441-afeb-ef8c2e0ead65 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:44.634402 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a034f7c-ecea-4441-afeb-ef8c2e0ead65 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:44.635766 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a034f7c-ecea-4441-afeb-ef8c2e0ead65 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:44.647742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-7a034f7c-ecea-4441-afeb-ef8c2e0ead65 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:06:44.647742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:44.647742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:06:44.647742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:06:44.647742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:06:44.647742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:06:44.647742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:06:44.647742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:44.647742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:06:44.647742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:44.647742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:44.647742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:44.647742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:44.647742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:44.647742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:44.647742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:44.647742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:44.648784 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:44.648784 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:44.648784 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:44.648784 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:44.648784 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:44.648784 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:44.648784 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:06:44.648784 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:06:44.648784 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:06:44.648784 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:06:44.648784 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:44.648784 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:44.648784 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:44.648784 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:44.648784 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:44.648784 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:44.650285 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:44.650285 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:44.650285 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:44.650285 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:44.650285 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:44.650285 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:44.650285 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:44.650285 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:44.650285 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:44.650285 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:44.650285 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:06:44.650285 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:44.650285 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:06:44.650285 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:44.650285 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 473/947] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:06:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:44.651097 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a034f7c-ecea-4441-afeb-ef8c2e0ead65 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:44.701872 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43532195-1f8b-4cf3-bce0-60970ff130cf None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:44.735796 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825b0b9-4a12-4426-af04-c5f6c81a65fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:44.736479 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825b0b9-4a12-4426-af04-c5f6c81a65fc None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:44.736756 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825b0b9-4a12-4426-af04-c5f6c81a65fc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:44.737027 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825b0b9-4a12-4426-af04-c5f6c81a65fc None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:44.737774 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825b0b9-4a12-4426-af04-c5f6c81a65fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:44.738077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825b0b9-4a12-4426-af04-c5f6c81a65fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:44.739421 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825b0b9-4a12-4426-af04-c5f6c81a65fc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:44.751931 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a034f7c-ecea-4441-afeb-ef8c2e0ead65 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:44.754502 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 475/948] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:44.755333 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825b0b9-4a12-4426-af04-c5f6c81a65fc None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:44.790952 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91ee31-bcfc-4881-b194-f8eb1b8fa232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:44.791722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91ee31-bcfc-4881-b194-f8eb1b8fa232 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:44.792003 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91ee31-bcfc-4881-b194-f8eb1b8fa232 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:44.792279 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91ee31-bcfc-4881-b194-f8eb1b8fa232 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:44.793028 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91ee31-bcfc-4881-b194-f8eb1b8fa232 None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:44.793336 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91ee31-bcfc-4881-b194-f8eb1b8fa232 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:44.794778 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91ee31-bcfc-4881-b194-f8eb1b8fa232 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:44.811485 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 474/949] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:06:44 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:44.812381 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91ee31-bcfc-4881-b194-f8eb1b8fa232 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:44.864605 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825b0b9-4a12-4426-af04-c5f6c81a65fc None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:44.903337 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3bc9b-c2c1-4b88-9d6a-01fbc8cfd75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:44.904019 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3bc9b-c2c1-4b88-9d6a-01fbc8cfd75b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:44.904303 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3bc9b-c2c1-4b88-9d6a-01fbc8cfd75b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:44.904581 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3bc9b-c2c1-4b88-9d6a-01fbc8cfd75b None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:44.905303 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3bc9b-c2c1-4b88-9d6a-01fbc8cfd75b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:44.905648 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3bc9b-c2c1-4b88-9d6a-01fbc8cfd75b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:44.907053 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3bc9b-c2c1-4b88-9d6a-01fbc8cfd75b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:44.918012 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 476/950] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:06:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:44.918012 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445786ba-9374-4712-9370-fd71042c8c50 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:44.918012 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445786ba-9374-4712-9370-fd71042c8c50 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:44.918012 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445786ba-9374-4712-9370-fd71042c8c50 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:44.918012 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 477/951] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:44.919157 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445786ba-9374-4712-9370-fd71042c8c50 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:44.944905 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91ee31-bcfc-4881-b194-f8eb1b8fa232 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:44.986772 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d82282-d269-4f9c-8c2d-52cb81064121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:44.988416 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d82282-d269-4f9c-8c2d-52cb81064121 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:44.988767 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d82282-d269-4f9c-8c2d-52cb81064121 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:44.989216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d82282-d269-4f9c-8c2d-52cb81064121 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:44.997345 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d82282-d269-4f9c-8c2d-52cb81064121 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:44.998823 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d82282-d269-4f9c-8c2d-52cb81064121 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:45.014377 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-57d82282-d269-4f9c-8c2d-52cb81064121 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:45.014377 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:45.014377 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:45.014377 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:45.014377 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:45.014377 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:45.014377 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:45.014377 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:45.014377 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:45.014377 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:45.014377 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:45.014377 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:45.014377 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:45.014377 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:45.014377 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:45.015337 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:45.015337 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:45.015337 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:45.015337 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:45.015337 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:45.015337 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:45.015337 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:45.015337 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:45.015337 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:45.015337 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:45.015337 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:45.015337 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:45.015337 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:45.015337 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:45.015337 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:45.015337 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:45.015337 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:45.016409 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:45.016409 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:45.016409 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:45.016409 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:45.016409 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:45.016409 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:45.016409 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:45.016409 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:45.016409 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 475/952] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:45.017440 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98786ae-d3ee-4ee0-9eb0-50962a88859d None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:45.017440 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98786ae-d3ee-4ee0-9eb0-50962a88859d None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:45.017597 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98786ae-d3ee-4ee0-9eb0-50962a88859d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:45.034366 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-b98786ae-d3ee-4ee0-9eb0-50962a88859d None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:45.035549 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b98786ae-d3ee-4ee0-9eb0-50962a88859d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:45.039377 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445786ba-9374-4712-9370-fd71042c8c50 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:45.080052 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d858b01-3b13-4e57-b617-af116fa54e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:45.080723 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d858b01-3b13-4e57-b617-af116fa54e17 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:45.081004 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d858b01-3b13-4e57-b617-af116fa54e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:45.081284 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d858b01-3b13-4e57-b617-af116fa54e17 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:45.082041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d858b01-3b13-4e57-b617-af116fa54e17 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:45.082346 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d858b01-3b13-4e57-b617-af116fa54e17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:45.083731 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d858b01-3b13-4e57-b617-af116fa54e17 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:45.089483 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 478/953] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:06:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:45.090302 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d858b01-3b13-4e57-b617-af116fa54e17 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:45.111474 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 476/954] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:45.111474 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98786ae-d3ee-4ee0-9eb0-50962a88859d None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:45.196622 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d858b01-3b13-4e57-b617-af116fa54e17 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:45.208449 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98786ae-d3ee-4ee0-9eb0-50962a88859d None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:45.231088 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c5c57-4364-49d4-b5bf-9ec1cd5a0835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:45.231815 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c5c57-4364-49d4-b5bf-9ec1cd5a0835 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:45.232092 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c5c57-4364-49d4-b5bf-9ec1cd5a0835 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:45.232363 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c5c57-4364-49d4-b5bf-9ec1cd5a0835 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:45.233149 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c5c57-4364-49d4-b5bf-9ec1cd5a0835 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:45.233541 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c5c57-4364-49d4-b5bf-9ec1cd5a0835 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:45.235265 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c5c57-4364-49d4-b5bf-9ec1cd5a0835 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:45.247825 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68016a-5818-4b50-aeac-90d02fb5ef53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:45.248169 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 479/955] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:06:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:45.248412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68016a-5818-4b50-aeac-90d02fb5ef53 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:45.248700 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68016a-5818-4b50-aeac-90d02fb5ef53 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:45.248978 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68016a-5818-4b50-aeac-90d02fb5ef53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:45.249718 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c5c57-4364-49d4-b5bf-9ec1cd5a0835 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:45.249837 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68016a-5818-4b50-aeac-90d02fb5ef53 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:45.251204 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68016a-5818-4b50-aeac-90d02fb5ef53 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:45.271351 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 477/956] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:06:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:06:45.272141 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68016a-5818-4b50-aeac-90d02fb5ef53 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:45.387060 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c5c57-4364-49d4-b5bf-9ec1cd5a0835 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:45.395062 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68016a-5818-4b50-aeac-90d02fb5ef53 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:45.433400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a486876-ccc6-482e-834a-6d4c1d691adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:45.433400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a486876-ccc6-482e-834a-6d4c1d691adc None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:45.433400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a486876-ccc6-482e-834a-6d4c1d691adc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:45.433400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a486876-ccc6-482e-834a-6d4c1d691adc None admin] PATH_INFO: `/v3/services/compute` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:45.433879 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a486876-ccc6-482e-834a-6d4c1d691adc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:45.433879 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a486876-ccc6-482e-834a-6d4c1d691adc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:45.434054 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f8230-bb3a-4c91-943b-99e14e0131e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:45.434054 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f8230-bb3a-4c91-943b-99e14e0131e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:45.434226 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f8230-bb3a-4c91-943b-99e14e0131e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:45.434437 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f8230-bb3a-4c91-943b-99e14e0131e7 None admin] PATH_INFO: `/v3/projects/4fcadeae44cc4547905b83bfebec79c7/users/057ad64901314362914287aed5b468ea/roles/9f1767627c554047835baae35bce7b7c` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:45.436952 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f8230-bb3a-4c91-943b-99e14e0131e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=4fcadeae44cc4547905b83bfebec79c7, user_id=057ad64901314362914287aed5b468ea, role_id=9f1767627c554047835baae35bce7b7c)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:45.438476 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f8230-bb3a-4c91-943b-99e14e0131e7 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:45.445988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-3a486876-ccc6-482e-834a-6d4c1d691adc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:06:45.445988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:45.445988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:06:45.445988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:06:45.445988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:06:45.445988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:06:45.445988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:06:45.445988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:45.445988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:06:45.445988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:45.445988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:45.445988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:45.445988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:45.445988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:45.445988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:45.445988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:45.445988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:45.447204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:45.447204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:45.447204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:45.447204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:45.447204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:45.447204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:45.447204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:06:45.447204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:06:45.447204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:06:45.447204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:06:45.447204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:45.447204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:45.447204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:45.447204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:45.447204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:45.447204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:45.448045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:45.448045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:45.448045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:45.448045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:45.448045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:45.448045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:45.448045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:45.448045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:45.448045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:45.448045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:45.448045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:06:45.448045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:45.448045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:06:45.448045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:45.448045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 480/957] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:45.459291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a486876-ccc6-482e-834a-6d4c1d691adc None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:45.469594 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 478/958] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:06:45 2022] PUT /identity/v3/projects/4fcadeae44cc4547905b83bfebec79c7/users/057ad64901314362914287aed5b468ea/roles/9f1767627c554047835baae35bce7b7c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:06:45.583661 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a486876-ccc6-482e-834a-6d4c1d691adc None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:45.622272 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9e72d-f537-4066-a3c4-1bd8f8a40700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:45.622952 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9e72d-f537-4066-a3c4-1bd8f8a40700 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:45.623237 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9e72d-f537-4066-a3c4-1bd8f8a40700 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:45.623512 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9e72d-f537-4066-a3c4-1bd8f8a40700 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:45.624234 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9e72d-f537-4066-a3c4-1bd8f8a40700 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:45.624548 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9e72d-f537-4066-a3c4-1bd8f8a40700 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:45.625965 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9e72d-f537-4066-a3c4-1bd8f8a40700 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:45.631986 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 481/959] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:06:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:45.638087 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f8230-bb3a-4c91-943b-99e14e0131e7 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:45.754341 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f8230-bb3a-4c91-943b-99e14e0131e7 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:45.790045 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f375d4-f5c0-46f5-8934-5345a2931ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:45.790896 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f375d4-f5c0-46f5-8934-5345a2931ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:45.791324 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f375d4-f5c0-46f5-8934-5345a2931ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:45.791757 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f375d4-f5c0-46f5-8934-5345a2931ef6 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:45.792853 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f375d4-f5c0-46f5-8934-5345a2931ef6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:45.793316 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f375d4-f5c0-46f5-8934-5345a2931ef6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:45.795775 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f375d4-f5c0-46f5-8934-5345a2931ef6 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:45.801918 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 479/960] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:06:45 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:47.249972 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61090a78-dd33-4a0d-8af5-10773f68fd6d None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:47.250494 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61090a78-dd33-4a0d-8af5-10773f68fd6d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:47.250610 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61090a78-dd33-4a0d-8af5-10773f68fd6d None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:47.252505 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 482/961] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:47.260393 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b2a1b-528c-4e19-813d-00b0a6a568ee None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:47.260879 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b2a1b-528c-4e19-813d-00b0a6a568ee None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:47.260982 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b2a1b-528c-4e19-813d-00b0a6a568ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:47.279113 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-732b2a1b-528c-4e19-813d-00b0a6a568ee None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:47.280298 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-732b2a1b-528c-4e19-813d-00b0a6a568ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:47.353128 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 480/962] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:06:47.379054 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61090a78-dd33-4a0d-8af5-10773f68fd6d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:47.493636 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61090a78-dd33-4a0d-8af5-10773f68fd6d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:47.531926 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a39711-25a9-47db-a4ce-b60c711cad4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:47.532528 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a39711-25a9-47db-a4ce-b60c711cad4c None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:47.532841 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a39711-25a9-47db-a4ce-b60c711cad4c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:47.533319 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a39711-25a9-47db-a4ce-b60c711cad4c None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:47.534390 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a39711-25a9-47db-a4ce-b60c711cad4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:47.535839 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a39711-25a9-47db-a4ce-b60c711cad4c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:47.550188 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.sql.core [None req-e6a39711-25a9-47db-a4ce-b60c711cad4c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 15:06:47.550188 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 09 15:06:47.550188 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [parameters: {'user_id': '718473663ae64035a83eb1004eb89f97', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 09 15:06:47.550188 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80164) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 15:06:47.558269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-e6a39711-25a9-47db-a4ce-b60c711cad4c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 09 15:06:47.558269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:47.558269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:06:47.558269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:06:47.558269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:06:47.558269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:06:47.558269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:06:47.558269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:06:47.558269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:06:47.558269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application conn.query(q) May 09 15:06:47.558269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:06:47.558269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:06:47.558269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:06:47.558269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application result.read() May 09 15:06:47.558269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:06:47.559161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:06:47.559161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:06:47.559161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:06:47.559161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:06:47.559161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:06:47.559161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:06:47.559161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:06:47.559161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 15:06:47.559161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:47.559161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 15:06:47.559161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:47.559161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:47.559161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 15:06:47.559161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 15:06:47.559161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 09 15:06:47.559161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 09 15:06:47.559161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:06:47.559161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application next(self.gen) May 09 15:06:47.560582 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 15:06:47.560582 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application yield resource May 09 15:06:47.560582 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:06:47.560582 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application next(self.gen) May 09 15:06:47.560582 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 15:06:47.560582 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.session.rollback() May 09 15:06:47.560582 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 15:06:47.560582 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.force_reraise() May 09 15:06:47.560582 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 15:06:47.560582 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise self.value May 09 15:06:47.560582 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 15:06:47.560582 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 15:06:47.560582 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 15:06:47.560582 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application session.commit() May 09 15:06:47.560582 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 15:06:47.560582 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 15:06:47.560582 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 15:06:47.561755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._prepare_impl() May 09 15:06:47.561755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 15:06:47.561755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.session.flush() May 09 15:06:47.561755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 15:06:47.561755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._flush(objects) May 09 15:06:47.561755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 15:06:47.561755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 15:06:47.561755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 15:06:47.561755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application compat.raise_( May 09 15:06:47.561755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:06:47.561755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception May 09 15:06:47.561755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 15:06:47.561755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application flush_context.execute() May 09 15:06:47.561755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 15:06:47.561755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rec.execute(self) May 09 15:06:47.561755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 15:06:47.561755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 15:06:47.562652 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 15:06:47.562652 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 15:06:47.562652 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 09 15:06:47.562652 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application result = connection._execute_20( May 09 15:06:47.562652 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 15:06:47.562652 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 15:06:47.562652 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 15:06:47.562652 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 15:06:47.562652 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 15:06:47.562652 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 15:06:47.562652 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 15:06:47.562652 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 15:06:47.562652 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 15:06:47.562652 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 15:06:47.562652 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:06:47.562652 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception May 09 15:06:47.563502 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:06:47.563502 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:06:47.563502 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:06:47.563502 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:06:47.563502 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:06:47.563502 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:06:47.563502 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:06:47.563502 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application conn.query(q) May 09 15:06:47.563502 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:06:47.563502 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:06:47.563502 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:06:47.563502 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application result.read() May 09 15:06:47.563502 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:06:47.563502 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:06:47.563502 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:06:47.563502 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:06:47.571264 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:06:47.571264 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:06:47.571264 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:06:47.571264 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:06:47.571264 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 15:06:47.571264 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 09 15:06:47.571264 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [parameters: {'user_id': '718473663ae64035a83eb1004eb89f97', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 09 15:06:47.571264 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 15:06:47.571264 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:47.571264 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:47.571264 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:47.571264 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:47.571264 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:47.571264 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:47.571264 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:47.573818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:47.573818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:47.573818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:47.573818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:47.573818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:47.573818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:47.573818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:47.573818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 09 15:06:47.573818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 09 15:06:47.573818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:47.573818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:47.573818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:47.573818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:47.573818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:47.573818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:47.573818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 09 15:06:47.573818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 09 15:06:47.576065 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 09 15:06:47.576065 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 09 15:06:47.576065 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 15:06:47.576065 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 15:06:47.576065 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 09 15:06:47.576065 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:47.576065 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 483/963] 10.222.0.48 () {60 vars in 1131 bytes} [Mon May 9 15:06:47 2022] POST /identity/v3/users => generated 160 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:47.576983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b2a1b-528c-4e19-813d-00b0a6a568ee None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:47.669865 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f7eed-675c-4845-8ca5-d1b1f1d5a498 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:47.670200 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f7eed-675c-4845-8ca5-d1b1f1d5a498 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:47.670467 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f7eed-675c-4845-8ca5-d1b1f1d5a498 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:47.671008 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b2a1b-528c-4e19-813d-00b0a6a568ee None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:47.680231 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 484/964] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:06:47.681616 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d6510-fbe6-4fd2-a15a-115f55ee6806 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:47.681903 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d6510-fbe6-4fd2-a15a-115f55ee6806 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:47.682179 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d6510-fbe6-4fd2-a15a-115f55ee6806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:47.701347 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-200d6510-fbe6-4fd2-a15a-115f55ee6806 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:47.703034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-200d6510-fbe6-4fd2-a15a-115f55ee6806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:47.713082 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a48ec-8374-4a94-8775-3f57db870dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:47.713935 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a48ec-8374-4a94-8775-3f57db870dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:47.714686 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a48ec-8374-4a94-8775-3f57db870dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:47.714973 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a48ec-8374-4a94-8775-3f57db870dd8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:47.726067 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a48ec-8374-4a94-8775-3f57db870dd8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:47.728697 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a48ec-8374-4a94-8775-3f57db870dd8 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:47.748372 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-bf7a48ec-8374-4a94-8775-3f57db870dd8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:06:47.748372 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:47.748372 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:47.748372 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:47.748372 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:47.748372 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:47.748372 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:47.748372 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:47.748372 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:47.748372 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:47.748372 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:47.748372 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:47.748372 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:47.748372 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:47.748372 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:47.748372 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:47.749835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:47.749835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:47.749835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:47.749835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:47.749835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:47.749835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:47.749835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:47.749835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:47.749835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:47.749835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:47.749835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:47.749835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:47.749835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:47.749835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:47.749835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:47.749835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:47.749835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:47.749835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:47.751171 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:47.751171 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:47.751171 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:47.751171 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:47.751171 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:47.751171 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:47.751171 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:47.751171 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:47.751171 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:06:47.751171 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:47.751171 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 481/965] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:06:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:47.756128 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a48ec-8374-4a94-8775-3f57db870dd8 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:47.785550 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 485/966] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:47.802239 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d6510-fbe6-4fd2-a15a-115f55ee6806 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:47.867764 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a48ec-8374-4a94-8775-3f57db870dd8 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:47.911008 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d6510-fbe6-4fd2-a15a-115f55ee6806 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:47.915823 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc531c6c-1d3e-47ae-819d-8c6d920eaa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:47.916506 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc531c6c-1d3e-47ae-819d-8c6d920eaa0d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:47.916863 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc531c6c-1d3e-47ae-819d-8c6d920eaa0d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:47.917151 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc531c6c-1d3e-47ae-819d-8c6d920eaa0d None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:47.918077 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc531c6c-1d3e-47ae-819d-8c6d920eaa0d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:47.918474 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc531c6c-1d3e-47ae-819d-8c6d920eaa0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:47.919876 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc531c6c-1d3e-47ae-819d-8c6d920eaa0d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:47.949498 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b994537-18a3-4ba0-9a0d-4641b618c32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:47.950315 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b994537-18a3-4ba0-9a0d-4641b618c32f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:47.950590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b994537-18a3-4ba0-9a0d-4641b618c32f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:47.950858 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b994537-18a3-4ba0-9a0d-4641b618c32f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:47.951524 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b994537-18a3-4ba0-9a0d-4641b618c32f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:47.953064 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b994537-18a3-4ba0-9a0d-4641b618c32f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:47.964290 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 482/967] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:06:47 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:47.964290 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f74de-b664-4890-89f8-f5581e7abf01 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:47.964290 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f74de-b664-4890-89f8-f5581e7abf01 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:47.964290 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f74de-b664-4890-89f8-f5581e7abf01 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:47.964290 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 483/968] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:47.967921 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-2b994537-18a3-4ba0-9a0d-4641b618c32f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:06:47.967921 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:47.967921 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:06:47.967921 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:06:47.967921 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:06:47.967921 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:06:47.967921 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:06:47.967921 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:47.967921 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:06:47.967921 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:47.967921 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:47.967921 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:47.967921 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:47.967921 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:47.967921 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:47.967921 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:47.967921 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:47.969082 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:47.969082 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:47.969082 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:47.969082 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:47.969082 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:47.969082 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:47.969082 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:06:47.969082 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:06:47.969082 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:06:47.969082 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:06:47.969082 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:47.969082 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:47.969082 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:47.969082 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:47.969082 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:47.969082 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:47.970008 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:47.970008 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:47.970008 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:47.970008 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:47.970008 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:47.970008 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:47.970008 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:47.970008 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:47.970008 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:47.970008 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:47.970008 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:06:47.970008 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:47.970008 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:06:47.970008 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:47.972828 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 486/969] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:06:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:47.973016 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29293775-093c-4331-b69d-8a3bdf662411 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:47.973292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29293775-093c-4331-b69d-8a3bdf662411 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:47.973606 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29293775-093c-4331-b69d-8a3bdf662411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:47.973824 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b994537-18a3-4ba0-9a0d-4641b618c32f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:48.001793 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-29293775-093c-4331-b69d-8a3bdf662411 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:48.004161 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-29293775-093c-4331-b69d-8a3bdf662411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:48.091629 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 484/970] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:48.102377 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b994537-18a3-4ba0-9a0d-4641b618c32f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:48.115266 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29293775-093c-4331-b69d-8a3bdf662411 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:48.142894 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59723ce2-2145-4332-bc97-52adef4335b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:48.143571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59723ce2-2145-4332-bc97-52adef4335b3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:48.143852 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59723ce2-2145-4332-bc97-52adef4335b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:48.144125 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59723ce2-2145-4332-bc97-52adef4335b3 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:48.144835 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59723ce2-2145-4332-bc97-52adef4335b3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:48.145156 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59723ce2-2145-4332-bc97-52adef4335b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:48.146570 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59723ce2-2145-4332-bc97-52adef4335b3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:48.152109 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 487/971] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:06:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:48.153568 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad1d13-d9dc-422e-b11a-487cff127538 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:48.153863 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad1d13-d9dc-422e-b11a-487cff127538 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:48.154133 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad1d13-d9dc-422e-b11a-487cff127538 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:48.155375 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 488/972] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:48.160395 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad1d13-d9dc-422e-b11a-487cff127538 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:48.239226 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29293775-093c-4331-b69d-8a3bdf662411 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:48.274118 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad1d13-d9dc-422e-b11a-487cff127538 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:48.276748 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eccbfa-8824-434d-b3cb-ea8216c4fa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:48.277586 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eccbfa-8824-434d-b3cb-ea8216c4fa0b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:48.277874 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eccbfa-8824-434d-b3cb-ea8216c4fa0b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:48.278154 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eccbfa-8824-434d-b3cb-ea8216c4fa0b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:48.291289 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eccbfa-8824-434d-b3cb-ea8216c4fa0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:06:48.300634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-24eccbfa-8824-434d-b3cb-ea8216c4fa0b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:06:48.300634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:48.300634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:48.300634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:48.300634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:48.300634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:48.300634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:48.300634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:48.300634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:48.300634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:48.300634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:48.300634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:48.300634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:06:48.300634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:06:48.300634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:06:48.300634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:06:48.302703 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:06:48.302703 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:06:48.302703 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:06:48.302703 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:06:48.302703 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:48.302703 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:48.302703 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:48.302703 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:48.302703 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:48.302703 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:48.302703 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:48.302703 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:48.302703 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:48.302703 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:48.302703 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:48.302703 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:48.307790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:48.307790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:48.307790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:48.307790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:48.307790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:06:48.307790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:06:48.307790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:06:48.307790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:06:48.307790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:06:48.307790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:06:48.307790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:06:48.307790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:48.307790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 485/973] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 9 15:06:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:48.307790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f65cef-3a79-4dcd-9e2e-703a0ced9988 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:48.310145 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f65cef-3a79-4dcd-9e2e-703a0ced9988 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:48.310145 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f65cef-3a79-4dcd-9e2e-703a0ced9988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:48.314014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba1234-95dc-427e-9730-0b03e109de43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:48.315050 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba1234-95dc-427e-9730-0b03e109de43 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:48.315508 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba1234-95dc-427e-9730-0b03e109de43 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:48.315938 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba1234-95dc-427e-9730-0b03e109de43 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:48.317039 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba1234-95dc-427e-9730-0b03e109de43 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:48.317594 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba1234-95dc-427e-9730-0b03e109de43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:48.319936 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba1234-95dc-427e-9730-0b03e109de43 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:48.332597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 489/974] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:06:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:48.332900 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-02f65cef-3a79-4dcd-9e2e-703a0ced9988 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:48.333062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba1234-95dc-427e-9730-0b03e109de43 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:48.333224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-02f65cef-3a79-4dcd-9e2e-703a0ced9988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:48.418047 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 486/975] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:48.418837 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f65cef-3a79-4dcd-9e2e-703a0ced9988 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:48.441658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba1234-95dc-427e-9730-0b03e109de43 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:48.480336 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a97417-f0d0-4048-90b2-2e55ef0d6597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:48.481036 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a97417-f0d0-4048-90b2-2e55ef0d6597 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:48.481309 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a97417-f0d0-4048-90b2-2e55ef0d6597 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:48.481624 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a97417-f0d0-4048-90b2-2e55ef0d6597 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:48.482387 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a97417-f0d0-4048-90b2-2e55ef0d6597 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:48.482699 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a97417-f0d0-4048-90b2-2e55ef0d6597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:48.484104 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a97417-f0d0-4048-90b2-2e55ef0d6597 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:48.493714 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 490/976] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:06:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:48.494545 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a97417-f0d0-4048-90b2-2e55ef0d6597 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:48.521968 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f65cef-3a79-4dcd-9e2e-703a0ced9988 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:48.556317 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643f017-7efa-456f-ab32-95abbdc2a3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:48.556970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643f017-7efa-456f-ab32-95abbdc2a3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:48.557255 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643f017-7efa-456f-ab32-95abbdc2a3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:48.557564 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643f017-7efa-456f-ab32-95abbdc2a3e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:48.558361 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643f017-7efa-456f-ab32-95abbdc2a3e7 None admin] RBAC: Adding query filter params (interface=admin, service_id=6d2262575fd340dd84b7f24bed697581, region_id=RegionOne) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:48.558676 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643f017-7efa-456f-ab32-95abbdc2a3e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:48.560031 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1643f017-7efa-456f-ab32-95abbdc2a3e7 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:48.564954 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 487/977] 10.222.0.48 () {56 vars in 1249 bytes} [Mon May 9 15:06:48 2022] GET /identity/v3/endpoints?service_id=6d2262575fd340dd84b7f24bed697581&interface=admin®ion_id=RegionOne => generated 193 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:48.565796 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643f017-7efa-456f-ab32-95abbdc2a3e7 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:48.595327 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a97417-f0d0-4048-90b2-2e55ef0d6597 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:48.628435 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02412fc-c705-4c71-a7c5-9008c6ddb36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:48.629090 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02412fc-c705-4c71-a7c5-9008c6ddb36f None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:48.629394 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02412fc-c705-4c71-a7c5-9008c6ddb36f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:48.629674 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02412fc-c705-4c71-a7c5-9008c6ddb36f None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:48.630388 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02412fc-c705-4c71-a7c5-9008c6ddb36f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:48.631813 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02412fc-c705-4c71-a7c5-9008c6ddb36f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:48.644790 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 491/978] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:06:48 2022] POST /identity/v3/services => generated 242 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:06:48.645643 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02412fc-c705-4c71-a7c5-9008c6ddb36f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:48.666632 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643f017-7efa-456f-ab32-95abbdc2a3e7 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:48.710958 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50488106-eeee-4963-a1a4-eaf985db923d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:48.711867 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50488106-eeee-4963-a1a4-eaf985db923d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:48.712157 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50488106-eeee-4963-a1a4-eaf985db923d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:48.712443 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50488106-eeee-4963-a1a4-eaf985db923d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:48.724074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50488106-eeee-4963-a1a4-eaf985db923d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:48.726155 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50488106-eeee-4963-a1a4-eaf985db923d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:48.746028 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-50488106-eeee-4963-a1a4-eaf985db923d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:48.746028 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:48.746028 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:48.746028 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:48.746028 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:48.746028 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:48.746028 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:48.746028 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:48.746028 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:48.746028 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:48.746028 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:48.746028 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:48.746028 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:48.746028 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:48.746028 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:48.747096 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:48.747096 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:48.747096 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:48.747096 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:48.747096 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:48.747096 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:48.747096 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:48.747096 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:48.747096 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:48.747096 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:48.747096 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:48.747096 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:48.747096 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:48.747096 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:48.747096 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:48.747096 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:48.747096 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:48.748845 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:48.748845 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:48.748845 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:48.748845 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:48.748845 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 488/979] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:48.753179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50488106-eeee-4963-a1a4-eaf985db923d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:48.775161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02412fc-c705-4c71-a7c5-9008c6ddb36f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:48.812824 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da5f4e-e1f7-40e6-9e48-8e26b956a08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:48.813850 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da5f4e-e1f7-40e6-9e48-8e26b956a08f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:48.814305 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da5f4e-e1f7-40e6-9e48-8e26b956a08f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:48.814741 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da5f4e-e1f7-40e6-9e48-8e26b956a08f None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:48.815446 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da5f4e-e1f7-40e6-9e48-8e26b956a08f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:48.816876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da5f4e-e1f7-40e6-9e48-8e26b956a08f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:48.824651 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 492/980] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:06:48 2022] GET /identity/v3/services => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:06:48.878254 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50488106-eeee-4963-a1a4-eaf985db923d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:48.921962 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fef0c2-20cc-45c8-9f89-98f233ea73d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:48.922644 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fef0c2-20cc-45c8-9f89-98f233ea73d0 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:48.922989 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fef0c2-20cc-45c8-9f89-98f233ea73d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:48.923278 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fef0c2-20cc-45c8-9f89-98f233ea73d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:48.924093 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fef0c2-20cc-45c8-9f89-98f233ea73d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:48.924445 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fef0c2-20cc-45c8-9f89-98f233ea73d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:48.925901 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fef0c2-20cc-45c8-9f89-98f233ea73d0 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:48.939577 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 489/981] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:48.945910 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da5f4e-e1f7-40e6-9e48-8e26b956a08f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:49.069005 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da5f4e-e1f7-40e6-9e48-8e26b956a08f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:49.104292 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea1069-e565-466c-9451-0537cc8548ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:49.105103 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea1069-e565-466c-9451-0537cc8548ee None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:49.105415 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea1069-e565-466c-9451-0537cc8548ee None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:49.105699 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea1069-e565-466c-9451-0537cc8548ee None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:49.114102 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea1069-e565-466c-9451-0537cc8548ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:49.115560 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea1069-e565-466c-9451-0537cc8548ee None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:49.132222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-94ea1069-e565-466c-9451-0537cc8548ee None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:06:49.132222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:49.132222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:49.132222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:49.132222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:49.132222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:49.132222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:49.132222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:49.132222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:49.132222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:49.132222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:49.132222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:49.132222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:49.132222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:49.132222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:49.132222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:49.134014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:49.134014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:49.134014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:49.134014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:49.134014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:49.134014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:49.134014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:49.134014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:49.134014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:49.134014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:49.134014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:49.134014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:49.134014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:49.134014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:49.134014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:49.134014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:49.134014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:49.134014 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:49.135003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:49.135003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:49.135003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:49.135003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:49.135003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:49.135003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:49.135003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:49.135003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:49.135003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:06:49.135003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:49.135003 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 493/982] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:06:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:49.141648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fef0c2-20cc-45c8-9f89-98f233ea73d0 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:49.253200 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fef0c2-20cc-45c8-9f89-98f233ea73d0 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:49.288911 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78bec3-675f-4798-b6a6-a3edd21fb6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:49.290188 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78bec3-675f-4798-b6a6-a3edd21fb6eb None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:49.290478 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78bec3-675f-4798-b6a6-a3edd21fb6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:49.290760 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78bec3-675f-4798-b6a6-a3edd21fb6eb None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:49.291623 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78bec3-675f-4798-b6a6-a3edd21fb6eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:49.291932 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78bec3-675f-4798-b6a6-a3edd21fb6eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:49.293348 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78bec3-675f-4798-b6a6-a3edd21fb6eb None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:49.311713 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 490/983] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 9 15:06:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:49.317301 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea1069-e565-466c-9451-0537cc8548ee None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:49.419923 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea1069-e565-466c-9451-0537cc8548ee None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:49.455622 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e9287-4f29-4332-a0e7-ab6a0912346f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:49.456270 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e9287-4f29-4332-a0e7-ab6a0912346f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:49.456554 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e9287-4f29-4332-a0e7-ab6a0912346f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:49.456830 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e9287-4f29-4332-a0e7-ab6a0912346f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:49.529015 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e9287-4f29-4332-a0e7-ab6a0912346f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:49.530534 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e9287-4f29-4332-a0e7-ab6a0912346f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:49.646788 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 494/984] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:06:49 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:06:49.652562 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78bec3-675f-4798-b6a6-a3edd21fb6eb None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:49.749136 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78bec3-675f-4798-b6a6-a3edd21fb6eb None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:49.781677 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20904d7d-6102-4e06-9490-2c8b26239168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:49.782461 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20904d7d-6102-4e06-9490-2c8b26239168 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:49.782741 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20904d7d-6102-4e06-9490-2c8b26239168 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:49.783020 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20904d7d-6102-4e06-9490-2c8b26239168 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:49.793191 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20904d7d-6102-4e06-9490-2c8b26239168 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:49.794650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20904d7d-6102-4e06-9490-2c8b26239168 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:49.811636 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-20904d7d-6102-4e06-9490-2c8b26239168 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:49.811636 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:49.811636 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:49.811636 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:49.811636 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:49.811636 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:49.811636 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:49.811636 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:49.811636 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:49.811636 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:49.811636 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:49.811636 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:49.811636 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:49.811636 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:49.811636 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:49.812578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:49.812578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:49.812578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:49.812578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:49.812578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:49.812578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:49.812578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:49.812578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:49.812578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:49.812578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:49.812578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:49.812578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:49.812578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:49.812578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:49.812578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:49.812578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:49.812578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:49.820699 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:49.820699 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:49.820699 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:49.820699 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:49.820699 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 491/985] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:49.821049 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e9287-4f29-4332-a0e7-ab6a0912346f None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:49.921993 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e9287-4f29-4332-a0e7-ab6a0912346f None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:49.957659 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67885547-10f2-4a93-959f-86778231d0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:49.958342 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67885547-10f2-4a93-959f-86778231d0dc None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:49.958623 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67885547-10f2-4a93-959f-86778231d0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:49.958902 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67885547-10f2-4a93-959f-86778231d0dc None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:49.959639 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67885547-10f2-4a93-959f-86778231d0dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:49.960095 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67885547-10f2-4a93-959f-86778231d0dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:49.961506 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67885547-10f2-4a93-959f-86778231d0dc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:49.973843 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 495/986] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:49.979731 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20904d7d-6102-4e06-9490-2c8b26239168 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:50.083989 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20904d7d-6102-4e06-9490-2c8b26239168 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:50.119944 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e89901-d0aa-443e-9b06-2a4183a773bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:50.120740 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e89901-d0aa-443e-9b06-2a4183a773bf None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:50.121020 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e89901-d0aa-443e-9b06-2a4183a773bf None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:50.121296 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e89901-d0aa-443e-9b06-2a4183a773bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:50.128531 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e89901-d0aa-443e-9b06-2a4183a773bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:50.130002 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e89901-d0aa-443e-9b06-2a4183a773bf None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:50.144042 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-e6e89901-d0aa-443e-9b06-2a4183a773bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:50.144042 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:50.144042 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:50.144042 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:50.144042 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:50.144042 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:50.144042 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:50.144042 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:50.144042 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:50.144042 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:50.144042 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:50.144042 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:50.144042 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:50.144042 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:50.144042 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:50.145080 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:50.145080 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:50.145080 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:50.145080 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:50.145080 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:50.145080 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:50.145080 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:50.145080 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:50.145080 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:50.145080 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:50.145080 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:50.145080 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:50.145080 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:50.145080 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:50.145080 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:50.145080 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:50.145080 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:50.146520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:50.146520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:50.146520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:50.146520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:50.146520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:50.146520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:50.146520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:50.146520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:50.146520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 492/987] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:50.151735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67885547-10f2-4a93-959f-86778231d0dc None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:50.250599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67885547-10f2-4a93-959f-86778231d0dc None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:50.285386 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7829c-83cd-4d14-beef-0ae241f4e7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:50.286069 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7829c-83cd-4d14-beef-0ae241f4e7cf None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:50.286352 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7829c-83cd-4d14-beef-0ae241f4e7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:50.286627 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7829c-83cd-4d14-beef-0ae241f4e7cf None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:50.287412 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7829c-83cd-4d14-beef-0ae241f4e7cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:50.287722 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7829c-83cd-4d14-beef-0ae241f4e7cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:50.289291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7829c-83cd-4d14-beef-0ae241f4e7cf None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:50.302416 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 496/988] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:06:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:50.308593 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e89901-d0aa-443e-9b06-2a4183a773bf None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:50.413604 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e89901-d0aa-443e-9b06-2a4183a773bf None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:50.452571 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3fedc1-18e5-4c0c-9c67-385e9dcd9a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:50.453249 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fedc1-18e5-4c0c-9c67-385e9dcd9a82 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:50.453572 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fedc1-18e5-4c0c-9c67-385e9dcd9a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:50.453850 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fedc1-18e5-4c0c-9c67-385e9dcd9a82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:50.454716 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3fedc1-18e5-4c0c-9c67-385e9dcd9a82 None admin] RBAC: Adding query filter params (role.id=9f1767627c554047835baae35bce7b7c, scope.project.id=4fcadeae44cc4547905b83bfebec79c7, user.id=057ad64901314362914287aed5b468ea) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:50.455034 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3fedc1-18e5-4c0c-9c67-385e9dcd9a82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:50.456512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3fedc1-18e5-4c0c-9c67-385e9dcd9a82 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:50.469409 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 493/989] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:06:50 2022] GET /identity/v3/role_assignments?user.id=057ad64901314362914287aed5b468ea&scope.project.id=4fcadeae44cc4547905b83bfebec79c7&role.id=9f1767627c554047835baae35bce7b7c => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:51.005294 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0bc0f-aea1-4e22-bb14-702a7f023770 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:51.005871 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0bc0f-aea1-4e22-bb14-702a7f023770 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:51.005871 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0bc0f-aea1-4e22-bb14-702a7f023770 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:51.007562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 497/990] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:51.013401 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f2fb2-be9e-4d85-b5d3-3882cf9cb228 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:51.013714 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f2fb2-be9e-4d85-b5d3-3882cf9cb228 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:51.013987 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f2fb2-be9e-4d85-b5d3-3882cf9cb228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:51.031726 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-747f2fb2-be9e-4d85-b5d3-3882cf9cb228 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:51.032892 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-747f2fb2-be9e-4d85-b5d3-3882cf9cb228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:51.101824 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 494/991] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:51.124832 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0bc0f-aea1-4e22-bb14-702a7f023770 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:51.177773 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52449cb8-32f8-4d66-934f-c9dee46a9758 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:51.178070 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52449cb8-32f8-4d66-934f-c9dee46a9758 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:51.178355 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52449cb8-32f8-4d66-934f-c9dee46a9758 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:51.180492 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 495/992] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:51.186384 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa2ddb-f63f-4311-b775-9e00fbae19b0 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:51.186727 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa2ddb-f63f-4311-b775-9e00fbae19b0 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:51.186959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa2ddb-f63f-4311-b775-9e00fbae19b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:51.205964 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-25aa2ddb-f63f-4311-b775-9e00fbae19b0 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:51.207197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-25aa2ddb-f63f-4311-b775-9e00fbae19b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:51.242627 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0bc0f-aea1-4e22-bb14-702a7f023770 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:51.280833 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111bf11-e02e-487a-b8bb-2b4449363375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:51.282042 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111bf11-e02e-487a-b8bb-2b4449363375 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:51.282321 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111bf11-e02e-487a-b8bb-2b4449363375 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:51.282591 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111bf11-e02e-487a-b8bb-2b4449363375 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:51.285519 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 496/993] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:06:51.285605 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111bf11-e02e-487a-b8bb-2b4449363375 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:51.285605 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111bf11-e02e-487a-b8bb-2b4449363375 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:51.297173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-8111bf11-e02e-487a-b8bb-2b4449363375 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:06:51.297173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:51.297173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:06:51.297173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:06:51.297173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:06:51.297173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:06:51.297173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:06:51.297173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:51.297173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:06:51.297173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:51.297173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:51.297173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:51.297173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:51.297173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:51.297173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:51.297173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:51.297173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:51.298269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:51.298269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:51.298269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:51.298269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:51.298269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:51.298269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:51.298269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:06:51.298269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:06:51.298269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:06:51.298269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:06:51.298269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:51.298269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:51.298269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:51.298269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:51.298269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:51.298269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:51.299169 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:51.299169 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:51.299169 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:51.299169 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:51.299169 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:51.299169 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:51.299169 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:51.299169 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:51.299169 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:51.299169 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:51.299169 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:06:51.299169 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:51.299169 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:06:51.299169 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:51.301860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 498/994] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:51.304549 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa2ddb-f63f-4311-b775-9e00fbae19b0 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:51.307358 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111bf11-e02e-487a-b8bb-2b4449363375 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:51.435691 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111bf11-e02e-487a-b8bb-2b4449363375 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:51.442715 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa2ddb-f63f-4311-b775-9e00fbae19b0 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:51.478041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23452804-f86e-4088-83e0-97c6e0cda4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:51.479390 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23452804-f86e-4088-83e0-97c6e0cda4bc None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:51.479887 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23452804-f86e-4088-83e0-97c6e0cda4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:51.480379 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23452804-f86e-4088-83e0-97c6e0cda4bc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:51.481603 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23452804-f86e-4088-83e0-97c6e0cda4bc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:51.483761 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23452804-f86e-4088-83e0-97c6e0cda4bc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:51.487351 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda12e8-26a9-4665-bde6-783f1841ae77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:51.488023 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda12e8-26a9-4665-bde6-783f1841ae77 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:51.488306 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda12e8-26a9-4665-bde6-783f1841ae77 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:51.488597 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda12e8-26a9-4665-bde6-783f1841ae77 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:51.489309 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda12e8-26a9-4665-bde6-783f1841ae77 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:51.489630 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda12e8-26a9-4665-bde6-783f1841ae77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:51.491073 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda12e8-26a9-4665-bde6-783f1841ae77 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:51.496802 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 497/995] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:06:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:51.502427 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda12e8-26a9-4665-bde6-783f1841ae77 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:51.503352 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-23452804-f86e-4088-83e0-97c6e0cda4bc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:06:51.503352 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:51.503352 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:06:51.503352 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:06:51.503352 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:06:51.503352 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:06:51.503352 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:06:51.503352 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:51.503352 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:06:51.503352 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:51.503352 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:51.503352 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:51.503352 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:51.503352 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:51.503352 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:51.503352 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:51.503352 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:51.505117 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:51.505117 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:51.505117 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:51.505117 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:51.505117 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:51.505117 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:51.505117 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:06:51.505117 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:06:51.505117 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:06:51.505117 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:06:51.505117 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:51.505117 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:51.505117 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:51.505117 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:51.505117 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:51.505117 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:51.506749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:51.506749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:51.506749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:51.506749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:51.506749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:51.506749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:51.506749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:51.506749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:51.506749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:51.506749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:51.506749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:06:51.506749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:51.506749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:06:51.506749 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:51.509766 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 499/996] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:06:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:51.511536 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23452804-f86e-4088-83e0-97c6e0cda4bc None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:51.627938 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23452804-f86e-4088-83e0-97c6e0cda4bc None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:51.646671 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda12e8-26a9-4665-bde6-783f1841ae77 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:51.671712 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ad58d-462c-49e7-918d-b5f4044971e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:51.672382 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ad58d-462c-49e7-918d-b5f4044971e0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:51.672669 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ad58d-462c-49e7-918d-b5f4044971e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:51.672949 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ad58d-462c-49e7-918d-b5f4044971e0 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:51.673711 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ad58d-462c-49e7-918d-b5f4044971e0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:51.674019 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ad58d-462c-49e7-918d-b5f4044971e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:51.675404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ad58d-462c-49e7-918d-b5f4044971e0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:51.681630 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 500/997] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:06:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:51.687269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ad58d-462c-49e7-918d-b5f4044971e0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:51.693324 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbe6a8-e5b6-4914-abfd-33e3b82eafdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:51.694612 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbe6a8-e5b6-4914-abfd-33e3b82eafdf None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:51.695118 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbe6a8-e5b6-4914-abfd-33e3b82eafdf None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:51.695633 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbe6a8-e5b6-4914-abfd-33e3b82eafdf None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:51.696822 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbe6a8-e5b6-4914-abfd-33e3b82eafdf None admin] RBAC: Adding query filter params (type=compute) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:51.697237 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbe6a8-e5b6-4914-abfd-33e3b82eafdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:51.699530 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbe6a8-e5b6-4914-abfd-33e3b82eafdf None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:51.714373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 498/998] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:06:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:51.715897 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbe6a8-e5b6-4914-abfd-33e3b82eafdf None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:51.797303 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ad58d-462c-49e7-918d-b5f4044971e0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:51.822414 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbe6a8-e5b6-4914-abfd-33e3b82eafdf None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:51.831785 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7aeae5-32da-417b-871b-cf61c3b0def8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:51.832561 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7aeae5-32da-417b-871b-cf61c3b0def8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:51.832907 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7aeae5-32da-417b-871b-cf61c3b0def8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:51.833246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7aeae5-32da-417b-871b-cf61c3b0def8 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:51.834091 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7aeae5-32da-417b-871b-cf61c3b0def8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:51.834472 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7aeae5-32da-417b-871b-cf61c3b0def8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:51.836659 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7aeae5-32da-417b-871b-cf61c3b0def8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:51.846625 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 501/999] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:06:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:51.847633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7aeae5-32da-417b-871b-cf61c3b0def8 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:51.858541 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccc111-9557-4e6f-8a4a-9491e8e9e5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:51.859197 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccc111-9557-4e6f-8a4a-9491e8e9e5f8 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:51.859481 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccc111-9557-4e6f-8a4a-9491e8e9e5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:51.860010 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccc111-9557-4e6f-8a4a-9491e8e9e5f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:51.860792 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccc111-9557-4e6f-8a4a-9491e8e9e5f8 None admin] RBAC: Adding query filter params (interface=public, service_id=72b1e139405a436fa0d409ed5b5c9faa, region_id=RegionOne) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:51.861105 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccc111-9557-4e6f-8a4a-9491e8e9e5f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:51.862492 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccc111-9557-4e6f-8a4a-9491e8e9e5f8 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:51.868380 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 499/1000] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:06:51 2022] GET /identity/v3/endpoints?service_id=72b1e139405a436fa0d409ed5b5c9faa&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:51.873576 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccc111-9557-4e6f-8a4a-9491e8e9e5f8 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:51.949742 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7aeae5-32da-417b-871b-cf61c3b0def8 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:51.969309 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccc111-9557-4e6f-8a4a-9491e8e9e5f8 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:51.982070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17415406-4fd8-4e5f-b4eb-7c8403a7b3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:51.982716 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17415406-4fd8-4e5f-b4eb-7c8403a7b3db None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:51.982998 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17415406-4fd8-4e5f-b4eb-7c8403a7b3db None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:51.983271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17415406-4fd8-4e5f-b4eb-7c8403a7b3db None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:51.984000 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17415406-4fd8-4e5f-b4eb-7c8403a7b3db None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:51.985622 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17415406-4fd8-4e5f-b4eb-7c8403a7b3db None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:52.009407 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 502/1001] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:06:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:06:52.010726 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85769cb2-e519-4802-ad2f-f491ad2bbd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:52.011408 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85769cb2-e519-4802-ad2f-f491ad2bbd7c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:52.011730 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85769cb2-e519-4802-ad2f-f491ad2bbd7c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:52.011967 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85769cb2-e519-4802-ad2f-f491ad2bbd7c None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:52.012671 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85769cb2-e519-4802-ad2f-f491ad2bbd7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:52.014083 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85769cb2-e519-4802-ad2f-f491ad2bbd7c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:52.025456 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 500/1002] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:06:51 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 15:06:52.795895 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4d51b-b527-488c-b06f-2e20a6bf9fa4 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:52.796298 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4d51b-b527-488c-b06f-2e20a6bf9fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:52.796504 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4d51b-b527-488c-b06f-2e20a6bf9fa4 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:52.797852 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 503/1003] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:52.803596 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590411f-3f18-45f6-97e9-156dcf53925c None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:52.804128 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590411f-3f18-45f6-97e9-156dcf53925c None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:52.804222 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590411f-3f18-45f6-97e9-156dcf53925c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:52.821806 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-9590411f-3f18-45f6-97e9-156dcf53925c None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:52.823014 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-9590411f-3f18-45f6-97e9-156dcf53925c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:52.892275 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 501/1004] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:52 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:52.914722 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4d51b-b527-488c-b06f-2e20a6bf9fa4 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:53.026885 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4d51b-b527-488c-b06f-2e20a6bf9fa4 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:53.063443 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cf2d8-caac-4c3d-99fa-87f1cd204aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:53.064323 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cf2d8-caac-4c3d-99fa-87f1cd204aeb None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:53.064736 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cf2d8-caac-4c3d-99fa-87f1cd204aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:53.065142 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cf2d8-caac-4c3d-99fa-87f1cd204aeb None admin] PATH_INFO: `/v3/services/image` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:53.065973 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273cf2d8-caac-4c3d-99fa-87f1cd204aeb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:53.067480 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273cf2d8-caac-4c3d-99fa-87f1cd204aeb None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:53.079436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-273cf2d8-caac-4c3d-99fa-87f1cd204aeb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:06:53.079436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:53.079436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:06:53.079436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:06:53.079436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:06:53.079436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:06:53.079436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:06:53.079436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:53.079436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:06:53.079436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:53.079436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:53.079436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:53.079436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:53.079436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:53.079436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:53.079436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:53.079436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:53.081845 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:53.081845 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:53.081845 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:53.081845 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:53.081845 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:53.081845 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:53.081845 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:06:53.081845 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:06:53.081845 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:06:53.081845 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:06:53.081845 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:53.081845 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:53.081845 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:53.081845 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:53.081845 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:53.081845 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:53.083633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:53.083633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:53.083633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:53.083633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:53.083633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:53.083633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:53.083633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:53.083633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:53.083633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:53.083633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:53.083633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:06:53.083633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:53.083633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:06:53.083633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:53.086805 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 504/1005] 10.222.0.48 () {56 vars in 1105 bytes} [Mon May 9 15:06:52 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:53.090116 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590411f-3f18-45f6-97e9-156dcf53925c None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:53.197271 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590411f-3f18-45f6-97e9-156dcf53925c None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:53.238627 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c3cbe-0cb1-4301-bd02-ad28a98b2231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:53.239306 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c3cbe-0cb1-4301-bd02-ad28a98b2231 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:53.239585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c3cbe-0cb1-4301-bd02-ad28a98b2231 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:53.239860 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c3cbe-0cb1-4301-bd02-ad28a98b2231 None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:53.240571 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c3cbe-0cb1-4301-bd02-ad28a98b2231 None admin] RBAC: Adding query filter params (name=image) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:53.241509 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c3cbe-0cb1-4301-bd02-ad28a98b2231 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:53.243552 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c3cbe-0cb1-4301-bd02-ad28a98b2231 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:53.249403 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 502/1006] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:53.255104 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cf2d8-caac-4c3d-99fa-87f1cd204aeb None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:53.363759 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cf2d8-caac-4c3d-99fa-87f1cd204aeb None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:53.398144 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcf809-397b-4d01-b2c4-c0b380c279f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:53.398892 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcf809-397b-4d01-b2c4-c0b380c279f1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:53.399175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcf809-397b-4d01-b2c4-c0b380c279f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:53.399447 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcf809-397b-4d01-b2c4-c0b380c279f1 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:53.400161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcf809-397b-4d01-b2c4-c0b380c279f1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:53.400468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcf809-397b-4d01-b2c4-c0b380c279f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:53.401869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcf809-397b-4d01-b2c4-c0b380c279f1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:53.413463 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 505/1007] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:53 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:54.335996 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5365d-0b67-49d5-af02-5cac48ab207a None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:54.336550 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5365d-0b67-49d5-af02-5cac48ab207a None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:54.336550 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5365d-0b67-49d5-af02-5cac48ab207a None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:54.338147 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 503/1008] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:54.343655 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74375b0-15e2-4c7c-9ebd-e435aa1cd712 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:54.344283 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74375b0-15e2-4c7c-9ebd-e435aa1cd712 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:54.344283 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74375b0-15e2-4c7c-9ebd-e435aa1cd712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:54.354138 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d191f-f6db-4622-9716-ce9af362a3c5 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:54.354420 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d191f-f6db-4622-9716-ce9af362a3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:54.354701 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d191f-f6db-4622-9716-ce9af362a3c5 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:54.356045 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 504/1009] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:06:54.361578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674e409-786a-4500-8cd2-a6864413cb9f None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:54.361864 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674e409-786a-4500-8cd2-a6864413cb9f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:54.362140 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674e409-786a-4500-8cd2-a6864413cb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:54.366175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a74375b0-15e2-4c7c-9ebd-e435aa1cd712 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:54.368068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a74375b0-15e2-4c7c-9ebd-e435aa1cd712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:54.380359 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-5674e409-786a-4500-8cd2-a6864413cb9f None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:54.382533 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5674e409-786a-4500-8cd2-a6864413cb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:54.448024 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 506/1010] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:54 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:54.471756 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 505/1011] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:54 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:06:54.475556 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74375b0-15e2-4c7c-9ebd-e435aa1cd712 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:54.496723 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674e409-786a-4500-8cd2-a6864413cb9f None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:54.601872 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74375b0-15e2-4c7c-9ebd-e435aa1cd712 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:54.619523 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674e409-786a-4500-8cd2-a6864413cb9f None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:54.645293 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d04ac-1133-4a8e-bb02-2c629a3536d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:54.646124 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d04ac-1133-4a8e-bb02-2c629a3536d3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:54.646403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d04ac-1133-4a8e-bb02-2c629a3536d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:54.646674 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d04ac-1133-4a8e-bb02-2c629a3536d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:54.648590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d04ac-1133-4a8e-bb02-2c629a3536d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:54.649912 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d04ac-1133-4a8e-bb02-2c629a3536d3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:54.651279 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 507/1012] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:54.657515 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d04ac-1133-4a8e-bb02-2c629a3536d3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:54.671868 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e1173-e110-4a90-a67d-fc3eebfcc469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:54.672674 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e1173-e110-4a90-a67d-fc3eebfcc469 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:54.672958 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e1173-e110-4a90-a67d-fc3eebfcc469 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:54.673237 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e1173-e110-4a90-a67d-fc3eebfcc469 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:54.673936 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e1173-e110-4a90-a67d-fc3eebfcc469 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:54.675299 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e1173-e110-4a90-a67d-fc3eebfcc469 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:54.687983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-866e1173-e110-4a90-a67d-fc3eebfcc469 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:06:54.687983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:54.687983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:06:54.687983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:06:54.687983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:06:54.687983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:06:54.687983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:06:54.687983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:54.687983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:06:54.687983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:54.687983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:54.687983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:54.687983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:54.687983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:54.687983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:54.687983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:54.687983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:54.689055 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:54.689055 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:54.689055 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:54.689055 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:54.689055 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:54.689055 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:54.689055 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:06:54.689055 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:06:54.689055 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:06:54.689055 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:06:54.689055 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:54.689055 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:54.689055 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:54.689055 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:54.689055 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:54.689055 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:54.690578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:54.690578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:54.690578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:54.690578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:54.690578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:54.690578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:54.690578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:54.690578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:54.690578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:54.690578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:54.690578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:06:54.690578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:54.690578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:06:54.690578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:54.690578 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 506/1013] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:54.695711 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e1173-e110-4a90-a67d-fc3eebfcc469 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:54.771393 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d04ac-1133-4a8e-bb02-2c629a3536d3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:54.809056 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea4dbf-cd4e-42ee-8d3c-399070c07c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:54.810112 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea4dbf-cd4e-42ee-8d3c-399070c07c5b None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:54.810615 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea4dbf-cd4e-42ee-8d3c-399070c07c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:54.811117 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea4dbf-cd4e-42ee-8d3c-399070c07c5b None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:54.811893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea4dbf-cd4e-42ee-8d3c-399070c07c5b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:54.813328 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea4dbf-cd4e-42ee-8d3c-399070c07c5b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:54.822943 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e1173-e110-4a90-a67d-fc3eebfcc469 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:54.849411 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 508/1014] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:06:54 2022] POST /identity/v3/projects => generated 311 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:06:54.867803 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b96e96-a297-4432-8d50-77c8401d334d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:54.868492 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b96e96-a297-4432-8d50-77c8401d334d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:54.868770 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b96e96-a297-4432-8d50-77c8401d334d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:54.869056 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b96e96-a297-4432-8d50-77c8401d334d None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:54.869838 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b96e96-a297-4432-8d50-77c8401d334d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:54.870147 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b96e96-a297-4432-8d50-77c8401d334d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:54.871593 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b96e96-a297-4432-8d50-77c8401d334d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:54.877928 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 507/1015] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:06:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:54.884441 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea4dbf-cd4e-42ee-8d3c-399070c07c5b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:55.007343 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea4dbf-cd4e-42ee-8d3c-399070c07c5b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:55.044475 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c09637-0792-4ce0-b422-5f679cbc2bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:55.045158 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c09637-0792-4ce0-b422-5f679cbc2bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:55.046173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c09637-0792-4ce0-b422-5f679cbc2bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:55.046173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c09637-0792-4ce0-b422-5f679cbc2bd7 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:55.046453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c09637-0792-4ce0-b422-5f679cbc2bd7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:55.046759 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c09637-0792-4ce0-b422-5f679cbc2bd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:55.048152 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c09637-0792-4ce0-b422-5f679cbc2bd7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:55.054854 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 509/1016] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:06:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:55.059966 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b96e96-a297-4432-8d50-77c8401d334d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:55.186876 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b96e96-a297-4432-8d50-77c8401d334d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:55.223168 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347caa5-33d2-48a3-8702-3ee4687f7616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:55.223826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347caa5-33d2-48a3-8702-3ee4687f7616 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:55.224107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347caa5-33d2-48a3-8702-3ee4687f7616 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:55.224385 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347caa5-33d2-48a3-8702-3ee4687f7616 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:55.225145 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347caa5-33d2-48a3-8702-3ee4687f7616 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:55.226783 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347caa5-33d2-48a3-8702-3ee4687f7616 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:55.265411 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 508/1017] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:06:55 2022] POST /identity/v3/endpoints => generated 334 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:06:55.726029 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb98f42-9875-429c-a84e-f195b33cb7f9 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:55.726870 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb98f42-9875-429c-a84e-f195b33cb7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:55.726870 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb98f42-9875-429c-a84e-f195b33cb7f9 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:55.728541 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 510/1018] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:06:55.734214 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55376bfd-c135-48bc-932a-2437133f510d None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:55.735232 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55376bfd-c135-48bc-932a-2437133f510d None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:55.735232 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55376bfd-c135-48bc-932a-2437133f510d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:55.752992 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-55376bfd-c135-48bc-932a-2437133f510d None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:55.754221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-55376bfd-c135-48bc-932a-2437133f510d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:55.832526 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 509/1019] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:55 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:55.855517 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb98f42-9875-429c-a84e-f195b33cb7f9 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:55.956588 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb98f42-9875-429c-a84e-f195b33cb7f9 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:55.994588 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7479c0-b17b-4d23-991d-df4eb679aa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:55.995173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7479c0-b17b-4d23-991d-df4eb679aa29 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:55.995458 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7479c0-b17b-4d23-991d-df4eb679aa29 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:55.995737 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7479c0-b17b-4d23-991d-df4eb679aa29 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:55.996475 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7479c0-b17b-4d23-991d-df4eb679aa29 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:55.997879 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7479c0-b17b-4d23-991d-df4eb679aa29 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:56.019127 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 511/1020] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:06:55 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:06:57.177579 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19454ffa-d6a0-426f-8e12-56b116f37106 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:57.178107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19454ffa-d6a0-426f-8e12-56b116f37106 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:57.178107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19454ffa-d6a0-426f-8e12-56b116f37106 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:57.179716 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 510/1021] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:57.185940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e0d15-dba0-4220-b38a-66524b366b95 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:57.186502 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e0d15-dba0-4220-b38a-66524b366b95 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:57.186931 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e0d15-dba0-4220-b38a-66524b366b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:57.206277 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a43e0d15-dba0-4220-b38a-66524b366b95 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:57.207498 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a43e0d15-dba0-4220-b38a-66524b366b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:57.283571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 512/1022] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:57.310650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19454ffa-d6a0-426f-8e12-56b116f37106 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:57.416471 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19454ffa-d6a0-426f-8e12-56b116f37106 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:57.452172 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030792b-224f-4e4f-b4e2-bd3182808d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:57.452959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030792b-224f-4e4f-b4e2-bd3182808d24 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:57.453241 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030792b-224f-4e4f-b4e2-bd3182808d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:57.453546 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030792b-224f-4e4f-b4e2-bd3182808d24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:57.454748 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030792b-224f-4e4f-b4e2-bd3182808d24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:57.456181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030792b-224f-4e4f-b4e2-bd3182808d24 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:57.463030 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 511/1023] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:57.464252 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e0d15-dba0-4220-b38a-66524b366b95 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:57.564590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e0d15-dba0-4220-b38a-66524b366b95 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:57.602205 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a71347-06b1-41d7-8466-157f061a1ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:57.602886 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a71347-06b1-41d7-8466-157f061a1ed4 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:57.603167 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a71347-06b1-41d7-8466-157f061a1ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:57.603441 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a71347-06b1-41d7-8466-157f061a1ed4 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:57.604177 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a71347-06b1-41d7-8466-157f061a1ed4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:57.605656 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a71347-06b1-41d7-8466-157f061a1ed4 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:57.633408 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 513/1024] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:06:57 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:06:57.774077 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66365ad3-f8b7-413b-9347-14731c7c618c None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:57.774390 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66365ad3-f8b7-413b-9347-14731c7c618c None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:57.774558 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66365ad3-f8b7-413b-9347-14731c7c618c None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:57.776212 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 512/1025] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:57.782102 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11d0ff-d959-4f1e-b7c4-f9318f697871 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:57.782396 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11d0ff-d959-4f1e-b7c4-f9318f697871 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:57.782677 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11d0ff-d959-4f1e-b7c4-f9318f697871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:57.801299 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-8a11d0ff-d959-4f1e-b7c4-f9318f697871 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:57.802554 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8a11d0ff-d959-4f1e-b7c4-f9318f697871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:57.876070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 514/1026] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:57.902696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66365ad3-f8b7-413b-9347-14731c7c618c None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:58.005027 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66365ad3-f8b7-413b-9347-14731c7c618c None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:58.039247 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb2b9d-f208-462c-bef8-bba1731e16db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:58.039942 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb2b9d-f208-462c-bef8-bba1731e16db None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:58.040224 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb2b9d-f208-462c-bef8-bba1731e16db None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:58.040498 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb2b9d-f208-462c-bef8-bba1731e16db None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:58.051422 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb2b9d-f208-462c-bef8-bba1731e16db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:06:58.059991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-71cb2b9d-f208-462c-bef8-bba1731e16db None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:06:58.059991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:58.059991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:58.059991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:58.059991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:58.059991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:58.059991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:58.059991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:58.059991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:58.059991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:58.059991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:58.059991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:58.059991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:06:58.059991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:06:58.059991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:06:58.059991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:06:58.060999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:06:58.060999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:06:58.060999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:06:58.060999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:06:58.060999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:58.060999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:58.060999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:58.060999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:58.060999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:58.060999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:58.060999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:58.060999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:58.060999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:58.060999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:58.060999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:58.060999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:58.065997 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:58.065997 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:58.065997 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:58.065997 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:58.065997 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:06:58.065997 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:06:58.065997 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:06:58.065997 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:06:58.065997 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:06:58.065997 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:06:58.065997 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:06:58.065997 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:58.065997 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 513/1027] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 9 15:06:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:58.069961 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11d0ff-d959-4f1e-b7c4-f9318f697871 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:58.177610 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11d0ff-d959-4f1e-b7c4-f9318f697871 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:58.212466 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1d721-903e-4ba4-8ccf-ffcd5837e011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:58.213236 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1d721-903e-4ba4-8ccf-ffcd5837e011 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:58.213450 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1d721-903e-4ba4-8ccf-ffcd5837e011 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:58.213716 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1d721-903e-4ba4-8ccf-ffcd5837e011 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:58.214462 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1d721-903e-4ba4-8ccf-ffcd5837e011 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:58.214763 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1d721-903e-4ba4-8ccf-ffcd5837e011 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:58.216122 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1d721-903e-4ba4-8ccf-ffcd5837e011 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:58.229596 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 515/1028] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:06:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:58.231786 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb2b9d-f208-462c-bef8-bba1731e16db None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:58.330872 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb2b9d-f208-462c-bef8-bba1731e16db None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:58.342423 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360d394-834c-43c0-935c-28f2037c8178 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:58.342708 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360d394-834c-43c0-935c-28f2037c8178 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:58.342979 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360d394-834c-43c0-935c-28f2037c8178 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:58.344592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 516/1029] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:06:58.349219 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092b494-6cf8-4a3a-86d3-c854348c6048 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:58.349592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092b494-6cf8-4a3a-86d3-c854348c6048 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:58.349934 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092b494-6cf8-4a3a-86d3-c854348c6048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:58.366967 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-2092b494-6cf8-4a3a-86d3-c854348c6048 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:06:58.368140 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2092b494-6cf8-4a3a-86d3-c854348c6048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:06:58.369383 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b818b1-ac8a-4370-9da6-0c6c4bc209f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:58.370190 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b818b1-ac8a-4370-9da6-0c6c4bc209f2 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:58.370475 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b818b1-ac8a-4370-9da6-0c6c4bc209f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:58.370750 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b818b1-ac8a-4370-9da6-0c6c4bc209f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:58.381269 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b818b1-ac8a-4370-9da6-0c6c4bc209f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:58.382795 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b818b1-ac8a-4370-9da6-0c6c4bc209f2 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:58.400113 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-e3b818b1-ac8a-4370-9da6-0c6c4bc209f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:58.400113 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:58.400113 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:58.400113 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:58.400113 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:58.400113 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:58.400113 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:58.400113 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:58.400113 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:58.400113 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:58.400113 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:58.400113 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:58.400113 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:58.400113 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:58.400113 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:58.401114 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:58.401114 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:58.401114 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:58.401114 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:58.401114 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:58.401114 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:58.401114 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:58.401114 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:58.401114 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:58.401114 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:58.401114 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:58.401114 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:58.401114 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:58.401114 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:58.401114 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:58.401114 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:58.401114 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:58.402602 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:58.402602 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:58.402602 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:58.402602 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:58.402602 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 514/1030] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:58.407549 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b818b1-ac8a-4370-9da6-0c6c4bc209f2 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:58.442287 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 517/1031] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:06:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:06:58.466149 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092b494-6cf8-4a3a-86d3-c854348c6048 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:58.523846 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b818b1-ac8a-4370-9da6-0c6c4bc209f2 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:58.558048 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d86e4-3abc-4a56-9eb1-d18598ba5708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:58.558721 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d86e4-3abc-4a56-9eb1-d18598ba5708 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:58.559005 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d86e4-3abc-4a56-9eb1-d18598ba5708 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:58.559281 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d86e4-3abc-4a56-9eb1-d18598ba5708 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:58.560007 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d86e4-3abc-4a56-9eb1-d18598ba5708 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:58.560316 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d86e4-3abc-4a56-9eb1-d18598ba5708 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:58.561700 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d86e4-3abc-4a56-9eb1-d18598ba5708 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:58.569449 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092b494-6cf8-4a3a-86d3-c854348c6048 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:58.574427 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 515/1032] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:58.579977 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d86e4-3abc-4a56-9eb1-d18598ba5708 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:58.603526 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67ab9b-a248-4a42-b98f-310b34a7ca2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:58.604235 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67ab9b-a248-4a42-b98f-310b34a7ca2d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:58.604523 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67ab9b-a248-4a42-b98f-310b34a7ca2d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:58.604797 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67ab9b-a248-4a42-b98f-310b34a7ca2d None admin] PATH_INFO: `/v3/services/image` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:58.605482 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67ab9b-a248-4a42-b98f-310b34a7ca2d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:58.606848 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67ab9b-a248-4a42-b98f-310b34a7ca2d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:58.619007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-6d67ab9b-a248-4a42-b98f-310b34a7ca2d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:06:58.619007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:58.619007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:06:58.619007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:06:58.619007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:06:58.619007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:06:58.619007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:06:58.619007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:58.619007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:06:58.619007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:58.619007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:06:58.619007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:58.619007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:58.619007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:58.619007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:58.619007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:58.619007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:58.620174 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:58.620174 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:58.620174 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:58.620174 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:58.620174 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:58.620174 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:58.620174 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:06:58.620174 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:06:58.620174 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:06:58.620174 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:06:58.620174 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:58.620174 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:58.620174 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:58.620174 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:58.620174 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:58.620174 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:58.621116 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:58.621116 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:06:58.621116 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:58.621116 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:58.621116 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:58.621116 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:58.621116 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:58.621116 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:58.621116 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:58.621116 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:58.621116 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:06:58.621116 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:06:58.621116 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:06:58.621116 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:06:58.621116 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 518/1033] 10.222.0.48 () {56 vars in 1105 bytes} [Mon May 9 15:06:58 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:58.626125 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67ab9b-a248-4a42-b98f-310b34a7ca2d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:58.684448 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d86e4-3abc-4a56-9eb1-d18598ba5708 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:58.717860 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56de70-0b2d-4fc8-a53e-ebcadae47115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:58.719148 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56de70-0b2d-4fc8-a53e-ebcadae47115 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:58.719599 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56de70-0b2d-4fc8-a53e-ebcadae47115 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:58.719877 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56de70-0b2d-4fc8-a53e-ebcadae47115 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:58.721111 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67ab9b-a248-4a42-b98f-310b34a7ca2d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:58.728027 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56de70-0b2d-4fc8-a53e-ebcadae47115 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:58.729492 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56de70-0b2d-4fc8-a53e-ebcadae47115 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:58.745307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-3c56de70-0b2d-4fc8-a53e-ebcadae47115 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:06:58.745307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:58.745307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:58.745307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:58.745307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:58.745307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:58.745307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:58.745307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:58.745307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:58.745307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:58.745307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:58.745307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:58.745307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:06:58.745307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:06:58.745307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:06:58.745307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:06:58.746491 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:58.746491 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:58.746491 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:06:58.746491 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:58.746491 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:06:58.746491 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:06:58.746491 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:58.746491 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:58.746491 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:58.746491 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:58.746491 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:58.746491 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:58.746491 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:58.746491 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:58.746491 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:58.746491 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:58.746491 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:58.746491 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:58.747474 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:58.747474 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:58.747474 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:06:58.747474 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:06:58.747474 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:06:58.747474 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:06:58.747474 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:06:58.747474 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:06:58.747474 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:06:58.747474 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:58.747474 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 516/1034] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:06:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:06:58.752328 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56de70-0b2d-4fc8-a53e-ebcadae47115 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:58.759950 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb123c4-b506-4e3a-a332-fd8fcb001ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:58.761256 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb123c4-b506-4e3a-a332-fd8fcb001ccf None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:58.761707 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb123c4-b506-4e3a-a332-fd8fcb001ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:58.762127 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb123c4-b506-4e3a-a332-fd8fcb001ccf None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:58.763328 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb123c4-b506-4e3a-a332-fd8fcb001ccf None admin] RBAC: Adding query filter params (name=image) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:58.763803 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb123c4-b506-4e3a-a332-fd8fcb001ccf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:58.765944 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb123c4-b506-4e3a-a332-fd8fcb001ccf None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:58.776649 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 519/1035] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:58.778112 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb123c4-b506-4e3a-a332-fd8fcb001ccf None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:58.858069 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56de70-0b2d-4fc8-a53e-ebcadae47115 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:58.879938 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb123c4-b506-4e3a-a332-fd8fcb001ccf None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:58.893190 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab608bc8-546c-49c2-95a2-01db8541363b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:58.893897 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab608bc8-546c-49c2-95a2-01db8541363b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:58.894216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab608bc8-546c-49c2-95a2-01db8541363b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:58.894442 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab608bc8-546c-49c2-95a2-01db8541363b None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:58.895263 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab608bc8-546c-49c2-95a2-01db8541363b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:58.895567 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab608bc8-546c-49c2-95a2-01db8541363b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:58.897218 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab608bc8-546c-49c2-95a2-01db8541363b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:58.920171 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 517/1036] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:06:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:06:58.921161 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab608bc8-546c-49c2-95a2-01db8541363b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:58.921836 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5dba6e-8006-4512-aec6-fdd51247d66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:58.922615 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5dba6e-8006-4512-aec6-fdd51247d66b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:58.922907 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5dba6e-8006-4512-aec6-fdd51247d66b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:58.923185 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5dba6e-8006-4512-aec6-fdd51247d66b None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:58.924010 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5dba6e-8006-4512-aec6-fdd51247d66b None admin] RBAC: Adding query filter params (type=image) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:58.924217 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5dba6e-8006-4512-aec6-fdd51247d66b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:58.925637 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5dba6e-8006-4512-aec6-fdd51247d66b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:58.936540 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 520/1037] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:58.937660 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5dba6e-8006-4512-aec6-fdd51247d66b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:59.020419 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab608bc8-546c-49c2-95a2-01db8541363b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:59.044792 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5dba6e-8006-4512-aec6-fdd51247d66b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:59.060092 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656181fd-0242-41d2-9f7d-d47dd2bca80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:59.060835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656181fd-0242-41d2-9f7d-d47dd2bca80a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:59.061158 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656181fd-0242-41d2-9f7d-d47dd2bca80a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:59.061505 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656181fd-0242-41d2-9f7d-d47dd2bca80a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:59.078679 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a3a4d-e19f-467f-8e82-b1dae37daaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:59.079333 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a3a4d-e19f-467f-8e82-b1dae37daaee None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:59.079612 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a3a4d-e19f-467f-8e82-b1dae37daaee None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:59.079884 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a3a4d-e19f-467f-8e82-b1dae37daaee None admin] PATH_INFO: `/v3/endpoints` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:59.080668 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a3a4d-e19f-467f-8e82-b1dae37daaee None admin] RBAC: Adding query filter params (interface=public, service_id=bd7815782cb5478db0339c9b5624802f, region_id=RegionOne) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:59.080978 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a3a4d-e19f-467f-8e82-b1dae37daaee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:59.082365 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a3a4d-e19f-467f-8e82-b1dae37daaee None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:59.092296 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 521/1038] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:06:58 2022] GET /identity/v3/endpoints?service_id=bd7815782cb5478db0339c9b5624802f&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:59.093337 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a3a4d-e19f-467f-8e82-b1dae37daaee None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:59.135721 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656181fd-0242-41d2-9f7d-d47dd2bca80a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:59.137563 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656181fd-0242-41d2-9f7d-d47dd2bca80a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:59.199204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a3a4d-e19f-467f-8e82-b1dae37daaee None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:59.232244 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59733f-5e70-492b-bd70-68ccc39113f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:59.232982 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59733f-5e70-492b-bd70-68ccc39113f0 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:59.233215 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59733f-5e70-492b-bd70-68ccc39113f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:59.233488 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59733f-5e70-492b-bd70-68ccc39113f0 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:59.234175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59733f-5e70-492b-bd70-68ccc39113f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:59.235800 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59733f-5e70-492b-bd70-68ccc39113f0 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:59.242004 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 518/1039] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:06:58 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:06:59.253960 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 522/1040] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:06:59 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 15:06:59.254785 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656181fd-0242-41d2-9f7d-d47dd2bca80a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:59.363301 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656181fd-0242-41d2-9f7d-d47dd2bca80a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:59.400568 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0ffd6-cb99-477c-99b8-96c32dbc284a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:59.401304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0ffd6-cb99-477c-99b8-96c32dbc284a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:59.401675 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0ffd6-cb99-477c-99b8-96c32dbc284a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:59.401958 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0ffd6-cb99-477c-99b8-96c32dbc284a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:59.415705 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0ffd6-cb99-477c-99b8-96c32dbc284a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:59.417181 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0ffd6-cb99-477c-99b8-96c32dbc284a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:59.439237 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-5dc0ffd6-cb99-477c-99b8-96c32dbc284a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:59.439237 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:59.439237 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:59.439237 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:59.439237 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:59.439237 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:59.439237 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:59.439237 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:59.439237 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:59.439237 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:59.439237 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:59.439237 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:59.439237 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:06:59.439237 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:06:59.439237 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:06:59.440259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:06:59.440259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:59.440259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:59.440259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:59.440259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:59.440259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:59.440259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:59.440259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:59.440259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:59.440259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:59.440259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:59.440259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:59.440259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:59.440259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:59.440259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:59.440259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:59.440259 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:59.441205 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:06:59.441205 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:06:59.441205 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:06:59.441205 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:59.441205 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 519/1041] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:59.447833 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59733f-5e70-492b-bd70-68ccc39113f0 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:59.551479 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59733f-5e70-492b-bd70-68ccc39113f0 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:59.585243 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfb139-932d-474d-a7d6-bf0f892207b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:59.585934 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfb139-932d-474d-a7d6-bf0f892207b7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:59.586215 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfb139-932d-474d-a7d6-bf0f892207b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:59.586484 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfb139-932d-474d-a7d6-bf0f892207b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:59.587206 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfb139-932d-474d-a7d6-bf0f892207b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:59.587507 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfb139-932d-474d-a7d6-bf0f892207b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:59.588859 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfb139-932d-474d-a7d6-bf0f892207b7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:59.602571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 523/1042] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:59.608122 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0ffd6-cb99-477c-99b8-96c32dbc284a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:59.714711 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0ffd6-cb99-477c-99b8-96c32dbc284a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:59.750513 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee2c97-3a73-4bdc-9b51-882147bd7016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:59.751307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee2c97-3a73-4bdc-9b51-882147bd7016 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:59.751584 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee2c97-3a73-4bdc-9b51-882147bd7016 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:59.751853 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee2c97-3a73-4bdc-9b51-882147bd7016 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:59.758834 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee2c97-3a73-4bdc-9b51-882147bd7016 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:59.760254 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee2c97-3a73-4bdc-9b51-882147bd7016 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:59.774755 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-4aee2c97-3a73-4bdc-9b51-882147bd7016 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:59.774755 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:06:59.774755 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:06:59.774755 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:06:59.774755 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:06:59.774755 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:06:59.774755 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:06:59.774755 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:06:59.774755 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:06:59.774755 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:06:59.774755 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:06:59.774755 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:06:59.774755 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:06:59.774755 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:06:59.774755 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:06:59.775738 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:06:59.775738 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:06:59.775738 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:06:59.775738 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:06:59.775738 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:06:59.775738 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:06:59.775738 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:06:59.775738 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:06:59.775738 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:06:59.775738 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:06:59.775738 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:06:59.775738 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:06:59.775738 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:06:59.775738 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:06:59.775738 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:06:59.775738 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:06:59.775738 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:06:59.776779 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:06:59.776779 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:06:59.776779 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:06:59.776779 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:06:59.776779 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:06:59.776779 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:06:59.776779 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:06:59.776779 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:06:59.776779 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 520/1043] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:06:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:06:59.781802 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfb139-932d-474d-a7d6-bf0f892207b7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:06:59.883104 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfb139-932d-474d-a7d6-bf0f892207b7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:06:59.916070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2492a8-7f1e-4ec1-baf5-fb3d6dedb5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:06:59.916736 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2492a8-7f1e-4ec1-baf5-fb3d6dedb5ea None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:06:59.917016 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2492a8-7f1e-4ec1-baf5-fb3d6dedb5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:06:59.917286 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2492a8-7f1e-4ec1-baf5-fb3d6dedb5ea None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:06:59.918110 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2492a8-7f1e-4ec1-baf5-fb3d6dedb5ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:06:59.918416 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2492a8-7f1e-4ec1-baf5-fb3d6dedb5ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:06:59.919869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2492a8-7f1e-4ec1-baf5-fb3d6dedb5ea None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:06:59.937237 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 524/1044] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:06:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:06:59.938568 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee2c97-3a73-4bdc-9b51-882147bd7016 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:00.005907 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482b57a-ad1c-48ed-8389-9778794761eb None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:00.005907 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482b57a-ad1c-48ed-8389-9778794761eb None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:00.006181 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482b57a-ad1c-48ed-8389-9778794761eb None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:00.008365 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 525/1045] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:07:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:07:00.013745 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2192c-89b9-460c-a54b-fd9c25835652 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:00.014028 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2192c-89b9-460c-a54b-fd9c25835652 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:00.014311 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2192c-89b9-460c-a54b-fd9c25835652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:00.031839 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-2ba2192c-89b9-460c-a54b-fd9c25835652 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:00.033105 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2ba2192c-89b9-460c-a54b-fd9c25835652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:00.047836 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee2c97-3a73-4bdc-9b51-882147bd7016 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:00.086840 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0703ae8-0728-447b-a477-1b248b44befc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:00.087787 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0703ae8-0728-447b-a477-1b248b44befc None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:00.088222 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0703ae8-0728-447b-a477-1b248b44befc None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:00.088648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0703ae8-0728-447b-a477-1b248b44befc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:00.089683 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0703ae8-0728-447b-a477-1b248b44befc None admin] RBAC: Adding query filter params (role.id=9f1767627c554047835baae35bce7b7c, scope.project.id=4fcadeae44cc4547905b83bfebec79c7, user.id=65e7a4e661ef4425b24844c3500b0b58) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:00.090163 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0703ae8-0728-447b-a477-1b248b44befc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:00.091751 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0703ae8-0728-447b-a477-1b248b44befc None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:00.105407 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 526/1046] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:07:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:07:00.105645 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 521/1047] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:06:59 2022] GET /identity/v3/role_assignments?user.id=65e7a4e661ef4425b24844c3500b0b58&scope.project.id=4fcadeae44cc4547905b83bfebec79c7&role.id=9f1767627c554047835baae35bce7b7c => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:07:00.125061 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2192c-89b9-460c-a54b-fd9c25835652 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:00.240057 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2192c-89b9-460c-a54b-fd9c25835652 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:00.286484 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57a3d4-2cbf-4a35-b2c7-2b46e7b100c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:00.287210 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57a3d4-2cbf-4a35-b2c7-2b46e7b100c4 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:00.287496 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57a3d4-2cbf-4a35-b2c7-2b46e7b100c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:00.288034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57a3d4-2cbf-4a35-b2c7-2b46e7b100c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:00.299221 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57a3d4-2cbf-4a35-b2c7-2b46e7b100c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:07:00.307734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-0f57a3d4-2cbf-4a35-b2c7-2b46e7b100c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:07:00.307734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:07:00.307734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:07:00.307734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:07:00.307734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:07:00.307734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:07:00.307734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:07:00.307734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:07:00.307734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:07:00.307734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:07:00.307734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:07:00.307734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:07:00.307734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:07:00.307734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:07:00.307734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:07:00.307734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:07:00.308707 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:07:00.308707 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:07:00.308707 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:07:00.308707 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:07:00.308707 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:07:00.308707 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:07:00.308707 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:07:00.308707 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:07:00.308707 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:07:00.308707 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:07:00.308707 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:07:00.308707 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:07:00.308707 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:07:00.308707 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:07:00.308707 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:07:00.308707 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:07:00.309646 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:07:00.309646 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:07:00.309646 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:07:00.309646 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:07:00.309646 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:07:00.309646 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:07:00.309646 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:07:00.309646 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:07:00.309646 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:07:00.309646 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:07:00.309646 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:07:00.309646 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:07:00.309646 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 527/1048] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:07:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:07:00.316426 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0703ae8-0728-447b-a477-1b248b44befc None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:00.427412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0703ae8-0728-447b-a477-1b248b44befc None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:00.463345 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988ee37-d7dc-465c-b512-6b3e06fad0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:00.464014 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988ee37-d7dc-465c-b512-6b3e06fad0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:00.464297 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988ee37-d7dc-465c-b512-6b3e06fad0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:00.464571 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988ee37-d7dc-465c-b512-6b3e06fad0e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:00.465391 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988ee37-d7dc-465c-b512-6b3e06fad0e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:00.465655 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988ee37-d7dc-465c-b512-6b3e06fad0e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:00.466997 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988ee37-d7dc-465c-b512-6b3e06fad0e9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:00.476205 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 522/1049] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:07:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:07:00.481809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57a3d4-2cbf-4a35-b2c7-2b46e7b100c4 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:00.587100 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57a3d4-2cbf-4a35-b2c7-2b46e7b100c4 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:00.619542 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbd8f5-82a8-4bb2-8536-dd01fd51986d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:00.620413 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbd8f5-82a8-4bb2-8536-dd01fd51986d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:00.620691 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbd8f5-82a8-4bb2-8536-dd01fd51986d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:00.621025 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbd8f5-82a8-4bb2-8536-dd01fd51986d None admin] PATH_INFO: `/v3/users/647619acd5764d71ab10af276a36b92b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:00.635055 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbd8f5-82a8-4bb2-8536-dd01fd51986d None admin] RBAC: Authorizing `identity:get_user(user_id=647619acd5764d71ab10af276a36b92b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:00.636497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbd8f5-82a8-4bb2-8536-dd01fd51986d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:00.642960 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 528/1050] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:07:00 2022] GET /identity/v3/users/647619acd5764d71ab10af276a36b92b => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:00.644522 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988ee37-d7dc-465c-b512-6b3e06fad0e9 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:00.744891 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988ee37-d7dc-465c-b512-6b3e06fad0e9 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:00.778326 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ebc4f-6847-4d24-8721-4e5859bbcf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:00.778971 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ebc4f-6847-4d24-8721-4e5859bbcf71 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:00.779248 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ebc4f-6847-4d24-8721-4e5859bbcf71 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:00.779564 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ebc4f-6847-4d24-8721-4e5859bbcf71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:00.845676 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ebc4f-6847-4d24-8721-4e5859bbcf71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:00.847013 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ebc4f-6847-4d24-8721-4e5859bbcf71 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:00.949758 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 523/1051] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:07:00 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:07:00.951676 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbd8f5-82a8-4bb2-8536-dd01fd51986d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:01.048947 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbd8f5-82a8-4bb2-8536-dd01fd51986d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:01.085400 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab82d72-128f-42b8-9e52-2e561b0f0c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:01.086237 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab82d72-128f-42b8-9e52-2e561b0f0c12 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:01.086512 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab82d72-128f-42b8-9e52-2e561b0f0c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:01.086780 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab82d72-128f-42b8-9e52-2e561b0f0c12 None admin] PATH_INFO: `/v3/projects/aae9635eb1ce43119da5a1246eb0b26d` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:01.087970 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab82d72-128f-42b8-9e52-2e561b0f0c12 None admin] RBAC: Authorizing `identity:get_project(project_id=aae9635eb1ce43119da5a1246eb0b26d)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:01.089409 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab82d72-128f-42b8-9e52-2e561b0f0c12 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:01.096578 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 529/1052] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:07:00 2022] GET /identity/v3/projects/aae9635eb1ce43119da5a1246eb0b26d => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:07:01.098511 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ebc4f-6847-4d24-8721-4e5859bbcf71 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:01.215979 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ebc4f-6847-4d24-8721-4e5859bbcf71 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:01.258325 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39344f59-91e0-45cf-ba8b-77f57a30d444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:01.259011 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39344f59-91e0-45cf-ba8b-77f57a30d444 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:01.259320 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39344f59-91e0-45cf-ba8b-77f57a30d444 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:01.259634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39344f59-91e0-45cf-ba8b-77f57a30d444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:01.260499 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39344f59-91e0-45cf-ba8b-77f57a30d444 None admin] RBAC: Adding query filter params (role.id=3409f00ead9e455182684faa27b1f8f0, scope.project.id=aae9635eb1ce43119da5a1246eb0b26d, user.id=647619acd5764d71ab10af276a36b92b) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:01.260811 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39344f59-91e0-45cf-ba8b-77f57a30d444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:01.263001 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39344f59-91e0-45cf-ba8b-77f57a30d444 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:01.275530 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 524/1053] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:07:01 2022] GET /identity/v3/role_assignments?user.id=647619acd5764d71ab10af276a36b92b&scope.project.id=aae9635eb1ce43119da5a1246eb0b26d&role.id=3409f00ead9e455182684faa27b1f8f0 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:01.542264 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c200ce1-baf6-4e8a-940a-38ebe946785f None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:01.542768 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c200ce1-baf6-4e8a-940a-38ebe946785f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:01.542847 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c200ce1-baf6-4e8a-940a-38ebe946785f None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:01.544306 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 530/1054] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:01.549832 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe907caf-4d94-4db4-a71c-5f457fe22ec0 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:01.550261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe907caf-4d94-4db4-a71c-5f457fe22ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:01.550604 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe907caf-4d94-4db4-a71c-5f457fe22ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:01.571076 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-fe907caf-4d94-4db4-a71c-5f457fe22ec0 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:01.572210 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-fe907caf-4d94-4db4-a71c-5f457fe22ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:01.641433 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 525/1055] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:07:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:07:01.666564 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c200ce1-baf6-4e8a-940a-38ebe946785f None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:01.837896 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c200ce1-baf6-4e8a-940a-38ebe946785f None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:01.902452 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5a510-00d0-497a-8eb6-7167c458617b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:01.903792 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5a510-00d0-497a-8eb6-7167c458617b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:01.904278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5a510-00d0-497a-8eb6-7167c458617b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:01.904659 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5a510-00d0-497a-8eb6-7167c458617b None admin] PATH_INFO: `/v3/services/image` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:01.905748 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5a510-00d0-497a-8eb6-7167c458617b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:01.908192 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5a510-00d0-497a-8eb6-7167c458617b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:01.929670 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-d6a5a510-00d0-497a-8eb6-7167c458617b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:07:01.929670 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:07:01.929670 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:07:01.929670 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:07:01.929670 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:07:01.929670 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:07:01.929670 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:07:01.929670 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:07:01.929670 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:07:01.929670 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:07:01.929670 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:07:01.929670 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:07:01.929670 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:07:01.929670 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:07:01.929670 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:07:01.929670 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:07:01.929670 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:07:01.931271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:07:01.931271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:07:01.931271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:07:01.931271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:07:01.931271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:07:01.931271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:07:01.931271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:07:01.931271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:07:01.931271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:07:01.931271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:07:01.931271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:07:01.931271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:07:01.931271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:07:01.931271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:07:01.931271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:07:01.931271 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:07:01.932740 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:07:01.932740 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:07:01.932740 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:07:01.932740 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:07:01.932740 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:07:01.932740 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:07:01.932740 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:07:01.932740 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:07:01.932740 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:07:01.932740 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:07:01.932740 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:07:01.932740 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:07:01.932740 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:07:01.932740 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:07:01.936659 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 531/1056] 10.222.0.48 () {56 vars in 1105 bytes} [Mon May 9 15:07:01 2022] GET /identity/v3/services/image => generated 86 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:07:01.941063 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe907caf-4d94-4db4-a71c-5f457fe22ec0 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:02.081794 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe907caf-4d94-4db4-a71c-5f457fe22ec0 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:02.116288 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcacd1d-2033-4812-8119-c5b2372be84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:02.116883 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcacd1d-2033-4812-8119-c5b2372be84f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:02.117169 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcacd1d-2033-4812-8119-c5b2372be84f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:02.117475 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcacd1d-2033-4812-8119-c5b2372be84f None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:02.118187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcacd1d-2033-4812-8119-c5b2372be84f None admin] RBAC: Adding query filter params (name=image) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:02.118496 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcacd1d-2033-4812-8119-c5b2372be84f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:02.119852 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcacd1d-2033-4812-8119-c5b2372be84f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:02.129268 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 526/1057] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:07:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:02.130356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5a510-00d0-497a-8eb6-7167c458617b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:02.230792 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5a510-00d0-497a-8eb6-7167c458617b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:02.265107 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf050540-f3bc-4933-b320-a339542a2c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:02.265801 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf050540-f3bc-4933-b320-a339542a2c70 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:02.266085 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf050540-f3bc-4933-b320-a339542a2c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:02.266359 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf050540-f3bc-4933-b320-a339542a2c70 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:02.267067 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf050540-f3bc-4933-b320-a339542a2c70 None admin] RBAC: Adding query filter params (type=image) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:02.267374 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf050540-f3bc-4933-b320-a339542a2c70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:02.268748 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf050540-f3bc-4933-b320-a339542a2c70 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:02.280413 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 532/1058] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:07:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:02.280634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcacd1d-2033-4812-8119-c5b2372be84f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:02.389927 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcacd1d-2033-4812-8119-c5b2372be84f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:02.401490 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0f99c-fb7e-4cdb-90a2-3947ddfbc2e3 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:02.401783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0f99c-fb7e-4cdb-90a2-3947ddfbc2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:02.402058 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0f99c-fb7e-4cdb-90a2-3947ddfbc2e3 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:02.403684 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 533/1059] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:07:02.408758 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac54be-e9a4-4a6f-ad0f-209e927859ab None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:02.409045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac54be-e9a4-4a6f-ad0f-209e927859ab None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:02.409316 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac54be-e9a4-4a6f-ad0f-209e927859ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:02.429893 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-7eac54be-e9a4-4a6f-ad0f-209e927859ab None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:02.431102 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-7eac54be-e9a4-4a6f-ad0f-209e927859ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:02.440426 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3538082-ce58-4782-9b6d-34ab8fad1168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:02.441090 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3538082-ce58-4782-9b6d-34ab8fad1168 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:02.441389 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3538082-ce58-4782-9b6d-34ab8fad1168 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:02.441691 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3538082-ce58-4782-9b6d-34ab8fad1168 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:02.442446 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3538082-ce58-4782-9b6d-34ab8fad1168 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:02.444313 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3538082-ce58-4782-9b6d-34ab8fad1168 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:02.469405 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 527/1060] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:07:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:07:02.521543 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 534/1061] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:07:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:07:02.545825 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3538082-ce58-4782-9b6d-34ab8fad1168 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:02.668067 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3538082-ce58-4782-9b6d-34ab8fad1168 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:02.706463 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54aaa8f-8a24-4337-a986-6390609ad3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:02.707594 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54aaa8f-8a24-4337-a986-6390609ad3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:02.707872 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54aaa8f-8a24-4337-a986-6390609ad3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:02.708144 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54aaa8f-8a24-4337-a986-6390609ad3f6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:02.719742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54aaa8f-8a24-4337-a986-6390609ad3f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:07:02.728179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-f54aaa8f-8a24-4337-a986-6390609ad3f6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:07:02.728179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:07:02.728179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:07:02.728179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:07:02.728179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:07:02.728179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:07:02.728179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:07:02.728179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:07:02.728179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:07:02.728179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:07:02.728179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:07:02.728179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:07:02.728179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:07:02.728179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:07:02.728179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:07:02.728179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:07:02.729201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:07:02.729201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:07:02.729201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:07:02.729201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:07:02.729201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:07:02.729201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:07:02.729201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:07:02.729201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:07:02.729201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:07:02.729201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:07:02.729201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:07:02.729201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:07:02.729201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:07:02.729201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:07:02.729201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:07:02.729201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:07:02.730396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:07:02.730396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:07:02.730396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:07:02.730396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:07:02.730396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:07:02.730396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:07:02.730396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:07:02.730396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:07:02.730396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:07:02.730396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:07:02.730396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:07:02.730396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:07:02.730396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 528/1062] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 9 15:07:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:07:02.737928 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac54be-e9a4-4a6f-ad0f-209e927859ab None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:02.847595 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac54be-e9a4-4a6f-ad0f-209e927859ab None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:02.889718 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabe822-df11-4089-8756-47ebf3b35618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:02.890393 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabe822-df11-4089-8756-47ebf3b35618 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:02.890672 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabe822-df11-4089-8756-47ebf3b35618 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:02.890940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabe822-df11-4089-8756-47ebf3b35618 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:02.891688 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabe822-df11-4089-8756-47ebf3b35618 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:02.891990 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabe822-df11-4089-8756-47ebf3b35618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:02.893357 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabe822-df11-4089-8756-47ebf3b35618 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:02.904985 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 535/1063] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:07:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:07:02.910536 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54aaa8f-8a24-4337-a986-6390609ad3f6 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:03.023431 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54aaa8f-8a24-4337-a986-6390609ad3f6 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:03.067940 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fe9df-a455-4dc1-a87a-dd0edcf2727d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:03.068767 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fe9df-a455-4dc1-a87a-dd0edcf2727d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:03.069255 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fe9df-a455-4dc1-a87a-dd0edcf2727d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:03.069568 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fe9df-a455-4dc1-a87a-dd0edcf2727d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:03.080811 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fe9df-a455-4dc1-a87a-dd0edcf2727d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:03.082287 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fe9df-a455-4dc1-a87a-dd0edcf2727d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:03.100982 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-a57fe9df-a455-4dc1-a87a-dd0edcf2727d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:07:03.100982 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:07:03.100982 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:07:03.100982 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:07:03.100982 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:07:03.100982 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:07:03.100982 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:07:03.100982 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:07:03.100982 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:07:03.100982 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:07:03.100982 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:07:03.100982 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:07:03.100982 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:07:03.100982 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:07:03.100982 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:07:03.101999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:07:03.101999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:07:03.101999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:07:03.101999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:07:03.101999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:07:03.101999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:07:03.101999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:07:03.101999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:07:03.101999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:07:03.101999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:07:03.101999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:07:03.101999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:07:03.101999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:07:03.101999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:07:03.101999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:07:03.101999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:07:03.101999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:07:03.102930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:07:03.102930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:07:03.102930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:07:03.102930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:07:03.105704 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 529/1064] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:07:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:07:03.107887 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabe822-df11-4089-8756-47ebf3b35618 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:03.214992 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabe822-df11-4089-8756-47ebf3b35618 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:03.254206 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debae891-b1fd-4eeb-ae2c-838f8fe503bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:03.254864 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debae891-b1fd-4eeb-ae2c-838f8fe503bf None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:03.255141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debae891-b1fd-4eeb-ae2c-838f8fe503bf None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:03.255408 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debae891-b1fd-4eeb-ae2c-838f8fe503bf None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:03.256130 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debae891-b1fd-4eeb-ae2c-838f8fe503bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:03.257133 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debae891-b1fd-4eeb-ae2c-838f8fe503bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:03.258709 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debae891-b1fd-4eeb-ae2c-838f8fe503bf None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:03.276025 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 536/1065] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:03.280685 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fe9df-a455-4dc1-a87a-dd0edcf2727d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:03.391878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fe9df-a455-4dc1-a87a-dd0edcf2727d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:03.426925 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7270b5-4a2f-4ec6-b10a-4ead8759c33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:03.427717 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7270b5-4a2f-4ec6-b10a-4ead8759c33e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:03.427999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7270b5-4a2f-4ec6-b10a-4ead8759c33e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:03.428902 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7270b5-4a2f-4ec6-b10a-4ead8759c33e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:03.436952 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7270b5-4a2f-4ec6-b10a-4ead8759c33e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:03.438398 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7270b5-4a2f-4ec6-b10a-4ead8759c33e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:03.452674 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-4f7270b5-4a2f-4ec6-b10a-4ead8759c33e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:07:03.452674 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:07:03.452674 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:07:03.452674 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:07:03.452674 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:07:03.452674 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:07:03.452674 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:07:03.452674 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:07:03.452674 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:07:03.452674 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:07:03.452674 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:07:03.452674 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:07:03.452674 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:07:03.452674 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:07:03.452674 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:07:03.452674 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:07:03.454373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:07:03.454373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:07:03.454373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:07:03.454373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:07:03.454373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:07:03.454373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:07:03.454373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:07:03.454373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:07:03.454373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:07:03.454373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:07:03.454373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:07:03.454373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:07:03.454373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:07:03.454373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:07:03.454373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:07:03.454373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:07:03.454373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:07:03.454373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:07:03.456771 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:07:03.456771 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:07:03.456771 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:07:03.456771 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:07:03.456771 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:07:03.456771 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:07:03.456771 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:07:03.456771 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:07:03.456771 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:07:03.456771 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:07:03.460775 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 530/1066] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:07:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:07:03.460946 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debae891-b1fd-4eeb-ae2c-838f8fe503bf None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:03.567536 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debae891-b1fd-4eeb-ae2c-838f8fe503bf None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:03.602234 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046adf4-110d-42b8-b0b3-0c07cda991f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:03.602904 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046adf4-110d-42b8-b0b3-0c07cda991f6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:03.603185 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046adf4-110d-42b8-b0b3-0c07cda991f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:03.603459 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046adf4-110d-42b8-b0b3-0c07cda991f6 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:03.604300 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046adf4-110d-42b8-b0b3-0c07cda991f6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:03.604606 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046adf4-110d-42b8-b0b3-0c07cda991f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:03.606067 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046adf4-110d-42b8-b0b3-0c07cda991f6 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:03.629413 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 537/1067] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:07:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:03.630731 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7270b5-4a2f-4ec6-b10a-4ead8759c33e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:03.693612 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969ccef-5f99-4cb4-94a0-9809a74673cf None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:03.694105 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969ccef-5f99-4cb4-94a0-9809a74673cf None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:03.694439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969ccef-5f99-4cb4-94a0-9809a74673cf None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:03.696250 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 538/1068] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:07:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:03.702345 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb7878-64b7-40b3-b840-3b628d7618e5 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:03.702633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb7878-64b7-40b3-b840-3b628d7618e5 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:03.702915 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb7878-64b7-40b3-b840-3b628d7618e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:03.721760 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e6fb7878-64b7-40b3-b840-3b628d7618e5 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:03.722978 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e6fb7878-64b7-40b3-b840-3b628d7618e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:03.763551 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7270b5-4a2f-4ec6-b10a-4ead8759c33e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:03.792474 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 539/1069] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:07:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:07:03.798237 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b88a76-2fa6-4b5b-b943-70f0589b10c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:03.799039 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b88a76-2fa6-4b5b-b943-70f0589b10c2 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:03.799321 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b88a76-2fa6-4b5b-b943-70f0589b10c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:03.799595 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b88a76-2fa6-4b5b-b943-70f0589b10c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:03.810414 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b88a76-2fa6-4b5b-b943-70f0589b10c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:03.811831 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b88a76-2fa6-4b5b-b943-70f0589b10c2 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:03.815394 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb7878-64b7-40b3-b840-3b628d7618e5 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:03.829529 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-a8b88a76-2fa6-4b5b-b943-70f0589b10c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:07:03.829529 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:07:03.829529 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:07:03.829529 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:07:03.829529 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:07:03.829529 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:07:03.829529 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:07:03.829529 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:07:03.829529 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:07:03.829529 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:07:03.829529 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:07:03.829529 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:07:03.829529 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:07:03.829529 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:07:03.829529 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:07:03.830667 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:07:03.830667 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:07:03.830667 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:07:03.830667 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:07:03.830667 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:07:03.830667 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:07:03.830667 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:07:03.830667 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:07:03.830667 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:07:03.830667 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:07:03.830667 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:07:03.830667 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:07:03.830667 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:07:03.830667 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:07:03.830667 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:07:03.830667 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:07:03.830667 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:07:03.831893 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:07:03.831893 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:07:03.831893 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:07:03.831893 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:07:03.831893 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 531/1070] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:07:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:07:03.836748 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b88a76-2fa6-4b5b-b943-70f0589b10c2 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:03.926060 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb7878-64b7-40b3-b840-3b628d7618e5 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:03.944857 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b88a76-2fa6-4b5b-b943-70f0589b10c2 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:03.960702 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56ba3f-a481-4d8a-9032-8e5f1b1fcc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:03.961674 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56ba3f-a481-4d8a-9032-8e5f1b1fcc99 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:03.961974 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56ba3f-a481-4d8a-9032-8e5f1b1fcc99 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:03.962234 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56ba3f-a481-4d8a-9032-8e5f1b1fcc99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:03.972132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56ba3f-a481-4d8a-9032-8e5f1b1fcc99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:07:03.980239 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-6d56ba3f-a481-4d8a-9032-8e5f1b1fcc99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:07:03.980239 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:07:03.980239 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:07:03.980239 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:07:03.980239 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:07:03.980239 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:07:03.980239 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:07:03.980239 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:07:03.980239 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:07:03.980239 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:07:03.980239 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:07:03.980239 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:07:03.980239 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:07:03.980239 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:07:03.980239 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:07:03.980239 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:07:03.981222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:07:03.981222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:07:03.981222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:07:03.981222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:07:03.981222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:07:03.981222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:07:03.981222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:07:03.981222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:07:03.981222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:07:03.981222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:07:03.981222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:07:03.981222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:07:03.981222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:07:03.981222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:07:03.981222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:07:03.981222 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:07:03.982324 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:07:03.982324 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:07:03.982324 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:07:03.982324 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:07:03.982324 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:07:03.982324 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:07:03.982324 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:07:03.982324 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:07:03.982324 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:07:03.982324 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:07:03.982324 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:07:03.982324 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:07:03.982324 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 540/1071] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:07:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:07:03.983035 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c39e6-7a79-4cee-b51e-8d3f444a67c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:03.983768 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c39e6-7a79-4cee-b51e-8d3f444a67c2 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:03.984059 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c39e6-7a79-4cee-b51e-8d3f444a67c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:03.984404 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c39e6-7a79-4cee-b51e-8d3f444a67c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:03.985436 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c39e6-7a79-4cee-b51e-8d3f444a67c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:03.985751 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c39e6-7a79-4cee-b51e-8d3f444a67c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:03.987165 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c39e6-7a79-4cee-b51e-8d3f444a67c2 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:03.987650 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56ba3f-a481-4d8a-9032-8e5f1b1fcc99 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:04.004422 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 532/1072] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:07:04.005322 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c39e6-7a79-4cee-b51e-8d3f444a67c2 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:04.103757 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56ba3f-a481-4d8a-9032-8e5f1b1fcc99 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:04.125422 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c39e6-7a79-4cee-b51e-8d3f444a67c2 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:04.156742 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca9078-6dea-4360-966a-d791c2576908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:04.157437 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca9078-6dea-4360-966a-d791c2576908 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:04.157735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca9078-6dea-4360-966a-d791c2576908 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:04.158009 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca9078-6dea-4360-966a-d791c2576908 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:04.158771 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca9078-6dea-4360-966a-d791c2576908 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:04.159078 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca9078-6dea-4360-966a-d791c2576908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:04.160653 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca9078-6dea-4360-966a-d791c2576908 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:04.166797 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2527460-6411-4a04-8aca-cca201ce36c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:04.168101 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2527460-6411-4a04-8aca-cca201ce36c5 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:04.168565 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2527460-6411-4a04-8aca-cca201ce36c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:04.169040 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2527460-6411-4a04-8aca-cca201ce36c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:04.176043 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 541/1073] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:07:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:07:04.177638 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca9078-6dea-4360-966a-d791c2576908 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:04.186081 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2527460-6411-4a04-8aca-cca201ce36c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:04.188559 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2527460-6411-4a04-8aca-cca201ce36c5 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:04.212833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-e2527460-6411-4a04-8aca-cca201ce36c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:07:04.212833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:07:04.212833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:07:04.212833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:07:04.212833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:07:04.212833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:07:04.212833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:07:04.212833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:07:04.212833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:07:04.212833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:07:04.212833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:07:04.212833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:07:04.212833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:07:04.212833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:07:04.212833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:07:04.214253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:07:04.214253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:07:04.214253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:07:04.214253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:07:04.214253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:07:04.214253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:07:04.214253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:07:04.214253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:07:04.214253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:07:04.214253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:07:04.214253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:07:04.214253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:07:04.214253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:07:04.214253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:07:04.214253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:07:04.214253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:07:04.214253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:07:04.215682 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:07:04.215682 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:07:04.215682 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:07:04.215682 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:07:04.215682 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:07:04.215682 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:07:04.215682 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:07:04.215682 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:07:04.215682 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 533/1074] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:07:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:07:04.223087 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2527460-6411-4a04-8aca-cca201ce36c5 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:04.308472 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca9078-6dea-4360-966a-d791c2576908 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:04.337452 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2527460-6411-4a04-8aca-cca201ce36c5 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:04.341710 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec2f9b-19cc-4ed8-aaf5-2a1385f3c146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:04.342580 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec2f9b-19cc-4ed8-aaf5-2a1385f3c146 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:04.342866 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec2f9b-19cc-4ed8-aaf5-2a1385f3c146 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:04.343139 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec2f9b-19cc-4ed8-aaf5-2a1385f3c146 None admin] PATH_INFO: `/v3/users/647619acd5764d71ab10af276a36b92b` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:04.344396 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec2f9b-19cc-4ed8-aaf5-2a1385f3c146 None admin] RBAC: Authorizing `identity:get_user(user_id=647619acd5764d71ab10af276a36b92b)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:04.345864 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec2f9b-19cc-4ed8-aaf5-2a1385f3c146 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:04.347511 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 542/1075] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:07:04 2022] GET /identity/v3/users/647619acd5764d71ab10af276a36b92b => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:07:04.353647 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec2f9b-19cc-4ed8-aaf5-2a1385f3c146 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:04.378299 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606117f5-e26a-40ff-bea6-0cde12fb962c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:04.379374 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606117f5-e26a-40ff-bea6-0cde12fb962c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:04.379807 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606117f5-e26a-40ff-bea6-0cde12fb962c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:04.380257 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606117f5-e26a-40ff-bea6-0cde12fb962c None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:04.381232 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606117f5-e26a-40ff-bea6-0cde12fb962c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:04.381812 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606117f5-e26a-40ff-bea6-0cde12fb962c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:04.383563 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606117f5-e26a-40ff-bea6-0cde12fb962c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:04.402274 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 534/1076] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:07:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:07:04.403740 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606117f5-e26a-40ff-bea6-0cde12fb962c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:04.472034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec2f9b-19cc-4ed8-aaf5-2a1385f3c146 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:04.510824 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12427b1-ed10-4fc4-a57f-934e2ee63950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:04.511694 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12427b1-ed10-4fc4-a57f-934e2ee63950 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:04.511977 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12427b1-ed10-4fc4-a57f-934e2ee63950 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:04.512261 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12427b1-ed10-4fc4-a57f-934e2ee63950 None admin] PATH_INFO: `/v3/projects/aae9635eb1ce43119da5a1246eb0b26d` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:04.513473 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12427b1-ed10-4fc4-a57f-934e2ee63950 None admin] RBAC: Authorizing `identity:get_project(project_id=aae9635eb1ce43119da5a1246eb0b26d)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:04.514919 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12427b1-ed10-4fc4-a57f-934e2ee63950 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:04.516791 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 543/1077] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:07:04 2022] GET /identity/v3/projects/aae9635eb1ce43119da5a1246eb0b26d => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:07:04.517285 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606117f5-e26a-40ff-bea6-0cde12fb962c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:04.523841 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12427b1-ed10-4fc4-a57f-934e2ee63950 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:04.554295 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c278b73-3891-4ce5-a282-85e1d92409f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:04.555567 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c278b73-3891-4ce5-a282-85e1d92409f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:04.555853 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c278b73-3891-4ce5-a282-85e1d92409f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:04.556128 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c278b73-3891-4ce5-a282-85e1d92409f4 None admin] PATH_INFO: `/v3/projects/4fcadeae44cc4547905b83bfebec79c7/users/65e7a4e661ef4425b24844c3500b0b58/roles/9f1767627c554047835baae35bce7b7c` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:04.558434 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c278b73-3891-4ce5-a282-85e1d92409f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=4fcadeae44cc4547905b83bfebec79c7, user_id=65e7a4e661ef4425b24844c3500b0b58, role_id=9f1767627c554047835baae35bce7b7c)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:04.559866 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c278b73-3891-4ce5-a282-85e1d92409f4 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:04.575007 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 535/1078] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:07:04 2022] PUT /identity/v3/projects/4fcadeae44cc4547905b83bfebec79c7/users/65e7a4e661ef4425b24844c3500b0b58/roles/9f1767627c554047835baae35bce7b7c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:07:04.635138 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12427b1-ed10-4fc4-a57f-934e2ee63950 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:04.673821 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30a3fb-6358-4f47-9525-01606669cc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:04.674747 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30a3fb-6358-4f47-9525-01606669cc15 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:04.675026 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30a3fb-6358-4f47-9525-01606669cc15 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:04.675457 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30a3fb-6358-4f47-9525-01606669cc15 None admin] PATH_INFO: `/v3/projects/aae9635eb1ce43119da5a1246eb0b26d/users/647619acd5764d71ab10af276a36b92b/roles/3409f00ead9e455182684faa27b1f8f0` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:04.677630 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30a3fb-6358-4f47-9525-01606669cc15 None admin] RBAC: Authorizing `identity:create_grant(project_id=aae9635eb1ce43119da5a1246eb0b26d, user_id=647619acd5764d71ab10af276a36b92b, role_id=3409f00ead9e455182684faa27b1f8f0)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:04.679410 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30a3fb-6358-4f47-9525-01606669cc15 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:04.705419 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 544/1079] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:07:04 2022] PUT /identity/v3/projects/aae9635eb1ce43119da5a1246eb0b26d/users/647619acd5764d71ab10af276a36b92b/roles/3409f00ead9e455182684faa27b1f8f0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:07:04.894140 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b28ee-97ee-4f99-8eb5-037dc6f5e830 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:04.894636 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b28ee-97ee-4f99-8eb5-037dc6f5e830 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:04.894636 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b28ee-97ee-4f99-8eb5-037dc6f5e830 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:04.896230 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 536/1080] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:04.902758 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca54d6-7c1f-4874-a38c-285ee5d42ee9 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:04.903274 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca54d6-7c1f-4874-a38c-285ee5d42ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:04.903362 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca54d6-7c1f-4874-a38c-285ee5d42ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:04.921245 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-9eca54d6-7c1f-4874-a38c-285ee5d42ee9 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:04.922502 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-9eca54d6-7c1f-4874-a38c-285ee5d42ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:04.993249 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 545/1081] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:07:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:07:05.015362 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b28ee-97ee-4f99-8eb5-037dc6f5e830 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:05.124849 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b28ee-97ee-4f99-8eb5-037dc6f5e830 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:05.159455 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1c447-aa3b-4a25-bc42-3a0b665a49a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:05.160031 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1c447-aa3b-4a25-bc42-3a0b665a49a1 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:05.160315 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1c447-aa3b-4a25-bc42-3a0b665a49a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:05.160591 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1c447-aa3b-4a25-bc42-3a0b665a49a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:05.230261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1c447-aa3b-4a25-bc42-3a0b665a49a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:05.231732 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1c447-aa3b-4a25-bc42-3a0b665a49a1 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:05.332322 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 537/1082] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:07:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:07:05.338922 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca54d6-7c1f-4874-a38c-285ee5d42ee9 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:05.458676 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca54d6-7c1f-4874-a38c-285ee5d42ee9 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:05.498611 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686297a-6877-4a9b-b3fd-a94529286bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:05.499418 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686297a-6877-4a9b-b3fd-a94529286bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:05.499699 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686297a-6877-4a9b-b3fd-a94529286bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:05.499975 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686297a-6877-4a9b-b3fd-a94529286bc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:05.511888 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686297a-6877-4a9b-b3fd-a94529286bc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:05.513409 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686297a-6877-4a9b-b3fd-a94529286bc6 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:05.531215 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-7686297a-6877-4a9b-b3fd-a94529286bc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:07:05.531215 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:07:05.531215 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:07:05.531215 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:07:05.531215 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:07:05.531215 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:07:05.531215 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:07:05.531215 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:07:05.531215 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:07:05.531215 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:07:05.531215 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:07:05.531215 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:07:05.531215 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:07:05.531215 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:07:05.531215 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:07:05.532504 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:07:05.532504 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:07:05.532504 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:07:05.532504 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:07:05.532504 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:07:05.532504 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:07:05.532504 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:07:05.532504 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:07:05.532504 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:07:05.532504 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:07:05.532504 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:07:05.532504 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:07:05.532504 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:07:05.532504 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:07:05.532504 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:07:05.532504 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:07:05.532504 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:07:05.534155 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:07:05.534155 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:07:05.534155 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:07:05.534155 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:07:05.535778 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 546/1083] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:07:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:07:05.539163 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1c447-aa3b-4a25-bc42-3a0b665a49a1 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:05.638024 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1c447-aa3b-4a25-bc42-3a0b665a49a1 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:05.673172 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca464b31-b5e2-4b02-bb0f-719a3a29176b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:05.673861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca464b31-b5e2-4b02-bb0f-719a3a29176b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:05.674194 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca464b31-b5e2-4b02-bb0f-719a3a29176b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:05.674418 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca464b31-b5e2-4b02-bb0f-719a3a29176b None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:05.675141 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca464b31-b5e2-4b02-bb0f-719a3a29176b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:05.675449 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca464b31-b5e2-4b02-bb0f-719a3a29176b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:05.676805 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca464b31-b5e2-4b02-bb0f-719a3a29176b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:05.688762 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 538/1084] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:07:06.880494 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a27f25-c1d0-4602-a7e8-cd88d9bea97e None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:06.881024 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a27f25-c1d0-4602-a7e8-cd88d9bea97e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:06.881024 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a27f25-c1d0-4602-a7e8-cd88d9bea97e None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:06.883538 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 547/1085] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:07:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:06.889615 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b0df6-30ca-4dc5-b73f-daad6994e792 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:06.890066 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b0df6-30ca-4dc5-b73f-daad6994e792 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:06.890157 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b0df6-30ca-4dc5-b73f-daad6994e792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:06.907373 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-844b0df6-30ca-4dc5-b73f-daad6994e792 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:06.908538 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-844b0df6-30ca-4dc5-b73f-daad6994e792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:06.980698 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 539/1086] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:07:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:07:06.986696 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d56fb-3f48-4588-8cef-5ea08573819a None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:06.986986 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d56fb-3f48-4588-8cef-5ea08573819a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:06.987264 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d56fb-3f48-4588-8cef-5ea08573819a None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:06.988647 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 548/1087] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:06.994838 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6c536-3968-41c4-8f84-4866ae1e173b None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:06.995129 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6c536-3968-41c4-8f84-4866ae1e173b None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:06.995410 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6c536-3968-41c4-8f84-4866ae1e173b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:07.003411 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d56fb-3f48-4588-8cef-5ea08573819a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:07.014392 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-09f6c536-3968-41c4-8f84-4866ae1e173b None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:07.015646 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-09f6c536-3968-41c4-8f84-4866ae1e173b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:07.085629 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 540/1088] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:07:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:07:07.108765 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6c536-3968-41c4-8f84-4866ae1e173b None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:07.120814 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d56fb-3f48-4588-8cef-5ea08573819a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:07.156755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf28e16-8a73-4a62-9186-3e79d9b01e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:07.157510 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf28e16-8a73-4a62-9186-3e79d9b01e4a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:07.157795 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf28e16-8a73-4a62-9186-3e79d9b01e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:07.158067 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf28e16-8a73-4a62-9186-3e79d9b01e4a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:07.169592 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf28e16-8a73-4a62-9186-3e79d9b01e4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:07:07.179974 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-9cf28e16-8a73-4a62-9186-3e79d9b01e4a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:07:07.179974 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:07:07.179974 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:07:07.179974 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:07:07.179974 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:07:07.179974 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:07:07.179974 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:07:07.179974 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:07:07.179974 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:07:07.179974 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:07:07.179974 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:07:07.179974 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:07:07.179974 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:07:07.179974 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:07:07.179974 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:07:07.179974 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:07:07.181363 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:07:07.181363 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:07:07.181363 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:07:07.181363 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:07:07.181363 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:07:07.181363 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:07:07.181363 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:07:07.181363 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:07:07.181363 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:07:07.181363 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:07:07.181363 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:07:07.181363 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:07:07.181363 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:07:07.181363 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:07:07.181363 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:07:07.181363 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:07:07.182590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:07:07.182590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:07:07.182590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:07:07.182590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:07:07.182590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:07:07.182590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:07:07.182590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:07:07.182590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:07:07.182590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:07:07.182590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:07:07.182590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:07:07.182590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:07:07.182590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 549/1089] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 9 15:07:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:07:07.187211 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf28e16-8a73-4a62-9186-3e79d9b01e4a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:07.220451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6c536-3968-41c4-8f84-4866ae1e173b None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:07.258540 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa7618-b5ab-4a71-8e37-3b3d2d24e260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:07.259346 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa7618-b5ab-4a71-8e37-3b3d2d24e260 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:07.259636 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa7618-b5ab-4a71-8e37-3b3d2d24e260 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:07.259914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa7618-b5ab-4a71-8e37-3b3d2d24e260 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:07.270346 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa7618-b5ab-4a71-8e37-3b3d2d24e260 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:07:07.278713 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-12aa7618-b5ab-4a71-8e37-3b3d2d24e260 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:07:07.278713 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:07:07.278713 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:07:07.278713 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:07:07.278713 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:07:07.278713 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:07:07.278713 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:07:07.278713 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:07:07.278713 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:07:07.278713 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:07:07.278713 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:07:07.278713 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:07:07.278713 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:07:07.278713 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:07:07.278713 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:07:07.278713 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:07:07.279914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:07:07.279914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:07:07.279914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:07:07.279914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:07:07.279914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:07:07.279914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:07:07.279914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:07:07.279914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:07:07.279914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:07:07.279914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:07:07.279914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:07:07.279914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:07:07.279914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:07:07.279914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:07:07.279914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:07:07.279914 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:07:07.280818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:07:07.280818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:07:07.280818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:07:07.280818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:07:07.280818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:07:07.280818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:07:07.280818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:07:07.280818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:07:07.280818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:07:07.280818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:07:07.280818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:07:07.280818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:07:07.280818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 541/1090] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:07:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:07:07.288665 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa7618-b5ab-4a71-8e37-3b3d2d24e260 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:07.297300 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf28e16-8a73-4a62-9186-3e79d9b01e4a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:07.332382 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9300c4-0baa-4c4d-a8e5-0668e41501ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:07.333054 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9300c4-0baa-4c4d-a8e5-0668e41501ab None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:07.333339 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9300c4-0baa-4c4d-a8e5-0668e41501ab None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:07.333643 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9300c4-0baa-4c4d-a8e5-0668e41501ab None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:07.334604 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9300c4-0baa-4c4d-a8e5-0668e41501ab None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:07.334938 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9300c4-0baa-4c4d-a8e5-0668e41501ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:07.336315 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9300c4-0baa-4c4d-a8e5-0668e41501ab None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:07.344468 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 550/1091] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:07:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:07:07.350354 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9300c4-0baa-4c4d-a8e5-0668e41501ab None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:07.398319 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa7618-b5ab-4a71-8e37-3b3d2d24e260 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:07.437313 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1dc83c-3e5f-4fc5-be6d-9e5ea13d2d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:07.438003 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1dc83c-3e5f-4fc5-be6d-9e5ea13d2d8a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:07.438284 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1dc83c-3e5f-4fc5-be6d-9e5ea13d2d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:07.438564 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1dc83c-3e5f-4fc5-be6d-9e5ea13d2d8a None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:07.439301 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1dc83c-3e5f-4fc5-be6d-9e5ea13d2d8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:07.439604 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1dc83c-3e5f-4fc5-be6d-9e5ea13d2d8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:07.440969 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1dc83c-3e5f-4fc5-be6d-9e5ea13d2d8a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:07.453822 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 542/1092] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:07:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:07:07.460311 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1dc83c-3e5f-4fc5-be6d-9e5ea13d2d8a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:07.477503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9300c4-0baa-4c4d-a8e5-0668e41501ab None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:07.512389 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85761b-c039-49f8-a008-8df1ffbfe6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:07.513189 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85761b-c039-49f8-a008-8df1ffbfe6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:07.513499 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85761b-c039-49f8-a008-8df1ffbfe6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:07.513775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85761b-c039-49f8-a008-8df1ffbfe6a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:07.525643 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85761b-c039-49f8-a008-8df1ffbfe6a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:07.527098 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85761b-c039-49f8-a008-8df1ffbfe6a3 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:07.545081 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-3e85761b-c039-49f8-a008-8df1ffbfe6a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:07:07.545081 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:07:07.545081 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:07:07.545081 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:07:07.545081 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:07:07.545081 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:07:07.545081 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:07:07.545081 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:07:07.545081 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:07:07.545081 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:07:07.545081 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:07:07.545081 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:07:07.545081 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:07:07.545081 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:07:07.545081 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:07:07.546248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:07:07.546248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:07:07.546248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:07:07.546248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:07:07.546248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:07:07.546248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:07:07.546248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:07:07.546248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:07:07.546248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:07:07.546248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:07:07.546248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:07:07.546248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:07:07.546248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:07:07.546248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:07:07.546248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:07:07.546248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:07:07.546248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:07:07.547278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:07:07.547278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:07:07.547278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:07:07.547278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:07:07.547278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 551/1093] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:07:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:07:07.552172 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85761b-c039-49f8-a008-8df1ffbfe6a3 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:07.560873 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1dc83c-3e5f-4fc5-be6d-9e5ea13d2d8a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:07.596639 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe085b9-d7ad-4328-9453-fae57e4d4a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:07.597533 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe085b9-d7ad-4328-9453-fae57e4d4a0a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:07.597818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe085b9-d7ad-4328-9453-fae57e4d4a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:07.598091 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe085b9-d7ad-4328-9453-fae57e4d4a0a None admin] PATH_INFO: `/v3/users/647619acd5764d71ab10af276a36b92b` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:07.599274 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe085b9-d7ad-4328-9453-fae57e4d4a0a None admin] RBAC: Authorizing `identity:get_user(user_id=647619acd5764d71ab10af276a36b92b)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:07.600931 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe085b9-d7ad-4328-9453-fae57e4d4a0a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:07.602567 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 543/1094] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:07:07 2022] GET /identity/v3/users/647619acd5764d71ab10af276a36b92b => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:07:07.608188 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe085b9-d7ad-4328-9453-fae57e4d4a0a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:07.666097 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85761b-c039-49f8-a008-8df1ffbfe6a3 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:07.700261 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812769e5-2892-4760-9b10-5498cd1c585b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:07.700921 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812769e5-2892-4760-9b10-5498cd1c585b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:07.701201 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812769e5-2892-4760-9b10-5498cd1c585b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:07.701510 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812769e5-2892-4760-9b10-5498cd1c585b None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:07.702227 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812769e5-2892-4760-9b10-5498cd1c585b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:07.702535 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812769e5-2892-4760-9b10-5498cd1c585b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:07.703891 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812769e5-2892-4760-9b10-5498cd1c585b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:07.715707 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 552/1095] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:07:07.721307 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812769e5-2892-4760-9b10-5498cd1c585b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:07.722639 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe085b9-d7ad-4328-9453-fae57e4d4a0a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:07.756529 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef353a2-dabb-499c-9c3d-9a7487a577e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:07.757351 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef353a2-dabb-499c-9c3d-9a7487a577e9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:07.757666 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef353a2-dabb-499c-9c3d-9a7487a577e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:07.757942 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef353a2-dabb-499c-9c3d-9a7487a577e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:07.815560 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812769e5-2892-4760-9b10-5498cd1c585b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:07.822029 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef353a2-dabb-499c-9c3d-9a7487a577e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:07.823451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef353a2-dabb-499c-9c3d-9a7487a577e9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:07.847968 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b64460-e285-4b2c-8a4a-ad9b15791e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:07.848800 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b64460-e285-4b2c-8a4a-ad9b15791e79 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:07.849220 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b64460-e285-4b2c-8a4a-ad9b15791e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:07.849356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b64460-e285-4b2c-8a4a-ad9b15791e79 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:07.857939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b64460-e285-4b2c-8a4a-ad9b15791e79 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:07.859624 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b64460-e285-4b2c-8a4a-ad9b15791e79 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:07.875200 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-d2b64460-e285-4b2c-8a4a-ad9b15791e79 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:07:07.875200 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:07:07.875200 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:07:07.875200 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:07:07.875200 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:07:07.875200 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:07:07.875200 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:07:07.875200 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:07:07.875200 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:07:07.875200 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:07:07.875200 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:07:07.875200 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:07:07.875200 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:07:07.875200 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:07:07.875200 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:07:07.875200 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:07:07.876399 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:07:07.876399 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:07:07.876399 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:07:07.876399 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:07:07.876399 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:07:07.876399 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:07:07.876399 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:07:07.876399 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:07:07.876399 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:07:07.876399 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:07:07.876399 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:07:07.876399 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:07:07.876399 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:07:07.876399 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:07:07.876399 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:07:07.876399 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:07:07.876399 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:07:07.876399 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:07:07.884368 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:07:07.884368 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:07:07.884368 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:07:07.884368 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:07:07.884368 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:07:07.884368 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:07:07.884368 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:07:07.884368 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:07:07.884368 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:07:07.884368 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:07:07.884368 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 553/1096] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:07:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:07:07.884368 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b64460-e285-4b2c-8a4a-ad9b15791e79 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:07.934368 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 544/1097] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:07:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:07:07.940183 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef353a2-dabb-499c-9c3d-9a7487a577e9 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:07.983762 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b64460-e285-4b2c-8a4a-ad9b15791e79 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:08.023674 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62a435-5827-4eba-b7d8-19dbc42ac76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:08.024361 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62a435-5827-4eba-b7d8-19dbc42ac76b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:08.024648 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62a435-5827-4eba-b7d8-19dbc42ac76b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:08.024930 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62a435-5827-4eba-b7d8-19dbc42ac76b None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:08.025809 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62a435-5827-4eba-b7d8-19dbc42ac76b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:08.026125 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62a435-5827-4eba-b7d8-19dbc42ac76b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:08.027559 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62a435-5827-4eba-b7d8-19dbc42ac76b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:08.044909 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 554/1098] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:07:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:07:08.047401 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef353a2-dabb-499c-9c3d-9a7487a577e9 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:08.050365 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62a435-5827-4eba-b7d8-19dbc42ac76b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:08.088515 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf852d-fe49-49bc-ab22-6c918923f06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:08.089408 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf852d-fe49-49bc-ab22-6c918923f06e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:08.089681 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf852d-fe49-49bc-ab22-6c918923f06e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:08.089959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf852d-fe49-49bc-ab22-6c918923f06e None admin] PATH_INFO: `/v3/projects/aae9635eb1ce43119da5a1246eb0b26d` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:08.091138 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf852d-fe49-49bc-ab22-6c918923f06e None admin] RBAC: Authorizing `identity:get_project(project_id=aae9635eb1ce43119da5a1246eb0b26d)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:08.092560 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf852d-fe49-49bc-ab22-6c918923f06e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:08.094292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 545/1099] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:07:07 2022] GET /identity/v3/projects/aae9635eb1ce43119da5a1246eb0b26d => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:07:08.100829 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf852d-fe49-49bc-ab22-6c918923f06e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:08.156767 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62a435-5827-4eba-b7d8-19dbc42ac76b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:08.190248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a1252-a2ca-4a19-8e6f-b8d4b71d4d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:08.190977 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a1252-a2ca-4a19-8e6f-b8d4b71d4d2a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:08.191173 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a1252-a2ca-4a19-8e6f-b8d4b71d4d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:08.191446 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a1252-a2ca-4a19-8e6f-b8d4b71d4d2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:08.199198 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf852d-fe49-49bc-ab22-6c918923f06e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:08.230867 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e056a-3522-4bb7-96cd-f4f91f943b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:08.231510 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e056a-3522-4bb7-96cd-f4f91f943b71 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:08.231788 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e056a-3522-4bb7-96cd-f4f91f943b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:08.232058 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e056a-3522-4bb7-96cd-f4f91f943b71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:08.232878 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e056a-3522-4bb7-96cd-f4f91f943b71 None admin] RBAC: Adding query filter params (role.id=3409f00ead9e455182684faa27b1f8f0, scope.project.id=aae9635eb1ce43119da5a1246eb0b26d, user.id=647619acd5764d71ab10af276a36b92b) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:08.233183 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e056a-3522-4bb7-96cd-f4f91f943b71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:08.234679 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e056a-3522-4bb7-96cd-f4f91f943b71 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:08.240966 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 546/1100] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:07:08 2022] GET /identity/v3/role_assignments?user.id=647619acd5764d71ab10af276a36b92b&scope.project.id=aae9635eb1ce43119da5a1246eb0b26d&role.id=3409f00ead9e455182684faa27b1f8f0 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:07:08.257914 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a1252-a2ca-4a19-8e6f-b8d4b71d4d2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:08.259404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94a1252-a2ca-4a19-8e6f-b8d4b71d4d2a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:08.368848 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 555/1101] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:07:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:07:08.374867 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e056a-3522-4bb7-96cd-f4f91f943b71 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:08.495942 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e056a-3522-4bb7-96cd-f4f91f943b71 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:08.530387 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05653a34-2651-4851-95e4-28d17095423d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:08.531170 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05653a34-2651-4851-95e4-28d17095423d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:08.531452 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05653a34-2651-4851-95e4-28d17095423d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:08.531730 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05653a34-2651-4851-95e4-28d17095423d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:08.544150 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05653a34-2651-4851-95e4-28d17095423d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:08.545631 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05653a34-2651-4851-95e4-28d17095423d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:08.564298 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-05653a34-2651-4851-95e4-28d17095423d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:07:08.564298 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:07:08.564298 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:07:08.564298 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:07:08.564298 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:07:08.564298 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:07:08.564298 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:07:08.564298 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:07:08.564298 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:07:08.564298 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:07:08.564298 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:07:08.564298 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:07:08.564298 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:07:08.564298 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:07:08.564298 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:07:08.565294 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:07:08.565294 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:07:08.565294 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:07:08.565294 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:07:08.565294 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:07:08.565294 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:07:08.565294 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:07:08.565294 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:07:08.565294 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:07:08.565294 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:07:08.565294 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:07:08.565294 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:07:08.565294 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:07:08.565294 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:07:08.565294 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:07:08.565294 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:07:08.565294 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:07:08.566253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:07:08.566253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:07:08.566253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:07:08.566253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:07:08.566253 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 547/1102] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:07:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:07:08.571538 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a1252-a2ca-4a19-8e6f-b8d4b71d4d2a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:08.678882 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a1252-a2ca-4a19-8e6f-b8d4b71d4d2a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:08.717464 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d29c8-49b7-48a0-88f2-24f767dd8150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:08.718133 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d29c8-49b7-48a0-88f2-24f767dd8150 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:08.718413 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d29c8-49b7-48a0-88f2-24f767dd8150 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:08.718684 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d29c8-49b7-48a0-88f2-24f767dd8150 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:08.719412 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d29c8-49b7-48a0-88f2-24f767dd8150 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:08.719716 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d29c8-49b7-48a0-88f2-24f767dd8150 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:08.721080 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d29c8-49b7-48a0-88f2-24f767dd8150 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:08.740229 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 556/1103] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:07:08.742381 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05653a34-2651-4851-95e4-28d17095423d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:08.856263 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05653a34-2651-4851-95e4-28d17095423d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:08.892340 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dce68a-643d-4e0b-8af0-e42227c8cb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:08.894762 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dce68a-643d-4e0b-8af0-e42227c8cb59 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:08.894762 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dce68a-643d-4e0b-8af0-e42227c8cb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:08.894762 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dce68a-643d-4e0b-8af0-e42227c8cb59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:08.901308 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dce68a-643d-4e0b-8af0-e42227c8cb59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:08.902799 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dce68a-643d-4e0b-8af0-e42227c8cb59 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:08.917145 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-f4dce68a-643d-4e0b-8af0-e42227c8cb59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:07:08.917145 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:07:08.917145 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:07:08.917145 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:07:08.917145 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:07:08.917145 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:07:08.917145 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:07:08.917145 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:07:08.917145 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:07:08.917145 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:07:08.917145 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:07:08.917145 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:07:08.917145 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:07:08.917145 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:07:08.917145 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:07:08.918189 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:07:08.918189 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:07:08.918189 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:07:08.918189 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:07:08.918189 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:07:08.918189 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:07:08.918189 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:07:08.918189 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:07:08.918189 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:07:08.918189 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:07:08.918189 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:07:08.918189 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:07:08.918189 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:07:08.918189 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:07:08.918189 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:07:08.918189 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:07:08.918189 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:07:08.919108 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:07:08.919108 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:07:08.919108 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:07:08.919108 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:07:08.919108 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:07:08.919108 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:07:08.919108 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:07:08.919108 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:07:08.919108 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 548/1104] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:07:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:07:08.924604 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d29c8-49b7-48a0-88f2-24f767dd8150 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:09.030953 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d29c8-49b7-48a0-88f2-24f767dd8150 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:09.065773 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88fc95-ff1e-4628-b833-045c7e66e287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:09.066440 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88fc95-ff1e-4628-b833-045c7e66e287 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:09.066715 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88fc95-ff1e-4628-b833-045c7e66e287 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:09.067499 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88fc95-ff1e-4628-b833-045c7e66e287 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:09.067774 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88fc95-ff1e-4628-b833-045c7e66e287 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:09.068183 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88fc95-ff1e-4628-b833-045c7e66e287 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:09.070356 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88fc95-ff1e-4628-b833-045c7e66e287 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:09.082765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 557/1105] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:07:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:09.089142 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dce68a-643d-4e0b-8af0-e42227c8cb59 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:09.219675 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dce68a-643d-4e0b-8af0-e42227c8cb59 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:09.256246 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6631d-23a8-42ee-baa7-55e02b974db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:09.256920 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6631d-23a8-42ee-baa7-55e02b974db6 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:09.257315 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6631d-23a8-42ee-baa7-55e02b974db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:09.257632 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6631d-23a8-42ee-baa7-55e02b974db6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:09.258544 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6631d-23a8-42ee-baa7-55e02b974db6 None admin] RBAC: Adding query filter params (role.id=9f1767627c554047835baae35bce7b7c, scope.project.id=4fcadeae44cc4547905b83bfebec79c7, user.id=65e7a4e661ef4425b24844c3500b0b58) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:09.258859 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6631d-23a8-42ee-baa7-55e02b974db6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:09.260297 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6631d-23a8-42ee-baa7-55e02b974db6 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:09.266304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 549/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:07:09 2022] GET /identity/v3/role_assignments?user.id=65e7a4e661ef4425b24844c3500b0b58&scope.project.id=4fcadeae44cc4547905b83bfebec79c7&role.id=9f1767627c554047835baae35bce7b7c => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:10.646934 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ba78a-5c46-4cb9-9653-56358e93419a None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:10.647477 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ba78a-5c46-4cb9-9653-56358e93419a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:10.647477 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ba78a-5c46-4cb9-9653-56358e93419a None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:10.649013 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 558/1107] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:10.654752 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90efdc1-bc31-4262-b0ef-89de8ecdb23b None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:10.655234 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90efdc1-bc31-4262-b0ef-89de8ecdb23b None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:10.655327 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90efdc1-bc31-4262-b0ef-89de8ecdb23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:10.673738 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-c90efdc1-bc31-4262-b0ef-89de8ecdb23b None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:10.674852 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-c90efdc1-bc31-4262-b0ef-89de8ecdb23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:10.743553 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 550/1108] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:07:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:07:10.768729 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ba78a-5c46-4cb9-9653-56358e93419a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:10.875274 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ba78a-5c46-4cb9-9653-56358e93419a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:10.909034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b22fd0-3f8f-428c-843c-2de062f4ed6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:10.909844 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b22fd0-3f8f-428c-843c-2de062f4ed6d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:10.910127 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b22fd0-3f8f-428c-843c-2de062f4ed6d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:10.910403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b22fd0-3f8f-428c-843c-2de062f4ed6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:10.911569 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b22fd0-3f8f-428c-843c-2de062f4ed6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:10.914047 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b22fd0-3f8f-428c-843c-2de062f4ed6d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:10.915691 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 559/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:07:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:10.921669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90efdc1-bc31-4262-b0ef-89de8ecdb23b None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:11.022712 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90efdc1-bc31-4262-b0ef-89de8ecdb23b None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:11.057548 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b8fd6-2deb-427e-84f5-91c247d04c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:11.058219 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b8fd6-2deb-427e-84f5-91c247d04c8e None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:11.058504 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b8fd6-2deb-427e-84f5-91c247d04c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:11.058812 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b8fd6-2deb-427e-84f5-91c247d04c8e None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:11.059535 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b8fd6-2deb-427e-84f5-91c247d04c8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:11.060972 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b8fd6-2deb-427e-84f5-91c247d04c8e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:11.082335 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 551/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:07:10 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:07:13.549123 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6dde6-634b-48a0-a5f3-0b96ee882a1a None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:13.549755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6dde6-634b-48a0-a5f3-0b96ee882a1a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:13.549755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6dde6-634b-48a0-a5f3-0b96ee882a1a None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:13.551092 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 560/1111] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:13.557646 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68af291-bda9-4ccc-8b3c-dd3bf186f3b5 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:13.558458 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68af291-bda9-4ccc-8b3c-dd3bf186f3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:13.558617 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68af291-bda9-4ccc-8b3c-dd3bf186f3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:13.576889 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-d68af291-bda9-4ccc-8b3c-dd3bf186f3b5 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:13.578139 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-d68af291-bda9-4ccc-8b3c-dd3bf186f3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:13.650191 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 552/1112] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:07:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:07:13.674491 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6dde6-634b-48a0-a5f3-0b96ee882a1a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:13.778703 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6dde6-634b-48a0-a5f3-0b96ee882a1a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:13.814757 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653d3cc-2534-4d3c-afcb-5d101c55eec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:13.815678 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653d3cc-2534-4d3c-afcb-5d101c55eec6 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:13.816007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653d3cc-2534-4d3c-afcb-5d101c55eec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:13.816331 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653d3cc-2534-4d3c-afcb-5d101c55eec6 None admin] PATH_INFO: `/v3/roles/371a69f4478447a2b7170a3078173caa` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:13.818019 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653d3cc-2534-4d3c-afcb-5d101c55eec6 None admin] RBAC: Authorizing `identity:get_role(role_id=371a69f4478447a2b7170a3078173caa)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:13.820313 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653d3cc-2534-4d3c-afcb-5d101c55eec6 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:13.821887 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 561/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:07:13 2022] GET /identity/v3/roles/371a69f4478447a2b7170a3078173caa => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:13.828703 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68af291-bda9-4ccc-8b3c-dd3bf186f3b5 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:13.934967 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68af291-bda9-4ccc-8b3c-dd3bf186f3b5 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:13.968460 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be45e52-14df-4676-99d1-0dc81a397f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:13.969321 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be45e52-14df-4676-99d1-0dc81a397f7e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:13.969634 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be45e52-14df-4676-99d1-0dc81a397f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:13.969909 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be45e52-14df-4676-99d1-0dc81a397f7e None admin] PATH_INFO: `/v3/users/3fb1d0b434e74a939cc0dd580f26e997` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:13.983128 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be45e52-14df-4676-99d1-0dc81a397f7e None admin] RBAC: Authorizing `identity:get_user(user_id=3fb1d0b434e74a939cc0dd580f26e997)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:13.984560 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be45e52-14df-4676-99d1-0dc81a397f7e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:13.986517 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 553/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:07:13 2022] GET /identity/v3/users/3fb1d0b434e74a939cc0dd580f26e997 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:13.995699 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653d3cc-2534-4d3c-afcb-5d101c55eec6 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:14.097547 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653d3cc-2534-4d3c-afcb-5d101c55eec6 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:14.133584 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6079c-924f-4daf-b64b-04eb41063da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:14.134239 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6079c-924f-4daf-b64b-04eb41063da5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:14.134521 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6079c-924f-4daf-b64b-04eb41063da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:14.134793 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6079c-924f-4daf-b64b-04eb41063da5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:14.207005 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6079c-924f-4daf-b64b-04eb41063da5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:14.208483 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6079c-924f-4daf-b64b-04eb41063da5 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:14.317634 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 562/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:07:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:07:14.324677 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be45e52-14df-4676-99d1-0dc81a397f7e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:14.425135 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be45e52-14df-4676-99d1-0dc81a397f7e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:14.461771 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01419580-34f8-4e37-9a42-28a65ef19d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:14.462646 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01419580-34f8-4e37-9a42-28a65ef19d7b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:14.462930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01419580-34f8-4e37-9a42-28a65ef19d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:14.463207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01419580-34f8-4e37-9a42-28a65ef19d7b None admin] PATH_INFO: `/v3/projects/aae9635eb1ce43119da5a1246eb0b26d` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:14.464421 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01419580-34f8-4e37-9a42-28a65ef19d7b None admin] RBAC: Authorizing `identity:get_project(project_id=aae9635eb1ce43119da5a1246eb0b26d)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:14.465886 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01419580-34f8-4e37-9a42-28a65ef19d7b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:14.467614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 554/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:07:14 2022] GET /identity/v3/projects/aae9635eb1ce43119da5a1246eb0b26d => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:14.474360 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6079c-924f-4daf-b64b-04eb41063da5 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:14.575816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6079c-924f-4daf-b64b-04eb41063da5 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:14.609270 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed8f30-43c7-4a14-b586-9a15a01580f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:14.610205 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed8f30-43c7-4a14-b586-9a15a01580f9 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:14.610487 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed8f30-43c7-4a14-b586-9a15a01580f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:14.610794 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed8f30-43c7-4a14-b586-9a15a01580f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:14.611690 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed8f30-43c7-4a14-b586-9a15a01580f9 None admin] RBAC: Adding query filter params (role.id=371a69f4478447a2b7170a3078173caa, scope.project.id=aae9635eb1ce43119da5a1246eb0b26d, user.id=3fb1d0b434e74a939cc0dd580f26e997) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:14.611917 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed8f30-43c7-4a14-b586-9a15a01580f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:14.613353 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed8f30-43c7-4a14-b586-9a15a01580f9 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:14.619835 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 563/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:07:14 2022] GET /identity/v3/role_assignments?user.id=3fb1d0b434e74a939cc0dd580f26e997&scope.project.id=aae9635eb1ce43119da5a1246eb0b26d&role.id=371a69f4478447a2b7170a3078173caa => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:16.917680 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a125c-5377-4ac0-b11f-eb20b50ed8ff None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:16.918277 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a125c-5377-4ac0-b11f-eb20b50ed8ff None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:16.918277 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a125c-5377-4ac0-b11f-eb20b50ed8ff None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:16.919823 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 555/1118] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:16.925530 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f04f4-b3c3-499d-838c-78430d62a3b0 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:16.926039 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f04f4-b3c3-499d-838c-78430d62a3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:16.926163 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f04f4-b3c3-499d-838c-78430d62a3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:16.945045 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e78f04f4-b3c3-499d-838c-78430d62a3b0 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:16.946277 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e78f04f4-b3c3-499d-838c-78430d62a3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:17.018000 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 564/1119] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:07:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:07:17.041769 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a125c-5377-4ac0-b11f-eb20b50ed8ff None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:17.146761 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a125c-5377-4ac0-b11f-eb20b50ed8ff None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:17.182635 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1491419-19c8-404f-b185-64665e0ccd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:17.183495 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1491419-19c8-404f-b185-64665e0ccd51 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:17.183776 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1491419-19c8-404f-b185-64665e0ccd51 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:17.184049 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1491419-19c8-404f-b185-64665e0ccd51 None admin] PATH_INFO: `/v3/roles/371a69f4478447a2b7170a3078173caa` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:17.185594 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1491419-19c8-404f-b185-64665e0ccd51 None admin] RBAC: Authorizing `identity:get_role(role_id=371a69f4478447a2b7170a3078173caa)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:17.186948 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1491419-19c8-404f-b185-64665e0ccd51 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:17.188354 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 556/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:07:17 2022] GET /identity/v3/roles/371a69f4478447a2b7170a3078173caa => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:07:17.195294 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f04f4-b3c3-499d-838c-78430d62a3b0 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:17.296384 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f04f4-b3c3-499d-838c-78430d62a3b0 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:17.330323 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8ac02-92b8-4c6e-914c-227d5edb9c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:17.331285 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8ac02-92b8-4c6e-914c-227d5edb9c16 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:17.331621 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8ac02-92b8-4c6e-914c-227d5edb9c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:17.331951 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8ac02-92b8-4c6e-914c-227d5edb9c16 None admin] PATH_INFO: `/v3/users/3fb1d0b434e74a939cc0dd580f26e997` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:17.333316 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8ac02-92b8-4c6e-914c-227d5edb9c16 None admin] RBAC: Authorizing `identity:get_user(user_id=3fb1d0b434e74a939cc0dd580f26e997)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:17.335728 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8ac02-92b8-4c6e-914c-227d5edb9c16 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:17.337688 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 565/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:07:17 2022] GET /identity/v3/users/3fb1d0b434e74a939cc0dd580f26e997 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:17.344006 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1491419-19c8-404f-b185-64665e0ccd51 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:17.449237 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1491419-19c8-404f-b185-64665e0ccd51 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:17.492923 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f86a33-07c2-4830-b552-d7accdf4cdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:17.493809 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f86a33-07c2-4830-b552-d7accdf4cdc9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:17.494093 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f86a33-07c2-4830-b552-d7accdf4cdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:17.494367 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f86a33-07c2-4830-b552-d7accdf4cdc9 None admin] PATH_INFO: `/v3/projects/aae9635eb1ce43119da5a1246eb0b26d` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:17.495573 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f86a33-07c2-4830-b552-d7accdf4cdc9 None admin] RBAC: Authorizing `identity:get_project(project_id=aae9635eb1ce43119da5a1246eb0b26d)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:17.496992 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f86a33-07c2-4830-b552-d7accdf4cdc9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:17.498736 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 557/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:07:17 2022] GET /identity/v3/projects/aae9635eb1ce43119da5a1246eb0b26d => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:07:17.504810 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8ac02-92b8-4c6e-914c-227d5edb9c16 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:17.611806 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8ac02-92b8-4c6e-914c-227d5edb9c16 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:17.651905 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25909790-bb2d-422e-911f-d6d01eb9a245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:17.652820 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25909790-bb2d-422e-911f-d6d01eb9a245 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:17.653104 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25909790-bb2d-422e-911f-d6d01eb9a245 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:17.653404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25909790-bb2d-422e-911f-d6d01eb9a245 None admin] PATH_INFO: `/v3/projects/aae9635eb1ce43119da5a1246eb0b26d/users/3fb1d0b434e74a939cc0dd580f26e997/roles/371a69f4478447a2b7170a3078173caa` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:17.656015 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25909790-bb2d-422e-911f-d6d01eb9a245 None admin] RBAC: Authorizing `identity:create_grant(project_id=aae9635eb1ce43119da5a1246eb0b26d, user_id=3fb1d0b434e74a939cc0dd580f26e997, role_id=371a69f4478447a2b7170a3078173caa)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:17.657521 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25909790-bb2d-422e-911f-d6d01eb9a245 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:17.672301 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 566/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:07:17 2022] PUT /identity/v3/projects/aae9635eb1ce43119da5a1246eb0b26d/users/3fb1d0b434e74a939cc0dd580f26e997/roles/371a69f4478447a2b7170a3078173caa => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:07:20.048276 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b78013-e238-4881-b48b-749b732cdf22 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:20.048840 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b78013-e238-4881-b48b-749b732cdf22 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:20.048840 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b78013-e238-4881-b48b-749b732cdf22 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:20.050201 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 558/1124] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:20.056658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c1fe0-6a6d-4216-8c57-938089a758bc None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:20.057159 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c1fe0-6a6d-4216-8c57-938089a758bc None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:20.057253 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c1fe0-6a6d-4216-8c57-938089a758bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:20.074533 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ee2c1fe0-6a6d-4216-8c57-938089a758bc None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:20.075735 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ee2c1fe0-6a6d-4216-8c57-938089a758bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:20.143338 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 567/1125] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:07:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:07:20.168581 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b78013-e238-4881-b48b-749b732cdf22 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:20.270651 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b78013-e238-4881-b48b-749b732cdf22 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:20.304417 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e5db2-0566-4c5a-bf11-110a127d6e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:20.305187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e5db2-0566-4c5a-bf11-110a127d6e59 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:20.305506 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e5db2-0566-4c5a-bf11-110a127d6e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:20.305791 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e5db2-0566-4c5a-bf11-110a127d6e59 None admin] PATH_INFO: `/v3/roles/371a69f4478447a2b7170a3078173caa` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:20.307280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e5db2-0566-4c5a-bf11-110a127d6e59 None admin] RBAC: Authorizing `identity:get_role(role_id=371a69f4478447a2b7170a3078173caa)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:20.308636 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e5db2-0566-4c5a-bf11-110a127d6e59 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:20.310034 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 559/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:07:20 2022] GET /identity/v3/roles/371a69f4478447a2b7170a3078173caa => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:20.315919 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c1fe0-6a6d-4216-8c57-938089a758bc None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:20.420706 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c1fe0-6a6d-4216-8c57-938089a758bc None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:20.455702 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fac570-c792-4d5e-a432-f077a89dabb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:20.456562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fac570-c792-4d5e-a432-f077a89dabb7 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:20.456841 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fac570-c792-4d5e-a432-f077a89dabb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:20.457109 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fac570-c792-4d5e-a432-f077a89dabb7 None admin] PATH_INFO: `/v3/users/3fb1d0b434e74a939cc0dd580f26e997` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:20.458365 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fac570-c792-4d5e-a432-f077a89dabb7 None admin] RBAC: Authorizing `identity:get_user(user_id=3fb1d0b434e74a939cc0dd580f26e997)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:20.460291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fac570-c792-4d5e-a432-f077a89dabb7 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:20.462025 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 568/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:07:20 2022] GET /identity/v3/users/3fb1d0b434e74a939cc0dd580f26e997 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:20.467907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e5db2-0566-4c5a-bf11-110a127d6e59 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:20.580266 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e5db2-0566-4c5a-bf11-110a127d6e59 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:20.625575 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df30fb-fb1d-4cf0-bee2-7a5dac352b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:20.626352 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df30fb-fb1d-4cf0-bee2-7a5dac352b6f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:20.626717 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df30fb-fb1d-4cf0-bee2-7a5dac352b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:20.627078 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df30fb-fb1d-4cf0-bee2-7a5dac352b6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:20.698376 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df30fb-fb1d-4cf0-bee2-7a5dac352b6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:20.699860 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df30fb-fb1d-4cf0-bee2-7a5dac352b6f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:20.800819 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 560/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:07:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:07:20.810044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fac570-c792-4d5e-a432-f077a89dabb7 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:20.909481 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fac570-c792-4d5e-a432-f077a89dabb7 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:20.942662 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa41e60-c85b-48c6-853d-5ce6e2310268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:20.944115 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa41e60-c85b-48c6-853d-5ce6e2310268 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:20.944387 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa41e60-c85b-48c6-853d-5ce6e2310268 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:20.944658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa41e60-c85b-48c6-853d-5ce6e2310268 None admin] PATH_INFO: `/v3/projects/aae9635eb1ce43119da5a1246eb0b26d` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:20.945860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa41e60-c85b-48c6-853d-5ce6e2310268 None admin] RBAC: Authorizing `identity:get_project(project_id=aae9635eb1ce43119da5a1246eb0b26d)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:20.947304 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa41e60-c85b-48c6-853d-5ce6e2310268 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:20.949012 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 569/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:07:20 2022] GET /identity/v3/projects/aae9635eb1ce43119da5a1246eb0b26d => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:20.955457 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df30fb-fb1d-4cf0-bee2-7a5dac352b6f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:21.060836 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df30fb-fb1d-4cf0-bee2-7a5dac352b6f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:21.100362 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636602d-04b9-475e-88f4-0330ca8240c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:21.101085 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636602d-04b9-475e-88f4-0330ca8240c3 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:21.101454 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636602d-04b9-475e-88f4-0330ca8240c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:21.101772 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636602d-04b9-475e-88f4-0330ca8240c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:21.102677 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636602d-04b9-475e-88f4-0330ca8240c3 None admin] RBAC: Adding query filter params (role.id=371a69f4478447a2b7170a3078173caa, scope.project.id=aae9635eb1ce43119da5a1246eb0b26d, user.id=3fb1d0b434e74a939cc0dd580f26e997) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:21.103028 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636602d-04b9-475e-88f4-0330ca8240c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:21.104549 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636602d-04b9-475e-88f4-0330ca8240c3 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:21.111517 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 561/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:07:20 2022] GET /identity/v3/role_assignments?user.id=3fb1d0b434e74a939cc0dd580f26e997&scope.project.id=aae9635eb1ce43119da5a1246eb0b26d&role.id=371a69f4478447a2b7170a3078173caa => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:23.437624 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07573f63-5e27-4df9-82bc-c463f9fb67df None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:23.438169 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07573f63-5e27-4df9-82bc-c463f9fb67df None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:23.438279 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07573f63-5e27-4df9-82bc-c463f9fb67df None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:23.439650 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 570/1131] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:23.444983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddf948-f12b-4c64-b0c7-8aae963855f7 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:23.445451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddf948-f12b-4c64-b0c7-8aae963855f7 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:23.445556 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddf948-f12b-4c64-b0c7-8aae963855f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:23.462983 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-9bddf948-f12b-4c64-b0c7-8aae963855f7 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:23.464146 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-9bddf948-f12b-4c64-b0c7-8aae963855f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:23.530231 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 562/1132] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:07:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:07:23.553349 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07573f63-5e27-4df9-82bc-c463f9fb67df None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:23.653677 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07573f63-5e27-4df9-82bc-c463f9fb67df None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:23.686229 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4196268-ab2b-4e23-82fb-a57c3bb5aa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:23.687015 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4196268-ab2b-4e23-82fb-a57c3bb5aa07 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:23.687297 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4196268-ab2b-4e23-82fb-a57c3bb5aa07 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:23.687572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4196268-ab2b-4e23-82fb-a57c3bb5aa07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:23.688733 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4196268-ab2b-4e23-82fb-a57c3bb5aa07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:23.690187 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4196268-ab2b-4e23-82fb-a57c3bb5aa07 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:23.691794 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 571/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:07:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:23.698363 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bddf948-f12b-4c64-b0c7-8aae963855f7 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:23.791540 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bddf948-f12b-4c64-b0c7-8aae963855f7 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:23.823701 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40291a-c0b6-40ec-bb1b-c33490aabb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:23.824350 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40291a-c0b6-40ec-bb1b-c33490aabb2e None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:23.824629 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40291a-c0b6-40ec-bb1b-c33490aabb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:23.824902 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40291a-c0b6-40ec-bb1b-c33490aabb2e None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:23.825696 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40291a-c0b6-40ec-bb1b-c33490aabb2e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:23.827099 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40291a-c0b6-40ec-bb1b-c33490aabb2e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:23.852291 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 563/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:07:23 2022] POST /identity/v3/projects => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:07:26.235543 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded7fac-579b-4cc7-ad75-e7afe20f89b5 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:26.236104 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded7fac-579b-4cc7-ad75-e7afe20f89b5 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:26.236104 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded7fac-579b-4cc7-ad75-e7afe20f89b5 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:26.237465 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 572/1135] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:26.243546 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f58ea-6a15-4f60-a8d4-03a2344a8a0f None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:26.243972 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f58ea-6a15-4f60-a8d4-03a2344a8a0f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:26.244105 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f58ea-6a15-4f60-a8d4-03a2344a8a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:26.261637 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-988f58ea-6a15-4f60-a8d4-03a2344a8a0f None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:26.262823 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-988f58ea-6a15-4f60-a8d4-03a2344a8a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:26.330086 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 564/1136] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:07:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:07:26.356487 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded7fac-579b-4cc7-ad75-e7afe20f89b5 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:26.454000 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded7fac-579b-4cc7-ad75-e7afe20f89b5 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:26.485989 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d9169-cfa0-490e-ac86-df7197b4dd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:26.486698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d9169-cfa0-490e-ac86-df7197b4dd4e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:26.486975 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d9169-cfa0-490e-ac86-df7197b4dd4e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:26.487253 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d9169-cfa0-490e-ac86-df7197b4dd4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:26.488436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d9169-cfa0-490e-ac86-df7197b4dd4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:26.490415 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d9169-cfa0-490e-ac86-df7197b4dd4e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:26.492504 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 573/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:07:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:26.498753 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f58ea-6a15-4f60-a8d4-03a2344a8a0f None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:26.593397 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f58ea-6a15-4f60-a8d4-03a2344a8a0f None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:26.636161 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4b77c-23c1-4509-8aaf-6f00110dcc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:26.636836 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4b77c-23c1-4509-8aaf-6f00110dcc52 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:26.637451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4b77c-23c1-4509-8aaf-6f00110dcc52 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:26.637451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4b77c-23c1-4509-8aaf-6f00110dcc52 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:26.638107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4b77c-23c1-4509-8aaf-6f00110dcc52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:26.639539 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4b77c-23c1-4509-8aaf-6f00110dcc52 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:26.663453 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 565/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:07:26 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:07:28.985838 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d600d-af11-4d70-af41-11884c0a322d None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:28.986435 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d600d-af11-4d70-af41-11884c0a322d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:28.986435 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d600d-af11-4d70-af41-11884c0a322d None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:28.987785 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 574/1139] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:28.994660 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7418b5-c93b-4c23-92a2-23aef4aae1e4 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:28.995215 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7418b5-c93b-4c23-92a2-23aef4aae1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:28.995215 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7418b5-c93b-4c23-92a2-23aef4aae1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:29.014567 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-bd7418b5-c93b-4c23-92a2-23aef4aae1e4 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:29.015799 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-bd7418b5-c93b-4c23-92a2-23aef4aae1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:29.090550 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 566/1140] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:07:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:07:29.116244 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d600d-af11-4d70-af41-11884c0a322d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:29.223780 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d600d-af11-4d70-af41-11884c0a322d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:29.258907 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66cc0d-900e-49b0-a79b-8f568db6424d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:29.259599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66cc0d-900e-49b0-a79b-8f568db6424d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:29.259878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66cc0d-900e-49b0-a79b-8f568db6424d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:29.260145 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66cc0d-900e-49b0-a79b-8f568db6424d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:29.270284 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66cc0d-900e-49b0-a79b-8f568db6424d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:07:29.278555 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-db66cc0d-900e-49b0-a79b-8f568db6424d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:07:29.278555 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:07:29.278555 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:07:29.278555 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:07:29.278555 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:07:29.278555 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:07:29.278555 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:07:29.278555 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:07:29.278555 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:07:29.278555 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:07:29.278555 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:07:29.278555 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:07:29.278555 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:07:29.278555 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:07:29.278555 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:07:29.278555 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:07:29.280497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:07:29.280497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:07:29.280497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:07:29.280497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:07:29.280497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:07:29.280497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:07:29.280497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:07:29.280497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:07:29.280497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:07:29.280497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:07:29.280497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:07:29.280497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:07:29.280497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:07:29.280497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:07:29.280497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:07:29.280497 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:07:29.282304 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:07:29.282304 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:07:29.282304 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:07:29.282304 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:07:29.282304 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:07:29.282304 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:07:29.282304 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:07:29.282304 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:07:29.282304 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:07:29.282304 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:07:29.282304 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:07:29.282304 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:07:29.282304 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 575/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:07:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:07:29.286358 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7418b5-c93b-4c23-92a2-23aef4aae1e4 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:29.385021 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7418b5-c93b-4c23-92a2-23aef4aae1e4 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:29.420879 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832ecbb-1edc-469b-9642-2c8acd3f1c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:29.421588 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832ecbb-1edc-469b-9642-2c8acd3f1c87 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:29.421875 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832ecbb-1edc-469b-9642-2c8acd3f1c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:29.422158 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832ecbb-1edc-469b-9642-2c8acd3f1c87 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:29.422930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832ecbb-1edc-469b-9642-2c8acd3f1c87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:29.423232 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832ecbb-1edc-469b-9642-2c8acd3f1c87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:29.424650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832ecbb-1edc-469b-9642-2c8acd3f1c87 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:29.434517 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 567/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:07:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:29.440445 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66cc0d-900e-49b0-a79b-8f568db6424d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:29.546637 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66cc0d-900e-49b0-a79b-8f568db6424d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:29.584996 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1faa5-f276-4ebc-bb47-3d5ff080045a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:29.585907 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1faa5-f276-4ebc-bb47-3d5ff080045a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:29.586189 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1faa5-f276-4ebc-bb47-3d5ff080045a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:29.586465 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1faa5-f276-4ebc-bb47-3d5ff080045a None admin] PATH_INFO: `/v3/users/edb1d6244ebf484e9c7187e2f62580fd` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:29.600521 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1faa5-f276-4ebc-bb47-3d5ff080045a None admin] RBAC: Authorizing `identity:get_user(user_id=edb1d6244ebf484e9c7187e2f62580fd)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:29.602008 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1faa5-f276-4ebc-bb47-3d5ff080045a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:29.603723 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 576/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:07:29 2022] GET /identity/v3/users/edb1d6244ebf484e9c7187e2f62580fd => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:07:29.609613 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832ecbb-1edc-469b-9642-2c8acd3f1c87 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:29.710009 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832ecbb-1edc-469b-9642-2c8acd3f1c87 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:29.744436 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94e9e1-81d3-47b9-957a-98c0b58c84c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:29.745182 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94e9e1-81d3-47b9-957a-98c0b58c84c4 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:29.746179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94e9e1-81d3-47b9-957a-98c0b58c84c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:29.746179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94e9e1-81d3-47b9-957a-98c0b58c84c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:29.817206 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94e9e1-81d3-47b9-957a-98c0b58c84c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:29.818689 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94e9e1-81d3-47b9-957a-98c0b58c84c4 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:29.916171 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 568/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:07:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:07:29.922300 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1faa5-f276-4ebc-bb47-3d5ff080045a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:30.046159 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1faa5-f276-4ebc-bb47-3d5ff080045a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:30.081541 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588dbb3-3e31-4110-99d9-71f9f54c657a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:30.082314 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588dbb3-3e31-4110-99d9-71f9f54c657a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:30.082597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588dbb3-3e31-4110-99d9-71f9f54c657a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:30.082873 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588dbb3-3e31-4110-99d9-71f9f54c657a None admin] PATH_INFO: `/v3/projects/55263aac5a2542b1906cffe94b96add7` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:30.084108 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588dbb3-3e31-4110-99d9-71f9f54c657a None admin] RBAC: Authorizing `identity:get_project(project_id=55263aac5a2542b1906cffe94b96add7)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:30.085699 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588dbb3-3e31-4110-99d9-71f9f54c657a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:30.087408 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 577/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:07:29 2022] GET /identity/v3/projects/55263aac5a2542b1906cffe94b96add7 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:30.093608 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94e9e1-81d3-47b9-957a-98c0b58c84c4 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:30.196419 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94e9e1-81d3-47b9-957a-98c0b58c84c4 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:30.231273 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409f2b0-9274-4a16-ba6b-11318ea822f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:30.231929 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409f2b0-9274-4a16-ba6b-11318ea822f9 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:30.232216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409f2b0-9274-4a16-ba6b-11318ea822f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:30.232496 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409f2b0-9274-4a16-ba6b-11318ea822f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:30.233332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409f2b0-9274-4a16-ba6b-11318ea822f9 None admin] RBAC: Adding query filter params (role.id=3409f00ead9e455182684faa27b1f8f0, scope.project.id=55263aac5a2542b1906cffe94b96add7, user.id=edb1d6244ebf484e9c7187e2f62580fd) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:30.233679 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409f2b0-9274-4a16-ba6b-11318ea822f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:30.235355 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409f2b0-9274-4a16-ba6b-11318ea822f9 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:30.241343 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 569/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:07:30 2022] GET /identity/v3/role_assignments?user.id=edb1d6244ebf484e9c7187e2f62580fd&scope.project.id=55263aac5a2542b1906cffe94b96add7&role.id=3409f00ead9e455182684faa27b1f8f0 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:32.590348 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c97ba5-6f1e-4c5c-9a00-21b1c5a90eb4 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:32.591083 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c97ba5-6f1e-4c5c-9a00-21b1c5a90eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:32.591083 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c97ba5-6f1e-4c5c-9a00-21b1c5a90eb4 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:32.592252 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 578/1147] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:32.599412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e68e4-b803-4b18-a4ae-e204e0c3631d None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:32.599941 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e68e4-b803-4b18-a4ae-e204e0c3631d None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:32.599941 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e68e4-b803-4b18-a4ae-e204e0c3631d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:32.620699 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-b86e68e4-b803-4b18-a4ae-e204e0c3631d None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:32.622318 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-b86e68e4-b803-4b18-a4ae-e204e0c3631d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:32.691498 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 570/1148] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:07:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:07:32.714874 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c97ba5-6f1e-4c5c-9a00-21b1c5a90eb4 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:32.813998 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c97ba5-6f1e-4c5c-9a00-21b1c5a90eb4 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:32.848090 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be8988-1b95-4875-a83d-cd3ee95a7e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:32.848865 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be8988-1b95-4875-a83d-cd3ee95a7e6d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:32.849170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be8988-1b95-4875-a83d-cd3ee95a7e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:32.849460 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be8988-1b95-4875-a83d-cd3ee95a7e6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:32.860482 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be8988-1b95-4875-a83d-cd3ee95a7e6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:07:32.868602 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-48be8988-1b95-4875-a83d-cd3ee95a7e6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:07:32.868602 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:07:32.868602 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:07:32.868602 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:07:32.868602 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:07:32.868602 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:07:32.868602 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:07:32.868602 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:07:32.868602 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:07:32.868602 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:07:32.868602 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:07:32.868602 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:07:32.868602 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:07:32.868602 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:07:32.868602 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:07:32.868602 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:07:32.870514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:07:32.870514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:07:32.870514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:07:32.870514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:07:32.870514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:07:32.870514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:07:32.870514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:07:32.870514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:07:32.870514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:07:32.870514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:07:32.870514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:07:32.870514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:07:32.870514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:07:32.870514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:07:32.870514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:07:32.870514 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:07:32.872204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:07:32.872204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:07:32.872204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:07:32.872204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:07:32.872204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:07:32.872204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:07:32.872204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:07:32.872204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:07:32.872204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:07:32.872204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:07:32.872204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:07:32.872204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:07:32.872204 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 579/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:07:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:07:32.876021 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e68e4-b803-4b18-a4ae-e204e0c3631d None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:32.979018 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e68e4-b803-4b18-a4ae-e204e0c3631d None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:33.011985 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd52ba-abf4-4c05-99c6-54887e923248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:33.012643 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd52ba-abf4-4c05-99c6-54887e923248 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:33.012921 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd52ba-abf4-4c05-99c6-54887e923248 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:33.013193 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd52ba-abf4-4c05-99c6-54887e923248 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:33.013963 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd52ba-abf4-4c05-99c6-54887e923248 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:33.014266 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd52ba-abf4-4c05-99c6-54887e923248 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:33.015609 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd52ba-abf4-4c05-99c6-54887e923248 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:33.028384 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 571/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:07:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:33.034379 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be8988-1b95-4875-a83d-cd3ee95a7e6d None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:33.143214 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be8988-1b95-4875-a83d-cd3ee95a7e6d None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:33.176622 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a6c05-7687-4541-9c94-aede31c6103a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:33.178012 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a6c05-7687-4541-9c94-aede31c6103a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:33.178347 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a6c05-7687-4541-9c94-aede31c6103a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:33.178619 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a6c05-7687-4541-9c94-aede31c6103a None admin] PATH_INFO: `/v3/users/edb1d6244ebf484e9c7187e2f62580fd` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:33.179819 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a6c05-7687-4541-9c94-aede31c6103a None admin] RBAC: Authorizing `identity:get_user(user_id=edb1d6244ebf484e9c7187e2f62580fd)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:33.181238 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a6c05-7687-4541-9c94-aede31c6103a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:33.182886 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 580/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:07:33 2022] GET /identity/v3/users/edb1d6244ebf484e9c7187e2f62580fd => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:33.188672 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd52ba-abf4-4c05-99c6-54887e923248 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:33.289408 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd52ba-abf4-4c05-99c6-54887e923248 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:33.322322 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264ff2f-7484-41a0-891c-cb225f7d853c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:33.323178 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264ff2f-7484-41a0-891c-cb225f7d853c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:33.323459 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264ff2f-7484-41a0-891c-cb225f7d853c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:33.323739 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264ff2f-7484-41a0-891c-cb225f7d853c None admin] PATH_INFO: `/v3/projects/55263aac5a2542b1906cffe94b96add7` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:33.324902 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264ff2f-7484-41a0-891c-cb225f7d853c None admin] RBAC: Authorizing `identity:get_project(project_id=55263aac5a2542b1906cffe94b96add7)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:33.326349 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264ff2f-7484-41a0-891c-cb225f7d853c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:33.328035 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 572/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:07:33 2022] GET /identity/v3/projects/55263aac5a2542b1906cffe94b96add7 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:33.334479 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a6c05-7687-4541-9c94-aede31c6103a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:33.440875 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a6c05-7687-4541-9c94-aede31c6103a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:33.473256 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f9665-80d2-49cd-8c81-9e74d986fc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:33.474194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f9665-80d2-49cd-8c81-9e74d986fc76 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:33.474591 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f9665-80d2-49cd-8c81-9e74d986fc76 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:33.475164 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f9665-80d2-49cd-8c81-9e74d986fc76 None admin] PATH_INFO: `/v3/projects/55263aac5a2542b1906cffe94b96add7/users/edb1d6244ebf484e9c7187e2f62580fd/roles/3409f00ead9e455182684faa27b1f8f0` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:33.477068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f9665-80d2-49cd-8c81-9e74d986fc76 None admin] RBAC: Authorizing `identity:create_grant(project_id=55263aac5a2542b1906cffe94b96add7, user_id=edb1d6244ebf484e9c7187e2f62580fd, role_id=3409f00ead9e455182684faa27b1f8f0)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:33.478557 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f9665-80d2-49cd-8c81-9e74d986fc76 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:33.493761 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 581/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:07:33 2022] PUT /identity/v3/projects/55263aac5a2542b1906cffe94b96add7/users/edb1d6244ebf484e9c7187e2f62580fd/roles/3409f00ead9e455182684faa27b1f8f0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:07:35.804225 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbb387-3aa1-476b-a436-52b765800683 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:35.804789 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbb387-3aa1-476b-a436-52b765800683 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:35.804789 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbb387-3aa1-476b-a436-52b765800683 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:35.806161 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 573/1154] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:07:35.811427 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc7ed1-338f-4569-97d8-ecbaadae99c2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:35.811815 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc7ed1-338f-4569-97d8-ecbaadae99c2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:35.811983 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc7ed1-338f-4569-97d8-ecbaadae99c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:35.829365 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-2bbc7ed1-338f-4569-97d8-ecbaadae99c2 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:35.830583 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2bbc7ed1-338f-4569-97d8-ecbaadae99c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:35.898004 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 582/1155] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:07:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:07:35.922190 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbb387-3aa1-476b-a436-52b765800683 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:36.023230 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbb387-3aa1-476b-a436-52b765800683 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:36.058153 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758bdde-0c59-4a29-b195-59e03330bc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:36.058885 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758bdde-0c59-4a29-b195-59e03330bc29 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:36.059166 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758bdde-0c59-4a29-b195-59e03330bc29 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:36.059438 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758bdde-0c59-4a29-b195-59e03330bc29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:36.072499 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758bdde-0c59-4a29-b195-59e03330bc29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:07:36.080331 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-3758bdde-0c59-4a29-b195-59e03330bc29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:07:36.080331 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:07:36.080331 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:07:36.080331 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:07:36.080331 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:07:36.080331 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:07:36.080331 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:07:36.080331 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:07:36.080331 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:07:36.080331 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:07:36.080331 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:07:36.080331 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:07:36.080331 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:07:36.080331 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:07:36.080331 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:07:36.080331 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:07:36.081557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:07:36.081557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:07:36.081557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:07:36.081557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:07:36.081557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:07:36.081557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:07:36.081557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:07:36.081557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:07:36.081557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:07:36.081557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:07:36.081557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:07:36.081557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:07:36.081557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:07:36.081557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:07:36.081557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:07:36.081557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:07:36.082629 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:07:36.082629 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:07:36.082629 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:07:36.082629 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:07:36.082629 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:07:36.082629 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:07:36.082629 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:07:36.082629 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:07:36.082629 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:07:36.082629 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:07:36.082629 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:07:36.082629 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:07:36.082629 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 574/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:07:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:07:36.088565 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc7ed1-338f-4569-97d8-ecbaadae99c2 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:36.184847 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc7ed1-338f-4569-97d8-ecbaadae99c2 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:36.218622 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cd1a5-316c-43b6-898d-4d30cf6c9504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:36.219293 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cd1a5-316c-43b6-898d-4d30cf6c9504 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:36.219579 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cd1a5-316c-43b6-898d-4d30cf6c9504 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:36.219854 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cd1a5-316c-43b6-898d-4d30cf6c9504 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:36.220607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cd1a5-316c-43b6-898d-4d30cf6c9504 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:36.220914 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cd1a5-316c-43b6-898d-4d30cf6c9504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:36.222310 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cd1a5-316c-43b6-898d-4d30cf6c9504 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:36.231697 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 583/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:07:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:36.237907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758bdde-0c59-4a29-b195-59e03330bc29 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:36.338320 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758bdde-0c59-4a29-b195-59e03330bc29 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:36.372549 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87effc6a-18ff-4f1a-9870-62b98a9bd39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:36.373438 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87effc6a-18ff-4f1a-9870-62b98a9bd39b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:36.373727 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87effc6a-18ff-4f1a-9870-62b98a9bd39b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:36.374012 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87effc6a-18ff-4f1a-9870-62b98a9bd39b None admin] PATH_INFO: `/v3/users/edb1d6244ebf484e9c7187e2f62580fd` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:36.375199 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87effc6a-18ff-4f1a-9870-62b98a9bd39b None admin] RBAC: Authorizing `identity:get_user(user_id=edb1d6244ebf484e9c7187e2f62580fd)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:36.376621 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87effc6a-18ff-4f1a-9870-62b98a9bd39b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:36.378307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 575/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:07:36 2022] GET /identity/v3/users/edb1d6244ebf484e9c7187e2f62580fd => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:36.384213 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cd1a5-316c-43b6-898d-4d30cf6c9504 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:36.482949 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cd1a5-316c-43b6-898d-4d30cf6c9504 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:36.518419 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6569f-36b9-45f8-8416-052207237917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:36.519075 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6569f-36b9-45f8-8416-052207237917 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:36.519363 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6569f-36b9-45f8-8416-052207237917 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:36.519641 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6569f-36b9-45f8-8416-052207237917 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:36.587282 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6569f-36b9-45f8-8416-052207237917 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:36.588799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6569f-36b9-45f8-8416-052207237917 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:36.691552 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 584/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:07:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:07:36.697622 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87effc6a-18ff-4f1a-9870-62b98a9bd39b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:36.793831 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87effc6a-18ff-4f1a-9870-62b98a9bd39b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:36.826870 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5919dc-a305-4d0c-a692-992ab5a0273f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:36.827721 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5919dc-a305-4d0c-a692-992ab5a0273f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:36.828009 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5919dc-a305-4d0c-a692-992ab5a0273f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:36.828288 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5919dc-a305-4d0c-a692-992ab5a0273f None admin] PATH_INFO: `/v3/projects/55263aac5a2542b1906cffe94b96add7` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:36.829486 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5919dc-a305-4d0c-a692-992ab5a0273f None admin] RBAC: Authorizing `identity:get_project(project_id=55263aac5a2542b1906cffe94b96add7)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:36.830909 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5919dc-a305-4d0c-a692-992ab5a0273f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:36.832597 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 576/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:07:36 2022] GET /identity/v3/projects/55263aac5a2542b1906cffe94b96add7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:36.839174 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6569f-36b9-45f8-8416-052207237917 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:36.940709 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6569f-36b9-45f8-8416-052207237917 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:36.973946 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be5021-7034-4ab9-8a00-99843746df07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:36.975455 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be5021-7034-4ab9-8a00-99843746df07 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:36.975807 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be5021-7034-4ab9-8a00-99843746df07 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:36.976090 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be5021-7034-4ab9-8a00-99843746df07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:36.976926 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be5021-7034-4ab9-8a00-99843746df07 None admin] RBAC: Adding query filter params (role.id=3409f00ead9e455182684faa27b1f8f0, scope.project.id=55263aac5a2542b1906cffe94b96add7, user.id=edb1d6244ebf484e9c7187e2f62580fd) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:36.977241 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be5021-7034-4ab9-8a00-99843746df07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:36.978699 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be5021-7034-4ab9-8a00-99843746df07 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:36.984627 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 585/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:07:36 2022] GET /identity/v3/role_assignments?user.id=edb1d6244ebf484e9c7187e2f62580fd&scope.project.id=55263aac5a2542b1906cffe94b96add7&role.id=3409f00ead9e455182684faa27b1f8f0 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:39.330241 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee32ea-4e5c-4f22-8b37-857be1c016a3 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:39.330792 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee32ea-4e5c-4f22-8b37-857be1c016a3 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:39.330792 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee32ea-4e5c-4f22-8b37-857be1c016a3 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:39.332125 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 577/1162] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:39.338021 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4bffd-d7e0-43c0-a6aa-ee1e9ababce9 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:39.338483 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4bffd-d7e0-43c0-a6aa-ee1e9ababce9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:39.338590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4bffd-d7e0-43c0-a6aa-ee1e9ababce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:39.356479 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-38b4bffd-d7e0-43c0-a6aa-ee1e9ababce9 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:39.357715 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-38b4bffd-d7e0-43c0-a6aa-ee1e9ababce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:39.425856 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 586/1163] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:07:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:07:39.448932 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee32ea-4e5c-4f22-8b37-857be1c016a3 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:39.551588 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee32ea-4e5c-4f22-8b37-857be1c016a3 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:39.585877 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d2e55-acd8-48d4-a80d-ad6ab9c59483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:39.586452 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d2e55-acd8-48d4-a80d-ad6ab9c59483 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:39.586735 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d2e55-acd8-48d4-a80d-ad6ab9c59483 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:39.587009 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d2e55-acd8-48d4-a80d-ad6ab9c59483 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:39.663505 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d2e55-acd8-48d4-a80d-ad6ab9c59483 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:39.664952 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d2e55-acd8-48d4-a80d-ad6ab9c59483 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:39.763930 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 578/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:07:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:07:39.770301 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4bffd-d7e0-43c0-a6aa-ee1e9ababce9 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:39.867529 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4bffd-d7e0-43c0-a6aa-ee1e9ababce9 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:39.902352 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bf8be-2f19-4f09-8def-9acc74bc126f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:39.903148 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bf8be-2f19-4f09-8def-9acc74bc126f None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:39.903429 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bf8be-2f19-4f09-8def-9acc74bc126f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:39.903698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bf8be-2f19-4f09-8def-9acc74bc126f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:39.910245 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8bf8be-2f19-4f09-8def-9acc74bc126f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:39.912202 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8bf8be-2f19-4f09-8def-9acc74bc126f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:39.925939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-5c8bf8be-2f19-4f09-8def-9acc74bc126f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 09 15:07:39.925939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:07:39.925939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 09 15:07:39.925939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 09 15:07:39.925939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:07:39.925939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:07:39.925939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:07:39.925939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:07:39.925939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 09 15:07:39.925939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:07:39.925939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:07:39.925939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:07:39.925939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:07:39.925939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:07:39.925939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:07:39.925939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:07:39.925939 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:07:39.928062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:07:39.928062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:07:39.928062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:07:39.928062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:07:39.928062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:07:39.928062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:07:39.928062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:07:39.928062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:07:39.928062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:07:39.928062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:07:39.928062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:07:39.928062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:07:39.928062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:07:39.928062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:07:39.928062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:07:39.928062 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:07:39.929334 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:07:39.929334 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:07:39.929334 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:07:39.929334 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:07:39.929334 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:07:39.929334 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:07:39.929334 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:07:39.929334 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:07:39.929334 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:07:39.929334 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:07:39.929334 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 09 15:07:39.929334 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:07:39.929334 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 09 15:07:39.929334 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:07:39.929334 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 587/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:07:39 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:07:39.933846 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d2e55-acd8-48d4-a80d-ad6ab9c59483 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:40.028554 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d2e55-acd8-48d4-a80d-ad6ab9c59483 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:40.083754 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa662ae-2d9d-48e8-999d-bb912845021d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:40.084740 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa662ae-2d9d-48e8-999d-bb912845021d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:40.084740 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa662ae-2d9d-48e8-999d-bb912845021d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:40.084975 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa662ae-2d9d-48e8-999d-bb912845021d None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:40.085725 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa662ae-2d9d-48e8-999d-bb912845021d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:40.086032 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa662ae-2d9d-48e8-999d-bb912845021d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:40.087380 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa662ae-2d9d-48e8-999d-bb912845021d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:40.094677 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 579/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:07:39 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:42.454616 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dce641-5daa-4d37-acc3-3b3cf7e66aa1 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:42.455140 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dce641-5daa-4d37-acc3-3b3cf7e66aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:42.455140 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dce641-5daa-4d37-acc3-3b3cf7e66aa1 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:42.456541 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 588/1167] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:42.462590 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fef77b-18d7-4012-a2ba-5c6a8bb43064 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:42.463044 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fef77b-18d7-4012-a2ba-5c6a8bb43064 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:42.463149 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fef77b-18d7-4012-a2ba-5c6a8bb43064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:42.479580 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-a9fef77b-18d7-4012-a2ba-5c6a8bb43064 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:42.480759 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a9fef77b-18d7-4012-a2ba-5c6a8bb43064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:42.547086 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 580/1168] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:07:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:07:42.570286 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dce641-5daa-4d37-acc3-3b3cf7e66aa1 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:42.668639 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dce641-5daa-4d37-acc3-3b3cf7e66aa1 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:42.700506 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb78276-1a4c-4c62-b9be-33bc2af18f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:42.701151 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb78276-1a4c-4c62-b9be-33bc2af18f8f None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:42.701454 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb78276-1a4c-4c62-b9be-33bc2af18f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:42.701725 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb78276-1a4c-4c62-b9be-33bc2af18f8f None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:42.702453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb78276-1a4c-4c62-b9be-33bc2af18f8f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:42.703798 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb78276-1a4c-4c62-b9be-33bc2af18f8f None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:42.718369 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 589/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Mon May 9 15:07:42 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:07:45.055573 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0885076-8c2e-4317-b11b-fb4ddca524f2 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:45.056243 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0885076-8c2e-4317-b11b-fb4ddca524f2 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:45.056571 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0885076-8c2e-4317-b11b-fb4ddca524f2 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:45.058261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 581/1170] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:07:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:45.063911 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722256ef-cf25-49e2-888c-f87349b675be None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:45.064346 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722256ef-cf25-49e2-888c-f87349b675be None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:45.064449 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722256ef-cf25-49e2-888c-f87349b675be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:45.081248 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-722256ef-cf25-49e2-888c-f87349b675be None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:45.082460 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-722256ef-cf25-49e2-888c-f87349b675be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:45.148174 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 590/1171] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:07:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:07:45.172402 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0885076-8c2e-4317-b11b-fb4ddca524f2 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:45.273017 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0885076-8c2e-4317-b11b-fb4ddca524f2 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:45.306334 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b88e3-c14d-495a-ab1b-8ae805176c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:45.307106 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b88e3-c14d-495a-ab1b-8ae805176c93 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:45.307387 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b88e3-c14d-495a-ab1b-8ae805176c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:45.307662 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b88e3-c14d-495a-ab1b-8ae805176c93 None admin] PATH_INFO: `/v3/domains/55f15bf27ce144229aef735367088448` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:45.317855 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b88e3-c14d-495a-ab1b-8ae805176c93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=55f15bf27ce144229aef735367088448)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:45.319284 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b88e3-c14d-495a-ab1b-8ae805176c93 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:45.320919 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 582/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Mon May 9 15:07:45 2022] GET /identity/v3/domains/55f15bf27ce144229aef735367088448 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:45.327120 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722256ef-cf25-49e2-888c-f87349b675be None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:45.422085 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722256ef-cf25-49e2-888c-f87349b675be None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:45.456990 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ea4eb-62b8-4a31-9dff-907caceb9efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:45.457682 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ea4eb-62b8-4a31-9dff-907caceb9efa None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:45.457962 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ea4eb-62b8-4a31-9dff-907caceb9efa None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:45.459438 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ea4eb-62b8-4a31-9dff-907caceb9efa None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:45.459438 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ea4eb-62b8-4a31-9dff-907caceb9efa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:45.460758 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ea4eb-62b8-4a31-9dff-907caceb9efa None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:45.487458 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 591/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:07:45 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:07:47.858290 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b95c26-05eb-4390-a2c8-d8800a950c5e None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:47.858825 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b95c26-05eb-4390-a2c8-d8800a950c5e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:47.858825 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b95c26-05eb-4390-a2c8-d8800a950c5e None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:47.860456 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 583/1174] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:47.866403 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb62d6-6fdf-4408-adbb-00b3b30b0378 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:47.866897 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb62d6-6fdf-4408-adbb-00b3b30b0378 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:47.867002 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb62d6-6fdf-4408-adbb-00b3b30b0378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:47.883745 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-92cb62d6-6fdf-4408-adbb-00b3b30b0378 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:47.884949 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-92cb62d6-6fdf-4408-adbb-00b3b30b0378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:47.950803 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 592/1175] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:07:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:07:47.977099 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b95c26-05eb-4390-a2c8-d8800a950c5e None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:48.076681 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b95c26-05eb-4390-a2c8-d8800a950c5e None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:48.116443 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3e7ad-3274-4211-a8e7-d8d5aa8cbc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:48.117234 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3e7ad-3274-4211-a8e7-d8d5aa8cbc7a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:48.117548 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3e7ad-3274-4211-a8e7-d8d5aa8cbc7a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:48.117826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3e7ad-3274-4211-a8e7-d8d5aa8cbc7a None admin] PATH_INFO: `/v3/domains/55f15bf27ce144229aef735367088448` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:48.119087 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3e7ad-3274-4211-a8e7-d8d5aa8cbc7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=55f15bf27ce144229aef735367088448)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:48.120531 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3e7ad-3274-4211-a8e7-d8d5aa8cbc7a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:48.122237 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 584/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Mon May 9 15:07:47 2022] GET /identity/v3/domains/55f15bf27ce144229aef735367088448 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:48.128185 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb62d6-6fdf-4408-adbb-00b3b30b0378 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:48.229562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb62d6-6fdf-4408-adbb-00b3b30b0378 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:48.265903 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6399fd-5e66-4cf5-a6e1-e041fcc22fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:48.266580 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6399fd-5e66-4cf5-a6e1-e041fcc22fad None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:48.266864 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6399fd-5e66-4cf5-a6e1-e041fcc22fad None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:48.267140 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6399fd-5e66-4cf5-a6e1-e041fcc22fad None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:48.267869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6399fd-5e66-4cf5-a6e1-e041fcc22fad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:48.269296 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6399fd-5e66-4cf5-a6e1-e041fcc22fad None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:48.291465 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 593/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:07:48 2022] POST /identity/v3/users => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:07:50.628842 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd1337-6c08-42ea-a1a4-19081b000e02 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:50.629430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd1337-6c08-42ea-a1a4-19081b000e02 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:50.629430 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd1337-6c08-42ea-a1a4-19081b000e02 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:50.630868 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 585/1178] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:50.636628 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0565b-1945-45cc-9498-1cbe1b3098d4 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:50.637109 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0565b-1945-45cc-9498-1cbe1b3098d4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:50.637220 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0565b-1945-45cc-9498-1cbe1b3098d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:50.654586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-d4b0565b-1945-45cc-9498-1cbe1b3098d4 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:50.655797 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d4b0565b-1945-45cc-9498-1cbe1b3098d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:50.725846 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 594/1179] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:07:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:07:50.751303 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd1337-6c08-42ea-a1a4-19081b000e02 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:50.871936 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd1337-6c08-42ea-a1a4-19081b000e02 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:50.908340 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df5d42-6ba6-4914-a1b6-250c1afe0b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:50.909137 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df5d42-6ba6-4914-a1b6-250c1afe0b87 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:50.909450 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df5d42-6ba6-4914-a1b6-250c1afe0b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:50.909734 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df5d42-6ba6-4914-a1b6-250c1afe0b87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:50.921074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df5d42-6ba6-4914-a1b6-250c1afe0b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:07:50.929074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-20df5d42-6ba6-4914-a1b6-250c1afe0b87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:07:50.929074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:07:50.929074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:07:50.929074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:07:50.929074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:07:50.929074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:07:50.929074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:07:50.929074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:07:50.929074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:07:50.929074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:07:50.929074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:07:50.929074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:07:50.929074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:07:50.929074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:07:50.929074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:07:50.929074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:07:50.930300 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:07:50.930300 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:07:50.930300 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:07:50.930300 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:07:50.930300 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:07:50.930300 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:07:50.930300 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:07:50.930300 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:07:50.930300 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:07:50.930300 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:07:50.930300 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:07:50.930300 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:07:50.930300 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:07:50.930300 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:07:50.930300 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:07:50.930300 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:07:50.931906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:07:50.931906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:07:50.931906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:07:50.931906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:07:50.931906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:07:50.931906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:07:50.931906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:07:50.931906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:07:50.931906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:07:50.931906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:07:50.931906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:07:50.931906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:07:50.931906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 586/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:07:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:07:50.940172 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0565b-1945-45cc-9498-1cbe1b3098d4 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:51.059495 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0565b-1945-45cc-9498-1cbe1b3098d4 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:51.096729 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2c6d5-ab4b-4f25-9570-10496a5bda7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:51.097419 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2c6d5-ab4b-4f25-9570-10496a5bda7b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:51.097704 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2c6d5-ab4b-4f25-9570-10496a5bda7b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:51.097981 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2c6d5-ab4b-4f25-9570-10496a5bda7b None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:51.099281 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2c6d5-ab4b-4f25-9570-10496a5bda7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:51.099744 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2c6d5-ab4b-4f25-9570-10496a5bda7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:51.101130 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2c6d5-ab4b-4f25-9570-10496a5bda7b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:51.110220 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 595/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:07:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:51.116040 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df5d42-6ba6-4914-a1b6-250c1afe0b87 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:51.214660 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df5d42-6ba6-4914-a1b6-250c1afe0b87 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:51.251489 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482ebb4-0fd5-4367-b162-975b988f5ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:51.252361 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482ebb4-0fd5-4367-b162-975b988f5ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:51.252643 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482ebb4-0fd5-4367-b162-975b988f5ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:51.252915 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482ebb4-0fd5-4367-b162-975b988f5ae7 None admin] PATH_INFO: `/v3/users/0d16111d995c469baa56fd6495c3d526` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:51.266673 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482ebb4-0fd5-4367-b162-975b988f5ae7 None admin] RBAC: Authorizing `identity:get_user(user_id=0d16111d995c469baa56fd6495c3d526)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:51.268109 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482ebb4-0fd5-4367-b162-975b988f5ae7 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:51.269834 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 587/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:07:51 2022] GET /identity/v3/users/0d16111d995c469baa56fd6495c3d526 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:51.276505 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2c6d5-ab4b-4f25-9570-10496a5bda7b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:51.375591 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2c6d5-ab4b-4f25-9570-10496a5bda7b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:51.408526 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde45490-cddb-4eb8-a95d-5decaefe77a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:51.409177 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde45490-cddb-4eb8-a95d-5decaefe77a9 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:51.409929 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde45490-cddb-4eb8-a95d-5decaefe77a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:51.410208 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde45490-cddb-4eb8-a95d-5decaefe77a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:51.481112 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde45490-cddb-4eb8-a95d-5decaefe77a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:51.482601 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde45490-cddb-4eb8-a95d-5decaefe77a9 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:51.582321 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 596/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:07:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:07:51.591403 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482ebb4-0fd5-4367-b162-975b988f5ae7 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:51.693761 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482ebb4-0fd5-4367-b162-975b988f5ae7 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:51.730099 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc84aed-ee5a-4f1a-a43e-2c8098d3fac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:51.730970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc84aed-ee5a-4f1a-a43e-2c8098d3fac0 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:51.731247 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc84aed-ee5a-4f1a-a43e-2c8098d3fac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:51.731521 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc84aed-ee5a-4f1a-a43e-2c8098d3fac0 None admin] PATH_INFO: `/v3/projects/054c0f80148e4b4382edcd03fa8e92d7` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:51.732716 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc84aed-ee5a-4f1a-a43e-2c8098d3fac0 None admin] RBAC: Authorizing `identity:get_project(project_id=054c0f80148e4b4382edcd03fa8e92d7)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:51.734168 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc84aed-ee5a-4f1a-a43e-2c8098d3fac0 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:51.736134 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 588/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:07:51 2022] GET /identity/v3/projects/054c0f80148e4b4382edcd03fa8e92d7 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:51.743031 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde45490-cddb-4eb8-a95d-5decaefe77a9 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:51.843097 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde45490-cddb-4eb8-a95d-5decaefe77a9 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:51.877896 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbc4b9-40bb-4b89-a2fc-f629cfa2114a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:51.878566 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbc4b9-40bb-4b89-a2fc-f629cfa2114a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:51.878882 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbc4b9-40bb-4b89-a2fc-f629cfa2114a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:51.879316 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbc4b9-40bb-4b89-a2fc-f629cfa2114a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:51.880822 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cbc4b9-40bb-4b89-a2fc-f629cfa2114a None admin] RBAC: Adding query filter params (role.id=3409f00ead9e455182684faa27b1f8f0, scope.project.id=054c0f80148e4b4382edcd03fa8e92d7, user.id=0d16111d995c469baa56fd6495c3d526) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:51.881133 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cbc4b9-40bb-4b89-a2fc-f629cfa2114a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:51.882782 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cbc4b9-40bb-4b89-a2fc-f629cfa2114a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:51.889785 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 597/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:07:51 2022] GET /identity/v3/role_assignments?user.id=0d16111d995c469baa56fd6495c3d526&scope.project.id=054c0f80148e4b4382edcd03fa8e92d7&role.id=3409f00ead9e455182684faa27b1f8f0 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:54.181142 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fb027-5a28-4ac8-9e89-b9b5722ab3f9 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:54.181931 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fb027-5a28-4ac8-9e89-b9b5722ab3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:54.181931 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fb027-5a28-4ac8-9e89-b9b5722ab3f9 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:54.183101 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 589/1186] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:54.188362 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7314da-e0f2-4209-a4cf-ac8287e1b2a3 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:54.188798 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7314da-e0f2-4209-a4cf-ac8287e1b2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:54.188900 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7314da-e0f2-4209-a4cf-ac8287e1b2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:54.205035 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-8c7314da-e0f2-4209-a4cf-ac8287e1b2a3 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:54.206227 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-8c7314da-e0f2-4209-a4cf-ac8287e1b2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:54.269265 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 598/1187] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:07:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:07:54.292865 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fb027-5a28-4ac8-9e89-b9b5722ab3f9 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:54.393473 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fb027-5a28-4ac8-9e89-b9b5722ab3f9 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:54.427557 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0bcd9-c041-4181-91fb-d31579e5b6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:54.428348 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0bcd9-c041-4181-91fb-d31579e5b6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:54.428628 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0bcd9-c041-4181-91fb-d31579e5b6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:54.428900 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0bcd9-c041-4181-91fb-d31579e5b6f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:54.439029 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0bcd9-c041-4181-91fb-d31579e5b6f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:07:54.446658 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-f3c0bcd9-c041-4181-91fb-d31579e5b6f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:07:54.446658 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:07:54.446658 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:07:54.446658 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:07:54.446658 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:07:54.446658 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:07:54.446658 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:07:54.446658 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:07:54.446658 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:07:54.446658 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:07:54.446658 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:07:54.446658 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:07:54.446658 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:07:54.446658 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:07:54.446658 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:07:54.446658 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:07:54.447868 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:07:54.447868 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:07:54.447868 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:07:54.447868 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:07:54.447868 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:07:54.447868 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:07:54.447868 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:07:54.447868 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:07:54.447868 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:07:54.447868 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:07:54.447868 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:07:54.447868 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:07:54.447868 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:07:54.447868 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:07:54.447868 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:07:54.447868 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:07:54.449276 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:07:54.449276 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:07:54.449276 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:07:54.449276 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:07:54.449276 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:07:54.449276 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:07:54.449276 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:07:54.449276 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:07:54.449276 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:07:54.449276 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:07:54.449276 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:07:54.449276 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:07:54.449276 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 590/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:07:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:07:54.454034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7314da-e0f2-4209-a4cf-ac8287e1b2a3 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:54.561057 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7314da-e0f2-4209-a4cf-ac8287e1b2a3 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:54.597120 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b306d-3155-4c2a-b92f-8a88ac700b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:54.597818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b306d-3155-4c2a-b92f-8a88ac700b17 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:54.598104 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b306d-3155-4c2a-b92f-8a88ac700b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:54.598408 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b306d-3155-4c2a-b92f-8a88ac700b17 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:54.599847 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b306d-3155-4c2a-b92f-8a88ac700b17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:54.600162 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b306d-3155-4c2a-b92f-8a88ac700b17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:54.601576 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b306d-3155-4c2a-b92f-8a88ac700b17 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:54.609578 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 599/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:07:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:54.615818 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0bcd9-c041-4181-91fb-d31579e5b6f2 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:54.717113 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0bcd9-c041-4181-91fb-d31579e5b6f2 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:54.751325 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069a8d5-2095-4998-8d72-b2ac2d45af85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:54.752185 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069a8d5-2095-4998-8d72-b2ac2d45af85 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:54.752469 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069a8d5-2095-4998-8d72-b2ac2d45af85 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:54.752745 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069a8d5-2095-4998-8d72-b2ac2d45af85 None admin] PATH_INFO: `/v3/users/0d16111d995c469baa56fd6495c3d526` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:54.753979 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069a8d5-2095-4998-8d72-b2ac2d45af85 None admin] RBAC: Authorizing `identity:get_user(user_id=0d16111d995c469baa56fd6495c3d526)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:54.755466 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069a8d5-2095-4998-8d72-b2ac2d45af85 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:54.757075 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 591/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:07:54 2022] GET /identity/v3/users/0d16111d995c469baa56fd6495c3d526 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:54.762872 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b306d-3155-4c2a-b92f-8a88ac700b17 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:54.863618 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b306d-3155-4c2a-b92f-8a88ac700b17 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:54.898612 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddfc3d-61f8-4e58-ae8c-ce0010a48967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:54.899484 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddfc3d-61f8-4e58-ae8c-ce0010a48967 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:54.899767 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddfc3d-61f8-4e58-ae8c-ce0010a48967 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:54.900044 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddfc3d-61f8-4e58-ae8c-ce0010a48967 None admin] PATH_INFO: `/v3/projects/054c0f80148e4b4382edcd03fa8e92d7` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:54.901252 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddfc3d-61f8-4e58-ae8c-ce0010a48967 None admin] RBAC: Authorizing `identity:get_project(project_id=054c0f80148e4b4382edcd03fa8e92d7)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:54.902725 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddfc3d-61f8-4e58-ae8c-ce0010a48967 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:54.904433 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 600/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:07:54 2022] GET /identity/v3/projects/054c0f80148e4b4382edcd03fa8e92d7 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:54.910396 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069a8d5-2095-4998-8d72-b2ac2d45af85 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:55.012946 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069a8d5-2095-4998-8d72-b2ac2d45af85 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:55.046929 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780558f-3611-4bf8-9447-e0da4b15fa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:55.047814 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780558f-3611-4bf8-9447-e0da4b15fa4f None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:55.048096 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780558f-3611-4bf8-9447-e0da4b15fa4f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:55.048365 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780558f-3611-4bf8-9447-e0da4b15fa4f None admin] PATH_INFO: `/v3/projects/054c0f80148e4b4382edcd03fa8e92d7/users/0d16111d995c469baa56fd6495c3d526/roles/3409f00ead9e455182684faa27b1f8f0` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:55.050369 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780558f-3611-4bf8-9447-e0da4b15fa4f None admin] RBAC: Authorizing `identity:create_grant(project_id=054c0f80148e4b4382edcd03fa8e92d7, user_id=0d16111d995c469baa56fd6495c3d526, role_id=3409f00ead9e455182684faa27b1f8f0)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:55.051833 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780558f-3611-4bf8-9447-e0da4b15fa4f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:55.065457 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 592/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:07:54 2022] PUT /identity/v3/projects/054c0f80148e4b4382edcd03fa8e92d7/users/0d16111d995c469baa56fd6495c3d526/roles/3409f00ead9e455182684faa27b1f8f0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:07:57.337443 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede076b0-db56-41b9-9811-76da38068b5d None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:57.338032 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede076b0-db56-41b9-9811-76da38068b5d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:57.338032 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede076b0-db56-41b9-9811-76da38068b5d None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:57.339375 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 601/1193] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:07:57.344996 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc60905-9b4d-4c0e-89b8-21530f440e5f None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:57.345461 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc60905-9b4d-4c0e-89b8-21530f440e5f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:57.345592 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc60905-9b4d-4c0e-89b8-21530f440e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:57.363767 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-ccc60905-9b4d-4c0e-89b8-21530f440e5f None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:07:57.365800 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-ccc60905-9b4d-4c0e-89b8-21530f440e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:07:57.435061 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 593/1194] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:07:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:07:57.459324 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede076b0-db56-41b9-9811-76da38068b5d None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:57.564590 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede076b0-db56-41b9-9811-76da38068b5d None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:57.597792 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9fabc-beba-4391-acea-99bf4711ab62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:57.599113 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9fabc-beba-4391-acea-99bf4711ab62 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:57.599300 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9fabc-beba-4391-acea-99bf4711ab62 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:57.599742 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9fabc-beba-4391-acea-99bf4711ab62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:57.610688 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b9fabc-beba-4391-acea-99bf4711ab62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:07:57.619136 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-36b9fabc-beba-4391-acea-99bf4711ab62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:07:57.619136 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:07:57.619136 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:07:57.619136 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:07:57.619136 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:07:57.619136 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:07:57.619136 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:07:57.619136 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:07:57.619136 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:07:57.619136 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:07:57.619136 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:07:57.619136 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:07:57.619136 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:07:57.619136 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:07:57.619136 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:07:57.619136 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:07:57.620316 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:07:57.620316 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:07:57.620316 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:07:57.620316 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:07:57.620316 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:07:57.620316 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:07:57.620316 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:07:57.620316 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:07:57.620316 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:07:57.620316 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:07:57.620316 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:07:57.620316 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:07:57.620316 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:07:57.620316 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:07:57.620316 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:07:57.620316 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:07:57.621698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:07:57.621698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:07:57.621698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:07:57.621698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:07:57.621698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:07:57.621698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:07:57.621698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:07:57.621698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:07:57.621698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:07:57.621698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:07:57.621698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:07:57.621698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:07:57.621698 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 602/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:07:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:07:57.626437 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc60905-9b4d-4c0e-89b8-21530f440e5f None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:57.727323 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc60905-9b4d-4c0e-89b8-21530f440e5f None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:57.773928 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0310d-564f-41da-91b6-0edfc1bfa63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:57.775039 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0310d-564f-41da-91b6-0edfc1bfa63f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:57.775406 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0310d-564f-41da-91b6-0edfc1bfa63f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:57.775692 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0310d-564f-41da-91b6-0edfc1bfa63f None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:57.776800 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce0310d-564f-41da-91b6-0edfc1bfa63f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:57.777107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce0310d-564f-41da-91b6-0edfc1bfa63f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:57.778506 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce0310d-564f-41da-91b6-0edfc1bfa63f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:57.787466 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 594/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:07:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:07:57.793672 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9fabc-beba-4391-acea-99bf4711ab62 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:57.892470 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9fabc-beba-4391-acea-99bf4711ab62 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:57.924439 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421afb8-efca-4cea-b5bb-ccf6be2b8202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:57.925284 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421afb8-efca-4cea-b5bb-ccf6be2b8202 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:57.925585 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421afb8-efca-4cea-b5bb-ccf6be2b8202 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:57.925853 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421afb8-efca-4cea-b5bb-ccf6be2b8202 None admin] PATH_INFO: `/v3/users/0d16111d995c469baa56fd6495c3d526` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:57.927571 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421afb8-efca-4cea-b5bb-ccf6be2b8202 None admin] RBAC: Authorizing `identity:get_user(user_id=0d16111d995c469baa56fd6495c3d526)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:57.928994 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421afb8-efca-4cea-b5bb-ccf6be2b8202 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:57.930655 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 603/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:07:57 2022] GET /identity/v3/users/0d16111d995c469baa56fd6495c3d526 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:57.936499 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0310d-564f-41da-91b6-0edfc1bfa63f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:58.046836 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0310d-564f-41da-91b6-0edfc1bfa63f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:58.081837 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987d494-99b2-412f-a147-768886634751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:58.082490 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987d494-99b2-412f-a147-768886634751 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:58.082831 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987d494-99b2-412f-a147-768886634751 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:58.083125 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987d494-99b2-412f-a147-768886634751 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:58.153879 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987d494-99b2-412f-a147-768886634751 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:58.155239 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987d494-99b2-412f-a147-768886634751 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:58.259589 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 595/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:07:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:07:58.265696 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421afb8-efca-4cea-b5bb-ccf6be2b8202 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:58.369806 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421afb8-efca-4cea-b5bb-ccf6be2b8202 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:58.404163 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da26f2-cda1-4235-861b-0dade561e600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:58.404945 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da26f2-cda1-4235-861b-0dade561e600 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:58.405228 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da26f2-cda1-4235-861b-0dade561e600 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:58.405536 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da26f2-cda1-4235-861b-0dade561e600 None admin] PATH_INFO: `/v3/projects/054c0f80148e4b4382edcd03fa8e92d7` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:58.406728 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da26f2-cda1-4235-861b-0dade561e600 None admin] RBAC: Authorizing `identity:get_project(project_id=054c0f80148e4b4382edcd03fa8e92d7)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:58.408188 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da26f2-cda1-4235-861b-0dade561e600 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:58.410283 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 604/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:07:58 2022] GET /identity/v3/projects/054c0f80148e4b4382edcd03fa8e92d7 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:07:58.417153 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987d494-99b2-412f-a147-768886634751 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:07:58.517756 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987d494-99b2-412f-a147-768886634751 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:07:58.550179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea060c-3fe9-4956-8c14-071e86121129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:07:58.550827 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea060c-3fe9-4956-8c14-071e86121129 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:07:58.551109 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea060c-3fe9-4956-8c14-071e86121129 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:07:58.551412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea060c-3fe9-4956-8c14-071e86121129 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:07:58.552835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea060c-3fe9-4956-8c14-071e86121129 None admin] RBAC: Adding query filter params (role.id=3409f00ead9e455182684faa27b1f8f0, scope.project.id=054c0f80148e4b4382edcd03fa8e92d7, user.id=0d16111d995c469baa56fd6495c3d526) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:07:58.553167 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea060c-3fe9-4956-8c14-071e86121129 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:07:58.554607 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea060c-3fe9-4956-8c14-071e86121129 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:07:58.560341 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 596/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:07:58 2022] GET /identity/v3/role_assignments?user.id=0d16111d995c469baa56fd6495c3d526&scope.project.id=054c0f80148e4b4382edcd03fa8e92d7&role.id=3409f00ead9e455182684faa27b1f8f0 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:01.988510 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a0070-8885-4498-80a9-7b624bda6287 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:01.989149 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a0070-8885-4498-80a9-7b624bda6287 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:01.989149 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a0070-8885-4498-80a9-7b624bda6287 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:01.990453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 605/1201] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:09:01.998969 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6230f4-0710-414d-b2c9-44d288b2b76d None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:01.999517 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6230f4-0710-414d-b2c9-44d288b2b76d None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:01.999688 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6230f4-0710-414d-b2c9-44d288b2b76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:02.017499 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-fb6230f4-0710-414d-b2c9-44d288b2b76d None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:09:02.018736 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-fb6230f4-0710-414d-b2c9-44d288b2b76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:09:02.093178 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 597/1202] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:09:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:09:02.119295 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a0070-8885-4498-80a9-7b624bda6287 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:02.250808 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a0070-8885-4498-80a9-7b624bda6287 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:02.294848 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131848e2-f1bf-43d0-aca4-84496579e1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:02.295674 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131848e2-f1bf-43d0-aca4-84496579e1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:02.295953 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131848e2-f1bf-43d0-aca4-84496579e1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:02.296260 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131848e2-f1bf-43d0-aca4-84496579e1f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:02.310160 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131848e2-f1bf-43d0-aca4-84496579e1f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:02.312174 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131848e2-f1bf-43d0-aca4-84496579e1f5 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:02.339757 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-131848e2-f1bf-43d0-aca4-84496579e1f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:02.339757 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:02.339757 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:02.339757 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:02.339757 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:02.339757 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:02.339757 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:02.339757 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:02.339757 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:02.339757 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:02.339757 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:02.339757 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:02.339757 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:09:02.339757 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:09:02.339757 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:09:02.341077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:09:02.341077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:02.341077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:02.341077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:02.341077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:02.341077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:02.341077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:02.341077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:02.341077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:09:02.341077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:02.341077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:02.341077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:02.341077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:02.341077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:02.341077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:02.341077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:02.341077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:02.342389 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:09:02.342389 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:09:02.342389 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:02.342389 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:09:02.342389 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 606/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:09:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:02.349534 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6230f4-0710-414d-b2c9-44d288b2b76d None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:02.466232 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6230f4-0710-414d-b2c9-44d288b2b76d None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:02.505800 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291cebe-b324-4578-8aeb-43766b593fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:02.506552 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291cebe-b324-4578-8aeb-43766b593fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:02.506866 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291cebe-b324-4578-8aeb-43766b593fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:02.507187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291cebe-b324-4578-8aeb-43766b593fc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:02.508084 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291cebe-b324-4578-8aeb-43766b593fc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:02.508408 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291cebe-b324-4578-8aeb-43766b593fc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:02.509883 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291cebe-b324-4578-8aeb-43766b593fc4 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:02.524332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 598/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:02.532642 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131848e2-f1bf-43d0-aca4-84496579e1f5 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:02.661453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131848e2-f1bf-43d0-aca4-84496579e1f5 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:02.698184 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb3868-54f3-46f4-9b09-6890f959084d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:02.698858 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb3868-54f3-46f4-9b09-6890f959084d None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:02.699143 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb3868-54f3-46f4-9b09-6890f959084d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:02.699433 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb3868-54f3-46f4-9b09-6890f959084d None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:02.700226 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb3868-54f3-46f4-9b09-6890f959084d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:02.701866 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb3868-54f3-46f4-9b09-6890f959084d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:02.725968 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 607/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:09:02 2022] POST /identity/v3/users => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:09:05.355325 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4fd78-a349-4464-ae31-8a93b875bae0 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:05.355951 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4fd78-a349-4464-ae31-8a93b875bae0 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:05.356043 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4fd78-a349-4464-ae31-8a93b875bae0 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:05.358091 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 599/1206] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:09:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:09:05.364767 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973f77c-a95f-4fde-af64-66342632f69b None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:05.365266 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973f77c-a95f-4fde-af64-66342632f69b None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:05.365409 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973f77c-a95f-4fde-af64-66342632f69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:05.384964 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-1973f77c-a95f-4fde-af64-66342632f69b None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:09:05.386898 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1973f77c-a95f-4fde-af64-66342632f69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:09:05.469611 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 608/1207] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:09:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:09:05.500205 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4fd78-a349-4464-ae31-8a93b875bae0 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:05.635077 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4fd78-a349-4464-ae31-8a93b875bae0 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:05.687231 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52700803-c707-4f9e-9f4a-b3d84088f12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:05.688858 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52700803-c707-4f9e-9f4a-b3d84088f12c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:05.689408 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52700803-c707-4f9e-9f4a-b3d84088f12c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:05.689953 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52700803-c707-4f9e-9f4a-b3d84088f12c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:05.707401 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52700803-c707-4f9e-9f4a-b3d84088f12c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:09:05.721631 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-52700803-c707-4f9e-9f4a-b3d84088f12c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:09:05.721631 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:05.721631 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:05.721631 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:05.721631 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:05.721631 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:05.721631 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:05.721631 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:05.721631 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:05.721631 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:05.721631 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:05.721631 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:05.721631 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:09:05.721631 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:09:05.721631 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:09:05.721631 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:09:05.723293 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:09:05.723293 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:09:05.723293 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:09:05.723293 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:09:05.723293 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:05.723293 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:05.723293 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:05.723293 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:05.723293 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:05.723293 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:05.723293 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:05.723293 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:09:05.723293 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:05.723293 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:05.723293 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:05.723293 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:05.724444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:05.724444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:05.724444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:05.724444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:05.724444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:09:05.724444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:09:05.724444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:09:05.724444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:09:05.724444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:09:05.724444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:09:05.724444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:09:05.724444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:09:05.724444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 600/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:09:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:09:05.732731 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973f77c-a95f-4fde-af64-66342632f69b None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:05.861574 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973f77c-a95f-4fde-af64-66342632f69b None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:05.913558 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fe149-4bb6-4ca9-9f04-e288e246ff07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:05.914182 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fe149-4bb6-4ca9-9f04-e288e246ff07 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:05.914498 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fe149-4bb6-4ca9-9f04-e288e246ff07 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:05.914803 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fe149-4bb6-4ca9-9f04-e288e246ff07 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:05.915766 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fe149-4bb6-4ca9-9f04-e288e246ff07 None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:05.916079 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fe149-4bb6-4ca9-9f04-e288e246ff07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:05.917547 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fe149-4bb6-4ca9-9f04-e288e246ff07 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:05.929114 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 609/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:09:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:05.935465 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52700803-c707-4f9e-9f4a-b3d84088f12c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:06.074019 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52700803-c707-4f9e-9f4a-b3d84088f12c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:06.123215 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b9d22-23d2-4678-b7e5-8406dff2114e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:06.124033 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b9d22-23d2-4678-b7e5-8406dff2114e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:06.124316 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b9d22-23d2-4678-b7e5-8406dff2114e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:06.124608 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b9d22-23d2-4678-b7e5-8406dff2114e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:06.137228 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b9d22-23d2-4678-b7e5-8406dff2114e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:06.138940 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b9d22-23d2-4678-b7e5-8406dff2114e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:06.160034 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-229b9d22-23d2-4678-b7e5-8406dff2114e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:06.160034 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:06.160034 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:06.160034 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:06.160034 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:06.160034 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:06.160034 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:06.160034 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:06.160034 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:06.160034 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:06.160034 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:06.160034 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:06.160034 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:09:06.160034 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:09:06.160034 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:09:06.161747 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:09:06.161747 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:06.161747 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:06.161747 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:06.161747 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:06.161747 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:06.161747 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:06.161747 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:06.161747 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:09:06.161747 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:06.161747 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:06.161747 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:06.161747 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:06.161747 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:06.161747 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:06.161747 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:06.161747 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:06.162937 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:09:06.162937 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:09:06.162937 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:06.162937 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:09:06.162937 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 601/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:09:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:06.168227 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fe149-4bb6-4ca9-9f04-e288e246ff07 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:06.289829 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fe149-4bb6-4ca9-9f04-e288e246ff07 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:06.331448 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41056e1f-54fe-4805-8fde-723ee0204434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:06.332879 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41056e1f-54fe-4805-8fde-723ee0204434 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:06.333177 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41056e1f-54fe-4805-8fde-723ee0204434 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:06.333481 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41056e1f-54fe-4805-8fde-723ee0204434 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:06.334236 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41056e1f-54fe-4805-8fde-723ee0204434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:06.334546 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41056e1f-54fe-4805-8fde-723ee0204434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:06.335991 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41056e1f-54fe-4805-8fde-723ee0204434 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:06.355618 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 610/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:06.357499 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b9d22-23d2-4678-b7e5-8406dff2114e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:06.508126 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b9d22-23d2-4678-b7e5-8406dff2114e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:06.577556 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32883339-3c69-40e7-83fe-353069b8184d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:06.578907 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32883339-3c69-40e7-83fe-353069b8184d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:06.579473 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32883339-3c69-40e7-83fe-353069b8184d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:06.579992 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32883339-3c69-40e7-83fe-353069b8184d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:06.591999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32883339-3c69-40e7-83fe-353069b8184d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:06.593529 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32883339-3c69-40e7-83fe-353069b8184d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:06.610520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-32883339-3c69-40e7-83fe-353069b8184d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:09:06.610520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:06.610520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:06.610520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:06.610520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:06.610520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:06.610520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:06.610520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:06.610520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:06.610520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:06.610520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:06.610520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:06.610520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:09:06.610520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:09:06.610520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:09:06.610520 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:09:06.620826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:06.620826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:06.620826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:09:06.620826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:09:06.620826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:09:06.620826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:09:06.620826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:06.620826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:06.620826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:06.620826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:06.620826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:06.620826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:09:06.620826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:06.620826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:06.620826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:06.620826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:06.620826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:06.620826 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:06.623160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:06.623160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:06.623160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:09:06.623160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:09:06.623160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:09:06.623160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:09:06.623160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:09:06.623160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:09:06.623160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:09:06.623160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:09:06.623160 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 602/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:09:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:09:06.624320 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41056e1f-54fe-4805-8fde-723ee0204434 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:06.750683 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41056e1f-54fe-4805-8fde-723ee0204434 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:06.795554 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fd745-24ef-406d-b607-cfa3975bf105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:06.796259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fd745-24ef-406d-b607-cfa3975bf105 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:06.796540 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fd745-24ef-406d-b607-cfa3975bf105 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:06.796838 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fd745-24ef-406d-b607-cfa3975bf105 None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:06.797775 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2fd745-24ef-406d-b607-cfa3975bf105 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:06.798081 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2fd745-24ef-406d-b607-cfa3975bf105 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:06.799673 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2fd745-24ef-406d-b607-cfa3975bf105 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:06.821415 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 611/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 9 15:09:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:06.825464 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32883339-3c69-40e7-83fe-353069b8184d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:06.951397 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32883339-3c69-40e7-83fe-353069b8184d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:06.992848 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f4844-6632-4c09-99d5-40288c909acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:06.993692 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f4844-6632-4c09-99d5-40288c909acf None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:06.993974 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f4844-6632-4c09-99d5-40288c909acf None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:06.994298 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f4844-6632-4c09-99d5-40288c909acf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:07.081465 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f4844-6632-4c09-99d5-40288c909acf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:07.083295 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f4844-6632-4c09-99d5-40288c909acf None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:07.197719 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 603/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:09:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:09:07.203977 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fd745-24ef-406d-b607-cfa3975bf105 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:07.315004 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fd745-24ef-406d-b607-cfa3975bf105 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:07.357475 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb5ccc-04fd-460b-a1f7-4d23c42585c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:07.357475 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb5ccc-04fd-460b-a1f7-4d23c42585c1 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:07.357765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb5ccc-04fd-460b-a1f7-4d23c42585c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:07.358717 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb5ccc-04fd-460b-a1f7-4d23c42585c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:07.370174 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb5ccc-04fd-460b-a1f7-4d23c42585c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:07.371938 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb5ccc-04fd-460b-a1f7-4d23c42585c1 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:07.393607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-5ffb5ccc-04fd-460b-a1f7-4d23c42585c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:07.393607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:07.393607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:07.393607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:07.393607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:07.393607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:07.393607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:07.393607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:07.393607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:07.393607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:07.393607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:07.393607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:07.393607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:09:07.393607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:09:07.393607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:09:07.394867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:09:07.394867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:07.394867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:07.394867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:07.394867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:07.394867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:07.394867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:07.394867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:07.394867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:09:07.394867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:07.394867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:07.394867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:07.394867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:07.394867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:07.394867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:07.394867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:07.394867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:07.396140 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:09:07.396140 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:09:07.396140 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:07.396140 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:09:07.397572 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 612/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:09:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:07.401304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f4844-6632-4c09-99d5-40288c909acf None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:07.520377 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f4844-6632-4c09-99d5-40288c909acf None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:07.558082 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020041f5-c52d-4e81-9653-38fb7e50c382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:07.558722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020041f5-c52d-4e81-9653-38fb7e50c382 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:07.559004 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020041f5-c52d-4e81-9653-38fb7e50c382 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:07.559276 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020041f5-c52d-4e81-9653-38fb7e50c382 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:07.559989 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020041f5-c52d-4e81-9653-38fb7e50c382 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:07.560292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020041f5-c52d-4e81-9653-38fb7e50c382 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:07.561666 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020041f5-c52d-4e81-9653-38fb7e50c382 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:07.578322 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 604/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:07.579183 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb5ccc-04fd-460b-a1f7-4d23c42585c1 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:07.700982 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb5ccc-04fd-460b-a1f7-4d23c42585c1 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:07.740077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e71731-7701-4678-96fc-44d657a38a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:07.740983 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e71731-7701-4678-96fc-44d657a38a0e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:07.741269 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e71731-7701-4678-96fc-44d657a38a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:07.741607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e71731-7701-4678-96fc-44d657a38a0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:07.749341 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e71731-7701-4678-96fc-44d657a38a0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:07.751105 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e71731-7701-4678-96fc-44d657a38a0e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:07.767876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-b6e71731-7701-4678-96fc-44d657a38a0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:09:07.767876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:07.767876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:07.767876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:07.767876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:07.767876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:07.767876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:07.767876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:07.767876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:07.767876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:07.767876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:07.767876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:07.767876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:09:07.767876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:09:07.767876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:09:07.768905 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:09:07.768905 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:07.768905 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:07.768905 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:07.768905 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:07.768905 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:07.768905 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:07.768905 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:07.768905 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:09:07.768905 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:07.768905 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:07.768905 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:07.768905 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:07.768905 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:07.768905 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:07.768905 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:07.768905 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:07.770261 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:09:07.770261 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:09:07.770261 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:09:07.770261 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:09:07.770261 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:09:07.770261 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:09:07.770261 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:09:07.770261 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:09:07.770261 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 613/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:09:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:09:07.775508 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020041f5-c52d-4e81-9653-38fb7e50c382 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:07.904048 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020041f5-c52d-4e81-9653-38fb7e50c382 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:07.943001 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f00d7-e677-4a3d-9b63-fecb84cba682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:07.943674 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f00d7-e677-4a3d-9b63-fecb84cba682 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:07.943957 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f00d7-e677-4a3d-9b63-fecb84cba682 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:07.944232 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f00d7-e677-4a3d-9b63-fecb84cba682 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:07.945030 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f00d7-e677-4a3d-9b63-fecb84cba682 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:07.945436 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f00d7-e677-4a3d-9b63-fecb84cba682 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:07.946946 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f00d7-e677-4a3d-9b63-fecb84cba682 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:07.961572 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 605/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:09:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:09:07.968384 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e71731-7701-4678-96fc-44d657a38a0e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:08.086731 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e71731-7701-4678-96fc-44d657a38a0e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:08.127127 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382a0e9-a3cd-45ca-bc6d-e9c6802a66ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:08.127811 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382a0e9-a3cd-45ca-bc6d-e9c6802a66ea None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:08.128110 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382a0e9-a3cd-45ca-bc6d-e9c6802a66ea None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:08.128460 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382a0e9-a3cd-45ca-bc6d-e9c6802a66ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:08.129562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382a0e9-a3cd-45ca-bc6d-e9c6802a66ea None admin] RBAC: Adding query filter params (role.id=d8aa93d29788400a97d04db10d8fb8d5, scope.project.id=4fcadeae44cc4547905b83bfebec79c7, user.id=2462e1778f3a4f3194a0b5dca13d9777) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:08.129885 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382a0e9-a3cd-45ca-bc6d-e9c6802a66ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:08.131404 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382a0e9-a3cd-45ca-bc6d-e9c6802a66ea None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:08.136863 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 614/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:09:07 2022] GET /identity/v3/role_assignments?user.id=2462e1778f3a4f3194a0b5dca13d9777&scope.project.id=4fcadeae44cc4547905b83bfebec79c7&role.id=d8aa93d29788400a97d04db10d8fb8d5 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:10.481274 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280afcd7-6d68-4474-aa6c-4f28274ef725 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:10.482026 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280afcd7-6d68-4474-aa6c-4f28274ef725 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:10.482026 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280afcd7-6d68-4474-aa6c-4f28274ef725 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:10.483456 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 606/1220] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:09:10.489141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9b109-5861-435f-9654-f4c95c578206 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:10.489683 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9b109-5861-435f-9654-f4c95c578206 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:10.489796 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9b109-5861-435f-9654-f4c95c578206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:10.508647 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-2ad9b109-5861-435f-9654-f4c95c578206 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:09:10.509876 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-2ad9b109-5861-435f-9654-f4c95c578206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:09:10.588330 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 615/1221] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:09:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:09:10.611693 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280afcd7-6d68-4474-aa6c-4f28274ef725 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:10.751742 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280afcd7-6d68-4474-aa6c-4f28274ef725 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:10.798422 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a13f44-0fda-4604-b6ac-e09df4b0597f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:10.799782 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a13f44-0fda-4604-b6ac-e09df4b0597f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:10.800251 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a13f44-0fda-4604-b6ac-e09df4b0597f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:10.800751 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a13f44-0fda-4604-b6ac-e09df4b0597f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:10.815318 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a13f44-0fda-4604-b6ac-e09df4b0597f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:09:10.825304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-e4a13f44-0fda-4604-b6ac-e09df4b0597f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:09:10.825304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:10.825304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:10.825304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:10.825304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:10.825304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:10.825304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:10.825304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:10.825304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:10.825304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:10.825304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:10.825304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:10.825304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:09:10.825304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:09:10.825304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:09:10.825304 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:09:10.826305 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:09:10.826305 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:09:10.826305 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:09:10.826305 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:09:10.826305 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:10.826305 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:10.826305 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:10.826305 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:10.826305 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:10.826305 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:10.826305 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:10.826305 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:09:10.826305 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:10.826305 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:10.826305 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:10.826305 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:10.827280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:10.827280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:10.827280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:10.827280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:10.827280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:09:10.827280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:09:10.827280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:09:10.827280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:09:10.827280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:09:10.827280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:09:10.827280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:09:10.827280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:09:10.827980 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 607/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:09:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:10.834961 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9b109-5861-435f-9654-f4c95c578206 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:10.951727 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9b109-5861-435f-9654-f4c95c578206 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:10.996950 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50b451-3b8d-4e55-851c-825fe2e90e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:10.997945 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50b451-3b8d-4e55-851c-825fe2e90e57 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:10.998323 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50b451-3b8d-4e55-851c-825fe2e90e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:10.998715 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50b451-3b8d-4e55-851c-825fe2e90e57 None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:10.999761 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50b451-3b8d-4e55-851c-825fe2e90e57 None admin] RBAC: Adding query filter params (name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:11.000161 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50b451-3b8d-4e55-851c-825fe2e90e57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:11.002390 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50b451-3b8d-4e55-851c-825fe2e90e57 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:11.014508 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 616/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:09:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:11.021519 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a13f44-0fda-4604-b6ac-e09df4b0597f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:11.157508 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a13f44-0fda-4604-b6ac-e09df4b0597f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:11.205835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48258e9f-6497-4e0f-874d-aa2ed1d0942f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:11.207093 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48258e9f-6497-4e0f-874d-aa2ed1d0942f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:11.207530 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48258e9f-6497-4e0f-874d-aa2ed1d0942f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:11.208000 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48258e9f-6497-4e0f-874d-aa2ed1d0942f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:11.221486 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48258e9f-6497-4e0f-874d-aa2ed1d0942f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:11.223469 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48258e9f-6497-4e0f-874d-aa2ed1d0942f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:11.241614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-48258e9f-6497-4e0f-874d-aa2ed1d0942f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:11.241614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:11.241614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:11.241614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:11.241614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:11.241614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:11.241614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:11.241614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:11.241614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:11.241614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:11.241614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:11.241614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:11.241614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:09:11.241614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:09:11.241614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:09:11.243648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:09:11.243648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:11.243648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:11.243648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:11.243648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:11.243648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:11.243648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:11.243648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:11.243648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:09:11.243648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:11.243648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:11.243648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:11.243648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:11.243648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:11.243648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:11.243648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:11.243648 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:11.245535 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:09:11.245535 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:09:11.245535 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:11.245535 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:09:11.245535 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 608/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:09:11.253158 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50b451-3b8d-4e55-851c-825fe2e90e57 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:11.374359 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50b451-3b8d-4e55-851c-825fe2e90e57 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:11.413136 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caf98e-f9cd-4396-a1fe-98b850b2df69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:11.413136 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caf98e-f9cd-4396-a1fe-98b850b2df69 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:11.413136 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caf98e-f9cd-4396-a1fe-98b850b2df69 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:11.413136 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caf98e-f9cd-4396-a1fe-98b850b2df69 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:11.413943 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94caf98e-f9cd-4396-a1fe-98b850b2df69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:11.414254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94caf98e-f9cd-4396-a1fe-98b850b2df69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:11.415627 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94caf98e-f9cd-4396-a1fe-98b850b2df69 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:11.434524 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 617/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:11.435713 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48258e9f-6497-4e0f-874d-aa2ed1d0942f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:11.545159 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48258e9f-6497-4e0f-874d-aa2ed1d0942f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:11.583844 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af64d75-08e7-474d-9326-5556fd2d8c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:11.584650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af64d75-08e7-474d-9326-5556fd2d8c39 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:11.584936 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af64d75-08e7-474d-9326-5556fd2d8c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:11.585200 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af64d75-08e7-474d-9326-5556fd2d8c39 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:11.594650 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af64d75-08e7-474d-9326-5556fd2d8c39 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:11.596080 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af64d75-08e7-474d-9326-5556fd2d8c39 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:11.616000 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-8af64d75-08e7-474d-9326-5556fd2d8c39 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:09:11.616000 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:11.616000 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:11.616000 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:11.616000 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:11.616000 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:11.616000 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:11.616000 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:11.616000 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:11.616000 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:11.616000 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:11.616000 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:11.616000 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:09:11.616000 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:09:11.616000 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:09:11.616000 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:09:11.617207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:11.617207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:11.617207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:09:11.617207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:09:11.617207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:09:11.617207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:09:11.617207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:11.617207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:11.617207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:11.617207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:11.617207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:11.617207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:09:11.617207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:11.617207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:11.617207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:11.617207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:11.617207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:11.617207 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:11.618244 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:11.618244 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:11.618244 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:09:11.618244 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:09:11.618244 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:09:11.618244 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:09:11.618244 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:09:11.618244 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:09:11.618244 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:09:11.618244 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:09:11.618244 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 609/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:09:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:11.623857 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caf98e-f9cd-4396-a1fe-98b850b2df69 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:11.746768 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caf98e-f9cd-4396-a1fe-98b850b2df69 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:11.785916 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7090c4b-99b4-483e-90f0-a3c3eb9ed79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:11.786748 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7090c4b-99b4-483e-90f0-a3c3eb9ed79e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:11.787098 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7090c4b-99b4-483e-90f0-a3c3eb9ed79e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:11.787453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7090c4b-99b4-483e-90f0-a3c3eb9ed79e None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:11.788333 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7090c4b-99b4-483e-90f0-a3c3eb9ed79e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:11.788644 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7090c4b-99b4-483e-90f0-a3c3eb9ed79e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:11.790372 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7090c4b-99b4-483e-90f0-a3c3eb9ed79e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:11.810941 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 618/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 9 15:09:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:11.816584 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af64d75-08e7-474d-9326-5556fd2d8c39 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:11.929598 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af64d75-08e7-474d-9326-5556fd2d8c39 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:11.962369 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514ec8d-64b3-409a-a834-30e9d3fc613d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:11.963314 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514ec8d-64b3-409a-a834-30e9d3fc613d None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:11.963626 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514ec8d-64b3-409a-a834-30e9d3fc613d None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:11.963941 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514ec8d-64b3-409a-a834-30e9d3fc613d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:11.976246 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514ec8d-64b3-409a-a834-30e9d3fc613d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:11.977815 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514ec8d-64b3-409a-a834-30e9d3fc613d None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:11.997440 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-b514ec8d-64b3-409a-a834-30e9d3fc613d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:11.997440 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:11.997440 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:11.997440 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:11.997440 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:11.997440 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:11.997440 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:11.997440 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:11.997440 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:11.997440 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:11.997440 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:11.997440 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:11.997440 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:09:11.997440 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:09:11.997440 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:09:11.998991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:09:11.998991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:11.998991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:11.998991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:11.998991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:11.998991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:11.998991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:11.998991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:11.998991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:09:11.998991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:11.998991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:11.998991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:11.998991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:11.998991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:11.998991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:11.998991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:11.998991 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:12.000074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:09:12.000074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:09:12.000074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:12.000074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:09:12.000074 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 610/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:09:12.005350 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7090c4b-99b4-483e-90f0-a3c3eb9ed79e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:12.121331 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7090c4b-99b4-483e-90f0-a3c3eb9ed79e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:12.166243 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de57799-93b2-4046-b316-34d7be62e805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:12.167456 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de57799-93b2-4046-b316-34d7be62e805 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:12.168006 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de57799-93b2-4046-b316-34d7be62e805 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:12.168495 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de57799-93b2-4046-b316-34d7be62e805 None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:12.170155 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de57799-93b2-4046-b316-34d7be62e805 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:12.170838 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de57799-93b2-4046-b316-34d7be62e805 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:12.173858 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de57799-93b2-4046-b316-34d7be62e805 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:12.196555 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 619/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:09:12.202262 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514ec8d-64b3-409a-a834-30e9d3fc613d None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:12.315975 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514ec8d-64b3-409a-a834-30e9d3fc613d None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:12.354581 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfad9e7-c0f1-484a-a65f-143f0d0ff0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:12.355522 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfad9e7-c0f1-484a-a65f-143f0d0ff0bc None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:12.355806 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfad9e7-c0f1-484a-a65f-143f0d0ff0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:12.356146 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfad9e7-c0f1-484a-a65f-143f0d0ff0bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:12.364190 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfad9e7-c0f1-484a-a65f-143f0d0ff0bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:12.365669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfad9e7-c0f1-484a-a65f-143f0d0ff0bc None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:12.381453 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-4bfad9e7-c0f1-484a-a65f-143f0d0ff0bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:09:12.381453 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:12.381453 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:12.381453 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:12.381453 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:12.381453 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:12.381453 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:12.381453 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:12.381453 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:12.381453 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:12.381453 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:12.381453 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:12.381453 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:09:12.381453 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:09:12.381453 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:09:12.382581 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:09:12.382581 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:12.382581 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:12.382581 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:12.382581 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:12.382581 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:12.382581 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:12.382581 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:12.382581 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:09:12.382581 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:12.382581 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:12.382581 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:12.382581 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:12.382581 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:12.382581 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:12.382581 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:12.382581 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:12.383706 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:09:12.383706 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:09:12.383706 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:09:12.383706 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:09:12.383706 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:09:12.383706 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:09:12.383706 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:09:12.383706 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:09:12.383706 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 611/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:09:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:09:12.390393 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de57799-93b2-4046-b316-34d7be62e805 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:12.519802 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de57799-93b2-4046-b316-34d7be62e805 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:12.563783 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1acaaf-2358-4fc3-a31b-580b455baa80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:12.564465 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1acaaf-2358-4fc3-a31b-580b455baa80 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:12.564751 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1acaaf-2358-4fc3-a31b-580b455baa80 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:12.565030 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1acaaf-2358-4fc3-a31b-580b455baa80 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:12.566392 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1acaaf-2358-4fc3-a31b-580b455baa80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:12.566706 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1acaaf-2358-4fc3-a31b-580b455baa80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:12.568372 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1acaaf-2358-4fc3-a31b-580b455baa80 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:12.582792 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 620/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:09:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:12.589275 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfad9e7-c0f1-484a-a65f-143f0d0ff0bc None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:12.709276 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfad9e7-c0f1-484a-a65f-143f0d0ff0bc None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:12.747180 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c87d8e-06f0-4100-8623-3fd3e49ea949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:12.748670 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c87d8e-06f0-4100-8623-3fd3e49ea949 None admin] REQUEST_METHOD: `PUT` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:12.749091 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c87d8e-06f0-4100-8623-3fd3e49ea949 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:12.749630 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c87d8e-06f0-4100-8623-3fd3e49ea949 None admin] PATH_INFO: `/v3/projects/4fcadeae44cc4547905b83bfebec79c7/users/2462e1778f3a4f3194a0b5dca13d9777/roles/d8aa93d29788400a97d04db10d8fb8d5` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:12.768815 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c87d8e-06f0-4100-8623-3fd3e49ea949 None admin] RBAC: Authorizing `identity:create_grant(project_id=4fcadeae44cc4547905b83bfebec79c7, user_id=2462e1778f3a4f3194a0b5dca13d9777, role_id=d8aa93d29788400a97d04db10d8fb8d5)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:12.771662 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c87d8e-06f0-4100-8623-3fd3e49ea949 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:12.789512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 612/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:09:12 2022] PUT /identity/v3/projects/4fcadeae44cc4547905b83bfebec79c7/users/2462e1778f3a4f3194a0b5dca13d9777/roles/d8aa93d29788400a97d04db10d8fb8d5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:09:15.291428 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e20f3-e06c-4155-9ff8-cc2eaa0c0056 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:15.292130 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e20f3-e06c-4155-9ff8-cc2eaa0c0056 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:15.292230 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e20f3-e06c-4155-9ff8-cc2eaa0c0056 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:15.294419 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 621/1233] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:09:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:09:15.300173 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5a789-9723-4790-a7ea-203ebf3af569 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:15.301192 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5a789-9723-4790-a7ea-203ebf3af569 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:15.301533 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5a789-9723-4790-a7ea-203ebf3af569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:15.320621 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-efc5a789-9723-4790-a7ea-203ebf3af569 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:09:15.321966 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-efc5a789-9723-4790-a7ea-203ebf3af569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:09:15.397756 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 613/1234] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:09:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:09:15.423332 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e20f3-e06c-4155-9ff8-cc2eaa0c0056 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:15.537137 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e20f3-e06c-4155-9ff8-cc2eaa0c0056 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:15.576192 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acecae63-7d20-40c1-b40c-e5382c478493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:15.576955 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecae63-7d20-40c1-b40c-e5382c478493 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:15.577186 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecae63-7d20-40c1-b40c-e5382c478493 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:15.577489 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acecae63-7d20-40c1-b40c-e5382c478493 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:15.589096 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acecae63-7d20-40c1-b40c-e5382c478493 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:09:15.596861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-acecae63-7d20-40c1-b40c-e5382c478493 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:09:15.596861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:15.596861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:15.596861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:15.596861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:15.596861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:15.596861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:15.596861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:15.596861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:15.596861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:15.596861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:15.596861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:15.596861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:09:15.596861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:09:15.596861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:09:15.596861 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:09:15.598460 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:09:15.598460 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:09:15.598460 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:09:15.598460 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:09:15.598460 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:15.598460 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:15.598460 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:15.598460 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:15.598460 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:15.598460 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:15.598460 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:15.598460 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:09:15.598460 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:15.598460 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:15.598460 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:15.598460 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:15.599997 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:15.599997 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:15.599997 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:15.599997 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:15.599997 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:09:15.599997 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:09:15.599997 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:09:15.599997 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:09:15.599997 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:09:15.599997 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:09:15.599997 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:09:15.599997 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:09:15.599997 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 622/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:09:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:15.605614 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5a789-9723-4790-a7ea-203ebf3af569 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:15.713962 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5a789-9723-4790-a7ea-203ebf3af569 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:15.753890 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dfb32-468e-406e-89d4-e32d31d2f01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:15.754669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dfb32-468e-406e-89d4-e32d31d2f01f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:15.754978 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dfb32-468e-406e-89d4-e32d31d2f01f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:15.755280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dfb32-468e-406e-89d4-e32d31d2f01f None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:15.756134 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593dfb32-468e-406e-89d4-e32d31d2f01f None admin] RBAC: Adding query filter params (name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:15.756482 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593dfb32-468e-406e-89d4-e32d31d2f01f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:15.757958 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593dfb32-468e-406e-89d4-e32d31d2f01f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:15.773232 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 614/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:09:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:15.774737 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acecae63-7d20-40c1-b40c-e5382c478493 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:15.896564 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acecae63-7d20-40c1-b40c-e5382c478493 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:15.939650 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029286df-65bd-4b74-9aca-b3c9899774de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:15.940446 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029286df-65bd-4b74-9aca-b3c9899774de None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:15.940818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029286df-65bd-4b74-9aca-b3c9899774de None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:15.941657 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029286df-65bd-4b74-9aca-b3c9899774de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:15.954035 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029286df-65bd-4b74-9aca-b3c9899774de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:15.955745 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029286df-65bd-4b74-9aca-b3c9899774de None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:15.978054 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-029286df-65bd-4b74-9aca-b3c9899774de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:15.978054 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:15.978054 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:15.978054 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:15.978054 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:15.978054 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:15.978054 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:15.978054 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:15.978054 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:15.978054 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:15.978054 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:15.978054 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:15.978054 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:09:15.978054 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:09:15.978054 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:09:15.979254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:09:15.979254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:15.979254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:15.979254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:15.979254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:15.979254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:15.979254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:15.979254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:15.979254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:09:15.979254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:15.979254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:15.979254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:15.979254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:15.979254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:15.979254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:15.979254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:15.979254 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:15.980260 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:09:15.980260 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:09:15.980260 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:15.980260 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:09:15.980260 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 623/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:09:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:15.985962 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dfb32-468e-406e-89d4-e32d31d2f01f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:16.099332 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dfb32-468e-406e-89d4-e32d31d2f01f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:16.160007 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699778ff-f30a-4c52-83d6-e8660746cd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:16.160938 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699778ff-f30a-4c52-83d6-e8660746cd57 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:16.161341 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699778ff-f30a-4c52-83d6-e8660746cd57 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:16.161896 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699778ff-f30a-4c52-83d6-e8660746cd57 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:16.163109 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699778ff-f30a-4c52-83d6-e8660746cd57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:16.163640 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699778ff-f30a-4c52-83d6-e8660746cd57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:16.166155 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699778ff-f30a-4c52-83d6-e8660746cd57 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:16.183327 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 615/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:16.189421 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029286df-65bd-4b74-9aca-b3c9899774de None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:16.308569 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029286df-65bd-4b74-9aca-b3c9899774de None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:16.345836 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5be5c-713f-44ce-b8e2-7404369a059c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:16.346647 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5be5c-713f-44ce-b8e2-7404369a059c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:16.348635 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5be5c-713f-44ce-b8e2-7404369a059c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:16.348635 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5be5c-713f-44ce-b8e2-7404369a059c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:16.356806 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5be5c-713f-44ce-b8e2-7404369a059c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:16.358285 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5be5c-713f-44ce-b8e2-7404369a059c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:16.374868 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f3c5be5c-713f-44ce-b8e2-7404369a059c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:09:16.374868 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:16.374868 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:16.374868 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:16.374868 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:16.374868 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:16.374868 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:16.374868 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:16.374868 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:16.374868 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:16.374868 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:16.374868 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:16.374868 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:09:16.374868 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:09:16.374868 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:09:16.374868 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:09:16.376259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:16.376259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:16.376259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:09:16.376259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:09:16.376259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:09:16.376259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:09:16.376259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:16.376259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:16.376259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:16.376259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:16.376259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:16.376259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:09:16.376259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:16.376259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:16.376259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:16.376259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:16.376259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:16.376259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:16.377779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:16.377779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:16.377779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:09:16.377779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:09:16.377779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:09:16.377779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:09:16.377779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:09:16.377779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:09:16.377779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:09:16.377779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:09:16.377779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 624/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:09:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:16.382591 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699778ff-f30a-4c52-83d6-e8660746cd57 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:16.505659 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699778ff-f30a-4c52-83d6-e8660746cd57 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:16.551501 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb9936-0523-4bf1-9f46-27848c259806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:16.552202 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb9936-0523-4bf1-9f46-27848c259806 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:16.552510 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb9936-0523-4bf1-9f46-27848c259806 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:16.552803 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb9936-0523-4bf1-9f46-27848c259806 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:16.553788 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb9936-0523-4bf1-9f46-27848c259806 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:16.554118 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb9936-0523-4bf1-9f46-27848c259806 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:16.555646 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb9936-0523-4bf1-9f46-27848c259806 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:16.577793 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 616/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 9 15:09:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:16.584179 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5be5c-713f-44ce-b8e2-7404369a059c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:16.707330 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5be5c-713f-44ce-b8e2-7404369a059c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:16.747755 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caa91e-906e-47fe-8386-2c25f55d372b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:16.748408 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caa91e-906e-47fe-8386-2c25f55d372b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:16.748762 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caa91e-906e-47fe-8386-2c25f55d372b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:16.749026 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caa91e-906e-47fe-8386-2c25f55d372b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:16.834884 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30caa91e-906e-47fe-8386-2c25f55d372b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:16.836731 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30caa91e-906e-47fe-8386-2c25f55d372b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:16.963178 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 625/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:09:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:09:16.969146 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb9936-0523-4bf1-9f46-27848c259806 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:17.085836 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb9936-0523-4bf1-9f46-27848c259806 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:17.123837 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837853e9-5578-4036-b31e-dc3eba49f2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:17.124711 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837853e9-5578-4036-b31e-dc3eba49f2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:17.124994 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837853e9-5578-4036-b31e-dc3eba49f2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:17.125285 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837853e9-5578-4036-b31e-dc3eba49f2b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:17.137120 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837853e9-5578-4036-b31e-dc3eba49f2b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:17.138583 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837853e9-5578-4036-b31e-dc3eba49f2b1 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:17.158307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-837853e9-5578-4036-b31e-dc3eba49f2b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:17.158307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:17.158307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:17.158307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:17.158307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:17.158307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:17.158307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:17.158307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:17.158307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:17.158307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:17.158307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:17.158307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:17.158307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:09:17.158307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:09:17.158307 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:09:17.159523 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:09:17.159523 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:17.159523 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:17.159523 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:17.159523 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:17.159523 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:17.159523 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:17.159523 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:17.159523 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:09:17.159523 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:17.159523 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:17.159523 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:17.159523 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:17.159523 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:17.159523 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:17.159523 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:17.159523 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:17.161124 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:09:17.161124 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:09:17.161124 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:17.161124 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:09:17.161124 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 617/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:09:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:17.169530 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caa91e-906e-47fe-8386-2c25f55d372b None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:17.281917 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caa91e-906e-47fe-8386-2c25f55d372b None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:17.322525 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed49e7-a636-4b0f-98db-02960ca0a0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:17.323250 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed49e7-a636-4b0f-98db-02960ca0a0ed None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:17.323568 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed49e7-a636-4b0f-98db-02960ca0a0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:17.323850 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed49e7-a636-4b0f-98db-02960ca0a0ed None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:17.324654 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed49e7-a636-4b0f-98db-02960ca0a0ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:17.324964 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed49e7-a636-4b0f-98db-02960ca0a0ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:17.326618 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed49e7-a636-4b0f-98db-02960ca0a0ed None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:17.340756 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 626/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:09:17.347692 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837853e9-5578-4036-b31e-dc3eba49f2b1 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:17.465257 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837853e9-5578-4036-b31e-dc3eba49f2b1 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:17.505292 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e2247-e0f1-4345-bd11-3bb0e03ec68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:17.506243 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e2247-e0f1-4345-bd11-3bb0e03ec68a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:17.506615 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e2247-e0f1-4345-bd11-3bb0e03ec68a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:17.506912 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e2247-e0f1-4345-bd11-3bb0e03ec68a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:17.515575 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e2247-e0f1-4345-bd11-3bb0e03ec68a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:17.517135 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e2247-e0f1-4345-bd11-3bb0e03ec68a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:17.533554 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-9e3e2247-e0f1-4345-bd11-3bb0e03ec68a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:09:17.533554 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:17.533554 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:17.533554 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:17.533554 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:17.533554 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:17.533554 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:17.533554 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:17.533554 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:17.533554 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:17.533554 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:17.533554 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:17.533554 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:09:17.533554 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:09:17.533554 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:09:17.534765 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:09:17.534765 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:17.534765 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:17.534765 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:17.534765 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:17.534765 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:17.534765 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:17.534765 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:17.534765 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:09:17.534765 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:17.534765 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:17.534765 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:17.534765 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:17.534765 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:17.534765 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:17.534765 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:17.534765 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:17.536141 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:09:17.536141 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:09:17.536141 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:09:17.536141 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:09:17.536141 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:09:17.536141 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:09:17.536141 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:09:17.536141 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:09:17.536141 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 618/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:09:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:17.541710 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed49e7-a636-4b0f-98db-02960ca0a0ed None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:17.678182 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed49e7-a636-4b0f-98db-02960ca0a0ed None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:17.719948 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae08732-2ffe-4f45-abfc-a881b2103961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:17.720713 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae08732-2ffe-4f45-abfc-a881b2103961 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:17.721036 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae08732-2ffe-4f45-abfc-a881b2103961 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:17.721330 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae08732-2ffe-4f45-abfc-a881b2103961 None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:17.723431 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae08732-2ffe-4f45-abfc-a881b2103961 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:17.723431 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae08732-2ffe-4f45-abfc-a881b2103961 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:17.725024 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae08732-2ffe-4f45-abfc-a881b2103961 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:17.744291 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 627/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:09:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:09:17.745981 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e2247-e0f1-4345-bd11-3bb0e03ec68a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:17.879832 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e2247-e0f1-4345-bd11-3bb0e03ec68a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:17.928260 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c02fd-637b-46b1-8695-02eaafb9858b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:17.929015 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c02fd-637b-46b1-8695-02eaafb9858b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:17.929300 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c02fd-637b-46b1-8695-02eaafb9858b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:17.929613 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c02fd-637b-46b1-8695-02eaafb9858b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:17.930457 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c02fd-637b-46b1-8695-02eaafb9858b None admin] RBAC: Adding query filter params (role.id=d8aa93d29788400a97d04db10d8fb8d5, scope.project.id=4fcadeae44cc4547905b83bfebec79c7, user.id=2462e1778f3a4f3194a0b5dca13d9777) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:17.930772 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c02fd-637b-46b1-8695-02eaafb9858b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:17.932216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c02fd-637b-46b1-8695-02eaafb9858b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:17.938531 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 619/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:09:17 2022] GET /identity/v3/role_assignments?user.id=2462e1778f3a4f3194a0b5dca13d9777&scope.project.id=4fcadeae44cc4547905b83bfebec79c7&role.id=d8aa93d29788400a97d04db10d8fb8d5 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:20.529063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d71f5-e4d2-4294-834c-3367da701ce5 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:20.529659 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d71f5-e4d2-4294-834c-3367da701ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:20.529659 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d71f5-e4d2-4294-834c-3367da701ce5 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:20.531025 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 628/1247] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:09:20.537535 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509510b2-3590-4a9d-9938-17507bd0470b None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:20.538048 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509510b2-3590-4a9d-9938-17507bd0470b None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:20.538128 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509510b2-3590-4a9d-9938-17507bd0470b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:20.557560 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-509510b2-3590-4a9d-9938-17507bd0470b None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:09:20.558761 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-509510b2-3590-4a9d-9938-17507bd0470b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:09:20.649175 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 620/1248] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:09:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:09:20.686949 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d71f5-e4d2-4294-834c-3367da701ce5 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:20.805769 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d71f5-e4d2-4294-834c-3367da701ce5 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:20.841833 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08531d62-4d00-4452-910e-6afc2a2f4906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:20.842632 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08531d62-4d00-4452-910e-6afc2a2f4906 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:20.842918 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08531d62-4d00-4452-910e-6afc2a2f4906 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:20.843194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08531d62-4d00-4452-910e-6afc2a2f4906 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:20.854134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08531d62-4d00-4452-910e-6afc2a2f4906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:09:20.862070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-08531d62-4d00-4452-910e-6afc2a2f4906 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:09:20.862070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:20.862070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:20.862070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:20.862070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:20.862070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:20.862070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:20.862070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:20.862070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:20.862070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:20.862070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:20.862070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:20.862070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:09:20.862070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:09:20.862070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:09:20.862070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:09:20.863867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:09:20.863867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:09:20.863867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:09:20.863867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:09:20.863867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:20.863867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:20.863867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:20.863867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:20.863867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:20.863867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:20.863867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:20.863867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:09:20.863867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:20.863867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:20.863867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:20.863867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:20.864747 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:20.864747 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:20.864747 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:20.864747 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:20.864747 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:09:20.864747 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:09:20.864747 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:09:20.864747 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:09:20.864747 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:09:20.864747 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:09:20.864747 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:09:20.864747 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:09:20.864747 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 629/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:09:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:20.870849 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509510b2-3590-4a9d-9938-17507bd0470b None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:20.984133 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509510b2-3590-4a9d-9938-17507bd0470b None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:21.021579 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b4494-8954-4257-a969-9a4a2bfad495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:21.022212 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b4494-8954-4257-a969-9a4a2bfad495 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:21.022658 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b4494-8954-4257-a969-9a4a2bfad495 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:21.022911 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b4494-8954-4257-a969-9a4a2bfad495 None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:21.023762 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b4494-8954-4257-a969-9a4a2bfad495 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:21.024121 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b4494-8954-4257-a969-9a4a2bfad495 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:21.025580 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b4494-8954-4257-a969-9a4a2bfad495 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:21.040779 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 621/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:09:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:21.042309 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08531d62-4d00-4452-910e-6afc2a2f4906 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:21.164596 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08531d62-4d00-4452-910e-6afc2a2f4906 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:21.204583 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4d4c1-245f-4d9b-bf64-596989da0bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:21.205386 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4d4c1-245f-4d9b-bf64-596989da0bda None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:21.205722 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4d4c1-245f-4d9b-bf64-596989da0bda None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:21.205974 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4d4c1-245f-4d9b-bf64-596989da0bda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:21.219883 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4d4c1-245f-4d9b-bf64-596989da0bda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:21.221717 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4d4c1-245f-4d9b-bf64-596989da0bda None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:21.242411 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-f6f4d4c1-245f-4d9b-bf64-596989da0bda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:21.242411 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:21.242411 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:21.242411 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:21.242411 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:21.242411 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:21.242411 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:21.242411 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:21.242411 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:21.242411 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:21.242411 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:21.242411 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:21.242411 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:09:21.242411 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:09:21.242411 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:09:21.244205 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:09:21.244205 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:21.244205 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:21.244205 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:21.244205 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:21.244205 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:21.244205 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:21.244205 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:21.244205 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:09:21.244205 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:21.244205 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:21.244205 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:21.244205 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:21.244205 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:21.244205 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:21.244205 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:21.244205 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:21.246019 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:09:21.246019 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:09:21.246019 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:21.246019 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:09:21.246019 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 630/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:09:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:21.249718 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b4494-8954-4257-a969-9a4a2bfad495 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:21.360605 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b4494-8954-4257-a969-9a4a2bfad495 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:21.401043 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2047e-79bc-4004-9038-92453c355a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:21.401786 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2047e-79bc-4004-9038-92453c355a48 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:21.402068 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2047e-79bc-4004-9038-92453c355a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:21.402348 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2047e-79bc-4004-9038-92453c355a48 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:21.403188 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2047e-79bc-4004-9038-92453c355a48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:21.403527 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2047e-79bc-4004-9038-92453c355a48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:21.404968 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2047e-79bc-4004-9038-92453c355a48 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:21.427803 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 622/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:21.433633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4d4c1-245f-4d9b-bf64-596989da0bda None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:21.548883 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4d4c1-245f-4d9b-bf64-596989da0bda None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:21.590990 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ff244-1ce5-41aa-92e6-f9d3f143ee8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:21.591949 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ff244-1ce5-41aa-92e6-f9d3f143ee8c None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:21.592237 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ff244-1ce5-41aa-92e6-f9d3f143ee8c None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:21.592542 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ff244-1ce5-41aa-92e6-f9d3f143ee8c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:21.602156 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ff244-1ce5-41aa-92e6-f9d3f143ee8c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:21.603760 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ff244-1ce5-41aa-92e6-f9d3f143ee8c None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:21.620730 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-675ff244-1ce5-41aa-92e6-f9d3f143ee8c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:09:21.620730 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:21.620730 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:21.620730 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:21.620730 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:21.620730 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:21.620730 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:21.620730 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:21.620730 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:21.620730 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:21.620730 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:21.620730 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:21.620730 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:09:21.620730 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:09:21.620730 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:09:21.620730 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:09:21.622063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:21.622063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:21.622063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:09:21.622063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:09:21.622063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:09:21.622063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:09:21.622063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:21.622063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:21.622063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:21.622063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:21.622063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:21.622063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:09:21.622063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:21.622063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:21.622063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:21.622063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:21.622063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:21.622063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:21.623041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:21.623041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:21.623041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:09:21.623041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:09:21.623041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:09:21.623041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:09:21.623041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:09:21.623041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:09:21.623041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:09:21.623041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:09:21.623041 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 631/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:09:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:21.630198 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2047e-79bc-4004-9038-92453c355a48 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:21.745708 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2047e-79bc-4004-9038-92453c355a48 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:21.782225 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c689477-e64a-4c51-8e3c-46459560bb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:21.782920 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c689477-e64a-4c51-8e3c-46459560bb95 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:21.783202 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c689477-e64a-4c51-8e3c-46459560bb95 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:21.783479 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c689477-e64a-4c51-8e3c-46459560bb95 None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:21.784911 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c689477-e64a-4c51-8e3c-46459560bb95 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:21.785280 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c689477-e64a-4c51-8e3c-46459560bb95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:21.786790 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c689477-e64a-4c51-8e3c-46459560bb95 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:21.813066 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 623/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 9 15:09:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:09:21.814084 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ff244-1ce5-41aa-92e6-f9d3f143ee8c None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:21.937434 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ff244-1ce5-41aa-92e6-f9d3f143ee8c None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:21.974469 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8734f93-7ed4-479b-aa39-27fc37f6ec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:21.975137 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8734f93-7ed4-479b-aa39-27fc37f6ec26 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:21.975424 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8734f93-7ed4-479b-aa39-27fc37f6ec26 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:21.975700 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8734f93-7ed4-479b-aa39-27fc37f6ec26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:22.049597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8734f93-7ed4-479b-aa39-27fc37f6ec26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:22.051107 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8734f93-7ed4-479b-aa39-27fc37f6ec26 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:22.161563 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 632/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:09:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:09:22.167298 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c689477-e64a-4c51-8e3c-46459560bb95 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:22.274134 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c689477-e64a-4c51-8e3c-46459560bb95 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:22.309596 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd61db-5687-4bc6-a8e0-195d2f72bd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:22.310389 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd61db-5687-4bc6-a8e0-195d2f72bd2b None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:22.310669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd61db-5687-4bc6-a8e0-195d2f72bd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:22.310940 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd61db-5687-4bc6-a8e0-195d2f72bd2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:22.321795 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd61db-5687-4bc6-a8e0-195d2f72bd2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:22.323231 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd61db-5687-4bc6-a8e0-195d2f72bd2b None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:22.344369 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-81bd61db-5687-4bc6-a8e0-195d2f72bd2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:22.344369 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:22.344369 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:22.344369 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:22.344369 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:22.344369 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:22.344369 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:22.344369 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:22.344369 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:22.344369 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:22.344369 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:22.344369 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:22.344369 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:09:22.344369 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:09:22.344369 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:09:22.345598 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:09:22.345598 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:22.345598 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:22.345598 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:22.345598 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:22.345598 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:22.345598 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:22.345598 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:22.345598 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:09:22.345598 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:22.345598 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:22.345598 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:22.345598 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:22.345598 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:22.345598 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:22.345598 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:22.345598 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:22.346558 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:09:22.346558 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:09:22.346558 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:22.346558 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:09:22.346558 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 624/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:09:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:22.351645 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8734f93-7ed4-479b-aa39-27fc37f6ec26 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:22.449584 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8734f93-7ed4-479b-aa39-27fc37f6ec26 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:22.494589 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b13e0-e7db-4da1-b1dc-491d0f5baf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:22.495492 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b13e0-e7db-4da1-b1dc-491d0f5baf9a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:22.495891 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b13e0-e7db-4da1-b1dc-491d0f5baf9a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:22.496281 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b13e0-e7db-4da1-b1dc-491d0f5baf9a None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:22.497344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b13e0-e7db-4da1-b1dc-491d0f5baf9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:22.497804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b13e0-e7db-4da1-b1dc-491d0f5baf9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:22.499759 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b13e0-e7db-4da1-b1dc-491d0f5baf9a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:22.513219 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 633/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:22.519617 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd61db-5687-4bc6-a8e0-195d2f72bd2b None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:22.623086 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd61db-5687-4bc6-a8e0-195d2f72bd2b None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:22.657587 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762de072-a3da-4fbd-80cb-ae84ac07c578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:22.658377 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762de072-a3da-4fbd-80cb-ae84ac07c578 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:22.658669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762de072-a3da-4fbd-80cb-ae84ac07c578 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:22.658947 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762de072-a3da-4fbd-80cb-ae84ac07c578 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:22.666068 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762de072-a3da-4fbd-80cb-ae84ac07c578 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:22.667497 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762de072-a3da-4fbd-80cb-ae84ac07c578 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:22.682503 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-762de072-a3da-4fbd-80cb-ae84ac07c578 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:09:22.682503 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:22.682503 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:22.682503 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:22.682503 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:22.682503 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:22.682503 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:22.682503 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:22.682503 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:22.682503 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:22.682503 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:22.682503 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:22.682503 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:09:22.682503 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:09:22.682503 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:09:22.683589 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:09:22.683589 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:22.683589 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:22.683589 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:22.683589 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:22.683589 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:22.683589 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:22.683589 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:22.683589 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:09:22.683589 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:22.683589 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:22.683589 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:22.683589 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:22.683589 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:22.683589 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:22.683589 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:22.683589 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:22.684585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:09:22.684585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:09:22.684585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:09:22.684585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:09:22.684585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:09:22.684585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:09:22.684585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:09:22.684585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:09:22.684585 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 625/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:09:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:22.689632 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b13e0-e7db-4da1-b1dc-491d0f5baf9a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:22.790205 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b13e0-e7db-4da1-b1dc-491d0f5baf9a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:22.825172 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379c802-d2da-4c4a-9b86-89239375bf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:22.825864 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379c802-d2da-4c4a-9b86-89239375bf2d None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:22.826148 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379c802-d2da-4c4a-9b86-89239375bf2d None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:22.826423 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379c802-d2da-4c4a-9b86-89239375bf2d None admin] PATH_INFO: `/v3/projects` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:22.827213 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379c802-d2da-4c4a-9b86-89239375bf2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:22.827521 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379c802-d2da-4c4a-9b86-89239375bf2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:22.828957 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379c802-d2da-4c4a-9b86-89239375bf2d None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:22.843087 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 634/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:09:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:22.850528 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762de072-a3da-4fbd-80cb-ae84ac07c578 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:22.960001 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762de072-a3da-4fbd-80cb-ae84ac07c578 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:22.992587 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf3e25-de64-4ed0-a484-f7c2c12c55bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:22.993225 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf3e25-de64-4ed0-a484-f7c2c12c55bb None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:22.993535 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf3e25-de64-4ed0-a484-f7c2c12c55bb None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:22.993811 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf3e25-de64-4ed0-a484-f7c2c12c55bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:22.994637 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf3e25-de64-4ed0-a484-f7c2c12c55bb None admin] RBAC: Adding query filter params (role.id=3409f00ead9e455182684faa27b1f8f0, scope.project.id=4fcadeae44cc4547905b83bfebec79c7, user.id=2462e1778f3a4f3194a0b5dca13d9777) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:22.994948 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf3e25-de64-4ed0-a484-f7c2c12c55bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:22.996359 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf3e25-de64-4ed0-a484-f7c2c12c55bb None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:23.001722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 626/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:09:22 2022] GET /identity/v3/role_assignments?user.id=2462e1778f3a4f3194a0b5dca13d9777&scope.project.id=4fcadeae44cc4547905b83bfebec79c7&role.id=3409f00ead9e455182684faa27b1f8f0 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:25.220230 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ed85e-f542-4120-9098-d84ff558f912 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:25.220869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ed85e-f542-4120-9098-d84ff558f912 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:25.220869 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ed85e-f542-4120-9098-d84ff558f912 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:25.222804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 635/1261] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:09:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:09:25.227806 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9776b7d-09dc-4003-a283-80de29330a54 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:25.228249 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9776b7d-09dc-4003-a283-80de29330a54 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:25.228358 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9776b7d-09dc-4003-a283-80de29330a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:25.244900 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-e9776b7d-09dc-4003-a283-80de29330a54 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:09:25.246105 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e9776b7d-09dc-4003-a283-80de29330a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:09:25.310766 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 627/1262] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:09:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:09:25.334607 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ed85e-f542-4120-9098-d84ff558f912 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:25.431171 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ed85e-f542-4120-9098-d84ff558f912 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:25.464107 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e76da-c4ed-41cb-b179-ce71ec63b3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:25.464888 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e76da-c4ed-41cb-b179-ce71ec63b3ff None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:25.465170 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e76da-c4ed-41cb-b179-ce71ec63b3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:25.465475 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e76da-c4ed-41cb-b179-ce71ec63b3ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:25.475718 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e76da-c4ed-41cb-b179-ce71ec63b3ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:09:25.483141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-c81e76da-c4ed-41cb-b179-ce71ec63b3ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:09:25.483141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:25.483141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:25.483141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:25.483141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:25.483141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:25.483141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:25.483141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:25.483141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:25.483141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:25.483141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:25.483141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:25.483141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:09:25.483141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:09:25.483141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:09:25.483141 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:09:25.484331 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:09:25.484331 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:09:25.484331 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:09:25.484331 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:09:25.484331 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:25.484331 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:25.484331 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:25.484331 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:25.484331 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:25.484331 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:25.484331 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:25.484331 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:09:25.484331 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:25.484331 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:25.484331 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:25.484331 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:25.485584 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:25.485584 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:25.485584 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:25.485584 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:25.485584 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:09:25.485584 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:09:25.485584 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:09:25.485584 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:09:25.485584 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:09:25.485584 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:09:25.485584 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:09:25.485584 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:09:25.485584 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 636/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:09:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:25.490956 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9776b7d-09dc-4003-a283-80de29330a54 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:25.587861 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9776b7d-09dc-4003-a283-80de29330a54 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:25.620452 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934e60c-5be4-45de-a344-d5d100a7dc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:25.621108 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934e60c-5be4-45de-a344-d5d100a7dc8c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:25.621412 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934e60c-5be4-45de-a344-d5d100a7dc8c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:25.621698 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934e60c-5be4-45de-a344-d5d100a7dc8c None admin] PATH_INFO: `/v3/roles` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:25.622437 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934e60c-5be4-45de-a344-d5d100a7dc8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:25.622745 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934e60c-5be4-45de-a344-d5d100a7dc8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:25.624095 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934e60c-5be4-45de-a344-d5d100a7dc8c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:25.632868 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 628/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:09:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:25.638779 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e76da-c4ed-41cb-b179-ce71ec63b3ff None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:25.736822 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e76da-c4ed-41cb-b179-ce71ec63b3ff None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:25.770383 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443c880-3973-40cd-8f0d-7b31d7894ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:25.771163 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443c880-3973-40cd-8f0d-7b31d7894ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:25.771449 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443c880-3973-40cd-8f0d-7b31d7894ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:25.771726 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443c880-3973-40cd-8f0d-7b31d7894ff8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:25.781805 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1443c880-3973-40cd-8f0d-7b31d7894ff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:25.783246 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1443c880-3973-40cd-8f0d-7b31d7894ff8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:25.800784 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-1443c880-3973-40cd-8f0d-7b31d7894ff8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:25.800784 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:25.800784 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:25.800784 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:25.800784 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:25.800784 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:25.800784 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:25.800784 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:25.800784 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:25.800784 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:25.800784 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:25.800784 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:25.800784 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:09:25.800784 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:09:25.800784 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:09:25.802068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:09:25.802068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:25.802068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:25.802068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:25.802068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:25.802068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:25.802068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:25.802068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:25.802068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:09:25.802068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:25.802068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:25.802068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:25.802068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:25.802068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:25.802068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:25.802068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:25.802068 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:25.807761 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:09:25.807761 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:09:25.807761 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:25.807761 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:09:25.807761 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 637/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:09:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:25.808144 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934e60c-5be4-45de-a344-d5d100a7dc8c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:25.915493 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934e60c-5be4-45de-a344-d5d100a7dc8c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:25.953009 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78712a7-24a2-44ce-b655-e49d186e652c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:25.953688 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78712a7-24a2-44ce-b655-e49d186e652c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:25.953972 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78712a7-24a2-44ce-b655-e49d186e652c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:25.954246 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78712a7-24a2-44ce-b655-e49d186e652c None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:25.954955 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78712a7-24a2-44ce-b655-e49d186e652c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:25.955266 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78712a7-24a2-44ce-b655-e49d186e652c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:25.956610 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78712a7-24a2-44ce-b655-e49d186e652c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:25.967838 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 629/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:25.973664 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443c880-3973-40cd-8f0d-7b31d7894ff8 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:26.068719 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443c880-3973-40cd-8f0d-7b31d7894ff8 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:26.100975 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0193d1-3214-45de-864f-2b01189d4d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:26.101794 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0193d1-3214-45de-864f-2b01189d4d57 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:26.102085 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0193d1-3214-45de-864f-2b01189d4d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:26.102363 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0193d1-3214-45de-864f-2b01189d4d57 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:26.109987 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0193d1-3214-45de-864f-2b01189d4d57 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:26.111430 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0193d1-3214-45de-864f-2b01189d4d57 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:26.126453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-be0193d1-3214-45de-864f-2b01189d4d57 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:09:26.126453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:26.126453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:26.126453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:26.126453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:26.126453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:26.126453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:26.126453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:26.126453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:26.126453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:26.126453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:26.126453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:26.126453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:09:26.126453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:09:26.126453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:09:26.126453 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:09:26.127436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:26.127436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:26.127436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:09:26.127436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:09:26.127436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:09:26.127436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:09:26.127436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:26.127436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:26.127436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:26.127436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:26.127436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:26.127436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:09:26.127436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:26.127436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:26.127436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:26.127436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:26.127436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:26.127436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:26.128848 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:26.128848 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:26.128848 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:09:26.128848 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:09:26.128848 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:09:26.128848 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:09:26.128848 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:09:26.128848 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:09:26.128848 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:09:26.128848 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:09:26.128848 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 638/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:09:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:26.133994 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78712a7-24a2-44ce-b655-e49d186e652c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:26.230722 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78712a7-24a2-44ce-b655-e49d186e652c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:26.265853 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bd0dd-e913-49bd-9179-d04c559371cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:26.266512 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bd0dd-e913-49bd-9179-d04c559371cc None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:26.266798 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bd0dd-e913-49bd-9179-d04c559371cc None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:26.267075 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bd0dd-e913-49bd-9179-d04c559371cc None admin] PATH_INFO: `/v3/users` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:26.267902 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bd0dd-e913-49bd-9179-d04c559371cc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:26.268214 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bd0dd-e913-49bd-9179-d04c559371cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:26.270135 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bd0dd-e913-49bd-9179-d04c559371cc None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:26.287450 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 630/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 9 15:09:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:26.293032 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0193d1-3214-45de-864f-2b01189d4d57 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:26.390501 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0193d1-3214-45de-864f-2b01189d4d57 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:26.423949 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06005a27-a459-4a8e-857b-656fe740f1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:26.424663 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06005a27-a459-4a8e-857b-656fe740f1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:26.425160 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06005a27-a459-4a8e-857b-656fe740f1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:26.425911 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06005a27-a459-4a8e-857b-656fe740f1f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:26.436256 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06005a27-a459-4a8e-857b-656fe740f1f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:26.437743 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06005a27-a459-4a8e-857b-656fe740f1f8 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:26.454354 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-06005a27-a459-4a8e-857b-656fe740f1f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:26.454354 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:26.454354 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:26.454354 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:26.454354 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:26.454354 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:26.454354 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:26.454354 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:26.454354 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:26.454354 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:26.454354 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:26.454354 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:26.454354 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:09:26.454354 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:09:26.454354 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:09:26.455418 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:09:26.455418 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:26.455418 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:26.455418 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:26.455418 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:26.455418 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:26.455418 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:26.455418 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:26.455418 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:09:26.455418 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:26.455418 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:26.455418 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:26.455418 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:26.455418 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:26.455418 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:26.455418 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:26.455418 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:26.457010 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:09:26.457010 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:09:26.457010 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:26.457010 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:09:26.457010 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 639/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:09:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:26.462265 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bd0dd-e913-49bd-9179-d04c559371cc None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:26.561149 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bd0dd-e913-49bd-9179-d04c559371cc None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:26.595345 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378ddda-ca2a-4d29-bd4a-50eaa18f52a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:26.596010 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378ddda-ca2a-4d29-bd4a-50eaa18f52a4 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:26.596300 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378ddda-ca2a-4d29-bd4a-50eaa18f52a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:26.596580 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378ddda-ca2a-4d29-bd4a-50eaa18f52a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:26.598505 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378ddda-ca2a-4d29-bd4a-50eaa18f52a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:26.598820 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378ddda-ca2a-4d29-bd4a-50eaa18f52a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:26.600179 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378ddda-ca2a-4d29-bd4a-50eaa18f52a4 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:26.611476 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 631/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:26.617344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06005a27-a459-4a8e-857b-656fe740f1f8 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:26.709643 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06005a27-a459-4a8e-857b-656fe740f1f8 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:26.741701 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3c592-9996-45c8-b51e-1d1a24cd1f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:26.742477 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3c592-9996-45c8-b51e-1d1a24cd1f7e None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:26.742757 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3c592-9996-45c8-b51e-1d1a24cd1f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:26.743025 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3c592-9996-45c8-b51e-1d1a24cd1f7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:26.749342 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3c592-9996-45c8-b51e-1d1a24cd1f7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:26.750791 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3c592-9996-45c8-b51e-1d1a24cd1f7e None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:26.765086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-38e3c592-9996-45c8-b51e-1d1a24cd1f7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:09:26.765086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:26.765086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:26.765086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:26.765086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:26.765086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:26.765086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:26.765086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:26.765086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:26.765086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:26.765086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:26.765086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:26.765086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:09:26.765086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:09:26.765086 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:09:26.766164 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:09:26.766164 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:26.766164 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:26.766164 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:26.766164 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:26.766164 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:26.766164 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:26.766164 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:26.766164 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:09:26.766164 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:26.766164 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:26.766164 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:26.766164 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:26.766164 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:26.766164 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:26.766164 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:26.766164 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:26.767132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:09:26.767132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:09:26.767132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:09:26.767132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:09:26.767132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:09:26.767132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:09:26.767132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:09:26.767132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:09:26.767132 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 640/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:09:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:26.773048 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378ddda-ca2a-4d29-bd4a-50eaa18f52a4 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:26.868977 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378ddda-ca2a-4d29-bd4a-50eaa18f52a4 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:26.907175 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dc96d-2875-46ae-8ad4-be8e0322d2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:26.907836 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dc96d-2875-46ae-8ad4-be8e0322d2cf None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:26.908118 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dc96d-2875-46ae-8ad4-be8e0322d2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:26.908390 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dc96d-2875-46ae-8ad4-be8e0322d2cf None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:26.909241 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93dc96d-2875-46ae-8ad4-be8e0322d2cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:26.909592 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93dc96d-2875-46ae-8ad4-be8e0322d2cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:26.911031 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93dc96d-2875-46ae-8ad4-be8e0322d2cf None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:26.923089 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 632/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:09:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:26.929166 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3c592-9996-45c8-b51e-1d1a24cd1f7e None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:27.022945 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3c592-9996-45c8-b51e-1d1a24cd1f7e None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:27.054638 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef227cc-03b5-4752-9830-d45fac8b8d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:27.055507 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef227cc-03b5-4752-9830-d45fac8b8d94 None admin] REQUEST_METHOD: `PUT` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:27.055786 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef227cc-03b5-4752-9830-d45fac8b8d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:27.056058 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef227cc-03b5-4752-9830-d45fac8b8d94 None admin] PATH_INFO: `/v3/projects/4fcadeae44cc4547905b83bfebec79c7/users/2462e1778f3a4f3194a0b5dca13d9777/roles/3409f00ead9e455182684faa27b1f8f0` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:27.058010 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef227cc-03b5-4752-9830-d45fac8b8d94 None admin] RBAC: Authorizing `identity:create_grant(project_id=4fcadeae44cc4547905b83bfebec79c7, user_id=2462e1778f3a4f3194a0b5dca13d9777, role_id=3409f00ead9e455182684faa27b1f8f0)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:27.059435 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef227cc-03b5-4752-9830-d45fac8b8d94 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:27.072447 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 641/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:09:26 2022] PUT /identity/v3/projects/4fcadeae44cc4547905b83bfebec79c7/users/2462e1778f3a4f3194a0b5dca13d9777/roles/3409f00ead9e455182684faa27b1f8f0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:09:29.308575 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492edbe4-f96b-4dce-8a72-3d0c563583f7 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:29.309134 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492edbe4-f96b-4dce-8a72-3d0c563583f7 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:29.309134 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492edbe4-f96b-4dce-8a72-3d0c563583f7 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:29.310501 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 633/1274] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:09:29.316760 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596a976-a6d5-4bdb-bc00-4d50838f3549 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:29.317140 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596a976-a6d5-4bdb-bc00-4d50838f3549 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:29.317354 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596a976-a6d5-4bdb-bc00-4d50838f3549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:29.334221 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6596a976-a6d5-4bdb-bc00-4d50838f3549 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:09:29.335396 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6596a976-a6d5-4bdb-bc00-4d50838f3549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:09:29.398463 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 642/1275] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:09:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:09:29.421703 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492edbe4-f96b-4dce-8a72-3d0c563583f7 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:29.517555 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492edbe4-f96b-4dce-8a72-3d0c563583f7 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:29.550252 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411fe4a-ca41-4b51-a381-73bb3ed08550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:29.551069 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411fe4a-ca41-4b51-a381-73bb3ed08550 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:29.551353 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411fe4a-ca41-4b51-a381-73bb3ed08550 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:29.551629 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411fe4a-ca41-4b51-a381-73bb3ed08550 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:29.561305 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411fe4a-ca41-4b51-a381-73bb3ed08550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:09:29.569345 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-d411fe4a-ca41-4b51-a381-73bb3ed08550 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:09:29.569345 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:29.569345 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:29.569345 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:29.569345 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:29.569345 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:29.569345 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:29.569345 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:29.569345 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:29.569345 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:29.569345 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:29.569345 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:29.569345 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:09:29.569345 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:09:29.569345 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:09:29.569345 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:09:29.570536 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:09:29.570536 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:09:29.570536 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:09:29.570536 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:09:29.570536 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:29.570536 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:29.570536 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:29.570536 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:29.570536 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:29.570536 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:29.570536 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:29.570536 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:09:29.570536 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:29.570536 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:29.570536 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:29.570536 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:29.571630 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:29.571630 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:29.571630 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:29.571630 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:29.571630 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:09:29.571630 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:09:29.571630 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:09:29.571630 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:09:29.571630 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:09:29.571630 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:09:29.571630 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:09:29.571630 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:09:29.571630 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 634/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:09:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:29.576649 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596a976-a6d5-4bdb-bc00-4d50838f3549 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:29.669884 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596a976-a6d5-4bdb-bc00-4d50838f3549 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:29.702895 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d54158-b074-4de2-9282-78832459478a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:29.703555 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d54158-b074-4de2-9282-78832459478a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:29.703837 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d54158-b074-4de2-9282-78832459478a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:29.704113 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d54158-b074-4de2-9282-78832459478a None admin] PATH_INFO: `/v3/roles` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:29.704858 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d54158-b074-4de2-9282-78832459478a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:29.705167 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d54158-b074-4de2-9282-78832459478a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:29.706587 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d54158-b074-4de2-9282-78832459478a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:29.714323 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 643/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:09:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:29.720003 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411fe4a-ca41-4b51-a381-73bb3ed08550 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:29.818921 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411fe4a-ca41-4b51-a381-73bb3ed08550 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:29.851090 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b831542-e956-4b46-9bdd-e7367ae3a68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:29.851872 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b831542-e956-4b46-9bdd-e7367ae3a68f None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:29.852158 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b831542-e956-4b46-9bdd-e7367ae3a68f None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:29.852436 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b831542-e956-4b46-9bdd-e7367ae3a68f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:29.863652 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b831542-e956-4b46-9bdd-e7367ae3a68f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:29.865519 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b831542-e956-4b46-9bdd-e7367ae3a68f None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:29.888834 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-7b831542-e956-4b46-9bdd-e7367ae3a68f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:29.888834 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:29.888834 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:29.888834 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:29.888834 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:29.888834 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:29.888834 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:29.888834 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:29.888834 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:29.888834 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:29.888834 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:29.888834 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:29.888834 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:09:29.888834 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:09:29.888834 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:09:29.889894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:09:29.889894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:29.889894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:29.889894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:29.889894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:29.889894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:29.889894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:29.889894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:29.889894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:09:29.889894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:29.889894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:29.889894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:29.889894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:29.889894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:29.889894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:29.889894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:29.889894 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:29.890829 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:09:29.890829 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:09:29.890829 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:29.890829 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:09:29.890829 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 635/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:09:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:29.898539 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d54158-b074-4de2-9282-78832459478a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:30.010183 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d54158-b074-4de2-9282-78832459478a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:30.041850 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14312624-b1f7-4314-bc8f-b810296c0f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:30.042498 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14312624-b1f7-4314-bc8f-b810296c0f3a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:30.042785 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14312624-b1f7-4314-bc8f-b810296c0f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:30.043057 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14312624-b1f7-4314-bc8f-b810296c0f3a None admin] PATH_INFO: `/v3/domains` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:30.043765 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14312624-b1f7-4314-bc8f-b810296c0f3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:30.044065 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14312624-b1f7-4314-bc8f-b810296c0f3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:30.045428 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14312624-b1f7-4314-bc8f-b810296c0f3a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:30.057152 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 644/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:30.062906 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b831542-e956-4b46-9bdd-e7367ae3a68f None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:30.160738 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b831542-e956-4b46-9bdd-e7367ae3a68f None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:30.191892 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5eb24a-d54a-4aef-b1be-7d8021eb57fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:30.192680 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5eb24a-d54a-4aef-b1be-7d8021eb57fc None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:30.192960 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5eb24a-d54a-4aef-b1be-7d8021eb57fc None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:30.193233 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5eb24a-d54a-4aef-b1be-7d8021eb57fc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:30.200479 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5eb24a-d54a-4aef-b1be-7d8021eb57fc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:30.201946 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5eb24a-d54a-4aef-b1be-7d8021eb57fc None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:30.216368 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-af5eb24a-d54a-4aef-b1be-7d8021eb57fc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:09:30.216368 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:30.216368 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:30.216368 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:30.216368 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:30.216368 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:30.216368 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:30.216368 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:30.216368 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:30.216368 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:30.216368 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:30.216368 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:30.216368 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:09:30.216368 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:09:30.216368 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:09:30.216368 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:09:30.217451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:30.217451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:30.217451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:09:30.217451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:09:30.217451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:09:30.217451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:09:30.217451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:30.217451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:30.217451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:30.217451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:30.217451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:30.217451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:09:30.217451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:30.217451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:30.217451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:30.217451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:30.217451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:30.217451 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:30.218538 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:30.218538 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:30.218538 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:09:30.218538 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:09:30.218538 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:09:30.218538 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:09:30.218538 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:09:30.218538 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:09:30.218538 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:09:30.218538 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:09:30.218538 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 636/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:09:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:30.224259 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14312624-b1f7-4314-bc8f-b810296c0f3a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:30.320024 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14312624-b1f7-4314-bc8f-b810296c0f3a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:30.352218 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67874b-1458-46cb-98c1-0281707a977a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:30.352877 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67874b-1458-46cb-98c1-0281707a977a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:30.353156 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67874b-1458-46cb-98c1-0281707a977a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:30.353456 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67874b-1458-46cb-98c1-0281707a977a None admin] PATH_INFO: `/v3/users` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:30.354287 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67874b-1458-46cb-98c1-0281707a977a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:30.354593 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67874b-1458-46cb-98c1-0281707a977a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:30.356001 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67874b-1458-46cb-98c1-0281707a977a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:30.372368 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 645/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 9 15:09:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:30.378782 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5eb24a-d54a-4aef-b1be-7d8021eb57fc None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:30.476119 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5eb24a-d54a-4aef-b1be-7d8021eb57fc None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:30.507929 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a733a0-f763-485e-bc40-151ebe78479c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:30.508569 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a733a0-f763-485e-bc40-151ebe78479c None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:30.508851 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a733a0-f763-485e-bc40-151ebe78479c None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:30.509127 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a733a0-f763-485e-bc40-151ebe78479c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:30.582844 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a733a0-f763-485e-bc40-151ebe78479c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:30.584269 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a733a0-f763-485e-bc40-151ebe78479c None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:30.683040 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 637/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:09:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:09:30.688860 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67874b-1458-46cb-98c1-0281707a977a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:30.784930 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67874b-1458-46cb-98c1-0281707a977a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:30.817626 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc318b3f-1ee9-4817-a656-21eb18346974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:30.818407 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc318b3f-1ee9-4817-a656-21eb18346974 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:30.818690 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc318b3f-1ee9-4817-a656-21eb18346974 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:30.818966 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc318b3f-1ee9-4817-a656-21eb18346974 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:30.828512 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc318b3f-1ee9-4817-a656-21eb18346974 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:30.829986 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc318b3f-1ee9-4817-a656-21eb18346974 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:30.847987 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-bc318b3f-1ee9-4817-a656-21eb18346974 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:30.847987 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:30.847987 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:30.847987 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:30.847987 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:30.847987 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:30.847987 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:30.847987 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:30.847987 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:30.847987 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:30.847987 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:30.847987 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:30.847987 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:09:30.847987 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:09:30.847987 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:09:30.849145 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:09:30.849145 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:30.849145 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:30.849145 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:30.849145 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:30.849145 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:30.849145 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:30.849145 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:30.849145 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:09:30.849145 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:30.849145 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:30.849145 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:30.849145 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:30.849145 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:30.849145 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:30.849145 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:30.849145 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:30.850326 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:09:30.850326 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:09:30.850326 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:09:30.850326 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:09:30.850326 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 646/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:09:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:30.855080 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a733a0-f763-485e-bc40-151ebe78479c None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:30.952733 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a733a0-f763-485e-bc40-151ebe78479c None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:30.986221 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178efffb-8cec-46f5-845d-e1128698dc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:30.986875 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178efffb-8cec-46f5-845d-e1128698dc4e None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:30.987188 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178efffb-8cec-46f5-845d-e1128698dc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:30.987593 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178efffb-8cec-46f5-845d-e1128698dc4e None admin] PATH_INFO: `/v3/domains` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:30.988313 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178efffb-8cec-46f5-845d-e1128698dc4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:30.988619 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178efffb-8cec-46f5-845d-e1128698dc4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:30.989999 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178efffb-8cec-46f5-845d-e1128698dc4e None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:31.000804 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 638/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:31.006596 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc318b3f-1ee9-4817-a656-21eb18346974 None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:31.101007 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc318b3f-1ee9-4817-a656-21eb18346974 None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:31.133519 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f540f70-1aa2-43bf-af7c-3cbceb74efdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:31.134318 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f540f70-1aa2-43bf-af7c-3cbceb74efdc None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:31.134597 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f540f70-1aa2-43bf-af7c-3cbceb74efdc None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:31.134867 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f540f70-1aa2-43bf-af7c-3cbceb74efdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:31.141829 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f540f70-1aa2-43bf-af7c-3cbceb74efdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:31.143270 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f540f70-1aa2-43bf-af7c-3cbceb74efdc None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:31.157799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application [None req-6f540f70-1aa2-43bf-af7c-3cbceb74efdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:09:31.157799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:31.157799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:31.157799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:31.157799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:31.157799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:31.157799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:31.157799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:31.157799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:31.157799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:31.157799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:31.157799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:31.157799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:09:31.157799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:09:31.157799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:09:31.158878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:09:31.158878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:31.158878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:31.158878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:31.158878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:31.158878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:31.158878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:31.158878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:31.158878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application with Lock( May 09 15:09:31.158878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:31.158878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:31.158878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:31.158878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:31.158878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:31.158878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:31.158878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:31.158878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:31.160229 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:09:31.160229 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:09:31.160229 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:09:31.160229 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:09:31.160229 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:09:31.160229 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:09:31.160229 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:09:31.160229 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: ERROR keystone.server.flask.application May 09 15:09:31.160229 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 647/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:09:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:31.166027 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178efffb-8cec-46f5-845d-e1128698dc4e None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:31.262367 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178efffb-8cec-46f5-845d-e1128698dc4e None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:31.296681 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8791bf2-a164-410a-9ed1-727752e28143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:31.297354 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8791bf2-a164-410a-9ed1-727752e28143 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:31.297669 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8791bf2-a164-410a-9ed1-727752e28143 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:31.297943 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8791bf2-a164-410a-9ed1-727752e28143 None admin] PATH_INFO: `/v3/projects` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:31.298736 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8791bf2-a164-410a-9ed1-727752e28143 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:31.299043 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8791bf2-a164-410a-9ed1-727752e28143 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:31.300597 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8791bf2-a164-410a-9ed1-727752e28143 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:31.313004 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 639/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:09:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:31.320156 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f540f70-1aa2-43bf-af7c-3cbceb74efdc None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:31.417239 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f540f70-1aa2-43bf-af7c-3cbceb74efdc None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:31.449311 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f8b9a-0779-4308-94ee-2ac7f48e6b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:31.449993 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f8b9a-0779-4308-94ee-2ac7f48e6b9b None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:31.450278 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f8b9a-0779-4308-94ee-2ac7f48e6b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:31.450555 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f8b9a-0779-4308-94ee-2ac7f48e6b9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:31.451383 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f8b9a-0779-4308-94ee-2ac7f48e6b9b None admin] RBAC: Adding query filter params (role.id=3409f00ead9e455182684faa27b1f8f0, scope.project.id=4fcadeae44cc4547905b83bfebec79c7, user.id=2462e1778f3a4f3194a0b5dca13d9777) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:31.451695 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f8b9a-0779-4308-94ee-2ac7f48e6b9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:31.453150 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f8b9a-0779-4308-94ee-2ac7f48e6b9b None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:31.459483 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 648/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:09:31 2022] GET /identity/v3/role_assignments?user.id=2462e1778f3a4f3194a0b5dca13d9777&scope.project.id=4fcadeae44cc4547905b83bfebec79c7&role.id=3409f00ead9e455182684faa27b1f8f0 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:33.818227 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b35ed1-edd7-411d-ad0f-fd957caf47b6 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:33.818794 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b35ed1-edd7-411d-ad0f-fd957caf47b6 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:33.818794 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b35ed1-edd7-411d-ad0f-fd957caf47b6 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:33.820121 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 640/1288] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:09:33.825633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78a0c7-42a1-450c-84e6-c0b94dae43f2 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:33.826102 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78a0c7-42a1-450c-84e6-c0b94dae43f2 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:33.826210 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78a0c7-42a1-450c-84e6-c0b94dae43f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:33.844237 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-ab78a0c7-42a1-450c-84e6-c0b94dae43f2 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:09:33.845486 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-ab78a0c7-42a1-450c-84e6-c0b94dae43f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:09:33.925032 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 649/1289] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:09:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:09:33.952039 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b35ed1-edd7-411d-ad0f-fd957caf47b6 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:34.052342 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b35ed1-edd7-411d-ad0f-fd957caf47b6 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:34.085124 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dd982-fffb-4a55-816f-e845163136ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:34.085860 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dd982-fffb-4a55-816f-e845163136ca None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:34.086140 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dd982-fffb-4a55-816f-e845163136ca None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:34.086410 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dd982-fffb-4a55-816f-e845163136ca None admin] PATH_INFO: `/v3/services/placement` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:34.088841 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dd982-fffb-4a55-816f-e845163136ca None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:34.088841 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dd982-fffb-4a55-816f-e845163136ca None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:34.100699 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-b37dd982-fffb-4a55-816f-e845163136ca None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:09:34.100699 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:34.100699 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:09:34.100699 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:09:34.100699 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:09:34.100699 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:09:34.100699 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:09:34.100699 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:09:34.100699 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:09:34.100699 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:09:34.100699 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:09:34.100699 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:09:34.100699 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:34.100699 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:34.100699 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:34.100699 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:34.100699 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:34.102133 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:34.102133 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:34.102133 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:34.102133 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:34.102133 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:34.102133 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:34.102133 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:09:34.102133 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:09:34.102133 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:09:34.102133 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:09:34.102133 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:34.102133 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:34.102133 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:34.102133 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:34.102133 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:34.102133 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:34.103187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:34.103187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:09:34.103187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:34.103187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:34.103187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:34.103187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:34.103187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:34.103187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:34.103187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:34.103187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:34.103187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:09:34.103187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:09:34.103187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:09:34.103187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:09:34.103187 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 641/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:09:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:34.107993 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78a0c7-42a1-450c-84e6-c0b94dae43f2 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:34.200111 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78a0c7-42a1-450c-84e6-c0b94dae43f2 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:34.232852 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78536ca6-6074-44c5-a88c-3c50f4070cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:34.233536 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78536ca6-6074-44c5-a88c-3c50f4070cbe None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:34.233822 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78536ca6-6074-44c5-a88c-3c50f4070cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:34.234098 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78536ca6-6074-44c5-a88c-3c50f4070cbe None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:34.235055 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78536ca6-6074-44c5-a88c-3c50f4070cbe None admin] RBAC: Adding query filter params (name=placement) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:34.235369 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78536ca6-6074-44c5-a88c-3c50f4070cbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:34.236744 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78536ca6-6074-44c5-a88c-3c50f4070cbe None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:34.241462 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 650/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Mon May 9 15:09:34 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:34.247288 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dd982-fffb-4a55-816f-e845163136ca None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:34.341351 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dd982-fffb-4a55-816f-e845163136ca None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:34.373900 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbc96c-962c-46fa-ac7d-4c7120bfbaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:34.374552 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbc96c-962c-46fa-ac7d-4c7120bfbaec None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:34.374834 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbc96c-962c-46fa-ac7d-4c7120bfbaec None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:34.375107 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbc96c-962c-46fa-ac7d-4c7120bfbaec None admin] PATH_INFO: `/v3/services` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:34.375801 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fbc96c-962c-46fa-ac7d-4c7120bfbaec None admin] RBAC: Adding query filter params (type=placement) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:34.376105 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fbc96c-962c-46fa-ac7d-4c7120bfbaec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:34.377479 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fbc96c-962c-46fa-ac7d-4c7120bfbaec None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:34.382247 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 642/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Mon May 9 15:09:34 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:09:36.648650 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f960c0-c098-478d-8249-7bc8976859e3 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:36.649201 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f960c0-c098-478d-8249-7bc8976859e3 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:36.649201 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f960c0-c098-478d-8249-7bc8976859e3 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:36.650599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 651/1293] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:09:36.655795 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245f98e-2bde-44b9-97d7-8f671b449f4e None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:36.656170 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245f98e-2bde-44b9-97d7-8f671b449f4e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:36.656347 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245f98e-2bde-44b9-97d7-8f671b449f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:36.673701 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-a245f98e-2bde-44b9-97d7-8f671b449f4e None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:09:36.674824 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a245f98e-2bde-44b9-97d7-8f671b449f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:09:36.738812 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 643/1294] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:09:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:09:36.761812 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f960c0-c098-478d-8249-7bc8976859e3 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:36.856000 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f960c0-c098-478d-8249-7bc8976859e3 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:36.893094 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe37aef-f081-4501-abb4-fd0d798d0852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:36.894739 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe37aef-f081-4501-abb4-fd0d798d0852 None admin] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:36.895026 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe37aef-f081-4501-abb4-fd0d798d0852 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:36.895314 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe37aef-f081-4501-abb4-fd0d798d0852 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:36.896091 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe37aef-f081-4501-abb4-fd0d798d0852 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:36.897489 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe37aef-f081-4501-abb4-fd0d798d0852 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:36.912063 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 652/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:09:36 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:09:39.236331 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a9275-006d-4bc5-b688-ba7e39e3946d None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:39.237411 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a9275-006d-4bc5-b688-ba7e39e3946d None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:39.237533 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a9275-006d-4bc5-b688-ba7e39e3946d None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:39.238784 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 644/1296] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:09:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:09:39.243973 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8856b-d83b-4ecc-a33c-86e27661b75a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:39.244353 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8856b-d83b-4ecc-a33c-86e27661b75a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:39.244539 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8856b-d83b-4ecc-a33c-86e27661b75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:39.261801 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-39f8856b-d83b-4ecc-a33c-86e27661b75a None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:09:39.262981 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-39f8856b-d83b-4ecc-a33c-86e27661b75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:09:39.334134 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 653/1297] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:09:39 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:09:39.357130 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a9275-006d-4bc5-b688-ba7e39e3946d None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:39.458248 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a9275-006d-4bc5-b688-ba7e39e3946d None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:39.490784 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019d663-29da-4292-9641-4c90576d1959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:39.491493 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019d663-29da-4292-9641-4c90576d1959 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:39.491768 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019d663-29da-4292-9641-4c90576d1959 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:39.492036 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019d663-29da-4292-9641-4c90576d1959 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:39.492675 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019d663-29da-4292-9641-4c90576d1959 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:39.494063 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019d663-29da-4292-9641-4c90576d1959 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:39.506072 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-3019d663-29da-4292-9641-4c90576d1959 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:09:39.506072 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:39.506072 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:09:39.506072 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:09:39.506072 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:09:39.506072 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:09:39.506072 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:09:39.506072 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:09:39.506072 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:09:39.506072 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:09:39.506072 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:09:39.506072 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:09:39.506072 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:39.506072 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:39.506072 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:39.506072 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:39.506072 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:39.507261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:39.507261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:39.507261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:39.507261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:39.507261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:39.507261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:39.507261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:09:39.507261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:09:39.507261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:09:39.507261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:09:39.507261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:39.507261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:39.507261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:39.507261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:39.507261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:39.507261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:39.508148 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:39.508148 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:09:39.508148 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:39.508148 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:39.508148 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:39.508148 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:39.508148 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:39.508148 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:39.508148 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:39.508148 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:39.508148 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:09:39.508148 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:09:39.508148 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:09:39.508148 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:09:39.508148 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 645/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:09:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:39.513347 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8856b-d83b-4ecc-a33c-86e27661b75a None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:39.606762 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8856b-d83b-4ecc-a33c-86e27661b75a None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:39.640282 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17a5f3-3de2-43ad-91c3-45da986c939a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:39.640945 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17a5f3-3de2-43ad-91c3-45da986c939a None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:39.641229 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17a5f3-3de2-43ad-91c3-45da986c939a None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:39.641523 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17a5f3-3de2-43ad-91c3-45da986c939a None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:39.642236 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17a5f3-3de2-43ad-91c3-45da986c939a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:39.642542 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17a5f3-3de2-43ad-91c3-45da986c939a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:39.643935 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17a5f3-3de2-43ad-91c3-45da986c939a None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:39.648915 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 654/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Mon May 9 15:09:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:39.654855 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019d663-29da-4292-9641-4c90576d1959 None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:39.757589 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019d663-29da-4292-9641-4c90576d1959 None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:39.793687 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169de29-24b4-43d8-9e25-eddf35a84645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:39.794343 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169de29-24b4-43d8-9e25-eddf35a84645 None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:39.794629 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169de29-24b4-43d8-9e25-eddf35a84645 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:39.794908 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169de29-24b4-43d8-9e25-eddf35a84645 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:39.795697 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169de29-24b4-43d8-9e25-eddf35a84645 None admin] RBAC: Adding query filter params (interface=public, service_id=3c6b5288fda34b4bb5f7499b0b2b4475, region_id=RegionOne) {{(pid=80165) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:39.796015 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169de29-24b4-43d8-9e25-eddf35a84645 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:39.797405 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169de29-24b4-43d8-9e25-eddf35a84645 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:39.803295 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 646/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:09:39 2022] GET /identity/v3/endpoints?service_id=3c6b5288fda34b4bb5f7499b0b2b4475&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:39.808976 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17a5f3-3de2-43ad-91c3-45da986c939a None admin] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:39.912848 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17a5f3-3de2-43ad-91c3-45da986c939a None admin] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:39.947365 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784b7d6-6d95-44f2-982f-3d958a8a6d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:39.948034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784b7d6-6d95-44f2-982f-3d958a8a6d80 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:39.948319 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784b7d6-6d95-44f2-982f-3d958a8a6d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:39.948596 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784b7d6-6d95-44f2-982f-3d958a8a6d80 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:39.949281 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784b7d6-6d95-44f2-982f-3d958a8a6d80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:39.950685 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784b7d6-6d95-44f2-982f-3d958a8a6d80 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:39.958832 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 655/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:09:39 2022] GET /identity/v3/services => generated 2191 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:09:42.156440 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5dc32-2a87-483e-9e3f-f910a9eb3d38 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:42.156998 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5dc32-2a87-483e-9e3f-f910a9eb3d38 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:42.157096 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5dc32-2a87-483e-9e3f-f910a9eb3d38 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:42.158458 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 647/1302] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:09:42.164463 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65a380-c2b4-4202-9e27-f45d77a068c4 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:42.164866 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65a380-c2b4-4202-9e27-f45d77a068c4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:42.165023 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65a380-c2b4-4202-9e27-f45d77a068c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:42.182139 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-1e65a380-c2b4-4202-9e27-f45d77a068c4 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:09:42.183319 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-1e65a380-c2b4-4202-9e27-f45d77a068c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:09:42.247480 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 656/1303] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:09:42 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:09:42.271121 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5dc32-2a87-483e-9e3f-f910a9eb3d38 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:42.372002 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5dc32-2a87-483e-9e3f-f910a9eb3d38 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:42.405384 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563c28f-dee7-4382-a07f-1f6fad8dd07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:42.406196 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563c28f-dee7-4382-a07f-1f6fad8dd07a None admin] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:42.406533 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563c28f-dee7-4382-a07f-1f6fad8dd07a None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:42.406761 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563c28f-dee7-4382-a07f-1f6fad8dd07a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:42.407413 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563c28f-dee7-4382-a07f-1f6fad8dd07a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:42.409917 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563c28f-dee7-4382-a07f-1f6fad8dd07a None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:42.421926 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application [None req-c563c28f-dee7-4382-a07f-1f6fad8dd07a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:09:42.421926 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:42.421926 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:09:42.421926 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:09:42.421926 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:09:42.421926 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:09:42.421926 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:09:42.421926 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:09:42.421926 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:09:42.421926 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:09:42.421926 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:09:42.421926 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:09:42.421926 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:09:42.421926 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:09:42.421926 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:09:42.421926 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:09:42.421926 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:09:42.423176 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:09:42.423176 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:09:42.423176 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:09:42.423176 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:09:42.423176 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:09:42.423176 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:09:42.423176 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:09:42.423176 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:09:42.423176 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:09:42.423176 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:09:42.423176 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:09:42.423176 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:09:42.423176 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:09:42.423176 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:09:42.423176 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:09:42.423176 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:09:42.424143 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:09:42.424143 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application with Lock( May 09 15:09:42.424143 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:09:42.424143 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self._enter() May 09 15:09:42.424143 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:09:42.424143 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:09:42.424143 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:09:42.424143 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application return self.creator() May 09 15:09:42.424143 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:09:42.424143 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application created_value = creator( May 09 15:09:42.424143 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:09:42.424143 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:09:42.424143 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:09:42.424143 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: ERROR keystone.server.flask.application May 09 15:09:42.424143 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 648/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:09:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:09:42.429436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65a380-c2b4-4202-9e27-f45d77a068c4 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:42.523342 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65a380-c2b4-4202-9e27-f45d77a068c4 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:42.555877 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf46165-5b78-4992-ad80-8cae0feb6814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:42.556531 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf46165-5b78-4992-ad80-8cae0feb6814 None admin] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:42.556815 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf46165-5b78-4992-ad80-8cae0feb6814 None admin] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:42.557091 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf46165-5b78-4992-ad80-8cae0feb6814 None admin] PATH_INFO: `/v3/services` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:42.557818 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf46165-5b78-4992-ad80-8cae0feb6814 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80164) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:09:42.558124 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf46165-5b78-4992-ad80-8cae0feb6814 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:42.559599 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf46165-5b78-4992-ad80-8cae0feb6814 None admin] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:42.564555 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 657/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Mon May 9 15:09:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:09:42.570916 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563c28f-dee7-4382-a07f-1f6fad8dd07a None admin] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:09:42.670483 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563c28f-dee7-4382-a07f-1f6fad8dd07a None admin] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:09:42.710594 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c34163-692d-409c-a9e2-b27749499fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f27a0181336c474fa1a80c34325076d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:09:42.711249 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c34163-692d-409c-a9e2-b27749499fd7 None admin] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:09:42.711533 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c34163-692d-409c-a9e2-b27749499fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:09:42.711809 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c34163-692d-409c-a9e2-b27749499fd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:09:42.712539 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c34163-692d-409c-a9e2-b27749499fd7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:09:42.713920 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c34163-692d-409c-a9e2-b27749499fd7 None admin] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:09:42.731216 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 649/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:09:42 2022] POST /identity/v3/endpoints => generated 331 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:10:48.043178 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5a2da-0b43-421a-b462-28b0b27d136e None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:10:48.044217 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5a2da-0b43-421a-b462-28b0b27d136e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:10:48.044727 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5a2da-0b43-421a-b462-28b0b27d136e None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:10:48.052480 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a289e49-7b67-4b76-b779-89b7bd9854a2 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:10:48.053357 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a289e49-7b67-4b76-b779-89b7bd9854a2 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:10:48.053862 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a289e49-7b67-4b76-b779-89b7bd9854a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:10:48.057769 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 658/1307] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:10:48 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:10:48.157916 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-0a289e49-7b67-4b76-b779-89b7bd9854a2 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:10:48.162269 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-0a289e49-7b67-4b76-b779-89b7bd9854a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:10:48.298561 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 650/1308] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:10:48.355008 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7945316-9ef5-41cc-9025-52a5120fad8c None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:10:48.355364 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7945316-9ef5-41cc-9025-52a5120fad8c None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:10:48.355738 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7945316-9ef5-41cc-9025-52a5120fad8c None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:10:48.358746 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 659/1309] 10.222.0.48 () {54 vars in 964 bytes} [Mon May 9 15:10:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:10:48.368959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c5ba0-cf51-4da6-80a3-eaa49b40ef4c None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:10:48.369250 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c5ba0-cf51-4da6-80a3-eaa49b40ef4c None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:10:48.369581 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c5ba0-cf51-4da6-80a3-eaa49b40ef4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:10:48.496300 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-5d6c5ba0-cf51-4da6-80a3-eaa49b40ef4c None None] MFA Rules not processed for user `4cd76a442c2f4c759e7438031d5d6aca`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:10:48.497615 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5d6c5ba0-cf51-4da6-80a3-eaa49b40ef4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:10:48.586472 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 651/1310] 10.222.0.48 () {58 vars in 1061 bytes} [Mon May 9 15:10:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:10:48.595371 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7945316-9ef5-41cc-9025-52a5120fad8c None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:10:48.597101 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e7945316-9ef5-41cc-9025-52a5120fad8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:10:48.705968 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7945316-9ef5-41cc-9025-52a5120fad8c None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:10:48.781191 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc3512-307c-4c6a-a91b-5b36a7025788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd76a442c2f4c759e7438031d5d6aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fcadeae44cc4547905b83bfebec79c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:10:48.782437 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc3512-307c-4c6a-a91b-5b36a7025788 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:10:48.782835 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc3512-307c-4c6a-a91b-5b36a7025788 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:10:48.783119 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc3512-307c-4c6a-a91b-5b36a7025788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:10:48.784826 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d3bc3512-307c-4c6a-a91b-5b36a7025788 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:10:48.897144 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc3512-307c-4c6a-a91b-5b36a7025788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:10:48.898528 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc3512-307c-4c6a-a91b-5b36a7025788 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:10:48.918701 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 660/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:10:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 15:10:51.476527 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc02f0-e014-4d3b-98f6-3f05918ec06d None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:10:51.477499 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc02f0-e014-4d3b-98f6-3f05918ec06d None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:10:51.477798 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc02f0-e014-4d3b-98f6-3f05918ec06d None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:10:51.479149 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 652/1312] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:10:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:10:51.484551 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c30d8-3186-408e-a6b0-60ccd91aea65 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:10:51.485814 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c30d8-3186-408e-a6b0-60ccd91aea65 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:10:51.485986 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c30d8-3186-408e-a6b0-60ccd91aea65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:10:51.558192 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-007c30d8-3186-408e-a6b0-60ccd91aea65 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:10:51.559683 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-007c30d8-3186-408e-a6b0-60ccd91aea65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:10:51.666039 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 661/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:10:51.704088 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc02f0-e014-4d3b-98f6-3f05918ec06d None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:10:51.705691 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-d5fc02f0-e014-4d3b-98f6-3f05918ec06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:10:51.826897 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc02f0-e014-4d3b-98f6-3f05918ec06d None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:10:51.918681 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d40166-9671-47fd-9f3a-69878cfd86db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd76a442c2f4c759e7438031d5d6aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fcadeae44cc4547905b83bfebec79c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:10:51.919227 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d40166-9671-47fd-9f3a-69878cfd86db service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:10:51.919501 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d40166-9671-47fd-9f3a-69878cfd86db service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:10:51.919893 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d40166-9671-47fd-9f3a-69878cfd86db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:10:51.922076 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-36d40166-9671-47fd-9f3a-69878cfd86db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:10:52.037023 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d40166-9671-47fd-9f3a-69878cfd86db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:10:52.038677 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d40166-9671-47fd-9f3a-69878cfd86db service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:10:52.061306 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 653/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:10:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:10:54.695506 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35530e-7c65-4f12-9922-76b4fa57142d None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:10:54.696024 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35530e-7c65-4f12-9922-76b4fa57142d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:10:54.696121 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35530e-7c65-4f12-9922-76b4fa57142d None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:10:54.697503 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 662/1315] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:10:54.703027 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54bbc7-b007-4a12-ac3a-2d3811fc93b6 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:10:54.703523 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54bbc7-b007-4a12-ac3a-2d3811fc93b6 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:10:54.704205 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54bbc7-b007-4a12-ac3a-2d3811fc93b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:10:54.767792 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-5d54bbc7-b007-4a12-ac3a-2d3811fc93b6 None None] MFA Rules not processed for user `e919023b70fc4d738d1bb03b30464081`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:10:54.768990 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5d54bbc7-b007-4a12-ac3a-2d3811fc93b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:10:54.860737 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 654/1316] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:10:54 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:10:54.916681 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479e0c2-dca5-44e5-8a80-be5761b12b35 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:10:54.916964 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479e0c2-dca5-44e5-8a80-be5761b12b35 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:10:54.917235 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479e0c2-dca5-44e5-8a80-be5761b12b35 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:10:54.918633 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 663/1317] 10.222.0.48 () {54 vars in 964 bytes} [Mon May 9 15:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:10:54.925793 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fcfe9-bccb-4184-a0f1-9ae8769eb5b3 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:10:54.926084 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fcfe9-bccb-4184-a0f1-9ae8769eb5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:10:54.926361 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fcfe9-bccb-4184-a0f1-9ae8769eb5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:10:55.000336 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-071fcfe9-bccb-4184-a0f1-9ae8769eb5b3 None None] MFA Rules not processed for user `4cd76a442c2f4c759e7438031d5d6aca`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:10:55.002185 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-071fcfe9-bccb-4184-a0f1-9ae8769eb5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:10:55.075659 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 655/1318] 10.222.0.48 () {58 vars in 1061 bytes} [Mon May 9 15:10:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:10:55.084804 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479e0c2-dca5-44e5-8a80-be5761b12b35 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:10:55.086345 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-c479e0c2-dca5-44e5-8a80-be5761b12b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:10:55.184518 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479e0c2-dca5-44e5-8a80-be5761b12b35 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:10:55.256421 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2ca6e-c4a0-419c-aa1a-12d20b1791bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd76a442c2f4c759e7438031d5d6aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fcadeae44cc4547905b83bfebec79c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:10:55.256988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2ca6e-c4a0-419c-aa1a-12d20b1791bb service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:10:55.257268 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2ca6e-c4a0-419c-aa1a-12d20b1791bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:10:55.257578 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2ca6e-c4a0-419c-aa1a-12d20b1791bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:10:55.259200 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-58d2ca6e-c4a0-419c-aa1a-12d20b1791bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:10:55.368979 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2ca6e-c4a0-419c-aa1a-12d20b1791bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:10:55.370457 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2ca6e-c4a0-419c-aa1a-12d20b1791bb service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:10:55.388690 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 664/1319] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:10:55 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:10:58.606190 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385065f-039c-49d1-ba89-44e0cd356030 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:10:58.606779 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385065f-039c-49d1-ba89-44e0cd356030 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:10:58.606887 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385065f-039c-49d1-ba89-44e0cd356030 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:10:58.609031 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 656/1320] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:10:58.615215 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b452b-9a2b-42b0-a670-bac194e25c6f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:10:58.615734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b452b-9a2b-42b0-a670-bac194e25c6f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:10:58.615734 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b452b-9a2b-42b0-a670-bac194e25c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:10:58.682303 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-e95b452b-9a2b-42b0-a670-bac194e25c6f None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:10:58.683502 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e95b452b-9a2b-42b0-a670-bac194e25c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:10:58.778694 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 665/1321] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:10:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:10:58.818226 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385065f-039c-49d1-ba89-44e0cd356030 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:10:58.819793 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-a385065f-039c-49d1-ba89-44e0cd356030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:10:58.929261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385065f-039c-49d1-ba89-44e0cd356030 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:10:59.004627 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df65b99-982c-42ff-8f43-45ef60f5aa4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd76a442c2f4c759e7438031d5d6aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fcadeae44cc4547905b83bfebec79c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:10:59.005183 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df65b99-982c-42ff-8f43-45ef60f5aa4c service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:10:59.005497 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df65b99-982c-42ff-8f43-45ef60f5aa4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:10:59.005779 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df65b99-982c-42ff-8f43-45ef60f5aa4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:10:59.007444 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-0df65b99-982c-42ff-8f43-45ef60f5aa4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:10:59.116282 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df65b99-982c-42ff-8f43-45ef60f5aa4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:10:59.117771 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df65b99-982c-42ff-8f43-45ef60f5aa4c service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:10:59.136970 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 657/1322] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:10:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:11:02.118650 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240abf6-1ed6-41ce-b18b-8997978dfc10 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:02.119226 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240abf6-1ed6-41ce-b18b-8997978dfc10 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:02.119226 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240abf6-1ed6-41ce-b18b-8997978dfc10 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:02.120546 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 666/1323] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:11:02.126645 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aad32a-103c-4582-8151-d0084e4c5c92 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:02.127113 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aad32a-103c-4582-8151-d0084e4c5c92 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:02.127228 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aad32a-103c-4582-8151-d0084e4c5c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:02.189716 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-44aad32a-103c-4582-8151-d0084e4c5c92 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:11:02.190887 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-44aad32a-103c-4582-8151-d0084e4c5c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:02.284092 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 658/1324] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:11:02.320200 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240abf6-1ed6-41ce-b18b-8997978dfc10 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:11:02.321816 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f240abf6-1ed6-41ce-b18b-8997978dfc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:02.428930 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240abf6-1ed6-41ce-b18b-8997978dfc10 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:11:02.501764 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66088824-badd-45d0-a6b6-e3bf2055c344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd76a442c2f4c759e7438031d5d6aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fcadeae44cc4547905b83bfebec79c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:11:02.502405 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66088824-badd-45d0-a6b6-e3bf2055c344 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:02.502679 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66088824-badd-45d0-a6b6-e3bf2055c344 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:02.502946 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66088824-badd-45d0-a6b6-e3bf2055c344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:02.504560 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-66088824-badd-45d0-a6b6-e3bf2055c344 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:02.608635 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66088824-badd-45d0-a6b6-e3bf2055c344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:11:02.610844 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66088824-badd-45d0-a6b6-e3bf2055c344 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:11:02.628849 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 667/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:11:04.942433 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e8b1b-c0e2-4db5-b3a6-41881ceb8737 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:04.943000 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e8b1b-c0e2-4db5-b3a6-41881ceb8737 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:04.943000 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e8b1b-c0e2-4db5-b3a6-41881ceb8737 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:04.944485 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 659/1326] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:11:04.949695 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f05f90-69a5-44e3-8998-85a89a3ef2f9 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:04.950095 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f05f90-69a5-44e3-8998-85a89a3ef2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:04.950255 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f05f90-69a5-44e3-8998-85a89a3ef2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:05.014198 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-01f05f90-69a5-44e3-8998-85a89a3ef2f9 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:11:05.015393 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-01f05f90-69a5-44e3-8998-85a89a3ef2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:05.109407 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 668/1327] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:11:05.145687 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e8b1b-c0e2-4db5-b3a6-41881ceb8737 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:11:05.147231 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-6f5e8b1b-c0e2-4db5-b3a6-41881ceb8737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:05.252248 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e8b1b-c0e2-4db5-b3a6-41881ceb8737 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:11:05.322131 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc5d46-7f2a-45a7-ba4a-d9ece5198e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd76a442c2f4c759e7438031d5d6aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fcadeae44cc4547905b83bfebec79c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:11:05.322775 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc5d46-7f2a-45a7-ba4a-d9ece5198e95 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:05.323058 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc5d46-7f2a-45a7-ba4a-d9ece5198e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:05.323333 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc5d46-7f2a-45a7-ba4a-d9ece5198e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:05.324959 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-7cbc5d46-7f2a-45a7-ba4a-d9ece5198e95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:05.433986 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc5d46-7f2a-45a7-ba4a-d9ece5198e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:11:05.435407 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc5d46-7f2a-45a7-ba4a-d9ece5198e95 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:11:05.453676 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 660/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:11:07.818194 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e88779-59e2-4686-902c-2942b8fc19b7 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:07.818738 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e88779-59e2-4686-902c-2942b8fc19b7 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:07.818738 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e88779-59e2-4686-902c-2942b8fc19b7 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:07.820116 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 669/1329] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:11:07.825532 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7d929-56d2-4508-9219-9becaa0fbbdc None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:07.825974 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7d929-56d2-4508-9219-9becaa0fbbdc None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:07.826091 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7d929-56d2-4508-9219-9becaa0fbbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:07.890210 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-bdb7d929-56d2-4508-9219-9becaa0fbbdc None None] MFA Rules not processed for user `e919023b70fc4d738d1bb03b30464081`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:11:07.892022 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-bdb7d929-56d2-4508-9219-9becaa0fbbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:07.986893 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 661/1330] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:11:07 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:11:08.026012 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e88779-59e2-4686-902c-2942b8fc19b7 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:11:08.026012 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-e8e88779-59e2-4686-902c-2942b8fc19b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:08.130543 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e88779-59e2-4686-902c-2942b8fc19b7 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:11:08.201510 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d6483-0038-4766-945d-1a5b1406867c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd76a442c2f4c759e7438031d5d6aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fcadeae44cc4547905b83bfebec79c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:11:08.202152 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d6483-0038-4766-945d-1a5b1406867c service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:08.202436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d6483-0038-4766-945d-1a5b1406867c service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:08.202709 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d6483-0038-4766-945d-1a5b1406867c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:08.204826 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-872d6483-0038-4766-945d-1a5b1406867c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:08.309685 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d6483-0038-4766-945d-1a5b1406867c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:11:08.311135 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d6483-0038-4766-945d-1a5b1406867c service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:11:08.329034 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 670/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:11:08 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 15:11:10.815849 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d84a4-dab2-4d5b-83b4-b94d8dd43269 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:10.816393 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d84a4-dab2-4d5b-83b4-b94d8dd43269 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:10.816393 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d84a4-dab2-4d5b-83b4-b94d8dd43269 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:10.817774 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 662/1332] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:11:10.823150 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ef746-328d-4829-aa27-176e62794e6f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:10.823579 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ef746-328d-4829-aa27-176e62794e6f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:10.823711 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ef746-328d-4829-aa27-176e62794e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:10.895121 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-166ef746-328d-4829-aa27-176e62794e6f None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:11:10.896337 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-166ef746-328d-4829-aa27-176e62794e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:11.005918 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 671/1333] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:11:11.040593 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d84a4-dab2-4d5b-83b4-b94d8dd43269 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:11:11.042229 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-325d84a4-dab2-4d5b-83b4-b94d8dd43269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:11.146483 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d84a4-dab2-4d5b-83b4-b94d8dd43269 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:11:11.222684 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc46618-399b-4e23-be58-187ddeaa1a83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd76a442c2f4c759e7438031d5d6aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fcadeae44cc4547905b83bfebec79c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:11:11.223350 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc46618-399b-4e23-be58-187ddeaa1a83 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:11.223636 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc46618-399b-4e23-be58-187ddeaa1a83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:11.223916 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc46618-399b-4e23-be58-187ddeaa1a83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:11.225646 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-0bc46618-399b-4e23-be58-187ddeaa1a83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:11.334954 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc46618-399b-4e23-be58-187ddeaa1a83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:11:11.336379 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc46618-399b-4e23-be58-187ddeaa1a83 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:11:11.354363 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 663/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:11:13.667148 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42102e76-a397-416e-8663-a7c7aadca3e4 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:13.667675 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42102e76-a397-416e-8663-a7c7aadca3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:13.667675 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42102e76-a397-416e-8663-a7c7aadca3e4 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:13.669060 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 672/1335] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:11:13.674727 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494070ae-799c-4c87-bd94-3b7b5d7cedc4 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:13.675113 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494070ae-799c-4c87-bd94-3b7b5d7cedc4 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:13.675227 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494070ae-799c-4c87-bd94-3b7b5d7cedc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:13.738346 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-494070ae-799c-4c87-bd94-3b7b5d7cedc4 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:11:13.739536 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-494070ae-799c-4c87-bd94-3b7b5d7cedc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:13.834062 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 664/1336] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:11:13.873354 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42102e76-a397-416e-8663-a7c7aadca3e4 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:11:13.874940 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-42102e76-a397-416e-8663-a7c7aadca3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:13.977251 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42102e76-a397-416e-8663-a7c7aadca3e4 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:11:14.046834 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c1f25-4916-40d7-bd2c-6239aeeb9ced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd76a442c2f4c759e7438031d5d6aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fcadeae44cc4547905b83bfebec79c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:11:14.048104 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c1f25-4916-40d7-bd2c-6239aeeb9ced service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:14.048387 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c1f25-4916-40d7-bd2c-6239aeeb9ced service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:14.048662 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c1f25-4916-40d7-bd2c-6239aeeb9ced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:14.050344 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-349c1f25-4916-40d7-bd2c-6239aeeb9ced service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:14.161004 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c1f25-4916-40d7-bd2c-6239aeeb9ced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:11:14.162473 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c1f25-4916-40d7-bd2c-6239aeeb9ced service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:11:14.180521 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 673/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:11:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:11:16.803533 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7637dce-ef3b-4ace-a839-66ee90c84f66 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:16.804139 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7637dce-ef3b-4ace-a839-66ee90c84f66 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:16.804139 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7637dce-ef3b-4ace-a839-66ee90c84f66 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:16.805469 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 665/1338] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:11:16.810622 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03261b36-7b7b-4467-bad8-81205faeb13a None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:16.811055 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03261b36-7b7b-4467-bad8-81205faeb13a None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:16.811166 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03261b36-7b7b-4467-bad8-81205faeb13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:16.872673 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-03261b36-7b7b-4467-bad8-81205faeb13a None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:11:16.873878 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-03261b36-7b7b-4467-bad8-81205faeb13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:16.971113 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 674/1339] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:11:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:11:17.007507 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7637dce-ef3b-4ace-a839-66ee90c84f66 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:11:17.009036 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e7637dce-ef3b-4ace-a839-66ee90c84f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:17.115428 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7637dce-ef3b-4ace-a839-66ee90c84f66 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:11:17.191150 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e120e2c-a0a9-4553-876c-69b2d4d516e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd76a442c2f4c759e7438031d5d6aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fcadeae44cc4547905b83bfebec79c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:11:17.191797 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e120e2c-a0a9-4553-876c-69b2d4d516e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:17.192081 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e120e2c-a0a9-4553-876c-69b2d4d516e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:17.192357 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e120e2c-a0a9-4553-876c-69b2d4d516e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:17.194029 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-6e120e2c-a0a9-4553-876c-69b2d4d516e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:17.300320 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e120e2c-a0a9-4553-876c-69b2d4d516e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:11:17.301791 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e120e2c-a0a9-4553-876c-69b2d4d516e0 service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:11:17.320112 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 666/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:11:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:11:21.799820 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4a7fb-35a5-429c-bc7a-0468eddfb554 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:21.800396 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4a7fb-35a5-429c-bc7a-0468eddfb554 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:21.800396 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4a7fb-35a5-429c-bc7a-0468eddfb554 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:21.801786 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 675/1341] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:11:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:11:21.807095 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f22bf0-bf37-4bb6-b768-970a0a58d9bc None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:21.807495 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f22bf0-bf37-4bb6-b768-970a0a58d9bc None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:21.807657 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f22bf0-bf37-4bb6-b768-970a0a58d9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:21.880909 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-c4f22bf0-bf37-4bb6-b768-970a0a58d9bc None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:11:21.882351 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-c4f22bf0-bf37-4bb6-b768-970a0a58d9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:21.989062 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 667/1342] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:11:22.028548 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4a7fb-35a5-429c-bc7a-0468eddfb554 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:11:22.031166 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-0da4a7fb-35a5-429c-bc7a-0468eddfb554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:22.124911 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4a7fb-35a5-429c-bc7a-0468eddfb554 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:11:22.129178 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aecda2-d60f-44b4-93b4-051ea12122f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd76a442c2f4c759e7438031d5d6aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fcadeae44cc4547905b83bfebec79c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:11:22.129863 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aecda2-d60f-44b4-93b4-051ea12122f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:22.130147 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aecda2-d60f-44b4-93b4-051ea12122f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:22.130424 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aecda2-d60f-44b4-93b4-051ea12122f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:22.139427 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aecda2-d60f-44b4-93b4-051ea12122f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:11:22.141549 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aecda2-d60f-44b4-93b4-051ea12122f0 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:11:22.151019 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 676/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:11:25.020728 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2cbfc-4e60-4f4a-b5a6-1d1abe90e9a0 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:25.021255 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2cbfc-4e60-4f4a-b5a6-1d1abe90e9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:25.021404 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2cbfc-4e60-4f4a-b5a6-1d1abe90e9a0 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:25.022666 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 668/1344] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:11:25.027838 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a12dc5-c45a-4622-a834-2e642f015b0f None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:25.028285 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a12dc5-c45a-4622-a834-2e642f015b0f None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:25.028390 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a12dc5-c45a-4622-a834-2e642f015b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:25.056856 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-d7a12dc5-c45a-4622-a834-2e642f015b0f None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:11:25.058107 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-d7a12dc5-c45a-4622-a834-2e642f015b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:25.133690 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 677/1345] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:11:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:11:25.170530 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2cbfc-4e60-4f4a-b5a6-1d1abe90e9a0 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:11:25.181947 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2cbfc-4e60-4f4a-b5a6-1d1abe90e9a0 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:11:25.185458 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80158e30-b42e-4e2b-b150-9f29caaa3cab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd76a442c2f4c759e7438031d5d6aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fcadeae44cc4547905b83bfebec79c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:11:25.186092 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80158e30-b42e-4e2b-b150-9f29caaa3cab service neutron] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:25.186371 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80158e30-b42e-4e2b-b150-9f29caaa3cab service neutron] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:25.186642 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80158e30-b42e-4e2b-b150-9f29caaa3cab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:25.196082 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80158e30-b42e-4e2b-b150-9f29caaa3cab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:11:25.197526 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80158e30-b42e-4e2b-b150-9f29caaa3cab service neutron] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:11:25.207075 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 669/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:11:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:11:29.647004 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1acab-142d-4af6-ac68-92766059c788 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:29.647562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1acab-142d-4af6-ac68-92766059c788 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:29.647562 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1acab-142d-4af6-ac68-92766059c788 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:29.648937 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 678/1347] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:11:29.654418 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e981311-fd18-4037-a269-632b82f29c8f None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:29.654856 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e981311-fd18-4037-a269-632b82f29c8f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:29.654967 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e981311-fd18-4037-a269-632b82f29c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:29.673539 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-2e981311-fd18-4037-a269-632b82f29c8f None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:11:29.674715 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-2e981311-fd18-4037-a269-632b82f29c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:29.682719 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 670/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:11:29.720391 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1acab-142d-4af6-ac68-92766059c788 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:11:29.730872 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1acab-142d-4af6-ac68-92766059c788 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:11:29.734396 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e659618-200e-495a-8121-7e2ccab5a7d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cd76a442c2f4c759e7438031d5d6aca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fcadeae44cc4547905b83bfebec79c7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:11:29.735923 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e659618-200e-495a-8121-7e2ccab5a7d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:29.736215 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e659618-200e-495a-8121-7e2ccab5a7d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:29.736490 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e659618-200e-495a-8121-7e2ccab5a7d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:29.745598 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e659618-200e-495a-8121-7e2ccab5a7d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:11:29.746959 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e659618-200e-495a-8121-7e2ccab5a7d4 service neutron] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:11:29.757137 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 679/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:11:35.385814 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d0f92-d711-4341-8551-ce5b6910594e None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:35.386655 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d0f92-d711-4341-8551-ce5b6910594e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:35.387103 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d0f92-d711-4341-8551-ce5b6910594e None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:35.389409 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 671/1350] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 9 15:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:11:35.398406 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96f8b8-b79c-4fb8-be67-dac65cb513e6 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:35.399773 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96f8b8-b79c-4fb8-be67-dac65cb513e6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:35.400346 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96f8b8-b79c-4fb8-be67-dac65cb513e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:35.495815 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-6e96f8b8-b79c-4fb8-be67-dac65cb513e6 None None] MFA Rules not processed for user `2462e1778f3a4f3194a0b5dca13d9777`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:11:35.498342 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-6e96f8b8-b79c-4fb8-be67-dac65cb513e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:35.601092 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 680/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 9 15:11:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:11:39.884465 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c9422-6d02-40aa-9c8f-8f7b4fd40941 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:39.885311 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c9422-6d02-40aa-9c8f-8f7b4fd40941 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:39.885702 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c9422-6d02-40aa-9c8f-8f7b4fd40941 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:39.887439 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 672/1352] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 9 15:11:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:11:39.893689 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f136d-0a3b-4430-9240-ffeabe6c034d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:39.894189 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f136d-0a3b-4430-9240-ffeabe6c034d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:39.894290 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f136d-0a3b-4430-9240-ffeabe6c034d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:39.912390 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-972f136d-0a3b-4430-9240-ffeabe6c034d None None] MFA Rules not processed for user `2462e1778f3a4f3194a0b5dca13d9777`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:11:39.913625 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-972f136d-0a3b-4430-9240-ffeabe6c034d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:39.922437 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 681/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 9 15:11:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:11:41.795662 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298acd9-7cc1-4a3c-964a-c3da61ba9e21 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:41.796210 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298acd9-7cc1-4a3c-964a-c3da61ba9e21 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:41.796210 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298acd9-7cc1-4a3c-964a-c3da61ba9e21 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:41.798121 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 673/1354] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 9 15:11:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:11:41.803191 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fab007-8030-45ed-9358-75fc3e2ff559 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:41.803638 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fab007-8030-45ed-9358-75fc3e2ff559 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:41.803817 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fab007-8030-45ed-9358-75fc3e2ff559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:41.822355 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-f5fab007-8030-45ed-9358-75fc3e2ff559 None None] MFA Rules not processed for user `2462e1778f3a4f3194a0b5dca13d9777`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:11:41.823532 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-f5fab007-8030-45ed-9358-75fc3e2ff559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:41.832524 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 682/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 9 15:11:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:11:45.629240 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c0171-3408-48ae-8d14-b103924b5199 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:45.629805 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c0171-3408-48ae-8d14-b103924b5199 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:45.629805 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c0171-3408-48ae-8d14-b103924b5199 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:45.631062 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 674/1356] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:11:45.637164 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2b142-6a5a-4c85-82f3-5f35cc5ca67e None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:45.637706 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2b142-6a5a-4c85-82f3-5f35cc5ca67e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:45.637799 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2b142-6a5a-4c85-82f3-5f35cc5ca67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:45.656454 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a5d2b142-6a5a-4c85-82f3-5f35cc5ca67e None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:11:45.658153 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a5d2b142-6a5a-4c85-82f3-5f35cc5ca67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:45.666586 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 683/1357] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:11:45.723058 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7457625-a526-4fa6-aab8-1b3b98aa612a None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:45.723675 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7457625-a526-4fa6-aab8-1b3b98aa612a None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:45.724250 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7457625-a526-4fa6-aab8-1b3b98aa612a None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:45.726095 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 675/1358] 10.222.0.48 () {54 vars in 961 bytes} [Mon May 9 15:11:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:11:45.731469 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8ee82-d85f-46e4-90ba-06d99055977d None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:45.731786 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8ee82-d85f-46e4-90ba-06d99055977d None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:45.732070 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8ee82-d85f-46e4-90ba-06d99055977d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:45.781568 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-01d8ee82-d85f-46e4-90ba-06d99055977d None None] MFA Rules not processed for user `65e7a4e661ef4425b24844c3500b0b58`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:11:45.783276 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-01d8ee82-d85f-46e4-90ba-06d99055977d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:45.863495 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 684/1359] 10.222.0.48 () {58 vars in 1058 bytes} [Mon May 9 15:11:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:11:45.871576 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7457625-a526-4fa6-aab8-1b3b98aa612a None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:11:45.886726 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7457625-a526-4fa6-aab8-1b3b98aa612a None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:11:45.893104 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69036e77-3aa5-48cb-a0dd-ebc14f778363 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e7a4e661ef4425b24844c3500b0b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fcadeae44cc4547905b83bfebec79c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:11:45.893842 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69036e77-3aa5-48cb-a0dd-ebc14f778363 service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:45.894194 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69036e77-3aa5-48cb-a0dd-ebc14f778363 service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:45.894540 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69036e77-3aa5-48cb-a0dd-ebc14f778363 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:45.905539 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69036e77-3aa5-48cb-a0dd-ebc14f778363 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:11:45.908258 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69036e77-3aa5-48cb-a0dd-ebc14f778363 service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:11:45.921487 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 676/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:11:48.441077 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0f682-fc60-443f-8e53-fa5e4c2a5baa None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:48.441658 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0f682-fc60-443f-8e53-fa5e4c2a5baa None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:48.441745 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0f682-fc60-443f-8e53-fa5e4c2a5baa None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:48.443469 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 685/1361] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:11:48.449071 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffdb6a-1651-45a3-a64f-dc8811b9bb1e None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:48.449967 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffdb6a-1651-45a3-a64f-dc8811b9bb1e None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:48.450249 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffdb6a-1651-45a3-a64f-dc8811b9bb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:48.474261 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-5dffdb6a-1651-45a3-a64f-dc8811b9bb1e None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:11:48.475516 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-5dffdb6a-1651-45a3-a64f-dc8811b9bb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:48.483770 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 677/1362] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:11:48.530071 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0f682-fc60-443f-8e53-fa5e4c2a5baa None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:11:48.547227 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0f682-fc60-443f-8e53-fa5e4c2a5baa None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:11:48.552999 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf0926-b5c4-4013-b222-9a191ba7b7dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e7a4e661ef4425b24844c3500b0b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fcadeae44cc4547905b83bfebec79c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:11:48.554029 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf0926-b5c4-4013-b222-9a191ba7b7dd service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:48.554323 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf0926-b5c4-4013-b222-9a191ba7b7dd service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:48.554608 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf0926-b5c4-4013-b222-9a191ba7b7dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:48.564395 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf0926-b5c4-4013-b222-9a191ba7b7dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:11:48.566055 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf0926-b5c4-4013-b222-9a191ba7b7dd service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:11:48.576759 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 686/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:11:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:11:51.242423 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18b04d-599a-4872-81c5-254c2f64ad5f None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:51.243503 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18b04d-599a-4872-81c5-254c2f64ad5f None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:51.244037 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18b04d-599a-4872-81c5-254c2f64ad5f None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:51.245789 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 678/1364] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:11:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:11:51.252124 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a115b3-2d82-4ba7-9a77-eb7defc8a0d5 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:51.252632 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a115b3-2d82-4ba7-9a77-eb7defc8a0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:51.252726 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a115b3-2d82-4ba7-9a77-eb7defc8a0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:51.278509 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-09a115b3-2d82-4ba7-9a77-eb7defc8a0d5 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:11:51.279887 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-09a115b3-2d82-4ba7-9a77-eb7defc8a0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:51.291536 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 687/1365] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:11:51.344740 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bb274-5f92-4ee3-93a0-1be6d5803d95 None None] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:51.345086 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bb274-5f92-4ee3-93a0-1be6d5803d95 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:51.345327 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bb274-5f92-4ee3-93a0-1be6d5803d95 None None] PATH_INFO: `/` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:51.347783 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 679/1366] 10.222.0.48 () {54 vars in 961 bytes} [Mon May 9 15:11:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:11:51.355844 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567e365-0b83-481c-aecb-890d77bd78c0 None None] REQUEST_METHOD: `POST` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:51.356234 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567e365-0b83-481c-aecb-890d77bd78c0 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:51.357947 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567e365-0b83-481c-aecb-890d77bd78c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:51.382722 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.auth.core [None req-a567e365-0b83-481c-aecb-890d77bd78c0 None None] MFA Rules not processed for user `65e7a4e661ef4425b24844c3500b0b58`. Rule list: `[]` (Enabled: `True`). {{(pid=80164) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:11:51.383943 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.fernet_utils [None req-a567e365-0b83-481c-aecb-890d77bd78c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80164) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:51.394915 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 688/1367] 10.222.0.48 () {58 vars in 1058 bytes} [Mon May 9 15:11:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:11:51.402884 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bb274-5f92-4ee3-93a0-1be6d5803d95 None None] Authenticating user token {{(pid=80165) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:11:51.419757 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6bb274-5f92-4ee3-93a0-1be6d5803d95 None None] Validating token access rules against request {{(pid=80165) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:11:51.427138 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849895f-ecff-459a-bee9-acd65e2153dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e7a4e661ef4425b24844c3500b0b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fcadeae44cc4547905b83bfebec79c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80165) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:11:51.427981 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849895f-ecff-459a-bee9-acd65e2153dd service nova] REQUEST_METHOD: `GET` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:51.428438 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849895f-ecff-459a-bee9-acd65e2153dd service nova] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:51.428881 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849895f-ecff-459a-bee9-acd65e2153dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:51.439318 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849895f-ecff-459a-bee9-acd65e2153dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:11:51.441131 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849895f-ecff-459a-bee9-acd65e2153dd service nova] RBAC: Authorization granted {{(pid=80165) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:11:51.452163 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 680/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 15:11:52.396236 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0de7f7-3db9-479a-83f8-659509520d4e None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:52.396778 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0de7f7-3db9-479a-83f8-659509520d4e None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:52.396778 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0de7f7-3db9-479a-83f8-659509520d4e None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:52.398495 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 689/1369] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:11:52.404228 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674dfa2-fb01-470a-9518-b328bff4a5d5 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:52.404753 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674dfa2-fb01-470a-9518-b328bff4a5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:52.404835 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674dfa2-fb01-470a-9518-b328bff4a5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:52.428271 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-9674dfa2-fb01-470a-9518-b328bff4a5d5 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:11:52.429529 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-9674dfa2-fb01-470a-9518-b328bff4a5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:52.441565 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 681/1370] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:11:53.847683 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf424383-a3bf-456f-a788-16125c99a4e6 None None] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:53.848226 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf424383-a3bf-456f-a788-16125c99a4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:53.848226 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf424383-a3bf-456f-a788-16125c99a4e6 None None] PATH_INFO: `/` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:53.849641 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 690/1371] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:11:53.855063 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4751585-01b7-4add-9112-fe8b43a11b24 None None] REQUEST_METHOD: `POST` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:53.855492 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4751585-01b7-4add-9112-fe8b43a11b24 None None] SCRIPT_NAME: `/identity` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:53.855654 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4751585-01b7-4add-9112-fe8b43a11b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80165) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:53.873492 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.auth.core [None req-e4751585-01b7-4add-9112-fe8b43a11b24 None None] MFA Rules not processed for user `f27a0181336c474fa1a80c34325076d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80165) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:11:53.874661 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: DEBUG keystone.common.fernet_utils [None req-e4751585-01b7-4add-9112-fe8b43a11b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80165) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:11:53.882468 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: [pid: 80165|app: 0|req: 682/1372] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:11:53.927154 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf424383-a3bf-456f-a788-16125c99a4e6 None None] Authenticating user token {{(pid=80164) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:11:53.941352 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf424383-a3bf-456f-a788-16125c99a4e6 None None] Validating token access rules against request {{(pid=80164) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:11:53.946808 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27445d-22d0-41d6-83d7-c4f1ad77c704 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e7a4e661ef4425b24844c3500b0b58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4fcadeae44cc4547905b83bfebec79c7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80164) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:11:53.947436 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27445d-22d0-41d6-83d7-c4f1ad77c704 service nova] REQUEST_METHOD: `GET` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:11:53.947715 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27445d-22d0-41d6-83d7-c4f1ad77c704 service nova] SCRIPT_NAME: `/identity` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:11:53.947988 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27445d-22d0-41d6-83d7-c4f1ad77c704 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80164) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:11:53.956583 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27445d-22d0-41d6-83d7-c4f1ad77c704 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:11:53.958175 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27445d-22d0-41d6-83d7-c4f1ad77c704 service nova] RBAC: Authorization granted {{(pid=80164) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:11:53.967318 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: [pid: 80164|app: 0|req: 691/1373] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:12:15.846429 dv-cinder-835881-7-iscsi systemd[1]: Stopping Devstack devstack@keystone.service... May 09 15:12:15.847023 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: Mon May 9 15:12:15 2022 - graceful shutdown triggered... May 09 15:12:15.847507 dv-cinder-835881-7-iscsi devstack@keystone.service[80164]: Gracefully killing worker 1 (pid: 80164)... May 09 15:12:15.847858 dv-cinder-835881-7-iscsi devstack@keystone.service[80165]: Gracefully killing worker 2 (pid: 80165)... May 09 15:12:16.848183 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: worker 1 buried after 1 seconds May 09 15:12:16.848183 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: worker 2 buried after 1 seconds May 09 15:12:16.848183 dv-cinder-835881-7-iscsi devstack@keystone.service[80151]: goodbye to uWSGI. May 09 15:12:16.849981 dv-cinder-835881-7-iscsi systemd[1]: devstack@keystone.service: Succeeded. May 09 15:12:16.850605 dv-cinder-835881-7-iscsi systemd[1]: Stopped Devstack devstack@keystone.service. May 09 15:17:50.505174 dv-cinder-835881-7-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 09 15:17:50.516185 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 09 15:17:50.517315 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 9 15:17:50 2022] *** May 09 15:17:50.517315 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 09 15:17:50.517315 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 09 15:17:50.517315 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: nodename: dv-cinder-835881-7-iscsi May 09 15:17:50.517315 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: machine: x86_64 May 09 15:17:50.517315 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: clock source: unix May 09 15:17:50.517315 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: pcre jit disabled May 09 15:17:50.517315 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: detected number of CPU cores: 4 May 09 15:17:50.517315 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: current working directory: / May 09 15:17:50.517315 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: detected binary path: /usr/bin/uwsgi-core May 09 15:17:50.517315 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: your processes number limit is 47680 May 09 15:17:50.517315 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: your memory page size is 4096 bytes May 09 15:17:50.517315 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: detected max file descriptor number: 2048 May 09 15:17:50.517315 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: lock engine: pthread robust mutexes May 09 15:17:50.517315 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: thunder lock: enabled May 09 15:17:50.517315 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 09 15:17:50.518371 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 09 15:17:50.572587 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: Python main interpreter initialized at 0x55b763b849c0 May 09 15:17:50.572587 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: python threads support enabled May 09 15:17:50.572587 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: your server socket listen backlog is limited to 100 connections May 09 15:17:50.572587 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: your mercy for graceful operations on workers is 90 seconds May 09 15:17:50.573059 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: mapped 403077 bytes (393 KB) for 2 cores May 09 15:17:50.573200 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: *** Operational MODE: preforking *** May 09 15:17:50.573661 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: *** uWSGI is running in multiple interpreter mode *** May 09 15:17:50.573661 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: spawned uWSGI master process (pid: 143280) May 09 15:17:50.573882 dv-cinder-835881-7-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 09 15:17:50.576502 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: spawned uWSGI worker 1 (pid: 143281, cores: 1) May 09 15:17:50.576502 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: spawned uWSGI worker 2 (pid: 143282, cores: 1) May 09 15:17:50.576502 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 09 15:17:56.622770 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:17:56.622770 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: from cryptography.utils import int_from_bytes May 09 15:17:56.624236 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:17:56.624236 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: from cryptography.utils import int_from_bytes May 09 15:17:56.625934 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:17:56.625934 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: from cryptography.utils import int_from_bytes May 09 15:17:56.627353 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:17:56.627353 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: from cryptography.utils import int_from_bytes May 09 15:17:56.674395 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 15:17:56.674634 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 15:17:56.674898 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] command line args: [] {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 15:17:56.675028 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 15:17:56.675120 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 15:17:56.675216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ================================================================================ {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 15:17:56.675307 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 15:17:56.675489 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] admin_token = **** {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.675596 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] command line args: [] {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 15:17:56.675759 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] config_dir = [] {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.675859 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 15:17:56.675940 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.676019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ================================================================================ {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 15:17:56.676104 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] config_source = [] {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.676198 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] admin_token = **** {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.676271 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] debug = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.677703 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] config_dir = [] {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.677825 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.679208 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.679208 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] config_source = [] {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.679883 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.679959 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] debug = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.680036 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] insecure_debug = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.680127 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.680247 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.680337 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.680451 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.680544 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] insecure_debug = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.680632 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] list_limit = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.680711 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.680792 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] log_config_append = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.680792 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.680938 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.681015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] log_dir = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.681093 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] list_limit = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.681178 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] log_file = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.681272 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] log_config_append = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.681361 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.681947 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.681947 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] log_dir = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.682404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.682648 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] log_file = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.682878 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.683105 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.683105 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.683564 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.683564 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.684017 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.684244 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.684479 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.684718 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.684978 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.684978 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.685424 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.685659 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.685921 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.686179 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.686428 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.686662 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.686889 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.687082 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.687286 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.687438 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.687590 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.687796 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.687973 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] notification_format = cadf {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.688120 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.688280 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.688490 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] notification_format = cadf {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.688490 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.688802 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.688802 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] publish_errors = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.689086 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.689247 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.689440 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] publish_errors = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.689632 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.689834 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.689994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.690155 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.690307 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.690469 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.690616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.690781 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.690940 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] standard_threads = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.691084 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.691241 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] strict_password_check = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.691399 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] standard_threads = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.691545 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.691689 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] strict_password_check = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.691839 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] use_eventlog = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.691839 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] use_journal = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.692137 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.692310 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] use_json = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.692565 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] use_eventlog = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.692719 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] use_stderr = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.692863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] use_journal = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.693020 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] use_syslog = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.693177 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] use_json = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.693177 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] use_stderr = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.693505 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] watch_log_file = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.693662 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] use_syslog = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.693809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.693959 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] watch_log_file = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:17:56.694112 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.694282 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.694445 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.694613 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.694758 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.694908 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.695138 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.695317 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.695465 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.695616 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.695774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.695920 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.696075 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.696231 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.696377 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.696545 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.696690 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.696864 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.697067 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.697243 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.697432 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.697609 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.697763 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.697909 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.698061 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.698216 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.698377 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.698534 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.698698 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.698862 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.699017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.699179 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.699329 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.699473 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.699642 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.699788 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.699943 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.700117 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.700271 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.700450 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.700618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.700773 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.700925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.701079 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.701261 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.701488 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.701662 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.701827 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.701982 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.702128 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.702433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.702601 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.702762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.702922 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.703089 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.703242 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.703388 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.703581 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.703733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.703895 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.704139 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.704294 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.704454 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.704621 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.704784 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.704942 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.705098 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.705250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.705414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.705578 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.705738 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.705895 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.706051 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.706197 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.706367 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.706513 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.706669 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.706825 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.706986 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.707134 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.707278 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.707422 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.707579 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.707733 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.707888 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.708033 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.708178 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.708333 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.708498 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.708658 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.708821 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.708968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.709127 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.709274 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.709506 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.709683 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.709850 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.710004 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.710158 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.710302 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.710459 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.711180 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.711419 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.711654 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.711823 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.711974 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.712166 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.712372 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.712534 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.712703 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.712703 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.713020 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.713182 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.713182 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.713511 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.713711 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.713864 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.714019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.714019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.714322 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.714485 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.714485 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.714780 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.714934 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.715090 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.715242 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.715390 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.715552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.715552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.715843 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.716000 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.716000 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.716292 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.716457 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.716624 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.716808 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.716808 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.717124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.717272 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.717499 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.717680 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.717680 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.717970 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.718129 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.enabled = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.718277 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.718428 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.718428 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.718719 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.718865 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.718865 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.719155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.719300 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.719445 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.719602 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.719602 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.719922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.720075 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.720229 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.720376 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.720376 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.720650 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.enabled = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.720810 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.720810 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.721099 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.721250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.721250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.721574 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.721735 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.721908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.722055 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.722055 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.722361 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.722505 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.722658 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.722805 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.722805 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.723097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.723243 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.723389 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.723550 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.723550 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.723845 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.723990 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.723990 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.724296 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.724509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.724660 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.724806 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.724952 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.725111 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.725111 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] auth.external = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.725446 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.725601 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] auth.mapped = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.725747 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.725892 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.725892 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.726786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.727028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] auth.password = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.727028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] auth.token = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.727410 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.727558 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.727741 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.727952 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] catalog.caching = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.727952 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.728255 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.728416 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.728569 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.728717 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.728717 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.729058 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.729219 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.729410 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.729580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] credential.caching = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.729580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] credential.driver = sql {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.729877 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.730043 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.730199 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.730365 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.730365 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.730643 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.730806 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.730961 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.731134 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.731134 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.731439 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.731593 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.731756 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.731910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.731910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.732299 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.732480 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.732633 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.732936 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.733143 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] auth.external = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.733427 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.733427 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.733925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] auth.mapped = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.734175 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.734175 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] federation.caching = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.734627 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.734881 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.735121 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.735366 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] federation.driver = sql {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.735366 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.735860 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] auth.password = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.736109 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.736374 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] auth.token = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.736609 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.736609 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.737072 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.737340 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.737709 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] catalog.caching = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.737964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.737964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.738422 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.738675 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.738923 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.739404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.739404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] identity.caching = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.739892 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.740130 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.740393 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.740647 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.740647 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.741128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.741424 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.741424 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] identity.driver = sql {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.741893 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] credential.caching = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.742159 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.742426 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] credential.driver = sql {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.742699 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.742699 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.743267 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.743497 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.743728 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.743990 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.743990 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.744385 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.744547 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.744711 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.744863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.744863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.745158 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.745303 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.745303 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.745608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.745769 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.745936 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.746095 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.746095 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.746385 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.746531 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.746531 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.746830 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.746975 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.746975 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.747248 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.747410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.747410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.747710 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.747856 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.747856 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.748151 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.748311 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.748311 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.748613 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.748768 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.748768 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.749043 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.749204 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.749204 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.749572 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] federation.caching = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.749735 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.749735 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.750024 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.750170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.password = **** {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.750170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.750464 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] federation.driver = sql {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.750623 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.750623 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.750914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.751058 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.751202 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.751368 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.751368 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.751650 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.751797 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.751797 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.752097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.752259 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.752259 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.752550 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.752701 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.752849 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.752994 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.752994 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.753411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.753649 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.753813 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.753959 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.user = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.754118 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.754276 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.754435 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] identity.caching = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.754607 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.754755 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.754909 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.755064 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.755223 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.755369 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.755514 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.755659 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.755816 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.755971 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] identity.driver = sql {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.756132 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.756289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.756435 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.756591 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.756746 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.756893 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.757039 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.757183 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.757327 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.757993 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.758200 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.758414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.758612 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.758770 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.759173 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.759379 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.759546 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.759714 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.759861 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.760023 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.760189 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.760337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.760509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.760656 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.760803 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.760948 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.761100 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.761260 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.761544 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.761739 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.762035 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.762218 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.762381 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.762534 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.762693 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.762841 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.762986 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.763140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.763294 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.763440 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.763602 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] policy.driver = sql {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.763748 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.763912 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.764066 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.764223 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.764370 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.764525 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.764671 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.764822 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] receipt.caching = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.764991 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.765150 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.765296 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.765489 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.765641 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.765785 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.765937 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.766091 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.766250 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.766425 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.766572 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.766733 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] resource.caching = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.766888 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.password = **** {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.767034 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.767178 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.767332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] resource.driver = sql {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.767479 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.767623 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.767768 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.767919 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.768079 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.768233 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.768390 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.768536 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] revoke.caching = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.768536 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.768821 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.768966 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.768966 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] role.cache_time = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.769331 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.769544 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] role.caching = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.769711 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.769871 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] role.driver = sql {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.769871 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] role.list_limit = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.770176 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.770329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.770497 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.770657 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.770657 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.770958 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.771113 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.771309 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.771467 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.771628 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.771783 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.771944 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.772104 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.772251 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.user = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.772396 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.772568 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.772727 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.772892 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.773987 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.774156 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.774315 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.774464 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.774617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.774775 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.774983 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.775148 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.775148 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.775437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.775591 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.775762 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.775910 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.776055 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.776201 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.776355 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.776507 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.776662 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.776816 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.776963 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.777121 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.777277 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.777442 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.777607 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.777754 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.777929 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.778083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.778230 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.778375 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.778530 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.778676 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.778821 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.778967 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.779112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.779257 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.779410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.779556 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.779712 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.779887 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.780035 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.780180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.780336 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.780336 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.780612 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.780756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] token.cache_time = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.780908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.781054 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] token.caching = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.781219 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.781416 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.781583 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] policy.driver = sql {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.781731 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] token.provider = fernet {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.781891 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.782047 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.782205 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.782352 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.782497 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.782655 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.782814 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] receipt.caching = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.782967 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.783127 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.783296 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.783443 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.783595 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.783754 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.783900 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] trust.driver = sql {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.784071 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.784234 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.784382 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.784534 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.784685 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] resource.caching = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.784847 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.785012 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.785165 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.785319 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] resource.driver = sql {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.785497 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.785650 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.785814 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.785981 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.786134 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.786307 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.786460 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.786871 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] revoke.caching = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.787033 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] database.connection = **** {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.787194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.787358 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.787519 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.787682 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.787835 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] role.cache_time = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.788000 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.788154 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] role.caching = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.788314 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.788468 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] role.driver = sql {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.788633 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.789462 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] role.list_limit = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.789666 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.789833 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.789997 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.790151 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.790323 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.790489 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.790644 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.790803 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.790955 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.791107 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.791267 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.791421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.791599 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.791753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.791951 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.792121 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.792284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.792444 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.792598 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.792763 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.792915 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.792915 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.793217 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.793404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.793582 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.793756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=143281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 15:17:56.793914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.793914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.793914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.793914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.793914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.793914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.793914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.793914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.793914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.795255 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.795255 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.795255 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.795255 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.795255 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.795255 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.795255 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.795255 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.795255 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.796550 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.796550 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] token.cache_time = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.796550 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] token.caching = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.796550 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.796550 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] token.provider = fernet {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.796550 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.796550 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.796550 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.796550 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.797890 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.797890 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.797890 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] trust.driver = sql {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.797890 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.797890 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.797890 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.797890 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.797890 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.797890 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.799180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.799180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.799180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] database.connection = **** {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.799180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.799180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.799180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.799180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.799180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.799180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.800569 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.800569 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.800569 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.800569 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.800569 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.800569 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.800569 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.800569 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.800569 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.801948 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.801948 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.801948 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:17:56.801948 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=143282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 15:17:56.802677 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:56.802677 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:56.802677 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:56.806870 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:56.807083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:56.807248 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:56.807430 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:56.816404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:56.837400 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:56.837732 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:56.838458 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:56.838696 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:56.893050 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:56.893474 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:56.947327 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:56.947697 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:56.947900 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:56.948087 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.018181 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.018516 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.018695 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.018887 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.019070 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.019253 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.019413 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.019579 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.019749 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.019933 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.019933 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.019933 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.043611 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.043919 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.044103 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.044275 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.044470 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.044661 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.044840 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.045008 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.045188 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.045345 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.045564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.045721 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.045721 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.045721 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.057203 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.058139 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.072034 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.072362 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.072605 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.072605 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.072929 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.073085 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.073239 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.073439 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.073619 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.073777 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.073930 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.074093 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=143281) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.074269 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.074269 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=143282) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:17:57.091388 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.091680 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:17:57.091936 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.092140 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:17:57.092322 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.092510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.092666 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:17:57.092833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.092988 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.093157 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.093329 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:17:57.093519 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.093674 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.093674 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.093973 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.094135 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.104904 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.105126 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.105472 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.105702 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.105891 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.106147 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.106419 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.106903 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.113839 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=143281) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.115120 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=143282) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.117964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=143281) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.118303 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.118610 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.119014 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.119220 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=143282) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.119398 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.119571 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.119725 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.119879 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.120040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.120040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.120344 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.120504 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.120667 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.120836 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.121001 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.121169 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.121403 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.121403 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.121705 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.121859 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.122023 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.147993 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.150470 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=143281) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.150737 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.150931 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.152412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=143282) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.152758 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.156033 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=143281) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.156364 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.156573 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.158014 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=143282) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.158305 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.158588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.164612 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=143281) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.164981 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.166614 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=143282) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.166911 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.169630 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=143281) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.169919 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.170203 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.170487 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.170764 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.171039 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.171307 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.171573 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.171735 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=143282) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.171906 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.172159 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.172444 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.172721 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.173001 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.173275 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.173577 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.190839 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.191139 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.193277 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.193596 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.196223 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=143281) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.198758 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=143282) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.199861 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.200157 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.202412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.202715 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.205115 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=143281) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.207687 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=143282) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.208692 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=143281) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.211318 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=143282) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.212785 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.213087 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.213387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.213676 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.213955 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.214232 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.215079 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.215385 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.215673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.215962 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.216245 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.216528 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.233746 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=143281) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.234141 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.234414 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.234679 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.236282 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=143282) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.236681 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.236956 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.237226 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.243563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.245290 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.245591 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.245956 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.247691 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.247969 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.248660 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=143281) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.248940 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.249226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.249534 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.249813 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.251087 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=143282) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.251372 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.251665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.251951 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.252230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.263380 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=143281) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.263662 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.263942 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.264236 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.264542 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.264821 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.265093 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.265877 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=143282) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.266170 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.266459 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.266758 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.267043 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.267334 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.267613 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.283694 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=143281) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.286679 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=143282) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.286997 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=143281) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.290070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=143282) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.290592 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.292185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.293407 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.293883 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=143281) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.294112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.294407 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.295042 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.296682 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=143282) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.296994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.297264 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.301838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.303433 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=143281) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.305328 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.306961 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=143282) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.307333 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.307627 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.307911 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.308187 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.310216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.310510 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.310796 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.311077 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.317413 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=143281) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.317710 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.317990 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.320414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=143282) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.320723 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.321009 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.326294 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=143281) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.326577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.326857 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.327130 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.327405 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.327689 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.327963 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.328238 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.328498 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.328759 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.329039 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.329207 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=143282) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:17:57.329403 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.329590 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.329771 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.329926 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.330080 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=143281) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.330234 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.330234 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.330534 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.330705 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.330978 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.331251 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.331533 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.331806 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.332080 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.332360 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.332621 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=143282) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:17:57.369850 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b763b849c0 pid: 143281 (default app) May 09 15:17:57.373352 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd484e-ee4e-4c0d-8abe-ebe606bd5eb3 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:17:57.373687 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd484e-ee4e-4c0d-8abe-ebe606bd5eb3 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:17:57.373858 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b763b849c0 pid: 143282 (default app) May 09 15:17:57.374017 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd484e-ee4e-4c0d-8abe-ebe606bd5eb3 None None] PATH_INFO: `/v3` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:17:57.378279 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Mon May 9 15:17:57 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:06.124152 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a793e4-f3c6-4572-9aaa-30157ed2fc2a None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:06.124813 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a793e4-f3c6-4572-9aaa-30157ed2fc2a None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:06.124813 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a793e4-f3c6-4572-9aaa-30157ed2fc2a None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:06.130247 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:06 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:18:06.140183 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1899af-8bba-4c10-9f88-875ecfa7aefb None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:06.141214 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1899af-8bba-4c10-9f88-875ecfa7aefb None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:06.142020 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1899af-8bba-4c10-9f88-875ecfa7aefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:06.188358 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG oslo_db.sqlalchemy.engines [None req-9c1899af-8bba-4c10-9f88-875ecfa7aefb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=143281) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 15:18:06.403236 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG passlib.handlers.bcrypt [None req-9c1899af-8bba-4c10-9f88-875ecfa7aefb None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=143281) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 09 15:18:06.403567 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG passlib.handlers.bcrypt [None req-9c1899af-8bba-4c10-9f88-875ecfa7aefb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=143281) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 09 15:18:06.462565 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-9c1899af-8bba-4c10-9f88-875ecfa7aefb None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:06.464294 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-9c1899af-8bba-4c10-9f88-875ecfa7aefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:06.607970 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 09 15:18:06.634329 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a793e4-f3c6-4572-9aaa-30157ed2fc2a None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:06.674317 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG oslo_db.sqlalchemy.engines [None req-18a793e4-f3c6-4572-9aaa-30157ed2fc2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=143282) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 15:18:06.810875 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a793e4-f3c6-4572-9aaa-30157ed2fc2a None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:06.815397 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295bb8c-81cc-4e3c-86af-1d17fcf9b1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3979039e1b469e8159aa2395cc78de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:06.816097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295bb8c-81cc-4e3c-86af-1d17fcf9b1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:06.816418 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295bb8c-81cc-4e3c-86af-1d17fcf9b1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:06.816706 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295bb8c-81cc-4e3c-86af-1d17fcf9b1b9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:06.826851 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295bb8c-81cc-4e3c-86af-1d17fcf9b1b9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:06.881109 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5295bb8c-81cc-4e3c-86af-1d17fcf9b1b9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 09 15:18:06.881595 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295bb8c-81cc-4e3c-86af-1d17fcf9b1b9 admin admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:06.893238 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Mon May 9 15:18:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 15:18:06.899551 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1899af-8bba-4c10-9f88-875ecfa7aefb None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:06.914274 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1899af-8bba-4c10-9f88-875ecfa7aefb None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:06.918898 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a0a69-4da9-4d75-91d4-f2a9571c1725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3979039e1b469e8159aa2395cc78de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:06.920182 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a0a69-4da9-4d75-91d4-f2a9571c1725 admin admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:06.920546 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a0a69-4da9-4d75-91d4-f2a9571c1725 admin admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:06.920906 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a0a69-4da9-4d75-91d4-f2a9571c1725 admin admin] PATH_INFO: `/v3/projects/0a3979039e1b469e8159aa2395cc78de` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:06.922597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a0a69-4da9-4d75-91d4-f2a9571c1725 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a3979039e1b469e8159aa2395cc78de)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:06.973910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1d7a0a69-4da9-4d75-91d4-f2a9571c1725 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 09 15:18:06.974259 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a0a69-4da9-4d75-91d4-f2a9571c1725 admin admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:06.979279 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Mon May 9 15:18:06 2022] GET /identity/v3/projects/0a3979039e1b469e8159aa2395cc78de => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:09.330478 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601c451-0ec8-4301-b05a-34f41813fc24 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:09.331053 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601c451-0ec8-4301-b05a-34f41813fc24 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:09.331053 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601c451-0ec8-4301-b05a-34f41813fc24 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:09.335858 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:09.342355 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c997c-7fc5-4fe7-b744-21acb7bee1e0 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:09.342805 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c997c-7fc5-4fe7-b744-21acb7bee1e0 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:09.342936 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c997c-7fc5-4fe7-b744-21acb7bee1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:09.364531 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-799c997c-7fc5-4fe7-b744-21acb7bee1e0 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:09.366133 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-799c997c-7fc5-4fe7-b744-21acb7bee1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:09.374524 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 09 15:18:09.397012 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601c451-0ec8-4301-b05a-34f41813fc24 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:09.410384 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601c451-0ec8-4301-b05a-34f41813fc24 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:09.415847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828b8d3-5957-45eb-a1a4-9a29c0fb36ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3979039e1b469e8159aa2395cc78de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:09.416500 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828b8d3-5957-45eb-a1a4-9a29c0fb36ff admin admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:09.416794 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828b8d3-5957-45eb-a1a4-9a29c0fb36ff admin admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:09.417084 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828b8d3-5957-45eb-a1a4-9a29c0fb36ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:09.425069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828b8d3-5957-45eb-a1a4-9a29c0fb36ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:09.426900 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828b8d3-5957-45eb-a1a4-9a29c0fb36ff admin admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:09.436723 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Mon May 9 15:18:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 15:18:09.442645 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c997c-7fc5-4fe7-b744-21acb7bee1e0 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:09.451999 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c997c-7fc5-4fe7-b744-21acb7bee1e0 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:09.456588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899abb3-96fe-4a09-a7cd-a2678574475f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a3979039e1b469e8159aa2395cc78de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:09.457586 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899abb3-96fe-4a09-a7cd-a2678574475f admin admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:09.457947 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899abb3-96fe-4a09-a7cd-a2678574475f admin admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:09.458320 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899abb3-96fe-4a09-a7cd-a2678574475f admin admin] PATH_INFO: `/v3/users/1cdae28a6c6045309f4aaea02e9f2c9d` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:09.459827 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899abb3-96fe-4a09-a7cd-a2678574475f admin admin] RBAC: Authorizing `identity:get_user(user_id=1cdae28a6c6045309f4aaea02e9f2c9d)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:09.462454 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899abb3-96fe-4a09-a7cd-a2678574475f admin admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:09.464287 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Mon May 9 15:18:09 2022] GET /identity/v3/users/1cdae28a6c6045309f4aaea02e9f2c9d => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:11.820171 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223b1f9-5f3a-4116-84cf-add2e9c7b05a None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:11.820716 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223b1f9-5f3a-4116-84cf-add2e9c7b05a None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:11.820716 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223b1f9-5f3a-4116-84cf-add2e9c7b05a None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:11.822076 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:18:11.827937 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd6bf6-07e0-4853-83f2-2eddea1fb1b6 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:11.828542 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd6bf6-07e0-4853-83f2-2eddea1fb1b6 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:11.828542 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd6bf6-07e0-4853-83f2-2eddea1fb1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:11.957927 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-1ebd6bf6-07e0-4853-83f2-2eddea1fb1b6 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:11.959162 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-1ebd6bf6-07e0-4853-83f2-2eddea1fb1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:11.999137 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68892273-aa89-4607-b806-d7444fdb2c44 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:11.999430 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68892273-aa89-4607-b806-d7444fdb2c44 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:11.999717 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68892273-aa89-4607-b806-d7444fdb2c44 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:12.001086 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:12.006427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9430ca-d240-4ff2-96cd-9e9150901f76 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:12.006724 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9430ca-d240-4ff2-96cd-9e9150901f76 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:12.007017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9430ca-d240-4ff2-96cd-9e9150901f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:12.040181 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:12.047870 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG passlib.handlers.bcrypt [None req-ed9430ca-d240-4ff2-96cd-9e9150901f76 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=143282) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 09 15:18:12.048296 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG passlib.handlers.bcrypt [None req-ed9430ca-d240-4ff2-96cd-9e9150901f76 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=143282) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 09 15:18:12.063399 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd6bf6-07e0-4853-83f2-2eddea1fb1b6 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:12.095849 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-ed9430ca-d240-4ff2-96cd-9e9150901f76 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:12.097466 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-ed9430ca-d240-4ff2-96cd-9e9150901f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:12.168014 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd6bf6-07e0-4853-83f2-2eddea1fb1b6 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:12.201782 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec019e7-e4e0-4e48-b035-c1af9b0f82dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:12.202583 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec019e7-e4e0-4e48-b035-c1af9b0f82dc None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:12.202884 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec019e7-e4e0-4e48-b035-c1af9b0f82dc None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:12.203161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec019e7-e4e0-4e48-b035-c1af9b0f82dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:12.209179 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:18:12.214945 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec019e7-e4e0-4e48-b035-c1af9b0f82dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:12.227005 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-4ec019e7-e4e0-4e48-b035-c1af9b0f82dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:18:12.227005 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:12.227005 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:12.227005 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:12.227005 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:12.227005 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:12.227005 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:12.227005 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:12.227005 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:12.227005 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:12.227005 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:12.227005 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:12.227005 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:12.227005 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:12.227005 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:12.227005 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:12.228278 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:12.228278 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:12.228278 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:12.228278 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:12.228278 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:12.228278 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:12.228278 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:12.228278 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:12.228278 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:12.228278 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:12.228278 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:12.228278 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:18:12.228278 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:12.228278 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:12.228278 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:12.228278 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:12.229288 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:12.229288 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:12.229288 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:12.229288 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:12.229288 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:12.229288 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:12.229288 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:12.229288 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:12.229288 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:12.229288 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:12.229288 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:18:12.229288 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:18:12.229288 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:18:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:18:12.232310 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9430ca-d240-4ff2-96cd-9e9150901f76 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:12.233710 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec019e7-e4e0-4e48-b035-c1af9b0f82dc None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:12.330577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec019e7-e4e0-4e48-b035-c1af9b0f82dc None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:12.338122 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9430ca-d240-4ff2-96cd-9e9150901f76 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:12.364645 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b91c6e-954c-4bbe-ac08-bcb13d8b9f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:12.365246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b91c6e-954c-4bbe-ac08-bcb13d8b9f06 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:12.365567 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b91c6e-954c-4bbe-ac08-bcb13d8b9f06 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:12.365847 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b91c6e-954c-4bbe-ac08-bcb13d8b9f06 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:12.366649 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b91c6e-954c-4bbe-ac08-bcb13d8b9f06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:12.366961 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b91c6e-954c-4bbe-ac08-bcb13d8b9f06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:12.368365 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b91c6e-954c-4bbe-ac08-bcb13d8b9f06 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:12.370972 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb1456-a909-4c56-8407-c935417b949e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:12.371980 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb1456-a909-4c56-8407-c935417b949e None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:12.372167 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb1456-a909-4c56-8407-c935417b949e None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:12.372449 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb1456-a909-4c56-8407-c935417b949e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:12.380272 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 8/15] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:18:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:12.385838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b91c6e-954c-4bbe-ac08-bcb13d8b9f06 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:12.438497 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb1456-a909-4c56-8407-c935417b949e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:12.440038 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb1456-a909-4c56-8407-c935417b949e None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:12.483110 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b91c6e-954c-4bbe-ac08-bcb13d8b9f06 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:12.517824 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7481f54-c561-4418-bc93-84c4935aef3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:12.518700 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7481f54-c561-4418-bc93-84c4935aef3a None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:12.518987 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7481f54-c561-4418-bc93-84c4935aef3a None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:12.519270 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7481f54-c561-4418-bc93-84c4935aef3a None admin] PATH_INFO: `/v3/users/1cdae28a6c6045309f4aaea02e9f2c9d` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:12.520501 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7481f54-c561-4418-bc93-84c4935aef3a None admin] RBAC: Authorizing `identity:get_user(user_id=1cdae28a6c6045309f4aaea02e9f2c9d)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:12.522012 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7481f54-c561-4418-bc93-84c4935aef3a None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:12.524514 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 9/16] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:12 2022] GET /identity/v3/users/1cdae28a6c6045309f4aaea02e9f2c9d => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:12.530043 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7481f54-c561-4418-bc93-84c4935aef3a None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:12.535957 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 8/17] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:18:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:18:12.541548 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb1456-a909-4c56-8407-c935417b949e None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:12.634563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7481f54-c561-4418-bc93-84c4935aef3a None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:12.670277 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3f029-1661-446d-bca6-b98e6f218add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:12.671080 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3f029-1661-446d-bca6-b98e6f218add None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:12.671363 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3f029-1661-446d-bca6-b98e6f218add None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:12.671638 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3f029-1661-446d-bca6-b98e6f218add None admin] PATH_INFO: `/v3/domains/default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:12.672837 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3f029-1661-446d-bca6-b98e6f218add None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:12.674307 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3f029-1661-446d-bca6-b98e6f218add None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:12.675927 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 10/18] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:18:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:12.681621 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3f029-1661-446d-bca6-b98e6f218add None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:12.751422 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb1456-a909-4c56-8407-c935417b949e None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:12.782201 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3f029-1661-446d-bca6-b98e6f218add None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:12.783950 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d56ab5-2530-4ce5-b7a1-a10468ff2b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:12.784755 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d56ab5-2530-4ce5-b7a1-a10468ff2b84 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:12.785042 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d56ab5-2530-4ce5-b7a1-a10468ff2b84 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:12.785318 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d56ab5-2530-4ce5-b7a1-a10468ff2b84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:12.805291 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d56ab5-2530-4ce5-b7a1-a10468ff2b84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:12.806808 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d56ab5-2530-4ce5-b7a1-a10468ff2b84 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:12.816450 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de37a9-38c8-48f3-853c-5a2a5885eb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:12.817117 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de37a9-38c8-48f3-853c-5a2a5885eb67 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:12.817430 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de37a9-38c8-48f3-853c-5a2a5885eb67 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:12.817711 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de37a9-38c8-48f3-853c-5a2a5885eb67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:12.818565 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de37a9-38c8-48f3-853c-5a2a5885eb67 None admin] RBAC: Adding query filter params (role.id=9aaa841361294b9c9b275ca1be0ed89c, scope.domain.id=default, user.id=1cdae28a6c6045309f4aaea02e9f2c9d) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:12.818890 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de37a9-38c8-48f3-853c-5a2a5885eb67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:12.820597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de37a9-38c8-48f3-853c-5a2a5885eb67 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:12.827412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-13d56ab5-2530-4ce5-b7a1-a10468ff2b84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:18:12.827412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:12.827412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:12.827412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:12.827412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:12.827412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:12.827412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:12.827412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:12.827412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:12.827412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:12.827412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:12.827412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:12.827412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:18:12.827412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:18:12.827412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:18:12.828786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:18:12.828786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:12.828786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:12.828786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:12.828786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:12.828786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:12.828786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:12.828786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:12.828786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:18:12.828786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:12.828786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:12.828786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:12.828786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:12.828786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:12.828786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:12.828786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:12.828786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:12.829834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:18:12.829834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:18:12.829834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:18:12.829834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:18:12.830105 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 11/19] 10.222.0.48 () {56 vars in 1322 bytes} [Mon May 9 15:18:12 2022] GET /identity/v3/role_assignments?user.id=1cdae28a6c6045309f4aaea02e9f2c9d&scope.domain.id=default&role.id=9aaa841361294b9c9b275ca1be0ed89c => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:12.830480 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 9/20] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:18:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:18:12.834837 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de37a9-38c8-48f3-853c-5a2a5885eb67 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:12.942842 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de37a9-38c8-48f3-853c-5a2a5885eb67 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:12.977810 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6373f4-3171-4b75-9a58-34eb304d5cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:12.978490 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6373f4-3171-4b75-9a58-34eb304d5cd3 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:12.978779 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6373f4-3171-4b75-9a58-34eb304d5cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:12.979059 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6373f4-3171-4b75-9a58-34eb304d5cd3 None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:12.979809 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6373f4-3171-4b75-9a58-34eb304d5cd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:12.980120 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6373f4-3171-4b75-9a58-34eb304d5cd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:12.981578 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6373f4-3171-4b75-9a58-34eb304d5cd3 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:13.001276 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 12/21] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:15.359472 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939551b-7eda-4e4d-a3a5-9160f01d84d0 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:15.360021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939551b-7eda-4e4d-a3a5-9160f01d84d0 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:15.360021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939551b-7eda-4e4d-a3a5-9160f01d84d0 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:15.361425 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 10/22] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:15.379488 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639a0c3-00ba-42b4-852d-1c2549a176d1 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:15.380064 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639a0c3-00ba-42b4-852d-1c2549a176d1 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:15.380064 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639a0c3-00ba-42b4-852d-1c2549a176d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:15.403838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-1639a0c3-00ba-42b4-852d-1c2549a176d1 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:15.405065 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-1639a0c3-00ba-42b4-852d-1c2549a176d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:15.493279 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 13/23] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:15.530900 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939551b-7eda-4e4d-a3a5-9160f01d84d0 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:15.679508 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939551b-7eda-4e4d-a3a5-9160f01d84d0 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:15.725285 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec30c4-baf7-4dc5-8531-fc869c109558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:15.726845 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec30c4-baf7-4dc5-8531-fc869c109558 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:15.727147 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec30c4-baf7-4dc5-8531-fc869c109558 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:15.727438 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec30c4-baf7-4dc5-8531-fc869c109558 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:15.748098 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec30c4-baf7-4dc5-8531-fc869c109558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:15.761797 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-f1ec30c4-baf7-4dc5-8531-fc869c109558 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:18:15.761797 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:15.761797 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:15.761797 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:15.761797 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:15.761797 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:15.761797 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:15.761797 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:15.761797 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:15.761797 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:15.761797 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:15.761797 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:15.761797 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:15.761797 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:15.761797 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:15.761797 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:15.763101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:15.763101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:15.763101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:15.763101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:15.763101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:15.763101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:15.763101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:15.763101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:15.763101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:15.763101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:15.763101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:15.763101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:18:15.763101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:15.763101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:15.763101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:15.763101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:15.764021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:15.764021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:15.764021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:15.764021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:15.764021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:15.764021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:15.764021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:15.764021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:15.764021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:15.764021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:15.764021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:18:15.764021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:18:15.764021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 11/24] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:18:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:15.770485 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639a0c3-00ba-42b4-852d-1c2549a176d1 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:15.837723 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d393052-6d6f-41ac-b4b3-05c278c61936 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:15.838407 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d393052-6d6f-41ac-b4b3-05c278c61936 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:15.838924 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d393052-6d6f-41ac-b4b3-05c278c61936 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:15.840809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 12/25] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:15.845927 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cee6b-157a-45e2-9b72-12cac0ce44dc None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:15.846495 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cee6b-157a-45e2-9b72-12cac0ce44dc None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:15.846997 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cee6b-157a-45e2-9b72-12cac0ce44dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:15.880128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-e91cee6b-157a-45e2-9b72-12cac0ce44dc None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:15.881781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-e91cee6b-157a-45e2-9b72-12cac0ce44dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:15.890414 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639a0c3-00ba-42b4-852d-1c2549a176d1 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:15.926402 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01743f-0a92-49b3-8326-36ac9a508408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:15.927456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01743f-0a92-49b3-8326-36ac9a508408 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:15.927975 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01743f-0a92-49b3-8326-36ac9a508408 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:15.928480 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01743f-0a92-49b3-8326-36ac9a508408 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:15.929600 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01743f-0a92-49b3-8326-36ac9a508408 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:15.930334 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01743f-0a92-49b3-8326-36ac9a508408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:15.931972 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01743f-0a92-49b3-8326-36ac9a508408 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:15.941162 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 14/26] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:18:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:15.950527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01743f-0a92-49b3-8326-36ac9a508408 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:16.008594 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 13/27] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:16.050822 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91cee6b-157a-45e2-9b72-12cac0ce44dc None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:16.066135 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01743f-0a92-49b3-8326-36ac9a508408 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:16.103650 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cdafd-f2ca-4da5-a24f-8d22d429e020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:16.105065 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cdafd-f2ca-4da5-a24f-8d22d429e020 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:16.105596 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cdafd-f2ca-4da5-a24f-8d22d429e020 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:16.106119 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cdafd-f2ca-4da5-a24f-8d22d429e020 None admin] PATH_INFO: `/v3/users/1cdae28a6c6045309f4aaea02e9f2c9d` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:16.107620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cdafd-f2ca-4da5-a24f-8d22d429e020 None admin] RBAC: Authorizing `identity:get_user(user_id=1cdae28a6c6045309f4aaea02e9f2c9d)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:16.109293 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cdafd-f2ca-4da5-a24f-8d22d429e020 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:16.111254 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 15/28] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:15 2022] GET /identity/v3/users/1cdae28a6c6045309f4aaea02e9f2c9d => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:16.118016 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cdafd-f2ca-4da5-a24f-8d22d429e020 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:16.188619 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91cee6b-157a-45e2-9b72-12cac0ce44dc None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:16.239502 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd32d2c-aeb1-4434-8463-90c1f0e1d447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:16.240568 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd32d2c-aeb1-4434-8463-90c1f0e1d447 None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:16.241115 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd32d2c-aeb1-4434-8463-90c1f0e1d447 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:16.242353 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd32d2c-aeb1-4434-8463-90c1f0e1d447 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:16.243371 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd32d2c-aeb1-4434-8463-90c1f0e1d447 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:16.245001 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd32d2c-aeb1-4434-8463-90c1f0e1d447 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:16.256719 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cdafd-f2ca-4da5-a24f-8d22d429e020 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:16.293960 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff2dba-3fc4-4396-97ab-cef830cd4ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:16.295218 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff2dba-3fc4-4396-97ab-cef830cd4ebc None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:16.295659 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff2dba-3fc4-4396-97ab-cef830cd4ebc None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:16.296103 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff2dba-3fc4-4396-97ab-cef830cd4ebc None admin] PATH_INFO: `/v3/domains/default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:16.297543 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff2dba-3fc4-4396-97ab-cef830cd4ebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:16.299817 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff2dba-3fc4-4396-97ab-cef830cd4ebc None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:16.302182 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 16/29] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:18:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:16.308302 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff2dba-3fc4-4396-97ab-cef830cd4ebc None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:16.424949 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 14/30] 10.222.0.48 () {60 vars in 1131 bytes} [Mon May 9 15:18:16 2022] POST /identity/v3/roles => generated 219 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:18:16.427129 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16904136-553e-4daa-9050-80944ed0a2d9 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:16.427620 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16904136-553e-4daa-9050-80944ed0a2d9 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:16.428071 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16904136-553e-4daa-9050-80944ed0a2d9 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:16.430859 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 15/31] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:16.439062 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd28be-498b-4387-b3e5-8cb524909c74 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:16.439600 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd28be-498b-4387-b3e5-8cb524909c74 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:16.440073 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd28be-498b-4387-b3e5-8cb524909c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:16.476292 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-0bdd28be-498b-4387-b3e5-8cb524909c74 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:16.478474 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-0bdd28be-498b-4387-b3e5-8cb524909c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:16.530366 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff2dba-3fc4-4396-97ab-cef830cd4ebc None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:16.622936 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2be051-321c-4d34-b138-0b5dcdf14063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:16.623800 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2be051-321c-4d34-b138-0b5dcdf14063 None admin] REQUEST_METHOD: `PUT` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:16.624091 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2be051-321c-4d34-b138-0b5dcdf14063 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:16.624384 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2be051-321c-4d34-b138-0b5dcdf14063 None admin] PATH_INFO: `/v3/domains/default/users/1cdae28a6c6045309f4aaea02e9f2c9d/roles/9aaa841361294b9c9b275ca1be0ed89c` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:16.631301 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2be051-321c-4d34-b138-0b5dcdf14063 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1cdae28a6c6045309f4aaea02e9f2c9d, role_id=9aaa841361294b9c9b275ca1be0ed89c)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:16.633872 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2be051-321c-4d34-b138-0b5dcdf14063 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:16.650889 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 16/32] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:16.690314 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd28be-498b-4387-b3e5-8cb524909c74 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:16.765179 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 17/33] 10.222.0.48 () {58 vars in 1361 bytes} [Mon May 9 15:18:16 2022] PUT /identity/v3/domains/default/users/1cdae28a6c6045309f4aaea02e9f2c9d/roles/9aaa841361294b9c9b275ca1be0ed89c => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:18:16.767074 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6e744-deba-4c15-9874-8866a3f9d45e None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:16.767378 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6e744-deba-4c15-9874-8866a3f9d45e None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:16.767663 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6e744-deba-4c15-9874-8866a3f9d45e None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:16.772198 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 18/34] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:16.778911 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1bbe1-26ca-431f-81a6-9eaf7999b89d None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:16.779247 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1bbe1-26ca-431f-81a6-9eaf7999b89d None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:16.779479 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1bbe1-26ca-431f-81a6-9eaf7999b89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:16.804797 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-00b1bbe1-26ca-431f-81a6-9eaf7999b89d None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:16.808627 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-00b1bbe1-26ca-431f-81a6-9eaf7999b89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:16.845601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd28be-498b-4387-b3e5-8cb524909c74 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:16.896913 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25431f28-fd5e-49fd-955e-d66735789f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:16.898348 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25431f28-fd5e-49fd-955e-d66735789f86 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:16.898748 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25431f28-fd5e-49fd-955e-d66735789f86 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:16.899696 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25431f28-fd5e-49fd-955e-d66735789f86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:16.917731 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25431f28-fd5e-49fd-955e-d66735789f86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:16.919389 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25431f28-fd5e-49fd-955e-d66735789f86 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:16.925630 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 19/35] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:18:16.950001 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-25431f28-fd5e-49fd-955e-d66735789f86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:18:16.950001 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:16.950001 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:16.950001 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:16.950001 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:16.950001 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:16.950001 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:16.950001 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:16.950001 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:16.950001 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:16.950001 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:16.950001 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:16.950001 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:18:16.950001 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:18:16.950001 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:18:16.951033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:18:16.951033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:16.951033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:16.951033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:16.951033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:16.951033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:16.951033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:16.951033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:16.951033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:18:16.951033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:16.951033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:16.951033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:16.951033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:16.951033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:16.951033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:16.951033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:16.951033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:16.952035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:18:16.952035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:18:16.952035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:18:16.952035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:18:16.952035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 17/36] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:18:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:16.959227 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1bbe1-26ca-431f-81a6-9eaf7999b89d None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:16.995883 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25431f28-fd5e-49fd-955e-d66735789f86 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:17.115260 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1bbe1-26ca-431f-81a6-9eaf7999b89d None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:17.157226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c957bd-e9d9-4a6f-a78f-ab70419af947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:17.157998 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c957bd-e9d9-4a6f-a78f-ab70419af947 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:17.158294 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c957bd-e9d9-4a6f-a78f-ab70419af947 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:17.158638 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c957bd-e9d9-4a6f-a78f-ab70419af947 None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:17.159414 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c957bd-e9d9-4a6f-a78f-ab70419af947 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:17.159716 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25431f28-fd5e-49fd-955e-d66735789f86 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:17.159833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c957bd-e9d9-4a6f-a78f-ab70419af947 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:17.161283 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c957bd-e9d9-4a6f-a78f-ab70419af947 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:17.174770 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 20/37] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:17.181604 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c957bd-e9d9-4a6f-a78f-ab70419af947 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:17.204180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49b74a-12a4-457e-8d4a-75d8b017a223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:17.204834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49b74a-12a4-457e-8d4a-75d8b017a223 None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:17.205124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49b74a-12a4-457e-8d4a-75d8b017a223 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:17.206510 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49b74a-12a4-457e-8d4a-75d8b017a223 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:17.211961 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49b74a-12a4-457e-8d4a-75d8b017a223 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:17.214533 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49b74a-12a4-457e-8d4a-75d8b017a223 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:17.243650 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 18/38] 10.222.0.48 () {60 vars in 1131 bytes} [Mon May 9 15:18:16 2022] POST /identity/v3/roles => generated 225 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:18:17.346569 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c957bd-e9d9-4a6f-a78f-ab70419af947 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:17.395913 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3e5fb-d03d-4604-83c1-78308da68b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:17.396668 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3e5fb-d03d-4604-83c1-78308da68b78 None admin] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:17.396961 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3e5fb-d03d-4604-83c1-78308da68b78 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:17.397249 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3e5fb-d03d-4604-83c1-78308da68b78 None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:17.399352 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3e5fb-d03d-4604-83c1-78308da68b78 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:17.400991 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3e5fb-d03d-4604-83c1-78308da68b78 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:17.455105 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 21/39] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:18:17 2022] POST /identity/v3/projects => generated 301 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:18:17.483319 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408a5b9-bf54-4486-848f-265f51470ff0 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:17.483848 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408a5b9-bf54-4486-848f-265f51470ff0 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:17.483980 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408a5b9-bf54-4486-848f-265f51470ff0 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:17.485293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 19/40] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:17.493001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7247359-2c9a-41f3-8a67-85c9df0324c7 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:17.493358 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7247359-2c9a-41f3-8a67-85c9df0324c7 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:17.493618 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7247359-2c9a-41f3-8a67-85c9df0324c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:17.523587 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-a7247359-2c9a-41f3-8a67-85c9df0324c7 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:17.524612 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-a7247359-2c9a-41f3-8a67-85c9df0324c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:17.621277 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 22/41] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:17.646559 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408a5b9-bf54-4486-848f-265f51470ff0 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:17.657756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01067221-86df-4d28-b46f-928db1c8bc3a None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:17.658110 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01067221-86df-4d28-b46f-928db1c8bc3a None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:17.658338 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01067221-86df-4d28-b46f-928db1c8bc3a None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:17.660117 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 23/42] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:17.666709 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38b4d4-a16e-42f7-9fa5-9487de7592e7 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:17.667064 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38b4d4-a16e-42f7-9fa5-9487de7592e7 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:17.667290 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38b4d4-a16e-42f7-9fa5-9487de7592e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:17.696216 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-5c38b4d4-a16e-42f7-9fa5-9487de7592e7 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:17.697618 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-5c38b4d4-a16e-42f7-9fa5-9487de7592e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:17.796976 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 24/43] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:18:17.815848 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408a5b9-bf54-4486-848f-265f51470ff0 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:17.821917 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38b4d4-a16e-42f7-9fa5-9487de7592e7 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:17.860604 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e86c8-9175-4cd7-972a-a4cc4f2edf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:17.861298 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e86c8-9175-4cd7-972a-a4cc4f2edf21 None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:17.861639 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e86c8-9175-4cd7-972a-a4cc4f2edf21 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:17.861926 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e86c8-9175-4cd7-972a-a4cc4f2edf21 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:17.862707 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e86c8-9175-4cd7-972a-a4cc4f2edf21 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:17.864364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e86c8-9175-4cd7-972a-a4cc4f2edf21 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:17.879051 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 20/44] 10.222.0.48 () {60 vars in 1131 bytes} [Mon May 9 15:18:17 2022] POST /identity/v3/roles => generated 223 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:18:17.937464 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38b4d4-a16e-42f7-9fa5-9487de7592e7 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:17.975347 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462fd39-02b1-47bd-a7af-8a8a417c6769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:17.976898 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462fd39-02b1-47bd-a7af-8a8a417c6769 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:17.977434 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462fd39-02b1-47bd-a7af-8a8a417c6769 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:17.977731 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462fd39-02b1-47bd-a7af-8a8a417c6769 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:17.979058 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462fd39-02b1-47bd-a7af-8a8a417c6769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:17.980593 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462fd39-02b1-47bd-a7af-8a8a417c6769 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:17.982708 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 25/45] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:18:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:17.988400 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e86c8-9175-4cd7-972a-a4cc4f2edf21 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:18.107259 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e86c8-9175-4cd7-972a-a4cc4f2edf21 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:18.146813 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46100ed7-43b0-4685-ad9a-3f80fb2bba99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:18.147817 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46100ed7-43b0-4685-ad9a-3f80fb2bba99 None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:18.147988 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46100ed7-43b0-4685-ad9a-3f80fb2bba99 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:18.148210 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46100ed7-43b0-4685-ad9a-3f80fb2bba99 None admin] PATH_INFO: `/v3/projects` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:18.149235 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46100ed7-43b0-4685-ad9a-3f80fb2bba99 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:18.150822 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46100ed7-43b0-4685-ad9a-3f80fb2bba99 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:18.181079 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 21/46] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:18:17 2022] POST /identity/v3/projects => generated 312 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:18:19.358074 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d2624-579c-4b09-bfd9-1521fe400256 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:19.358650 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d2624-579c-4b09-bfd9-1521fe400256 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:19.358650 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d2624-579c-4b09-bfd9-1521fe400256 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:19.360071 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 26/47] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:19.365967 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80281a58-ead1-47c5-bb0b-ae4a843574a7 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:19.366499 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80281a58-ead1-47c5-bb0b-ae4a843574a7 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:19.366580 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80281a58-ead1-47c5-bb0b-ae4a843574a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:19.384228 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-80281a58-ead1-47c5-bb0b-ae4a843574a7 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:19.385478 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-80281a58-ead1-47c5-bb0b-ae4a843574a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:19.451613 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 22/48] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:19.475092 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d2624-579c-4b09-bfd9-1521fe400256 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:19.574723 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d2624-579c-4b09-bfd9-1521fe400256 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:19.607203 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c689fc-8697-4463-bd3b-cacfe05c5b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:19.608008 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c689fc-8697-4463-bd3b-cacfe05c5b4e None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:19.608347 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c689fc-8697-4463-bd3b-cacfe05c5b4e None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:19.608579 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c689fc-8697-4463-bd3b-cacfe05c5b4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:19.619451 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c689fc-8697-4463-bd3b-cacfe05c5b4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:19.627311 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-82c689fc-8697-4463-bd3b-cacfe05c5b4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:18:19.627311 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:19.627311 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:19.627311 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:19.627311 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:19.627311 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:19.627311 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:19.627311 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:19.627311 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:19.627311 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:19.627311 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:19.627311 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:19.627311 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:19.627311 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:19.627311 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:19.627311 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:19.628528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:19.628528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:19.628528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:19.628528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:19.628528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:19.628528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:19.628528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:19.628528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:19.628528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:19.628528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:19.628528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:19.628528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:18:19.628528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:19.628528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:19.628528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:19.628528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:19.629533 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:19.629533 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:19.629533 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:19.629533 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:19.629533 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:19.629533 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:19.629533 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:19.629533 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:19.629533 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:19.629533 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:19.629533 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:18:19.629533 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:18:19.629533 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 27/49] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:18:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:19.635834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80281a58-ead1-47c5-bb0b-ae4a843574a7 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:19.729788 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80281a58-ead1-47c5-bb0b-ae4a843574a7 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:19.763711 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950acdbf-1e77-4ef9-8968-e4a21902549a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:19.764387 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950acdbf-1e77-4ef9-8968-e4a21902549a None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:19.764673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950acdbf-1e77-4ef9-8968-e4a21902549a None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:19.764952 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950acdbf-1e77-4ef9-8968-e4a21902549a None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:19.765744 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950acdbf-1e77-4ef9-8968-e4a21902549a None admin] RBAC: Adding query filter params (name=admin) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:19.766057 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950acdbf-1e77-4ef9-8968-e4a21902549a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:19.767442 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950acdbf-1e77-4ef9-8968-e4a21902549a None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:19.779134 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 23/50] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:18:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:19.784695 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c689fc-8697-4463-bd3b-cacfe05c5b4e None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:19.881727 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c689fc-8697-4463-bd3b-cacfe05c5b4e None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:19.915401 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84500a-94d0-46ea-80fe-9f511d7c49c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:19.916281 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84500a-94d0-46ea-80fe-9f511d7c49c7 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:19.916572 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84500a-94d0-46ea-80fe-9f511d7c49c7 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:19.916852 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84500a-94d0-46ea-80fe-9f511d7c49c7 None admin] PATH_INFO: `/v3/users/1cdae28a6c6045309f4aaea02e9f2c9d` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:19.918083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84500a-94d0-46ea-80fe-9f511d7c49c7 None admin] RBAC: Authorizing `identity:get_user(user_id=1cdae28a6c6045309f4aaea02e9f2c9d)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:19.919577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84500a-94d0-46ea-80fe-9f511d7c49c7 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:19.921425 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 28/51] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:19 2022] GET /identity/v3/users/1cdae28a6c6045309f4aaea02e9f2c9d => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:19.926669 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950acdbf-1e77-4ef9-8968-e4a21902549a None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:20.028504 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950acdbf-1e77-4ef9-8968-e4a21902549a None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:20.060483 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874596a-eb18-472b-bf49-6ee068313931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:20.061280 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874596a-eb18-472b-bf49-6ee068313931 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:20.061595 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874596a-eb18-472b-bf49-6ee068313931 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:20.061876 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874596a-eb18-472b-bf49-6ee068313931 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:20.063066 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874596a-eb18-472b-bf49-6ee068313931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:20.064509 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874596a-eb18-472b-bf49-6ee068313931 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:20.066189 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 24/52] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:18:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:20.072528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84500a-94d0-46ea-80fe-9f511d7c49c7 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:20.174064 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84500a-94d0-46ea-80fe-9f511d7c49c7 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:20.209898 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8b661-10bc-49c7-9ffe-20970507147a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:20.211397 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8b661-10bc-49c7-9ffe-20970507147a None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:20.211696 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8b661-10bc-49c7-9ffe-20970507147a None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:20.211980 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8b661-10bc-49c7-9ffe-20970507147a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:20.212840 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8b661-10bc-49c7-9ffe-20970507147a None admin] RBAC: Adding query filter params (role.id=9aaa841361294b9c9b275ca1be0ed89c, scope.domain.id=default, user.id=1cdae28a6c6045309f4aaea02e9f2c9d) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:20.213176 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8b661-10bc-49c7-9ffe-20970507147a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:20.214654 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8b661-10bc-49c7-9ffe-20970507147a None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:20.220708 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 29/53] 10.222.0.48 () {56 vars in 1322 bytes} [Mon May 9 15:18:20 2022] GET /identity/v3/role_assignments?user.id=1cdae28a6c6045309f4aaea02e9f2c9d&scope.domain.id=default&role.id=9aaa841361294b9c9b275ca1be0ed89c => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:20.483527 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d81af-b8d1-4264-8ecd-cc7047af72eb None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:20.484100 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d81af-b8d1-4264-8ecd-cc7047af72eb None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:20.484196 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d81af-b8d1-4264-8ecd-cc7047af72eb None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:20.485637 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 25/54] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:20.491835 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f2d1c-72fa-4d41-8017-c612d8d36cfe None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:20.492308 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f2d1c-72fa-4d41-8017-c612d8d36cfe None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:20.492492 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f2d1c-72fa-4d41-8017-c612d8d36cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:20.509717 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-a10f2d1c-72fa-4d41-8017-c612d8d36cfe None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:20.510976 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-a10f2d1c-72fa-4d41-8017-c612d8d36cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:20.581757 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 30/55] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:20.605310 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d81af-b8d1-4264-8ecd-cc7047af72eb None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:20.704169 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d81af-b8d1-4264-8ecd-cc7047af72eb None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:20.737157 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9d8a5-cf32-4720-bc52-f4a6325bfe4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:20.737909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9d8a5-cf32-4720-bc52-f4a6325bfe4b None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:20.738198 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9d8a5-cf32-4720-bc52-f4a6325bfe4b None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:20.738477 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9d8a5-cf32-4720-bc52-f4a6325bfe4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:20.739919 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9d8a5-cf32-4720-bc52-f4a6325bfe4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:20.742067 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9d8a5-cf32-4720-bc52-f4a6325bfe4b None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:20.743709 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 26/56] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:18:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:20.749360 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f2d1c-72fa-4d41-8017-c612d8d36cfe None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:20.844152 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f2d1c-72fa-4d41-8017-c612d8d36cfe None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:20.876647 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88391744-eed3-4f58-ab09-d1928916fa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:20.877313 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88391744-eed3-4f58-ab09-d1928916fa47 None admin] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:20.877626 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88391744-eed3-4f58-ab09-d1928916fa47 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:20.877906 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88391744-eed3-4f58-ab09-d1928916fa47 None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:20.878626 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88391744-eed3-4f58-ab09-d1928916fa47 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:20.880089 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88391744-eed3-4f58-ab09-d1928916fa47 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:20.904708 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 31/57] 10.222.0.48 () {60 vars in 1140 bytes} [Mon May 9 15:18:20 2022] POST /identity/v3/projects => generated 298 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:18:23.185574 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03410048-9ba5-42d8-94e1-af951cfc1444 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:23.186155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03410048-9ba5-42d8-94e1-af951cfc1444 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:23.186155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03410048-9ba5-42d8-94e1-af951cfc1444 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:23.187540 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 27/58] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:23.192993 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602527c-3110-4029-8a75-77cd45fa972a None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:23.193454 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602527c-3110-4029-8a75-77cd45fa972a None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:23.193611 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602527c-3110-4029-8a75-77cd45fa972a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:23.210745 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-c602527c-3110-4029-8a75-77cd45fa972a None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:23.211988 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-c602527c-3110-4029-8a75-77cd45fa972a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:23.277942 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 32/59] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:18:23.303515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03410048-9ba5-42d8-94e1-af951cfc1444 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:23.399981 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03410048-9ba5-42d8-94e1-af951cfc1444 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:23.435776 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71deec-1cf1-40d5-9617-d39edaa88f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:23.436931 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71deec-1cf1-40d5-9617-d39edaa88f6d None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:23.437518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71deec-1cf1-40d5-9617-d39edaa88f6d None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:23.437803 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71deec-1cf1-40d5-9617-d39edaa88f6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:23.439110 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71deec-1cf1-40d5-9617-d39edaa88f6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:23.440571 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71deec-1cf1-40d5-9617-d39edaa88f6d None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:23.442243 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 28/60] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:18:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:23.448531 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602527c-3110-4029-8a75-77cd45fa972a None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:23.554109 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602527c-3110-4029-8a75-77cd45fa972a None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:23.587238 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdd78f-b4a5-402e-8539-d98fb17b9a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:23.587942 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdd78f-b4a5-402e-8539-d98fb17b9a79 None admin] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:23.588232 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdd78f-b4a5-402e-8539-d98fb17b9a79 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:23.588513 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdd78f-b4a5-402e-8539-d98fb17b9a79 None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:23.589233 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdd78f-b4a5-402e-8539-d98fb17b9a79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:23.590731 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdd78f-b4a5-402e-8539-d98fb17b9a79 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:23.616800 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 33/61] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:18:23 2022] POST /identity/v3/users => generated 275 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:18:27.234706 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360770cb-244c-49ac-9e71-680209e6bf73 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:27.235762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360770cb-244c-49ac-9e71-680209e6bf73 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:27.236306 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360770cb-244c-49ac-9e71-680209e6bf73 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:27.238301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 29/62] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:27.245473 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b81960-e4be-4722-84de-89f2375438c1 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:27.246417 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b81960-e4be-4722-84de-89f2375438c1 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:27.246913 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b81960-e4be-4722-84de-89f2375438c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:27.258351 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7ddef-13e9-4f78-be9b-794b70a94d63 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:27.261528 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7ddef-13e9-4f78-be9b-794b70a94d63 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:27.262085 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7ddef-13e9-4f78-be9b-794b70a94d63 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:27.263763 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 30/63] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:27.274369 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-f8b81960-e4be-4722-84de-89f2375438c1 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:27.274669 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11f88f-e97b-4f72-9b87-d50db6fdb071 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:27.275207 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11f88f-e97b-4f72-9b87-d50db6fdb071 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:27.275727 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11f88f-e97b-4f72-9b87-d50db6fdb071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:27.275963 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-f8b81960-e4be-4722-84de-89f2375438c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:27.293752 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-bd11f88f-e97b-4f72-9b87-d50db6fdb071 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:27.298000 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-bd11f88f-e97b-4f72-9b87-d50db6fdb071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:27.360424 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 34/64] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:27.362177 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da24eca-c013-4918-b52d-fd280eaa4278 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:27.362767 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da24eca-c013-4918-b52d-fd280eaa4278 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:27.363214 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da24eca-c013-4918-b52d-fd280eaa4278 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:27.365288 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 35/65] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:27.371346 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983388f-5329-4308-af77-ffaab28c765c None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:27.371874 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983388f-5329-4308-af77-ffaab28c765c None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:27.372322 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983388f-5329-4308-af77-ffaab28c765c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:27.391039 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-0983388f-5329-4308-af77-ffaab28c765c None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:27.392539 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-0983388f-5329-4308-af77-ffaab28c765c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:27.402812 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 31/66] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:18:27.405525 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11f88f-e97b-4f72-9b87-d50db6fdb071 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:27.483414 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 36/67] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:27.484097 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983388f-5329-4308-af77-ffaab28c765c None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:27.517941 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11f88f-e97b-4f72-9b87-d50db6fdb071 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:27.562825 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236501fb-5a46-4cf9-b113-2bbcf0ec8f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:27.563639 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236501fb-5a46-4cf9-b113-2bbcf0ec8f53 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:27.564107 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236501fb-5a46-4cf9-b113-2bbcf0ec8f53 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:27.564558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236501fb-5a46-4cf9-b113-2bbcf0ec8f53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:27.576283 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236501fb-5a46-4cf9-b113-2bbcf0ec8f53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:27.584448 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-236501fb-5a46-4cf9-b113-2bbcf0ec8f53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:18:27.584448 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:27.584448 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:27.584448 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:27.584448 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:27.584448 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:27.584448 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:27.584448 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:27.584448 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:27.584448 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:27.584448 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:27.584448 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:27.584448 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:27.584448 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:27.584448 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:27.584448 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:27.586343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:27.586343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:27.586343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:27.586343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:27.586343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:27.586343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:27.586343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:27.586343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:27.586343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:27.586343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:27.586343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:27.586343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:18:27.586343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:27.586343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:27.586343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:27.586343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:27.587286 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:27.587286 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:27.587286 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:27.587286 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:27.587286 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:27.587286 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:27.587286 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:27.587286 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:27.587286 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:27.587286 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:27.587286 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:18:27.587286 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:18:27.589556 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 32/68] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:18:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:27.595334 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236501fb-5a46-4cf9-b113-2bbcf0ec8f53 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:27.601597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983388f-5329-4308-af77-ffaab28c765c None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:27.641546 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56177b59-952c-4fdb-8aa0-a6eab235a8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:27.642392 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56177b59-952c-4fdb-8aa0-a6eab235a8cc None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:27.642689 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56177b59-952c-4fdb-8aa0-a6eab235a8cc None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:27.642979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56177b59-952c-4fdb-8aa0-a6eab235a8cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:27.654914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56177b59-952c-4fdb-8aa0-a6eab235a8cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:27.664231 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-56177b59-952c-4fdb-8aa0-a6eab235a8cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:18:27.664231 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:27.664231 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:27.664231 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:27.664231 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:27.664231 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:27.664231 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:27.664231 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:27.664231 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:27.664231 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:27.664231 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:27.664231 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:27.664231 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:27.664231 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:27.664231 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:27.664231 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:27.665515 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:27.665515 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:27.665515 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:27.665515 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:27.665515 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:27.665515 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:27.665515 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:27.665515 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:27.665515 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:27.665515 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:27.665515 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:27.665515 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:18:27.665515 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:27.665515 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:27.665515 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:27.665515 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:27.666522 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:27.666522 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:27.666522 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:27.666522 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:27.666522 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:27.666522 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:27.666522 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:27.666522 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:27.666522 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:27.666522 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:27.666522 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:18:27.666522 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:18:27.666522 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 37/69] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:18:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:27.667303 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56177b59-952c-4fdb-8aa0-a6eab235a8cc None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:27.714755 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236501fb-5a46-4cf9-b113-2bbcf0ec8f53 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:27.748941 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84bdad-cf0d-4b1a-89c1-7b46de4baada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:27.749798 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84bdad-cf0d-4b1a-89c1-7b46de4baada None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:27.750082 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84bdad-cf0d-4b1a-89c1-7b46de4baada None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:27.750356 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84bdad-cf0d-4b1a-89c1-7b46de4baada None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:27.761733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84bdad-cf0d-4b1a-89c1-7b46de4baada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:27.769476 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-fe84bdad-cf0d-4b1a-89c1-7b46de4baada None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:18:27.769476 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:27.769476 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:27.769476 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:27.769476 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:27.769476 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:27.769476 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:27.769476 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:27.769476 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:27.769476 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:27.769476 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:27.769476 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:27.769476 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:27.769476 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:27.769476 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:27.769476 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:27.770509 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:27.770509 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:27.770509 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:27.770509 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:27.770509 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:27.770509 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:27.770509 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:27.770509 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:27.770509 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:27.770509 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:27.770509 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:27.770509 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:18:27.770509 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:27.770509 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:27.770509 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:27.770509 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:27.771441 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:27.771441 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:27.771441 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:27.771441 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:27.771441 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:27.771441 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:27.771441 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:27.771441 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:27.771441 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:27.771441 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:27.771441 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:18:27.771441 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:18:27.772127 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56177b59-952c-4fdb-8aa0-a6eab235a8cc None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:27.772261 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 33/70] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:18:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:27.772261 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84bdad-cf0d-4b1a-89c1-7b46de4baada None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:27.807233 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac114004-522e-4410-a7f2-c238580c4b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:27.807925 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac114004-522e-4410-a7f2-c238580c4b59 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:27.808211 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac114004-522e-4410-a7f2-c238580c4b59 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:27.808492 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac114004-522e-4410-a7f2-c238580c4b59 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:27.809258 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac114004-522e-4410-a7f2-c238580c4b59 None admin] RBAC: Adding query filter params (name=member) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:27.809624 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac114004-522e-4410-a7f2-c238580c4b59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:27.811030 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac114004-522e-4410-a7f2-c238580c4b59 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:27.819895 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 38/71] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:18:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:27.821482 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d41849-fe11-4b91-b303-90f2bc9e88a7 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:27.821717 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d41849-fe11-4b91-b303-90f2bc9e88a7 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:27.822000 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d41849-fe11-4b91-b303-90f2bc9e88a7 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:27.823273 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 39/72] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:27.823970 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d41849-fe11-4b91-b303-90f2bc9e88a7 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:27.877194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84bdad-cf0d-4b1a-89c1-7b46de4baada None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:27.909722 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1501e-4093-46c7-9807-5fc853b78273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:27.910394 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1501e-4093-46c7-9807-5fc853b78273 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:27.910679 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1501e-4093-46c7-9807-5fc853b78273 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:27.910958 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1501e-4093-46c7-9807-5fc853b78273 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:27.911712 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1501e-4093-46c7-9807-5fc853b78273 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:27.912026 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1501e-4093-46c7-9807-5fc853b78273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:27.913704 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1501e-4093-46c7-9807-5fc853b78273 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:27.921514 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 34/73] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:18:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:27.922804 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b93d70-23eb-4509-95c8-c2e4c0a971fb None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:27.923092 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b93d70-23eb-4509-95c8-c2e4c0a971fb None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:27.923375 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b93d70-23eb-4509-95c8-c2e4c0a971fb None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:27.924869 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 35/74] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:27.925328 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b93d70-23eb-4509-95c8-c2e4c0a971fb None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:27.930726 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d41849-fe11-4b91-b303-90f2bc9e88a7 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:27.963460 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190df4f4-250a-4455-b87f-ca8d76ba1d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:27.964134 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190df4f4-250a-4455-b87f-ca8d76ba1d8b None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:27.964420 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190df4f4-250a-4455-b87f-ca8d76ba1d8b None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:27.964698 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190df4f4-250a-4455-b87f-ca8d76ba1d8b None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:27.965503 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190df4f4-250a-4455-b87f-ca8d76ba1d8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:27.965844 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190df4f4-250a-4455-b87f-ca8d76ba1d8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:27.968004 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190df4f4-250a-4455-b87f-ca8d76ba1d8b None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:27.976156 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 40/75] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:18:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:27.976156 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec217f-e9f2-4b58-81b3-e3374a1f8f15 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:27.976156 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec217f-e9f2-4b58-81b3-e3374a1f8f15 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:27.976156 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec217f-e9f2-4b58-81b3-e3374a1f8f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:27.994610 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-32ec217f-e9f2-4b58-81b3-e3374a1f8f15 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:27.995825 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-32ec217f-e9f2-4b58-81b3-e3374a1f8f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:28.025330 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b93d70-23eb-4509-95c8-c2e4c0a971fb None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:28.058315 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3751b26-3b4f-4be3-ada3-cf89878428a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:28.059196 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3751b26-3b4f-4be3-ada3-cf89878428a7 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:28.059488 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3751b26-3b4f-4be3-ada3-cf89878428a7 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:28.059772 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3751b26-3b4f-4be3-ada3-cf89878428a7 None admin] PATH_INFO: `/v3/users/0c56e75b50944a4781c82d5e2c9cfbcd` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:28.060650 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 41/76] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:28.062758 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec217f-e9f2-4b58-81b3-e3374a1f8f15 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:28.075642 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3751b26-3b4f-4be3-ada3-cf89878428a7 None admin] RBAC: Authorizing `identity:get_user(user_id=0c56e75b50944a4781c82d5e2c9cfbcd)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:28.077099 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3751b26-3b4f-4be3-ada3-cf89878428a7 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:28.078868 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 36/77] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:27 2022] GET /identity/v3/users/0c56e75b50944a4781c82d5e2c9cfbcd => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:28.080230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6b22d-b24b-4412-924d-439fe2658531 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:28.080609 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6b22d-b24b-4412-924d-439fe2658531 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:28.080807 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6b22d-b24b-4412-924d-439fe2658531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:28.097753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-12f6b22d-b24b-4412-924d-439fe2658531 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:28.098953 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-12f6b22d-b24b-4412-924d-439fe2658531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:28.161608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 37/78] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:28.162348 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec217f-e9f2-4b58-81b3-e3374a1f8f15 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:28.165276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6b22d-b24b-4412-924d-439fe2658531 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:28.196517 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2771ecd-04f6-4171-9539-b0133c5c5968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:28.197407 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2771ecd-04f6-4171-9539-b0133c5c5968 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:28.197704 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2771ecd-04f6-4171-9539-b0133c5c5968 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:28.197983 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2771ecd-04f6-4171-9539-b0133c5c5968 None admin] PATH_INFO: `/v3/users/0c56e75b50944a4781c82d5e2c9cfbcd` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:28.199185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2771ecd-04f6-4171-9539-b0133c5c5968 None admin] RBAC: Authorizing `identity:get_user(user_id=0c56e75b50944a4781c82d5e2c9cfbcd)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:28.200637 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2771ecd-04f6-4171-9539-b0133c5c5968 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:28.202469 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 42/79] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:28 2022] GET /identity/v3/users/0c56e75b50944a4781c82d5e2c9cfbcd => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:28.203156 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2771ecd-04f6-4171-9539-b0133c5c5968 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:28.263925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6b22d-b24b-4412-924d-439fe2658531 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:28.296920 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33329a-9f4f-40d0-ac79-72904212e85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:28.297750 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33329a-9f4f-40d0-ac79-72904212e85f None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:28.298086 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33329a-9f4f-40d0-ac79-72904212e85f None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:28.298373 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33329a-9f4f-40d0-ac79-72904212e85f None admin] PATH_INFO: `/v3/users/1cdae28a6c6045309f4aaea02e9f2c9d` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:28.298484 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2771ecd-04f6-4171-9539-b0133c5c5968 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:28.299649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33329a-9f4f-40d0-ac79-72904212e85f None admin] RBAC: Authorizing `identity:get_user(user_id=1cdae28a6c6045309f4aaea02e9f2c9d)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:28.301125 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e33329a-9f4f-40d0-ac79-72904212e85f None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:28.302823 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 38/80] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:28 2022] GET /identity/v3/users/1cdae28a6c6045309f4aaea02e9f2c9d => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:28.307697 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33329a-9f4f-40d0-ac79-72904212e85f None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:28.332067 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fe498-dbc0-415c-a2aa-8434aeecafba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:28.332721 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fe498-dbc0-415c-a2aa-8434aeecafba None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:28.333008 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fe498-dbc0-415c-a2aa-8434aeecafba None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:28.333283 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fe498-dbc0-415c-a2aa-8434aeecafba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:28.400616 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fe498-dbc0-415c-a2aa-8434aeecafba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:28.402158 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fe498-dbc0-415c-a2aa-8434aeecafba None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:28.409711 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e33329a-9f4f-40d0-ac79-72904212e85f None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:28.441672 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2327ce-a605-444a-a93e-497220968f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:28.442468 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2327ce-a605-444a-a93e-497220968f19 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:28.442762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2327ce-a605-444a-a93e-497220968f19 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:28.443044 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2327ce-a605-444a-a93e-497220968f19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:28.444758 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2327ce-a605-444a-a93e-497220968f19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:28.446237 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2327ce-a605-444a-a93e-497220968f19 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:28.447880 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 39/81] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:18:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:28.449844 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2327ce-a605-444a-a93e-497220968f19 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:28.497644 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 43/82] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:18:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:18:28.498312 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fe498-dbc0-415c-a2aa-8434aeecafba None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:28.544709 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2327ce-a605-444a-a93e-497220968f19 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:28.578546 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3295f7c-40b2-45d2-859a-c092ca8f7f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:28.579253 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3295f7c-40b2-45d2-859a-c092ca8f7f1a None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:28.579538 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3295f7c-40b2-45d2-859a-c092ca8f7f1a None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:28.579818 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3295f7c-40b2-45d2-859a-c092ca8f7f1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:28.591953 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3295f7c-40b2-45d2-859a-c092ca8f7f1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:28.599710 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fe498-dbc0-415c-a2aa-8434aeecafba None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:28.599953 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-c3295f7c-40b2-45d2-859a-c092ca8f7f1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:18:28.599953 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:28.599953 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:28.599953 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:28.599953 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:28.599953 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:28.599953 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:28.599953 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:28.599953 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:28.599953 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:28.599953 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:28.599953 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:28.599953 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:28.599953 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:28.599953 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:28.599953 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:28.601396 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:28.601396 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:28.601396 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:28.601396 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:28.601396 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:28.601396 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:28.601396 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:28.601396 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:28.601396 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:28.601396 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:28.601396 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:28.601396 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:18:28.601396 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:28.601396 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:28.601396 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:28.601396 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:28.602344 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:28.602344 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:28.602344 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:28.602344 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:28.602344 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:28.602344 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:28.602344 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:28.602344 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:28.602344 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:28.602344 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:28.602344 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:18:28.602344 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:18:28.602344 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 40/83] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:18:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:28.602344 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3295f7c-40b2-45d2-859a-c092ca8f7f1a None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:28.637106 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eefd8f-8d2c-4bdb-8e23-659cba22c0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:28.637792 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eefd8f-8d2c-4bdb-8e23-659cba22c0af None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:28.638078 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eefd8f-8d2c-4bdb-8e23-659cba22c0af None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:28.638357 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eefd8f-8d2c-4bdb-8e23-659cba22c0af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:28.701763 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3295f7c-40b2-45d2-859a-c092ca8f7f1a None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:28.703412 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eefd8f-8d2c-4bdb-8e23-659cba22c0af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:28.704910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eefd8f-8d2c-4bdb-8e23-659cba22c0af None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:28.733916 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982056c8-36f0-415e-b117-5ca378b7aabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:28.734574 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982056c8-36f0-415e-b117-5ca378b7aabf None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:28.734863 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982056c8-36f0-415e-b117-5ca378b7aabf None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:28.735143 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982056c8-36f0-415e-b117-5ca378b7aabf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:28.800499 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 44/84] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:18:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:18:28.801337 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eefd8f-8d2c-4bdb-8e23-659cba22c0af None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:28.802965 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982056c8-36f0-415e-b117-5ca378b7aabf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:28.804499 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982056c8-36f0-415e-b117-5ca378b7aabf None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:28.898301 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eefd8f-8d2c-4bdb-8e23-659cba22c0af None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:28.899292 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 41/85] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:18:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:18:28.903989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982056c8-36f0-415e-b117-5ca378b7aabf None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:28.936689 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141a855-c6da-469c-b77c-890b56882bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:28.937396 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141a855-c6da-469c-b77c-890b56882bab None admin] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:28.937693 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141a855-c6da-469c-b77c-890b56882bab None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:28.937979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141a855-c6da-469c-b77c-890b56882bab None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:28.938742 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141a855-c6da-469c-b77c-890b56882bab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:28.940208 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141a855-c6da-469c-b77c-890b56882bab None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:28.959537 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 45/86] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:18:28 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:18:28.961129 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141a855-c6da-469c-b77c-890b56882bab None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:29.007127 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982056c8-36f0-415e-b117-5ca378b7aabf None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:29.044698 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc9cd7-7c34-48c1-aa90-b7c2726038bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:29.045629 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc9cd7-7c34-48c1-aa90-b7c2726038bd None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:29.045921 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc9cd7-7c34-48c1-aa90-b7c2726038bd None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:29.046202 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc9cd7-7c34-48c1-aa90-b7c2726038bd None admin] PATH_INFO: `/v3/projects/27fffefbce874beab07ae5240b7f0d10` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:29.047519 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc9cd7-7c34-48c1-aa90-b7c2726038bd None admin] RBAC: Authorizing `identity:get_project(project_id=27fffefbce874beab07ae5240b7f0d10)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:29.049039 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc9cd7-7c34-48c1-aa90-b7c2726038bd None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:29.055999 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 42/87] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:28 2022] GET /identity/v3/projects/27fffefbce874beab07ae5240b7f0d10 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:29.055999 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc9cd7-7c34-48c1-aa90-b7c2726038bd None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:29.080971 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141a855-c6da-469c-b77c-890b56882bab None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:29.119281 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adc590-f117-448d-b46b-af242a5a0aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:29.120138 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adc590-f117-448d-b46b-af242a5a0aff None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:29.120361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adc590-f117-448d-b46b-af242a5a0aff None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:29.120528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adc590-f117-448d-b46b-af242a5a0aff None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:29.121759 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adc590-f117-448d-b46b-af242a5a0aff None admin] RBAC: Adding query filter params (name=member) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:29.122196 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adc590-f117-448d-b46b-af242a5a0aff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:29.123900 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adc590-f117-448d-b46b-af242a5a0aff None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:29.133693 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 46/88] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:18:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:29.139672 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adc590-f117-448d-b46b-af242a5a0aff None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:29.169334 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc9cd7-7c34-48c1-aa90-b7c2726038bd None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:29.210220 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e468a-7031-457d-b522-e66af30a6e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:29.213142 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e468a-7031-457d-b522-e66af30a6e88 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:29.213142 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e468a-7031-457d-b522-e66af30a6e88 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:29.213142 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e468a-7031-457d-b522-e66af30a6e88 None admin] PATH_INFO: `/v3/projects/27fffefbce874beab07ae5240b7f0d10` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:29.213142 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e468a-7031-457d-b522-e66af30a6e88 None admin] RBAC: Authorizing `identity:get_project(project_id=27fffefbce874beab07ae5240b7f0d10)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:29.214923 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e468a-7031-457d-b522-e66af30a6e88 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:29.216934 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 43/89] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:29 2022] GET /identity/v3/projects/27fffefbce874beab07ae5240b7f0d10 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:29.216934 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e468a-7031-457d-b522-e66af30a6e88 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:29.260858 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adc590-f117-448d-b46b-af242a5a0aff None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:29.304830 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb5f2f-7980-44ad-a96a-4473896ed87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:29.305754 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb5f2f-7980-44ad-a96a-4473896ed87c None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:29.306046 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb5f2f-7980-44ad-a96a-4473896ed87c None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:29.306329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb5f2f-7980-44ad-a96a-4473896ed87c None admin] PATH_INFO: `/v3/projects/27fffefbce874beab07ae5240b7f0d10` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:29.307643 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb5f2f-7980-44ad-a96a-4473896ed87c None admin] RBAC: Authorizing `identity:get_project(project_id=27fffefbce874beab07ae5240b7f0d10)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:29.309158 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb5f2f-7980-44ad-a96a-4473896ed87c None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:29.310972 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 47/90] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:29 2022] GET /identity/v3/projects/27fffefbce874beab07ae5240b7f0d10 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:29.311765 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb5f2f-7980-44ad-a96a-4473896ed87c None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:29.338089 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e468a-7031-457d-b522-e66af30a6e88 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:29.379956 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d690f6c-2e86-4997-a8f9-9d441aeeb233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:29.381204 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d690f6c-2e86-4997-a8f9-9d441aeeb233 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:29.382069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d690f6c-2e86-4997-a8f9-9d441aeeb233 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:29.382848 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d690f6c-2e86-4997-a8f9-9d441aeeb233 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:29.384138 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d690f6c-2e86-4997-a8f9-9d441aeeb233 None admin] RBAC: Adding query filter params (role.id=a65ce6e645574561bb50ce9148d0637a, scope.project.id=27fffefbce874beab07ae5240b7f0d10, user.id=0c56e75b50944a4781c82d5e2c9cfbcd) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:29.385000 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d690f6c-2e86-4997-a8f9-9d441aeeb233 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:29.386998 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d690f6c-2e86-4997-a8f9-9d441aeeb233 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:29.399364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 44/91] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:18:29 2022] GET /identity/v3/role_assignments?user.id=0c56e75b50944a4781c82d5e2c9cfbcd&scope.project.id=27fffefbce874beab07ae5240b7f0d10&role.id=a65ce6e645574561bb50ce9148d0637a => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:29.400643 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d690f6c-2e86-4997-a8f9-9d441aeeb233 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:29.432385 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb5f2f-7980-44ad-a96a-4473896ed87c None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:29.470370 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f1a64-9e0a-4e93-9228-24755df30af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:29.471261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f1a64-9e0a-4e93-9228-24755df30af3 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:29.471551 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f1a64-9e0a-4e93-9228-24755df30af3 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:29.471832 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f1a64-9e0a-4e93-9228-24755df30af3 None admin] PATH_INFO: `/v3/users/0c56e75b50944a4781c82d5e2c9cfbcd` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:29.473084 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f1a64-9e0a-4e93-9228-24755df30af3 None admin] RBAC: Authorizing `identity:get_user(user_id=0c56e75b50944a4781c82d5e2c9cfbcd)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:29.474625 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f1a64-9e0a-4e93-9228-24755df30af3 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:29.477029 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 48/92] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:29 2022] GET /identity/v3/users/0c56e75b50944a4781c82d5e2c9cfbcd => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:29.477784 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f1a64-9e0a-4e93-9228-24755df30af3 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:29.524293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d690f6c-2e86-4997-a8f9-9d441aeeb233 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:29.582241 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51808b9d-b8be-4eb7-a3d5-78e0283e9d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:29.582931 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808b9d-b8be-4eb7-a3d5-78e0283e9d84 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:29.583220 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808b9d-b8be-4eb7-a3d5-78e0283e9d84 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:29.583534 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808b9d-b8be-4eb7-a3d5-78e0283e9d84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:29.584436 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51808b9d-b8be-4eb7-a3d5-78e0283e9d84 None admin] RBAC: Adding query filter params (role.id=b624791ed6aa460fa31372c80cf5991d, scope.project.id=27fffefbce874beab07ae5240b7f0d10, user.id=0c56e75b50944a4781c82d5e2c9cfbcd) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:29.585318 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51808b9d-b8be-4eb7-a3d5-78e0283e9d84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:29.586854 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51808b9d-b8be-4eb7-a3d5-78e0283e9d84 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:29.588675 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f1a64-9e0a-4e93-9228-24755df30af3 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:29.593033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 45/93] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:18:29 2022] GET /identity/v3/role_assignments?user.id=0c56e75b50944a4781c82d5e2c9cfbcd&scope.project.id=27fffefbce874beab07ae5240b7f0d10&role.id=b624791ed6aa460fa31372c80cf5991d => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:29.597932 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51808b9d-b8be-4eb7-a3d5-78e0283e9d84 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:29.628002 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526d3fd-12b3-46c0-9e0d-e13b6428281c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:29.628683 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526d3fd-12b3-46c0-9e0d-e13b6428281c None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:29.628969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526d3fd-12b3-46c0-9e0d-e13b6428281c None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:29.629248 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526d3fd-12b3-46c0-9e0d-e13b6428281c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:29.630200 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526d3fd-12b3-46c0-9e0d-e13b6428281c None admin] RBAC: Adding query filter params (role.id=9aaa841361294b9c9b275ca1be0ed89c, scope.project.id=27fffefbce874beab07ae5240b7f0d10, user.id=1cdae28a6c6045309f4aaea02e9f2c9d) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:29.630530 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526d3fd-12b3-46c0-9e0d-e13b6428281c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:29.632223 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526d3fd-12b3-46c0-9e0d-e13b6428281c None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:29.639072 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 49/94] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:18:29 2022] GET /identity/v3/role_assignments?user.id=1cdae28a6c6045309f4aaea02e9f2c9d&scope.project.id=27fffefbce874beab07ae5240b7f0d10&role.id=9aaa841361294b9c9b275ca1be0ed89c => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:29.775197 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51808b9d-b8be-4eb7-a3d5-78e0283e9d84 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:29.830458 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c932b7-864d-41de-8274-357b8520f8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:29.831136 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c932b7-864d-41de-8274-357b8520f8c6 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:29.831421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c932b7-864d-41de-8274-357b8520f8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:29.831699 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c932b7-864d-41de-8274-357b8520f8c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:29.924747 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c932b7-864d-41de-8274-357b8520f8c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:29.926260 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c932b7-864d-41de-8274-357b8520f8c6 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:30.065357 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 46/95] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:18:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:18:30.071589 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526d3fd-12b3-46c0-9e0d-e13b6428281c None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:30.211880 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526d3fd-12b3-46c0-9e0d-e13b6428281c None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:30.255883 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed02ff-8947-4686-9f3a-5380e92f0bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:30.256932 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed02ff-8947-4686-9f3a-5380e92f0bbc None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:30.257230 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed02ff-8947-4686-9f3a-5380e92f0bbc None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:30.257535 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed02ff-8947-4686-9f3a-5380e92f0bbc None admin] PATH_INFO: `/v3/projects/41b62c74a1c847c58056e97f418bf4d2` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:30.258912 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed02ff-8947-4686-9f3a-5380e92f0bbc None admin] RBAC: Authorizing `identity:get_project(project_id=41b62c74a1c847c58056e97f418bf4d2)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:30.260413 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed02ff-8947-4686-9f3a-5380e92f0bbc None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:30.262307 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 50/96] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:30 2022] GET /identity/v3/projects/41b62c74a1c847c58056e97f418bf4d2 => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:30.268487 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c932b7-864d-41de-8274-357b8520f8c6 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:30.404364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c932b7-864d-41de-8274-357b8520f8c6 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:30.442041 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91aaaf8-1d06-42a1-8eeb-971b557436dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:30.442719 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aaaf8-1d06-42a1-8eeb-971b557436dc None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:30.443008 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aaaf8-1d06-42a1-8eeb-971b557436dc None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:30.443287 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aaaf8-1d06-42a1-8eeb-971b557436dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:30.444760 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91aaaf8-1d06-42a1-8eeb-971b557436dc None admin] RBAC: Adding query filter params (role.id=a65ce6e645574561bb50ce9148d0637a, scope.project.id=41b62c74a1c847c58056e97f418bf4d2, user.id=0c56e75b50944a4781c82d5e2c9cfbcd) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:30.445082 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91aaaf8-1d06-42a1-8eeb-971b557436dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:30.446600 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91aaaf8-1d06-42a1-8eeb-971b557436dc None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:30.453191 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 47/97] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:18:30 2022] GET /identity/v3/role_assignments?user.id=0c56e75b50944a4781c82d5e2c9cfbcd&scope.project.id=41b62c74a1c847c58056e97f418bf4d2&role.id=a65ce6e645574561bb50ce9148d0637a => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:32.245843 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5141b-dd23-4222-aad8-4d7209b9135f None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:32.246404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5141b-dd23-4222-aad8-4d7209b9135f None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:32.246404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5141b-dd23-4222-aad8-4d7209b9135f None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:32.247787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 51/98] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:32.253415 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59622e3-9149-4d91-8f1b-3ee265f98ebc None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:32.253839 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59622e3-9149-4d91-8f1b-3ee265f98ebc None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:32.254029 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59622e3-9149-4d91-8f1b-3ee265f98ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:32.272039 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-c59622e3-9149-4d91-8f1b-3ee265f98ebc None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:32.273362 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-c59622e3-9149-4d91-8f1b-3ee265f98ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:32.355973 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 48/99] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:18:32.375031 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5141b-dd23-4222-aad8-4d7209b9135f None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:32.482574 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5141b-dd23-4222-aad8-4d7209b9135f None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:32.525771 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413ea4c-3107-453d-ab0f-a459e85d1ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:32.527080 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413ea4c-3107-453d-ab0f-a459e85d1ffa None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:32.527624 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413ea4c-3107-453d-ab0f-a459e85d1ffa None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:32.533709 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413ea4c-3107-453d-ab0f-a459e85d1ffa None admin] PATH_INFO: `/v3/domains/default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:32.543922 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413ea4c-3107-453d-ab0f-a459e85d1ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:32.545834 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413ea4c-3107-453d-ab0f-a459e85d1ffa None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:32.548174 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 52/100] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:18:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:32.554685 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59622e3-9149-4d91-8f1b-3ee265f98ebc None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:32.649037 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5afaf7-cb9b-4f90-89c1-4be3e1a04ffb None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:32.649738 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5afaf7-cb9b-4f90-89c1-4be3e1a04ffb None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:32.650234 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5afaf7-cb9b-4f90-89c1-4be3e1a04ffb None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:32.651891 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 53/101] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:18:32.661777 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e96fa-8a84-4f37-b98f-598915344bf7 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:32.662428 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e96fa-8a84-4f37-b98f-598915344bf7 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:32.663487 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e96fa-8a84-4f37-b98f-598915344bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:32.683917 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59622e3-9149-4d91-8f1b-3ee265f98ebc None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:32.706474 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-f70e96fa-8a84-4f37-b98f-598915344bf7 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:32.708086 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-f70e96fa-8a84-4f37-b98f-598915344bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:32.727765 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f63577-fc97-414b-b32b-825e005740c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:32.728448 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f63577-fc97-414b-b32b-825e005740c3 None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:32.728744 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f63577-fc97-414b-b32b-825e005740c3 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:32.729025 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f63577-fc97-414b-b32b-825e005740c3 None admin] PATH_INFO: `/v3/projects` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:32.729795 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f63577-fc97-414b-b32b-825e005740c3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:32.731265 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f63577-fc97-414b-b32b-825e005740c3 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:32.783769 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 49/102] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:18:32 2022] POST /identity/v3/projects => generated 302 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:18:32.820140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f73db-5560-4c98-8dfb-83bc53542a8a None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:32.820490 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f73db-5560-4c98-8dfb-83bc53542a8a None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:32.820749 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f73db-5560-4c98-8dfb-83bc53542a8a None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:32.826612 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 50/103] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:18:32.834332 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522713f-6c2b-4785-b88c-80edb2a5b6a9 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:32.834665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522713f-6c2b-4785-b88c-80edb2a5b6a9 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:32.835483 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522713f-6c2b-4785-b88c-80edb2a5b6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:32.844340 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 54/104] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:18:32.859911 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf28c8-3e6b-49c6-a3cf-dc719d165895 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:32.860308 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf28c8-3e6b-49c6-a3cf-dc719d165895 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:32.860498 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf28c8-3e6b-49c6-a3cf-dc719d165895 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:32.862075 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 55/105] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:32.873523 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-c522713f-6c2b-4785-b88c-80edb2a5b6a9 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:32.875285 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3f557-ab88-44ed-90a1-9b88ae23ba73 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:32.875578 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3f557-ab88-44ed-90a1-9b88ae23ba73 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:32.875860 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3f557-ab88-44ed-90a1-9b88ae23ba73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:32.878485 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-c522713f-6c2b-4785-b88c-80edb2a5b6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:32.911095 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-74b3f557-ab88-44ed-90a1-9b88ae23ba73 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:32.912337 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-74b3f557-ab88-44ed-90a1-9b88ae23ba73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:33.007228 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 51/106] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:18:33.008005 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522713f-6c2b-4785-b88c-80edb2a5b6a9 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:33.060661 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 56/107] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:18:33.066746 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3f557-ab88-44ed-90a1-9b88ae23ba73 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:33.186728 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3f557-ab88-44ed-90a1-9b88ae23ba73 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:33.189115 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522713f-6c2b-4785-b88c-80edb2a5b6a9 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:33.224588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dfe6b-52b3-4230-ab0d-69891dc86a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:33.226530 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dfe6b-52b3-4230-ab0d-69891dc86a86 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:33.227102 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dfe6b-52b3-4230-ab0d-69891dc86a86 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:33.227624 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dfe6b-52b3-4230-ab0d-69891dc86a86 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:33.231391 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580ab19-7fa9-4dea-92f2-094ca4001dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:33.232554 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580ab19-7fa9-4dea-92f2-094ca4001dd2 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:33.233154 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580ab19-7fa9-4dea-92f2-094ca4001dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:33.233988 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580ab19-7fa9-4dea-92f2-094ca4001dd2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:33.240716 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dfe6b-52b3-4230-ab0d-69891dc86a86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:33.248873 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580ab19-7fa9-4dea-92f2-094ca4001dd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:33.252325 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-9a7dfe6b-52b3-4230-ab0d-69891dc86a86 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:18:33.252325 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:33.252325 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:33.252325 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:33.252325 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:33.252325 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:33.252325 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:33.252325 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:33.252325 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:33.252325 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:33.252325 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:33.252325 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:33.252325 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:33.252325 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:33.252325 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:33.252325 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:33.253914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:33.253914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:33.253914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:33.253914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:33.253914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:33.253914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:33.253914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:33.253914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:33.253914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:33.253914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:33.253914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:33.253914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:18:33.253914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:33.253914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:33.253914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:33.253914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:33.255155 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:33.255155 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:33.255155 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:33.255155 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:33.255155 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:33.255155 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:33.255155 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:33.255155 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:33.255155 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:33.255155 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:33.255155 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:18:33.255155 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:18:33.255155 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 57/108] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:18:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:18:33.255155 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dfe6b-52b3-4230-ab0d-69891dc86a86 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:33.262211 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-9580ab19-7fa9-4dea-92f2-094ca4001dd2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:18:33.262211 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:33.262211 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:33.262211 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:33.262211 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:33.262211 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:33.262211 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:33.262211 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:33.262211 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:33.262211 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:33.262211 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:33.262211 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:33.262211 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:33.262211 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:33.262211 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:33.262211 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:33.263735 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:33.263735 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:33.263735 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:33.263735 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:33.263735 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:33.263735 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:33.263735 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:33.263735 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:33.263735 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:33.263735 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:33.263735 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:33.263735 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:18:33.263735 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:33.263735 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:33.263735 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:33.263735 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:33.264642 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:33.264642 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:33.264642 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:33.264642 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:33.264642 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:33.264642 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:33.264642 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:33.264642 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:33.264642 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:33.264642 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:33.264642 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:18:33.264642 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:18:33.266835 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 52/109] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:18:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:33.271564 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580ab19-7fa9-4dea-92f2-094ca4001dd2 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:33.395047 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dfe6b-52b3-4230-ab0d-69891dc86a86 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:33.400543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580ab19-7fa9-4dea-92f2-094ca4001dd2 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:33.437503 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9153e-f2b6-4bbd-bf84-dd7cb841ff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:33.438331 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9153e-f2b6-4bbd-bf84-dd7cb841ff28 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:33.438621 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9153e-f2b6-4bbd-bf84-dd7cb841ff28 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:33.438900 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9153e-f2b6-4bbd-bf84-dd7cb841ff28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:33.440034 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a9e1b-db3d-4e48-958d-ace072b4c70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:33.440708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a9e1b-db3d-4e48-958d-ace072b4c70c None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:33.440991 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a9e1b-db3d-4e48-958d-ace072b4c70c None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:33.441268 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a9e1b-db3d-4e48-958d-ace072b4c70c None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:33.442072 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a9e1b-db3d-4e48-958d-ace072b4c70c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:33.442384 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a9e1b-db3d-4e48-958d-ace072b4c70c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:33.443798 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a9e1b-db3d-4e48-958d-ace072b4c70c None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:33.461509 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 53/110] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:18:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:33.462370 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a9e1b-db3d-4e48-958d-ace072b4c70c None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:33.467929 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9153e-f2b6-4bbd-bf84-dd7cb841ff28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:33.476173 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-cac9153e-f2b6-4bbd-bf84-dd7cb841ff28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:18:33.476173 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:33.476173 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:33.476173 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:33.476173 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:33.476173 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:33.476173 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:33.476173 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:33.476173 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:33.476173 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:33.476173 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:33.476173 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:33.476173 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:33.476173 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:33.476173 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:33.476173 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:33.477213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:33.477213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:33.477213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:33.477213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:33.477213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:33.477213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:33.477213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:33.477213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:33.477213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:33.477213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:33.477213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:33.477213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:18:33.477213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:33.477213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:33.477213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:33.477213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:33.478153 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:33.478153 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:33.478153 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:33.478153 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:33.478153 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:33.478153 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:33.478153 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:33.478153 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:33.478153 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:33.478153 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:33.478153 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:18:33.478153 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:18:33.481825 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 58/111] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:18:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:33.482764 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9153e-f2b6-4bbd-bf84-dd7cb841ff28 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:33.591309 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a9e1b-db3d-4e48-958d-ace072b4c70c None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:33.622661 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9153e-f2b6-4bbd-bf84-dd7cb841ff28 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:33.635265 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba66485-5c47-403c-bf3b-8a9245b66202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:33.636241 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba66485-5c47-403c-bf3b-8a9245b66202 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:33.636703 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba66485-5c47-403c-bf3b-8a9245b66202 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:33.637197 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba66485-5c47-403c-bf3b-8a9245b66202 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:33.638150 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba66485-5c47-403c-bf3b-8a9245b66202 None admin] RBAC: Adding query filter params (name=reader) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:33.638618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba66485-5c47-403c-bf3b-8a9245b66202 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:33.640206 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba66485-5c47-403c-bf3b-8a9245b66202 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:33.649615 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 54/112] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:18:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:33.651170 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ff0c5-cc8b-4ead-accd-c7bd8eaaa226 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:33.651711 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ff0c5-cc8b-4ead-accd-c7bd8eaaa226 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:33.652203 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ff0c5-cc8b-4ead-accd-c7bd8eaaa226 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:33.653780 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 55/113] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:33.654762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ff0c5-cc8b-4ead-accd-c7bd8eaaa226 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:33.668383 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3b45e-bed2-41bf-898b-6e686fe0024f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:33.669737 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3b45e-bed2-41bf-898b-6e686fe0024f None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:33.670244 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3b45e-bed2-41bf-898b-6e686fe0024f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:33.670751 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3b45e-bed2-41bf-898b-6e686fe0024f None admin] PATH_INFO: `/v3/users/0c56e75b50944a4781c82d5e2c9cfbcd` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:33.672287 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3b45e-bed2-41bf-898b-6e686fe0024f None admin] RBAC: Authorizing `identity:get_user(user_id=0c56e75b50944a4781c82d5e2c9cfbcd)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:33.674027 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3b45e-bed2-41bf-898b-6e686fe0024f None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:33.675985 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 59/114] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:33 2022] GET /identity/v3/users/0c56e75b50944a4781c82d5e2c9cfbcd => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:33.677079 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3b45e-bed2-41bf-898b-6e686fe0024f None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:33.784547 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ff0c5-cc8b-4ead-accd-c7bd8eaaa226 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:33.801253 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3b45e-bed2-41bf-898b-6e686fe0024f None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:33.821277 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039d3ca-ad56-434f-9bf0-d734ead1fe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:33.822051 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039d3ca-ad56-434f-9bf0-d734ead1fe8b None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:33.822405 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039d3ca-ad56-434f-9bf0-d734ead1fe8b None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:33.822699 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039d3ca-ad56-434f-9bf0-d734ead1fe8b None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:33.823835 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039d3ca-ad56-434f-9bf0-d734ead1fe8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:33.824160 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039d3ca-ad56-434f-9bf0-d734ead1fe8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:33.825627 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039d3ca-ad56-434f-9bf0-d734ead1fe8b None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:33.834265 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 56/115] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:18:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:33.836674 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed32a5e-9100-4b7c-a720-d1c89f2a88a6 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:33.836964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed32a5e-9100-4b7c-a720-d1c89f2a88a6 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:33.837252 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed32a5e-9100-4b7c-a720-d1c89f2a88a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:33.846398 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c6a23-b2d2-48e8-9c1c-7d67f81a35b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:33.847720 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c6a23-b2d2-48e8-9c1c-7d67f81a35b2 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:33.848303 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c6a23-b2d2-48e8-9c1c-7d67f81a35b2 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:33.849314 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c6a23-b2d2-48e8-9c1c-7d67f81a35b2 None admin] PATH_INFO: `/v3/users/7d8fb6ae08b94fabb12b189ed5d9cafb` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:33.855713 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-bed32a5e-9100-4b7c-a720-d1c89f2a88a6 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:33.857038 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-bed32a5e-9100-4b7c-a720-d1c89f2a88a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:33.868933 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c6a23-b2d2-48e8-9c1c-7d67f81a35b2 None admin] RBAC: Authorizing `identity:get_user(user_id=7d8fb6ae08b94fabb12b189ed5d9cafb)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:33.871066 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c6a23-b2d2-48e8-9c1c-7d67f81a35b2 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:33.873150 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 60/116] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:33 2022] GET /identity/v3/users/7d8fb6ae08b94fabb12b189ed5d9cafb => generated 289 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:33.875369 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c6a23-b2d2-48e8-9c1c-7d67f81a35b2 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:33.939778 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 57/117] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:33.940952 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed32a5e-9100-4b7c-a720-d1c89f2a88a6 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:34.003256 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c6a23-b2d2-48e8-9c1c-7d67f81a35b2 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:34.041995 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df724b-445b-42fc-abea-3eff90370024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:34.042882 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df724b-445b-42fc-abea-3eff90370024 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:34.043177 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df724b-445b-42fc-abea-3eff90370024 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:34.043467 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df724b-445b-42fc-abea-3eff90370024 None admin] PATH_INFO: `/v3/projects/27fffefbce874beab07ae5240b7f0d10` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:34.044792 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df724b-445b-42fc-abea-3eff90370024 None admin] RBAC: Authorizing `identity:get_project(project_id=27fffefbce874beab07ae5240b7f0d10)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:34.046295 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df724b-445b-42fc-abea-3eff90370024 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:34.048621 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 61/118] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:33 2022] GET /identity/v3/projects/27fffefbce874beab07ae5240b7f0d10 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:34.048947 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df724b-445b-42fc-abea-3eff90370024 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:34.058133 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed32a5e-9100-4b7c-a720-d1c89f2a88a6 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:34.094974 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30605a-26a0-4ef7-adbe-2e28bbe767ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:34.095860 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30605a-26a0-4ef7-adbe-2e28bbe767ec None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:34.096152 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30605a-26a0-4ef7-adbe-2e28bbe767ec None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:34.096433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30605a-26a0-4ef7-adbe-2e28bbe767ec None admin] PATH_INFO: `/v3/users/1cdae28a6c6045309f4aaea02e9f2c9d` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:34.097691 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30605a-26a0-4ef7-adbe-2e28bbe767ec None admin] RBAC: Authorizing `identity:get_user(user_id=1cdae28a6c6045309f4aaea02e9f2c9d)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:34.099128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30605a-26a0-4ef7-adbe-2e28bbe767ec None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:34.101841 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 58/119] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:33 2022] GET /identity/v3/users/1cdae28a6c6045309f4aaea02e9f2c9d => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:34.102518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30605a-26a0-4ef7-adbe-2e28bbe767ec None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:34.164951 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df724b-445b-42fc-abea-3eff90370024 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:34.200843 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58dfd6c-e16f-4a42-b18c-1f4bac41bc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:34.201454 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dfd6c-e16f-4a42-b18c-1f4bac41bc05 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:34.201747 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dfd6c-e16f-4a42-b18c-1f4bac41bc05 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:34.201855 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30605a-26a0-4ef7-adbe-2e28bbe767ec None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:34.202035 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dfd6c-e16f-4a42-b18c-1f4bac41bc05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:34.235771 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edca7c-b71c-40c6-94f4-222474c75913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:34.236607 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edca7c-b71c-40c6-94f4-222474c75913 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:34.236894 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edca7c-b71c-40c6-94f4-222474c75913 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:34.237174 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edca7c-b71c-40c6-94f4-222474c75913 None admin] PATH_INFO: `/v3/roles/member` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:34.247484 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edca7c-b71c-40c6-94f4-222474c75913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:34.255124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-04edca7c-b71c-40c6-94f4-222474c75913 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:18:34.255124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:34.255124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:34.255124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:34.255124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:34.255124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:34.255124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:34.255124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:34.255124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:34.255124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:34.255124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:34.255124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:34.255124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:34.255124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:34.255124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:34.255124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:34.256141 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:34.256141 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:34.256141 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:34.256141 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:34.256141 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:34.256141 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:34.256141 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:34.256141 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:34.256141 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:34.256141 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:34.256141 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:34.256141 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:18:34.256141 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:34.256141 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:34.256141 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:34.256141 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:34.257653 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:34.257653 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:34.257653 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:34.257653 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:34.257653 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:34.257653 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:34.257653 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:34.257653 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:34.257653 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:34.257653 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:34.257653 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:18:34.257653 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:18:34.257653 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 59/120] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:18:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:34.258430 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edca7c-b71c-40c6-94f4-222474c75913 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:34.274488 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58dfd6c-e16f-4a42-b18c-1f4bac41bc05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:34.275975 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58dfd6c-e16f-4a42-b18c-1f4bac41bc05 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:34.359874 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edca7c-b71c-40c6-94f4-222474c75913 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:34.378881 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 62/121] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:18:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:18:34.380233 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c1f0e-3b33-4c79-bef7-0fafd0827056 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:34.380533 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c1f0e-3b33-4c79-bef7-0fafd0827056 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:34.380813 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c1f0e-3b33-4c79-bef7-0fafd0827056 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:34.383914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 63/122] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:34.384949 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c1f0e-3b33-4c79-bef7-0fafd0827056 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:34.399483 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a0684-7c1c-426f-a4c4-1238335e6512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:34.400372 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a0684-7c1c-426f-a4c4-1238335e6512 None admin] REQUEST_METHOD: `PUT` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:34.400659 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a0684-7c1c-426f-a4c4-1238335e6512 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:34.400931 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a0684-7c1c-426f-a4c4-1238335e6512 None admin] PATH_INFO: `/v3/projects/27fffefbce874beab07ae5240b7f0d10/users/0c56e75b50944a4781c82d5e2c9cfbcd/roles/b624791ed6aa460fa31372c80cf5991d` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:34.403199 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a0684-7c1c-426f-a4c4-1238335e6512 None admin] RBAC: Authorizing `identity:create_grant(project_id=27fffefbce874beab07ae5240b7f0d10, user_id=0c56e75b50944a4781c82d5e2c9cfbcd, role_id=b624791ed6aa460fa31372c80cf5991d)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:34.404649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a0684-7c1c-426f-a4c4-1238335e6512 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:34.421294 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 60/123] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:18:34 2022] PUT /identity/v3/projects/27fffefbce874beab07ae5240b7f0d10/users/0c56e75b50944a4781c82d5e2c9cfbcd/roles/b624791ed6aa460fa31372c80cf5991d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:18:34.426389 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a0684-7c1c-426f-a4c4-1238335e6512 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:34.501160 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c1f0e-3b33-4c79-bef7-0fafd0827056 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:34.540664 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d648e-a342-459f-9aa1-a84be114b56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:34.541243 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d648e-a342-459f-9aa1-a84be114b56b None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:34.541560 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d648e-a342-459f-9aa1-a84be114b56b None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:34.541840 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d648e-a342-459f-9aa1-a84be114b56b None admin] PATH_INFO: `/v3/projects/27fffefbce874beab07ae5240b7f0d10` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:34.543343 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d648e-a342-459f-9aa1-a84be114b56b None admin] RBAC: Authorizing `identity:get_project(project_id=27fffefbce874beab07ae5240b7f0d10)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:34.544855 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d648e-a342-459f-9aa1-a84be114b56b None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:34.546849 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 64/124] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:34 2022] GET /identity/v3/projects/27fffefbce874beab07ae5240b7f0d10 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:34.547529 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d648e-a342-459f-9aa1-a84be114b56b None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:34.562160 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a0684-7c1c-426f-a4c4-1238335e6512 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:34.603465 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c97ba6-9839-40ca-8db5-2d1943568a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:34.604557 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c97ba6-9839-40ca-8db5-2d1943568a61 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:34.605068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c97ba6-9839-40ca-8db5-2d1943568a61 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:34.605590 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c97ba6-9839-40ca-8db5-2d1943568a61 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:34.606628 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c97ba6-9839-40ca-8db5-2d1943568a61 None admin] RBAC: Adding query filter params (name=member) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:34.607162 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c97ba6-9839-40ca-8db5-2d1943568a61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:34.608950 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c97ba6-9839-40ca-8db5-2d1943568a61 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:34.622492 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 61/125] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:18:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:34.624181 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6245c7e-891f-4ff3-aed7-a64cd6910950 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:34.624718 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6245c7e-891f-4ff3-aed7-a64cd6910950 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:34.625231 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6245c7e-891f-4ff3-aed7-a64cd6910950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:34.652083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-f6245c7e-891f-4ff3-aed7-a64cd6910950 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:34.653689 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-f6245c7e-891f-4ff3-aed7-a64cd6910950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:34.662131 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d648e-a342-459f-9aa1-a84be114b56b None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:34.698555 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341afa8-54a3-4b2c-856d-112f48db8e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:34.699440 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341afa8-54a3-4b2c-856d-112f48db8e34 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:34.699733 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341afa8-54a3-4b2c-856d-112f48db8e34 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:34.700017 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341afa8-54a3-4b2c-856d-112f48db8e34 None admin] PATH_INFO: `/v3/projects/27fffefbce874beab07ae5240b7f0d10` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:34.701282 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341afa8-54a3-4b2c-856d-112f48db8e34 None admin] RBAC: Authorizing `identity:get_project(project_id=27fffefbce874beab07ae5240b7f0d10)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:34.702781 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341afa8-54a3-4b2c-856d-112f48db8e34 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:34.704864 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 65/126] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:34 2022] GET /identity/v3/projects/27fffefbce874beab07ae5240b7f0d10 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:34.705664 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341afa8-54a3-4b2c-856d-112f48db8e34 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:34.736085 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 62/127] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:34.736948 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6245c7e-891f-4ff3-aed7-a64cd6910950 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:34.818999 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341afa8-54a3-4b2c-856d-112f48db8e34 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:34.846559 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6245c7e-891f-4ff3-aed7-a64cd6910950 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:34.855602 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d185f41-719b-4c9a-9051-b481c10aaffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:34.856519 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d185f41-719b-4c9a-9051-b481c10aaffe None admin] REQUEST_METHOD: `PUT` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:34.856812 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d185f41-719b-4c9a-9051-b481c10aaffe None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:34.857093 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d185f41-719b-4c9a-9051-b481c10aaffe None admin] PATH_INFO: `/v3/projects/27fffefbce874beab07ae5240b7f0d10/users/1cdae28a6c6045309f4aaea02e9f2c9d/roles/9aaa841361294b9c9b275ca1be0ed89c` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:34.859227 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d185f41-719b-4c9a-9051-b481c10aaffe None admin] RBAC: Authorizing `identity:create_grant(project_id=27fffefbce874beab07ae5240b7f0d10, user_id=1cdae28a6c6045309f4aaea02e9f2c9d, role_id=9aaa841361294b9c9b275ca1be0ed89c)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:34.860700 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d185f41-719b-4c9a-9051-b481c10aaffe None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:34.879166 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 66/128] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:18:34 2022] PUT /identity/v3/projects/27fffefbce874beab07ae5240b7f0d10/users/1cdae28a6c6045309f4aaea02e9f2c9d/roles/9aaa841361294b9c9b275ca1be0ed89c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:18:34.880097 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d185f41-719b-4c9a-9051-b481c10aaffe None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:34.891197 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca7903-c0f0-451e-83b8-e75b06106767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:34.893566 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca7903-c0f0-451e-83b8-e75b06106767 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:34.893863 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca7903-c0f0-451e-83b8-e75b06106767 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:34.894143 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca7903-c0f0-451e-83b8-e75b06106767 None admin] PATH_INFO: `/v3/users/0c56e75b50944a4781c82d5e2c9cfbcd` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:34.902526 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca7903-c0f0-451e-83b8-e75b06106767 None admin] RBAC: Authorizing `identity:get_user(user_id=0c56e75b50944a4781c82d5e2c9cfbcd)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:34.904065 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca7903-c0f0-451e-83b8-e75b06106767 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:34.906363 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 63/129] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:34 2022] GET /identity/v3/users/0c56e75b50944a4781c82d5e2c9cfbcd => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:34.906822 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca7903-c0f0-451e-83b8-e75b06106767 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:35.012563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d185f41-719b-4c9a-9051-b481c10aaffe None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:35.052566 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384e4d2-7ee1-4662-92eb-82125a2ad5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:35.053844 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384e4d2-7ee1-4662-92eb-82125a2ad5d3 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:35.054506 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384e4d2-7ee1-4662-92eb-82125a2ad5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:35.054506 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384e4d2-7ee1-4662-92eb-82125a2ad5d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:35.055310 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384e4d2-7ee1-4662-92eb-82125a2ad5d3 None admin] RBAC: Adding query filter params (role.id=1cf9a76305b6469cb57c1115c9cb198b, scope.project.id=27fffefbce874beab07ae5240b7f0d10, user.id=7d8fb6ae08b94fabb12b189ed5d9cafb) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:35.055620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384e4d2-7ee1-4662-92eb-82125a2ad5d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:35.057148 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384e4d2-7ee1-4662-92eb-82125a2ad5d3 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:35.063820 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 67/130] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:18:34 2022] GET /identity/v3/role_assignments?user.id=7d8fb6ae08b94fabb12b189ed5d9cafb&scope.project.id=27fffefbce874beab07ae5240b7f0d10&role.id=1cf9a76305b6469cb57c1115c9cb198b => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:35.064718 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384e4d2-7ee1-4662-92eb-82125a2ad5d3 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:35.136438 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca7903-c0f0-451e-83b8-e75b06106767 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:35.187171 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f91e33-864b-47f7-9aab-63074f1642ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:35.188405 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f91e33-864b-47f7-9aab-63074f1642ff None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:35.188935 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f91e33-864b-47f7-9aab-63074f1642ff None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:35.189539 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f91e33-864b-47f7-9aab-63074f1642ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:35.217235 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f91e33-864b-47f7-9aab-63074f1642ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:35.230084 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-01f91e33-864b-47f7-9aab-63074f1642ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:18:35.230084 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:35.230084 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:35.230084 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:35.230084 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:35.230084 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:35.230084 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:35.230084 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:35.230084 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:35.230084 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:35.230084 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:35.230084 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:35.230084 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:35.230084 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:35.230084 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:35.230084 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:35.231187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:35.231187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:35.231187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:35.231187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:35.231187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:35.231187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:35.231187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:35.231187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:35.231187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:35.231187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:35.231187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:35.231187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:18:35.231187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:35.231187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:35.231187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:35.231187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:35.232128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:35.232128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:35.232128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:35.232128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:35.232128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:35.232128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:35.232128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:35.232128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:35.232128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:35.232128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:35.232128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:18:35.232128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:18:35.234858 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 64/131] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:18:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:35.242227 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f91e33-864b-47f7-9aab-63074f1642ff None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:35.299128 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384e4d2-7ee1-4662-92eb-82125a2ad5d3 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:35.391763 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43b5ed-a3bc-46cf-b787-e7797ae45919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:35.393213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43b5ed-a3bc-46cf-b787-e7797ae45919 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:35.395083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43b5ed-a3bc-46cf-b787-e7797ae45919 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:35.396378 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43b5ed-a3bc-46cf-b787-e7797ae45919 None admin] PATH_INFO: `/v3/projects/27fffefbce874beab07ae5240b7f0d10` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:35.399260 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43b5ed-a3bc-46cf-b787-e7797ae45919 None admin] RBAC: Authorizing `identity:get_project(project_id=27fffefbce874beab07ae5240b7f0d10)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:35.401237 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43b5ed-a3bc-46cf-b787-e7797ae45919 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:35.405421 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 68/132] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:35 2022] GET /identity/v3/projects/27fffefbce874beab07ae5240b7f0d10 => generated 298 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:35.412136 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43b5ed-a3bc-46cf-b787-e7797ae45919 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:35.476700 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f91e33-864b-47f7-9aab-63074f1642ff None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:35.548700 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa90889-866c-4402-a715-4e209490cdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:35.549605 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa90889-866c-4402-a715-4e209490cdd3 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:35.549999 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa90889-866c-4402-a715-4e209490cdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:35.555253 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa90889-866c-4402-a715-4e209490cdd3 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:35.556291 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa90889-866c-4402-a715-4e209490cdd3 None admin] RBAC: Adding query filter params (name=member) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:35.556716 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa90889-866c-4402-a715-4e209490cdd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:35.558274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa90889-866c-4402-a715-4e209490cdd3 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:35.575832 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 65/133] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:18:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:35.582702 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa90889-866c-4402-a715-4e209490cdd3 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:35.597614 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43b5ed-a3bc-46cf-b787-e7797ae45919 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:35.662154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64c009-1261-4337-8080-8991c5524795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:35.663644 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64c009-1261-4337-8080-8991c5524795 None admin] REQUEST_METHOD: `PUT` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:35.663945 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64c009-1261-4337-8080-8991c5524795 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:35.664225 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64c009-1261-4337-8080-8991c5524795 None admin] PATH_INFO: `/v3/projects/27fffefbce874beab07ae5240b7f0d10/users/0c56e75b50944a4781c82d5e2c9cfbcd/roles/a65ce6e645574561bb50ce9148d0637a` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:35.668515 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64c009-1261-4337-8080-8991c5524795 None admin] RBAC: Authorizing `identity:create_grant(project_id=27fffefbce874beab07ae5240b7f0d10, user_id=0c56e75b50944a4781c82d5e2c9cfbcd, role_id=a65ce6e645574561bb50ce9148d0637a)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:35.670046 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64c009-1261-4337-8080-8991c5524795 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:35.693501 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 69/134] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:18:35 2022] PUT /identity/v3/projects/27fffefbce874beab07ae5240b7f0d10/users/0c56e75b50944a4781c82d5e2c9cfbcd/roles/a65ce6e645574561bb50ce9148d0637a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:18:35.752820 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa90889-866c-4402-a715-4e209490cdd3 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:35.804164 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c67c81-21e3-4b8f-b13b-54d08f755730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:35.805181 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c67c81-21e3-4b8f-b13b-54d08f755730 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:35.805500 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c67c81-21e3-4b8f-b13b-54d08f755730 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:35.805788 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c67c81-21e3-4b8f-b13b-54d08f755730 None admin] PATH_INFO: `/v3/users/0c56e75b50944a4781c82d5e2c9cfbcd` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:35.807195 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c67c81-21e3-4b8f-b13b-54d08f755730 None admin] RBAC: Authorizing `identity:get_user(user_id=0c56e75b50944a4781c82d5e2c9cfbcd)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:35.808807 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c67c81-21e3-4b8f-b13b-54d08f755730 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:35.810717 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 66/135] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:35 2022] GET /identity/v3/users/0c56e75b50944a4781c82d5e2c9cfbcd => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:35.816818 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64c009-1261-4337-8080-8991c5524795 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:35.862204 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce9794-994a-4b2b-8833-f5302ce60a35 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:35.862544 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce9794-994a-4b2b-8833-f5302ce60a35 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:35.862779 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce9794-994a-4b2b-8833-f5302ce60a35 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:35.864426 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 67/136] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:35.870655 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae5635-639e-464d-98b1-50f33d944e3d None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:35.870940 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae5635-639e-464d-98b1-50f33d944e3d None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:35.871218 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae5635-639e-464d-98b1-50f33d944e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:35.903022 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-7bae5635-639e-464d-98b1-50f33d944e3d None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:35.904281 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-7bae5635-639e-464d-98b1-50f33d944e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:36.010050 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64c009-1261-4337-8080-8991c5524795 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:36.041953 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 68/137] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:36.072715 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae5635-639e-464d-98b1-50f33d944e3d None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:36.077522 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00896c3a-60a3-4356-ad7d-da3a39a03f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:36.078417 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00896c3a-60a3-4356-ad7d-da3a39a03f58 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:36.078706 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00896c3a-60a3-4356-ad7d-da3a39a03f58 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:36.078988 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00896c3a-60a3-4356-ad7d-da3a39a03f58 None admin] PATH_INFO: `/v3/projects/41b62c74a1c847c58056e97f418bf4d2` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:36.080258 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00896c3a-60a3-4356-ad7d-da3a39a03f58 None admin] RBAC: Authorizing `identity:get_project(project_id=41b62c74a1c847c58056e97f418bf4d2)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:36.082275 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00896c3a-60a3-4356-ad7d-da3a39a03f58 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:36.084425 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 70/138] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:35 2022] GET /identity/v3/projects/41b62c74a1c847c58056e97f418bf4d2 => generated 312 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:36.090251 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00896c3a-60a3-4356-ad7d-da3a39a03f58 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:36.228021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae5635-639e-464d-98b1-50f33d944e3d None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:36.277149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f89d01-aeb0-4bf6-857d-d79243e6118d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:36.277959 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f89d01-aeb0-4bf6-857d-d79243e6118d None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:36.278255 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f89d01-aeb0-4bf6-857d-d79243e6118d None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:36.278537 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f89d01-aeb0-4bf6-857d-d79243e6118d None admin] PATH_INFO: `/v3/domains/default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:36.282104 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f89d01-aeb0-4bf6-857d-d79243e6118d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:36.284072 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f89d01-aeb0-4bf6-857d-d79243e6118d None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:36.285921 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 69/139] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:18:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:36.292451 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f89d01-aeb0-4bf6-857d-d79243e6118d None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:36.387801 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00896c3a-60a3-4356-ad7d-da3a39a03f58 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:36.417180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f89d01-aeb0-4bf6-857d-d79243e6118d None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:36.460412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6fcd2-d4a9-4faa-b543-0a4e5ffa1987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:36.460994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6fcd2-d4a9-4faa-b543-0a4e5ffa1987 None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:36.461286 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6fcd2-d4a9-4faa-b543-0a4e5ffa1987 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:36.461601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6fcd2-d4a9-4faa-b543-0a4e5ffa1987 None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:36.462371 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6fcd2-d4a9-4faa-b543-0a4e5ffa1987 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:36.463871 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6fcd2-d4a9-4faa-b543-0a4e5ffa1987 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:36.476635 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd90b4c-c76e-4805-ab99-886728c5f9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:36.478966 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd90b4c-c76e-4805-ab99-886728c5f9c5 None admin] REQUEST_METHOD: `PUT` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:36.479366 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd90b4c-c76e-4805-ab99-886728c5f9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:36.479665 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd90b4c-c76e-4805-ab99-886728c5f9c5 None admin] PATH_INFO: `/v3/projects/41b62c74a1c847c58056e97f418bf4d2/users/0c56e75b50944a4781c82d5e2c9cfbcd/roles/a65ce6e645574561bb50ce9148d0637a` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:36.484247 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd90b4c-c76e-4805-ab99-886728c5f9c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=41b62c74a1c847c58056e97f418bf4d2, user_id=0c56e75b50944a4781c82d5e2c9cfbcd, role_id=a65ce6e645574561bb50ce9148d0637a)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:36.485900 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd90b4c-c76e-4805-ab99-886728c5f9c5 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:36.505604 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 70/140] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:18:36 2022] POST /identity/v3/users => generated 283 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:18:36.515972 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 71/141] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:18:36 2022] PUT /identity/v3/projects/41b62c74a1c847c58056e97f418bf4d2/users/0c56e75b50944a4781c82d5e2c9cfbcd/roles/a65ce6e645574561bb50ce9148d0637a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:18:37.702865 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fa3bf-7ed3-4069-b7f8-9941fc3eec46 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:37.703418 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fa3bf-7ed3-4069-b7f8-9941fc3eec46 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:37.703418 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fa3bf-7ed3-4069-b7f8-9941fc3eec46 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:37.704843 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 71/142] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:37.711605 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c37b6-854c-44bc-9365-74574d878f50 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:37.712107 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c37b6-854c-44bc-9365-74574d878f50 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:37.712224 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c37b6-854c-44bc-9365-74574d878f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:37.734606 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-d62c37b6-854c-44bc-9365-74574d878f50 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:37.735884 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-d62c37b6-854c-44bc-9365-74574d878f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:37.811916 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 72/143] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:37.848527 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fa3bf-7ed3-4069-b7f8-9941fc3eec46 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:37.974703 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fa3bf-7ed3-4069-b7f8-9941fc3eec46 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:38.020903 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948a789-f664-413d-906a-22613d19b7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:38.021776 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948a789-f664-413d-906a-22613d19b7fc None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:38.022751 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948a789-f664-413d-906a-22613d19b7fc None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:38.023197 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948a789-f664-413d-906a-22613d19b7fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:38.036259 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948a789-f664-413d-906a-22613d19b7fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:38.050885 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-6948a789-f664-413d-906a-22613d19b7fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:18:38.050885 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:38.050885 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:38.050885 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:38.050885 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:38.050885 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:38.050885 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:38.050885 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:38.050885 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:38.050885 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:38.050885 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:38.050885 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:38.050885 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:38.050885 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:38.050885 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:38.050885 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:38.051987 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:38.051987 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:38.051987 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:38.051987 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:38.051987 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:38.051987 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:38.051987 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:38.051987 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:38.051987 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:38.051987 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:38.051987 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:38.051987 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:18:38.051987 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:38.051987 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:38.051987 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:38.051987 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:38.052928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:38.052928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:38.052928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:38.052928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:38.052928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:38.052928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:38.052928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:38.052928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:38.052928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:38.052928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:38.052928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:18:38.052928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:18:38.052928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 72/144] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:18:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:38.060256 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c37b6-854c-44bc-9365-74574d878f50 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:38.129404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffaa65a-4461-4b36-b710-34c17d5ae2bb None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:38.129609 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffaa65a-4461-4b36-b710-34c17d5ae2bb None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:38.129880 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffaa65a-4461-4b36-b710-34c17d5ae2bb None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:38.131797 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 73/145] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:18:38.137722 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695737ef-290b-44fa-a7eb-91e5d3fa6f3e None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:38.138055 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695737ef-290b-44fa-a7eb-91e5d3fa6f3e None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:38.138298 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695737ef-290b-44fa-a7eb-91e5d3fa6f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:38.168144 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-695737ef-290b-44fa-a7eb-91e5d3fa6f3e None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:38.169401 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-695737ef-290b-44fa-a7eb-91e5d3fa6f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:38.241692 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c37b6-854c-44bc-9365-74574d878f50 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:38.296166 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 74/146] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:18:38.296699 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdeab3c-24de-4ca3-ba49-944c750567d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:38.297438 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdeab3c-24de-4ca3-ba49-944c750567d9 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:38.297731 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdeab3c-24de-4ca3-ba49-944c750567d9 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:38.298011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdeab3c-24de-4ca3-ba49-944c750567d9 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:38.298808 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdeab3c-24de-4ca3-ba49-944c750567d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:38.299122 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdeab3c-24de-4ca3-ba49-944c750567d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:38.300529 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdeab3c-24de-4ca3-ba49-944c750567d9 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:38.311025 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 73/147] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:18:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:38.317049 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695737ef-290b-44fa-a7eb-91e5d3fa6f3e None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:38.348435 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdeab3c-24de-4ca3-ba49-944c750567d9 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:38.441236 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695737ef-290b-44fa-a7eb-91e5d3fa6f3e None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:38.492571 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67673654-a802-4ad2-9590-5f3e350776d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:38.493512 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67673654-a802-4ad2-9590-5f3e350776d0 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:38.493809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67673654-a802-4ad2-9590-5f3e350776d0 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:38.494102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67673654-a802-4ad2-9590-5f3e350776d0 None admin] PATH_INFO: `/v3/users/0c56e75b50944a4781c82d5e2c9cfbcd` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:38.495436 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67673654-a802-4ad2-9590-5f3e350776d0 None admin] RBAC: Authorizing `identity:get_user(user_id=0c56e75b50944a4781c82d5e2c9cfbcd)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:38.496918 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67673654-a802-4ad2-9590-5f3e350776d0 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:38.498672 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 75/148] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:38 2022] GET /identity/v3/users/0c56e75b50944a4781c82d5e2c9cfbcd => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:38.504135 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67673654-a802-4ad2-9590-5f3e350776d0 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:38.519276 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdeab3c-24de-4ca3-ba49-944c750567d9 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:38.559369 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57111f70-7f8b-47b3-a0e0-ea5515e0353a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:38.560458 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57111f70-7f8b-47b3-a0e0-ea5515e0353a None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:38.560910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57111f70-7f8b-47b3-a0e0-ea5515e0353a None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:38.561415 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57111f70-7f8b-47b3-a0e0-ea5515e0353a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:38.574143 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57111f70-7f8b-47b3-a0e0-ea5515e0353a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:38.582268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-57111f70-7f8b-47b3-a0e0-ea5515e0353a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:18:38.582268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:38.582268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:38.582268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:38.582268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:38.582268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:38.582268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:38.582268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:38.582268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:38.582268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:38.582268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:38.582268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:38.582268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:38.582268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:38.582268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:38.582268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:38.583580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:38.583580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:38.583580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:38.583580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:38.583580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:38.583580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:38.583580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:38.583580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:38.583580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:38.583580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:38.583580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:38.583580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:18:38.583580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:38.583580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:38.583580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:38.583580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:38.584813 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:38.584813 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:38.584813 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:38.584813 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:38.584813 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:38.584813 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:38.584813 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:38.584813 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:38.584813 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:38.584813 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:38.584813 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:18:38.584813 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:18:38.587882 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 74/149] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:18:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:18:38.593897 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57111f70-7f8b-47b3-a0e0-ea5515e0353a None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:38.676026 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67673654-a802-4ad2-9590-5f3e350776d0 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:38.706243 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57111f70-7f8b-47b3-a0e0-ea5515e0353a None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:38.744658 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064a803-fd07-4982-89c0-ac2ce6c2f37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:38.746781 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064a803-fd07-4982-89c0-ac2ce6c2f37f None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:38.747547 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064a803-fd07-4982-89c0-ac2ce6c2f37f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:38.748275 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064a803-fd07-4982-89c0-ac2ce6c2f37f None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:38.749799 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9064a803-fd07-4982-89c0-ac2ce6c2f37f None admin] RBAC: Adding query filter params (name=admin) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:38.750572 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9064a803-fd07-4982-89c0-ac2ce6c2f37f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:38.753167 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9064a803-fd07-4982-89c0-ac2ce6c2f37f None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:38.762746 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140a93a-c920-4cd5-bbca-906aca763fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:38.763469 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140a93a-c920-4cd5-bbca-906aca763fd9 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:38.763781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140a93a-c920-4cd5-bbca-906aca763fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:38.764026 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140a93a-c920-4cd5-bbca-906aca763fd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:38.769295 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 75/150] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:18:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:38.775265 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f665d84-1c53-4a45-a199-38999755e7ab None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:38.776131 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f665d84-1c53-4a45-a199-38999755e7ab None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:38.777012 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f665d84-1c53-4a45-a199-38999755e7ab None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:38.783802 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 76/151] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:38 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:38.786124 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f665d84-1c53-4a45-a199-38999755e7ab None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:38.906020 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f665d84-1c53-4a45-a199-38999755e7ab None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:38.908399 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140a93a-c920-4cd5-bbca-906aca763fd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:38.918254 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140a93a-c920-4cd5-bbca-906aca763fd9 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:38.947383 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfce16-81af-4d5d-b0c4-f769abbe1e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:38.948735 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfce16-81af-4d5d-b0c4-f769abbe1e8a None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:38.949257 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfce16-81af-4d5d-b0c4-f769abbe1e8a None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:38.949841 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfce16-81af-4d5d-b0c4-f769abbe1e8a None admin] PATH_INFO: `/v3/users/1cdae28a6c6045309f4aaea02e9f2c9d` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:38.955018 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfce16-81af-4d5d-b0c4-f769abbe1e8a None admin] RBAC: Authorizing `identity:get_user(user_id=1cdae28a6c6045309f4aaea02e9f2c9d)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:38.956926 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfce16-81af-4d5d-b0c4-f769abbe1e8a None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:38.958919 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 77/152] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:38 2022] GET /identity/v3/users/1cdae28a6c6045309f4aaea02e9f2c9d => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:38.960472 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48138c22-212a-424c-ad43-31c0f44eda5e None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:38.961001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48138c22-212a-424c-ad43-31c0f44eda5e None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:38.965668 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48138c22-212a-424c-ad43-31c0f44eda5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:39.014481 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-48138c22-212a-424c-ad43-31c0f44eda5e None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:39.017780 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-48138c22-212a-424c-ad43-31c0f44eda5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:39.100818 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 76/153] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:18:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:18:39.105980 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140a93a-c920-4cd5-bbca-906aca763fd9 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:39.198802 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 78/154] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:39.199712 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48138c22-212a-424c-ad43-31c0f44eda5e None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:39.273474 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140a93a-c920-4cd5-bbca-906aca763fd9 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:39.316658 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc593dc-459b-4484-94f1-089692c47114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:39.317348 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc593dc-459b-4484-94f1-089692c47114 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:39.317656 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc593dc-459b-4484-94f1-089692c47114 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:39.317934 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc593dc-459b-4484-94f1-089692c47114 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:39.419274 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48138c22-212a-424c-ad43-31c0f44eda5e None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:39.466531 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc593dc-459b-4484-94f1-089692c47114 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:39.468040 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc593dc-459b-4484-94f1-089692c47114 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:39.506138 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6102bb0-562f-4051-a46b-92e5e38fd92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:39.507562 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6102bb0-562f-4051-a46b-92e5e38fd92a None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:39.507865 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6102bb0-562f-4051-a46b-92e5e38fd92a None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:39.508123 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6102bb0-562f-4051-a46b-92e5e38fd92a None admin] PATH_INFO: `/v3/projects/27fffefbce874beab07ae5240b7f0d10` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:39.509465 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6102bb0-562f-4051-a46b-92e5e38fd92a None admin] RBAC: Authorizing `identity:get_project(project_id=27fffefbce874beab07ae5240b7f0d10)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:39.510936 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6102bb0-562f-4051-a46b-92e5e38fd92a None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:39.512699 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 79/155] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:39 2022] GET /identity/v3/projects/27fffefbce874beab07ae5240b7f0d10 => generated 298 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:39.513515 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6102bb0-562f-4051-a46b-92e5e38fd92a None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:39.671766 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 77/156] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:18:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:18:39.674030 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc593dc-459b-4484-94f1-089692c47114 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:39.729778 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6102bb0-562f-4051-a46b-92e5e38fd92a None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:39.784002 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29466ba-f285-4aa3-92ad-a99cc8e03faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:39.784830 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29466ba-f285-4aa3-92ad-a99cc8e03faf None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:39.785096 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29466ba-f285-4aa3-92ad-a99cc8e03faf None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:39.785390 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29466ba-f285-4aa3-92ad-a99cc8e03faf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:39.802380 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29466ba-f285-4aa3-92ad-a99cc8e03faf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:39.820083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-f29466ba-f285-4aa3-92ad-a99cc8e03faf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:18:39.820083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:39.820083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:39.820083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:39.820083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:39.820083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:39.820083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:39.820083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:39.820083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:39.820083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:39.820083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:39.820083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:39.820083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:39.820083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:39.820083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:39.820083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:39.821195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:39.821195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:39.821195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:39.821195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:39.821195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:39.821195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:39.821195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:39.821195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:39.821195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:39.821195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:39.821195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:39.821195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:18:39.821195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:39.821195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:39.821195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:39.821195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:39.822152 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:39.822152 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:39.822152 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:39.822152 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:39.822152 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:39.822152 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:39.822152 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:39.822152 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:39.822152 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:39.822152 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:39.822152 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:18:39.822152 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:18:39.822152 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 80/157] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:18:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:39.822152 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a4ff1-97d1-4a56-9a53-cdd1104da9d4 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:39.822984 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a4ff1-97d1-4a56-9a53-cdd1104da9d4 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:39.822984 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a4ff1-97d1-4a56-9a53-cdd1104da9d4 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:39.824975 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 81/158] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:39.824975 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a4ff1-97d1-4a56-9a53-cdd1104da9d4 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:39.875018 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc593dc-459b-4484-94f1-089692c47114 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:39.941235 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c380f8f-649b-4117-915e-20ce4b4e0936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:39.942431 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c380f8f-649b-4117-915e-20ce4b4e0936 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:39.942956 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c380f8f-649b-4117-915e-20ce4b4e0936 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:39.943455 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c380f8f-649b-4117-915e-20ce4b4e0936 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:39.944566 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c380f8f-649b-4117-915e-20ce4b4e0936 None admin] RBAC: Adding query filter params (role.id=b624791ed6aa460fa31372c80cf5991d, scope.project.id=27fffefbce874beab07ae5240b7f0d10, user.id=0c56e75b50944a4781c82d5e2c9cfbcd) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:39.945201 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c380f8f-649b-4117-915e-20ce4b4e0936 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:39.946945 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c380f8f-649b-4117-915e-20ce4b4e0936 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:39.961091 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 78/159] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:18:39 2022] GET /identity/v3/role_assignments?user.id=0c56e75b50944a4781c82d5e2c9cfbcd&scope.project.id=27fffefbce874beab07ae5240b7f0d10&role.id=b624791ed6aa460fa31372c80cf5991d => generated 608 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:39.962826 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73222bb4-a4cc-4d35-9672-3e8783a67458 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:39.963333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73222bb4-a4cc-4d35-9672-3e8783a67458 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:39.963844 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73222bb4-a4cc-4d35-9672-3e8783a67458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:39.998546 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-73222bb4-a4cc-4d35-9672-3e8783a67458 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:40.000250 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-73222bb4-a4cc-4d35-9672-3e8783a67458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:40.000486 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a4ff1-97d1-4a56-9a53-cdd1104da9d4 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:40.081502 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c0e21-c854-4b49-bfa0-442f9f9f45e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:40.081502 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c0e21-c854-4b49-bfa0-442f9f9f45e2 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:40.081502 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c0e21-c854-4b49-bfa0-442f9f9f45e2 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:40.081502 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c0e21-c854-4b49-bfa0-442f9f9f45e2 None admin] PATH_INFO: `/v3/projects/27fffefbce874beab07ae5240b7f0d10` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:40.081957 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c0e21-c854-4b49-bfa0-442f9f9f45e2 None admin] RBAC: Authorizing `identity:get_project(project_id=27fffefbce874beab07ae5240b7f0d10)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:40.081957 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c0e21-c854-4b49-bfa0-442f9f9f45e2 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:40.083300 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 82/160] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:39 2022] GET /identity/v3/projects/27fffefbce874beab07ae5240b7f0d10 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:40.084101 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c0e21-c854-4b49-bfa0-442f9f9f45e2 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:40.130749 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 79/161] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:40.132785 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73222bb4-a4cc-4d35-9672-3e8783a67458 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:40.289387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c0e21-c854-4b49-bfa0-442f9f9f45e2 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:40.345383 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73222bb4-a4cc-4d35-9672-3e8783a67458 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:40.357178 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252603c-c93f-4555-bcc0-50b850e10e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:40.357905 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252603c-c93f-4555-bcc0-50b850e10e1e None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:40.358189 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252603c-c93f-4555-bcc0-50b850e10e1e None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:40.358464 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252603c-c93f-4555-bcc0-50b850e10e1e None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:40.359229 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252603c-c93f-4555-bcc0-50b850e10e1e None admin] RBAC: Adding query filter params (name=reader) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:40.359535 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252603c-c93f-4555-bcc0-50b850e10e1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:40.360940 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252603c-c93f-4555-bcc0-50b850e10e1e None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:40.384596 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 83/162] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:18:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:40.385492 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252603c-c93f-4555-bcc0-50b850e10e1e None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:40.420853 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fd615-df88-4b07-ae3c-0b38a21f4e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:40.422008 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fd615-df88-4b07-ae3c-0b38a21f4e4a None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:40.422602 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fd615-df88-4b07-ae3c-0b38a21f4e4a None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:40.423098 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fd615-df88-4b07-ae3c-0b38a21f4e4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:40.424175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fd615-df88-4b07-ae3c-0b38a21f4e4a None admin] RBAC: Adding query filter params (role.id=9aaa841361294b9c9b275ca1be0ed89c, scope.project.id=27fffefbce874beab07ae5240b7f0d10, user.id=1cdae28a6c6045309f4aaea02e9f2c9d) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:40.424728 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fd615-df88-4b07-ae3c-0b38a21f4e4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:40.426545 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fd615-df88-4b07-ae3c-0b38a21f4e4a None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:40.438291 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 80/163] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:18:40 2022] GET /identity/v3/role_assignments?user.id=1cdae28a6c6045309f4aaea02e9f2c9d&scope.project.id=27fffefbce874beab07ae5240b7f0d10&role.id=9aaa841361294b9c9b275ca1be0ed89c => generated 608 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:40.439529 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fd615-df88-4b07-ae3c-0b38a21f4e4a None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:40.569293 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252603c-c93f-4555-bcc0-50b850e10e1e None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:40.624142 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f087b5-6f78-47bf-b218-c5d61b9e99cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:40.624889 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f087b5-6f78-47bf-b218-c5d61b9e99cd None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:40.625483 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f087b5-6f78-47bf-b218-c5d61b9e99cd None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:40.625483 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f087b5-6f78-47bf-b218-c5d61b9e99cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:40.641138 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f087b5-6f78-47bf-b218-c5d61b9e99cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:40.650327 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-87f087b5-6f78-47bf-b218-c5d61b9e99cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:18:40.650327 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:40.650327 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:40.650327 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:40.650327 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:40.650327 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:40.650327 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:40.650327 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:40.650327 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:40.650327 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:40.650327 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:40.650327 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:40.650327 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:40.650327 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:40.650327 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:40.650327 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:40.651440 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:40.651440 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:40.651440 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:40.651440 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:40.651440 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:40.651440 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:40.651440 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:40.651440 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:40.651440 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:40.651440 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:40.651440 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:40.651440 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:18:40.651440 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:40.651440 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:40.651440 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:40.651440 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:40.652386 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:40.652386 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:40.652386 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:40.652386 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:40.652386 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:40.652386 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:40.652386 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:40.652386 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:40.652386 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:40.652386 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:40.652386 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:18:40.652386 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:18:40.652386 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 84/164] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:18:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:40.657601 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f087b5-6f78-47bf-b218-c5d61b9e99cd None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:40.661143 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fd615-df88-4b07-ae3c-0b38a21f4e4a None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:40.703022 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d77b99-a524-4450-91b0-0f52a961f681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:40.704261 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d77b99-a524-4450-91b0-0f52a961f681 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:40.704829 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d77b99-a524-4450-91b0-0f52a961f681 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:40.705315 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d77b99-a524-4450-91b0-0f52a961f681 None admin] PATH_INFO: `/v3/users/7d8fb6ae08b94fabb12b189ed5d9cafb` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:40.710300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d77b99-a524-4450-91b0-0f52a961f681 None admin] RBAC: Authorizing `identity:get_user(user_id=7d8fb6ae08b94fabb12b189ed5d9cafb)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:40.712231 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d77b99-a524-4450-91b0-0f52a961f681 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:40.714202 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 81/165] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:40 2022] GET /identity/v3/users/7d8fb6ae08b94fabb12b189ed5d9cafb => generated 289 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:40.720139 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d77b99-a524-4450-91b0-0f52a961f681 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:40.772542 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f087b5-6f78-47bf-b218-c5d61b9e99cd None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:40.820589 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9f9d9-6d4d-4dcd-9eae-c5350fa1fbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:40.821250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9f9d9-6d4d-4dcd-9eae-c5350fa1fbcd None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:40.821250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9f9d9-6d4d-4dcd-9eae-c5350fa1fbcd None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:40.821581 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9f9d9-6d4d-4dcd-9eae-c5350fa1fbcd None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:40.822448 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9f9d9-6d4d-4dcd-9eae-c5350fa1fbcd None admin] RBAC: Adding query filter params (name=member) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:40.823023 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9f9d9-6d4d-4dcd-9eae-c5350fa1fbcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:40.824488 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9f9d9-6d4d-4dcd-9eae-c5350fa1fbcd None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:40.838905 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 85/166] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:18:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:40.845847 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9f9d9-6d4d-4dcd-9eae-c5350fa1fbcd None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:40.859540 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d77b99-a524-4450-91b0-0f52a961f681 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:40.905806 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bb889-d289-4e10-a5ba-7be6f12048ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:40.907530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bb889-d289-4e10-a5ba-7be6f12048ab None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:40.908011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bb889-d289-4e10-a5ba-7be6f12048ab None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:40.908513 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bb889-d289-4e10-a5ba-7be6f12048ab None admin] PATH_INFO: `/v3/projects/27fffefbce874beab07ae5240b7f0d10` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:40.914251 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bb889-d289-4e10-a5ba-7be6f12048ab None admin] RBAC: Authorizing `identity:get_project(project_id=27fffefbce874beab07ae5240b7f0d10)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:40.916116 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695bb889-d289-4e10-a5ba-7be6f12048ab None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:40.918679 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 82/167] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:40 2022] GET /identity/v3/projects/27fffefbce874beab07ae5240b7f0d10 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:40.924197 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bb889-d289-4e10-a5ba-7be6f12048ab None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:40.967644 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9f9d9-6d4d-4dcd-9eae-c5350fa1fbcd None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:41.011172 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f9f3b-29fd-400a-87c0-578a96378f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:41.012011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f9f3b-29fd-400a-87c0-578a96378f4c None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:41.012317 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f9f3b-29fd-400a-87c0-578a96378f4c None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:41.012578 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f9f3b-29fd-400a-87c0-578a96378f4c None admin] PATH_INFO: `/v3/users/0c56e75b50944a4781c82d5e2c9cfbcd` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:41.013869 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f9f3b-29fd-400a-87c0-578a96378f4c None admin] RBAC: Authorizing `identity:get_user(user_id=0c56e75b50944a4781c82d5e2c9cfbcd)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:41.015329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f9f3b-29fd-400a-87c0-578a96378f4c None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:41.017173 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 86/168] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:40 2022] GET /identity/v3/users/0c56e75b50944a4781c82d5e2c9cfbcd => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:41.023592 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef7d25-68f7-464d-9f45-ca8d575a7e61 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:41.023592 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef7d25-68f7-464d-9f45-ca8d575a7e61 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:41.023891 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef7d25-68f7-464d-9f45-ca8d575a7e61 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:41.025574 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 87/169] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:41.026685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef7d25-68f7-464d-9f45-ca8d575a7e61 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:41.033410 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bb889-d289-4e10-a5ba-7be6f12048ab None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:41.075505 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24854c69-25b2-4d72-a3ea-be90730734d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:41.076475 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24854c69-25b2-4d72-a3ea-be90730734d4 None admin] REQUEST_METHOD: `PUT` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:41.076762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24854c69-25b2-4d72-a3ea-be90730734d4 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:41.077041 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24854c69-25b2-4d72-a3ea-be90730734d4 None admin] PATH_INFO: `/v3/projects/27fffefbce874beab07ae5240b7f0d10/users/7d8fb6ae08b94fabb12b189ed5d9cafb/roles/1cf9a76305b6469cb57c1115c9cb198b` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:41.080958 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24854c69-25b2-4d72-a3ea-be90730734d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=27fffefbce874beab07ae5240b7f0d10, user_id=7d8fb6ae08b94fabb12b189ed5d9cafb, role_id=1cf9a76305b6469cb57c1115c9cb198b)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:41.082470 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24854c69-25b2-4d72-a3ea-be90730734d4 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:41.111470 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 83/170] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:18:40 2022] PUT /identity/v3/projects/27fffefbce874beab07ae5240b7f0d10/users/7d8fb6ae08b94fabb12b189ed5d9cafb/roles/1cf9a76305b6469cb57c1115c9cb198b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:18:41.113799 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9198b71-6c9d-4c5e-8454-ddff3a0fa510 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:41.114092 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9198b71-6c9d-4c5e-8454-ddff3a0fa510 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:41.114627 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9198b71-6c9d-4c5e-8454-ddff3a0fa510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:41.158544 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-f9198b71-6c9d-4c5e-8454-ddff3a0fa510 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:41.159686 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-f9198b71-6c9d-4c5e-8454-ddff3a0fa510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:41.196380 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef7d25-68f7-464d-9f45-ca8d575a7e61 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:41.282592 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b646a-d382-4c58-8fce-4db3c5ec4e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:41.283270 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b646a-d382-4c58-8fce-4db3c5ec4e86 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:41.283560 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b646a-d382-4c58-8fce-4db3c5ec4e86 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:41.283842 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b646a-d382-4c58-8fce-4db3c5ec4e86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:41.326681 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 84/171] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:41.399555 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b646a-d382-4c58-8fce-4db3c5ec4e86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:41.401152 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b646a-d382-4c58-8fce-4db3c5ec4e86 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:41.402282 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9198b71-6c9d-4c5e-8454-ddff3a0fa510 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:41.573531 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 88/172] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:18:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:18:41.578863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b646a-d382-4c58-8fce-4db3c5ec4e86 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:41.647522 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9198b71-6c9d-4c5e-8454-ddff3a0fa510 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:41.714060 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b646a-d382-4c58-8fce-4db3c5ec4e86 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:41.744211 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef809d12-eaf3-4a7e-9612-74eefaf5baf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:41.745419 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef809d12-eaf3-4a7e-9612-74eefaf5baf6 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:41.745964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef809d12-eaf3-4a7e-9612-74eefaf5baf6 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:41.746461 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef809d12-eaf3-4a7e-9612-74eefaf5baf6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:41.759685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5b09f-8a7d-4be0-a1e8-a0a4b242ea7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:41.760568 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5b09f-8a7d-4be0-a1e8-a0a4b242ea7c None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:41.760866 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5b09f-8a7d-4be0-a1e8-a0a4b242ea7c None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:41.761146 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5b09f-8a7d-4be0-a1e8-a0a4b242ea7c None admin] PATH_INFO: `/v3/projects/27fffefbce874beab07ae5240b7f0d10` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:41.762660 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5b09f-8a7d-4be0-a1e8-a0a4b242ea7c None admin] RBAC: Authorizing `identity:get_project(project_id=27fffefbce874beab07ae5240b7f0d10)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:41.764135 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5b09f-8a7d-4be0-a1e8-a0a4b242ea7c None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:41.769099 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 89/173] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:41 2022] GET /identity/v3/projects/27fffefbce874beab07ae5240b7f0d10 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:41.776576 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5b09f-8a7d-4be0-a1e8-a0a4b242ea7c None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:41.780131 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef809d12-eaf3-4a7e-9612-74eefaf5baf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:41.789324 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-ef809d12-eaf3-4a7e-9612-74eefaf5baf6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:18:41.789324 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:41.789324 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:41.789324 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:41.789324 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:41.789324 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:41.789324 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:41.789324 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:41.789324 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:41.789324 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:41.789324 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:41.789324 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:41.789324 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:41.789324 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:41.789324 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:41.789324 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:41.790494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:41.790494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:41.790494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:41.790494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:41.790494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:41.790494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:41.790494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:41.790494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:41.790494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:41.790494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:41.790494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:41.790494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:18:41.790494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:41.790494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:41.790494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:41.790494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:41.791424 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:41.791424 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:41.791424 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:41.791424 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:41.791424 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:41.791424 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:41.791424 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:41.791424 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:41.791424 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:41.791424 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:41.791424 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:18:41.791424 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:18:41.791424 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 85/174] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:18:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:18:41.798407 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef809d12-eaf3-4a7e-9612-74eefaf5baf6 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:41.896649 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5b09f-8a7d-4be0-a1e8-a0a4b242ea7c None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:41.958417 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49496775-e357-4698-b3de-67c765169d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:41.959095 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49496775-e357-4698-b3de-67c765169d1e None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:41.959425 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49496775-e357-4698-b3de-67c765169d1e None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:41.959709 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49496775-e357-4698-b3de-67c765169d1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:41.961235 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49496775-e357-4698-b3de-67c765169d1e None admin] RBAC: Adding query filter params (role.id=a65ce6e645574561bb50ce9148d0637a, scope.project.id=27fffefbce874beab07ae5240b7f0d10, user.id=0c56e75b50944a4781c82d5e2c9cfbcd) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:41.961591 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49496775-e357-4698-b3de-67c765169d1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:41.963047 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49496775-e357-4698-b3de-67c765169d1e None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:41.977283 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 90/175] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:18:41 2022] GET /identity/v3/role_assignments?user.id=0c56e75b50944a4781c82d5e2c9cfbcd&scope.project.id=27fffefbce874beab07ae5240b7f0d10&role.id=a65ce6e645574561bb50ce9148d0637a => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:42.046040 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef809d12-eaf3-4a7e-9612-74eefaf5baf6 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:42.091228 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee4ea7-8e00-4606-85a2-ac20f2b4593e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:42.091853 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee4ea7-8e00-4606-85a2-ac20f2b4593e None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:42.092144 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee4ea7-8e00-4606-85a2-ac20f2b4593e None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:42.092429 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee4ea7-8e00-4606-85a2-ac20f2b4593e None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:42.093220 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee4ea7-8e00-4606-85a2-ac20f2b4593e None admin] RBAC: Adding query filter params (name=member) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:42.093562 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee4ea7-8e00-4606-85a2-ac20f2b4593e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:42.095015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee4ea7-8e00-4606-85a2-ac20f2b4593e None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:42.107428 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda83248-516d-4d15-a8dd-d1318f96d203 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:42.107779 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda83248-516d-4d15-a8dd-d1318f96d203 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:42.107993 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda83248-516d-4d15-a8dd-d1318f96d203 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:42.109687 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 91/176] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:18:42.110258 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 86/177] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:18:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:42.117810 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee4ea7-8e00-4606-85a2-ac20f2b4593e None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:42.118204 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ed0d2-ea77-443a-84af-ff8543e59fb8 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:42.118204 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ed0d2-ea77-443a-84af-ff8543e59fb8 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:42.118540 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ed0d2-ea77-443a-84af-ff8543e59fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:42.158541 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-d68ed0d2-ea77-443a-84af-ff8543e59fb8 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:42.159786 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-d68ed0d2-ea77-443a-84af-ff8543e59fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:42.258505 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee4ea7-8e00-4606-85a2-ac20f2b4593e None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:42.290714 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 92/178] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:42.292448 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78426e3b-2244-427f-b6a7-f0f407bd3fba None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:42.299431 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78426e3b-2244-427f-b6a7-f0f407bd3fba None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:42.299431 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78426e3b-2244-427f-b6a7-f0f407bd3fba None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:42.300490 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 93/179] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:42.305835 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53353bac-daa5-4f3a-a59e-3d5e1bf51cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:42.306871 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422927d-a240-4b94-8bef-aab6d2f3521a None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:42.307148 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53353bac-daa5-4f3a-a59e-3d5e1bf51cf4 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:42.307290 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422927d-a240-4b94-8bef-aab6d2f3521a None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:42.307434 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422927d-a240-4b94-8bef-aab6d2f3521a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:42.307857 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53353bac-daa5-4f3a-a59e-3d5e1bf51cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:42.308288 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53353bac-daa5-4f3a-a59e-3d5e1bf51cf4 None admin] PATH_INFO: `/v3/users/0c56e75b50944a4781c82d5e2c9cfbcd` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:42.309845 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53353bac-daa5-4f3a-a59e-3d5e1bf51cf4 None admin] RBAC: Authorizing `identity:get_user(user_id=0c56e75b50944a4781c82d5e2c9cfbcd)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:42.311491 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53353bac-daa5-4f3a-a59e-3d5e1bf51cf4 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:42.313349 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 87/180] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:42 2022] GET /identity/v3/users/0c56e75b50944a4781c82d5e2c9cfbcd => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:42.319503 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53353bac-daa5-4f3a-a59e-3d5e1bf51cf4 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:42.345146 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-c422927d-a240-4b94-8bef-aab6d2f3521a None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:42.346369 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-c422927d-a240-4b94-8bef-aab6d2f3521a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:42.437509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 94/181] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:18:42.438667 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422927d-a240-4b94-8bef-aab6d2f3521a None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:42.463355 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53353bac-daa5-4f3a-a59e-3d5e1bf51cf4 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:42.512614 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be6923-a9fd-4381-a2fb-ab5d6ae20844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:42.513276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be6923-a9fd-4381-a2fb-ab5d6ae20844 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:42.513612 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be6923-a9fd-4381-a2fb-ab5d6ae20844 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:42.513896 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be6923-a9fd-4381-a2fb-ab5d6ae20844 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:42.546033 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422927d-a240-4b94-8bef-aab6d2f3521a None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:42.585820 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9a1b2-19d5-4b96-af97-204d9fecba80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:42.586660 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9a1b2-19d5-4b96-af97-204d9fecba80 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:42.586957 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9a1b2-19d5-4b96-af97-204d9fecba80 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:42.587237 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9a1b2-19d5-4b96-af97-204d9fecba80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:42.594979 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be6923-a9fd-4381-a2fb-ab5d6ae20844 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:42.596537 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be6923-a9fd-4381-a2fb-ab5d6ae20844 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:42.599561 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9a1b2-19d5-4b96-af97-204d9fecba80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:42.608191 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-e8f9a1b2-19d5-4b96-af97-204d9fecba80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:18:42.608191 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:42.608191 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:42.608191 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:42.608191 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:42.608191 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:42.608191 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:42.608191 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:42.608191 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:42.608191 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:42.608191 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:42.608191 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:42.608191 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:42.608191 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:42.608191 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:42.608191 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:42.609523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:42.609523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:42.609523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:42.609523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:42.609523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:42.609523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:42.609523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:42.609523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:42.609523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:42.609523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:42.609523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:42.609523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:18:42.609523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:42.609523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:42.609523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:42.609523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:42.610570 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:42.610570 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:42.610570 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:42.610570 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:42.610570 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:42.610570 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:42.610570 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:42.610570 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:42.610570 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:42.610570 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:42.610570 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:18:42.610570 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:18:42.610570 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 95/182] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:18:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:42.615278 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607173e-7567-45c3-b65c-72f36f0b1d90 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:42.615758 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607173e-7567-45c3-b65c-72f36f0b1d90 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:42.617001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607173e-7567-45c3-b65c-72f36f0b1d90 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:42.618582 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 96/183] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:42.623084 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607173e-7567-45c3-b65c-72f36f0b1d90 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:42.731223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 88/184] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:18:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:18:42.731223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be6923-a9fd-4381-a2fb-ab5d6ae20844 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:42.751994 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607173e-7567-45c3-b65c-72f36f0b1d90 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:42.789548 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb7418-76ea-43d7-8a15-1d603a70732a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:42.790462 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb7418-76ea-43d7-8a15-1d603a70732a None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:42.790757 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb7418-76ea-43d7-8a15-1d603a70732a None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:42.791043 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb7418-76ea-43d7-8a15-1d603a70732a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:42.802898 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb7418-76ea-43d7-8a15-1d603a70732a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:42.812161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-97bb7418-76ea-43d7-8a15-1d603a70732a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:18:42.812161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:42.812161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:42.812161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:42.812161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:42.812161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:42.812161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:42.812161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:42.812161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:42.812161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:42.812161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:42.812161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:42.812161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:42.812161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:42.812161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:42.812161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:42.813287 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:42.813287 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:42.813287 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:42.813287 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:42.813287 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:42.813287 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:42.813287 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:42.813287 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:42.813287 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:42.813287 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:42.813287 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:42.813287 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:18:42.813287 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:42.813287 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:42.813287 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:42.813287 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:42.814270 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:42.814270 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:42.814270 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:42.814270 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:42.814270 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:42.814270 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:42.814270 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:42.814270 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:42.814270 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:42.814270 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:42.814270 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:18:42.814270 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:18:42.814270 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 97/185] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:18:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:42.815086 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9130f7f-73aa-4eac-bf18-017e733da8e6 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:42.815086 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9130f7f-73aa-4eac-bf18-017e733da8e6 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:42.815763 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9130f7f-73aa-4eac-bf18-017e733da8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:42.836749 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-d9130f7f-73aa-4eac-bf18-017e733da8e6 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:42.838126 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-d9130f7f-73aa-4eac-bf18-017e733da8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:42.840837 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be6923-a9fd-4381-a2fb-ab5d6ae20844 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:42.888029 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e36de-194a-4ed6-893b-18bf0c2d422c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:42.888740 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e36de-194a-4ed6-893b-18bf0c2d422c None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:42.889103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e36de-194a-4ed6-893b-18bf0c2d422c None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:42.889478 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e36de-194a-4ed6-893b-18bf0c2d422c None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:42.890339 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e36de-194a-4ed6-893b-18bf0c2d422c None admin] RBAC: Adding query filter params (name=admin) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:42.890748 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e36de-194a-4ed6-893b-18bf0c2d422c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:42.892192 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e36de-194a-4ed6-893b-18bf0c2d422c None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:42.906583 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 89/186] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:18:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:42.906583 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e36de-194a-4ed6-893b-18bf0c2d422c None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:42.922353 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 98/187] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:42.923384 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9130f7f-73aa-4eac-bf18-017e733da8e6 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:43.032334 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e36de-194a-4ed6-893b-18bf0c2d422c None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:43.072504 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9130f7f-73aa-4eac-bf18-017e733da8e6 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:43.091504 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32364558-4367-4a8d-b23a-44054b571ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:43.093467 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32364558-4367-4a8d-b23a-44054b571ffe None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:43.093775 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32364558-4367-4a8d-b23a-44054b571ffe None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:43.094037 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32364558-4367-4a8d-b23a-44054b571ffe None admin] PATH_INFO: `/v3/projects/41b62c74a1c847c58056e97f418bf4d2` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:43.095905 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32364558-4367-4a8d-b23a-44054b571ffe None admin] RBAC: Authorizing `identity:get_project(project_id=41b62c74a1c847c58056e97f418bf4d2)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:43.097359 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32364558-4367-4a8d-b23a-44054b571ffe None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:43.106774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 90/188] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:42 2022] GET /identity/v3/projects/41b62c74a1c847c58056e97f418bf4d2 => generated 312 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:43.106774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32364558-4367-4a8d-b23a-44054b571ffe None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:43.137974 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bc468-9687-429f-8303-7342c177c400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:43.139744 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bc468-9687-429f-8303-7342c177c400 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:43.139979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bc468-9687-429f-8303-7342c177c400 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:43.140266 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bc468-9687-429f-8303-7342c177c400 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:43.141997 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bc468-9687-429f-8303-7342c177c400 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:43.142306 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bc468-9687-429f-8303-7342c177c400 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:43.143742 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bc468-9687-429f-8303-7342c177c400 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:43.159614 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 99/189] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:18:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:43.159614 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bc468-9687-429f-8303-7342c177c400 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:43.255603 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32364558-4367-4a8d-b23a-44054b571ffe None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:43.304787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bc468-9687-429f-8303-7342c177c400 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:43.313122 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81549fd5-4f8c-4e58-9d65-2463212bb067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:43.314062 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81549fd5-4f8c-4e58-9d65-2463212bb067 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:43.314349 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81549fd5-4f8c-4e58-9d65-2463212bb067 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:43.314632 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81549fd5-4f8c-4e58-9d65-2463212bb067 None admin] PATH_INFO: `/v3/users/f2ef37efc685484c85d31139dac006a9` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:43.335893 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81549fd5-4f8c-4e58-9d65-2463212bb067 None admin] RBAC: Authorizing `identity:get_user(user_id=f2ef37efc685484c85d31139dac006a9)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:43.336518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81549fd5-4f8c-4e58-9d65-2463212bb067 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:43.343055 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 91/190] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:43 2022] GET /identity/v3/users/f2ef37efc685484c85d31139dac006a9 => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:43.343055 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81549fd5-4f8c-4e58-9d65-2463212bb067 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:43.349775 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73926cc7-571e-48d5-8894-c16cfebb250f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:43.351632 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73926cc7-571e-48d5-8894-c16cfebb250f None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:43.352151 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73926cc7-571e-48d5-8894-c16cfebb250f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:43.352685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73926cc7-571e-48d5-8894-c16cfebb250f None admin] PATH_INFO: `/v3/domains/default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:43.354469 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73926cc7-571e-48d5-8894-c16cfebb250f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:43.356405 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73926cc7-571e-48d5-8894-c16cfebb250f None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:43.358685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 100/191] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:18:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:43.361028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73926cc7-571e-48d5-8894-c16cfebb250f None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:43.487244 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81549fd5-4f8c-4e58-9d65-2463212bb067 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:43.502289 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73926cc7-571e-48d5-8894-c16cfebb250f None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:43.549127 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662480bd-0e90-4692-9387-5e5f5ebd8bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:43.549849 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662480bd-0e90-4692-9387-5e5f5ebd8bde None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:43.550280 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662480bd-0e90-4692-9387-5e5f5ebd8bde None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:43.552230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662480bd-0e90-4692-9387-5e5f5ebd8bde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:43.552356 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6c9fa-3a3a-49cd-94fb-3dc2c0d7f810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:43.553494 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6c9fa-3a3a-49cd-94fb-3dc2c0d7f810 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:43.553687 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662480bd-0e90-4692-9387-5e5f5ebd8bde None admin] RBAC: Adding query filter params (role.id=a65ce6e645574561bb50ce9148d0637a, scope.project.id=41b62c74a1c847c58056e97f418bf4d2, user.id=0c56e75b50944a4781c82d5e2c9cfbcd) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:43.554108 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662480bd-0e90-4692-9387-5e5f5ebd8bde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:43.554451 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6c9fa-3a3a-49cd-94fb-3dc2c0d7f810 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:43.554451 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6c9fa-3a3a-49cd-94fb-3dc2c0d7f810 None admin] PATH_INFO: `/v3/users/f2ef37efc685484c85d31139dac006a9` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:43.555352 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662480bd-0e90-4692-9387-5e5f5ebd8bde None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:43.556096 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6c9fa-3a3a-49cd-94fb-3dc2c0d7f810 None admin] RBAC: Authorizing `identity:get_user(user_id=f2ef37efc685484c85d31139dac006a9)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:43.558452 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6c9fa-3a3a-49cd-94fb-3dc2c0d7f810 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:43.560628 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 101/192] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:43 2022] GET /identity/v3/users/f2ef37efc685484c85d31139dac006a9 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:43.561254 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6c9fa-3a3a-49cd-94fb-3dc2c0d7f810 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:43.567483 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 92/193] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:18:43 2022] GET /identity/v3/role_assignments?user.id=0c56e75b50944a4781c82d5e2c9cfbcd&scope.project.id=41b62c74a1c847c58056e97f418bf4d2&role.id=a65ce6e645574561bb50ce9148d0637a => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:43.569185 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662480bd-0e90-4692-9387-5e5f5ebd8bde None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:43.729334 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6c9fa-3a3a-49cd-94fb-3dc2c0d7f810 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:43.732036 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662480bd-0e90-4692-9387-5e5f5ebd8bde None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:43.779381 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00029ba9-12df-44a1-b2b7-60257acc4ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:43.780001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00029ba9-12df-44a1-b2b7-60257acc4ffb None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:43.780288 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00029ba9-12df-44a1-b2b7-60257acc4ffb None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:43.780566 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00029ba9-12df-44a1-b2b7-60257acc4ffb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:43.781205 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b40644-241c-49b4-ab9f-dd05f03b070c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:43.782509 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b40644-241c-49b4-ab9f-dd05f03b070c None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:43.783121 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b40644-241c-49b4-ab9f-dd05f03b070c None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:43.783717 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b40644-241c-49b4-ab9f-dd05f03b070c None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:43.786562 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b40644-241c-49b4-ab9f-dd05f03b070c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:43.788887 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b40644-241c-49b4-ab9f-dd05f03b070c None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:43.814573 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 93/194] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:18:43 2022] POST /identity/v3/users => generated 297 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:18:43.815690 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b40644-241c-49b4-ab9f-dd05f03b070c None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:43.871769 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00029ba9-12df-44a1-b2b7-60257acc4ffb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:43.873804 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00029ba9-12df-44a1-b2b7-60257acc4ffb None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:43.959050 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b40644-241c-49b4-ab9f-dd05f03b070c None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:43.998633 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 102/195] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:18:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:18:44.005487 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00029ba9-12df-44a1-b2b7-60257acc4ffb None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:44.007594 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04577b-ce55-4fca-8688-4d6d057f5f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:44.008302 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04577b-ce55-4fca-8688-4d6d057f5f99 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:44.008593 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04577b-ce55-4fca-8688-4d6d057f5f99 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:44.008874 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04577b-ce55-4fca-8688-4d6d057f5f99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:44.105582 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04577b-ce55-4fca-8688-4d6d057f5f99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:44.107000 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04577b-ce55-4fca-8688-4d6d057f5f99 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:44.166457 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00029ba9-12df-44a1-b2b7-60257acc4ffb None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:44.212588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845002e-fe03-4901-af8f-044c6d24e990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:44.213511 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845002e-fe03-4901-af8f-044c6d24e990 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:44.213803 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845002e-fe03-4901-af8f-044c6d24e990 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:44.214087 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845002e-fe03-4901-af8f-044c6d24e990 None admin] PATH_INFO: `/v3/projects/46dbfbf04ba34604abb1879881e3e4d9` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:44.215337 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845002e-fe03-4901-af8f-044c6d24e990 None admin] RBAC: Authorizing `identity:get_project(project_id=46dbfbf04ba34604abb1879881e3e4d9)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:44.216810 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845002e-fe03-4901-af8f-044c6d24e990 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:44.218823 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 103/196] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:44 2022] GET /identity/v3/projects/46dbfbf04ba34604abb1879881e3e4d9 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:44.219886 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b1a06-2e78-4fc7-b26f-923e516cc99d None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:44.220176 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b1a06-2e78-4fc7-b26f-923e516cc99d None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:44.220456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b1a06-2e78-4fc7-b26f-923e516cc99d None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:44.222250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 104/197] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:44.228195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307d806-a68b-43ba-a2f4-622631a8f338 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:44.228492 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307d806-a68b-43ba-a2f4-622631a8f338 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:44.228780 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307d806-a68b-43ba-a2f4-622631a8f338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:44.239742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 94/198] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:18:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:18:44.241021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04577b-ce55-4fca-8688-4d6d057f5f99 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:44.248825 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-1307d806-a68b-43ba-a2f4-622631a8f338 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:44.250227 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-1307d806-a68b-43ba-a2f4-622631a8f338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:44.330068 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 105/199] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:18:44.337700 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307d806-a68b-43ba-a2f4-622631a8f338 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:44.373065 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04577b-ce55-4fca-8688-4d6d057f5f99 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:44.417937 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d76f91-6bc1-4b1b-ab35-a26d168dae90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:44.418791 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d76f91-6bc1-4b1b-ab35-a26d168dae90 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:44.419599 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d76f91-6bc1-4b1b-ab35-a26d168dae90 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:44.419888 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d76f91-6bc1-4b1b-ab35-a26d168dae90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:44.421054 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d76f91-6bc1-4b1b-ab35-a26d168dae90 None admin] RBAC: Adding query filter params (role.id=9aaa841361294b9c9b275ca1be0ed89c, scope.project.id=46dbfbf04ba34604abb1879881e3e4d9, user.id=f2ef37efc685484c85d31139dac006a9) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:44.421397 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d76f91-6bc1-4b1b-ab35-a26d168dae90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:44.423877 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d76f91-6bc1-4b1b-ab35-a26d168dae90 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:44.431892 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 95/200] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:18:44 2022] GET /identity/v3/role_assignments?user.id=f2ef37efc685484c85d31139dac006a9&scope.project.id=46dbfbf04ba34604abb1879881e3e4d9&role.id=9aaa841361294b9c9b275ca1be0ed89c => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:44.433035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d76f91-6bc1-4b1b-ab35-a26d168dae90 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:44.455826 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307d806-a68b-43ba-a2f4-622631a8f338 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:44.501814 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94606360-ab1d-4745-921d-58296f565b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:44.502791 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94606360-ab1d-4745-921d-58296f565b18 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:44.503076 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94606360-ab1d-4745-921d-58296f565b18 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:44.503353 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94606360-ab1d-4745-921d-58296f565b18 None admin] PATH_INFO: `/v3/projects/46dbfbf04ba34604abb1879881e3e4d9` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:44.504698 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94606360-ab1d-4745-921d-58296f565b18 None admin] RBAC: Authorizing `identity:get_project(project_id=46dbfbf04ba34604abb1879881e3e4d9)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:44.506936 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94606360-ab1d-4745-921d-58296f565b18 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:44.509225 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 106/201] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:44 2022] GET /identity/v3/projects/46dbfbf04ba34604abb1879881e3e4d9 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:44.523755 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94606360-ab1d-4745-921d-58296f565b18 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:44.570872 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d76f91-6bc1-4b1b-ab35-a26d168dae90 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:44.615540 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8a94a-8f91-4bbb-9a4d-7af3f7e6b959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:44.616696 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8a94a-8f91-4bbb-9a4d-7af3f7e6b959 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:44.617002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8a94a-8f91-4bbb-9a4d-7af3f7e6b959 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:44.617510 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8a94a-8f91-4bbb-9a4d-7af3f7e6b959 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:44.630346 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8a94a-8f91-4bbb-9a4d-7af3f7e6b959 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:44.638849 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-25d8a94a-8f91-4bbb-9a4d-7af3f7e6b959 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:18:44.638849 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:44.638849 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:44.638849 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:44.638849 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:44.638849 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:44.638849 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:44.638849 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:44.638849 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:44.638849 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:44.638849 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:44.638849 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:44.638849 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:44.638849 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:44.638849 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:44.638849 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:44.641302 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:44.641302 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:44.641302 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:44.641302 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:44.641302 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:44.641302 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:44.641302 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:44.641302 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:44.641302 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:44.641302 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:44.641302 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:44.641302 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:18:44.641302 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:44.641302 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:44.641302 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:44.641302 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:44.643524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:44.643524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:44.643524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:44.643524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:44.643524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:44.643524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:44.643524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:44.643524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:44.643524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:44.643524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:44.643524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:18:44.643524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:18:44.643524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 96/202] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:18:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:44.649751 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8a94a-8f91-4bbb-9a4d-7af3f7e6b959 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:44.724317 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94606360-ab1d-4745-921d-58296f565b18 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:44.765235 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e12dc0-016a-4542-88fd-06976ea97ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:44.765952 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e12dc0-016a-4542-88fd-06976ea97ff6 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:44.766247 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e12dc0-016a-4542-88fd-06976ea97ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:44.766529 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e12dc0-016a-4542-88fd-06976ea97ff6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:44.767384 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e12dc0-016a-4542-88fd-06976ea97ff6 None admin] RBAC: Adding query filter params (role.id=b624791ed6aa460fa31372c80cf5991d, scope.project.id=46dbfbf04ba34604abb1879881e3e4d9, user.id=f2ef37efc685484c85d31139dac006a9) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:44.767704 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e12dc0-016a-4542-88fd-06976ea97ff6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:44.769215 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e12dc0-016a-4542-88fd-06976ea97ff6 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:44.777955 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 107/203] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:18:44 2022] GET /identity/v3/role_assignments?user.id=f2ef37efc685484c85d31139dac006a9&scope.project.id=46dbfbf04ba34604abb1879881e3e4d9&role.id=b624791ed6aa460fa31372c80cf5991d => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:44.797924 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8a94a-8f91-4bbb-9a4d-7af3f7e6b959 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:44.837699 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd95cb-b21b-4740-83ad-052cd5d3ba1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:44.838404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd95cb-b21b-4740-83ad-052cd5d3ba1f None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:44.838758 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd95cb-b21b-4740-83ad-052cd5d3ba1f None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:44.839045 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd95cb-b21b-4740-83ad-052cd5d3ba1f None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:44.839824 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd95cb-b21b-4740-83ad-052cd5d3ba1f None admin] RBAC: Adding query filter params (name=reader) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:44.840138 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd95cb-b21b-4740-83ad-052cd5d3ba1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:44.841601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd95cb-b21b-4740-83ad-052cd5d3ba1f None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:44.852011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 97/204] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:18:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:44.857910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e12dc0-016a-4542-88fd-06976ea97ff6 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:44.970504 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e12dc0-016a-4542-88fd-06976ea97ff6 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:45.009832 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca4b06-651a-4dfd-ab1e-aaffa80dcc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:45.010730 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca4b06-651a-4dfd-ab1e-aaffa80dcc98 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:45.011018 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca4b06-651a-4dfd-ab1e-aaffa80dcc98 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:45.011367 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca4b06-651a-4dfd-ab1e-aaffa80dcc98 None admin] PATH_INFO: `/v3/users/7d8fb6ae08b94fabb12b189ed5d9cafb` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:45.012692 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca4b06-651a-4dfd-ab1e-aaffa80dcc98 None admin] RBAC: Authorizing `identity:get_user(user_id=7d8fb6ae08b94fabb12b189ed5d9cafb)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:45.014279 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca4b06-651a-4dfd-ab1e-aaffa80dcc98 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:45.016245 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 108/205] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:44 2022] GET /identity/v3/users/7d8fb6ae08b94fabb12b189ed5d9cafb => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:45.021951 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd95cb-b21b-4740-83ad-052cd5d3ba1f None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:45.131043 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd95cb-b21b-4740-83ad-052cd5d3ba1f None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:45.170903 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798ca3e-f77a-452e-9804-61a5c59ac52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:45.171566 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798ca3e-f77a-452e-9804-61a5c59ac52c None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:45.171854 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798ca3e-f77a-452e-9804-61a5c59ac52c None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:45.172139 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798ca3e-f77a-452e-9804-61a5c59ac52c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:45.242520 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798ca3e-f77a-452e-9804-61a5c59ac52c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:45.243934 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798ca3e-f77a-452e-9804-61a5c59ac52c None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:45.351508 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 98/206] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:18:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:18:45.357268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca4b06-651a-4dfd-ab1e-aaffa80dcc98 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:45.468934 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca4b06-651a-4dfd-ab1e-aaffa80dcc98 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:45.515694 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7c3ef-b07c-4353-a4b7-ca5879588b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:45.516506 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7c3ef-b07c-4353-a4b7-ca5879588b5c None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:45.516792 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7c3ef-b07c-4353-a4b7-ca5879588b5c None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:45.517068 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7c3ef-b07c-4353-a4b7-ca5879588b5c None admin] PATH_INFO: `/v3/projects/27fffefbce874beab07ae5240b7f0d10` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:45.518451 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7c3ef-b07c-4353-a4b7-ca5879588b5c None admin] RBAC: Authorizing `identity:get_project(project_id=27fffefbce874beab07ae5240b7f0d10)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:45.519925 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7c3ef-b07c-4353-a4b7-ca5879588b5c None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:45.522631 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 109/207] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:45 2022] GET /identity/v3/projects/27fffefbce874beab07ae5240b7f0d10 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:45.528055 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798ca3e-f77a-452e-9804-61a5c59ac52c None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:45.641764 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798ca3e-f77a-452e-9804-61a5c59ac52c None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:45.677113 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec036e-1ae0-4efe-9a83-efa0502be94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:45.678763 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec036e-1ae0-4efe-9a83-efa0502be94e None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:45.679299 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec036e-1ae0-4efe-9a83-efa0502be94e None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:45.679790 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec036e-1ae0-4efe-9a83-efa0502be94e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:45.680844 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec036e-1ae0-4efe-9a83-efa0502be94e None admin] RBAC: Adding query filter params (role.id=1cf9a76305b6469cb57c1115c9cb198b, scope.project.id=27fffefbce874beab07ae5240b7f0d10, user.id=7d8fb6ae08b94fabb12b189ed5d9cafb) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:45.681489 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec036e-1ae0-4efe-9a83-efa0502be94e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:45.683170 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec036e-1ae0-4efe-9a83-efa0502be94e None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:45.689850 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 99/208] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:18:45 2022] GET /identity/v3/role_assignments?user.id=7d8fb6ae08b94fabb12b189ed5d9cafb&scope.project.id=27fffefbce874beab07ae5240b7f0d10&role.id=1cf9a76305b6469cb57c1115c9cb198b => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:46.687343 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f89145-b344-43b1-92b2-d03f24b7d946 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:46.688377 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f89145-b344-43b1-92b2-d03f24b7d946 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:46.688882 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f89145-b344-43b1-92b2-d03f24b7d946 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:46.690778 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 110/209] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:46.697556 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ffb23-5d23-4a49-9749-b850d4cef647 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:46.698442 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ffb23-5d23-4a49-9749-b850d4cef647 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:46.698959 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ffb23-5d23-4a49-9749-b850d4cef647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:46.717228 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-dd5ffb23-5d23-4a49-9749-b850d4cef647 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:46.718394 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01772af3-83f0-458e-92b5-9b7d01f4494c None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:46.718687 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01772af3-83f0-458e-92b5-9b7d01f4494c None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:46.718972 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01772af3-83f0-458e-92b5-9b7d01f4494c None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:46.719626 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-dd5ffb23-5d23-4a49-9749-b850d4cef647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:46.720666 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 111/210] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:18:46.726475 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427ecc5-9523-41ce-b954-599533e4aebd None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:46.726780 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427ecc5-9523-41ce-b954-599533e4aebd None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:46.727038 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427ecc5-9523-41ce-b954-599533e4aebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:46.744546 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-3427ecc5-9523-41ce-b954-599533e4aebd None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:46.745810 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-3427ecc5-9523-41ce-b954-599533e4aebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:46.808885 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 100/211] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:46.825532 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 112/212] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:18:46.833241 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ffb23-5d23-4a49-9749-b850d4cef647 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:46.843955 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427ecc5-9523-41ce-b954-599533e4aebd None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:46.937714 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ffb23-5d23-4a49-9749-b850d4cef647 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:46.947636 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427ecc5-9523-41ce-b954-599533e4aebd None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:46.988933 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabd1af-02a8-40ab-b1f5-c9c170cc9766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:46.990281 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabd1af-02a8-40ab-b1f5-c9c170cc9766 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:46.991046 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabd1af-02a8-40ab-b1f5-c9c170cc9766 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:46.991519 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabd1af-02a8-40ab-b1f5-c9c170cc9766 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:46.992483 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369961b-53b1-4dce-be4b-928720ce7ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:46.993192 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fabd1af-02a8-40ab-b1f5-c9c170cc9766 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:46.994093 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369961b-53b1-4dce-be4b-928720ce7ef2 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:46.994579 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369961b-53b1-4dce-be4b-928720ce7ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:46.995021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369961b-53b1-4dce-be4b-928720ce7ef2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:46.995151 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fabd1af-02a8-40ab-b1f5-c9c170cc9766 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:46.997333 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 113/213] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:18:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:47.003842 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabd1af-02a8-40ab-b1f5-c9c170cc9766 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:47.010083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369961b-53b1-4dce-be4b-928720ce7ef2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:47.018388 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-c369961b-53b1-4dce-be4b-928720ce7ef2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:18:47.018388 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:47.018388 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:47.018388 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:47.018388 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:47.018388 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:47.018388 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:47.018388 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:47.018388 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:47.018388 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:47.018388 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:47.018388 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:47.018388 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:47.018388 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:47.018388 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:47.018388 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:47.019705 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:47.019705 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:47.019705 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:47.019705 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:47.019705 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:47.019705 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:47.019705 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:47.019705 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:47.019705 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:47.019705 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:47.019705 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:47.019705 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:18:47.019705 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:47.019705 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:47.019705 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:47.019705 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:47.020884 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:47.020884 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:47.020884 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:47.020884 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:47.020884 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:47.020884 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:47.020884 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:47.020884 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:47.020884 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:47.020884 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:47.020884 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:18:47.020884 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:18:47.029029 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 101/214] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:18:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:47.030290 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369961b-53b1-4dce-be4b-928720ce7ef2 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:47.115631 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabd1af-02a8-40ab-b1f5-c9c170cc9766 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:47.135383 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369961b-53b1-4dce-be4b-928720ce7ef2 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:47.151551 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27b7ed-85d1-4b84-8398-100d24dcf94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:47.152308 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27b7ed-85d1-4b84-8398-100d24dcf94e None admin] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:47.152746 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27b7ed-85d1-4b84-8398-100d24dcf94e None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:47.153139 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27b7ed-85d1-4b84-8398-100d24dcf94e None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:47.153983 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27b7ed-85d1-4b84-8398-100d24dcf94e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:47.155711 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27b7ed-85d1-4b84-8398-100d24dcf94e None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:47.178420 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c7d10-779c-4fb4-88af-0c78a5c96e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:47.179653 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c7d10-779c-4fb4-88af-0c78a5c96e69 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:47.180195 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c7d10-779c-4fb4-88af-0c78a5c96e69 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:47.180637 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c7d10-779c-4fb4-88af-0c78a5c96e69 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:47.181839 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c7d10-779c-4fb4-88af-0c78a5c96e69 None admin] RBAC: Adding query filter params (name=member) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:47.182450 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c7d10-779c-4fb4-88af-0c78a5c96e69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:47.184300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c7d10-779c-4fb4-88af-0c78a5c96e69 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:47.186590 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 114/215] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:18:47 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:18:47.190142 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd3127-48c0-495f-90fe-f7250d664fb7 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:47.190555 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd3127-48c0-495f-90fe-f7250d664fb7 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:47.190754 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd3127-48c0-495f-90fe-f7250d664fb7 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:47.192509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 115/216] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:47.198350 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 102/217] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:18:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:47.203389 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79f191-1f40-4c23-9471-bb3379faf623 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:47.203389 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79f191-1f40-4c23-9471-bb3379faf623 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:47.203389 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79f191-1f40-4c23-9471-bb3379faf623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:47.205264 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c7d10-779c-4fb4-88af-0c78a5c96e69 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:47.224565 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-3b79f191-1f40-4c23-9471-bb3379faf623 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:47.227556 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-3b79f191-1f40-4c23-9471-bb3379faf623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:47.317412 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 116/218] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:47.336087 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c7d10-779c-4fb4-88af-0c78a5c96e69 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:47.341357 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79f191-1f40-4c23-9471-bb3379faf623 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:47.378811 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5c9c9-992e-4734-8734-8099b89b189d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:47.379977 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5c9c9-992e-4734-8734-8099b89b189d None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:47.380493 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5c9c9-992e-4734-8734-8099b89b189d None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:47.380944 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5c9c9-992e-4734-8734-8099b89b189d None admin] PATH_INFO: `/v3/users/179bca7a106d4b99b6622e2fff115835` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:47.397648 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5c9c9-992e-4734-8734-8099b89b189d None admin] RBAC: Authorizing `identity:get_user(user_id=179bca7a106d4b99b6622e2fff115835)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:47.399483 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5c9c9-992e-4734-8734-8099b89b189d None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:47.406802 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 103/219] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:47 2022] GET /identity/v3/users/179bca7a106d4b99b6622e2fff115835 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:47.408053 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5c9c9-992e-4734-8734-8099b89b189d None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:47.468456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79f191-1f40-4c23-9471-bb3379faf623 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:47.530759 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f499c3e-5e3a-481f-aedd-2df4d8ff859f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:47.531022 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f499c3e-5e3a-481f-aedd-2df4d8ff859f None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:47.531316 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f499c3e-5e3a-481f-aedd-2df4d8ff859f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:47.531597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f499c3e-5e3a-481f-aedd-2df4d8ff859f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:47.550883 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5c9c9-992e-4734-8734-8099b89b189d None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:47.554604 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f499c3e-5e3a-481f-aedd-2df4d8ff859f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:47.563247 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-6f499c3e-5e3a-481f-aedd-2df4d8ff859f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:18:47.563247 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:47.563247 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:47.563247 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:47.563247 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:47.563247 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:47.563247 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:47.563247 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:47.563247 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:47.563247 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:47.563247 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:47.563247 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:47.563247 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:47.563247 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:47.563247 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:47.563247 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:47.564559 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:47.564559 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:47.564559 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:47.564559 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:47.564559 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:47.564559 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:47.564559 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:47.564559 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:47.564559 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:47.564559 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:47.564559 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:47.564559 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:18:47.564559 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:47.564559 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:47.564559 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:47.564559 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:47.565678 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:47.565678 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:47.565678 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:47.565678 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:47.565678 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:47.565678 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:47.565678 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:47.565678 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:47.565678 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:47.565678 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:47.565678 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:18:47.565678 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:18:47.565678 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 117/220] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:18:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:47.574498 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f499c3e-5e3a-481f-aedd-2df4d8ff859f None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:47.621876 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea5de9-eb01-4ad7-a292-f30fcb656899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:47.622811 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea5de9-eb01-4ad7-a292-f30fcb656899 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:47.623261 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea5de9-eb01-4ad7-a292-f30fcb656899 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:47.623548 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea5de9-eb01-4ad7-a292-f30fcb656899 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:47.709098 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea5de9-eb01-4ad7-a292-f30fcb656899 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:47.713398 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea5de9-eb01-4ad7-a292-f30fcb656899 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:47.726799 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f499c3e-5e3a-481f-aedd-2df4d8ff859f None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:47.767147 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67a23b-cc6c-4116-b60e-d3d77d566a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:47.767846 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67a23b-cc6c-4116-b60e-d3d77d566a5f None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:47.768140 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67a23b-cc6c-4116-b60e-d3d77d566a5f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:47.768425 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67a23b-cc6c-4116-b60e-d3d77d566a5f None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:47.769209 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67a23b-cc6c-4116-b60e-d3d77d566a5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:47.769563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67a23b-cc6c-4116-b60e-d3d77d566a5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:47.770992 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67a23b-cc6c-4116-b60e-d3d77d566a5f None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:47.781623 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 118/221] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:18:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:47.783065 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b26def-91d9-40e6-97db-9c7df5849f90 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:47.783367 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b26def-91d9-40e6-97db-9c7df5849f90 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:47.783651 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b26def-91d9-40e6-97db-9c7df5849f90 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:47.784983 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 119/222] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:47.790847 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b26def-91d9-40e6-97db-9c7df5849f90 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:47.821404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 104/223] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:18:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:18:47.822784 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bff1a-7b36-43b0-871a-c5d25345e396 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:47.823056 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bff1a-7b36-43b0-871a-c5d25345e396 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:47.823360 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bff1a-7b36-43b0-871a-c5d25345e396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:47.843119 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-1a0bff1a-7b36-43b0-871a-c5d25345e396 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:47.844340 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-1a0bff1a-7b36-43b0-871a-c5d25345e396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:47.908581 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b26def-91d9-40e6-97db-9c7df5849f90 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:47.918582 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 105/224] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:47.919277 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bff1a-7b36-43b0-871a-c5d25345e396 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:47.988449 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963c03d-16c2-4993-b853-acc455474825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:47.989534 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963c03d-16c2-4993-b853-acc455474825 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:47.989827 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963c03d-16c2-4993-b853-acc455474825 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:47.993395 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963c03d-16c2-4993-b853-acc455474825 None admin] PATH_INFO: `/v3/users/f2ef37efc685484c85d31139dac006a9` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:48.001731 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963c03d-16c2-4993-b853-acc455474825 None admin] RBAC: Authorizing `identity:get_user(user_id=f2ef37efc685484c85d31139dac006a9)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:48.001731 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963c03d-16c2-4993-b853-acc455474825 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:48.001731 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 120/225] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:47 2022] GET /identity/v3/users/f2ef37efc685484c85d31139dac006a9 => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:48.002558 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963c03d-16c2-4993-b853-acc455474825 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:48.020759 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bff1a-7b36-43b0-871a-c5d25345e396 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:48.056956 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb81ee7-747f-435e-8648-2b1be7656326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:48.058150 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb81ee7-747f-435e-8648-2b1be7656326 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:48.058373 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb81ee7-747f-435e-8648-2b1be7656326 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:48.058645 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb81ee7-747f-435e-8648-2b1be7656326 None admin] PATH_INFO: `/v3/projects/46dbfbf04ba34604abb1879881e3e4d9` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:48.069034 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb81ee7-747f-435e-8648-2b1be7656326 None admin] RBAC: Authorizing `identity:get_project(project_id=46dbfbf04ba34604abb1879881e3e4d9)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:48.069034 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb81ee7-747f-435e-8648-2b1be7656326 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:48.069034 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 106/226] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:47 2022] GET /identity/v3/projects/46dbfbf04ba34604abb1879881e3e4d9 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:48.069034 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb81ee7-747f-435e-8648-2b1be7656326 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:48.131872 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963c03d-16c2-4993-b853-acc455474825 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:48.169933 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ebf2f-6d18-4faf-815d-bd3e51b1f6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:48.170758 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ebf2f-6d18-4faf-815d-bd3e51b1f6bf None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:48.171046 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ebf2f-6d18-4faf-815d-bd3e51b1f6bf None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:48.171331 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ebf2f-6d18-4faf-815d-bd3e51b1f6bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:48.171968 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb81ee7-747f-435e-8648-2b1be7656326 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:48.183072 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ebf2f-6d18-4faf-815d-bd3e51b1f6bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:48.191404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-289ebf2f-6d18-4faf-815d-bd3e51b1f6bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:18:48.191404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:48.191404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:48.191404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:48.191404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:48.191404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:48.191404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:48.191404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:48.191404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:48.191404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:48.191404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:48.191404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:48.191404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:48.191404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:48.191404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:48.191404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:48.192444 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:48.192444 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:48.192444 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:48.192444 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:48.192444 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:48.192444 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:48.192444 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:48.192444 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:48.192444 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:48.192444 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:48.192444 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:48.192444 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:18:48.192444 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:48.192444 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:48.192444 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:48.192444 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:48.193395 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:48.193395 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:48.193395 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:48.193395 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:48.193395 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:48.193395 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:48.193395 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:48.193395 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:48.193395 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:48.193395 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:48.193395 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:18:48.193395 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:18:48.193395 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 121/227] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:18:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:48.194964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ebf2f-6d18-4faf-815d-bd3e51b1f6bf None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:48.221401 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e66e4-2691-4513-9cf4-57070e60357d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:48.221401 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e66e4-2691-4513-9cf4-57070e60357d None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:48.221401 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e66e4-2691-4513-9cf4-57070e60357d None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:48.221401 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e66e4-2691-4513-9cf4-57070e60357d None admin] PATH_INFO: `/v3/projects/46dbfbf04ba34604abb1879881e3e4d9` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:48.225437 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e66e4-2691-4513-9cf4-57070e60357d None admin] RBAC: Authorizing `identity:get_project(project_id=46dbfbf04ba34604abb1879881e3e4d9)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:48.225437 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e66e4-2691-4513-9cf4-57070e60357d None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:48.229183 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 107/228] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:48 2022] GET /identity/v3/projects/46dbfbf04ba34604abb1879881e3e4d9 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:48.230310 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e66e4-2691-4513-9cf4-57070e60357d None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:48.371462 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ebf2f-6d18-4faf-815d-bd3e51b1f6bf None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:48.417395 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bcf1a-4a47-403a-99be-214068239563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:48.417395 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bcf1a-4a47-403a-99be-214068239563 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:48.417935 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bcf1a-4a47-403a-99be-214068239563 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:48.417935 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bcf1a-4a47-403a-99be-214068239563 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:48.421400 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4bcf1a-4a47-403a-99be-214068239563 None admin] RBAC: Adding query filter params (role.id=a65ce6e645574561bb50ce9148d0637a, scope.project.id=46dbfbf04ba34604abb1879881e3e4d9, user.id=179bca7a106d4b99b6622e2fff115835) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:48.421400 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4bcf1a-4a47-403a-99be-214068239563 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:48.421400 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4bcf1a-4a47-403a-99be-214068239563 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:48.433396 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e66e4-2691-4513-9cf4-57070e60357d None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:48.434936 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 122/229] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:18:48 2022] GET /identity/v3/role_assignments?user.id=179bca7a106d4b99b6622e2fff115835&scope.project.id=46dbfbf04ba34604abb1879881e3e4d9&role.id=a65ce6e645574561bb50ce9148d0637a => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:48.435930 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bcf1a-4a47-403a-99be-214068239563 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:48.509398 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9dd3e-fdbe-44a8-9fc3-f19125714364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:48.509398 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9dd3e-fdbe-44a8-9fc3-f19125714364 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:48.509398 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9dd3e-fdbe-44a8-9fc3-f19125714364 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:48.509398 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9dd3e-fdbe-44a8-9fc3-f19125714364 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:48.510220 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9dd3e-fdbe-44a8-9fc3-f19125714364 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:48.510400 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9dd3e-fdbe-44a8-9fc3-f19125714364 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:48.512405 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9dd3e-fdbe-44a8-9fc3-f19125714364 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:48.534245 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 108/230] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:18:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:48.544857 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9dd3e-fdbe-44a8-9fc3-f19125714364 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:48.624556 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bcf1a-4a47-403a-99be-214068239563 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:48.670747 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c566111-d499-4d51-b253-04d78f4758d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:48.671684 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c566111-d499-4d51-b253-04d78f4758d9 None admin] REQUEST_METHOD: `PUT` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:48.671965 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c566111-d499-4d51-b253-04d78f4758d9 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:48.672240 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c566111-d499-4d51-b253-04d78f4758d9 None admin] PATH_INFO: `/v3/projects/46dbfbf04ba34604abb1879881e3e4d9/users/f2ef37efc685484c85d31139dac006a9/roles/9aaa841361294b9c9b275ca1be0ed89c` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:48.676179 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c566111-d499-4d51-b253-04d78f4758d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=46dbfbf04ba34604abb1879881e3e4d9, user_id=f2ef37efc685484c85d31139dac006a9, role_id=9aaa841361294b9c9b275ca1be0ed89c)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:48.679955 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c566111-d499-4d51-b253-04d78f4758d9 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:48.713346 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 123/231] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:18:48 2022] PUT /identity/v3/projects/46dbfbf04ba34604abb1879881e3e4d9/users/f2ef37efc685484c85d31139dac006a9/roles/9aaa841361294b9c9b275ca1be0ed89c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:18:48.751301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9dd3e-fdbe-44a8-9fc3-f19125714364 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:48.794684 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34e671-f330-4e8b-b313-36bd772ed4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:48.796096 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34e671-f330-4e8b-b313-36bd772ed4c8 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:48.796668 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34e671-f330-4e8b-b313-36bd772ed4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:48.797185 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34e671-f330-4e8b-b313-36bd772ed4c8 None admin] PATH_INFO: `/v3/users/f2ef37efc685484c85d31139dac006a9` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:48.798830 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f34e671-f330-4e8b-b313-36bd772ed4c8 None admin] RBAC: Authorizing `identity:get_user(user_id=f2ef37efc685484c85d31139dac006a9)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:48.800714 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f34e671-f330-4e8b-b313-36bd772ed4c8 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:48.802837 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 109/232] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:48 2022] GET /identity/v3/users/f2ef37efc685484c85d31139dac006a9 => generated 283 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:48.810198 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c566111-d499-4d51-b253-04d78f4758d9 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:48.946407 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c566111-d499-4d51-b253-04d78f4758d9 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:48.994626 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4a9d3-70aa-4ac5-a193-5ee1e4c44694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:48.995532 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4a9d3-70aa-4ac5-a193-5ee1e4c44694 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:48.995815 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4a9d3-70aa-4ac5-a193-5ee1e4c44694 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:48.996093 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4a9d3-70aa-4ac5-a193-5ee1e4c44694 None admin] PATH_INFO: `/v3/projects/46dbfbf04ba34604abb1879881e3e4d9` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:48.997447 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4a9d3-70aa-4ac5-a193-5ee1e4c44694 None admin] RBAC: Authorizing `identity:get_project(project_id=46dbfbf04ba34604abb1879881e3e4d9)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:48.998951 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4a9d3-70aa-4ac5-a193-5ee1e4c44694 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:49.000995 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 124/233] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:48 2022] GET /identity/v3/projects/46dbfbf04ba34604abb1879881e3e4d9 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:49.007195 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34e671-f330-4e8b-b313-36bd772ed4c8 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:49.123325 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34e671-f330-4e8b-b313-36bd772ed4c8 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:49.159671 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875a3c4-8a95-4323-aa10-2800cad897d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:49.160578 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875a3c4-8a95-4323-aa10-2800cad897d6 None admin] REQUEST_METHOD: `PUT` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:49.160867 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875a3c4-8a95-4323-aa10-2800cad897d6 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:49.161148 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875a3c4-8a95-4323-aa10-2800cad897d6 None admin] PATH_INFO: `/v3/projects/46dbfbf04ba34604abb1879881e3e4d9/users/f2ef37efc685484c85d31139dac006a9/roles/b624791ed6aa460fa31372c80cf5991d` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:49.164194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875a3c4-8a95-4323-aa10-2800cad897d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=46dbfbf04ba34604abb1879881e3e4d9, user_id=f2ef37efc685484c85d31139dac006a9, role_id=b624791ed6aa460fa31372c80cf5991d)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:49.165677 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875a3c4-8a95-4323-aa10-2800cad897d6 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:49.184007 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 110/234] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:18:49 2022] PUT /identity/v3/projects/46dbfbf04ba34604abb1879881e3e4d9/users/f2ef37efc685484c85d31139dac006a9/roles/b624791ed6aa460fa31372c80cf5991d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:18:50.128097 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484318e-4f70-4a0a-aa14-d166361f4e93 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:50.128682 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484318e-4f70-4a0a-aa14-d166361f4e93 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:50.128972 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484318e-4f70-4a0a-aa14-d166361f4e93 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:50.130861 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 125/235] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:50.148440 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2d185-84ab-40b6-8005-e21770b93d45 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:50.149128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2d185-84ab-40b6-8005-e21770b93d45 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:50.149128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2d185-84ab-40b6-8005-e21770b93d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:50.170678 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-05d2d185-84ab-40b6-8005-e21770b93d45 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:50.171923 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-05d2d185-84ab-40b6-8005-e21770b93d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:50.178690 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2d18f-367b-48a5-b975-8f94bb530beb None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:50.179011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2d18f-367b-48a5-b975-8f94bb530beb None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:50.179250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2d18f-367b-48a5-b975-8f94bb530beb None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:50.180925 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 126/236] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:50.186465 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64591f4d-c18c-43e5-9e17-08755a3b649d None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:50.186835 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64591f4d-c18c-43e5-9e17-08755a3b649d None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:50.187039 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64591f4d-c18c-43e5-9e17-08755a3b649d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:50.226514 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-64591f4d-c18c-43e5-9e17-08755a3b649d None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:50.227787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-64591f4d-c18c-43e5-9e17-08755a3b649d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:50.252370 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 111/237] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:50.299068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2d185-84ab-40b6-8005-e21770b93d45 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:50.323449 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 127/238] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:18:50.347027 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64591f4d-c18c-43e5-9e17-08755a3b649d None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:50.453445 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64591f4d-c18c-43e5-9e17-08755a3b649d None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:50.471938 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2d185-84ab-40b6-8005-e21770b93d45 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:50.490340 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7411ba-7be0-4f5c-992f-01d83e74e88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:50.491686 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7411ba-7be0-4f5c-992f-01d83e74e88f None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:50.491974 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7411ba-7be0-4f5c-992f-01d83e74e88f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:50.492250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7411ba-7be0-4f5c-992f-01d83e74e88f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:50.510847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc03442-8369-4b1d-9293-ab3b5c29ac20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:50.511668 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc03442-8369-4b1d-9293-ab3b5c29ac20 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:50.511950 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc03442-8369-4b1d-9293-ab3b5c29ac20 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:50.512338 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc03442-8369-4b1d-9293-ab3b5c29ac20 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:50.521829 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc03442-8369-4b1d-9293-ab3b5c29ac20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:50.521829 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc03442-8369-4b1d-9293-ab3b5c29ac20 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:50.521829 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 112/239] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:18:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:50.522194 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7411ba-7be0-4f5c-992f-01d83e74e88f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:50.525213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-0b7411ba-7be0-4f5c-992f-01d83e74e88f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:18:50.525213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:50.525213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:50.525213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:50.525213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:50.525213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:50.525213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:50.525213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:50.525213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:50.525213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:50.525213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:50.525213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:50.525213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:50.525213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:50.525213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:50.525213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:50.526279 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:50.526279 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:50.526279 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:50.526279 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:50.526279 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:50.526279 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:50.526279 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:50.526279 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:50.526279 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:50.526279 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:50.526279 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:50.526279 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:18:50.526279 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:50.526279 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:50.526279 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:50.526279 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:50.527205 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:50.527205 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:50.527205 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:50.527205 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:50.527205 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:50.527205 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:50.527205 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:50.527205 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:50.527205 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:50.527205 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:50.527205 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:18:50.527205 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:18:50.527205 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 128/240] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:18:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:50.529176 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc03442-8369-4b1d-9293-ab3b5c29ac20 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:50.536549 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7411ba-7be0-4f5c-992f-01d83e74e88f None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:50.704702 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7411ba-7be0-4f5c-992f-01d83e74e88f None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:50.755271 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81368f-68b1-4889-b8dd-fcbb3bfe3908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:50.756149 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81368f-68b1-4889-b8dd-fcbb3bfe3908 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:50.756501 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81368f-68b1-4889-b8dd-fcbb3bfe3908 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:50.756820 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81368f-68b1-4889-b8dd-fcbb3bfe3908 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:50.757684 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81368f-68b1-4889-b8dd-fcbb3bfe3908 None admin] RBAC: Adding query filter params (name=reader) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:50.758006 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81368f-68b1-4889-b8dd-fcbb3bfe3908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:50.760158 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81368f-68b1-4889-b8dd-fcbb3bfe3908 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:50.768127 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc03442-8369-4b1d-9293-ab3b5c29ac20 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:50.770148 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 129/241] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:18:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:50.789094 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81368f-68b1-4889-b8dd-fcbb3bfe3908 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:50.890155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fadb07-04dd-41dd-99de-32b8e29c4f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:50.890852 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fadb07-04dd-41dd-99de-32b8e29c4f66 None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:50.891138 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fadb07-04dd-41dd-99de-32b8e29c4f66 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:50.891419 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fadb07-04dd-41dd-99de-32b8e29c4f66 None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:50.892150 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fadb07-04dd-41dd-99de-32b8e29c4f66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:50.893660 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fadb07-04dd-41dd-99de-32b8e29c4f66 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:50.916671 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81368f-68b1-4889-b8dd-fcbb3bfe3908 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:50.933239 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 113/242] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:18:50 2022] POST /identity/v3/users => generated 293 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:18:50.965772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5aeb03-2ddb-4eec-91b1-5a118ba3af6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:50.966728 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5aeb03-2ddb-4eec-91b1-5a118ba3af6e None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:50.967115 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5aeb03-2ddb-4eec-91b1-5a118ba3af6e None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:50.967428 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5aeb03-2ddb-4eec-91b1-5a118ba3af6e None admin] PATH_INFO: `/v3/users/f8967691639d41f38d496bb1ec885a41` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:50.997798 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5aeb03-2ddb-4eec-91b1-5a118ba3af6e None admin] RBAC: Authorizing `identity:get_user(user_id=f8967691639d41f38d496bb1ec885a41)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:50.999598 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5aeb03-2ddb-4eec-91b1-5a118ba3af6e None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:51.001923 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 130/243] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:50 2022] GET /identity/v3/users/f8967691639d41f38d496bb1ec885a41 => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:51.008051 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fadb07-04dd-41dd-99de-32b8e29c4f66 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:51.201550 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fadb07-04dd-41dd-99de-32b8e29c4f66 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:51.247814 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c350fc-2da0-41b2-b1cd-e697a956ec4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:51.248415 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c350fc-2da0-41b2-b1cd-e697a956ec4a None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:51.248722 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c350fc-2da0-41b2-b1cd-e697a956ec4a None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:51.249043 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c350fc-2da0-41b2-b1cd-e697a956ec4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:51.327597 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c350fc-2da0-41b2-b1cd-e697a956ec4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:51.329094 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c350fc-2da0-41b2-b1cd-e697a956ec4a None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:51.403574 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ae46a-c8f7-4d10-ac09-1d1a460e5f39 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:51.404097 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ae46a-c8f7-4d10-ac09-1d1a460e5f39 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:51.404206 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ae46a-c8f7-4d10-ac09-1d1a460e5f39 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:51.405573 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 131/244] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:51.411466 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8700a3-a6ce-42fa-b5c6-285c0aa57f28 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:51.411765 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8700a3-a6ce-42fa-b5c6-285c0aa57f28 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:51.412041 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8700a3-a6ce-42fa-b5c6-285c0aa57f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:51.442463 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-9a8700a3-a6ce-42fa-b5c6-285c0aa57f28 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:51.443756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-9a8700a3-a6ce-42fa-b5c6-285c0aa57f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:51.464553 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 114/245] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:18:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:18:51.476483 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c350fc-2da0-41b2-b1cd-e697a956ec4a None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:51.582367 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 132/246] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:51.607527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8700a3-a6ce-42fa-b5c6-285c0aa57f28 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:51.652254 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c350fc-2da0-41b2-b1cd-e697a956ec4a None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:51.703739 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af6238-72f8-4b82-93d1-07c8eb2829e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:51.704645 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af6238-72f8-4b82-93d1-07c8eb2829e1 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:51.704933 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af6238-72f8-4b82-93d1-07c8eb2829e1 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:51.705216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af6238-72f8-4b82-93d1-07c8eb2829e1 None admin] PATH_INFO: `/v3/projects/46dbfbf04ba34604abb1879881e3e4d9` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:51.706636 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af6238-72f8-4b82-93d1-07c8eb2829e1 None admin] RBAC: Authorizing `identity:get_project(project_id=46dbfbf04ba34604abb1879881e3e4d9)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:51.708114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af6238-72f8-4b82-93d1-07c8eb2829e1 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:51.711690 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 115/247] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:51 2022] GET /identity/v3/projects/46dbfbf04ba34604abb1879881e3e4d9 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:51.719598 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af6238-72f8-4b82-93d1-07c8eb2829e1 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:51.778262 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8700a3-a6ce-42fa-b5c6-285c0aa57f28 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:51.842635 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a57021-6c23-42b3-a8c5-b6ba2354f74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:51.843871 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a57021-6c23-42b3-a8c5-b6ba2354f74d None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:51.844332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a57021-6c23-42b3-a8c5-b6ba2354f74d None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:51.844672 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a57021-6c23-42b3-a8c5-b6ba2354f74d None admin] PATH_INFO: `/v3/roles/member` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:51.864791 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a57021-6c23-42b3-a8c5-b6ba2354f74d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:51.869884 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af6238-72f8-4b82-93d1-07c8eb2829e1 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:51.878950 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-49a57021-6c23-42b3-a8c5-b6ba2354f74d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:18:51.878950 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:51.878950 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:51.878950 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:51.878950 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:51.878950 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:51.878950 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:51.878950 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:51.878950 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:51.878950 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:51.878950 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:51.878950 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:51.878950 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:51.878950 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:51.878950 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:51.878950 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:51.880069 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:51.880069 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:51.880069 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:51.880069 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:51.880069 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:51.880069 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:51.880069 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:51.880069 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:51.880069 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:51.880069 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:51.880069 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:51.880069 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:18:51.880069 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:51.880069 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:51.880069 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:51.880069 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:51.881178 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:51.881178 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:51.881178 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:51.881178 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:51.881178 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:51.881178 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:51.881178 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:51.881178 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:51.881178 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:51.881178 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:51.881178 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:18:51.881178 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:18:51.881178 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 133/248] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:18:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:18:51.889615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a57021-6c23-42b3-a8c5-b6ba2354f74d None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:51.920168 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97232288-26ee-4dd6-a38a-44ca92cad5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:51.920921 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97232288-26ee-4dd6-a38a-44ca92cad5d1 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:51.921218 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97232288-26ee-4dd6-a38a-44ca92cad5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:51.921584 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97232288-26ee-4dd6-a38a-44ca92cad5d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:51.922465 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97232288-26ee-4dd6-a38a-44ca92cad5d1 None admin] RBAC: Adding query filter params (role.id=1cf9a76305b6469cb57c1115c9cb198b, scope.project.id=46dbfbf04ba34604abb1879881e3e4d9, user.id=f8967691639d41f38d496bb1ec885a41) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:51.922788 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97232288-26ee-4dd6-a38a-44ca92cad5d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:51.924271 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97232288-26ee-4dd6-a38a-44ca92cad5d1 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:51.931388 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 116/249] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:18:51 2022] GET /identity/v3/role_assignments?user.id=f8967691639d41f38d496bb1ec885a41&scope.project.id=46dbfbf04ba34604abb1879881e3e4d9&role.id=1cf9a76305b6469cb57c1115c9cb198b => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:51.949205 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e82fc-0e8b-48fd-97d2-69425472abe6 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:51.949550 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e82fc-0e8b-48fd-97d2-69425472abe6 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:51.949818 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e82fc-0e8b-48fd-97d2-69425472abe6 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:51.951406 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 117/250] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:18:51.956973 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea11bb0-ba55-4069-bdfa-dc2421516f51 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:51.957708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea11bb0-ba55-4069-bdfa-dc2421516f51 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:51.958332 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea11bb0-ba55-4069-bdfa-dc2421516f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:51.994228 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-6ea11bb0-ba55-4069-bdfa-dc2421516f51 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:51.995996 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-6ea11bb0-ba55-4069-bdfa-dc2421516f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:52.071190 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a57021-6c23-42b3-a8c5-b6ba2354f74d None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:52.137493 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d651c-8a14-4172-a305-77e0a0d63f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:52.137493 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d651c-8a14-4172-a305-77e0a0d63f1a None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:52.137493 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d651c-8a14-4172-a305-77e0a0d63f1a None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:52.137493 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d651c-8a14-4172-a305-77e0a0d63f1a None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:52.137926 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d651c-8a14-4172-a305-77e0a0d63f1a None admin] RBAC: Adding query filter params (name=member) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:52.138460 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d651c-8a14-4172-a305-77e0a0d63f1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:52.140977 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d651c-8a14-4172-a305-77e0a0d63f1a None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:52.161725 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 134/251] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:18:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:52.167255 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d651c-8a14-4172-a305-77e0a0d63f1a None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:52.170187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 118/252] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:52.211300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea11bb0-ba55-4069-bdfa-dc2421516f51 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:52.362459 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d651c-8a14-4172-a305-77e0a0d63f1a None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:52.430191 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a46d9f-575f-4800-9c89-c824553bdb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:52.431641 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a46d9f-575f-4800-9c89-c824553bdb0c None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:52.432136 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a46d9f-575f-4800-9c89-c824553bdb0c None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:52.432593 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a46d9f-575f-4800-9c89-c824553bdb0c None admin] PATH_INFO: `/v3/users/179bca7a106d4b99b6622e2fff115835` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:52.434936 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a46d9f-575f-4800-9c89-c824553bdb0c None admin] RBAC: Authorizing `identity:get_user(user_id=179bca7a106d4b99b6622e2fff115835)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:52.437736 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a46d9f-575f-4800-9c89-c824553bdb0c None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:52.441563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 135/253] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:52 2022] GET /identity/v3/users/179bca7a106d4b99b6622e2fff115835 => generated 297 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:52.451396 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a46d9f-575f-4800-9c89-c824553bdb0c None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:52.460456 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea11bb0-ba55-4069-bdfa-dc2421516f51 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:52.526842 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9bbb1-8f18-4e81-98c6-5817f8e4850a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:52.533569 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9bbb1-8f18-4e81-98c6-5817f8e4850a None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:52.534187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9bbb1-8f18-4e81-98c6-5817f8e4850a None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:52.534665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9bbb1-8f18-4e81-98c6-5817f8e4850a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:52.558611 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9bbb1-8f18-4e81-98c6-5817f8e4850a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:52.571246 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-9df9bbb1-8f18-4e81-98c6-5817f8e4850a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:18:52.571246 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:52.571246 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:52.571246 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:52.571246 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:52.571246 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:52.571246 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:52.571246 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:52.571246 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:52.571246 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:52.571246 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:52.571246 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:52.571246 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:52.571246 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:52.571246 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:52.571246 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:52.572404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:52.572404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:52.572404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:52.572404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:52.572404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:52.572404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:52.572404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:52.572404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:52.572404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:52.572404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:52.572404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:52.572404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:18:52.572404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:52.572404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:52.572404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:52.572404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:52.573518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:52.573518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:52.573518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:52.573518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:52.573518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:52.573518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:52.573518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:52.573518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:52.573518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:52.573518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:52.573518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:18:52.573518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:18:52.576565 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 119/254] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:18:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:52.586515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9bbb1-8f18-4e81-98c6-5817f8e4850a None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:52.615250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a46d9f-575f-4800-9c89-c824553bdb0c None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:52.653317 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a2cb6-a242-4728-8a90-6db7baea6d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:52.654245 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a2cb6-a242-4728-8a90-6db7baea6d7d None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:52.654670 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a2cb6-a242-4728-8a90-6db7baea6d7d None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:52.654924 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a2cb6-a242-4728-8a90-6db7baea6d7d None admin] PATH_INFO: `/v3/projects/46dbfbf04ba34604abb1879881e3e4d9` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:52.656281 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a2cb6-a242-4728-8a90-6db7baea6d7d None admin] RBAC: Authorizing `identity:get_project(project_id=46dbfbf04ba34604abb1879881e3e4d9)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:52.658002 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a2cb6-a242-4728-8a90-6db7baea6d7d None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:52.660221 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 136/255] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:52 2022] GET /identity/v3/projects/46dbfbf04ba34604abb1879881e3e4d9 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:52.665756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b1c0d-41ec-48b4-9d27-2026a2d02a75 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:52.666207 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b1c0d-41ec-48b4-9d27-2026a2d02a75 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:52.666588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b1c0d-41ec-48b4-9d27-2026a2d02a75 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:52.668333 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 137/256] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:52.670664 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b1c0d-41ec-48b4-9d27-2026a2d02a75 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:52.708561 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9bbb1-8f18-4e81-98c6-5817f8e4850a None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:52.755173 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8128fe4-84db-420c-930c-8ac3dfb0976d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:52.756852 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8128fe4-84db-420c-930c-8ac3dfb0976d None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:52.757956 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8128fe4-84db-420c-930c-8ac3dfb0976d None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:52.760194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8128fe4-84db-420c-930c-8ac3dfb0976d None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:52.761418 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8128fe4-84db-420c-930c-8ac3dfb0976d None admin] RBAC: Adding query filter params (name=admin) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:52.762944 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8128fe4-84db-420c-930c-8ac3dfb0976d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:52.765633 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8128fe4-84db-420c-930c-8ac3dfb0976d None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:52.785421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 120/257] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:18:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:52.788802 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789cb28f-16a1-4ec2-97c2-b427965ab5a5 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:52.790267 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789cb28f-16a1-4ec2-97c2-b427965ab5a5 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:52.792681 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789cb28f-16a1-4ec2-97c2-b427965ab5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:52.832198 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-789cb28f-16a1-4ec2-97c2-b427965ab5a5 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:52.835788 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-789cb28f-16a1-4ec2-97c2-b427965ab5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:52.906239 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b1c0d-41ec-48b4-9d27-2026a2d02a75 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:52.926847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 121/258] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:52.927786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789cb28f-16a1-4ec2-97c2-b427965ab5a5 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:52.985988 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a129d4-ef86-4687-8aad-999599a0547e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:52.988182 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a129d4-ef86-4687-8aad-999599a0547e None admin] REQUEST_METHOD: `PUT` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:52.988722 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a129d4-ef86-4687-8aad-999599a0547e None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:52.989504 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a129d4-ef86-4687-8aad-999599a0547e None admin] PATH_INFO: `/v3/projects/46dbfbf04ba34604abb1879881e3e4d9/users/179bca7a106d4b99b6622e2fff115835/roles/a65ce6e645574561bb50ce9148d0637a` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:53.000288 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a129d4-ef86-4687-8aad-999599a0547e None admin] RBAC: Authorizing `identity:create_grant(project_id=46dbfbf04ba34604abb1879881e3e4d9, user_id=179bca7a106d4b99b6622e2fff115835, role_id=a65ce6e645574561bb50ce9148d0637a)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:53.003040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a129d4-ef86-4687-8aad-999599a0547e None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:53.026958 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 138/259] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:18:52 2022] PUT /identity/v3/projects/46dbfbf04ba34604abb1879881e3e4d9/users/179bca7a106d4b99b6622e2fff115835/roles/a65ce6e645574561bb50ce9148d0637a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:18:53.028245 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a129d4-ef86-4687-8aad-999599a0547e None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:53.141973 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789cb28f-16a1-4ec2-97c2-b427965ab5a5 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:53.226680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ab061-02bf-4ae1-8559-7ab5cc0651fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:53.228459 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ab061-02bf-4ae1-8559-7ab5cc0651fd None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:53.229744 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ab061-02bf-4ae1-8559-7ab5cc0651fd None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:53.230300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ab061-02bf-4ae1-8559-7ab5cc0651fd None admin] PATH_INFO: `/v3/users/f2ef37efc685484c85d31139dac006a9` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:53.233530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ab061-02bf-4ae1-8559-7ab5cc0651fd None admin] RBAC: Authorizing `identity:get_user(user_id=f2ef37efc685484c85d31139dac006a9)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:53.235156 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a129d4-ef86-4687-8aad-999599a0547e None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:53.237223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ab061-02bf-4ae1-8559-7ab5cc0651fd None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:53.243834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 122/260] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:52 2022] GET /identity/v3/users/f2ef37efc685484c85d31139dac006a9 => generated 283 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:53.250367 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ab061-02bf-4ae1-8559-7ab5cc0651fd None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:53.327927 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209212d8-3324-48e0-8d10-0b09d24de6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:53.328803 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209212d8-3324-48e0-8d10-0b09d24de6f9 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:53.329087 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209212d8-3324-48e0-8d10-0b09d24de6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:53.329386 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209212d8-3324-48e0-8d10-0b09d24de6f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:53.374480 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209212d8-3324-48e0-8d10-0b09d24de6f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:53.387615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-209212d8-3324-48e0-8d10-0b09d24de6f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:18:53.387615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:53.387615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:53.387615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:53.387615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:53.387615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:53.387615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:53.387615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:53.387615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:53.387615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:53.387615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:53.387615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:53.387615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:53.387615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:53.387615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:53.387615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:53.389200 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:53.389200 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:53.389200 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:53.389200 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:53.389200 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:53.389200 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:53.389200 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:53.389200 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:53.389200 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:53.389200 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:53.389200 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:53.389200 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:18:53.389200 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:53.389200 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:53.389200 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:53.389200 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:53.390352 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:53.390352 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:53.390352 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:53.390352 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:53.390352 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:53.390352 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:53.390352 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:53.390352 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:53.390352 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:53.390352 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:53.390352 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:18:53.390352 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:18:53.390352 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 139/261] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:18:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:53.395089 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209212d8-3324-48e0-8d10-0b09d24de6f9 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:53.406458 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ab061-02bf-4ae1-8559-7ab5cc0651fd None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:53.465912 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc0f21-b504-4080-93fd-6119e012528e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:53.468342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc0f21-b504-4080-93fd-6119e012528e None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:53.468908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc0f21-b504-4080-93fd-6119e012528e None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:53.469680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc0f21-b504-4080-93fd-6119e012528e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:53.612557 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209212d8-3324-48e0-8d10-0b09d24de6f9 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:53.673957 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc0f21-b504-4080-93fd-6119e012528e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:53.675608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc0f21-b504-4080-93fd-6119e012528e None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:53.726346 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6f697-d526-43a9-9c6a-8caab2a61264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:53.727466 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6f697-d526-43a9-9c6a-8caab2a61264 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:53.727980 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6f697-d526-43a9-9c6a-8caab2a61264 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:53.728501 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6f697-d526-43a9-9c6a-8caab2a61264 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:53.729572 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6f697-d526-43a9-9c6a-8caab2a61264 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:53.731281 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6f697-d526-43a9-9c6a-8caab2a61264 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:53.734581 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6f697-d526-43a9-9c6a-8caab2a61264 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:53.762538 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 140/262] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:18:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:53.767888 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6f697-d526-43a9-9c6a-8caab2a61264 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:53.866498 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 123/263] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:18:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:18:53.874520 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc0f21-b504-4080-93fd-6119e012528e None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:53.996905 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6f697-d526-43a9-9c6a-8caab2a61264 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:54.057108 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc0f21-b504-4080-93fd-6119e012528e None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:54.059146 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31308f03-34b7-4c47-991f-fe8309ea03aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:54.060088 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31308f03-34b7-4c47-991f-fe8309ea03aa None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:54.060370 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31308f03-34b7-4c47-991f-fe8309ea03aa None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:54.060685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31308f03-34b7-4c47-991f-fe8309ea03aa None admin] PATH_INFO: `/v3/users/f2ef37efc685484c85d31139dac006a9` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:54.066278 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31308f03-34b7-4c47-991f-fe8309ea03aa None admin] RBAC: Authorizing `identity:get_user(user_id=f2ef37efc685484c85d31139dac006a9)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:54.067777 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31308f03-34b7-4c47-991f-fe8309ea03aa None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:54.070704 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 141/264] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:53 2022] GET /identity/v3/users/f2ef37efc685484c85d31139dac006a9 => generated 283 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:54.076377 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31308f03-34b7-4c47-991f-fe8309ea03aa None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:54.119418 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1162f-eaaa-4033-9929-39d7415a5eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:54.121447 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1162f-eaaa-4033-9929-39d7415a5eee None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:54.122388 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1162f-eaaa-4033-9929-39d7415a5eee None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:54.123192 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1162f-eaaa-4033-9929-39d7415a5eee None admin] PATH_INFO: `/v3/projects/46dbfbf04ba34604abb1879881e3e4d9` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:54.130601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1162f-eaaa-4033-9929-39d7415a5eee None admin] RBAC: Authorizing `identity:get_project(project_id=46dbfbf04ba34604abb1879881e3e4d9)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:54.134182 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1162f-eaaa-4033-9929-39d7415a5eee None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:54.136811 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 124/265] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:53 2022] GET /identity/v3/projects/46dbfbf04ba34604abb1879881e3e4d9 => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:54.142341 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1162f-eaaa-4033-9929-39d7415a5eee None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:54.216516 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31308f03-34b7-4c47-991f-fe8309ea03aa None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:54.266166 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12caeb73-d299-4d59-bc1f-fcfb977aae14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:54.267010 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12caeb73-d299-4d59-bc1f-fcfb977aae14 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:54.267152 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12caeb73-d299-4d59-bc1f-fcfb977aae14 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:54.267412 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12caeb73-d299-4d59-bc1f-fcfb977aae14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:54.292924 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1162f-eaaa-4033-9929-39d7415a5eee None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:54.339823 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307b104-f1cc-491e-8dff-483acc04d129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:54.341066 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307b104-f1cc-491e-8dff-483acc04d129 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:54.341687 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307b104-f1cc-491e-8dff-483acc04d129 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:54.342275 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307b104-f1cc-491e-8dff-483acc04d129 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:54.343436 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307b104-f1cc-491e-8dff-483acc04d129 None admin] RBAC: Adding query filter params (role.id=9aaa841361294b9c9b275ca1be0ed89c, scope.project.id=46dbfbf04ba34604abb1879881e3e4d9, user.id=f2ef37efc685484c85d31139dac006a9) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:54.344074 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307b104-f1cc-491e-8dff-483acc04d129 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:54.345850 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307b104-f1cc-491e-8dff-483acc04d129 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:54.361242 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12caeb73-d299-4d59-bc1f-fcfb977aae14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:54.362760 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12caeb73-d299-4d59-bc1f-fcfb977aae14 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:54.373218 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 125/266] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:18:54 2022] GET /identity/v3/role_assignments?user.id=f2ef37efc685484c85d31139dac006a9&scope.project.id=46dbfbf04ba34604abb1879881e3e4d9&role.id=9aaa841361294b9c9b275ca1be0ed89c => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:54.486568 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 142/267] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:18:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:18:54.494176 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307b104-f1cc-491e-8dff-483acc04d129 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:54.717121 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307b104-f1cc-491e-8dff-483acc04d129 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:54.777861 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f61004-0ca0-444e-9a85-b042ff69cd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:54.779555 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f61004-0ca0-444e-9a85-b042ff69cd51 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:54.780000 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f61004-0ca0-444e-9a85-b042ff69cd51 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:54.780424 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f61004-0ca0-444e-9a85-b042ff69cd51 None admin] PATH_INFO: `/v3/projects/46dbfbf04ba34604abb1879881e3e4d9` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:54.786643 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f61004-0ca0-444e-9a85-b042ff69cd51 None admin] RBAC: Authorizing `identity:get_project(project_id=46dbfbf04ba34604abb1879881e3e4d9)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:54.789702 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f61004-0ca0-444e-9a85-b042ff69cd51 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:54.793018 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 126/268] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:54 2022] GET /identity/v3/projects/46dbfbf04ba34604abb1879881e3e4d9 => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:54.801229 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12caeb73-d299-4d59-bc1f-fcfb977aae14 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:55.031637 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12caeb73-d299-4d59-bc1f-fcfb977aae14 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:55.099090 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c6a1c-1028-4616-bae4-094a832ecb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:55.100630 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c6a1c-1028-4616-bae4-094a832ecb03 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:55.100833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c6a1c-1028-4616-bae4-094a832ecb03 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:55.101302 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c6a1c-1028-4616-bae4-094a832ecb03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:55.103034 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c6a1c-1028-4616-bae4-094a832ecb03 None admin] RBAC: Adding query filter params (role.id=b624791ed6aa460fa31372c80cf5991d, scope.project.id=46dbfbf04ba34604abb1879881e3e4d9, user.id=f2ef37efc685484c85d31139dac006a9) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:55.103617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c6a1c-1028-4616-bae4-094a832ecb03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:55.106388 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c6a1c-1028-4616-bae4-094a832ecb03 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:55.123783 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 143/269] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:18:54 2022] GET /identity/v3/role_assignments?user.id=f2ef37efc685484c85d31139dac006a9&scope.project.id=46dbfbf04ba34604abb1879881e3e4d9&role.id=b624791ed6aa460fa31372c80cf5991d => generated 608 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:55.374662 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43383c7-cf8a-4bae-9fa2-d5692768947e None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:55.375707 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43383c7-cf8a-4bae-9fa2-d5692768947e None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:55.376225 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43383c7-cf8a-4bae-9fa2-d5692768947e None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:55.378328 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 127/270] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:55.385740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9526c4-a843-48b1-ab65-a6a62b8ddfc7 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:55.386200 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9526c4-a843-48b1-ab65-a6a62b8ddfc7 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:55.386647 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9526c4-a843-48b1-ab65-a6a62b8ddfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:55.422991 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-3a9526c4-a843-48b1-ab65-a6a62b8ddfc7 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:55.424673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-3a9526c4-a843-48b1-ab65-a6a62b8ddfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:55.556367 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 144/271] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:55.585663 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43383c7-cf8a-4bae-9fa2-d5692768947e None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:55.658611 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebbcd3-1cac-4746-8715-0b724abc3c08 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:55.658813 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebbcd3-1cac-4746-8715-0b724abc3c08 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:55.659109 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebbcd3-1cac-4746-8715-0b724abc3c08 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:55.660580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 145/272] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:55.667548 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270285c-880d-43f9-914a-cdab55573ea3 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:55.667837 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270285c-880d-43f9-914a-cdab55573ea3 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:55.668120 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270285c-880d-43f9-914a-cdab55573ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:55.699407 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-b270285c-880d-43f9-914a-cdab55573ea3 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:55.700921 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-b270285c-880d-43f9-914a-cdab55573ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:55.739661 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43383c7-cf8a-4bae-9fa2-d5692768947e None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:55.779822 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b570bc-df8f-44d7-924e-3617af5bb71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:55.780643 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b570bc-df8f-44d7-924e-3617af5bb71f None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:55.780930 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b570bc-df8f-44d7-924e-3617af5bb71f None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:55.781209 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b570bc-df8f-44d7-924e-3617af5bb71f None admin] PATH_INFO: `/v3/domains/default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:55.782603 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b570bc-df8f-44d7-924e-3617af5bb71f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:55.784173 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b570bc-df8f-44d7-924e-3617af5bb71f None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:55.786257 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 128/273] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:18:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:55.787534 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33278d5-e497-4b65-ac14-f0a9a6c12d57 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:55.787890 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33278d5-e497-4b65-ac14-f0a9a6c12d57 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:55.788202 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33278d5-e497-4b65-ac14-f0a9a6c12d57 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:55.789836 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 129/274] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:55.795059 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33278d5-e497-4b65-ac14-f0a9a6c12d57 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:55.796298 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 146/275] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:18:55.801547 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a51bc4-7dfd-458d-a54a-1dca5825b071 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:55.801547 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a51bc4-7dfd-458d-a54a-1dca5825b071 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:55.801547 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a51bc4-7dfd-458d-a54a-1dca5825b071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:55.826110 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-38a51bc4-7dfd-458d-a54a-1dca5825b071 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:55.827432 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-38a51bc4-7dfd-458d-a54a-1dca5825b071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:55.901785 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 147/276] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:55.902712 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a51bc4-7dfd-458d-a54a-1dca5825b071 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:55.924142 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33278d5-e497-4b65-ac14-f0a9a6c12d57 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:55.966195 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928919a0-54b4-4a41-834b-1e6a6c1e2588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:55.966888 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928919a0-54b4-4a41-834b-1e6a6c1e2588 None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:55.967173 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928919a0-54b4-4a41-834b-1e6a6c1e2588 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:55.967452 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928919a0-54b4-4a41-834b-1e6a6c1e2588 None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:55.968198 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928919a0-54b4-4a41-834b-1e6a6c1e2588 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:55.969725 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928919a0-54b4-4a41-834b-1e6a6c1e2588 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:56.001415 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 130/277] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:18:55 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:18:56.001415 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928919a0-54b4-4a41-834b-1e6a6c1e2588 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:56.036571 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a51bc4-7dfd-458d-a54a-1dca5825b071 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:56.077851 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2d0f0-0061-4a3c-add3-ae532d888d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:56.079120 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2d0f0-0061-4a3c-add3-ae532d888d84 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:56.079622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2d0f0-0061-4a3c-add3-ae532d888d84 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:56.080294 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2d0f0-0061-4a3c-add3-ae532d888d84 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:56.093632 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2d0f0-0061-4a3c-add3-ae532d888d84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:56.103108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-e6d2d0f0-0061-4a3c-add3-ae532d888d84 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:18:56.103108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:56.103108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:56.103108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:56.103108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:56.103108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:56.103108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:56.103108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:56.103108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:56.103108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:56.103108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:56.103108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:56.103108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:56.103108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:56.103108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:56.103108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:56.104232 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:56.104232 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:56.104232 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:56.104232 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:56.104232 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:56.104232 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:56.104232 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:56.104232 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:56.104232 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:56.104232 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:56.104232 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:56.104232 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:18:56.104232 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:56.104232 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:56.104232 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:56.104232 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:56.105172 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:56.105172 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:56.105172 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:56.105172 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:56.105172 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:56.105172 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:56.105172 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:56.105172 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:56.105172 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:56.105172 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:56.105172 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:18:56.105172 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:18:56.107910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 148/278] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:18:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:56.115435 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2d0f0-0061-4a3c-add3-ae532d888d84 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:56.125266 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928919a0-54b4-4a41-834b-1e6a6c1e2588 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:56.165773 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b54d18-ef05-4c1d-b49c-b1814dd09689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:56.166626 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b54d18-ef05-4c1d-b49c-b1814dd09689 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:56.166915 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b54d18-ef05-4c1d-b49c-b1814dd09689 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:56.167197 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b54d18-ef05-4c1d-b49c-b1814dd09689 None admin] PATH_INFO: `/v3/roles/member` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:56.180191 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b54d18-ef05-4c1d-b49c-b1814dd09689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:56.188137 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-49b54d18-ef05-4c1d-b49c-b1814dd09689 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:18:56.188137 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:56.188137 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:56.188137 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:56.188137 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:56.188137 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:56.188137 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:56.188137 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:56.188137 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:56.188137 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:56.188137 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:56.188137 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:56.188137 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:56.188137 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:56.188137 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:56.188137 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:56.189315 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:56.189315 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:56.189315 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:56.189315 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:56.189315 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:56.189315 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:56.189315 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:56.189315 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:56.189315 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:56.189315 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:56.189315 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:56.189315 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:18:56.189315 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:56.189315 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:56.189315 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:56.189315 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:56.190289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:56.190289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:56.190289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:56.190289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:56.190289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:56.190289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:56.190289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:56.190289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:56.190289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:56.190289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:56.190289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:18:56.190289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:18:56.194581 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 131/279] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:18:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:18:56.196116 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b54d18-ef05-4c1d-b49c-b1814dd09689 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:56.254195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2d0f0-0061-4a3c-add3-ae532d888d84 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:56.314085 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e101e3-73a3-4d28-a0da-8617af7aa4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:56.315141 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e101e3-73a3-4d28-a0da-8617af7aa4b5 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:56.315598 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e101e3-73a3-4d28-a0da-8617af7aa4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:56.316088 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e101e3-73a3-4d28-a0da-8617af7aa4b5 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:56.317467 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e101e3-73a3-4d28-a0da-8617af7aa4b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:56.318869 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e101e3-73a3-4d28-a0da-8617af7aa4b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:56.321319 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e101e3-73a3-4d28-a0da-8617af7aa4b5 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:56.338978 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 149/280] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:18:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:56.352008 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e101e3-73a3-4d28-a0da-8617af7aa4b5 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:56.363145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b54d18-ef05-4c1d-b49c-b1814dd09689 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:56.415556 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60efd5e-e536-4583-b282-769a7e9afa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:56.416686 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60efd5e-e536-4583-b282-769a7e9afa8b None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:56.417019 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60efd5e-e536-4583-b282-769a7e9afa8b None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:56.417549 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60efd5e-e536-4583-b282-769a7e9afa8b None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:56.418740 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60efd5e-e536-4583-b282-769a7e9afa8b None admin] RBAC: Adding query filter params (name=member) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:56.419133 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60efd5e-e536-4583-b282-769a7e9afa8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:56.420947 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60efd5e-e536-4583-b282-769a7e9afa8b None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:56.439000 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 132/281] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:18:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:56.445950 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60efd5e-e536-4583-b282-769a7e9afa8b None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:56.511943 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e101e3-73a3-4d28-a0da-8617af7aa4b5 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:56.571606 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60efd5e-e536-4583-b282-769a7e9afa8b None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:56.572690 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bece8c2-e530-460c-8dde-e89e63b76f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:56.574043 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bece8c2-e530-460c-8dde-e89e63b76f27 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:56.574420 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bece8c2-e530-460c-8dde-e89e63b76f27 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:56.574862 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bece8c2-e530-460c-8dde-e89e63b76f27 None admin] PATH_INFO: `/v3/users/f8967691639d41f38d496bb1ec885a41` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:56.576357 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bece8c2-e530-460c-8dde-e89e63b76f27 None admin] RBAC: Authorizing `identity:get_user(user_id=f8967691639d41f38d496bb1ec885a41)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:56.578748 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bece8c2-e530-460c-8dde-e89e63b76f27 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:56.580482 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 150/282] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:56 2022] GET /identity/v3/users/f8967691639d41f38d496bb1ec885a41 => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:56.586978 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bece8c2-e530-460c-8dde-e89e63b76f27 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:56.631617 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a3729-06f7-4258-83fa-485c098a922a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:56.633402 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a3729-06f7-4258-83fa-485c098a922a None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:56.633906 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a3729-06f7-4258-83fa-485c098a922a None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:56.634396 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a3729-06f7-4258-83fa-485c098a922a None admin] PATH_INFO: `/v3/users/d16f99fb8e614249a15c0c23fc1eaafe` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:56.670738 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a3729-06f7-4258-83fa-485c098a922a None admin] RBAC: Authorizing `identity:get_user(user_id=d16f99fb8e614249a15c0c23fc1eaafe)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:56.673260 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a3729-06f7-4258-83fa-485c098a922a None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:56.680627 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 133/283] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:56 2022] GET /identity/v3/users/d16f99fb8e614249a15c0c23fc1eaafe => generated 293 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:56.687009 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a3729-06f7-4258-83fa-485c098a922a None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:56.737954 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bece8c2-e530-460c-8dde-e89e63b76f27 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:56.843034 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbcbcf-dbc7-4ad0-90d6-68a0a365c9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:56.844152 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbcbcf-dbc7-4ad0-90d6-68a0a365c9ab None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:56.844534 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbcbcf-dbc7-4ad0-90d6-68a0a365c9ab None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:56.844912 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbcbcf-dbc7-4ad0-90d6-68a0a365c9ab None admin] PATH_INFO: `/v3/projects/46dbfbf04ba34604abb1879881e3e4d9` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:56.846445 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbcbcf-dbc7-4ad0-90d6-68a0a365c9ab None admin] RBAC: Authorizing `identity:get_project(project_id=46dbfbf04ba34604abb1879881e3e4d9)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:56.848321 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cbcbcf-dbc7-4ad0-90d6-68a0a365c9ab None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:56.857260 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 151/284] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:56 2022] GET /identity/v3/projects/46dbfbf04ba34604abb1879881e3e4d9 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:56.863154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbcbcf-dbc7-4ad0-90d6-68a0a365c9ab None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:56.884818 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a3729-06f7-4258-83fa-485c098a922a None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:56.941125 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d2c9e-7ae8-4201-a168-ff59cef7b26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:56.942038 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d2c9e-7ae8-4201-a168-ff59cef7b26c None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:56.942491 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d2c9e-7ae8-4201-a168-ff59cef7b26c None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:56.942778 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d2c9e-7ae8-4201-a168-ff59cef7b26c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:56.944518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d2c9e-7ae8-4201-a168-ff59cef7b26c None admin] RBAC: Adding query filter params (role.id=a65ce6e645574561bb50ce9148d0637a, user.id=d16f99fb8e614249a15c0c23fc1eaafe, scope.system=all) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:56.944747 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d2c9e-7ae8-4201-a168-ff59cef7b26c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:56.947323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d2c9e-7ae8-4201-a168-ff59cef7b26c None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:56.956261 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 134/285] 10.222.0.48 () {56 vars in 1308 bytes} [Mon May 9 15:18:56 2022] GET /identity/v3/role_assignments?user.id=d16f99fb8e614249a15c0c23fc1eaafe&scope.system=all&role.id=a65ce6e645574561bb50ce9148d0637a => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:18:56.958488 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997066c-32b8-4e6a-9149-afca13483aa4 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:56.959476 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997066c-32b8-4e6a-9149-afca13483aa4 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:56.960073 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997066c-32b8-4e6a-9149-afca13483aa4 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:56.964415 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 135/286] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:56.970488 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9089d2-40d1-4735-b4c2-55b0672c4fa4 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:56.973438 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9089d2-40d1-4735-b4c2-55b0672c4fa4 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:56.973438 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9089d2-40d1-4735-b4c2-55b0672c4fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:57.028738 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-0b9089d2-40d1-4735-b4c2-55b0672c4fa4 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:57.033687 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-0b9089d2-40d1-4735-b4c2-55b0672c4fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:57.103901 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbcbcf-dbc7-4ad0-90d6-68a0a365c9ab None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:57.173207 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 136/287] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:18:57.199775 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16deda3-4407-420e-9f95-5c3f358ba06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:57.201009 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16deda3-4407-420e-9f95-5c3f358ba06c None admin] REQUEST_METHOD: `PUT` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:57.201525 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16deda3-4407-420e-9f95-5c3f358ba06c None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:57.202014 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16deda3-4407-420e-9f95-5c3f358ba06c None admin] PATH_INFO: `/v3/projects/46dbfbf04ba34604abb1879881e3e4d9/users/f8967691639d41f38d496bb1ec885a41/roles/1cf9a76305b6469cb57c1115c9cb198b` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:57.206931 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16deda3-4407-420e-9f95-5c3f358ba06c None admin] RBAC: Authorizing `identity:create_grant(project_id=46dbfbf04ba34604abb1879881e3e4d9, user_id=f8967691639d41f38d496bb1ec885a41, role_id=1cf9a76305b6469cb57c1115c9cb198b)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:57.208691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16deda3-4407-420e-9f95-5c3f358ba06c None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:57.218587 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9089d2-40d1-4735-b4c2-55b0672c4fa4 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:57.240008 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 152/288] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:18:56 2022] PUT /identity/v3/projects/46dbfbf04ba34604abb1879881e3e4d9/users/f8967691639d41f38d496bb1ec885a41/roles/1cf9a76305b6469cb57c1115c9cb198b => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:18:57.400973 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9089d2-40d1-4735-b4c2-55b0672c4fa4 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:57.466397 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24b868-6b7c-4f4c-92c0-6a0dc4243a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:57.467730 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24b868-6b7c-4f4c-92c0-6a0dc4243a45 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:57.468205 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24b868-6b7c-4f4c-92c0-6a0dc4243a45 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:57.468670 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24b868-6b7c-4f4c-92c0-6a0dc4243a45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:57.489631 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24b868-6b7c-4f4c-92c0-6a0dc4243a45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:18:57.501280 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-9f24b868-6b7c-4f4c-92c0-6a0dc4243a45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:18:57.501280 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:18:57.501280 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:18:57.501280 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:18:57.501280 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:18:57.501280 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:18:57.501280 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:18:57.501280 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:18:57.501280 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:18:57.501280 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:18:57.501280 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:18:57.501280 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:18:57.501280 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:18:57.501280 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:18:57.501280 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:18:57.501280 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:18:57.502480 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:18:57.502480 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:18:57.502480 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:18:57.502480 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:18:57.502480 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:18:57.502480 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:18:57.502480 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:18:57.502480 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:18:57.502480 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:18:57.502480 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:18:57.502480 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:18:57.502480 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:18:57.502480 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:18:57.502480 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:18:57.502480 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:18:57.502480 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:18:57.503403 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:18:57.503403 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:18:57.503403 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:18:57.503403 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:18:57.503403 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:18:57.503403 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:18:57.503403 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:18:57.503403 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:18:57.503403 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:18:57.503403 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:18:57.503403 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:18:57.503403 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:18:57.504102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 137/289] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:18:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:18:57.511575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16deda3-4407-420e-9f95-5c3f358ba06c None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:57.692038 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16deda3-4407-420e-9f95-5c3f358ba06c None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:57.741488 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d64df-e42c-47cb-a079-e2b28f38b6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:57.742259 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d64df-e42c-47cb-a079-e2b28f38b6ee None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:57.742549 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d64df-e42c-47cb-a079-e2b28f38b6ee None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:57.742830 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d64df-e42c-47cb-a079-e2b28f38b6ee None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:57.743617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d64df-e42c-47cb-a079-e2b28f38b6ee None admin] RBAC: Adding query filter params (name=member) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:57.743931 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d64df-e42c-47cb-a079-e2b28f38b6ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:57.745339 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d64df-e42c-47cb-a079-e2b28f38b6ee None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:57.758129 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 153/290] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:18:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:57.764192 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24b868-6b7c-4f4c-92c0-6a0dc4243a45 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:57.917343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24b868-6b7c-4f4c-92c0-6a0dc4243a45 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:57.976124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445af86-1cf9-430e-bda8-36bb1b8b57d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:57.976952 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445af86-1cf9-430e-bda8-36bb1b8b57d5 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:57.977245 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445af86-1cf9-430e-bda8-36bb1b8b57d5 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:57.977557 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445af86-1cf9-430e-bda8-36bb1b8b57d5 None admin] PATH_INFO: `/v3/users/179bca7a106d4b99b6622e2fff115835` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:57.978889 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445af86-1cf9-430e-bda8-36bb1b8b57d5 None admin] RBAC: Authorizing `identity:get_user(user_id=179bca7a106d4b99b6622e2fff115835)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:57.980374 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445af86-1cf9-430e-bda8-36bb1b8b57d5 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:57.986178 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 138/291] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:18:57 2022] GET /identity/v3/users/179bca7a106d4b99b6622e2fff115835 => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:57.992296 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d64df-e42c-47cb-a079-e2b28f38b6ee None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:58.177489 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d64df-e42c-47cb-a079-e2b28f38b6ee None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:58.223429 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f98d1-6017-4afa-a1be-88979e412455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:58.224092 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f98d1-6017-4afa-a1be-88979e412455 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:58.224375 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f98d1-6017-4afa-a1be-88979e412455 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:58.225263 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f98d1-6017-4afa-a1be-88979e412455 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:58.327378 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f98d1-6017-4afa-a1be-88979e412455 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:58.328789 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f98d1-6017-4afa-a1be-88979e412455 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:58.477926 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 154/292] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:18:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:18:58.484417 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445af86-1cf9-430e-bda8-36bb1b8b57d5 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:58.692724 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445af86-1cf9-430e-bda8-36bb1b8b57d5 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:58.757051 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30502677-5ef1-492b-94c4-75d996dc7b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:58.758648 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30502677-5ef1-492b-94c4-75d996dc7b65 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:58.759172 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30502677-5ef1-492b-94c4-75d996dc7b65 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:58.759688 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30502677-5ef1-492b-94c4-75d996dc7b65 None admin] PATH_INFO: `/v3/projects/46dbfbf04ba34604abb1879881e3e4d9` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:58.762010 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30502677-5ef1-492b-94c4-75d996dc7b65 None admin] RBAC: Authorizing `identity:get_project(project_id=46dbfbf04ba34604abb1879881e3e4d9)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:58.764888 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30502677-5ef1-492b-94c4-75d996dc7b65 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:58.768761 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 139/293] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:18:58 2022] GET /identity/v3/projects/46dbfbf04ba34604abb1879881e3e4d9 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:58.775095 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f98d1-6017-4afa-a1be-88979e412455 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:18:58.981217 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f98d1-6017-4afa-a1be-88979e412455 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:18:59.056931 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f70c10-1350-482d-aa78-e9bcc576ec83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:18:59.058153 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f70c10-1350-482d-aa78-e9bcc576ec83 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:59.058539 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f70c10-1350-482d-aa78-e9bcc576ec83 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:59.059034 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f70c10-1350-482d-aa78-e9bcc576ec83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:59.060717 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f70c10-1350-482d-aa78-e9bcc576ec83 None admin] RBAC: Adding query filter params (role.id=a65ce6e645574561bb50ce9148d0637a, scope.project.id=46dbfbf04ba34604abb1879881e3e4d9, user.id=179bca7a106d4b99b6622e2fff115835) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:18:59.061288 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f70c10-1350-482d-aa78-e9bcc576ec83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:18:59.064002 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f70c10-1350-482d-aa78-e9bcc576ec83 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:18:59.080953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 155/294] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:18:58 2022] GET /identity/v3/role_assignments?user.id=179bca7a106d4b99b6622e2fff115835&scope.project.id=46dbfbf04ba34604abb1879881e3e4d9&role.id=a65ce6e645574561bb50ce9148d0637a => generated 608 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:18:59.608463 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f903c-25e6-41b4-96ca-32c8313bd5c9 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:59.609263 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f903c-25e6-41b4-96ca-32c8313bd5c9 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:59.609263 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f903c-25e6-41b4-96ca-32c8313bd5c9 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:59.610789 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 140/295] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:18:59.618153 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd84a4-852d-4712-ab4c-438ffc2b55bc None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:18:59.618465 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd84a4-852d-4712-ab4c-438ffc2b55bc None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:18:59.618790 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd84a4-852d-4712-ab4c-438ffc2b55bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:18:59.640321 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-b0fd84a4-852d-4712-ab4c-438ffc2b55bc None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:18:59.641577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-b0fd84a4-852d-4712-ab4c-438ffc2b55bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:18:59.744665 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 156/296] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:18:59.776186 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f903c-25e6-41b4-96ca-32c8313bd5c9 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:00.033715 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f903c-25e6-41b4-96ca-32c8313bd5c9 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:00.040104 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7a1e9-2a6e-43d6-8b74-9172294bfdef None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:00.040796 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7a1e9-2a6e-43d6-8b74-9172294bfdef None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:00.041298 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7a1e9-2a6e-43d6-8b74-9172294bfdef None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:00.043029 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 157/297] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:00.049000 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2562ad-7601-4a28-a4c7-1eb24bfffe16 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:00.049729 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2562ad-7601-4a28-a4c7-1eb24bfffe16 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:00.050261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2562ad-7601-4a28-a4c7-1eb24bfffe16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:00.069205 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-0f2562ad-7601-4a28-a4c7-1eb24bfffe16 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:00.071388 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-0f2562ad-7601-4a28-a4c7-1eb24bfffe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:00.085080 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b543ac-2369-4bfe-be9f-f8e36cf861c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:00.086289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b543ac-2369-4bfe-be9f-f8e36cf861c6 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:00.086598 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b543ac-2369-4bfe-be9f-f8e36cf861c6 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:00.086903 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b543ac-2369-4bfe-be9f-f8e36cf861c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:00.103957 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b543ac-2369-4bfe-be9f-f8e36cf861c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:00.116990 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-b5b543ac-2369-4bfe-be9f-f8e36cf861c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:19:00.116990 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:00.116990 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:00.116990 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:00.116990 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:00.116990 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:00.116990 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:00.116990 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:00.116990 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:00.116990 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:00.116990 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:00.116990 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:00.116990 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:00.116990 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:00.116990 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:00.116990 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:00.118549 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:00.118549 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:00.118549 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:00.118549 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:00.118549 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:00.118549 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:00.118549 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:00.118549 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:00.118549 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:00.118549 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:00.118549 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:00.118549 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:00.118549 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:00.118549 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:00.118549 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:00.118549 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:00.119715 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:00.119715 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:00.119715 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:00.119715 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:00.119715 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:00.119715 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:00.119715 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:00.119715 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:00.119715 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:00.119715 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:00.119715 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:19:00.119715 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:00.119715 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 141/298] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:18:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:19:00.125156 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b543ac-2369-4bfe-be9f-f8e36cf861c6 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:00.155646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 158/299] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:00.181551 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2562ad-7601-4a28-a4c7-1eb24bfffe16 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:00.283407 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b543ac-2369-4bfe-be9f-f8e36cf861c6 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:00.311814 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2562ad-7601-4a28-a4c7-1eb24bfffe16 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:00.345086 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40922a3d-0c4a-487c-9d4b-162d495837d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:00.346231 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40922a3d-0c4a-487c-9d4b-162d495837d8 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:00.346695 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40922a3d-0c4a-487c-9d4b-162d495837d8 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:00.347138 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40922a3d-0c4a-487c-9d4b-162d495837d8 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:00.348443 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40922a3d-0c4a-487c-9d4b-162d495837d8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:00.348925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40922a3d-0c4a-487c-9d4b-162d495837d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:00.352010 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40922a3d-0c4a-487c-9d4b-162d495837d8 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:00.367037 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392c23a-fa08-44ab-ad15-5e6e6ecd1372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:00.368030 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 142/300] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:19:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:00.368172 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392c23a-fa08-44ab-ad15-5e6e6ecd1372 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:00.368466 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392c23a-fa08-44ab-ad15-5e6e6ecd1372 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:00.368827 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392c23a-fa08-44ab-ad15-5e6e6ecd1372 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:00.376718 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40922a3d-0c4a-487c-9d4b-162d495837d8 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:00.378518 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392c23a-fa08-44ab-ad15-5e6e6ecd1372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:00.380545 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392c23a-fa08-44ab-ad15-5e6e6ecd1372 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:00.385438 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 159/301] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:00.394991 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392c23a-fa08-44ab-ad15-5e6e6ecd1372 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:00.559057 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40922a3d-0c4a-487c-9d4b-162d495837d8 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:00.560065 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392c23a-fa08-44ab-ad15-5e6e6ecd1372 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:00.595923 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6e349-6775-4cf7-919e-11089a456a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:00.596728 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6e349-6775-4cf7-919e-11089a456a4a None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:00.597003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6e349-6775-4cf7-919e-11089a456a4a None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:00.597280 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6e349-6775-4cf7-919e-11089a456a4a None admin] PATH_INFO: `/v3/users/0edaadacd1254060a8c15f24a1cbdb3f` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:00.601026 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55a96a-9a9f-4537-bb5e-1bf4d88cee13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:00.601766 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55a96a-9a9f-4537-bb5e-1bf4d88cee13 None admin] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:00.602049 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55a96a-9a9f-4537-bb5e-1bf4d88cee13 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:00.602325 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55a96a-9a9f-4537-bb5e-1bf4d88cee13 None admin] PATH_INFO: `/v3/groups` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:00.603079 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55a96a-9a9f-4537-bb5e-1bf4d88cee13 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:00.604556 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55a96a-9a9f-4537-bb5e-1bf4d88cee13 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:00.614535 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6e349-6775-4cf7-919e-11089a456a4a None admin] RBAC: Authorizing `identity:get_user(user_id=0edaadacd1254060a8c15f24a1cbdb3f)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:00.616579 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6e349-6775-4cf7-919e-11089a456a4a None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:00.618789 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 143/302] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:19:00 2022] GET /identity/v3/users/0edaadacd1254060a8c15f24a1cbdb3f => generated 293 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:00.620198 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b3fc5-9e80-47a6-85d7-60dc84fba044 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:00.620648 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b3fc5-9e80-47a6-85d7-60dc84fba044 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:00.620881 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b3fc5-9e80-47a6-85d7-60dc84fba044 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:00.625488 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 144/303] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:00.625750 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 160/304] 10.222.0.48 () {60 vars in 1134 bytes} [Mon May 9 15:19:00 2022] POST /identity/v3/groups => generated 229 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:19:00.625936 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a80d07-c687-44ce-9559-1d0f3e7ad9fa None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:00.625936 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a80d07-c687-44ce-9559-1d0f3e7ad9fa None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:00.625936 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a80d07-c687-44ce-9559-1d0f3e7ad9fa None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:00.626342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 145/305] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:00.632419 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55a96a-9a9f-4537-bb5e-1bf4d88cee13 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:00.633744 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f5ab9-88c7-4f13-bbdc-fb134bc3cb69 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:00.634215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f5ab9-88c7-4f13-bbdc-fb134bc3cb69 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:00.634674 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f5ab9-88c7-4f13-bbdc-fb134bc3cb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:00.662827 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-c64f5ab9-88c7-4f13-bbdc-fb134bc3cb69 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:00.664843 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-c64f5ab9-88c7-4f13-bbdc-fb134bc3cb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:00.777411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 146/306] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:19:00.777411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afddb5f-485b-41b1-86f2-642b7a4db49d None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:00.777411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afddb5f-485b-41b1-86f2-642b7a4db49d None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:00.777411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afddb5f-485b-41b1-86f2-642b7a4db49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:00.799819 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55a96a-9a9f-4537-bb5e-1bf4d88cee13 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:00.804293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-3afddb5f-485b-41b1-86f2-642b7a4db49d None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:00.806583 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-3afddb5f-485b-41b1-86f2-642b7a4db49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:00.856275 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a8122-ba61-41bc-824b-6150e99f38c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:00.856877 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a8122-ba61-41bc-824b-6150e99f38c1 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:00.857122 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a8122-ba61-41bc-824b-6150e99f38c1 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:00.857402 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a8122-ba61-41bc-824b-6150e99f38c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:00.858293 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a8122-ba61-41bc-824b-6150e99f38c1 None admin] RBAC: Adding query filter params (role.id=1cf9a76305b6469cb57c1115c9cb198b, user.id=0edaadacd1254060a8c15f24a1cbdb3f, scope.system=all) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:00.858615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a8122-ba61-41bc-824b-6150e99f38c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:00.860077 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a8122-ba61-41bc-824b-6150e99f38c1 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:00.867049 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 161/307] 10.222.0.48 () {56 vars in 1308 bytes} [Mon May 9 15:19:00 2022] GET /identity/v3/role_assignments?user.id=0edaadacd1254060a8c15f24a1cbdb3f&scope.system=all&role.id=1cf9a76305b6469cb57c1115c9cb198b => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:00.867927 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a8122-ba61-41bc-824b-6150e99f38c1 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:00.924075 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 147/308] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:00.961556 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afddb5f-485b-41b1-86f2-642b7a4db49d None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:01.030306 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a8122-ba61-41bc-824b-6150e99f38c1 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:01.071886 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a4a79-bab6-46b0-8428-bd82d4d6a094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:01.072924 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a4a79-bab6-46b0-8428-bd82d4d6a094 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:01.073110 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a4a79-bab6-46b0-8428-bd82d4d6a094 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:01.073277 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a4a79-bab6-46b0-8428-bd82d4d6a094 None admin] PATH_INFO: `/v3/roles/member` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:01.086326 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a4a79-bab6-46b0-8428-bd82d4d6a094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:01.094286 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-665a4a79-bab6-46b0-8428-bd82d4d6a094 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:19:01.094286 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:01.094286 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:01.094286 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:01.094286 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:01.094286 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:01.094286 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:01.094286 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:01.094286 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:01.094286 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:01.094286 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:01.094286 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:01.094286 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:01.094286 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:01.094286 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:01.094286 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:01.095612 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:01.095612 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:01.095612 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:01.095612 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:01.095612 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:01.095612 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:01.095612 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:01.095612 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:01.095612 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:01.095612 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:01.095612 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:01.095612 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:01.095612 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:01.095612 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:01.095612 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:01.095612 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:01.097261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:01.097261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:01.097261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:01.097261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:01.097261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:01.097261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:01.097261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:01.097261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:01.097261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:01.097261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:01.097261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:19:01.097261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:01.097261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 162/309] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:19:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:01.103134 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a4a79-bab6-46b0-8428-bd82d4d6a094 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:01.127965 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afddb5f-485b-41b1-86f2-642b7a4db49d None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:01.175908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed3b16-4ef2-4d2e-bcde-d4e24303d7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:01.176982 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed3b16-4ef2-4d2e-bcde-d4e24303d7af None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:01.177398 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed3b16-4ef2-4d2e-bcde-d4e24303d7af None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:01.178028 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed3b16-4ef2-4d2e-bcde-d4e24303d7af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:01.192766 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed3b16-4ef2-4d2e-bcde-d4e24303d7af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:01.202008 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-88ed3b16-4ef2-4d2e-bcde-d4e24303d7af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:19:01.202008 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:01.202008 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:01.202008 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:01.202008 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:01.202008 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:01.202008 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:01.202008 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:01.202008 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:01.202008 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:01.202008 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:01.202008 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:01.202008 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:01.202008 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:01.202008 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:01.202008 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:01.204102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:01.204102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:01.204102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:01.204102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:01.204102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:01.204102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:01.204102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:01.204102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:01.204102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:01.204102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:01.204102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:01.204102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:01.204102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:01.204102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:01.204102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:01.204102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:01.205900 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:01.205900 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:01.205900 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:01.205900 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:01.205900 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:01.205900 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:01.205900 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:01.205900 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:01.205900 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:01.205900 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:01.205900 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:19:01.205900 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:01.207563 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 148/310] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:19:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:19:01.212500 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed3b16-4ef2-4d2e-bcde-d4e24303d7af None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:01.318249 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a4a79-bab6-46b0-8428-bd82d4d6a094 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:01.360197 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed3b16-4ef2-4d2e-bcde-d4e24303d7af None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:01.371639 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c2ff7-f8c8-4069-895a-9887fbdfa71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:01.372387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c2ff7-f8c8-4069-895a-9887fbdfa71a None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:01.372682 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c2ff7-f8c8-4069-895a-9887fbdfa71a None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:01.372966 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c2ff7-f8c8-4069-895a-9887fbdfa71a None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:01.373861 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c2ff7-f8c8-4069-895a-9887fbdfa71a None admin] RBAC: Adding query filter params (name=member) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:01.374180 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c2ff7-f8c8-4069-895a-9887fbdfa71a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:01.375734 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c2ff7-f8c8-4069-895a-9887fbdfa71a None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:01.388972 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 163/311] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:19:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:01.396198 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c2ff7-f8c8-4069-895a-9887fbdfa71a None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:01.430484 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f791a-15c0-4ba7-8f96-5d8b333dbb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:01.433464 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f791a-15c0-4ba7-8f96-5d8b333dbb07 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:01.434707 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f791a-15c0-4ba7-8f96-5d8b333dbb07 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:01.435244 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f791a-15c0-4ba7-8f96-5d8b333dbb07 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:01.436492 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f791a-15c0-4ba7-8f96-5d8b333dbb07 None admin] RBAC: Adding query filter params (name=reader) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:01.437796 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f791a-15c0-4ba7-8f96-5d8b333dbb07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:01.440076 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f791a-15c0-4ba7-8f96-5d8b333dbb07 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:01.455716 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 149/312] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:19:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:01.463682 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f791a-15c0-4ba7-8f96-5d8b333dbb07 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:01.568961 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c2ff7-f8c8-4069-895a-9887fbdfa71a None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:01.626947 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f791a-15c0-4ba7-8f96-5d8b333dbb07 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:01.639549 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37ce25-5780-4e45-ad57-0353836927d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:01.641118 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37ce25-5780-4e45-ad57-0353836927d6 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:01.641550 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37ce25-5780-4e45-ad57-0353836927d6 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:01.641953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37ce25-5780-4e45-ad57-0353836927d6 None admin] PATH_INFO: `/v3/users/d16f99fb8e614249a15c0c23fc1eaafe` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:01.643820 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37ce25-5780-4e45-ad57-0353836927d6 None admin] RBAC: Authorizing `identity:get_user(user_id=d16f99fb8e614249a15c0c23fc1eaafe)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:01.646091 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37ce25-5780-4e45-ad57-0353836927d6 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:01.654070 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 164/313] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:19:01 2022] GET /identity/v3/users/d16f99fb8e614249a15c0c23fc1eaafe => generated 293 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:01.655589 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37ce25-5780-4e45-ad57-0353836927d6 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:01.689188 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e67a7-70d9-424b-8786-62e8cb3430d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:01.691740 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e67a7-70d9-424b-8786-62e8cb3430d7 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:01.692864 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e67a7-70d9-424b-8786-62e8cb3430d7 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:01.694148 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e67a7-70d9-424b-8786-62e8cb3430d7 None admin] PATH_INFO: `/v3/users/f8967691639d41f38d496bb1ec885a41` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:01.700960 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e67a7-70d9-424b-8786-62e8cb3430d7 None admin] RBAC: Authorizing `identity:get_user(user_id=f8967691639d41f38d496bb1ec885a41)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:01.704580 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e67a7-70d9-424b-8786-62e8cb3430d7 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:01.708682 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 150/314] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:19:01 2022] GET /identity/v3/users/f8967691639d41f38d496bb1ec885a41 => generated 297 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:01.719501 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e67a7-70d9-424b-8786-62e8cb3430d7 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:01.803841 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37ce25-5780-4e45-ad57-0353836927d6 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:01.860220 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24631ac3-59e0-4dea-aa9f-62de7aabbaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:01.861650 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24631ac3-59e0-4dea-aa9f-62de7aabbaee None admin] REQUEST_METHOD: `PUT` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:01.863091 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24631ac3-59e0-4dea-aa9f-62de7aabbaee None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:01.863855 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24631ac3-59e0-4dea-aa9f-62de7aabbaee None admin] PATH_INFO: `/v3/system/users/d16f99fb8e614249a15c0c23fc1eaafe/roles/a65ce6e645574561bb50ce9148d0637a` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:01.867642 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24631ac3-59e0-4dea-aa9f-62de7aabbaee None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d16f99fb8e614249a15c0c23fc1eaafe, role_id=a65ce6e645574561bb50ce9148d0637a)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:01.869650 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24631ac3-59e0-4dea-aa9f-62de7aabbaee None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:01.883294 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 165/315] 10.222.0.48 () {58 vars in 1334 bytes} [Mon May 9 15:19:01 2022] PUT /identity/v3/system/users/d16f99fb8e614249a15c0c23fc1eaafe/roles/a65ce6e645574561bb50ce9148d0637a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:19:01.904545 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e67a7-70d9-424b-8786-62e8cb3430d7 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:01.960103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ceb6f4-6cfe-41a8-b660-1d49d7010541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:01.961343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ceb6f4-6cfe-41a8-b660-1d49d7010541 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:01.961939 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ceb6f4-6cfe-41a8-b660-1d49d7010541 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:01.962502 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ceb6f4-6cfe-41a8-b660-1d49d7010541 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:02.054932 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ceb6f4-6cfe-41a8-b660-1d49d7010541 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:02.057044 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ceb6f4-6cfe-41a8-b660-1d49d7010541 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:02.172720 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 151/316] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:19:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:19:02.181139 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24631ac3-59e0-4dea-aa9f-62de7aabbaee None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:02.310845 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24631ac3-59e0-4dea-aa9f-62de7aabbaee None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:02.360661 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bfa49-7510-4626-8c86-6ab968f07c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:02.361993 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bfa49-7510-4626-8c86-6ab968f07c35 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:02.362629 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bfa49-7510-4626-8c86-6ab968f07c35 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:02.363085 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bfa49-7510-4626-8c86-6ab968f07c35 None admin] PATH_INFO: `/v3/projects/46dbfbf04ba34604abb1879881e3e4d9` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:02.364896 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bfa49-7510-4626-8c86-6ab968f07c35 None admin] RBAC: Authorizing `identity:get_project(project_id=46dbfbf04ba34604abb1879881e3e4d9)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:02.367776 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bfa49-7510-4626-8c86-6ab968f07c35 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:02.376062 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 166/317] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:19:02 2022] GET /identity/v3/projects/46dbfbf04ba34604abb1879881e3e4d9 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:02.378182 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ceb6f4-6cfe-41a8-b660-1d49d7010541 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:02.537411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ceb6f4-6cfe-41a8-b660-1d49d7010541 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:02.593074 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b45e1-3c8c-4db3-bc62-f28711a78b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:02.594234 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b45e1-3c8c-4db3-bc62-f28711a78b81 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:02.594705 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b45e1-3c8c-4db3-bc62-f28711a78b81 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:02.595062 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b45e1-3c8c-4db3-bc62-f28711a78b81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:02.596311 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b45e1-3c8c-4db3-bc62-f28711a78b81 None admin] RBAC: Adding query filter params (role.id=1cf9a76305b6469cb57c1115c9cb198b, scope.project.id=46dbfbf04ba34604abb1879881e3e4d9, user.id=f8967691639d41f38d496bb1ec885a41) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:02.596743 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b45e1-3c8c-4db3-bc62-f28711a78b81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:02.599367 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b45e1-3c8c-4db3-bc62-f28711a78b81 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:02.611389 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 152/318] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:19:02 2022] GET /identity/v3/role_assignments?user.id=f8967691639d41f38d496bb1ec885a41&scope.project.id=46dbfbf04ba34604abb1879881e3e4d9&role.id=1cf9a76305b6469cb57c1115c9cb198b => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:03.162802 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e51f9-62a2-4817-9b8d-ef16178a6c68 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:03.163264 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e51f9-62a2-4817-9b8d-ef16178a6c68 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:03.163477 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e51f9-62a2-4817-9b8d-ef16178a6c68 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:03.164802 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 167/319] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:03.172072 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5318c6f-d114-4cc6-ba8f-a1fb960e7d2e None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:03.172927 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5318c6f-d114-4cc6-ba8f-a1fb960e7d2e None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:03.173548 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5318c6f-d114-4cc6-ba8f-a1fb960e7d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:03.204237 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-f5318c6f-d114-4cc6-ba8f-a1fb960e7d2e None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:03.206470 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-f5318c6f-d114-4cc6-ba8f-a1fb960e7d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:03.301412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 153/320] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:03.336139 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e51f9-62a2-4817-9b8d-ef16178a6c68 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:03.416389 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d3b6d-02d2-48fa-8a6b-01f895612829 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:03.416624 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d3b6d-02d2-48fa-8a6b-01f895612829 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:03.417865 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d3b6d-02d2-48fa-8a6b-01f895612829 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:03.418634 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 154/321] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:19:03.426392 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a99499-fb4f-4c4f-a78e-a9f91586bff5 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:03.426904 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a99499-fb4f-4c4f-a78e-a9f91586bff5 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:03.427375 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a99499-fb4f-4c4f-a78e-a9f91586bff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:03.447445 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-99a99499-fb4f-4c4f-a78e-a9f91586bff5 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:03.449177 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-99a99499-fb4f-4c4f-a78e-a9f91586bff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:03.495642 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e51f9-62a2-4817-9b8d-ef16178a6c68 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:03.537449 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 155/322] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:19:03.540578 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b582c4-e037-4fc4-8560-f6d0808e537b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:03.541739 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b582c4-e037-4fc4-8560-f6d0808e537b None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:03.542205 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b582c4-e037-4fc4-8560-f6d0808e537b None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:03.542707 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b582c4-e037-4fc4-8560-f6d0808e537b None admin] PATH_INFO: `/v3/domains/default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:03.544424 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b582c4-e037-4fc4-8560-f6d0808e537b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:03.546014 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b582c4-e037-4fc4-8560-f6d0808e537b None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:03.548085 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 168/323] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:03.554405 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a99499-fb4f-4c4f-a78e-a9f91586bff5 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:03.559580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b582c4-e037-4fc4-8560-f6d0808e537b None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:03.682841 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a99499-fb4f-4c4f-a78e-a9f91586bff5 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:03.722312 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cc8ce-c269-4c7b-8fb5-229d937faa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:03.723053 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cc8ce-c269-4c7b-8fb5-229d937faa1e None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:03.723340 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cc8ce-c269-4c7b-8fb5-229d937faa1e None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:03.723620 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cc8ce-c269-4c7b-8fb5-229d937faa1e None admin] PATH_INFO: `/v3/groups` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:03.724493 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cc8ce-c269-4c7b-8fb5-229d937faa1e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:03.726240 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cc8ce-c269-4c7b-8fb5-229d937faa1e None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:03.733910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b582c4-e037-4fc4-8560-f6d0808e537b None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:03.743784 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 156/324] 10.222.0.48 () {60 vars in 1134 bytes} [Mon May 9 15:19:03 2022] POST /identity/v3/groups => generated 226 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:19:03.800634 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3025d-d7a0-48ba-a498-bc4ab54f1914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:03.802069 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3025d-d7a0-48ba-a498-bc4ab54f1914 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:03.803116 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3025d-d7a0-48ba-a498-bc4ab54f1914 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:03.803848 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3025d-d7a0-48ba-a498-bc4ab54f1914 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:03.825247 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3025d-d7a0-48ba-a498-bc4ab54f1914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:03.836170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-7ff3025d-d7a0-48ba-a498-bc4ab54f1914 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:19:03.836170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:03.836170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:03.836170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:03.836170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:03.836170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:03.836170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:03.836170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:03.836170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:03.836170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:03.836170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:03.836170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:03.836170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:03.836170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:03.836170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:03.836170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:03.838081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:03.838081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:03.838081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:03.838081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:03.838081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:03.838081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:03.838081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:03.838081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:03.838081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:03.838081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:03.838081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:03.838081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:03.838081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:03.838081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:03.838081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:03.838081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:03.840552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:03.840552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:03.840552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:03.840552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:03.840552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:03.840552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:03.840552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:03.840552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:03.840552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:03.840552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:03.840552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:19:03.840552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:03.845160 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 169/325] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:19:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:19:03.845529 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cc8ce-c269-4c7b-8fb5-229d937faa1e None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:04.002796 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cc8ce-c269-4c7b-8fb5-229d937faa1e None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:04.058089 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90c924-c80b-4c60-810c-ab76174f1be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:04.058908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90c924-c80b-4c60-810c-ab76174f1be8 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:04.059215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90c924-c80b-4c60-810c-ab76174f1be8 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:04.059558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90c924-c80b-4c60-810c-ab76174f1be8 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:04.060436 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90c924-c80b-4c60-810c-ab76174f1be8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:04.060781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90c924-c80b-4c60-810c-ab76174f1be8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:04.062859 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90c924-c80b-4c60-810c-ab76174f1be8 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:04.078637 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 157/326] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:19:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:04.088505 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3025d-d7a0-48ba-a498-bc4ab54f1914 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:04.231113 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3025d-d7a0-48ba-a498-bc4ab54f1914 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:04.286170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fef87-5154-4c82-ae4a-7ad6833ed170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:04.287634 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fef87-5154-4c82-ae4a-7ad6833ed170 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:04.288217 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fef87-5154-4c82-ae4a-7ad6833ed170 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:04.288511 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fef87-5154-4c82-ae4a-7ad6833ed170 None admin] PATH_INFO: `/v3/users/0edaadacd1254060a8c15f24a1cbdb3f` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:04.290399 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fef87-5154-4c82-ae4a-7ad6833ed170 None admin] RBAC: Authorizing `identity:get_user(user_id=0edaadacd1254060a8c15f24a1cbdb3f)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:04.293266 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fef87-5154-4c82-ae4a-7ad6833ed170 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:04.297171 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 170/327] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:19:04 2022] GET /identity/v3/users/0edaadacd1254060a8c15f24a1cbdb3f => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:04.305521 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90c924-c80b-4c60-810c-ab76174f1be8 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:04.448199 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90c924-c80b-4c60-810c-ab76174f1be8 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:04.500786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e1107-b661-4495-966e-052adf11163e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:04.501988 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e1107-b661-4495-966e-052adf11163e None admin] REQUEST_METHOD: `PUT` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:04.502290 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e1107-b661-4495-966e-052adf11163e None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:04.502553 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e1107-b661-4495-966e-052adf11163e None admin] PATH_INFO: `/v3/system/users/0edaadacd1254060a8c15f24a1cbdb3f/roles/1cf9a76305b6469cb57c1115c9cb198b` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:04.504615 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e1107-b661-4495-966e-052adf11163e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0edaadacd1254060a8c15f24a1cbdb3f, role_id=1cf9a76305b6469cb57c1115c9cb198b)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:04.506594 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e1107-b661-4495-966e-052adf11163e None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:04.518768 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 158/328] 10.222.0.48 () {58 vars in 1334 bytes} [Mon May 9 15:19:04 2022] PUT /identity/v3/system/users/0edaadacd1254060a8c15f24a1cbdb3f/roles/1cf9a76305b6469cb57c1115c9cb198b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:19:04.728128 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d8f9f-a484-4f5b-afcb-e471c0776722 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:04.728841 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d8f9f-a484-4f5b-afcb-e471c0776722 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:04.729024 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d8f9f-a484-4f5b-afcb-e471c0776722 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:04.731931 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 171/329] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:04.738394 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce571a-8cfb-409e-a3b3-ef39cd9512de None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:04.738810 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce571a-8cfb-409e-a3b3-ef39cd9512de None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:04.739536 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce571a-8cfb-409e-a3b3-ef39cd9512de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:04.773424 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-9fce571a-8cfb-409e-a3b3-ef39cd9512de None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:04.775509 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-9fce571a-8cfb-409e-a3b3-ef39cd9512de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:04.893745 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 159/330] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:04.936404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d8f9f-a484-4f5b-afcb-e471c0776722 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:05.079105 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d8f9f-a484-4f5b-afcb-e471c0776722 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:05.142225 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d07e4-b6fc-4091-8f60-34f31d979a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:05.143654 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d07e4-b6fc-4091-8f60-34f31d979a45 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:05.144232 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d07e4-b6fc-4091-8f60-34f31d979a45 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:05.144648 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d07e4-b6fc-4091-8f60-34f31d979a45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:05.168364 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d07e4-b6fc-4091-8f60-34f31d979a45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:05.184654 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-085d07e4-b6fc-4091-8f60-34f31d979a45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:19:05.184654 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:05.184654 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:05.184654 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:05.184654 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:05.184654 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:05.184654 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:05.184654 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:05.184654 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:05.184654 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:05.184654 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:05.184654 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:05.184654 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:05.184654 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:05.184654 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:05.184654 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:05.185838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:05.185838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:05.185838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:05.185838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:05.185838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:05.185838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:05.185838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:05.185838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:05.185838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:05.185838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:05.185838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:05.185838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:05.185838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:05.185838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:05.185838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:05.185838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:05.186770 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:05.186770 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:05.186770 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:05.186770 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:05.186770 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:05.186770 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:05.186770 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:05.186770 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:05.186770 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:05.186770 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:05.186770 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:19:05.186770 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:05.187491 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 172/331] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:19:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:05.194896 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce571a-8cfb-409e-a3b3-ef39cd9512de None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:05.406829 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce571a-8cfb-409e-a3b3-ef39cd9512de None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:05.473570 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fce10-9131-413f-8de1-fa4999d83220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:05.474835 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fce10-9131-413f-8de1-fa4999d83220 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:05.475359 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fce10-9131-413f-8de1-fa4999d83220 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:05.475876 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fce10-9131-413f-8de1-fa4999d83220 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:05.477420 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fce10-9131-413f-8de1-fa4999d83220 None admin] RBAC: Adding query filter params (name=member) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:05.477995 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fce10-9131-413f-8de1-fa4999d83220 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:05.480754 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fce10-9131-413f-8de1-fa4999d83220 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:05.498183 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 160/332] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:19:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:05.504461 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d07e4-b6fc-4091-8f60-34f31d979a45 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:05.714760 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d07e4-b6fc-4091-8f60-34f31d979a45 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:05.782511 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf8534-5a9e-4b61-86e8-7a7b5440245d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:05.784144 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf8534-5a9e-4b61-86e8-7a7b5440245d None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:05.784558 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf8534-5a9e-4b61-86e8-7a7b5440245d None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:05.785066 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf8534-5a9e-4b61-86e8-7a7b5440245d None admin] PATH_INFO: `/v3/users/d16f99fb8e614249a15c0c23fc1eaafe` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:05.788190 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf8534-5a9e-4b61-86e8-7a7b5440245d None admin] RBAC: Authorizing `identity:get_user(user_id=d16f99fb8e614249a15c0c23fc1eaafe)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:05.791096 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf8534-5a9e-4b61-86e8-7a7b5440245d None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:05.794935 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 173/333] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:19:05 2022] GET /identity/v3/users/d16f99fb8e614249a15c0c23fc1eaafe => generated 293 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:05.803809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fce10-9131-413f-8de1-fa4999d83220 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:05.931987 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fce10-9131-413f-8de1-fa4999d83220 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:05.978275 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3203165-663b-4eaa-8e51-63021d6c0693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:05.978938 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3203165-663b-4eaa-8e51-63021d6c0693 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:05.979234 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3203165-663b-4eaa-8e51-63021d6c0693 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:05.979520 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3203165-663b-4eaa-8e51-63021d6c0693 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:05.980387 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3203165-663b-4eaa-8e51-63021d6c0693 None admin] RBAC: Adding query filter params (role.id=a65ce6e645574561bb50ce9148d0637a, user.id=d16f99fb8e614249a15c0c23fc1eaafe, scope.system=all) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:05.980717 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3203165-663b-4eaa-8e51-63021d6c0693 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:05.982237 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3203165-663b-4eaa-8e51-63021d6c0693 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:06.002364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 161/334] 10.222.0.48 () {56 vars in 1308 bytes} [Mon May 9 15:19:05 2022] GET /identity/v3/role_assignments?user.id=d16f99fb8e614249a15c0c23fc1eaafe&scope.system=all&role.id=a65ce6e645574561bb50ce9148d0637a => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:07.895013 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c8ea4-a813-47ff-8e24-31cdac8080af None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:07.896632 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c8ea4-a813-47ff-8e24-31cdac8080af None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:07.897497 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c8ea4-a813-47ff-8e24-31cdac8080af None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:07.901601 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 174/335] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:07.909674 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151c480-0946-47bc-8557-f9c75e72d813 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:07.911539 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151c480-0946-47bc-8557-f9c75e72d813 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:07.912932 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151c480-0946-47bc-8557-f9c75e72d813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:07.951295 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-4151c480-0946-47bc-8557-f9c75e72d813 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:07.952527 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-4151c480-0946-47bc-8557-f9c75e72d813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:08.040187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 162/336] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:08.081354 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c8ea4-a813-47ff-8e24-31cdac8080af None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:08.244749 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c8ea4-a813-47ff-8e24-31cdac8080af None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:08.292633 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da3495-a0d9-46e6-a810-40dd2f5fc8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:08.293844 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da3495-a0d9-46e6-a810-40dd2f5fc8ad None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:08.294304 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da3495-a0d9-46e6-a810-40dd2f5fc8ad None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:08.294901 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da3495-a0d9-46e6-a810-40dd2f5fc8ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:08.308830 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da3495-a0d9-46e6-a810-40dd2f5fc8ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:08.320694 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-b9da3495-a0d9-46e6-a810-40dd2f5fc8ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:19:08.320694 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:08.320694 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:08.320694 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:08.320694 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:08.320694 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:08.320694 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:08.320694 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:08.320694 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:08.320694 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:08.320694 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:08.320694 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:08.320694 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:08.320694 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:08.320694 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:08.320694 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:08.322787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:08.322787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:08.322787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:08.322787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:08.322787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:08.322787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:08.322787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:08.322787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:08.322787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:08.322787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:08.322787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:08.322787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:08.322787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:08.322787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:08.322787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:08.322787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:08.324433 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:08.324433 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:08.324433 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:08.324433 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:08.324433 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:08.324433 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:08.324433 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:08.324433 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:08.324433 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:08.324433 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:08.324433 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:19:08.324433 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:08.328233 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 175/337] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:19:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:08.334528 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151c480-0946-47bc-8557-f9c75e72d813 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:08.370960 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f2334-861a-45fc-8cdf-ec349c927b03 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:08.371693 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f2334-861a-45fc-8cdf-ec349c927b03 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:08.372194 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f2334-861a-45fc-8cdf-ec349c927b03 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:08.374726 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 176/338] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:08.390018 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35c03f-5463-4f9a-a4b4-fb46c8888dbf None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:08.390709 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35c03f-5463-4f9a-a4b4-fb46c8888dbf None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:08.391321 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35c03f-5463-4f9a-a4b4-fb46c8888dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:08.430960 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-fa35c03f-5463-4f9a-a4b4-fb46c8888dbf None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:08.432588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-fa35c03f-5463-4f9a-a4b4-fb46c8888dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:08.507189 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151c480-0946-47bc-8557-f9c75e72d813 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:08.525933 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 177/339] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:08.527679 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34e5c9-18df-4f63-b7be-cf4a3c6bceb3 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:08.528165 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34e5c9-18df-4f63-b7be-cf4a3c6bceb3 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:08.528599 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34e5c9-18df-4f63-b7be-cf4a3c6bceb3 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:08.530479 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 178/340] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:08.547312 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351e72f-cbd9-45f7-bdf8-2c2e7da03936 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:08.547832 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351e72f-cbd9-45f7-bdf8-2c2e7da03936 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:08.548242 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351e72f-cbd9-45f7-bdf8-2c2e7da03936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:08.573646 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e93908-711d-4af6-bce6-0eb8f576ef01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:08.574805 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e93908-711d-4af6-bce6-0eb8f576ef01 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:08.575297 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e93908-711d-4af6-bce6-0eb8f576ef01 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:08.575744 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e93908-711d-4af6-bce6-0eb8f576ef01 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:08.576804 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e93908-711d-4af6-bce6-0eb8f576ef01 None admin] RBAC: Adding query filter params (name=member) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:08.577119 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e93908-711d-4af6-bce6-0eb8f576ef01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:08.578698 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e93908-711d-4af6-bce6-0eb8f576ef01 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:08.586470 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-c351e72f-cbd9-45f7-bdf8-2c2e7da03936 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:08.588501 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-c351e72f-cbd9-45f7-bdf8-2c2e7da03936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:08.603798 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 163/341] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:19:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:08.604688 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e93908-711d-4af6-bce6-0eb8f576ef01 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:08.729595 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 179/342] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:19:08.730376 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e93908-711d-4af6-bce6-0eb8f576ef01 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:08.731481 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351e72f-cbd9-45f7-bdf8-2c2e7da03936 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:08.767394 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8841f-90b7-4bb3-ac45-7109c221f0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:08.768178 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8841f-90b7-4bb3-ac45-7109c221f0bf None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:08.768478 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8841f-90b7-4bb3-ac45-7109c221f0bf None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:08.768754 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8841f-90b7-4bb3-ac45-7109c221f0bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:08.781426 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8841f-90b7-4bb3-ac45-7109c221f0bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:08.790017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-3be8841f-90b7-4bb3-ac45-7109c221f0bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:19:08.790017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:08.790017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:08.790017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:08.790017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:08.790017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:08.790017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:08.790017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:08.790017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:08.790017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:08.790017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:08.790017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:08.790017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:08.790017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:08.790017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:08.790017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:08.792647 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:08.792647 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:08.792647 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:08.792647 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:08.792647 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:08.792647 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:08.792647 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:08.792647 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:08.792647 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:08.792647 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:08.792647 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:08.792647 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:08.792647 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:08.792647 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:08.792647 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:08.792647 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:08.794977 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:08.794977 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:08.794977 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:08.794977 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:08.794977 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:08.794977 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:08.794977 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:08.794977 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:08.794977 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:08.794977 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:08.794977 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:19:08.794977 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:08.794977 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 164/343] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:19:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:08.794977 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8841f-90b7-4bb3-ac45-7109c221f0bf None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:08.907458 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8841f-90b7-4bb3-ac45-7109c221f0bf None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:08.947367 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351e72f-cbd9-45f7-bdf8-2c2e7da03936 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:08.961351 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6d54a-6206-4038-a990-d88f04d0aa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:08.962312 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6d54a-6206-4038-a990-d88f04d0aa72 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:08.962663 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6d54a-6206-4038-a990-d88f04d0aa72 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:08.962974 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6d54a-6206-4038-a990-d88f04d0aa72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:08.977514 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6d54a-6206-4038-a990-d88f04d0aa72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:08.986223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-b1e6d54a-6206-4038-a990-d88f04d0aa72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:19:08.986223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:08.986223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:08.986223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:08.986223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:08.986223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:08.986223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:08.986223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:08.986223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:08.986223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:08.986223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:08.986223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:08.986223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:08.986223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:08.986223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:08.986223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:08.988886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:08.988886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:08.988886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:08.988886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:08.988886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:08.988886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:08.988886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:08.988886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:08.988886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:08.988886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:08.988886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:08.988886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:08.988886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:08.988886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:08.988886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:08.988886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:08.992086 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:08.992086 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:08.992086 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:08.992086 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:08.992086 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:08.992086 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:08.992086 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:08.992086 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:08.992086 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:08.992086 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:08.992086 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:19:08.992086 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:08.992086 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 165/344] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:19:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:08.992086 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6d54a-6206-4038-a990-d88f04d0aa72 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:09.015747 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f20dd-181c-4cf1-9af9-ee6f3e90327f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:09.016867 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f20dd-181c-4cf1-9af9-ee6f3e90327f None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:09.017507 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f20dd-181c-4cf1-9af9-ee6f3e90327f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:09.017898 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f20dd-181c-4cf1-9af9-ee6f3e90327f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:09.158010 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6d54a-6206-4038-a990-d88f04d0aa72 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:09.179035 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f20dd-181c-4cf1-9af9-ee6f3e90327f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:09.181982 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f20dd-181c-4cf1-9af9-ee6f3e90327f None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:09.197514 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a2cf3-52e2-4878-928d-9987d387e624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:09.198205 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a2cf3-52e2-4878-928d-9987d387e624 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:09.198493 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a2cf3-52e2-4878-928d-9987d387e624 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:09.198767 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a2cf3-52e2-4878-928d-9987d387e624 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:09.199543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a2cf3-52e2-4878-928d-9987d387e624 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:09.199859 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a2cf3-52e2-4878-928d-9987d387e624 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:09.201335 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a2cf3-52e2-4878-928d-9987d387e624 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:09.211067 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 166/345] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:19:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:09.211943 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a2cf3-52e2-4878-928d-9987d387e624 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:09.330254 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a2cf3-52e2-4878-928d-9987d387e624 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:09.370206 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5bc22-e2c8-4aa9-9122-424865eb0060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:09.370923 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5bc22-e2c8-4aa9-9122-424865eb0060 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:09.371210 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5bc22-e2c8-4aa9-9122-424865eb0060 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:09.371495 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5bc22-e2c8-4aa9-9122-424865eb0060 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:09.372278 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5bc22-e2c8-4aa9-9122-424865eb0060 None admin] RBAC: Adding query filter params (name=member) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:09.372592 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5bc22-e2c8-4aa9-9122-424865eb0060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:09.374061 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5bc22-e2c8-4aa9-9122-424865eb0060 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:09.383823 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 167/346] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:19:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:09.384730 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5bc22-e2c8-4aa9-9122-424865eb0060 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:09.394645 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 180/347] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:19:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:19:09.396310 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f20dd-181c-4cf1-9af9-ee6f3e90327f None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:09.500080 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5bc22-e2c8-4aa9-9122-424865eb0060 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:09.543304 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0bd27-1dca-4a82-898e-d735cd0b0e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:09.543304 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0bd27-1dca-4a82-898e-d735cd0b0e0a None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:09.543304 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0bd27-1dca-4a82-898e-d735cd0b0e0a None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:09.543304 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0bd27-1dca-4a82-898e-d735cd0b0e0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:09.595196 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f20dd-181c-4cf1-9af9-ee6f3e90327f None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:09.640062 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a24e7d-d613-41fe-b9ac-06cf276dc69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:09.640721 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a24e7d-d613-41fe-b9ac-06cf276dc69b None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:09.641006 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a24e7d-d613-41fe-b9ac-06cf276dc69b None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:09.641276 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a24e7d-d613-41fe-b9ac-06cf276dc69b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:09.666393 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa0bd27-1dca-4a82-898e-d735cd0b0e0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:09.668987 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa0bd27-1dca-4a82-898e-d735cd0b0e0a None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:09.716904 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a24e7d-d613-41fe-b9ac-06cf276dc69b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:09.718433 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a24e7d-d613-41fe-b9ac-06cf276dc69b None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:09.823230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 168/348] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:19:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:19:09.825088 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0bd27-1dca-4a82-898e-d735cd0b0e0a None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:09.860206 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 181/349] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:19:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:19:09.864083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1c979-dc2e-4a52-901a-357f3b1cc6c2 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:09.865424 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1c979-dc2e-4a52-901a-357f3b1cc6c2 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:09.866637 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1c979-dc2e-4a52-901a-357f3b1cc6c2 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:09.870155 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 182/350] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:09.873144 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61161f16-4a55-4ec1-bc92-dd1ae5f8becf None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:09.873788 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61161f16-4a55-4ec1-bc92-dd1ae5f8becf None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:09.874376 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61161f16-4a55-4ec1-bc92-dd1ae5f8becf None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:09.877190 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 183/351] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:09.878747 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61161f16-4a55-4ec1-bc92-dd1ae5f8becf None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:09.994014 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0bd27-1dca-4a82-898e-d735cd0b0e0a None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:10.039307 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61161f16-4a55-4ec1-bc92-dd1ae5f8becf None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:10.042050 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9bb9b-26b2-4f41-9823-5c6b641e9728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:10.043029 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9bb9b-26b2-4f41-9823-5c6b641e9728 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:10.044154 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9bb9b-26b2-4f41-9823-5c6b641e9728 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:10.044154 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9bb9b-26b2-4f41-9823-5c6b641e9728 None admin] PATH_INFO: `/v3/projects/27fffefbce874beab07ae5240b7f0d10` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:10.045021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9bb9b-26b2-4f41-9823-5c6b641e9728 None admin] RBAC: Authorizing `identity:get_project(project_id=27fffefbce874beab07ae5240b7f0d10)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:10.046647 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9bb9b-26b2-4f41-9823-5c6b641e9728 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:10.054181 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 169/352] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:19:09 2022] GET /identity/v3/projects/27fffefbce874beab07ae5240b7f0d10 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:10.054181 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9bb9b-26b2-4f41-9823-5c6b641e9728 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:10.086219 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fb0d2-f5f7-48cf-a49d-547518cd1704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:10.087192 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fb0d2-f5f7-48cf-a49d-547518cd1704 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:10.087481 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fb0d2-f5f7-48cf-a49d-547518cd1704 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:10.087781 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fb0d2-f5f7-48cf-a49d-547518cd1704 None admin] PATH_INFO: `/v3/projects/27fffefbce874beab07ae5240b7f0d10` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:10.089975 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fb0d2-f5f7-48cf-a49d-547518cd1704 None admin] RBAC: Authorizing `identity:get_project(project_id=27fffefbce874beab07ae5240b7f0d10)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:10.091472 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fb0d2-f5f7-48cf-a49d-547518cd1704 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:10.093271 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 184/353] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:19:09 2022] GET /identity/v3/projects/27fffefbce874beab07ae5240b7f0d10 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:10.095451 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c13d8a-3071-47a0-9440-d4927b719fa7 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:10.095741 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c13d8a-3071-47a0-9440-d4927b719fa7 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:10.096025 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c13d8a-3071-47a0-9440-d4927b719fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:10.116387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-b5c13d8a-3071-47a0-9440-d4927b719fa7 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:10.117668 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-b5c13d8a-3071-47a0-9440-d4927b719fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:10.200810 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9bb9b-26b2-4f41-9823-5c6b641e9728 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:10.218073 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 185/354] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:10.219385 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79f173-74fb-4f4f-ac69-42aaa45caf6c None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:10.219682 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79f173-74fb-4f4f-ac69-42aaa45caf6c None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:10.219957 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79f173-74fb-4f4f-ac69-42aaa45caf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:10.243701 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-8b79f173-74fb-4f4f-ac69-42aaa45caf6c None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:10.245586 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-8b79f173-74fb-4f4f-ac69-42aaa45caf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:10.250435 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694554ec-cef2-4b03-9a72-0b879a10491f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:10.252111 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694554ec-cef2-4b03-9a72-0b879a10491f None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:10.252720 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694554ec-cef2-4b03-9a72-0b879a10491f None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:10.253165 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694554ec-cef2-4b03-9a72-0b879a10491f None admin] PATH_INFO: `/v3/projects/46dbfbf04ba34604abb1879881e3e4d9` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:10.256357 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694554ec-cef2-4b03-9a72-0b879a10491f None admin] RBAC: Authorizing `identity:get_project(project_id=46dbfbf04ba34604abb1879881e3e4d9)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:10.257716 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694554ec-cef2-4b03-9a72-0b879a10491f None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:10.259551 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 170/355] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:19:10 2022] GET /identity/v3/projects/46dbfbf04ba34604abb1879881e3e4d9 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:10.260863 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f775559-153b-4b07-a87c-33403b0a137d None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:10.261153 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f775559-153b-4b07-a87c-33403b0a137d None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:10.261540 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f775559-153b-4b07-a87c-33403b0a137d None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:10.263037 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 171/356] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:10.263665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f775559-153b-4b07-a87c-33403b0a137d None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:10.345676 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 186/357] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:10.346423 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79f173-74fb-4f4f-ac69-42aaa45caf6c None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:10.427533 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f775559-153b-4b07-a87c-33403b0a137d None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:10.475382 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288a7ae-0292-4126-be84-39c98355b688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:10.476880 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288a7ae-0292-4126-be84-39c98355b688 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:10.477482 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288a7ae-0292-4126-be84-39c98355b688 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:10.478065 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288a7ae-0292-4126-be84-39c98355b688 None admin] PATH_INFO: `/v3/groups/e7ea14e5c95744a3b3fecb6503b3b8c0` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:10.494296 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79f173-74fb-4f4f-ac69-42aaa45caf6c None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:10.494720 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288a7ae-0292-4126-be84-39c98355b688 None admin] RBAC: Authorizing `identity:get_group(group_id=e7ea14e5c95744a3b3fecb6503b3b8c0)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:10.498222 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288a7ae-0292-4126-be84-39c98355b688 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:10.500258 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 172/358] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:19:10 2022] GET /identity/v3/groups/e7ea14e5c95744a3b3fecb6503b3b8c0 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:10.500851 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288a7ae-0292-4126-be84-39c98355b688 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:10.550116 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b0c1b-4ed2-45db-a339-f5e9f6bc4b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:10.551929 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b0c1b-4ed2-45db-a339-f5e9f6bc4b92 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:10.551929 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b0c1b-4ed2-45db-a339-f5e9f6bc4b92 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:10.551929 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b0c1b-4ed2-45db-a339-f5e9f6bc4b92 None admin] PATH_INFO: `/v3/groups/e7ea14e5c95744a3b3fecb6503b3b8c0` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:10.553972 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b0c1b-4ed2-45db-a339-f5e9f6bc4b92 None admin] RBAC: Authorizing `identity:get_group(group_id=e7ea14e5c95744a3b3fecb6503b3b8c0)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:10.555484 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b0c1b-4ed2-45db-a339-f5e9f6bc4b92 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:10.561995 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 187/359] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:19:10 2022] GET /identity/v3/groups/e7ea14e5c95744a3b3fecb6503b3b8c0 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:10.561995 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b0c1b-4ed2-45db-a339-f5e9f6bc4b92 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:10.674934 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288a7ae-0292-4126-be84-39c98355b688 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:10.701216 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b0c1b-4ed2-45db-a339-f5e9f6bc4b92 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:10.728987 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc45588-ac80-458c-b1dd-921ac262e5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:10.730097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc45588-ac80-458c-b1dd-921ac262e5b9 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:10.730273 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc45588-ac80-458c-b1dd-921ac262e5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:10.730439 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc45588-ac80-458c-b1dd-921ac262e5b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:10.746945 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a303742-08aa-42fc-b077-e02325792340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:10.747327 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc45588-ac80-458c-b1dd-921ac262e5b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:10.748230 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a303742-08aa-42fc-b077-e02325792340 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:10.748230 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a303742-08aa-42fc-b077-e02325792340 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:10.748679 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a303742-08aa-42fc-b077-e02325792340 None admin] PATH_INFO: `/v3/groups/e7ea14e5c95744a3b3fecb6503b3b8c0` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:10.750775 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a303742-08aa-42fc-b077-e02325792340 None admin] RBAC: Authorizing `identity:get_group(group_id=e7ea14e5c95744a3b3fecb6503b3b8c0)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:10.753288 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a303742-08aa-42fc-b077-e02325792340 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:10.756380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-0dc45588-ac80-458c-b1dd-921ac262e5b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:19:10.756380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:10.756380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:10.756380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:10.756380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:10.756380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:10.756380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:10.756380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:10.756380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:10.756380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:10.756380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:10.756380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:10.756380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:10.756380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:10.756380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:10.756380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:10.757888 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:10.757888 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:10.757888 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:10.757888 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:10.757888 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:10.757888 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:10.757888 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:10.757888 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:10.757888 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:10.757888 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:10.757888 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:10.757888 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:10.757888 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:10.757888 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:10.757888 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:10.757888 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:10.759225 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:10.759225 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:10.759225 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:10.759225 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:10.759225 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:10.759225 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:10.759225 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:10.759225 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:10.759225 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:10.759225 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:10.759225 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:19:10.759225 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:10.759951 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 188/360] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:19:10 2022] GET /identity/v3/groups/e7ea14e5c95744a3b3fecb6503b3b8c0 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:10.760042 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 173/361] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:19:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:10.760132 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad0ba1-89f6-4afe-9bf1-907f36943041 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:10.760216 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad0ba1-89f6-4afe-9bf1-907f36943041 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:10.760868 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad0ba1-89f6-4afe-9bf1-907f36943041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:10.761561 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc45588-ac80-458c-b1dd-921ac262e5b9 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:10.784660 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-06ad0ba1-89f6-4afe-9bf1-907f36943041 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:10.785966 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-06ad0ba1-89f6-4afe-9bf1-907f36943041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:10.891037 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 189/362] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:10.893363 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad0ba1-89f6-4afe-9bf1-907f36943041 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:10.918917 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc45588-ac80-458c-b1dd-921ac262e5b9 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:10.961975 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1dd52-0c6c-48a7-aa17-c22f7a76809f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:10.963237 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1dd52-0c6c-48a7-aa17-c22f7a76809f None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:10.963237 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1dd52-0c6c-48a7-aa17-c22f7a76809f None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:10.963237 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1dd52-0c6c-48a7-aa17-c22f7a76809f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:10.981164 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1dd52-0c6c-48a7-aa17-c22f7a76809f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:10.988975 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-e8b1dd52-0c6c-48a7-aa17-c22f7a76809f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:19:10.988975 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:10.988975 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:10.988975 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:10.988975 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:10.988975 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:10.988975 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:10.988975 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:10.988975 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:10.988975 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:10.988975 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:10.988975 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:10.988975 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:10.988975 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:10.988975 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:10.988975 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:10.992003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:10.992003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:10.992003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:10.992003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:10.992003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:10.992003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:10.992003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:10.992003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:10.992003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:10.992003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:10.992003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:10.992003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:10.992003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:10.992003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:10.992003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:10.992003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:10.997051 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:10.997051 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:10.997051 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:10.997051 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:10.997051 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:10.997051 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:10.997051 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:10.997051 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:10.997051 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:10.997051 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:10.997051 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:19:10.997051 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:10.997051 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 174/363] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:19:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:10.997051 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1dd52-0c6c-48a7-aa17-c22f7a76809f None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:11.046954 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad0ba1-89f6-4afe-9bf1-907f36943041 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:11.097246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6910c-a30d-4871-b118-1246f1f32a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:11.098958 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6910c-a30d-4871-b118-1246f1f32a56 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:11.100349 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6910c-a30d-4871-b118-1246f1f32a56 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:11.101032 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6910c-a30d-4871-b118-1246f1f32a56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:11.102975 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6910c-a30d-4871-b118-1246f1f32a56 None admin] RBAC: Adding query filter params (group.id=e7ea14e5c95744a3b3fecb6503b3b8c0, role.id=a65ce6e645574561bb50ce9148d0637a, scope.project.id=27fffefbce874beab07ae5240b7f0d10) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:11.103840 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6910c-a30d-4871-b118-1246f1f32a56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:11.106799 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6910c-a30d-4871-b118-1246f1f32a56 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:11.117562 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 190/364] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:19:10 2022] GET /identity/v3/role_assignments?group.id=e7ea14e5c95744a3b3fecb6503b3b8c0&scope.project.id=27fffefbce874beab07ae5240b7f0d10&role.id=a65ce6e645574561bb50ce9148d0637a => generated 260 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:11.118238 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6910c-a30d-4871-b118-1246f1f32a56 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:11.130109 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1dd52-0c6c-48a7-aa17-c22f7a76809f None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:11.186369 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda586d1-8710-41f8-85a4-a65ec106f938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:11.187521 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda586d1-8710-41f8-85a4-a65ec106f938 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:11.188011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda586d1-8710-41f8-85a4-a65ec106f938 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:11.188487 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda586d1-8710-41f8-85a4-a65ec106f938 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:11.190896 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda586d1-8710-41f8-85a4-a65ec106f938 None admin] RBAC: Adding query filter params (group.id=e7ea14e5c95744a3b3fecb6503b3b8c0, role.id=b624791ed6aa460fa31372c80cf5991d, scope.project.id=27fffefbce874beab07ae5240b7f0d10) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:11.191416 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda586d1-8710-41f8-85a4-a65ec106f938 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:11.195156 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda586d1-8710-41f8-85a4-a65ec106f938 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:11.209883 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 175/365] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:19:10 2022] GET /identity/v3/role_assignments?group.id=e7ea14e5c95744a3b3fecb6503b3b8c0&scope.project.id=27fffefbce874beab07ae5240b7f0d10&role.id=b624791ed6aa460fa31372c80cf5991d => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:11.212215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda586d1-8710-41f8-85a4-a65ec106f938 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:11.250525 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6910c-a30d-4871-b118-1246f1f32a56 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:11.310270 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913292e-f24f-4218-accd-1ee5ca5f7e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:11.311758 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913292e-f24f-4218-accd-1ee5ca5f7e4d None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:11.312580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913292e-f24f-4218-accd-1ee5ca5f7e4d None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:11.313238 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913292e-f24f-4218-accd-1ee5ca5f7e4d None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:11.314806 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913292e-f24f-4218-accd-1ee5ca5f7e4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:11.315575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913292e-f24f-4218-accd-1ee5ca5f7e4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:11.320486 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913292e-f24f-4218-accd-1ee5ca5f7e4d None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:11.339291 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 191/366] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:19:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:11.341165 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913292e-f24f-4218-accd-1ee5ca5f7e4d None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:11.389438 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda586d1-8710-41f8-85a4-a65ec106f938 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:11.441069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ff211-59f1-461c-beec-d2a183db3edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:11.441555 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ff211-59f1-461c-beec-d2a183db3edb None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:11.441971 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ff211-59f1-461c-beec-d2a183db3edb None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:11.442389 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ff211-59f1-461c-beec-d2a183db3edb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:11.445094 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ff211-59f1-461c-beec-d2a183db3edb None admin] RBAC: Adding query filter params (group.id=e7ea14e5c95744a3b3fecb6503b3b8c0, role.id=a65ce6e645574561bb50ce9148d0637a, scope.project.id=46dbfbf04ba34604abb1879881e3e4d9) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:11.445570 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ff211-59f1-461c-beec-d2a183db3edb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:11.447516 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ff211-59f1-461c-beec-d2a183db3edb None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:11.454915 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 176/367] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:19:11 2022] GET /identity/v3/role_assignments?group.id=e7ea14e5c95744a3b3fecb6503b3b8c0&scope.project.id=46dbfbf04ba34604abb1879881e3e4d9&role.id=a65ce6e645574561bb50ce9148d0637a => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:11.455923 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ff211-59f1-461c-beec-d2a183db3edb None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:11.584334 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913292e-f24f-4218-accd-1ee5ca5f7e4d None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:11.632106 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ff211-59f1-461c-beec-d2a183db3edb None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:11.667992 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba349796-da24-4f60-b486-66d42d4051d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:11.669024 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba349796-da24-4f60-b486-66d42d4051d9 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:11.669349 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba349796-da24-4f60-b486-66d42d4051d9 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:11.671269 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba349796-da24-4f60-b486-66d42d4051d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:11.695421 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba349796-da24-4f60-b486-66d42d4051d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:11.706407 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6854e0c-3839-4331-bbb4-d8c664afc9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:11.707252 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6854e0c-3839-4331-bbb4-d8c664afc9cb None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:11.707594 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6854e0c-3839-4331-bbb4-d8c664afc9cb None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:11.708101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6854e0c-3839-4331-bbb4-d8c664afc9cb None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:11.709229 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6854e0c-3839-4331-bbb4-d8c664afc9cb None admin] RBAC: Adding query filter params (name=reader) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:11.709661 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6854e0c-3839-4331-bbb4-d8c664afc9cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:11.711390 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6854e0c-3839-4331-bbb4-d8c664afc9cb None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:11.717129 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-ba349796-da24-4f60-b486-66d42d4051d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:19:11.717129 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:11.717129 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:11.717129 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:11.717129 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:11.717129 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:11.717129 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:11.717129 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:11.717129 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:11.717129 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:11.717129 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:11.717129 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:11.717129 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:11.717129 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:11.717129 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:11.717129 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:11.718427 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:11.718427 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:11.718427 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:11.718427 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:11.718427 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:11.718427 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:11.718427 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:11.718427 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:11.718427 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:11.718427 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:11.718427 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:11.718427 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:11.718427 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:11.718427 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:11.718427 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:11.718427 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:11.719385 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:11.719385 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:11.719385 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:11.719385 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:11.719385 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:11.719385 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:11.719385 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:11.719385 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:11.719385 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:11.719385 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:11.719385 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:19:11.719385 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:11.719385 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 192/368] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:19:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:11.720275 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba349796-da24-4f60-b486-66d42d4051d9 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:11.734197 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 177/369] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:19:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:11.738244 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6854e0c-3839-4331-bbb4-d8c664afc9cb None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:11.901486 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba349796-da24-4f60-b486-66d42d4051d9 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:11.909819 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6854e0c-3839-4331-bbb4-d8c664afc9cb None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:11.947245 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c200f5-284a-4cd7-a47c-f7374abe56da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:11.948030 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c200f5-284a-4cd7-a47c-f7374abe56da None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:11.948354 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c200f5-284a-4cd7-a47c-f7374abe56da None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:11.948730 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c200f5-284a-4cd7-a47c-f7374abe56da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:11.964235 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0854b42-3ed5-48dd-85cd-4613ec4df88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:11.965360 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0854b42-3ed5-48dd-85cd-4613ec4df88b None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:11.965673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0854b42-3ed5-48dd-85cd-4613ec4df88b None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:11.965955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0854b42-3ed5-48dd-85cd-4613ec4df88b None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:11.967111 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0854b42-3ed5-48dd-85cd-4613ec4df88b None admin] RBAC: Adding query filter params (name=admin) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:11.967421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0854b42-3ed5-48dd-85cd-4613ec4df88b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:11.969160 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0854b42-3ed5-48dd-85cd-4613ec4df88b None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:11.987589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 178/370] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:19:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:11.992322 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0854b42-3ed5-48dd-85cd-4613ec4df88b None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:12.083298 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c200f5-284a-4cd7-a47c-f7374abe56da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:12.086169 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c200f5-284a-4cd7-a47c-f7374abe56da None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:12.153276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0854b42-3ed5-48dd-85cd-4613ec4df88b None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:12.230497 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c562af6-eef4-4fd0-8df2-aae3cff44886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:12.231411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c562af6-eef4-4fd0-8df2-aae3cff44886 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:12.231699 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c562af6-eef4-4fd0-8df2-aae3cff44886 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:12.231971 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c562af6-eef4-4fd0-8df2-aae3cff44886 None admin] PATH_INFO: `/v3/users/0edaadacd1254060a8c15f24a1cbdb3f` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:12.233746 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c562af6-eef4-4fd0-8df2-aae3cff44886 None admin] RBAC: Authorizing `identity:get_user(user_id=0edaadacd1254060a8c15f24a1cbdb3f)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:12.238190 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c562af6-eef4-4fd0-8df2-aae3cff44886 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:12.240810 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 179/371] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:19:11 2022] GET /identity/v3/users/0edaadacd1254060a8c15f24a1cbdb3f => generated 293 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:12.241552 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c562af6-eef4-4fd0-8df2-aae3cff44886 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:12.310180 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 193/372] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:19:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:19:12.311046 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c200f5-284a-4cd7-a47c-f7374abe56da None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:12.465146 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c562af6-eef4-4fd0-8df2-aae3cff44886 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:12.502876 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c200f5-284a-4cd7-a47c-f7374abe56da None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:12.511195 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ebf1b-3841-4fd9-ac27-2bdf287b9626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:12.512285 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ebf1b-3841-4fd9-ac27-2bdf287b9626 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:12.512770 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ebf1b-3841-4fd9-ac27-2bdf287b9626 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:12.513125 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ebf1b-3841-4fd9-ac27-2bdf287b9626 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:12.558805 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e1328-3204-41ab-98cd-1a227e935dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:12.559893 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e1328-3204-41ab-98cd-1a227e935dac None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:12.560386 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e1328-3204-41ab-98cd-1a227e935dac None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:12.561474 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e1328-3204-41ab-98cd-1a227e935dac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:12.562727 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e1328-3204-41ab-98cd-1a227e935dac None admin] RBAC: Adding query filter params (role.id=1cf9a76305b6469cb57c1115c9cb198b, user.id=0edaadacd1254060a8c15f24a1cbdb3f, scope.system=all) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:12.563279 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e1328-3204-41ab-98cd-1a227e935dac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:12.564941 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e1328-3204-41ab-98cd-1a227e935dac None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:12.581214 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 194/373] 10.222.0.48 () {56 vars in 1308 bytes} [Mon May 9 15:19:12 2022] GET /identity/v3/role_assignments?user.id=0edaadacd1254060a8c15f24a1cbdb3f&scope.system=all&role.id=1cf9a76305b6469cb57c1115c9cb198b => generated 510 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:12.586112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e1328-3204-41ab-98cd-1a227e935dac None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:12.679822 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ebf1b-3841-4fd9-ac27-2bdf287b9626 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:12.681711 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ebf1b-3841-4fd9-ac27-2bdf287b9626 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:12.791191 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e1328-3204-41ab-98cd-1a227e935dac None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:12.846482 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4759e17-bfeb-4757-8095-6ccbd8762568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:12.847875 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4759e17-bfeb-4757-8095-6ccbd8762568 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:12.848907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4759e17-bfeb-4757-8095-6ccbd8762568 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:12.849475 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4759e17-bfeb-4757-8095-6ccbd8762568 None admin] PATH_INFO: `/v3/projects/46dbfbf04ba34604abb1879881e3e4d9` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:12.853431 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4759e17-bfeb-4757-8095-6ccbd8762568 None admin] RBAC: Authorizing `identity:get_project(project_id=46dbfbf04ba34604abb1879881e3e4d9)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:12.856926 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4759e17-bfeb-4757-8095-6ccbd8762568 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:12.867131 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 195/374] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:19:12 2022] GET /identity/v3/projects/46dbfbf04ba34604abb1879881e3e4d9 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:12.884131 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4759e17-bfeb-4757-8095-6ccbd8762568 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:12.926052 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 180/375] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:19:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:19:12.937353 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ebf1b-3841-4fd9-ac27-2bdf287b9626 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:13.102611 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ebf1b-3841-4fd9-ac27-2bdf287b9626 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:13.134114 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4759e17-bfeb-4757-8095-6ccbd8762568 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:13.165780 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928704f0-9246-48ad-b6c8-051f5a92daad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:13.167373 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928704f0-9246-48ad-b6c8-051f5a92daad None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:13.167891 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928704f0-9246-48ad-b6c8-051f5a92daad None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:13.168368 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928704f0-9246-48ad-b6c8-051f5a92daad None admin] PATH_INFO: `/v3/projects/0a3979039e1b469e8159aa2395cc78de` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:13.174635 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928704f0-9246-48ad-b6c8-051f5a92daad None admin] RBAC: Authorizing `identity:get_project(project_id=0a3979039e1b469e8159aa2395cc78de)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:13.177240 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928704f0-9246-48ad-b6c8-051f5a92daad None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:13.177718 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001bee8-3ed7-42f0-a6a9-d77c3ae54c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:13.178920 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001bee8-3ed7-42f0-a6a9-d77c3ae54c50 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:13.179209 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001bee8-3ed7-42f0-a6a9-d77c3ae54c50 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:13.179568 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001bee8-3ed7-42f0-a6a9-d77c3ae54c50 None admin] PATH_INFO: `/v3/groups/e7ea14e5c95744a3b3fecb6503b3b8c0` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:13.188970 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 181/376] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:19:12 2022] GET /identity/v3/projects/0a3979039e1b469e8159aa2395cc78de => generated 344 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:13.190330 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001bee8-3ed7-42f0-a6a9-d77c3ae54c50 None admin] RBAC: Authorizing `identity:get_group(group_id=e7ea14e5c95744a3b3fecb6503b3b8c0)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:13.192435 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001bee8-3ed7-42f0-a6a9-d77c3ae54c50 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:13.195670 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 196/377] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:19:12 2022] GET /identity/v3/groups/e7ea14e5c95744a3b3fecb6503b3b8c0 => generated 226 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:13.197147 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928704f0-9246-48ad-b6c8-051f5a92daad None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:13.204505 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001bee8-3ed7-42f0-a6a9-d77c3ae54c50 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:13.357449 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928704f0-9246-48ad-b6c8-051f5a92daad None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:13.400756 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfd7f8-c46a-438d-9e71-b374478c204e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:13.402357 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfd7f8-c46a-438d-9e71-b374478c204e None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:13.402652 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfd7f8-c46a-438d-9e71-b374478c204e None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:13.402955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfd7f8-c46a-438d-9e71-b374478c204e None admin] PATH_INFO: `/v3/groups/18608b3820e2410e98922e123a3dd01c` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:13.418292 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfd7f8-c46a-438d-9e71-b374478c204e None admin] RBAC: Authorizing `identity:get_group(group_id=18608b3820e2410e98922e123a3dd01c)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:13.419870 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfd7f8-c46a-438d-9e71-b374478c204e None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:13.425396 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 182/378] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:19:13 2022] GET /identity/v3/groups/18608b3820e2410e98922e123a3dd01c => generated 229 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:13.431270 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfd7f8-c46a-438d-9e71-b374478c204e None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:13.437725 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001bee8-3ed7-42f0-a6a9-d77c3ae54c50 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:13.524610 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efed9b5-b88f-4946-a10a-8085b32796a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:13.524610 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efed9b5-b88f-4946-a10a-8085b32796a1 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:13.524610 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efed9b5-b88f-4946-a10a-8085b32796a1 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:13.524610 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efed9b5-b88f-4946-a10a-8085b32796a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:13.525102 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efed9b5-b88f-4946-a10a-8085b32796a1 None admin] RBAC: Adding query filter params (group.id=e7ea14e5c95744a3b3fecb6503b3b8c0, role.id=b624791ed6aa460fa31372c80cf5991d, scope.project.id=46dbfbf04ba34604abb1879881e3e4d9) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:13.525102 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efed9b5-b88f-4946-a10a-8085b32796a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:13.526496 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efed9b5-b88f-4946-a10a-8085b32796a1 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:13.552782 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 197/379] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:19:13 2022] GET /identity/v3/role_assignments?group.id=e7ea14e5c95744a3b3fecb6503b3b8c0&scope.project.id=46dbfbf04ba34604abb1879881e3e4d9&role.id=b624791ed6aa460fa31372c80cf5991d => generated 260 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:13.626134 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfd7f8-c46a-438d-9e71-b374478c204e None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:13.685530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356760e7-11c5-4d2c-9e3a-963905669346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:13.687187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356760e7-11c5-4d2c-9e3a-963905669346 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:13.687995 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356760e7-11c5-4d2c-9e3a-963905669346 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:13.688584 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356760e7-11c5-4d2c-9e3a-963905669346 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:13.689774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356760e7-11c5-4d2c-9e3a-963905669346 None admin] RBAC: Adding query filter params (group.id=18608b3820e2410e98922e123a3dd01c, role.id=9aaa841361294b9c9b275ca1be0ed89c, scope.project.id=0a3979039e1b469e8159aa2395cc78de) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:13.690348 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356760e7-11c5-4d2c-9e3a-963905669346 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:13.692090 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356760e7-11c5-4d2c-9e3a-963905669346 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:13.705551 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 183/380] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:19:13 2022] GET /identity/v3/role_assignments?group.id=18608b3820e2410e98922e123a3dd01c&scope.project.id=0a3979039e1b469e8159aa2395cc78de&role.id=9aaa841361294b9c9b275ca1be0ed89c => generated 260 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:14.259887 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71ee05-7721-4d4e-b10b-2a5ba929aad3 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:14.260419 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71ee05-7721-4d4e-b10b-2a5ba929aad3 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:14.260507 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71ee05-7721-4d4e-b10b-2a5ba929aad3 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:14.262283 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 198/381] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:14.270788 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff02b3-0c9f-4bc8-bbcc-08cba2027065 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:14.272090 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff02b3-0c9f-4bc8-bbcc-08cba2027065 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:14.272090 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff02b3-0c9f-4bc8-bbcc-08cba2027065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:14.296203 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-1dff02b3-0c9f-4bc8-bbcc-08cba2027065 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:14.297699 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-1dff02b3-0c9f-4bc8-bbcc-08cba2027065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:14.395365 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 184/382] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:14.434802 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71ee05-7721-4d4e-b10b-2a5ba929aad3 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:14.576155 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71ee05-7721-4d4e-b10b-2a5ba929aad3 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:14.582185 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdad533-b198-4bb0-915f-9a78e33d5b26 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:14.582498 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdad533-b198-4bb0-915f-9a78e33d5b26 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:14.582755 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdad533-b198-4bb0-915f-9a78e33d5b26 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:14.584592 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 185/383] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:14.595105 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba910a4-9bf9-4d59-b2e6-21974f041a9b None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:14.595498 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba910a4-9bf9-4d59-b2e6-21974f041a9b None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:14.595886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba910a4-9bf9-4d59-b2e6-21974f041a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:14.620183 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-8ba910a4-9bf9-4d59-b2e6-21974f041a9b None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:14.621506 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-8ba910a4-9bf9-4d59-b2e6-21974f041a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:14.658446 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ceaff-6e26-4ab3-a914-4177cacee65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:14.659276 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ceaff-6e26-4ab3-a914-4177cacee65d None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:14.659594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ceaff-6e26-4ab3-a914-4177cacee65d None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:14.659873 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ceaff-6e26-4ab3-a914-4177cacee65d None admin] PATH_INFO: `/v3/roles/member` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:14.680207 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ceaff-6e26-4ab3-a914-4177cacee65d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:14.688128 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-2c8ceaff-6e26-4ab3-a914-4177cacee65d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:19:14.688128 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:14.688128 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:14.688128 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:14.688128 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:14.688128 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:14.688128 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:14.688128 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:14.688128 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:14.688128 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:14.688128 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:14.688128 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:14.688128 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:14.688128 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:14.688128 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:14.688128 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:14.689221 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:14.689221 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:14.689221 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:14.689221 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:14.689221 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:14.689221 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:14.689221 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:14.689221 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:14.689221 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:14.689221 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:14.689221 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:14.689221 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:14.689221 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:14.689221 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:14.689221 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:14.689221 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:14.690684 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:14.690684 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:14.690684 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:14.690684 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:14.690684 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:14.690684 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:14.690684 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:14.690684 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:14.690684 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:14.690684 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:14.690684 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:19:14.690684 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:14.691423 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 199/384] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:19:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:14.700115 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ceaff-6e26-4ab3-a914-4177cacee65d None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:14.754393 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 186/385] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:14.793094 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba910a4-9bf9-4d59-b2e6-21974f041a9b None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:14.933836 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ceaff-6e26-4ab3-a914-4177cacee65d None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:14.973926 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd420c0c-383b-454d-a8fa-ea159fbc0cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:14.976334 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd420c0c-383b-454d-a8fa-ea159fbc0cf4 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:14.976845 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd420c0c-383b-454d-a8fa-ea159fbc0cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:14.977316 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd420c0c-383b-454d-a8fa-ea159fbc0cf4 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:14.978331 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd420c0c-383b-454d-a8fa-ea159fbc0cf4 None admin] RBAC: Adding query filter params (name=member) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:14.978853 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd420c0c-383b-454d-a8fa-ea159fbc0cf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:14.980607 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd420c0c-383b-454d-a8fa-ea159fbc0cf4 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:14.989709 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba910a4-9bf9-4d59-b2e6-21974f041a9b None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:14.996189 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 200/386] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:19:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:14.998063 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d83978-8e55-452b-a731-f7399c699d57 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:14.998566 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d83978-8e55-452b-a731-f7399c699d57 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:14.999077 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d83978-8e55-452b-a731-f7399c699d57 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:15.000692 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 201/387] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:15.002116 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d83978-8e55-452b-a731-f7399c699d57 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:15.049085 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd237e3-455e-41c5-836a-1984e66b60b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:15.050335 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd237e3-455e-41c5-836a-1984e66b60b2 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:15.050811 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd237e3-455e-41c5-836a-1984e66b60b2 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:15.051430 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd237e3-455e-41c5-836a-1984e66b60b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:15.065688 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd237e3-455e-41c5-836a-1984e66b60b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:15.075638 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-0cd237e3-455e-41c5-836a-1984e66b60b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:19:15.075638 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:15.075638 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:15.075638 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:15.075638 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:15.075638 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:15.075638 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:15.075638 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:15.075638 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:15.075638 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:15.075638 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:15.075638 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:15.075638 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:15.075638 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:15.075638 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:15.075638 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:15.076988 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:15.076988 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:15.076988 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:15.076988 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:15.076988 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:15.076988 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:15.076988 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:15.076988 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:15.076988 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:15.076988 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:15.076988 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:15.076988 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:15.076988 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:15.076988 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:15.076988 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:15.076988 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:15.078161 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:15.078161 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:15.078161 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:15.078161 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:15.078161 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:15.078161 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:15.078161 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:15.078161 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:15.078161 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:15.078161 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:15.078161 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:19:15.078161 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:15.081249 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 187/388] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:19:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:19:15.084044 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08c7ea-79ea-4edf-b366-af1f5c201274 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:15.085128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08c7ea-79ea-4edf-b366-af1f5c201274 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:15.085616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08c7ea-79ea-4edf-b366-af1f5c201274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:15.107756 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-4c08c7ea-79ea-4edf-b366-af1f5c201274 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:15.109665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-4c08c7ea-79ea-4edf-b366-af1f5c201274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:15.200841 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d83978-8e55-452b-a731-f7399c699d57 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:15.225601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 188/389] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:15.227576 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08c7ea-79ea-4edf-b366-af1f5c201274 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:15.281347 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039682d-f48b-4233-861f-adb4692f4aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:15.282471 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039682d-f48b-4233-861f-adb4692f4aa5 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:15.282645 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039682d-f48b-4233-861f-adb4692f4aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:15.282916 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039682d-f48b-4233-861f-adb4692f4aa5 None admin] PATH_INFO: `/v3/groups/e7ea14e5c95744a3b3fecb6503b3b8c0` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:15.284285 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e039682d-f48b-4233-861f-adb4692f4aa5 None admin] RBAC: Authorizing `identity:get_group(group_id=e7ea14e5c95744a3b3fecb6503b3b8c0)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:15.285846 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e039682d-f48b-4233-861f-adb4692f4aa5 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:15.293411 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 202/390] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:19:15 2022] GET /identity/v3/groups/e7ea14e5c95744a3b3fecb6503b3b8c0 => generated 226 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:15.293411 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039682d-f48b-4233-861f-adb4692f4aa5 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:15.403742 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039682d-f48b-4233-861f-adb4692f4aa5 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:15.440084 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5058ef4-5823-4668-a4e8-277810da8580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:15.440881 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5058ef4-5823-4668-a4e8-277810da8580 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:15.441204 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5058ef4-5823-4668-a4e8-277810da8580 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:15.441500 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5058ef4-5823-4668-a4e8-277810da8580 None admin] PATH_INFO: `/v3/roles/member` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:15.453164 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5058ef4-5823-4668-a4e8-277810da8580 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:15.462381 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-f5058ef4-5823-4668-a4e8-277810da8580 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:19:15.462381 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:15.462381 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:15.462381 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:15.462381 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:15.462381 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:15.462381 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:15.462381 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:15.462381 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:15.462381 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:15.462381 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:15.462381 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:15.462381 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:15.462381 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:15.462381 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:15.462381 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:15.464387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:15.464387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:15.464387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:15.464387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:15.464387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:15.464387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:15.464387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:15.464387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:15.464387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:15.464387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:15.464387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:15.464387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:15.464387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:15.464387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:15.464387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:15.464387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:15.466927 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:15.466927 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:15.466927 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:15.466927 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:15.466927 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:15.466927 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:15.466927 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:15.466927 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:15.466927 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:15.466927 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:15.466927 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:19:15.466927 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:15.469493 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 203/391] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:19:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:15.469493 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5058ef4-5823-4668-a4e8-277810da8580 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:15.471234 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08c7ea-79ea-4edf-b366-af1f5c201274 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:15.545123 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8d967-74e0-4077-a8d2-f5e199e7167e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:15.546065 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8d967-74e0-4077-a8d2-f5e199e7167e None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:15.546393 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8d967-74e0-4077-a8d2-f5e199e7167e None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:15.546739 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8d967-74e0-4077-a8d2-f5e199e7167e None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:15.547835 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8d967-74e0-4077-a8d2-f5e199e7167e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:15.548572 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8d967-74e0-4077-a8d2-f5e199e7167e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:15.550642 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8d967-74e0-4077-a8d2-f5e199e7167e None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:15.562880 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 189/392] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:19:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:15.564387 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8d967-74e0-4077-a8d2-f5e199e7167e None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:15.621402 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5058ef4-5823-4668-a4e8-277810da8580 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:15.667322 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd3ee5-58af-4f36-8fb9-83dc81bc30d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:15.669768 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd3ee5-58af-4f36-8fb9-83dc81bc30d7 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:15.669903 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd3ee5-58af-4f36-8fb9-83dc81bc30d7 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:15.670183 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd3ee5-58af-4f36-8fb9-83dc81bc30d7 None admin] PATH_INFO: `/v3/projects/27fffefbce874beab07ae5240b7f0d10` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:15.673934 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd3ee5-58af-4f36-8fb9-83dc81bc30d7 None admin] RBAC: Authorizing `identity:get_project(project_id=27fffefbce874beab07ae5240b7f0d10)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:15.676121 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd3ee5-58af-4f36-8fb9-83dc81bc30d7 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:15.680009 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 204/393] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:19:15 2022] GET /identity/v3/projects/27fffefbce874beab07ae5240b7f0d10 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:15.681475 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd3ee5-58af-4f36-8fb9-83dc81bc30d7 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:15.709695 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8d967-74e0-4077-a8d2-f5e199e7167e None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:15.767688 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2d7cd-6548-4fe4-a0c7-55d5796340c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:15.769507 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2d7cd-6548-4fe4-a0c7-55d5796340c4 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:15.770170 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2d7cd-6548-4fe4-a0c7-55d5796340c4 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:15.771054 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2d7cd-6548-4fe4-a0c7-55d5796340c4 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:15.772495 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2d7cd-6548-4fe4-a0c7-55d5796340c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:15.773293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2d7cd-6548-4fe4-a0c7-55d5796340c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:15.776063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2d7cd-6548-4fe4-a0c7-55d5796340c4 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:15.791679 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 190/394] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:19:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:15.791679 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2d7cd-6548-4fe4-a0c7-55d5796340c4 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:15.822917 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd3ee5-58af-4f36-8fb9-83dc81bc30d7 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:15.872239 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b189c3-4b33-4500-9f4b-f54e52dbf9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:15.873331 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b189c3-4b33-4500-9f4b-f54e52dbf9a6 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:15.873751 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b189c3-4b33-4500-9f4b-f54e52dbf9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:15.874142 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b189c3-4b33-4500-9f4b-f54e52dbf9a6 None admin] PATH_INFO: `/v3/groups/e7ea14e5c95744a3b3fecb6503b3b8c0` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:15.875634 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b189c3-4b33-4500-9f4b-f54e52dbf9a6 None admin] RBAC: Authorizing `identity:get_group(group_id=e7ea14e5c95744a3b3fecb6503b3b8c0)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:15.877273 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b189c3-4b33-4500-9f4b-f54e52dbf9a6 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:15.879881 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 205/395] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:19:15 2022] GET /identity/v3/groups/e7ea14e5c95744a3b3fecb6503b3b8c0 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:15.881810 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b189c3-4b33-4500-9f4b-f54e52dbf9a6 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:15.934947 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2d7cd-6548-4fe4-a0c7-55d5796340c4 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:15.984010 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4b47e-1000-47ff-967e-da20a9237886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:15.985167 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4b47e-1000-47ff-967e-da20a9237886 None admin] REQUEST_METHOD: `PUT` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:15.985680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4b47e-1000-47ff-967e-da20a9237886 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:15.986107 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4b47e-1000-47ff-967e-da20a9237886 None admin] PATH_INFO: `/v3/projects/27fffefbce874beab07ae5240b7f0d10/groups/e7ea14e5c95744a3b3fecb6503b3b8c0/roles/a65ce6e645574561bb50ce9148d0637a` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:15.988885 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4b47e-1000-47ff-967e-da20a9237886 None admin] RBAC: Authorizing `identity:create_grant(project_id=27fffefbce874beab07ae5240b7f0d10, group_id=e7ea14e5c95744a3b3fecb6503b3b8c0, role_id=a65ce6e645574561bb50ce9148d0637a)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:15.992221 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4b47e-1000-47ff-967e-da20a9237886 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:16.011708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 191/396] 10.222.0.48 () {58 vars in 1442 bytes} [Mon May 9 15:19:15 2022] PUT /identity/v3/projects/27fffefbce874beab07ae5240b7f0d10/groups/e7ea14e5c95744a3b3fecb6503b3b8c0/roles/a65ce6e645574561bb50ce9148d0637a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:19:16.012931 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4b47e-1000-47ff-967e-da20a9237886 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:16.033565 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b189c3-4b33-4500-9f4b-f54e52dbf9a6 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:16.113951 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf22d5-56bc-41ed-bd42-e2125d2f2178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:16.115688 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf22d5-56bc-41ed-bd42-e2125d2f2178 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:16.116219 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf22d5-56bc-41ed-bd42-e2125d2f2178 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:16.116741 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf22d5-56bc-41ed-bd42-e2125d2f2178 None admin] PATH_INFO: `/v3/groups/e7ea14e5c95744a3b3fecb6503b3b8c0` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:16.118237 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf22d5-56bc-41ed-bd42-e2125d2f2178 None admin] RBAC: Authorizing `identity:get_group(group_id=e7ea14e5c95744a3b3fecb6503b3b8c0)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:16.120035 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf22d5-56bc-41ed-bd42-e2125d2f2178 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:16.122785 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 206/397] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:19:15 2022] GET /identity/v3/groups/e7ea14e5c95744a3b3fecb6503b3b8c0 => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:16.128497 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf22d5-56bc-41ed-bd42-e2125d2f2178 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:16.253039 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4b47e-1000-47ff-967e-da20a9237886 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:16.301205 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf22d5-56bc-41ed-bd42-e2125d2f2178 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:16.313578 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d420f93-5cbf-4761-8999-67aac4fb1040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:16.314556 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d420f93-5cbf-4761-8999-67aac4fb1040 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:16.314869 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d420f93-5cbf-4761-8999-67aac4fb1040 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:16.315152 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d420f93-5cbf-4761-8999-67aac4fb1040 None admin] PATH_INFO: `/v3/projects/27fffefbce874beab07ae5240b7f0d10` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:16.318807 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d420f93-5cbf-4761-8999-67aac4fb1040 None admin] RBAC: Authorizing `identity:get_project(project_id=27fffefbce874beab07ae5240b7f0d10)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:16.320370 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d420f93-5cbf-4761-8999-67aac4fb1040 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:16.322833 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 192/398] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:19:16 2022] GET /identity/v3/projects/27fffefbce874beab07ae5240b7f0d10 => generated 298 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:16.330908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d420f93-5cbf-4761-8999-67aac4fb1040 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:16.361127 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfeac9-0f26-45de-adc0-e43d321e5aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:16.364023 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfeac9-0f26-45de-adc0-e43d321e5aa7 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:16.365263 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfeac9-0f26-45de-adc0-e43d321e5aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:16.366057 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfeac9-0f26-45de-adc0-e43d321e5aa7 None admin] PATH_INFO: `/v3/projects/46dbfbf04ba34604abb1879881e3e4d9` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:16.368591 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfeac9-0f26-45de-adc0-e43d321e5aa7 None admin] RBAC: Authorizing `identity:get_project(project_id=46dbfbf04ba34604abb1879881e3e4d9)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:16.370956 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfeac9-0f26-45de-adc0-e43d321e5aa7 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:16.381247 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 207/399] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:19:16 2022] GET /identity/v3/projects/46dbfbf04ba34604abb1879881e3e4d9 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:16.382918 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfeac9-0f26-45de-adc0-e43d321e5aa7 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:16.531204 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d420f93-5cbf-4761-8999-67aac4fb1040 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:16.545553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfeac9-0f26-45de-adc0-e43d321e5aa7 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:16.574213 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8edda-c5d5-496a-825e-b17eff6bd5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:16.575433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8edda-c5d5-496a-825e-b17eff6bd5af None admin] REQUEST_METHOD: `PUT` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:16.575802 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8edda-c5d5-496a-825e-b17eff6bd5af None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:16.576126 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8edda-c5d5-496a-825e-b17eff6bd5af None admin] PATH_INFO: `/v3/projects/27fffefbce874beab07ae5240b7f0d10/groups/e7ea14e5c95744a3b3fecb6503b3b8c0/roles/b624791ed6aa460fa31372c80cf5991d` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:16.578920 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8edda-c5d5-496a-825e-b17eff6bd5af None admin] RBAC: Authorizing `identity:create_grant(project_id=27fffefbce874beab07ae5240b7f0d10, group_id=e7ea14e5c95744a3b3fecb6503b3b8c0, role_id=b624791ed6aa460fa31372c80cf5991d)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:16.581394 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8edda-c5d5-496a-825e-b17eff6bd5af None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:16.593911 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b4898-7e4e-4e93-bb54-27428fef2173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:16.594877 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b4898-7e4e-4e93-bb54-27428fef2173 None admin] REQUEST_METHOD: `PUT` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:16.595192 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b4898-7e4e-4e93-bb54-27428fef2173 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:16.595482 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b4898-7e4e-4e93-bb54-27428fef2173 None admin] PATH_INFO: `/v3/projects/46dbfbf04ba34604abb1879881e3e4d9/groups/e7ea14e5c95744a3b3fecb6503b3b8c0/roles/a65ce6e645574561bb50ce9148d0637a` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:16.597606 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b4898-7e4e-4e93-bb54-27428fef2173 None admin] RBAC: Authorizing `identity:create_grant(project_id=46dbfbf04ba34604abb1879881e3e4d9, group_id=e7ea14e5c95744a3b3fecb6503b3b8c0, role_id=a65ce6e645574561bb50ce9148d0637a)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:16.599228 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b4898-7e4e-4e93-bb54-27428fef2173 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:16.605616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 193/400] 10.222.0.48 () {58 vars in 1442 bytes} [Mon May 9 15:19:16 2022] PUT /identity/v3/projects/27fffefbce874beab07ae5240b7f0d10/groups/e7ea14e5c95744a3b3fecb6503b3b8c0/roles/b624791ed6aa460fa31372c80cf5991d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:19:16.605616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88731394-2991-42f8-8213-2f5b4db55b5a None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:16.605616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88731394-2991-42f8-8213-2f5b4db55b5a None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:16.605616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88731394-2991-42f8-8213-2f5b4db55b5a None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:16.605616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 194/401] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:16.606179 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b622d19-705f-44c5-8f24-1393e823e2c8 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:16.606479 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b622d19-705f-44c5-8f24-1393e823e2c8 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:16.606812 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b622d19-705f-44c5-8f24-1393e823e2c8 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:16.612669 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 195/402] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:16.614231 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91a9b4-fe33-4ead-bc4c-654e653aa076 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:16.615313 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91a9b4-fe33-4ead-bc4c-654e653aa076 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:16.616463 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91a9b4-fe33-4ead-bc4c-654e653aa076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:16.629809 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 208/403] 10.222.0.48 () {58 vars in 1442 bytes} [Mon May 9 15:19:16 2022] PUT /identity/v3/projects/46dbfbf04ba34604abb1879881e3e4d9/groups/e7ea14e5c95744a3b3fecb6503b3b8c0/roles/a65ce6e645574561bb50ce9148d0637a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:19:16.632096 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c930dd3-6f3c-486a-a69b-49c8bf24a9fb None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:16.632447 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c930dd3-6f3c-486a-a69b-49c8bf24a9fb None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:16.632876 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c930dd3-6f3c-486a-a69b-49c8bf24a9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:16.637549 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-4d91a9b4-fe33-4ead-bc4c-654e653aa076 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:16.639227 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-4d91a9b4-fe33-4ead-bc4c-654e653aa076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:16.665603 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-6c930dd3-6f3c-486a-a69b-49c8bf24a9fb None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:16.666895 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-6c930dd3-6f3c-486a-a69b-49c8bf24a9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:16.820115 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 196/404] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:16.860803 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91a9b4-fe33-4ead-bc4c-654e653aa076 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:16.861448 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 209/405] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:16.886676 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c930dd3-6f3c-486a-a69b-49c8bf24a9fb None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:16.999326 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91a9b4-fe33-4ead-bc4c-654e653aa076 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:17.015979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c930dd3-6f3c-486a-a69b-49c8bf24a9fb None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:17.042781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b01d6-c6fd-4257-8adb-c147827405c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:17.043914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b01d6-c6fd-4257-8adb-c147827405c2 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:17.044219 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b01d6-c6fd-4257-8adb-c147827405c2 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:17.044502 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b01d6-c6fd-4257-8adb-c147827405c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:17.059188 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0cb82-f3d4-4099-9c19-da7a1bf6a5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:17.059450 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b01d6-c6fd-4257-8adb-c147827405c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:17.060530 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0cb82-f3d4-4099-9c19-da7a1bf6a5a0 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:17.061039 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0cb82-f3d4-4099-9c19-da7a1bf6a5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:17.061563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0cb82-f3d4-4099-9c19-da7a1bf6a5a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:17.069515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-d30b01d6-c6fd-4257-8adb-c147827405c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:19:17.069515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:17.069515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:17.069515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:17.069515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:17.069515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:17.069515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:17.069515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:17.069515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:17.069515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:17.069515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:17.069515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:17.069515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:17.069515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:17.069515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:17.069515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:17.070678 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:17.070678 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:17.070678 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:17.070678 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:17.070678 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:17.070678 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:17.070678 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:17.070678 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:17.070678 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:17.070678 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:17.070678 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:17.070678 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:17.070678 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:17.070678 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:17.070678 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:17.070678 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:17.071746 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:17.071746 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:17.071746 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:17.071746 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:17.071746 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:17.071746 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:17.071746 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:17.071746 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:17.071746 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:17.071746 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:17.071746 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:19:17.071746 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:17.071746 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 197/406] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:19:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:19:17.077420 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b01d6-c6fd-4257-8adb-c147827405c2 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:17.081228 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0cb82-f3d4-4099-9c19-da7a1bf6a5a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:17.091583 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-8ae0cb82-f3d4-4099-9c19-da7a1bf6a5a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:19:17.091583 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:17.091583 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:17.091583 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:17.091583 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:17.091583 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:17.091583 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:17.091583 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:17.091583 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:17.091583 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:17.091583 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:17.091583 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:17.091583 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:17.091583 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:17.091583 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:17.091583 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:17.092817 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:17.092817 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:17.092817 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:17.092817 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:17.092817 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:17.092817 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:17.092817 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:17.092817 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:17.092817 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:17.092817 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:17.092817 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:17.092817 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:17.092817 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:17.092817 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:17.092817 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:17.092817 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:17.093978 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:17.093978 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:17.093978 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:17.093978 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:17.093978 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:17.093978 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:17.093978 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:17.093978 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:17.093978 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:17.093978 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:17.093978 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:19:17.093978 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:17.097521 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 210/407] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:19:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:19:17.108619 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0cb82-f3d4-4099-9c19-da7a1bf6a5a0 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:17.297536 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0cb82-f3d4-4099-9c19-da7a1bf6a5a0 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:17.313662 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b01d6-c6fd-4257-8adb-c147827405c2 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:17.358235 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c81e5-9748-4c34-abf5-e7cafbce6691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:17.358439 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a3868-ee86-441f-adfd-21c6aa6b7c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:17.358892 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c81e5-9748-4c34-abf5-e7cafbce6691 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:17.359145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c81e5-9748-4c34-abf5-e7cafbce6691 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:17.359385 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c81e5-9748-4c34-abf5-e7cafbce6691 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:17.360151 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c81e5-9748-4c34-abf5-e7cafbce6691 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:17.360461 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c81e5-9748-4c34-abf5-e7cafbce6691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:17.360673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a3868-ee86-441f-adfd-21c6aa6b7c0f None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:17.361171 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a3868-ee86-441f-adfd-21c6aa6b7c0f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:17.361672 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a3868-ee86-441f-adfd-21c6aa6b7c0f None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:17.361900 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c81e5-9748-4c34-abf5-e7cafbce6691 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:17.362872 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a3868-ee86-441f-adfd-21c6aa6b7c0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:17.363406 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a3868-ee86-441f-adfd-21c6aa6b7c0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:17.365966 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a3868-ee86-441f-adfd-21c6aa6b7c0f None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:17.378783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 198/408] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:19:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:17.381066 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 211/409] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:19:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:17.385943 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c81e5-9748-4c34-abf5-e7cafbce6691 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:17.387195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a3868-ee86-441f-adfd-21c6aa6b7c0f None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:17.546521 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c81e5-9748-4c34-abf5-e7cafbce6691 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:17.605466 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35558c8-677e-4055-8cd1-489acebbd29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:17.607162 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35558c8-677e-4055-8cd1-489acebbd29b None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:17.607911 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35558c8-677e-4055-8cd1-489acebbd29b None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:17.608482 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35558c8-677e-4055-8cd1-489acebbd29b None admin] PATH_INFO: `/v3/groups/e7ea14e5c95744a3b3fecb6503b3b8c0` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:17.610799 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35558c8-677e-4055-8cd1-489acebbd29b None admin] RBAC: Authorizing `identity:get_group(group_id=e7ea14e5c95744a3b3fecb6503b3b8c0)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:17.613456 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35558c8-677e-4055-8cd1-489acebbd29b None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:17.618732 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 199/410] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:19:17 2022] GET /identity/v3/groups/e7ea14e5c95744a3b3fecb6503b3b8c0 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:17.631613 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35558c8-677e-4055-8cd1-489acebbd29b None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:17.637253 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a3868-ee86-441f-adfd-21c6aa6b7c0f None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:17.680732 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c727d-53d8-43a1-8a22-01bc150a0126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:17.681720 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c727d-53d8-43a1-8a22-01bc150a0126 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:17.682009 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c727d-53d8-43a1-8a22-01bc150a0126 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:17.682289 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c727d-53d8-43a1-8a22-01bc150a0126 None admin] PATH_INFO: `/v3/groups/18608b3820e2410e98922e123a3dd01c` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:17.684417 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c727d-53d8-43a1-8a22-01bc150a0126 None admin] RBAC: Authorizing `identity:get_group(group_id=18608b3820e2410e98922e123a3dd01c)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:17.685926 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c727d-53d8-43a1-8a22-01bc150a0126 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:17.694546 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 212/411] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:19:17 2022] GET /identity/v3/groups/18608b3820e2410e98922e123a3dd01c => generated 229 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:17.697573 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c727d-53d8-43a1-8a22-01bc150a0126 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:17.856815 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35558c8-677e-4055-8cd1-489acebbd29b None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:17.888682 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c727d-53d8-43a1-8a22-01bc150a0126 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:17.925924 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df11f0-1e0a-48f1-8d96-89bd6505a280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:17.927867 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df11f0-1e0a-48f1-8d96-89bd6505a280 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:17.928396 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df11f0-1e0a-48f1-8d96-89bd6505a280 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:17.928918 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df11f0-1e0a-48f1-8d96-89bd6505a280 None admin] PATH_INFO: `/v3/projects/0a3979039e1b469e8159aa2395cc78de` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:17.930445 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df11f0-1e0a-48f1-8d96-89bd6505a280 None admin] RBAC: Authorizing `identity:get_project(project_id=0a3979039e1b469e8159aa2395cc78de)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:17.932134 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df11f0-1e0a-48f1-8d96-89bd6505a280 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:17.934497 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 213/412] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:19:17 2022] GET /identity/v3/projects/0a3979039e1b469e8159aa2395cc78de => generated 344 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:17.934626 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e7839-79e7-49e6-85fe-225a8a18f42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:17.935491 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e7839-79e7-49e6-85fe-225a8a18f42e None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:17.935788 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e7839-79e7-49e6-85fe-225a8a18f42e None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:17.936069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e7839-79e7-49e6-85fe-225a8a18f42e None admin] PATH_INFO: `/v3/projects/46dbfbf04ba34604abb1879881e3e4d9` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:17.938146 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e7839-79e7-49e6-85fe-225a8a18f42e None admin] RBAC: Authorizing `identity:get_project(project_id=46dbfbf04ba34604abb1879881e3e4d9)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:17.939845 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e7839-79e7-49e6-85fe-225a8a18f42e None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:17.940895 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df11f0-1e0a-48f1-8d96-89bd6505a280 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:17.943759 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 200/413] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:19:17 2022] GET /identity/v3/projects/46dbfbf04ba34604abb1879881e3e4d9 => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:17.953926 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e7839-79e7-49e6-85fe-225a8a18f42e None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:18.148538 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df11f0-1e0a-48f1-8d96-89bd6505a280 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:18.163746 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e7839-79e7-49e6-85fe-225a8a18f42e None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:18.227147 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838406f-7ac9-4062-b7be-55ab1a618121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:18.229224 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838406f-7ac9-4062-b7be-55ab1a618121 None admin] REQUEST_METHOD: `PUT` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:18.230008 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838406f-7ac9-4062-b7be-55ab1a618121 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:18.231124 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838406f-7ac9-4062-b7be-55ab1a618121 None admin] PATH_INFO: `/v3/projects/0a3979039e1b469e8159aa2395cc78de/groups/18608b3820e2410e98922e123a3dd01c/roles/9aaa841361294b9c9b275ca1be0ed89c` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:18.235687 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838406f-7ac9-4062-b7be-55ab1a618121 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a3979039e1b469e8159aa2395cc78de, group_id=18608b3820e2410e98922e123a3dd01c, role_id=9aaa841361294b9c9b275ca1be0ed89c)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:18.237288 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f323a-049e-494c-8d46-dc4af546b5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:18.239162 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838406f-7ac9-4062-b7be-55ab1a618121 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:18.241356 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f323a-049e-494c-8d46-dc4af546b5ff None admin] REQUEST_METHOD: `PUT` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:18.241939 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f323a-049e-494c-8d46-dc4af546b5ff None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:18.242447 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f323a-049e-494c-8d46-dc4af546b5ff None admin] PATH_INFO: `/v3/projects/46dbfbf04ba34604abb1879881e3e4d9/groups/e7ea14e5c95744a3b3fecb6503b3b8c0/roles/b624791ed6aa460fa31372c80cf5991d` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:18.247949 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f323a-049e-494c-8d46-dc4af546b5ff None admin] RBAC: Authorizing `identity:create_grant(project_id=46dbfbf04ba34604abb1879881e3e4d9, group_id=e7ea14e5c95744a3b3fecb6503b3b8c0, role_id=b624791ed6aa460fa31372c80cf5991d)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:18.250681 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f323a-049e-494c-8d46-dc4af546b5ff None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:18.266620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 214/414] 10.222.0.48 () {58 vars in 1442 bytes} [Mon May 9 15:19:17 2022] PUT /identity/v3/projects/0a3979039e1b469e8159aa2395cc78de/groups/18608b3820e2410e98922e123a3dd01c/roles/9aaa841361294b9c9b275ca1be0ed89c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:19:18.272476 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 201/415] 10.222.0.48 () {58 vars in 1442 bytes} [Mon May 9 15:19:17 2022] PUT /identity/v3/projects/46dbfbf04ba34604abb1879881e3e4d9/groups/e7ea14e5c95744a3b3fecb6503b3b8c0/roles/b624791ed6aa460fa31372c80cf5991d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:19:19.218918 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98000c-2c2c-48e0-b7f7-a1af7417d67b None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:19.219463 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98000c-2c2c-48e0-b7f7-a1af7417d67b None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:19.219463 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98000c-2c2c-48e0-b7f7-a1af7417d67b None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:19.221176 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 215/416] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:19.228956 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb206a74-d763-4301-b352-e400ede221f4 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:19.230007 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb206a74-d763-4301-b352-e400ede221f4 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:19.230494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb206a74-d763-4301-b352-e400ede221f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:19.258252 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-bb206a74-d763-4301-b352-e400ede221f4 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:19.259968 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-bb206a74-d763-4301-b352-e400ede221f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:19.366819 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 202/417] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:19.401597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98000c-2c2c-48e0-b7f7-a1af7417d67b None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:19.549423 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98000c-2c2c-48e0-b7f7-a1af7417d67b None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:19.607776 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27aa09e-697f-40f5-8f9c-241d85f8de98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:19.608603 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aa09e-697f-40f5-8f9c-241d85f8de98 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:19.608892 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aa09e-697f-40f5-8f9c-241d85f8de98 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:19.609172 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aa09e-697f-40f5-8f9c-241d85f8de98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:19.628894 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27aa09e-697f-40f5-8f9c-241d85f8de98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:19.637252 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-a27aa09e-697f-40f5-8f9c-241d85f8de98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:19:19.637252 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:19.637252 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:19.637252 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:19.637252 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:19.637252 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:19.637252 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:19.637252 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:19.637252 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:19.637252 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:19.637252 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:19.637252 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:19.637252 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:19.637252 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:19.637252 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:19.637252 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:19.638424 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:19.638424 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:19.638424 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:19.638424 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:19.638424 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:19.638424 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:19.638424 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:19.638424 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:19.638424 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:19.638424 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:19.638424 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:19.638424 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:19.638424 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:19.638424 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:19.638424 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:19.638424 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:19.639374 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:19.639374 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:19.639374 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:19.639374 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:19.639374 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:19.639374 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:19.639374 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:19.639374 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:19.639374 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:19.639374 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:19.639374 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:19:19.639374 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:19.639374 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 216/418] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:19:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:19.649317 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb206a74-d763-4301-b352-e400ede221f4 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:19.649690 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013ff85-4728-474a-9319-76897a3489fd None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:19.649884 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013ff85-4728-474a-9319-76897a3489fd None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:19.650230 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013ff85-4728-474a-9319-76897a3489fd None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:19.652018 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 217/419] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:19:19.657854 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2aa82-18f8-4437-8dac-165b108be65b None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:19.658150 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2aa82-18f8-4437-8dac-165b108be65b None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:19.658408 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2aa82-18f8-4437-8dac-165b108be65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:19.676856 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-45e2aa82-18f8-4437-8dac-165b108be65b None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:19.678358 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-45e2aa82-18f8-4437-8dac-165b108be65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:19.793472 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 218/420] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:19:19.811354 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f740f8-757a-471d-b2db-c9fd829522e1 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:19.811686 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f740f8-757a-471d-b2db-c9fd829522e1 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:19.811927 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f740f8-757a-471d-b2db-c9fd829522e1 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:19.813327 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 219/421] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:19:19.830070 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa2cf0-4235-4486-873c-d3f90549d908 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:19.830425 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa2cf0-4235-4486-873c-d3f90549d908 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:19.830766 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa2cf0-4235-4486-873c-d3f90549d908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:19.850291 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-2aaa2cf0-4235-4486-873c-d3f90549d908 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:19.851521 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-2aaa2cf0-4235-4486-873c-d3f90549d908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:19.854821 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb206a74-d763-4301-b352-e400ede221f4 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:19.929971 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a867c-80a4-4fd8-b828-0276ce551a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:19.931048 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a867c-80a4-4fd8-b828-0276ce551a2c None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:19.931584 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a867c-80a4-4fd8-b828-0276ce551a2c None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:19.931969 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a867c-80a4-4fd8-b828-0276ce551a2c None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:19.932871 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a867c-80a4-4fd8-b828-0276ce551a2c None admin] RBAC: Adding query filter params (name=member) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:19.933317 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a867c-80a4-4fd8-b828-0276ce551a2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:19.935269 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a867c-80a4-4fd8-b828-0276ce551a2c None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:19.947461 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 203/422] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:19:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:19.948505 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a867c-80a4-4fd8-b828-0276ce551a2c None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:19.956611 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 220/423] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:19:19.958315 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa2cf0-4235-4486-873c-d3f90549d908 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:20.096644 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa2cf0-4235-4486-873c-d3f90549d908 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:20.108473 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a867c-80a4-4fd8-b828-0276ce551a2c None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:20.142917 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb0aa4-343a-41db-8e7a-087b19be4894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:20.143870 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb0aa4-343a-41db-8e7a-087b19be4894 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:20.144198 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb0aa4-343a-41db-8e7a-087b19be4894 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:20.144637 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb0aa4-343a-41db-8e7a-087b19be4894 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:20.155642 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e876a3-504e-49b6-9936-3cce72d154ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:20.156849 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e876a3-504e-49b6-9936-3cce72d154ba None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:20.157699 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e876a3-504e-49b6-9936-3cce72d154ba None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:20.158100 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e876a3-504e-49b6-9936-3cce72d154ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:20.175532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e876a3-504e-49b6-9936-3cce72d154ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:20.187543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-a7e876a3-504e-49b6-9936-3cce72d154ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:19:20.187543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:20.187543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:20.187543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:20.187543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:20.187543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:20.187543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:20.187543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:20.187543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:20.187543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:20.187543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:20.187543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:20.187543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:20.187543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:20.187543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:20.187543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:20.188914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:20.188914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:20.188914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:20.188914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:20.188914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:20.188914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:20.188914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:20.188914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:20.188914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:20.188914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:20.188914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:20.188914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:20.188914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:20.188914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:20.188914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:20.188914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:20.189976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:20.189976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:20.189976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:20.189976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:20.189976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:20.189976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:20.189976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:20.189976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:20.189976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:20.189976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:20.189976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:19:20.189976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:20.191879 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 204/424] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:19:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:20.192829 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e876a3-504e-49b6-9936-3cce72d154ba None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:20.248649 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb0aa4-343a-41db-8e7a-087b19be4894 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:20.250872 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb0aa4-343a-41db-8e7a-087b19be4894 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:20.339570 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e876a3-504e-49b6-9936-3cce72d154ba None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:20.396551 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017fa26-3beb-4d7a-99f0-2051a05c93ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:20.397414 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 221/425] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:19:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:19:20.398145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017fa26-3beb-4d7a-99f0-2051a05c93ed None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:20.398730 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017fa26-3beb-4d7a-99f0-2051a05c93ed None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:20.399187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017fa26-3beb-4d7a-99f0-2051a05c93ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:20.399679 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb0aa4-343a-41db-8e7a-087b19be4894 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:20.423802 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017fa26-3beb-4d7a-99f0-2051a05c93ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:20.444928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-4017fa26-3beb-4d7a-99f0-2051a05c93ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:19:20.444928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:20.444928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:20.444928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:20.444928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:20.444928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:20.444928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:20.444928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:20.444928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:20.444928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:20.444928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:20.444928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:20.444928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:20.444928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:20.444928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:20.444928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:20.446320 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:20.446320 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:20.446320 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:20.446320 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:20.446320 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:20.446320 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:20.446320 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:20.446320 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:20.446320 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:20.446320 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:20.446320 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:20.446320 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:20.446320 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:20.446320 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:20.446320 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:20.446320 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:20.447309 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:20.447309 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:20.447309 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:20.447309 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:20.447309 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:20.447309 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:20.447309 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:20.447309 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:20.447309 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:20.447309 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:20.447309 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:19:20.447309 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:20.449451 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 205/426] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:19:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:20.450575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017fa26-3beb-4d7a-99f0-2051a05c93ed None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:20.548438 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb0aa4-343a-41db-8e7a-087b19be4894 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:20.593900 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869501a-e883-4c43-8934-014aeceef19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:20.594598 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869501a-e883-4c43-8934-014aeceef19b None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:20.594884 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869501a-e883-4c43-8934-014aeceef19b None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:20.595165 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869501a-e883-4c43-8934-014aeceef19b None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:20.596289 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869501a-e883-4c43-8934-014aeceef19b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:20.596713 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869501a-e883-4c43-8934-014aeceef19b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:20.598197 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869501a-e883-4c43-8934-014aeceef19b None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:20.603836 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017fa26-3beb-4d7a-99f0-2051a05c93ed None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:20.615021 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 222/427] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:19:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:20.615021 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869501a-e883-4c43-8934-014aeceef19b None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:20.659377 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93affea4-6f20-4e63-bcd3-b4e79944e8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:20.660680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93affea4-6f20-4e63-bcd3-b4e79944e8f9 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:20.661187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93affea4-6f20-4e63-bcd3-b4e79944e8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:20.661733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93affea4-6f20-4e63-bcd3-b4e79944e8f9 None admin] PATH_INFO: `/v3/projects/27fffefbce874beab07ae5240b7f0d10` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:20.663235 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93affea4-6f20-4e63-bcd3-b4e79944e8f9 None admin] RBAC: Authorizing `identity:get_project(project_id=27fffefbce874beab07ae5240b7f0d10)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:20.664924 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93affea4-6f20-4e63-bcd3-b4e79944e8f9 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:20.666972 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 206/428] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:19:20 2022] GET /identity/v3/projects/27fffefbce874beab07ae5240b7f0d10 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:20.667994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93affea4-6f20-4e63-bcd3-b4e79944e8f9 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:20.761255 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869501a-e883-4c43-8934-014aeceef19b None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:20.804011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd27c1a-fb2a-4832-a63b-d7fecdd198fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:20.804877 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd27c1a-fb2a-4832-a63b-d7fecdd198fe None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:20.805343 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd27c1a-fb2a-4832-a63b-d7fecdd198fe None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:20.805676 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd27c1a-fb2a-4832-a63b-d7fecdd198fe None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:20.806669 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd27c1a-fb2a-4832-a63b-d7fecdd198fe None admin] RBAC: Adding query filter params (name=member) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:20.807009 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd27c1a-fb2a-4832-a63b-d7fecdd198fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:20.808418 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93affea4-6f20-4e63-bcd3-b4e79944e8f9 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:20.808592 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd27c1a-fb2a-4832-a63b-d7fecdd198fe None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:20.829122 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 223/429] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:19:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:20.830635 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd27c1a-fb2a-4832-a63b-d7fecdd198fe None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:20.863326 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47c8d3-8484-4e84-b221-904e351e0527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:20.865879 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47c8d3-8484-4e84-b221-904e351e0527 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:20.866714 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47c8d3-8484-4e84-b221-904e351e0527 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:20.867634 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47c8d3-8484-4e84-b221-904e351e0527 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:20.950377 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47c8d3-8484-4e84-b221-904e351e0527 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:20.952422 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47c8d3-8484-4e84-b221-904e351e0527 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:20.986468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd27c1a-fb2a-4832-a63b-d7fecdd198fe None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:21.031985 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52c0dd-5ec6-4417-8f23-432343f7c737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:21.033690 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52c0dd-5ec6-4417-8f23-432343f7c737 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:21.034520 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52c0dd-5ec6-4417-8f23-432343f7c737 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:21.035058 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52c0dd-5ec6-4417-8f23-432343f7c737 None admin] PATH_INFO: `/v3/groups/e7ea14e5c95744a3b3fecb6503b3b8c0` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:21.036947 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52c0dd-5ec6-4417-8f23-432343f7c737 None admin] RBAC: Authorizing `identity:get_group(group_id=e7ea14e5c95744a3b3fecb6503b3b8c0)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:21.039170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52c0dd-5ec6-4417-8f23-432343f7c737 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:21.041827 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 224/430] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:19:20 2022] GET /identity/v3/groups/e7ea14e5c95744a3b3fecb6503b3b8c0 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:21.042899 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52c0dd-5ec6-4417-8f23-432343f7c737 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:21.089414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 207/431] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:19:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:19:21.089414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47c8d3-8484-4e84-b221-904e351e0527 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:21.195113 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52c0dd-5ec6-4417-8f23-432343f7c737 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:21.215715 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47c8d3-8484-4e84-b221-904e351e0527 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:21.233527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96c6dc-e020-4dbb-8248-dae5d2b67818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:21.234198 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96c6dc-e020-4dbb-8248-dae5d2b67818 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:21.234589 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96c6dc-e020-4dbb-8248-dae5d2b67818 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:21.234890 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96c6dc-e020-4dbb-8248-dae5d2b67818 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:21.264189 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b7bfe-debd-418b-87d3-b872007e5183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:21.265822 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b7bfe-debd-418b-87d3-b872007e5183 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:21.266344 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b7bfe-debd-418b-87d3-b872007e5183 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:21.266865 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b7bfe-debd-418b-87d3-b872007e5183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:21.268271 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b7bfe-debd-418b-87d3-b872007e5183 None admin] RBAC: Adding query filter params (group.id=e7ea14e5c95744a3b3fecb6503b3b8c0, role.id=a65ce6e645574561bb50ce9148d0637a, scope.project.id=27fffefbce874beab07ae5240b7f0d10) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:21.268863 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b7bfe-debd-418b-87d3-b872007e5183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:21.273185 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b7bfe-debd-418b-87d3-b872007e5183 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:21.289648 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 208/432] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:19:21 2022] GET /identity/v3/role_assignments?group.id=e7ea14e5c95744a3b3fecb6503b3b8c0&scope.project.id=27fffefbce874beab07ae5240b7f0d10&role.id=a65ce6e645574561bb50ce9148d0637a => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:21.289648 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b7bfe-debd-418b-87d3-b872007e5183 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:21.329260 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd96c6dc-e020-4dbb-8248-dae5d2b67818 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:21.330795 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd96c6dc-e020-4dbb-8248-dae5d2b67818 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:21.428129 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b7bfe-debd-418b-87d3-b872007e5183 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:21.472950 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed92e6-cff9-4955-a81c-df1e32880a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:21.473785 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed92e6-cff9-4955-a81c-df1e32880a14 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:21.474597 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed92e6-cff9-4955-a81c-df1e32880a14 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:21.475421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed92e6-cff9-4955-a81c-df1e32880a14 None admin] PATH_INFO: `/v3/projects/27fffefbce874beab07ae5240b7f0d10` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:21.476711 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed92e6-cff9-4955-a81c-df1e32880a14 None admin] RBAC: Authorizing `identity:get_project(project_id=27fffefbce874beab07ae5240b7f0d10)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:21.478223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed92e6-cff9-4955-a81c-df1e32880a14 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:21.480038 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 209/433] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:19:21 2022] GET /identity/v3/projects/27fffefbce874beab07ae5240b7f0d10 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:21.481348 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cacfd-9744-48ed-b289-16dc11f4be3d None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:21.481666 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cacfd-9744-48ed-b289-16dc11f4be3d None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:21.481950 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cacfd-9744-48ed-b289-16dc11f4be3d None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:21.483289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 210/434] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:21.484453 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc23df-e4f6-4375-85cb-89ebf92f1ab4 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:21.484743 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc23df-e4f6-4375-85cb-89ebf92f1ab4 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:21.485025 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc23df-e4f6-4375-85cb-89ebf92f1ab4 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:21.491842 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 211/435] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:21.492801 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc23df-e4f6-4375-85cb-89ebf92f1ab4 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:21.497509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 225/436] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:19:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:19:21.499280 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6def78-a175-420c-9ad9-ec71e9bbf4b9 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:21.499596 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6def78-a175-420c-9ad9-ec71e9bbf4b9 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:21.499860 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6def78-a175-420c-9ad9-ec71e9bbf4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:21.519467 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-bc6def78-a175-420c-9ad9-ec71e9bbf4b9 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:21.519995 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-bc6def78-a175-420c-9ad9-ec71e9bbf4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:21.606029 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 226/437] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:21.615618 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb52ba4-57bc-4e5a-bdc7-59e7953485ac None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:21.615898 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb52ba4-57bc-4e5a-bdc7-59e7953485ac None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:21.616273 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb52ba4-57bc-4e5a-bdc7-59e7953485ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:21.635112 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc23df-e4f6-4375-85cb-89ebf92f1ab4 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:21.643325 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-8bb52ba4-57bc-4e5a-bdc7-59e7953485ac None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:21.644542 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-8bb52ba4-57bc-4e5a-bdc7-59e7953485ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:21.679708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2272766-723f-456c-8096-fbe814ab790d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:21.681848 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2272766-723f-456c-8096-fbe814ab790d None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:21.682645 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2272766-723f-456c-8096-fbe814ab790d None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:21.684209 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2272766-723f-456c-8096-fbe814ab790d None admin] PATH_INFO: `/v3/groups/e7ea14e5c95744a3b3fecb6503b3b8c0` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:21.686179 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2272766-723f-456c-8096-fbe814ab790d None admin] RBAC: Authorizing `identity:get_group(group_id=e7ea14e5c95744a3b3fecb6503b3b8c0)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:21.689019 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2272766-723f-456c-8096-fbe814ab790d None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:21.692156 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 212/438] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:19:21 2022] GET /identity/v3/groups/e7ea14e5c95744a3b3fecb6503b3b8c0 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:21.697970 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2272766-723f-456c-8096-fbe814ab790d None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:21.745918 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 227/439] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:21.747442 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb52ba4-57bc-4e5a-bdc7-59e7953485ac None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:21.834283 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2272766-723f-456c-8096-fbe814ab790d None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:21.867231 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb52ba4-57bc-4e5a-bdc7-59e7953485ac None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:21.869869 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314d88d-7b01-47a6-b390-d7e913c560d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:21.870775 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314d88d-7b01-47a6-b390-d7e913c560d4 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:21.871057 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314d88d-7b01-47a6-b390-d7e913c560d4 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:21.871412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314d88d-7b01-47a6-b390-d7e913c560d4 None admin] PATH_INFO: `/v3/projects/46dbfbf04ba34604abb1879881e3e4d9` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:21.872580 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314d88d-7b01-47a6-b390-d7e913c560d4 None admin] RBAC: Authorizing `identity:get_project(project_id=46dbfbf04ba34604abb1879881e3e4d9)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:21.874137 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314d88d-7b01-47a6-b390-d7e913c560d4 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:21.875942 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 213/440] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:19:21 2022] GET /identity/v3/projects/46dbfbf04ba34604abb1879881e3e4d9 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:21.876727 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314d88d-7b01-47a6-b390-d7e913c560d4 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:21.909731 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ca4a0-933a-457c-8e64-f8197d1f6160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:21.910649 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ca4a0-933a-457c-8e64-f8197d1f6160 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:21.910946 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ca4a0-933a-457c-8e64-f8197d1f6160 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:21.911518 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ca4a0-933a-457c-8e64-f8197d1f6160 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:21.924588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ca4a0-933a-457c-8e64-f8197d1f6160 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:21.933437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-4a3ca4a0-933a-457c-8e64-f8197d1f6160 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:19:21.933437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:21.933437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:21.933437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:21.933437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:21.933437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:21.933437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:21.933437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:21.933437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:21.933437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:21.933437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:21.933437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:21.933437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:21.933437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:21.933437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:21.933437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:21.935387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:21.935387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:21.935387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:21.935387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:21.935387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:21.935387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:21.935387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:21.935387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:21.935387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:21.935387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:21.935387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:21.935387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:21.935387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:21.935387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:21.935387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:21.935387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:21.937081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:21.937081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:21.937081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:21.937081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:21.937081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:21.937081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:21.937081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:21.937081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:21.937081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:21.937081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:21.937081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:19:21.937081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:21.937081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 228/441] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:19:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:21.937081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ca4a0-933a-457c-8e64-f8197d1f6160 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:21.990257 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314d88d-7b01-47a6-b390-d7e913c560d4 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:22.030876 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e71e91-9a81-4749-b557-e164fe808d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:22.031477 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e71e91-9a81-4749-b557-e164fe808d36 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:22.031756 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e71e91-9a81-4749-b557-e164fe808d36 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:22.032028 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e71e91-9a81-4749-b557-e164fe808d36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:22.033097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e71e91-9a81-4749-b557-e164fe808d36 None admin] RBAC: Adding query filter params (group.id=e7ea14e5c95744a3b3fecb6503b3b8c0, role.id=b624791ed6aa460fa31372c80cf5991d, scope.project.id=27fffefbce874beab07ae5240b7f0d10) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:22.033453 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e71e91-9a81-4749-b557-e164fe808d36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:22.035138 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e71e91-9a81-4749-b557-e164fe808d36 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:22.042490 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 214/442] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:19:21 2022] GET /identity/v3/role_assignments?group.id=e7ea14e5c95744a3b3fecb6503b3b8c0&scope.project.id=27fffefbce874beab07ae5240b7f0d10&role.id=b624791ed6aa460fa31372c80cf5991d => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:22.043548 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e71e91-9a81-4749-b557-e164fe808d36 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:22.061539 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ca4a0-933a-457c-8e64-f8197d1f6160 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:22.110094 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd1615-3666-4d36-a68b-843d583ba244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:22.110941 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd1615-3666-4d36-a68b-843d583ba244 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:22.111236 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd1615-3666-4d36-a68b-843d583ba244 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:22.111521 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd1615-3666-4d36-a68b-843d583ba244 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:22.126233 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd1615-3666-4d36-a68b-843d583ba244 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:22.136577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-ffbd1615-3666-4d36-a68b-843d583ba244 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:19:22.136577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:22.136577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:22.136577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:22.136577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:22.136577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:22.136577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:22.136577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:22.136577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:22.136577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:22.136577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:22.136577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:22.136577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:22.136577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:22.136577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:22.136577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:22.138673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:22.138673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:22.138673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:22.138673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:22.138673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:22.138673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:22.138673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:22.138673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:22.138673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:22.138673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:22.138673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:22.138673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:22.138673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:22.138673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:22.138673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:22.138673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:22.139761 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:22.139761 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:22.139761 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:22.139761 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:22.139761 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:22.139761 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:22.139761 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:22.139761 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:22.139761 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:22.139761 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:22.139761 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:19:22.139761 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:22.139761 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 229/443] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:19:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:22.139761 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd1615-3666-4d36-a68b-843d583ba244 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:22.181995 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e71e91-9a81-4749-b557-e164fe808d36 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:22.226086 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7468cc-1c39-4c9f-83a8-935c231a8f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:22.226977 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7468cc-1c39-4c9f-83a8-935c231a8f76 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:22.227265 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7468cc-1c39-4c9f-83a8-935c231a8f76 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:22.227554 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7468cc-1c39-4c9f-83a8-935c231a8f76 None admin] PATH_INFO: `/v3/groups/e7ea14e5c95744a3b3fecb6503b3b8c0` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:22.228899 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7468cc-1c39-4c9f-83a8-935c231a8f76 None admin] RBAC: Authorizing `identity:get_group(group_id=e7ea14e5c95744a3b3fecb6503b3b8c0)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:22.230479 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7468cc-1c39-4c9f-83a8-935c231a8f76 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:22.238594 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 215/444] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:19:22 2022] GET /identity/v3/groups/e7ea14e5c95744a3b3fecb6503b3b8c0 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:22.238594 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7468cc-1c39-4c9f-83a8-935c231a8f76 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:22.277646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd1615-3666-4d36-a68b-843d583ba244 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:22.318399 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64acc42c-586e-463f-b583-e6cda277fd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:22.319721 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acc42c-586e-463f-b583-e6cda277fd85 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:22.320014 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acc42c-586e-463f-b583-e6cda277fd85 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:22.320296 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acc42c-586e-463f-b583-e6cda277fd85 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:22.321078 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64acc42c-586e-463f-b583-e6cda277fd85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:22.321452 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64acc42c-586e-463f-b583-e6cda277fd85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:22.322835 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64acc42c-586e-463f-b583-e6cda277fd85 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:22.332058 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 230/445] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:19:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:22.332981 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64acc42c-586e-463f-b583-e6cda277fd85 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:22.382605 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7468cc-1c39-4c9f-83a8-935c231a8f76 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:22.436753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763d8a0-dd57-4c65-a6de-fb72d463a9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:22.437565 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763d8a0-dd57-4c65-a6de-fb72d463a9f8 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:22.437775 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763d8a0-dd57-4c65-a6de-fb72d463a9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:22.438058 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763d8a0-dd57-4c65-a6de-fb72d463a9f8 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:22.438837 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763d8a0-dd57-4c65-a6de-fb72d463a9f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:22.439147 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763d8a0-dd57-4c65-a6de-fb72d463a9f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:22.440680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763d8a0-dd57-4c65-a6de-fb72d463a9f8 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:22.454979 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 216/446] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:19:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:22.456530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763d8a0-dd57-4c65-a6de-fb72d463a9f8 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:22.488090 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64acc42c-586e-463f-b583-e6cda277fd85 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:22.547915 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de5484-1f5c-42c1-920a-7faf68ff9d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:22.549041 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de5484-1f5c-42c1-920a-7faf68ff9d62 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:22.549587 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de5484-1f5c-42c1-920a-7faf68ff9d62 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:22.550091 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de5484-1f5c-42c1-920a-7faf68ff9d62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:22.551719 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de5484-1f5c-42c1-920a-7faf68ff9d62 None admin] RBAC: Adding query filter params (group.id=e7ea14e5c95744a3b3fecb6503b3b8c0, role.id=a65ce6e645574561bb50ce9148d0637a, scope.project.id=46dbfbf04ba34604abb1879881e3e4d9) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:22.552823 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de5484-1f5c-42c1-920a-7faf68ff9d62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:22.555516 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de5484-1f5c-42c1-920a-7faf68ff9d62 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:22.568650 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 231/447] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:19:22 2022] GET /identity/v3/role_assignments?group.id=e7ea14e5c95744a3b3fecb6503b3b8c0&scope.project.id=46dbfbf04ba34604abb1879881e3e4d9&role.id=a65ce6e645574561bb50ce9148d0637a => generated 611 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:22.570191 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de5484-1f5c-42c1-920a-7faf68ff9d62 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:22.583280 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763d8a0-dd57-4c65-a6de-fb72d463a9f8 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:22.635752 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48292e9-5291-4352-ab2e-7792c2ce5cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:22.636469 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48292e9-5291-4352-ab2e-7792c2ce5cb1 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:22.636888 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48292e9-5291-4352-ab2e-7792c2ce5cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:22.637363 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48292e9-5291-4352-ab2e-7792c2ce5cb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:22.730233 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de5484-1f5c-42c1-920a-7faf68ff9d62 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:22.742664 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48292e9-5291-4352-ab2e-7792c2ce5cb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:22.745321 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48292e9-5291-4352-ab2e-7792c2ce5cb1 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:22.776880 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cbddd-90cd-4e45-a774-3df3ce7292ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:22.777630 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cbddd-90cd-4e45-a774-3df3ce7292ba None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:22.777965 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cbddd-90cd-4e45-a774-3df3ce7292ba None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:22.778202 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cbddd-90cd-4e45-a774-3df3ce7292ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:22.878261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cbddd-90cd-4e45-a774-3df3ce7292ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:22.879824 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cbddd-90cd-4e45-a774-3df3ce7292ba None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:22.887558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 217/448] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:19:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:19:22.894385 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48292e9-5291-4352-ab2e-7792c2ce5cb1 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:23.010558 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 232/449] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:19:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:19:23.016294 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cbddd-90cd-4e45-a774-3df3ce7292ba None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:23.055781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48292e9-5291-4352-ab2e-7792c2ce5cb1 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:23.091715 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037d9b3-9c60-4c35-9a69-393459570dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:23.092708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037d9b3-9c60-4c35-9a69-393459570dbc None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:23.092994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037d9b3-9c60-4c35-9a69-393459570dbc None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:23.093271 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037d9b3-9c60-4c35-9a69-393459570dbc None admin] PATH_INFO: `/v3/projects/46dbfbf04ba34604abb1879881e3e4d9` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:23.094522 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037d9b3-9c60-4c35-9a69-393459570dbc None admin] RBAC: Authorizing `identity:get_project(project_id=46dbfbf04ba34604abb1879881e3e4d9)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:23.095964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037d9b3-9c60-4c35-9a69-393459570dbc None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:23.097793 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 218/450] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:19:22 2022] GET /identity/v3/projects/46dbfbf04ba34604abb1879881e3e4d9 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:23.105065 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037d9b3-9c60-4c35-9a69-393459570dbc None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:23.133845 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cbddd-90cd-4e45-a774-3df3ce7292ba None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:23.192005 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd3633-e5b1-493c-9f70-b073f51e1db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:23.193749 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd3633-e5b1-493c-9f70-b073f51e1db0 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:23.194221 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd3633-e5b1-493c-9f70-b073f51e1db0 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:23.194630 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd3633-e5b1-493c-9f70-b073f51e1db0 None admin] PATH_INFO: `/v3/projects/0a3979039e1b469e8159aa2395cc78de` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:23.197046 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd3633-e5b1-493c-9f70-b073f51e1db0 None admin] RBAC: Authorizing `identity:get_project(project_id=0a3979039e1b469e8159aa2395cc78de)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:23.199732 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd3633-e5b1-493c-9f70-b073f51e1db0 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:23.203057 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 233/451] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:19:23 2022] GET /identity/v3/projects/0a3979039e1b469e8159aa2395cc78de => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:23.212877 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd3633-e5b1-493c-9f70-b073f51e1db0 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:23.259428 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037d9b3-9c60-4c35-9a69-393459570dbc None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:23.313143 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac8187-0a02-427c-afbe-3d9031b39b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:23.314594 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac8187-0a02-427c-afbe-3d9031b39b7c None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:23.315058 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac8187-0a02-427c-afbe-3d9031b39b7c None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:23.315529 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac8187-0a02-427c-afbe-3d9031b39b7c None admin] PATH_INFO: `/v3/groups/e7ea14e5c95744a3b3fecb6503b3b8c0` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:23.317425 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac8187-0a02-427c-afbe-3d9031b39b7c None admin] RBAC: Authorizing `identity:get_group(group_id=e7ea14e5c95744a3b3fecb6503b3b8c0)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:23.320041 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac8187-0a02-427c-afbe-3d9031b39b7c None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:23.322742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 219/452] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:19:23 2022] GET /identity/v3/groups/e7ea14e5c95744a3b3fecb6503b3b8c0 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:23.328955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac8187-0a02-427c-afbe-3d9031b39b7c None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:23.362237 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd3633-e5b1-493c-9f70-b073f51e1db0 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:23.412350 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a5602-faf9-435c-a49a-9c7c0333cb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:23.413244 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a5602-faf9-435c-a49a-9c7c0333cb03 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:23.413573 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a5602-faf9-435c-a49a-9c7c0333cb03 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:23.413851 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a5602-faf9-435c-a49a-9c7c0333cb03 None admin] PATH_INFO: `/v3/groups/18608b3820e2410e98922e123a3dd01c` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:23.415533 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a5602-faf9-435c-a49a-9c7c0333cb03 None admin] RBAC: Authorizing `identity:get_group(group_id=18608b3820e2410e98922e123a3dd01c)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:23.417258 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a5602-faf9-435c-a49a-9c7c0333cb03 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:23.419151 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 234/453] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:19:23 2022] GET /identity/v3/groups/18608b3820e2410e98922e123a3dd01c => generated 229 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:23.425932 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a5602-faf9-435c-a49a-9c7c0333cb03 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:23.433235 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac8187-0a02-427c-afbe-3d9031b39b7c None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:23.478458 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de46c33-c671-4f0e-819c-3a99390a7cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:23.479195 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de46c33-c671-4f0e-819c-3a99390a7cd0 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:23.479482 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de46c33-c671-4f0e-819c-3a99390a7cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:23.479761 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de46c33-c671-4f0e-819c-3a99390a7cd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:23.480594 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de46c33-c671-4f0e-819c-3a99390a7cd0 None admin] RBAC: Adding query filter params (group.id=e7ea14e5c95744a3b3fecb6503b3b8c0, role.id=b624791ed6aa460fa31372c80cf5991d, scope.project.id=46dbfbf04ba34604abb1879881e3e4d9) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:23.480911 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de46c33-c671-4f0e-819c-3a99390a7cd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:23.482477 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de46c33-c671-4f0e-819c-3a99390a7cd0 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:23.488986 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 220/454] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:19:23 2022] GET /identity/v3/role_assignments?group.id=e7ea14e5c95744a3b3fecb6503b3b8c0&scope.project.id=46dbfbf04ba34604abb1879881e3e4d9&role.id=b624791ed6aa460fa31372c80cf5991d => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:23.558512 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a5602-faf9-435c-a49a-9c7c0333cb03 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:23.608892 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaae46a-abbd-4e82-919b-0627e2e0bea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:23.609708 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaae46a-abbd-4e82-919b-0627e2e0bea7 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:23.610011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaae46a-abbd-4e82-919b-0627e2e0bea7 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:23.610296 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaae46a-abbd-4e82-919b-0627e2e0bea7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:23.611372 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaae46a-abbd-4e82-919b-0627e2e0bea7 None admin] RBAC: Adding query filter params (group.id=18608b3820e2410e98922e123a3dd01c, role.id=9aaa841361294b9c9b275ca1be0ed89c, scope.project.id=0a3979039e1b469e8159aa2395cc78de) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:23.611776 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaae46a-abbd-4e82-919b-0627e2e0bea7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:23.613358 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaae46a-abbd-4e82-919b-0627e2e0bea7 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:23.620912 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 235/455] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:19:23 2022] GET /identity/v3/role_assignments?group.id=18608b3820e2410e98922e123a3dd01c&scope.project.id=0a3979039e1b469e8159aa2395cc78de&role.id=9aaa841361294b9c9b275ca1be0ed89c => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:26.938230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc2162-b7ff-434e-949d-f19e76353f49 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:26.939309 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc2162-b7ff-434e-949d-f19e76353f49 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:26.939825 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc2162-b7ff-434e-949d-f19e76353f49 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:26.941759 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 221/456] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:26.948201 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e48f0-7984-45e4-af61-57f51068c7a5 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:26.948716 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e48f0-7984-45e4-af61-57f51068c7a5 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:26.948946 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e48f0-7984-45e4-af61-57f51068c7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:26.973300 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-da0e48f0-7984-45e4-af61-57f51068c7a5 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:26.975433 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-da0e48f0-7984-45e4-af61-57f51068c7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:27.063873 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f35037-9669-4175-be78-f0e9d3010c53 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:27.064260 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f35037-9669-4175-be78-f0e9d3010c53 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:27.064487 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f35037-9669-4175-be78-f0e9d3010c53 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:27.065666 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 236/457] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:27.066002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 222/458] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:27.072322 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9b6b7-ddfc-449f-a0b0-bd55cd3fad90 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:27.072670 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9b6b7-ddfc-449f-a0b0-bd55cd3fad90 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:27.072892 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9b6b7-ddfc-449f-a0b0-bd55cd3fad90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:27.092226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-dbe9b6b7-ddfc-449f-a0b0-bd55cd3fad90 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:27.093796 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-dbe9b6b7-ddfc-449f-a0b0-bd55cd3fad90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:27.097005 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f35037-9669-4175-be78-f0e9d3010c53 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:27.184846 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 237/459] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:27.186344 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab8b74-fce8-4013-9f77-a1d02c266dc9 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:27.186636 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab8b74-fce8-4013-9f77-a1d02c266dc9 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:27.186893 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab8b74-fce8-4013-9f77-a1d02c266dc9 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:27.188627 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 238/460] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:27.195293 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db49a90-356f-442d-94cb-e45e16b615fb None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:27.195616 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db49a90-356f-442d-94cb-e45e16b615fb None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:27.195967 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db49a90-356f-442d-94cb-e45e16b615fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:27.230684 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-6db49a90-356f-442d-94cb-e45e16b615fb None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:27.232089 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-6db49a90-356f-442d-94cb-e45e16b615fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:27.296326 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f35037-9669-4175-be78-f0e9d3010c53 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:27.320058 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 239/461] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:27.321485 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db49a90-356f-442d-94cb-e45e16b615fb None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:27.374940 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46704cfb-f492-4333-b572-f7d22633fa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:27.375790 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46704cfb-f492-4333-b572-f7d22633fa32 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:27.376072 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46704cfb-f492-4333-b572-f7d22633fa32 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:27.376388 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46704cfb-f492-4333-b572-f7d22633fa32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:27.389772 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46704cfb-f492-4333-b572-f7d22633fa32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:27.391791 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46704cfb-f492-4333-b572-f7d22633fa32 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:27.414126 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-46704cfb-f492-4333-b572-f7d22633fa32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:27.414126 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:27.414126 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:27.414126 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:27.414126 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:27.414126 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:27.414126 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:27.414126 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:27.414126 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:27.414126 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:27.414126 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:27.414126 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:27.414126 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:27.414126 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:27.414126 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:27.415293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:27.415293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:27.415293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:27.415293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:27.415293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:27.415293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:27.415293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:27.415293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:27.415293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:27.415293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:27.415293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:27.415293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:27.415293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:27.415293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:27.415293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:27.415293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:27.415293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:27.417011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:27.417011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:27.417011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:27.417011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:27.417011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 223/462] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:27.417754 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46704cfb-f492-4333-b572-f7d22633fa32 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:27.457004 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db49a90-356f-442d-94cb-e45e16b615fb None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:27.501682 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9186bc7-c505-4b0f-8f14-eb4bc2fda060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:27.502497 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9186bc7-c505-4b0f-8f14-eb4bc2fda060 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:27.502783 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9186bc7-c505-4b0f-8f14-eb4bc2fda060 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:27.503062 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9186bc7-c505-4b0f-8f14-eb4bc2fda060 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:27.514836 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9186bc7-c505-4b0f-8f14-eb4bc2fda060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:27.516331 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9186bc7-c505-4b0f-8f14-eb4bc2fda060 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:27.544560 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46704cfb-f492-4333-b572-f7d22633fa32 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:27.563318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-b9186bc7-c505-4b0f-8f14-eb4bc2fda060 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:27.563318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:27.563318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:27.563318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:27.563318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:27.563318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:27.563318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:27.563318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:27.563318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:27.563318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:27.563318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:27.563318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:27.563318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:27.563318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:27.563318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:27.565550 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:27.565550 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:27.565550 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:27.565550 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:27.565550 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:27.565550 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:27.565550 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:27.565550 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:27.565550 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:27.565550 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:27.565550 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:27.565550 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:27.565550 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:27.565550 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:27.565550 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:27.565550 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:27.565550 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:27.567548 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:27.567548 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:27.567548 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:27.567548 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:27.576468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 240/463] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:27.577835 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9186bc7-c505-4b0f-8f14-eb4bc2fda060 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:27.593659 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2497df-7aad-4f98-a678-9f32853a0d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:27.594487 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2497df-7aad-4f98-a678-9f32853a0d63 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:27.595238 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2497df-7aad-4f98-a678-9f32853a0d63 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:27.595528 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2497df-7aad-4f98-a678-9f32853a0d63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:27.611541 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2497df-7aad-4f98-a678-9f32853a0d63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:27.613056 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2497df-7aad-4f98-a678-9f32853a0d63 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:27.639853 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-ba2497df-7aad-4f98-a678-9f32853a0d63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:27.639853 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:27.639853 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:27.639853 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:27.639853 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:27.639853 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:27.639853 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:27.639853 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:27.639853 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:27.639853 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:27.639853 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:27.639853 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:27.639853 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:27.639853 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:27.639853 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:27.640927 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:27.640927 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:27.640927 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:27.640927 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:27.640927 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:27.640927 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:27.640927 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:27.640927 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:27.640927 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:27.640927 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:27.640927 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:27.640927 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:27.640927 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:27.640927 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:27.640927 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:27.640927 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:27.640927 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:27.642010 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:27.642010 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:27.642010 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:27.642010 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:27.649141 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 224/464] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:27.650600 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2497df-7aad-4f98-a678-9f32853a0d63 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:27.718452 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9186bc7-c505-4b0f-8f14-eb4bc2fda060 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:27.766804 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2497df-7aad-4f98-a678-9f32853a0d63 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:27.768723 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26d6da-3df5-44d8-862e-22b87d200e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:27.769723 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26d6da-3df5-44d8-862e-22b87d200e4c None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:27.770228 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26d6da-3df5-44d8-862e-22b87d200e4c None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:27.770761 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26d6da-3df5-44d8-862e-22b87d200e4c None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:27.771877 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26d6da-3df5-44d8-862e-22b87d200e4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:27.772409 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26d6da-3df5-44d8-862e-22b87d200e4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:27.774107 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26d6da-3df5-44d8-862e-22b87d200e4c None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:27.787936 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 241/465] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:27.789294 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26d6da-3df5-44d8-862e-22b87d200e4c None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:27.803858 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37eae3-19bf-4a5e-9904-887e35cad4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:27.804805 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37eae3-19bf-4a5e-9904-887e35cad4e1 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:27.804805 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37eae3-19bf-4a5e-9904-887e35cad4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:27.805134 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37eae3-19bf-4a5e-9904-887e35cad4e1 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:27.805890 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37eae3-19bf-4a5e-9904-887e35cad4e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:27.806204 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37eae3-19bf-4a5e-9904-887e35cad4e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:27.807634 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37eae3-19bf-4a5e-9904-887e35cad4e1 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:27.833006 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 225/466] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:27.834851 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37eae3-19bf-4a5e-9904-887e35cad4e1 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:27.904692 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26d6da-3df5-44d8-862e-22b87d200e4c None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:27.941562 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37eae3-19bf-4a5e-9904-887e35cad4e1 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:27.945040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ba340-2ef5-4ad4-9932-9a9c4e01db9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:27.946236 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ba340-2ef5-4ad4-9932-9a9c4e01db9b None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:27.946765 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ba340-2ef5-4ad4-9932-9a9c4e01db9b None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:27.947381 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ba340-2ef5-4ad4-9932-9a9c4e01db9b None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:27.948418 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ba340-2ef5-4ad4-9932-9a9c4e01db9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:27.949462 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ba340-2ef5-4ad4-9932-9a9c4e01db9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:27.951361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ba340-2ef5-4ad4-9932-9a9c4e01db9b None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:27.965847 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 242/467] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:27.967115 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ba340-2ef5-4ad4-9932-9a9c4e01db9b None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:27.986152 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346d7e0-b33f-44d9-9328-d9cd10ea3937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:27.986760 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346d7e0-b33f-44d9-9328-d9cd10ea3937 None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:27.987045 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346d7e0-b33f-44d9-9328-d9cd10ea3937 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:27.987323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346d7e0-b33f-44d9-9328-d9cd10ea3937 None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:27.988044 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7346d7e0-b33f-44d9-9328-d9cd10ea3937 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:27.989848 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7346d7e0-b33f-44d9-9328-d9cd10ea3937 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:28.011930 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 226/468] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:19:27 2022] POST /identity/v3/users => generated 248 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:19:28.012749 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346d7e0-b33f-44d9-9328-d9cd10ea3937 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:28.101132 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ba340-2ef5-4ad4-9932-9a9c4e01db9b None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:28.133492 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346d7e0-b33f-44d9-9328-d9cd10ea3937 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:28.142757 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01e52f-a77e-4996-bc86-dc6d7f9f9f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:28.143474 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01e52f-a77e-4996-bc86-dc6d7f9f9f02 None admin] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:28.143767 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01e52f-a77e-4996-bc86-dc6d7f9f9f02 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:28.144048 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01e52f-a77e-4996-bc86-dc6d7f9f9f02 None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:28.144807 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01e52f-a77e-4996-bc86-dc6d7f9f9f02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:28.146855 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01e52f-a77e-4996-bc86-dc6d7f9f9f02 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:28.171938 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 243/469] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:19:27 2022] POST /identity/v3/users => generated 246 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:19:28.173893 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954389ee-9a64-4710-9777-71a195efb4d4 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:28.174493 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954389ee-9a64-4710-9777-71a195efb4d4 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:28.174833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954389ee-9a64-4710-9777-71a195efb4d4 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:28.176740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 244/470] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:28.177892 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b1a77-bb87-43de-abd6-edadadf52b11 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:28.178290 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b1a77-bb87-43de-abd6-edadadf52b11 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:28.178637 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b1a77-bb87-43de-abd6-edadadf52b11 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:28.184312 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 245/471] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:28.188680 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e3644-c0d2-4aec-8952-2c7b56910a34 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:28.188680 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e3644-c0d2-4aec-8952-2c7b56910a34 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:28.188680 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e3644-c0d2-4aec-8952-2c7b56910a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:28.191653 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f3071-0811-44cb-9967-744cc3a39692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:28.193065 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f3071-0811-44cb-9967-744cc3a39692 None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:28.193528 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f3071-0811-44cb-9967-744cc3a39692 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:28.193890 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f3071-0811-44cb-9967-744cc3a39692 None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:28.194905 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f3071-0811-44cb-9967-744cc3a39692 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:28.198047 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f3071-0811-44cb-9967-744cc3a39692 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:28.211527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-f30e3644-c0d2-4aec-8952-2c7b56910a34 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:28.213330 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-f30e3644-c0d2-4aec-8952-2c7b56910a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:28.226725 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 227/472] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:19:28 2022] POST /identity/v3/users => generated 248 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:19:28.229074 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed360ce-88ed-4200-a4de-6868397a2658 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:28.229532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed360ce-88ed-4200-a4de-6868397a2658 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:28.229818 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed360ce-88ed-4200-a4de-6868397a2658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:28.251473 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-fed360ce-88ed-4200-a4de-6868397a2658 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:28.252747 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-fed360ce-88ed-4200-a4de-6868397a2658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:28.309539 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 246/473] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:28.348424 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e3644-c0d2-4aec-8952-2c7b56910a34 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:28.359802 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 228/474] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:28.388782 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed360ce-88ed-4200-a4de-6868397a2658 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:28.498659 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e3644-c0d2-4aec-8952-2c7b56910a34 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:28.522116 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed360ce-88ed-4200-a4de-6868397a2658 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:28.555748 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecdf30-9544-490a-b7e2-e69d51c578f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:28.556552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecdf30-9544-490a-b7e2-e69d51c578f6 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:28.556837 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecdf30-9544-490a-b7e2-e69d51c578f6 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:28.557320 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecdf30-9544-490a-b7e2-e69d51c578f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:28.567904 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc0230-f983-428f-a15b-68e78b1ec66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:28.568370 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecdf30-9544-490a-b7e2-e69d51c578f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:28.568694 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc0230-f983-428f-a15b-68e78b1ec66d None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:28.568985 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc0230-f983-428f-a15b-68e78b1ec66d None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:28.569263 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc0230-f983-428f-a15b-68e78b1ec66d None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:28.569985 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecdf30-9544-490a-b7e2-e69d51c578f6 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:28.570113 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc0230-f983-428f-a15b-68e78b1ec66d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:28.571659 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc0230-f983-428f-a15b-68e78b1ec66d None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:28.579865 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.sql.core [None req-e8fc0230-f983-428f-a15b-68e78b1ec66d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 15:19:28.579865 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 09 15:19:28.579865 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [parameters: {'id': 'c38a9e59ce944935bbc36899a78e5321', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 09 15:19:28.579865 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=143282) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 15:19:28.589597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-70ecdf30-9544-490a-b7e2-e69d51c578f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:28.589597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:28.589597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:28.589597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:28.589597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:28.589597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:28.589597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:28.589597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:28.589597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:28.589597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:28.589597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:28.589597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:28.589597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:28.589597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:28.589597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:28.590685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:28.590685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:28.590685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:28.590685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:28.590685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:28.590685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:28.590685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:28.590685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:28.590685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:28.590685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:28.590685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:28.590685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:28.590685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:28.590685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:28.590685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:28.590685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:28.590685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:28.591765 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:28.591765 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:28.591765 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:28.591765 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:28.591765 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 247/475] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:19:28.599983 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecdf30-9544-490a-b7e2-e69d51c578f6 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:28.600274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-e8fc0230-f983-428f-a15b-68e78b1ec66d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 09 15:19:28.600274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:28.600274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:19:28.600274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:19:28.600274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:19:28.600274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:19:28.600274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:19:28.600274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:19:28.600274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:19:28.600274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application conn.query(q) May 09 15:19:28.600274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:19:28.600274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:19:28.600274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:19:28.600274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application result.read() May 09 15:19:28.600274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:19:28.602411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:19:28.602411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:19:28.602411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:19:28.602411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:19:28.602411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:19:28.602411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:19:28.602411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:19:28.602411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 15:19:28.602411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:28.602411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 15:19:28.602411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:28.602411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:28.602411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 15:19:28.602411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 15:19:28.602411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 09 15:19:28.602411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return ref.to_dict() May 09 15:19:28.602411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:19:28.602411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application next(self.gen) May 09 15:19:28.604305 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 15:19:28.604305 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application yield resource May 09 15:19:28.604305 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:19:28.604305 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application next(self.gen) May 09 15:19:28.604305 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 15:19:28.604305 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self.session.rollback() May 09 15:19:28.604305 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 15:19:28.604305 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self.force_reraise() May 09 15:19:28.604305 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 15:19:28.604305 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise self.value May 09 15:19:28.604305 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 15:19:28.604305 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 15:19:28.604305 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 15:19:28.604305 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application session.commit() May 09 15:19:28.604305 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 15:19:28.604305 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 15:19:28.604305 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 15:19:28.610427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._prepare_impl() May 09 15:19:28.610427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 15:19:28.610427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self.session.flush() May 09 15:19:28.610427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 15:19:28.610427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._flush(objects) May 09 15:19:28.610427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 15:19:28.610427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 15:19:28.610427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 15:19:28.610427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application compat.raise_( May 09 15:19:28.610427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:19:28.610427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception May 09 15:19:28.610427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 15:19:28.610427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application flush_context.execute() May 09 15:19:28.610427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 15:19:28.610427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rec.execute(self) May 09 15:19:28.610427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 15:19:28.610427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 15:19:28.612515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 15:19:28.612515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 15:19:28.612515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 09 15:19:28.612515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application c = connection._execute_20( May 09 15:19:28.612515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 15:19:28.612515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 15:19:28.612515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 15:19:28.612515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 15:19:28.612515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 15:19:28.612515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 15:19:28.612515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 15:19:28.612515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 15:19:28.612515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 15:19:28.612515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 15:19:28.612515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:19:28.612515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception May 09 15:19:28.613771 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:19:28.613771 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:19:28.613771 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:19:28.613771 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:19:28.613771 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:19:28.613771 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:19:28.613771 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:19:28.613771 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application conn.query(q) May 09 15:19:28.613771 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:19:28.613771 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:19:28.613771 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:19:28.613771 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application result.read() May 09 15:19:28.613771 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:19:28.613771 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:19:28.613771 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:19:28.613771 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:19:28.621608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:19:28.621608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:19:28.621608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:19:28.621608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:19:28.621608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 15:19:28.621608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 09 15:19:28.621608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [parameters: {'id': 'c38a9e59ce944935bbc36899a78e5321', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 09 15:19:28.621608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 15:19:28.621608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:28.621608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:19:28.621608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:28.621608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:28.621608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:28.621608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:28.621608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:28.621608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:28.624095 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:28.624095 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:28.624095 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:28.624095 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:28.624095 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:28.624095 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:28.624095 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 09 15:19:28.624095 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 09 15:19:28.624095 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:28.624095 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:28.624095 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 09 15:19:28.624095 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 09 15:19:28.624095 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 15:19:28.624095 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 15:19:28.624095 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 09 15:19:28.624095 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:28.626412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 229/476] 10.222.0.48 () {60 vars in 1131 bytes} [Mon May 9 15:19:28 2022] POST /identity/v3/roles => generated 144 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 09 15:19:28.626412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc0230-f983-428f-a15b-68e78b1ec66d None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:28.729219 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecdf30-9544-490a-b7e2-e69d51c578f6 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:28.765875 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d4953-55d1-454c-81e7-9026f0c8f390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:28.766555 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d4953-55d1-454c-81e7-9026f0c8f390 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:28.766841 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d4953-55d1-454c-81e7-9026f0c8f390 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:28.767111 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d4953-55d1-454c-81e7-9026f0c8f390 None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:28.767854 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d4953-55d1-454c-81e7-9026f0c8f390 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:28.768160 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d4953-55d1-454c-81e7-9026f0c8f390 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:28.769652 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d4953-55d1-454c-81e7-9026f0c8f390 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:28.783106 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 248/477] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:28.788311 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d4953-55d1-454c-81e7-9026f0c8f390 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:28.851427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc0230-f983-428f-a15b-68e78b1ec66d None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:28.924063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7056c06-29a3-4eab-a9a6-8e78f2a0717c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:28.924949 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7056c06-29a3-4eab-a9a6-8e78f2a0717c None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:28.925240 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7056c06-29a3-4eab-a9a6-8e78f2a0717c None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:28.925546 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7056c06-29a3-4eab-a9a6-8e78f2a0717c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:28.947877 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d4953-55d1-454c-81e7-9026f0c8f390 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:28.957440 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7056c06-29a3-4eab-a9a6-8e78f2a0717c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:28.963913 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-b7056c06-29a3-4eab-a9a6-8e78f2a0717c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:19:28.963913 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:28.963913 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:28.963913 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:28.963913 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:28.963913 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:28.963913 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:28.963913 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:28.963913 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:28.963913 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:28.963913 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:28.963913 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:28.963913 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:28.963913 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:28.963913 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:28.963913 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:28.965015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:28.965015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:28.965015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:28.965015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:28.965015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:28.965015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:28.965015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:28.965015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:28.965015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:28.965015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:28.965015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:28.965015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:28.965015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:28.965015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:28.965015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:28.965015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:28.966002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:28.966002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:28.966002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:28.966002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:28.966002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:28.966002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:28.966002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:28.966002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:28.966002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:28.966002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:28.966002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:19:28.966002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:28.968977 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 230/478] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:19:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:19:28.978006 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7056c06-29a3-4eab-a9a6-8e78f2a0717c None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:29.002068 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f1a41-ea9c-49f9-b1c2-ed4fc131d47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:29.002777 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f1a41-ea9c-49f9-b1c2-ed4fc131d47f None admin] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:29.003066 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f1a41-ea9c-49f9-b1c2-ed4fc131d47f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:29.003345 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f1a41-ea9c-49f9-b1c2-ed4fc131d47f None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:29.004088 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f1a41-ea9c-49f9-b1c2-ed4fc131d47f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:29.007059 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f1a41-ea9c-49f9-b1c2-ed4fc131d47f None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:29.054926 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 249/479] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:19:28 2022] POST /identity/v3/users => generated 249 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:19:29.156219 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7056c06-29a3-4eab-a9a6-8e78f2a0717c None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:29.194580 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd6327-dcdc-4afe-8516-00e4f17bb109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:29.195278 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd6327-dcdc-4afe-8516-00e4f17bb109 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:29.195567 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd6327-dcdc-4afe-8516-00e4f17bb109 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:29.195850 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd6327-dcdc-4afe-8516-00e4f17bb109 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:29.196628 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd6327-dcdc-4afe-8516-00e4f17bb109 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:29.196939 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd6327-dcdc-4afe-8516-00e4f17bb109 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:29.198402 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd6327-dcdc-4afe-8516-00e4f17bb109 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:29.208989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 231/480] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:19:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:31.068003 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4d177-34a4-49b7-b481-9262362e2787 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:31.068682 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4d177-34a4-49b7-b481-9262362e2787 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:31.068682 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4d177-34a4-49b7-b481-9262362e2787 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:31.070532 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 250/481] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:31.072583 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ba43b-c091-483d-84a7-4d8dc923ae44 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:31.073036 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ba43b-c091-483d-84a7-4d8dc923ae44 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:31.073130 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ba43b-c091-483d-84a7-4d8dc923ae44 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:31.074545 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 232/482] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:31.077036 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e2419-13d9-45d9-8492-81a8e4d839bd None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:31.077328 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e2419-13d9-45d9-8492-81a8e4d839bd None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:31.077641 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e2419-13d9-45d9-8492-81a8e4d839bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:31.096493 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910aa669-1acc-4992-a244-dd57df501366 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:31.097150 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910aa669-1acc-4992-a244-dd57df501366 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:31.097708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910aa669-1acc-4992-a244-dd57df501366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:31.101349 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-c91e2419-13d9-45d9-8492-81a8e4d839bd None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:31.102721 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-c91e2419-13d9-45d9-8492-81a8e4d839bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:31.118540 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-910aa669-1acc-4992-a244-dd57df501366 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:31.122197 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-910aa669-1acc-4992-a244-dd57df501366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:31.225718 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 233/483] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:19:31.238817 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 251/484] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:31.261864 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910aa669-1acc-4992-a244-dd57df501366 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:31.277978 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e2419-13d9-45d9-8492-81a8e4d839bd None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:31.405142 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910aa669-1acc-4992-a244-dd57df501366 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:31.425411 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e2419-13d9-45d9-8492-81a8e4d839bd None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:31.447534 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47581c29-81ec-4d1d-80ff-06c19ee4055b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:31.448756 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47581c29-81ec-4d1d-80ff-06c19ee4055b None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:31.449265 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47581c29-81ec-4d1d-80ff-06c19ee4055b None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:31.449790 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47581c29-81ec-4d1d-80ff-06c19ee4055b None admin] PATH_INFO: `/v3/roles/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:31.461090 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47581c29-81ec-4d1d-80ff-06c19ee4055b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:31.468279 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943dafd8-5c5f-4522-b2ed-d9664914fbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:31.469090 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dafd8-5c5f-4522-b2ed-d9664914fbfe None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:31.469397 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dafd8-5c5f-4522-b2ed-d9664914fbfe None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:31.469674 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dafd8-5c5f-4522-b2ed-d9664914fbfe None admin] PATH_INFO: `/v3/roles/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:31.471736 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-47581c29-81ec-4d1d-80ff-06c19ee4055b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:31.471736 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:31.471736 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:31.471736 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:31.471736 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:31.471736 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:31.471736 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:31.471736 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:31.471736 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:31.471736 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:31.471736 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:31.471736 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:31.471736 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:31.471736 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:31.471736 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:31.471736 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:31.472930 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:31.472930 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:31.472930 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:31.472930 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:31.472930 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:31.472930 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:31.472930 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:31.472930 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:31.472930 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:31.472930 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:31.472930 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:31.472930 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:31.472930 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:31.472930 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:31.472930 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:31.472930 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:31.474352 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:31.474352 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:31.474352 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:31.474352 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:31.474352 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:31.474352 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:31.474352 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:31.474352 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:31.474352 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:31.474352 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:31.474352 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:31.474352 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:31.477252 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 234/485] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:19:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:31.478862 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67eace-5b9f-4f41-853d-869e036e6b6a None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:31.479388 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67eace-5b9f-4f41-853d-869e036e6b6a None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:31.479899 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67eace-5b9f-4f41-853d-869e036e6b6a None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:31.481701 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 235/486] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:31.488165 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67eace-5b9f-4f41-853d-869e036e6b6a None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:31.492556 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943dafd8-5c5f-4522-b2ed-d9664914fbfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:31.500393 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-943dafd8-5c5f-4522-b2ed-d9664914fbfe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:31.500393 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:31.500393 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:31.500393 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:31.500393 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:31.500393 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:31.500393 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:31.500393 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:31.500393 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:31.500393 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:31.500393 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:31.500393 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:31.500393 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:31.500393 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:31.500393 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:31.500393 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:31.501564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:31.501564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:31.501564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:31.501564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:31.501564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:31.501564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:31.501564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:31.501564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:31.501564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:31.501564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:31.501564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:31.501564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:31.501564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:31.501564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:31.501564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:31.501564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:31.502535 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:31.502535 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:31.502535 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:31.502535 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:31.502535 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:31.502535 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:31.502535 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:31.502535 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:31.502535 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:31.502535 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:31.502535 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:31.502535 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:31.502535 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 252/487] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:19:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:31.503329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae271df0-8f5a-4127-a39a-1395ab84cacd None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:31.503925 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae271df0-8f5a-4127-a39a-1395ab84cacd None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:31.503925 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae271df0-8f5a-4127-a39a-1395ab84cacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:31.527413 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-ae271df0-8f5a-4127-a39a-1395ab84cacd None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:31.534506 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-ae271df0-8f5a-4127-a39a-1395ab84cacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:31.622567 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 253/488] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:31.622567 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae271df0-8f5a-4127-a39a-1395ab84cacd None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:31.665748 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67eace-5b9f-4f41-853d-869e036e6b6a None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:31.723209 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d192e1a-7347-4569-b6d7-45935256c2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:31.724947 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d192e1a-7347-4569-b6d7-45935256c2cc None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:31.725676 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d192e1a-7347-4569-b6d7-45935256c2cc None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:31.726530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d192e1a-7347-4569-b6d7-45935256c2cc None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:31.728314 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d192e1a-7347-4569-b6d7-45935256c2cc None admin] RBAC: Adding query filter params (name=service) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:31.729198 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d192e1a-7347-4569-b6d7-45935256c2cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:31.732019 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d192e1a-7347-4569-b6d7-45935256c2cc None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:31.752688 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae271df0-8f5a-4127-a39a-1395ab84cacd None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:31.753556 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 236/489] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:19:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:31.756060 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d192e1a-7347-4569-b6d7-45935256c2cc None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:31.791896 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadcc72-7c67-461c-8158-42fa72c82865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:31.792589 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadcc72-7c67-461c-8158-42fa72c82865 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:31.792873 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadcc72-7c67-461c-8158-42fa72c82865 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:31.793151 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadcc72-7c67-461c-8158-42fa72c82865 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:31.794132 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadcc72-7c67-461c-8158-42fa72c82865 None admin] RBAC: Adding query filter params (name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:31.794351 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadcc72-7c67-461c-8158-42fa72c82865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:31.795789 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadcc72-7c67-461c-8158-42fa72c82865 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:31.805274 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 254/490] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:19:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:31.810654 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadcc72-7c67-461c-8158-42fa72c82865 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:31.886102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d192e1a-7347-4569-b6d7-45935256c2cc None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:31.926328 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ff6de-e4ad-49b9-8d1f-db4b67289d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:31.927459 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadcc72-7c67-461c-8158-42fa72c82865 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:31.928343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ff6de-e4ad-49b9-8d1f-db4b67289d2f None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:31.928859 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ff6de-e4ad-49b9-8d1f-db4b67289d2f None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:31.929364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ff6de-e4ad-49b9-8d1f-db4b67289d2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:31.941877 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ff6de-e4ad-49b9-8d1f-db4b67289d2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:31.950024 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-d56ff6de-e4ad-49b9-8d1f-db4b67289d2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:31.950024 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:31.950024 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:31.950024 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:31.950024 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:31.950024 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:31.950024 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:31.950024 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:31.950024 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:31.950024 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:31.950024 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:31.950024 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:31.950024 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:31.950024 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:31.950024 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:31.950024 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:31.951101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:31.951101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:31.951101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:31.951101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:31.951101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:31.951101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:31.951101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:31.951101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:31.951101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:31.951101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:31.951101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:31.951101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:31.951101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:31.951101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:31.951101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:31.951101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:31.952048 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:31.952048 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:31.952048 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:31.952048 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:31.952048 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:31.952048 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:31.952048 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:31.952048 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:31.952048 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:31.952048 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:31.952048 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:31.952048 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:31.959518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 237/491] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:19:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:31.960713 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ff6de-e4ad-49b9-8d1f-db4b67289d2f None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:31.986570 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3449e5c-332c-4165-9ed5-f9aa427840dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:31.988022 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3449e5c-332c-4165-9ed5-f9aa427840dc None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:31.988332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3449e5c-332c-4165-9ed5-f9aa427840dc None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:31.988802 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3449e5c-332c-4165-9ed5-f9aa427840dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:32.009582 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3449e5c-332c-4165-9ed5-f9aa427840dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:32.012585 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3449e5c-332c-4165-9ed5-f9aa427840dc None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:32.031387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-f3449e5c-332c-4165-9ed5-f9aa427840dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:32.031387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:32.031387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:32.031387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:32.031387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:32.031387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:32.031387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:32.031387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:32.031387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:32.031387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:32.031387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:32.031387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:32.031387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:32.031387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:32.031387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:32.032489 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:32.032489 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:32.032489 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:32.032489 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:32.032489 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:32.032489 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:32.032489 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:32.032489 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:32.032489 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:32.032489 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:32.032489 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:32.032489 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:32.032489 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:32.032489 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:32.032489 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:32.032489 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:32.032489 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:32.033949 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:32.033949 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:32.033949 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:32.033949 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:32.037868 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 255/492] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:32.038765 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3449e5c-332c-4165-9ed5-f9aa427840dc None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:32.071989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ff6de-e4ad-49b9-8d1f-db4b67289d2f None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:32.104591 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d62a18-93c1-467b-835f-5cd33f1530c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:32.105419 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d62a18-93c1-467b-835f-5cd33f1530c7 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:32.105714 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d62a18-93c1-467b-835f-5cd33f1530c7 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:32.105991 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d62a18-93c1-467b-835f-5cd33f1530c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:32.117212 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d62a18-93c1-467b-835f-5cd33f1530c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:32.118718 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d62a18-93c1-467b-835f-5cd33f1530c7 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:32.136844 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-34d62a18-93c1-467b-835f-5cd33f1530c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:32.136844 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:32.136844 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:32.136844 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:32.136844 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:32.136844 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:32.136844 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:32.136844 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:32.136844 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:32.136844 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:32.136844 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:32.136844 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:32.136844 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:32.136844 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:32.136844 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:32.138150 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:32.138150 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:32.138150 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:32.138150 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:32.138150 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:32.138150 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:32.138150 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:32.138150 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:32.138150 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:32.138150 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:32.138150 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:32.138150 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:32.138150 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:32.138150 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:32.138150 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:32.138150 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:32.138150 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:32.139188 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:32.139188 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:32.139188 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:32.139188 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:32.139188 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 238/493] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:32.139188 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d62a18-93c1-467b-835f-5cd33f1530c7 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:32.146934 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3449e5c-332c-4165-9ed5-f9aa427840dc None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:32.191624 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcaaef-76f3-42f1-b9c1-253a9eb1c3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:32.192303 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcaaef-76f3-42f1-b9c1-253a9eb1c3d8 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:32.193198 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcaaef-76f3-42f1-b9c1-253a9eb1c3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:32.193541 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcaaef-76f3-42f1-b9c1-253a9eb1c3d8 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:32.194252 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcaaef-76f3-42f1-b9c1-253a9eb1c3d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:32.194560 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcaaef-76f3-42f1-b9c1-253a9eb1c3d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:32.195925 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcaaef-76f3-42f1-b9c1-253a9eb1c3d8 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:32.204001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 256/494] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:19:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:32.205275 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88d9ae-f9c1-4700-967f-4936fa87c847 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:32.205597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88d9ae-f9c1-4700-967f-4936fa87c847 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:32.205949 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88d9ae-f9c1-4700-967f-4936fa87c847 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:32.209414 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 257/495] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:32.209414 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a5063-3c86-47b1-95a9-98f1a8014c83 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:32.209414 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a5063-3c86-47b1-95a9-98f1a8014c83 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:32.209414 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a5063-3c86-47b1-95a9-98f1a8014c83 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:32.210578 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 258/496] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:32.216499 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a5063-3c86-47b1-95a9-98f1a8014c83 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:32.249743 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d62a18-93c1-467b-835f-5cd33f1530c7 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:32.283955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccc14e-62ba-4a0e-bb78-8d7dbd89bb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:32.284660 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccc14e-62ba-4a0e-bb78-8d7dbd89bb35 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:32.284953 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccc14e-62ba-4a0e-bb78-8d7dbd89bb35 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:32.285237 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccc14e-62ba-4a0e-bb78-8d7dbd89bb35 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:32.286020 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccc14e-62ba-4a0e-bb78-8d7dbd89bb35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:32.286564 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccc14e-62ba-4a0e-bb78-8d7dbd89bb35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:32.288044 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccc14e-62ba-4a0e-bb78-8d7dbd89bb35 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:32.300499 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 239/497] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:32.301346 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccc14e-62ba-4a0e-bb78-8d7dbd89bb35 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:32.322151 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a5063-3c86-47b1-95a9-98f1a8014c83 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:32.357971 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad566610-42c3-4548-b9af-dbffb3406576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:32.358645 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad566610-42c3-4548-b9af-dbffb3406576 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:32.358962 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad566610-42c3-4548-b9af-dbffb3406576 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:32.359254 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad566610-42c3-4548-b9af-dbffb3406576 None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:32.359947 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad566610-42c3-4548-b9af-dbffb3406576 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:32.360261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad566610-42c3-4548-b9af-dbffb3406576 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:32.361662 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad566610-42c3-4548-b9af-dbffb3406576 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:32.374582 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 259/498] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:32.375843 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7ea38-945b-47b0-8d41-9672eee3489c None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:32.376136 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7ea38-945b-47b0-8d41-9672eee3489c None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:32.377112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7ea38-945b-47b0-8d41-9672eee3489c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:32.393672 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-57c7ea38-945b-47b0-8d41-9672eee3489c None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:32.394882 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-57c7ea38-945b-47b0-8d41-9672eee3489c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:32.425228 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccc14e-62ba-4a0e-bb78-8d7dbd89bb35 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:32.458882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09859d6e-bb7a-4a4a-9375-556c3dc289a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:32.459592 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09859d6e-bb7a-4a4a-9375-556c3dc289a1 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:32.459874 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09859d6e-bb7a-4a4a-9375-556c3dc289a1 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:32.460144 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09859d6e-bb7a-4a4a-9375-556c3dc289a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:32.465236 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 260/499] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:32.466575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3531b-24e3-44e3-89e9-e232ee566ea4 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:32.466871 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3531b-24e3-44e3-89e9-e232ee566ea4 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:32.467150 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3531b-24e3-44e3-89e9-e232ee566ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:32.470897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09859d6e-bb7a-4a4a-9375-556c3dc289a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:32.472369 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09859d6e-bb7a-4a4a-9375-556c3dc289a1 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:32.484817 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-d9d3531b-24e3-44e3-89e9-e232ee566ea4 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:32.486085 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-d9d3531b-24e3-44e3-89e9-e232ee566ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:32.493116 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-09859d6e-bb7a-4a4a-9375-556c3dc289a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:32.493116 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:32.493116 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:32.493116 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:32.493116 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:32.493116 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:32.493116 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:32.493116 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:32.493116 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:32.493116 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:32.493116 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:32.493116 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:32.493116 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:32.493116 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:32.493116 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:32.494380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:32.494380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:32.494380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:32.494380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:32.494380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:32.494380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:32.494380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:32.494380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:32.494380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:32.494380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:32.494380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:32.494380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:32.494380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:32.494380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:32.494380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:32.494380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:32.494380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:32.495528 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:32.495528 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:32.495528 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:32.495528 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:32.495528 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 240/500] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:32.495528 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09859d6e-bb7a-4a4a-9375-556c3dc289a1 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:32.556463 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 261/501] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:32.557324 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3531b-24e3-44e3-89e9-e232ee566ea4 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:32.595215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09859d6e-bb7a-4a4a-9375-556c3dc289a1 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:32.634177 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffeaa99-08a0-43ff-ab93-1cd3e591bc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:32.634976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffeaa99-08a0-43ff-ab93-1cd3e591bc33 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:32.635261 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffeaa99-08a0-43ff-ab93-1cd3e591bc33 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:32.635538 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffeaa99-08a0-43ff-ab93-1cd3e591bc33 None admin] PATH_INFO: `/v3/users/glance` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:32.643408 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffeaa99-08a0-43ff-ab93-1cd3e591bc33 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:32.644866 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffeaa99-08a0-43ff-ab93-1cd3e591bc33 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:32.660673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-0ffeaa99-08a0-43ff-ab93-1cd3e591bc33 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 15:19:32.660673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:32.660673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:32.660673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:32.660673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:32.660673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:32.660673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:32.660673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:32.660673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:32.660673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:32.660673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:32.660673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:32.660673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:19:32.660673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:19:32.660673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:19:32.660673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:19:32.662551 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:32.662551 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:32.662551 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:19:32.662551 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:32.662551 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:19:32.662551 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:32.662551 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:32.662551 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:32.662551 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:32.662551 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:32.662551 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:32.662551 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:32.662551 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:32.662551 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:32.662551 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:32.662551 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:32.662551 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:32.662551 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:32.664513 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:32.664513 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:32.664513 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:19:32.664513 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:19:32.664513 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:19:32.664513 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:19:32.664513 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:19:32.664513 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:19:32.664513 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 15:19:32.664513 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:32.664513 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 241/502] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:19:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:32.664513 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffeaa99-08a0-43ff-ab93-1cd3e591bc33 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:32.667277 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3531b-24e3-44e3-89e9-e232ee566ea4 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:32.703531 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb3fbc-7a10-4c8a-8edb-84854b20ef8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:32.704339 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb3fbc-7a10-4c8a-8edb-84854b20ef8e None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:32.704625 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb3fbc-7a10-4c8a-8edb-84854b20ef8e None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:32.704899 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb3fbc-7a10-4c8a-8edb-84854b20ef8e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:32.712511 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb3fbc-7a10-4c8a-8edb-84854b20ef8e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:32.713953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb3fbc-7a10-4c8a-8edb-84854b20ef8e None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:32.730407 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-fbdb3fbc-7a10-4c8a-8edb-84854b20ef8e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:19:32.730407 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:32.730407 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:32.730407 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:32.730407 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:32.730407 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:32.730407 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:32.730407 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:32.730407 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:32.730407 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:32.730407 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:32.730407 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:32.730407 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:19:32.730407 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:19:32.730407 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:19:32.730407 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:19:32.731691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:32.731691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:32.731691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:19:32.731691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:32.731691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:19:32.731691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:32.731691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:32.731691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:32.731691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:32.731691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:32.731691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:32.731691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:32.731691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:32.731691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:32.731691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:32.731691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:32.731691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:32.731691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:32.733011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:32.733011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:32.733011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:19:32.733011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:19:32.733011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:19:32.733011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:19:32.733011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:19:32.733011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:19:32.733011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:19:32.733011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:32.733011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 262/503] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:19:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:32.733011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb3fbc-7a10-4c8a-8edb-84854b20ef8e None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:32.768387 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffeaa99-08a0-43ff-ab93-1cd3e591bc33 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:32.801810 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccb8f4-3168-410b-be25-c9498ba381fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:32.802703 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccb8f4-3168-410b-be25-c9498ba381fb None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:32.802989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccb8f4-3168-410b-be25-c9498ba381fb None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:32.803274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccb8f4-3168-410b-be25-c9498ba381fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:32.813801 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccb8f4-3168-410b-be25-c9498ba381fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:32.815285 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccb8f4-3168-410b-be25-c9498ba381fb None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:32.832540 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-e5ccb8f4-3168-410b-be25-c9498ba381fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:32.832540 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:32.832540 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:32.832540 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:32.832540 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:32.832540 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:32.832540 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:32.832540 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:32.832540 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:32.832540 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:32.832540 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:32.832540 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:32.832540 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:32.832540 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:32.832540 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:32.834416 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:32.834416 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:32.834416 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:32.834416 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:32.834416 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:32.834416 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:32.834416 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:32.834416 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:32.834416 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:32.834416 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:32.834416 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:32.834416 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:32.834416 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:32.834416 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:32.834416 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:32.834416 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:32.834416 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:32.835418 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:32.835418 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:32.835418 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:32.835418 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:32.835418 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 242/504] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:32.835752 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccb8f4-3168-410b-be25-c9498ba381fb None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:32.841241 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb3fbc-7a10-4c8a-8edb-84854b20ef8e None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:32.876524 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6831c62-ea09-4a2c-a52b-1f8f6dbfb3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:32.877195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6831c62-ea09-4a2c-a52b-1f8f6dbfb3da None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:32.877512 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6831c62-ea09-4a2c-a52b-1f8f6dbfb3da None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:32.877794 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6831c62-ea09-4a2c-a52b-1f8f6dbfb3da None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:32.878528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6831c62-ea09-4a2c-a52b-1f8f6dbfb3da None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:32.878846 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6831c62-ea09-4a2c-a52b-1f8f6dbfb3da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:32.880832 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6831c62-ea09-4a2c-a52b-1f8f6dbfb3da None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:32.892187 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 263/505] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:32.893026 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6831c62-ea09-4a2c-a52b-1f8f6dbfb3da None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:32.954184 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccb8f4-3168-410b-be25-c9498ba381fb None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:32.992532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d83003-d05e-41a8-ab53-4fe02366d72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:32.993256 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d83003-d05e-41a8-ab53-4fe02366d72f None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:32.993573 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d83003-d05e-41a8-ab53-4fe02366d72f None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:32.993862 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d83003-d05e-41a8-ab53-4fe02366d72f None admin] PATH_INFO: `/v3/roles/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:33.002590 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6831c62-ea09-4a2c-a52b-1f8f6dbfb3da None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:33.005338 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d83003-d05e-41a8-ab53-4fe02366d72f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:33.013421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-05d83003-d05e-41a8-ab53-4fe02366d72f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:33.013421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:33.013421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:33.013421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:33.013421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:33.013421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:33.013421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:33.013421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:33.013421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:33.013421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:33.013421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:33.013421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:33.013421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:33.013421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:33.013421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:33.013421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:33.014635 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:33.014635 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:33.014635 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:33.014635 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:33.014635 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:33.014635 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:33.014635 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:33.014635 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:33.014635 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:33.014635 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:33.014635 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:33.014635 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:33.014635 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:33.014635 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:33.014635 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:33.014635 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:33.015601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:33.015601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:33.015601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:33.015601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:33.015601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:33.015601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:33.015601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:33.015601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:33.015601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:33.015601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:33.015601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:33.015601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:33.015601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 243/506] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:19:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:33.015601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d83003-d05e-41a8-ab53-4fe02366d72f None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:33.043764 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc81f32-2272-49c3-b4de-754559aef49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:33.044444 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc81f32-2272-49c3-b4de-754559aef49d None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:33.044733 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc81f32-2272-49c3-b4de-754559aef49d None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:33.045014 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc81f32-2272-49c3-b4de-754559aef49d None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:33.045907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc81f32-2272-49c3-b4de-754559aef49d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:33.046222 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc81f32-2272-49c3-b4de-754559aef49d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:33.047672 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc81f32-2272-49c3-b4de-754559aef49d None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:33.087505 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 264/507] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 9 15:19:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:33.088195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc81f32-2272-49c3-b4de-754559aef49d None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:33.122083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d83003-d05e-41a8-ab53-4fe02366d72f None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:33.156856 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61317016-05c9-44d8-9245-4d3e038a3b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:33.157575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61317016-05c9-44d8-9245-4d3e038a3b58 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:33.157867 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61317016-05c9-44d8-9245-4d3e038a3b58 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:33.158149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61317016-05c9-44d8-9245-4d3e038a3b58 None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:33.159001 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61317016-05c9-44d8-9245-4d3e038a3b58 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:33.159324 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61317016-05c9-44d8-9245-4d3e038a3b58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:33.160777 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61317016-05c9-44d8-9245-4d3e038a3b58 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:33.199101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 244/508] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 9 15:19:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:33.199956 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61317016-05c9-44d8-9245-4d3e038a3b58 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:33.201759 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc81f32-2272-49c3-b4de-754559aef49d None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:33.236786 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240afab9-f8dc-4d4a-af5d-91551ce9eb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:33.237478 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240afab9-f8dc-4d4a-af5d-91551ce9eb17 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:33.237764 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240afab9-f8dc-4d4a-af5d-91551ce9eb17 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:33.238039 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240afab9-f8dc-4d4a-af5d-91551ce9eb17 None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:33.238771 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240afab9-f8dc-4d4a-af5d-91551ce9eb17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:33.239073 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240afab9-f8dc-4d4a-af5d-91551ce9eb17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:33.241136 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240afab9-f8dc-4d4a-af5d-91551ce9eb17 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:33.252809 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 265/509] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:33.253587 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240afab9-f8dc-4d4a-af5d-91551ce9eb17 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:33.310936 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61317016-05c9-44d8-9245-4d3e038a3b58 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:33.349023 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2950a-7b09-4e1d-b612-9a9397f9fc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:33.350055 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2950a-7b09-4e1d-b612-9a9397f9fc52 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:33.350343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2950a-7b09-4e1d-b612-9a9397f9fc52 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:33.350625 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2950a-7b09-4e1d-b612-9a9397f9fc52 None admin] PATH_INFO: `/v3/users/nova` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:33.357426 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240afab9-f8dc-4d4a-af5d-91551ce9eb17 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:33.357918 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2950a-7b09-4e1d-b612-9a9397f9fc52 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:33.359412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2950a-7b09-4e1d-b612-9a9397f9fc52 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:33.375209 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-bcf2950a-7b09-4e1d-b612-9a9397f9fc52 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:19:33.375209 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:33.375209 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:33.375209 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:33.375209 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:33.375209 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:33.375209 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:33.375209 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:33.375209 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:33.375209 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:33.375209 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:33.375209 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:33.375209 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:19:33.375209 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:19:33.375209 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:19:33.375209 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:19:33.376535 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:33.376535 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:33.376535 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:19:33.376535 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:33.376535 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:19:33.376535 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:33.376535 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:33.376535 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:33.376535 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:33.376535 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:33.376535 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:33.376535 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:33.376535 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:33.376535 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:33.376535 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:33.376535 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:33.376535 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:33.376535 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:33.377733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:33.377733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:33.377733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:19:33.377733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:19:33.377733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:19:33.377733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:19:33.377733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:19:33.377733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:19:33.377733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:19:33.377733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:33.377733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 245/510] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:19:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:33.377733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2950a-7b09-4e1d-b612-9a9397f9fc52 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:33.396069 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f9851-60a8-41f8-a593-240a515ab255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:33.397111 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f9851-60a8-41f8-a593-240a515ab255 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:33.397432 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f9851-60a8-41f8-a593-240a515ab255 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:33.397722 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f9851-60a8-41f8-a593-240a515ab255 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:33.398490 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f9851-60a8-41f8-a593-240a515ab255 None admin] RBAC: Adding query filter params (name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:33.398847 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f9851-60a8-41f8-a593-240a515ab255 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:33.400223 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f9851-60a8-41f8-a593-240a515ab255 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:33.408547 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 266/511] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:19:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:33.409479 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f9851-60a8-41f8-a593-240a515ab255 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:33.480738 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2950a-7b09-4e1d-b612-9a9397f9fc52 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:33.510164 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f9851-60a8-41f8-a593-240a515ab255 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:33.516526 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d377f-3fc0-4f55-ad6f-b1c2279aaa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:33.517189 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d377f-3fc0-4f55-ad6f-b1c2279aaa06 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:33.517517 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d377f-3fc0-4f55-ad6f-b1c2279aaa06 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:33.517803 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d377f-3fc0-4f55-ad6f-b1c2279aaa06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:33.548661 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb081f-44a9-4a0a-8f8d-41c90ac0b6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:33.549335 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb081f-44a9-4a0a-8f8d-41c90ac0b6e9 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:33.549665 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb081f-44a9-4a0a-8f8d-41c90ac0b6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:33.549945 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb081f-44a9-4a0a-8f8d-41c90ac0b6e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:33.586688 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d377f-3fc0-4f55-ad6f-b1c2279aaa06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:33.588176 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d377f-3fc0-4f55-ad6f-b1c2279aaa06 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:33.622424 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb081f-44a9-4a0a-8f8d-41c90ac0b6e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:33.623885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb081f-44a9-4a0a-8f8d-41c90ac0b6e9 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:33.690499 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 246/512] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:19:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:19:33.691149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d377f-3fc0-4f55-ad6f-b1c2279aaa06 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:33.725423 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 267/513] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:19:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:19:33.725975 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb081f-44a9-4a0a-8f8d-41c90ac0b6e9 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:33.792590 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d377f-3fc0-4f55-ad6f-b1c2279aaa06 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:33.827251 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb081f-44a9-4a0a-8f8d-41c90ac0b6e9 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:33.827918 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed32017-2407-4126-8e00-29a580caab73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:33.828605 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed32017-2407-4126-8e00-29a580caab73 None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:33.828905 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed32017-2407-4126-8e00-29a580caab73 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:33.829183 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed32017-2407-4126-8e00-29a580caab73 None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:33.829952 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed32017-2407-4126-8e00-29a580caab73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:33.831445 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed32017-2407-4126-8e00-29a580caab73 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:33.851993 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 247/514] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:19:33 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:19:33.852823 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed32017-2407-4126-8e00-29a580caab73 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:33.865080 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518f0f1-c8aa-45fc-b828-0b76cf364fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:33.866011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518f0f1-c8aa-45fc-b828-0b76cf364fbc None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:33.866339 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518f0f1-c8aa-45fc-b828-0b76cf364fbc None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:33.866589 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518f0f1-c8aa-45fc-b828-0b76cf364fbc None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:33.867511 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1518f0f1-c8aa-45fc-b828-0b76cf364fbc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:33.867841 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1518f0f1-c8aa-45fc-b828-0b76cf364fbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:33.869396 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1518f0f1-c8aa-45fc-b828-0b76cf364fbc None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:33.890709 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 268/515] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:19:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:33.891746 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518f0f1-c8aa-45fc-b828-0b76cf364fbc None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:33.985946 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed32017-2407-4126-8e00-29a580caab73 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:34.014034 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518f0f1-c8aa-45fc-b828-0b76cf364fbc None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:34.023822 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8734c4-dc25-4e5a-a41a-53307d105af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:34.024655 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8734c4-dc25-4e5a-a41a-53307d105af6 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:34.024944 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8734c4-dc25-4e5a-a41a-53307d105af6 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:34.025226 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8734c4-dc25-4e5a-a41a-53307d105af6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:34.037325 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8734c4-dc25-4e5a-a41a-53307d105af6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:34.038852 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8734c4-dc25-4e5a-a41a-53307d105af6 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:34.055861 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc94cb-3ae6-477e-a202-40821fe3ceb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:34.056602 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc94cb-3ae6-477e-a202-40821fe3ceb9 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:34.056890 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc94cb-3ae6-477e-a202-40821fe3ceb9 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:34.057002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-7b8734c4-dc25-4e5a-a41a-53307d105af6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:34.057002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:34.057002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:34.057002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:34.057002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:34.057002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:34.057002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:34.057002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:34.057002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:34.057002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:34.057002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:34.057002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:34.057002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:34.057002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:34.057002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:34.057989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:34.057989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:34.057989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:34.057989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:34.057989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:34.057989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:34.057989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:34.057989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:34.057989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:34.057989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:34.057989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:34.057989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:34.057989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:34.057989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:34.057989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:34.057989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:34.057989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:34.058984 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:34.058984 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:34.058984 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:34.058984 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:34.059224 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc94cb-3ae6-477e-a202-40821fe3ceb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:34.059309 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 248/516] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:34.059309 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8734c4-dc25-4e5a-a41a-53307d105af6 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:34.073058 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc94cb-3ae6-477e-a202-40821fe3ceb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:34.074587 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc94cb-3ae6-477e-a202-40821fe3ceb9 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:34.094740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-e6cc94cb-3ae6-477e-a202-40821fe3ceb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:34.094740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:34.094740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:34.094740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:34.094740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:34.094740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:34.094740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:34.094740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:34.094740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:34.094740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:34.094740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:34.094740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:34.094740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:34.094740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:34.094740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:34.096040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:34.096040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:34.096040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:34.096040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:34.096040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:34.096040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:34.096040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:34.096040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:34.096040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:34.096040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:34.096040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:34.096040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:34.096040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:34.096040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:34.096040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:34.096040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:34.096040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:34.097052 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:34.097052 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:34.097052 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:34.097052 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:34.097052 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 269/517] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:34.097388 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc94cb-3ae6-477e-a202-40821fe3ceb9 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:34.168068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8734c4-dc25-4e5a-a41a-53307d105af6 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:34.204368 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2db00-09a1-4d37-a971-843c1e58ec87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:34.205146 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2db00-09a1-4d37-a971-843c1e58ec87 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:34.205488 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2db00-09a1-4d37-a971-843c1e58ec87 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:34.205743 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2db00-09a1-4d37-a971-843c1e58ec87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:34.214966 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc94cb-3ae6-477e-a202-40821fe3ceb9 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:34.217719 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2db00-09a1-4d37-a971-843c1e58ec87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:34.219201 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2db00-09a1-4d37-a971-843c1e58ec87 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:34.236499 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-0cd2db00-09a1-4d37-a971-843c1e58ec87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:34.236499 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:34.236499 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:34.236499 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:34.236499 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:34.236499 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:34.236499 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:34.236499 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:34.236499 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:34.236499 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:34.236499 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:34.236499 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:34.236499 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:34.236499 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:34.236499 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:34.237774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:34.237774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:34.237774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:34.237774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:34.237774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:34.237774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:34.237774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:34.237774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:34.237774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:34.237774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:34.237774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:34.237774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:34.237774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:34.237774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:34.237774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:34.237774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:34.237774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:34.239102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:34.239102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:34.239102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:34.239102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:34.239102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 249/518] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:34.239102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2db00-09a1-4d37-a971-843c1e58ec87 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:34.258066 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db64be-ef23-4137-8729-1e3477b7b497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:34.258735 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db64be-ef23-4137-8729-1e3477b7b497 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:34.259015 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db64be-ef23-4137-8729-1e3477b7b497 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:34.259296 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db64be-ef23-4137-8729-1e3477b7b497 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:34.326721 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db64be-ef23-4137-8729-1e3477b7b497 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:34.328104 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db64be-ef23-4137-8729-1e3477b7b497 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:34.344016 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2db00-09a1-4d37-a971-843c1e58ec87 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:34.378419 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfce29a-13a8-42e9-88e0-7262b9f4c81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:34.379089 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfce29a-13a8-42e9-88e0-7262b9f4c81a None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:34.379671 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfce29a-13a8-42e9-88e0-7262b9f4c81a None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:34.379671 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfce29a-13a8-42e9-88e0-7262b9f4c81a None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:34.380734 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfce29a-13a8-42e9-88e0-7262b9f4c81a None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:34.381034 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfce29a-13a8-42e9-88e0-7262b9f4c81a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:34.382417 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfce29a-13a8-42e9-88e0-7262b9f4c81a None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:34.394040 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 250/519] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:34.394873 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfce29a-13a8-42e9-88e0-7262b9f4c81a None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:34.433362 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 270/520] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:19:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:19:34.438363 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db64be-ef23-4137-8729-1e3477b7b497 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:34.503414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfce29a-13a8-42e9-88e0-7262b9f4c81a None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:34.543606 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6fd34-3100-497e-afa8-82b1627fac5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:34.544483 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6fd34-3100-497e-afa8-82b1627fac5f None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:34.544937 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6fd34-3100-497e-afa8-82b1627fac5f None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:34.545433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6fd34-3100-497e-afa8-82b1627fac5f None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:34.546338 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6fd34-3100-497e-afa8-82b1627fac5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:34.546850 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6fd34-3100-497e-afa8-82b1627fac5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:34.548231 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6fd34-3100-497e-afa8-82b1627fac5f None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:34.552854 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db64be-ef23-4137-8729-1e3477b7b497 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:34.560626 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 251/521] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:34.562720 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6fd34-3100-497e-afa8-82b1627fac5f None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:34.589197 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05e4d1-65a1-4b46-a85e-f2bc1ebf63e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:34.590284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05e4d1-65a1-4b46-a85e-f2bc1ebf63e8 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:34.590813 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05e4d1-65a1-4b46-a85e-f2bc1ebf63e8 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:34.591283 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05e4d1-65a1-4b46-a85e-f2bc1ebf63e8 None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:34.592210 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05e4d1-65a1-4b46-a85e-f2bc1ebf63e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:34.592689 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05e4d1-65a1-4b46-a85e-f2bc1ebf63e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:34.594293 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05e4d1-65a1-4b46-a85e-f2bc1ebf63e8 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:34.609754 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 271/522] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:34.610901 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05e4d1-65a1-4b46-a85e-f2bc1ebf63e8 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:34.666227 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6fd34-3100-497e-afa8-82b1627fac5f None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:34.700360 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52f4dc-95f1-474a-8dd7-981e1911369e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:34.701190 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52f4dc-95f1-474a-8dd7-981e1911369e None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:34.701520 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52f4dc-95f1-474a-8dd7-981e1911369e None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:34.701799 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52f4dc-95f1-474a-8dd7-981e1911369e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:34.709578 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52f4dc-95f1-474a-8dd7-981e1911369e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:34.711016 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52f4dc-95f1-474a-8dd7-981e1911369e None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:34.719836 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05e4d1-65a1-4b46-a85e-f2bc1ebf63e8 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:34.725560 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-2a52f4dc-95f1-474a-8dd7-981e1911369e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:19:34.725560 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:34.725560 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:34.725560 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:34.725560 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:34.725560 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:34.725560 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:34.725560 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:34.725560 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:34.725560 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:34.725560 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:34.725560 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:34.725560 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:19:34.725560 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:19:34.725560 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:19:34.725560 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:19:34.726612 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:34.726612 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:34.726612 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:19:34.726612 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:34.726612 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:19:34.726612 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:34.726612 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:34.726612 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:34.726612 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:34.726612 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:34.726612 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:34.726612 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:34.726612 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:34.726612 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:34.726612 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:34.726612 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:34.726612 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:34.726612 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:34.727674 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:34.727674 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:34.727674 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:19:34.727674 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:19:34.727674 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:19:34.727674 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:19:34.727674 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:19:34.727674 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:19:34.727674 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:19:34.727674 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:34.727674 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 252/523] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:19:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:34.729047 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52f4dc-95f1-474a-8dd7-981e1911369e None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:34.757667 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d201c-5481-4aeb-8f7c-203c64ae7ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:34.758479 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d201c-5481-4aeb-8f7c-203c64ae7ee6 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:34.758768 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d201c-5481-4aeb-8f7c-203c64ae7ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:34.759049 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d201c-5481-4aeb-8f7c-203c64ae7ee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:34.771321 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d201c-5481-4aeb-8f7c-203c64ae7ee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:34.772821 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d201c-5481-4aeb-8f7c-203c64ae7ee6 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:34.790906 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-534d201c-5481-4aeb-8f7c-203c64ae7ee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:34.790906 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:34.790906 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:34.790906 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:34.790906 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:34.790906 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:34.790906 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:34.790906 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:34.790906 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:34.790906 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:34.790906 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:34.790906 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:34.790906 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:34.790906 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:34.790906 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:34.791964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:34.791964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:34.791964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:34.791964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:34.791964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:34.791964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:34.791964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:34.791964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:34.791964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:34.791964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:34.791964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:34.791964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:34.791964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:34.791964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:34.791964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:34.791964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:34.791964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:34.792964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:34.792964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:34.792964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:34.792964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:34.792964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 272/524] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:34.792964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d201c-5481-4aeb-8f7c-203c64ae7ee6 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:34.842368 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52f4dc-95f1-474a-8dd7-981e1911369e None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:34.880372 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae0ecb-82fb-4bd0-8e14-7cd678cebc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:34.881694 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae0ecb-82fb-4bd0-8e14-7cd678cebc89 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:34.882218 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae0ecb-82fb-4bd0-8e14-7cd678cebc89 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:34.882692 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae0ecb-82fb-4bd0-8e14-7cd678cebc89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:34.890144 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae0ecb-82fb-4bd0-8e14-7cd678cebc89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:34.891812 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae0ecb-82fb-4bd0-8e14-7cd678cebc89 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:34.903249 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d201c-5481-4aeb-8f7c-203c64ae7ee6 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:34.908464 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-82ae0ecb-82fb-4bd0-8e14-7cd678cebc89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:34.908464 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:34.908464 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:34.908464 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:34.908464 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:34.908464 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:34.908464 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:34.908464 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:34.908464 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:34.908464 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:34.908464 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:34.908464 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:34.908464 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:19:34.908464 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:19:34.908464 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:19:34.909596 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:19:34.909596 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:34.909596 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:34.909596 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:34.909596 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:34.909596 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:34.909596 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:34.909596 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:34.909596 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:34.909596 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:34.909596 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:34.909596 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:34.909596 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:34.909596 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:34.909596 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:34.909596 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:34.909596 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:34.910593 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:19:34.910593 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:19:34.910593 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:19:34.910593 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:19:34.910593 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:19:34.910593 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:19:34.910593 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:34.910593 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:34.911726 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 253/525] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:19:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:34.912418 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae0ecb-82fb-4bd0-8e14-7cd678cebc89 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:34.942840 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf97471-8e96-4e07-9e83-190f8ee85eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:34.943655 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf97471-8e96-4e07-9e83-190f8ee85eb2 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:34.943948 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf97471-8e96-4e07-9e83-190f8ee85eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:34.944230 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf97471-8e96-4e07-9e83-190f8ee85eb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:34.951372 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf97471-8e96-4e07-9e83-190f8ee85eb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:34.952848 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf97471-8e96-4e07-9e83-190f8ee85eb2 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:34.968063 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-9bf97471-8e96-4e07-9e83-190f8ee85eb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:34.968063 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:34.968063 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:34.968063 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:34.968063 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:34.968063 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:34.968063 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:34.968063 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:34.968063 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:34.968063 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:34.968063 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:34.968063 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:34.968063 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:19:34.968063 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:19:34.968063 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:19:34.969317 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:19:34.969317 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:34.969317 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:34.969317 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:34.969317 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:34.969317 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:34.969317 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:34.969317 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:34.969317 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:34.969317 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:34.969317 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:34.969317 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:34.969317 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:34.969317 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:34.969317 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:34.969317 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:34.969317 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:34.974968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:19:34.974968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:19:34.974968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:19:34.974968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:19:34.974968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:19:34.974968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:19:34.974968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:34.974968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:34.974968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 273/526] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:19:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:34.974968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf97471-8e96-4e07-9e83-190f8ee85eb2 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:35.027886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae0ecb-82fb-4bd0-8e14-7cd678cebc89 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:35.064051 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108592f-f805-43a3-936d-058193dcf571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:35.064749 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108592f-f805-43a3-936d-058193dcf571 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:35.065038 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108592f-f805-43a3-936d-058193dcf571 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:35.065320 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108592f-f805-43a3-936d-058193dcf571 None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:35.066232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108592f-f805-43a3-936d-058193dcf571 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:35.066555 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108592f-f805-43a3-936d-058193dcf571 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:35.068610 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108592f-f805-43a3-936d-058193dcf571 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:35.075417 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf97471-8e96-4e07-9e83-190f8ee85eb2 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:35.091774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 254/527] 10.222.0.48 () {56 vars in 1139 bytes} [Mon May 9 15:19:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:35.091774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108592f-f805-43a3-936d-058193dcf571 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:35.111485 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0741129-2666-4d5c-b385-605231b8134a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:35.112170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0741129-2666-4d5c-b385-605231b8134a None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:35.112527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0741129-2666-4d5c-b385-605231b8134a None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:35.112875 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0741129-2666-4d5c-b385-605231b8134a None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:35.113729 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0741129-2666-4d5c-b385-605231b8134a None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:35.114107 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0741129-2666-4d5c-b385-605231b8134a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:35.115836 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0741129-2666-4d5c-b385-605231b8134a None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:35.127423 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 274/528] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:35.128334 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0741129-2666-4d5c-b385-605231b8134a None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:35.214240 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108592f-f805-43a3-936d-058193dcf571 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:35.264778 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd259ff2-de9d-4a05-b9b0-95e504251a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:35.265811 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd259ff2-de9d-4a05-b9b0-95e504251a3c None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:35.266244 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd259ff2-de9d-4a05-b9b0-95e504251a3c None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:35.266714 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd259ff2-de9d-4a05-b9b0-95e504251a3c None admin] PATH_INFO: `/v3/projects` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:35.268113 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd259ff2-de9d-4a05-b9b0-95e504251a3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:35.268616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd259ff2-de9d-4a05-b9b0-95e504251a3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:35.268737 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0741129-2666-4d5c-b385-605231b8134a None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:35.271475 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd259ff2-de9d-4a05-b9b0-95e504251a3c None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:35.304390 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 255/529] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:19:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:35.304390 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd259ff2-de9d-4a05-b9b0-95e504251a3c None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:35.320050 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9dca3-f326-4870-b3a7-7ea8671f5a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:35.320824 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9dca3-f326-4870-b3a7-7ea8671f5a3e None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:35.321189 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9dca3-f326-4870-b3a7-7ea8671f5a3e None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:35.321579 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9dca3-f326-4870-b3a7-7ea8671f5a3e None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:35.322468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9dca3-f326-4870-b3a7-7ea8671f5a3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:35.322860 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9dca3-f326-4870-b3a7-7ea8671f5a3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:35.324391 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9dca3-f326-4870-b3a7-7ea8671f5a3e None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:35.343400 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 275/530] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:19:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:35.344546 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9dca3-f326-4870-b3a7-7ea8671f5a3e None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:35.407734 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd259ff2-de9d-4a05-b9b0-95e504251a3c None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:35.442728 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4de6a-94bb-4a03-af29-9428163667c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:35.443521 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4de6a-94bb-4a03-af29-9428163667c3 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:35.443818 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4de6a-94bb-4a03-af29-9428163667c3 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:35.444098 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4de6a-94bb-4a03-af29-9428163667c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:35.459558 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9dca3-f326-4870-b3a7-7ea8671f5a3e None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:35.496987 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e40160-c29d-47cb-ac24-20aaf6516dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:35.497924 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e40160-c29d-47cb-ac24-20aaf6516dc9 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:35.498275 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e40160-c29d-47cb-ac24-20aaf6516dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:35.498641 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e40160-c29d-47cb-ac24-20aaf6516dc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:35.507152 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e40160-c29d-47cb-ac24-20aaf6516dc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:35.508718 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e40160-c29d-47cb-ac24-20aaf6516dc9 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:35.519460 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4de6a-94bb-4a03-af29-9428163667c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:35.521608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4de6a-94bb-4a03-af29-9428163667c3 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:35.524752 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-97e40160-c29d-47cb-ac24-20aaf6516dc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:35.524752 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:35.524752 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:35.524752 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:35.524752 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:35.524752 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:35.524752 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:35.524752 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:35.524752 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:35.524752 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:35.524752 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:35.524752 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:35.524752 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:19:35.524752 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:19:35.524752 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:19:35.525953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:19:35.525953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:35.525953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:35.525953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:35.525953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:35.525953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:35.525953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:35.525953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:35.525953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:35.525953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:35.525953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:35.525953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:35.525953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:35.525953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:35.525953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:35.525953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:35.525953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:35.527161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:19:35.527161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:19:35.527161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:19:35.527161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:19:35.527161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:19:35.527161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:19:35.527161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:35.527161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:35.532778 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 276/531] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:19:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:35.532778 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e40160-c29d-47cb-ac24-20aaf6516dc9 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:35.630940 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 256/532] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:19:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:19:35.632149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4de6a-94bb-4a03-af29-9428163667c3 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:35.648918 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e40160-c29d-47cb-ac24-20aaf6516dc9 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:35.685848 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738b606-8c1b-4ec6-afcb-9538afb2dfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:35.686529 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738b606-8c1b-4ec6-afcb-9538afb2dfff None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:35.686820 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738b606-8c1b-4ec6-afcb-9538afb2dfff None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:35.687104 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738b606-8c1b-4ec6-afcb-9538afb2dfff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:35.687983 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738b606-8c1b-4ec6-afcb-9538afb2dfff None admin] RBAC: Adding query filter params (role.id=7d8a1698372145a59d70d67ed7867f56, scope.project.id=eb2de9bea1cf451db5f8c697f480c480, user.id=9575eaad5f3f497094f508ebf1c5e656) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:35.688280 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738b606-8c1b-4ec6-afcb-9538afb2dfff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:35.689758 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738b606-8c1b-4ec6-afcb-9538afb2dfff None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:35.701467 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 277/533] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:19:35 2022] GET /identity/v3/role_assignments?user.id=9575eaad5f3f497094f508ebf1c5e656&scope.project.id=eb2de9bea1cf451db5f8c697f480c480&role.id=7d8a1698372145a59d70d67ed7867f56 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:35.701467 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738b606-8c1b-4ec6-afcb-9538afb2dfff None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:35.756855 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4de6a-94bb-4a03-af29-9428163667c3 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:35.806062 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bfd67f-5376-42c4-be98-1bfbb9a752c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:35.806752 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfd67f-5376-42c4-be98-1bfbb9a752c3 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:35.807565 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfd67f-5376-42c4-be98-1bfbb9a752c3 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:35.807866 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfd67f-5376-42c4-be98-1bfbb9a752c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:35.808907 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bfd67f-5376-42c4-be98-1bfbb9a752c3 None admin] RBAC: Adding query filter params (role.id=7d8a1698372145a59d70d67ed7867f56, scope.project.id=eb2de9bea1cf451db5f8c697f480c480, user.id=2d337bfaeac14e53872539cebff40ab9) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:35.809352 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bfd67f-5376-42c4-be98-1bfbb9a752c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:35.811492 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bfd67f-5376-42c4-be98-1bfbb9a752c3 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:35.820542 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 257/534] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:19:35 2022] GET /identity/v3/role_assignments?user.id=2d337bfaeac14e53872539cebff40ab9&scope.project.id=eb2de9bea1cf451db5f8c697f480c480&role.id=7d8a1698372145a59d70d67ed7867f56 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:35.821557 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bfd67f-5376-42c4-be98-1bfbb9a752c3 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:35.831867 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738b606-8c1b-4ec6-afcb-9538afb2dfff None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:35.918439 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15d744-409c-4bdf-affe-7012134426bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:35.919383 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15d744-409c-4bdf-affe-7012134426bd None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:35.919681 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15d744-409c-4bdf-affe-7012134426bd None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:35.919961 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15d744-409c-4bdf-affe-7012134426bd None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:35.920791 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15d744-409c-4bdf-affe-7012134426bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:35.921104 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15d744-409c-4bdf-affe-7012134426bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:35.922623 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15d744-409c-4bdf-affe-7012134426bd None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:35.939470 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 278/535] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:19:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:35.945897 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15d744-409c-4bdf-affe-7012134426bd None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:35.952376 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bfd67f-5376-42c4-be98-1bfbb9a752c3 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:36.006353 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607190f-3a4f-40a4-8cca-34f5e9ea3853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:36.007203 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607190f-3a4f-40a4-8cca-34f5e9ea3853 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:36.007490 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607190f-3a4f-40a4-8cca-34f5e9ea3853 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:36.007775 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607190f-3a4f-40a4-8cca-34f5e9ea3853 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:36.024126 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607190f-3a4f-40a4-8cca-34f5e9ea3853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:36.025731 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607190f-3a4f-40a4-8cca-34f5e9ea3853 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:36.049742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-b607190f-3a4f-40a4-8cca-34f5e9ea3853 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:36.049742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:36.049742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:36.049742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:36.049742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:36.049742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:36.049742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:36.049742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:36.049742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:36.049742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:36.049742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:36.049742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:36.049742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:36.049742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:36.049742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:36.051063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:36.051063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:36.051063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:36.051063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:36.051063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:36.051063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:36.051063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:36.051063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:36.051063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:36.051063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:36.051063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:36.051063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:36.051063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:36.051063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:36.051063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:36.051063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:36.051063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:36.052783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:36.052783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:36.052783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:36.052783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:36.056728 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 258/536] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:36.058145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607190f-3a4f-40a4-8cca-34f5e9ea3853 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:36.131567 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15d744-409c-4bdf-affe-7012134426bd None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:36.177597 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607190f-3a4f-40a4-8cca-34f5e9ea3853 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:36.178086 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05605ad-37e3-4bf3-be21-2045c5c72e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:36.178764 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05605ad-37e3-4bf3-be21-2045c5c72e2a None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:36.179048 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05605ad-37e3-4bf3-be21-2045c5c72e2a None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:36.179321 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05605ad-37e3-4bf3-be21-2045c5c72e2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:36.180170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05605ad-37e3-4bf3-be21-2045c5c72e2a None admin] RBAC: Adding query filter params (role.id=7d8a1698372145a59d70d67ed7867f56, scope.project.id=eb2de9bea1cf451db5f8c697f480c480, user.id=42dc38d6c3634b7496b1b7e99ca3f647) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:36.180485 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05605ad-37e3-4bf3-be21-2045c5c72e2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:36.181990 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05605ad-37e3-4bf3-be21-2045c5c72e2a None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:36.188527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 279/537] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:19:35 2022] GET /identity/v3/role_assignments?user.id=42dc38d6c3634b7496b1b7e99ca3f647&scope.project.id=eb2de9bea1cf451db5f8c697f480c480&role.id=7d8a1698372145a59d70d67ed7867f56 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:36.221680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32792332-946e-4ddf-8147-5013c6332aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:36.222377 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32792332-946e-4ddf-8147-5013c6332aec None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:36.222552 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32792332-946e-4ddf-8147-5013c6332aec None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:36.222877 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32792332-946e-4ddf-8147-5013c6332aec None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:36.223700 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32792332-946e-4ddf-8147-5013c6332aec None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:36.224568 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32792332-946e-4ddf-8147-5013c6332aec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:36.225569 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32792332-946e-4ddf-8147-5013c6332aec None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:36.245504 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 259/538] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:36.248312 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05605ad-37e3-4bf3-be21-2045c5c72e2a None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:36.252282 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4079d3-924d-4034-ba8a-d8cba30ff539 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:36.252869 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4079d3-924d-4034-ba8a-d8cba30ff539 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:36.253358 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4079d3-924d-4034-ba8a-d8cba30ff539 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:36.255975 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 260/539] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:36.262091 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c896960-2bb1-4d4e-b14a-e11d70e33cbd None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:36.263831 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c896960-2bb1-4d4e-b14a-e11d70e33cbd None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:36.264356 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c896960-2bb1-4d4e-b14a-e11d70e33cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:36.284578 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-5c896960-2bb1-4d4e-b14a-e11d70e33cbd None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:36.287240 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-5c896960-2bb1-4d4e-b14a-e11d70e33cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:36.387308 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 261/540] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:36.425072 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c896960-2bb1-4d4e-b14a-e11d70e33cbd None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:36.491222 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05605ad-37e3-4bf3-be21-2045c5c72e2a None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:36.555769 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51696f86-52be-44bf-9e01-45d69d8fc8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:36.556577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51696f86-52be-44bf-9e01-45d69d8fc8ef None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:36.556862 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51696f86-52be-44bf-9e01-45d69d8fc8ef None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:36.557138 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51696f86-52be-44bf-9e01-45d69d8fc8ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:36.572513 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51696f86-52be-44bf-9e01-45d69d8fc8ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:36.574051 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51696f86-52be-44bf-9e01-45d69d8fc8ef None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:36.605513 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c896960-2bb1-4d4e-b14a-e11d70e33cbd None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:36.605773 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-51696f86-52be-44bf-9e01-45d69d8fc8ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:36.605773 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:36.605773 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:36.605773 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:36.605773 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:36.605773 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:36.605773 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:36.605773 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:36.605773 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:36.605773 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:36.605773 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:36.605773 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:36.605773 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:19:36.605773 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:19:36.605773 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:19:36.606741 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:19:36.606741 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:36.606741 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:36.606741 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:36.606741 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:36.606741 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:36.606741 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:36.606741 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:36.606741 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:36.606741 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:36.606741 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:36.606741 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:36.606741 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:36.606741 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:36.606741 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:36.606741 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:36.606741 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:36.607990 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:19:36.607990 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:19:36.607990 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:19:36.607990 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:19:36.607990 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:19:36.607990 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:19:36.607990 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:36.607990 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:36.607990 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 280/541] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:19:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:36.612885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51696f86-52be-44bf-9e01-45d69d8fc8ef None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:36.642397 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53c5b8-d9d4-40b8-a304-f1205118b577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:36.643210 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53c5b8-d9d4-40b8-a304-f1205118b577 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:36.643495 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53c5b8-d9d4-40b8-a304-f1205118b577 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:36.643776 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53c5b8-d9d4-40b8-a304-f1205118b577 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:36.654777 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53c5b8-d9d4-40b8-a304-f1205118b577 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:36.662694 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-5f53c5b8-d9d4-40b8-a304-f1205118b577 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:36.662694 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:36.662694 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:36.662694 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:36.662694 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:36.662694 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:36.662694 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:36.662694 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:36.662694 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:36.662694 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:36.662694 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:36.662694 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:36.662694 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:36.662694 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:36.662694 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:36.662694 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:36.663774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:36.663774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:36.663774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:36.663774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:36.663774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:36.663774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:36.663774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:36.663774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:36.663774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:36.663774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:36.663774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:36.663774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:36.663774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:36.663774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:36.663774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:36.663774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:36.665038 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:36.665038 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:36.665038 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:36.665038 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:36.665038 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:36.665038 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:36.665038 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:36.665038 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:36.665038 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:36.665038 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:36.665038 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:36.665038 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:36.665038 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 262/542] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:19:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:36.670058 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53c5b8-d9d4-40b8-a304-f1205118b577 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:36.807109 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51696f86-52be-44bf-9e01-45d69d8fc8ef None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:36.859333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53c5b8-d9d4-40b8-a304-f1205118b577 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:36.896847 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf87a49-0233-442b-8b01-96e1aa61e707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:36.897635 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf87a49-0233-442b-8b01-96e1aa61e707 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:36.897920 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf87a49-0233-442b-8b01-96e1aa61e707 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:36.898198 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf87a49-0233-442b-8b01-96e1aa61e707 None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:36.899150 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf87a49-0233-442b-8b01-96e1aa61e707 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:36.899467 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf87a49-0233-442b-8b01-96e1aa61e707 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:36.900994 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf87a49-0233-442b-8b01-96e1aa61e707 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:36.927831 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 281/543] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:19:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:36.934023 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf87a49-0233-442b-8b01-96e1aa61e707 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:36.935378 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d6c81-e2a1-4bac-8039-c472805bcd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:36.938392 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d6c81-e2a1-4bac-8039-c472805bcd5a None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:36.939513 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d6c81-e2a1-4bac-8039-c472805bcd5a None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:36.940033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d6c81-e2a1-4bac-8039-c472805bcd5a None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:36.941351 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d6c81-e2a1-4bac-8039-c472805bcd5a None admin] RBAC: Adding query filter params (name=service) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:36.944441 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d6c81-e2a1-4bac-8039-c472805bcd5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:36.946161 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d6c81-e2a1-4bac-8039-c472805bcd5a None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:36.956000 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 263/544] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:19:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:36.970708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d6c81-e2a1-4bac-8039-c472805bcd5a None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:37.058960 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf87a49-0233-442b-8b01-96e1aa61e707 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:37.098417 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ad7ec-b756-4d95-916b-5f63b6d208af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:37.100332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ad7ec-b756-4d95-916b-5f63b6d208af None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:37.100628 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ad7ec-b756-4d95-916b-5f63b6d208af None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:37.100912 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ad7ec-b756-4d95-916b-5f63b6d208af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:37.101797 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ad7ec-b756-4d95-916b-5f63b6d208af None admin] RBAC: Adding query filter params (role.id=7d8a1698372145a59d70d67ed7867f56, scope.project.id=eb2de9bea1cf451db5f8c697f480c480, user.id=e9433a0b92c34247b4e539b96dc4d581) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:37.102119 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ad7ec-b756-4d95-916b-5f63b6d208af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:37.103568 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ad7ec-b756-4d95-916b-5f63b6d208af None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:37.120014 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 282/545] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:19:36 2022] GET /identity/v3/role_assignments?user.id=e9433a0b92c34247b4e539b96dc4d581&scope.project.id=eb2de9bea1cf451db5f8c697f480c480&role.id=7d8a1698372145a59d70d67ed7867f56 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:37.167131 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d6c81-e2a1-4bac-8039-c472805bcd5a None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:37.220845 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4321d-051e-4a00-a6b5-212725e1bff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:37.221712 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4321d-051e-4a00-a6b5-212725e1bff5 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:37.222275 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4321d-051e-4a00-a6b5-212725e1bff5 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:37.222275 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4321d-051e-4a00-a6b5-212725e1bff5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:37.235238 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4321d-051e-4a00-a6b5-212725e1bff5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:37.236715 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4321d-051e-4a00-a6b5-212725e1bff5 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:37.265035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-dee4321d-051e-4a00-a6b5-212725e1bff5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:37.265035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:37.265035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:37.265035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:37.265035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:37.265035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:37.265035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:37.265035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:37.265035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:37.265035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:37.265035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:37.265035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:37.265035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:37.265035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:37.265035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:37.266134 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:37.266134 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:37.266134 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:37.266134 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:37.266134 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:37.266134 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:37.266134 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:37.266134 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:37.266134 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:37.266134 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:37.266134 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:37.266134 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:37.266134 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:37.266134 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:37.266134 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:37.266134 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:37.266134 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:37.268293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:37.268293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:37.268293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:37.268293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:37.268293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 264/546] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:37.273067 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ad7ec-b756-4d95-916b-5f63b6d208af None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:37.402170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ad7ec-b756-4d95-916b-5f63b6d208af None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:37.441011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e55b01-6e77-4577-bb65-598c60fc5351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:37.441728 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e55b01-6e77-4577-bb65-598c60fc5351 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:37.442019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e55b01-6e77-4577-bb65-598c60fc5351 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:37.442338 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e55b01-6e77-4577-bb65-598c60fc5351 None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:37.443793 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e55b01-6e77-4577-bb65-598c60fc5351 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:37.444115 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e55b01-6e77-4577-bb65-598c60fc5351 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:37.445569 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e55b01-6e77-4577-bb65-598c60fc5351 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:37.460483 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 283/547] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:37.466001 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4321d-051e-4a00-a6b5-212725e1bff5 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:37.612543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4321d-051e-4a00-a6b5-212725e1bff5 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:37.658165 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a90d3-c8a6-4a7b-a0fb-02972af30668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:37.659349 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a90d3-c8a6-4a7b-a0fb-02972af30668 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:37.659924 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a90d3-c8a6-4a7b-a0fb-02972af30668 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:37.660412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a90d3-c8a6-4a7b-a0fb-02972af30668 None admin] PATH_INFO: `/v3/users/swift` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:37.668714 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a90d3-c8a6-4a7b-a0fb-02972af30668 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:37.670465 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a90d3-c8a6-4a7b-a0fb-02972af30668 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:37.684891 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-aa5a90d3-c8a6-4a7b-a0fb-02972af30668 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:19:37.684891 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:37.684891 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:37.684891 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:37.684891 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:37.684891 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:37.684891 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:37.684891 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:37.684891 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:37.684891 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:37.684891 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:37.684891 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:37.684891 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:19:37.684891 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:19:37.684891 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:19:37.684891 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:19:37.686003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:37.686003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:37.686003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:19:37.686003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:37.686003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:19:37.686003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:37.686003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:37.686003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:37.686003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:37.686003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:37.686003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:37.686003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:37.686003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:37.686003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:37.686003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:37.686003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:37.686003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:37.686003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:37.687063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:37.687063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:37.687063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:19:37.687063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:19:37.687063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:19:37.687063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:19:37.687063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:19:37.687063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:19:37.687063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:19:37.687063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:37.689874 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 265/548] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:19:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:37.698485 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e55b01-6e77-4577-bb65-598c60fc5351 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:37.847210 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e55b01-6e77-4577-bb65-598c60fc5351 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:37.893152 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8e7d6-581f-475c-97b4-491cddefb820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:37.893867 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8e7d6-581f-475c-97b4-491cddefb820 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:37.894153 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8e7d6-581f-475c-97b4-491cddefb820 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:37.894438 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8e7d6-581f-475c-97b4-491cddefb820 None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:37.895412 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8e7d6-581f-475c-97b4-491cddefb820 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:37.896009 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8e7d6-581f-475c-97b4-491cddefb820 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:37.897482 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8e7d6-581f-475c-97b4-491cddefb820 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:37.925076 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 284/549] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 9 15:19:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:37.931500 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a90d3-c8a6-4a7b-a0fb-02972af30668 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:38.151682 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a90d3-c8a6-4a7b-a0fb-02972af30668 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:38.185815 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc9d5c-9274-4a72-b986-3933d5c229cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:38.186474 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc9d5c-9274-4a72-b986-3933d5c229cd None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:38.186758 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc9d5c-9274-4a72-b986-3933d5c229cd None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:38.187033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc9d5c-9274-4a72-b986-3933d5c229cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:38.254929 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc9d5c-9274-4a72-b986-3933d5c229cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:38.256391 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc9d5c-9274-4a72-b986-3933d5c229cd None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:38.366968 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 266/550] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:19:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:19:38.372237 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8e7d6-581f-475c-97b4-491cddefb820 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:38.515036 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9546f3-fa98-4dc2-a179-593e4b15d8f0 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:38.515235 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9546f3-fa98-4dc2-a179-593e4b15d8f0 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:38.515496 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9546f3-fa98-4dc2-a179-593e4b15d8f0 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:38.516877 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 267/551] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:38.534250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8e7d6-581f-475c-97b4-491cddefb820 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:38.537444 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1db935-5f72-40ad-9d1a-4fb31cffb65f None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:38.537444 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1db935-5f72-40ad-9d1a-4fb31cffb65f None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:38.537444 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1db935-5f72-40ad-9d1a-4fb31cffb65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:38.566288 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-de1db935-5f72-40ad-9d1a-4fb31cffb65f None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:38.568605 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-de1db935-5f72-40ad-9d1a-4fb31cffb65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:38.575634 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822e263-d2ee-4e84-b714-1e7832e39595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:38.576431 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822e263-d2ee-4e84-b714-1e7832e39595 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:38.576715 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822e263-d2ee-4e84-b714-1e7832e39595 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:38.576989 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822e263-d2ee-4e84-b714-1e7832e39595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:38.591072 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e822e263-d2ee-4e84-b714-1e7832e39595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:38.592973 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e822e263-d2ee-4e84-b714-1e7832e39595 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:38.616142 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-e822e263-d2ee-4e84-b714-1e7832e39595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:38.616142 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:38.616142 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:38.616142 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:38.616142 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:38.616142 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:38.616142 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:38.616142 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:38.616142 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:38.616142 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:38.616142 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:38.616142 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:38.616142 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:38.616142 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:38.616142 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:38.617210 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:38.617210 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:38.617210 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:38.617210 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:38.617210 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:38.617210 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:38.617210 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:38.617210 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:38.617210 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:38.617210 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:38.617210 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:38.617210 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:38.617210 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:38.617210 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:38.617210 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:38.617210 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:38.617210 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:38.620523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:38.620523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:38.620523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:38.620523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:38.620523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 285/552] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:38.620523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7886fd-123f-49f4-94ca-c1c71d1f6f9a None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:38.620523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7886fd-123f-49f4-94ca-c1c71d1f6f9a None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:38.620523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7886fd-123f-49f4-94ca-c1c71d1f6f9a None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:38.635119 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 286/553] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:38.635119 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7886fd-123f-49f4-94ca-c1c71d1f6f9a None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:38.664901 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 268/554] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:38.667571 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b33fa-5af4-4c02-97fc-3d8f120c7d98 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:38.668121 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b33fa-5af4-4c02-97fc-3d8f120c7d98 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:38.668799 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b33fa-5af4-4c02-97fc-3d8f120c7d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:38.691172 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-2d6b33fa-5af4-4c02-97fc-3d8f120c7d98 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:38.694447 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-2d6b33fa-5af4-4c02-97fc-3d8f120c7d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:38.754442 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7886fd-123f-49f4-94ca-c1c71d1f6f9a None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:38.793617 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 269/555] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:38.793617 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b33fa-5af4-4c02-97fc-3d8f120c7d98 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:38.802399 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09209f2b-89b5-4f7e-8590-77441175e1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:38.803140 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09209f2b-89b5-4f7e-8590-77441175e1f1 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:38.803423 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09209f2b-89b5-4f7e-8590-77441175e1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:38.803701 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09209f2b-89b5-4f7e-8590-77441175e1f1 None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:38.804558 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09209f2b-89b5-4f7e-8590-77441175e1f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:38.806531 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09209f2b-89b5-4f7e-8590-77441175e1f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:38.808378 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09209f2b-89b5-4f7e-8590-77441175e1f1 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:38.824213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 287/556] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:38.825091 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09209f2b-89b5-4f7e-8590-77441175e1f1 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:38.919354 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b33fa-5af4-4c02-97fc-3d8f120c7d98 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:38.936421 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09209f2b-89b5-4f7e-8590-77441175e1f1 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:38.956174 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b6347-7f90-4b1c-bd0a-ce3852be70a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:38.957231 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b6347-7f90-4b1c-bd0a-ce3852be70a0 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:38.957737 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b6347-7f90-4b1c-bd0a-ce3852be70a0 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:38.958286 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b6347-7f90-4b1c-bd0a-ce3852be70a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:38.969772 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b6347-7f90-4b1c-bd0a-ce3852be70a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:38.972728 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c08253-de66-43e1-8662-9c465642222f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:38.973596 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c08253-de66-43e1-8662-9c465642222f None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:38.973904 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c08253-de66-43e1-8662-9c465642222f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:38.974157 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c08253-de66-43e1-8662-9c465642222f None admin] PATH_INFO: `/v3/roles/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:38.979543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-644b6347-7f90-4b1c-bd0a-ce3852be70a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:38.979543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:38.979543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:38.979543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:38.979543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:38.979543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:38.979543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:38.979543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:38.979543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:38.979543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:38.979543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:38.979543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:38.979543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:38.979543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:38.979543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:38.979543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:38.980626 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:38.980626 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:38.980626 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:38.980626 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:38.980626 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:38.980626 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:38.980626 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:38.980626 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:38.980626 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:38.980626 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:38.980626 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:38.980626 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:38.980626 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:38.980626 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:38.980626 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:38.980626 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:38.981623 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:38.981623 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:38.981623 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:38.981623 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:38.981623 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:38.981623 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:38.981623 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:38.981623 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:38.981623 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:38.981623 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:38.981623 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:38.981623 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:38.984364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 270/557] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:19:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:38.985490 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b6347-7f90-4b1c-bd0a-ce3852be70a0 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:38.988418 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c08253-de66-43e1-8662-9c465642222f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:38.997833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-e6c08253-de66-43e1-8662-9c465642222f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:38.997833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:38.997833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:38.997833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:38.997833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:38.997833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:38.997833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:38.997833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:38.997833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:38.997833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:38.997833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:38.997833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:38.997833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:38.997833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:38.997833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:38.997833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:38.999112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:38.999112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:38.999112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:38.999112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:38.999112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:38.999112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:38.999112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:38.999112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:38.999112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:38.999112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:38.999112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:38.999112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:38.999112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:38.999112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:38.999112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:38.999112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:39.000066 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:39.000066 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:39.000066 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:39.000066 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:39.000066 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:39.000066 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:39.000066 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:39.000066 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:39.000066 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:39.000066 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:39.000066 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:39.000066 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:39.006108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 288/558] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:19:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:39.006905 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c08253-de66-43e1-8662-9c465642222f None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:39.102269 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b6347-7f90-4b1c-bd0a-ce3852be70a0 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:39.114733 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c08253-de66-43e1-8662-9c465642222f None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:39.138618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7be0d-2009-452a-99dd-b6251508de08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:39.139833 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7be0d-2009-452a-99dd-b6251508de08 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:39.140319 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7be0d-2009-452a-99dd-b6251508de08 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:39.141099 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7be0d-2009-452a-99dd-b6251508de08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:39.151445 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7be0d-2009-452a-99dd-b6251508de08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:39.151771 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd40d8e-cd79-4e01-8ffe-e36269273f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:39.152349 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd40d8e-cd79-4e01-8ffe-e36269273f62 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:39.152647 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd40d8e-cd79-4e01-8ffe-e36269273f62 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:39.152963 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd40d8e-cd79-4e01-8ffe-e36269273f62 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:39.153981 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd40d8e-cd79-4e01-8ffe-e36269273f62 None admin] RBAC: Adding query filter params (name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:39.154289 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd40d8e-cd79-4e01-8ffe-e36269273f62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:39.155680 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd40d8e-cd79-4e01-8ffe-e36269273f62 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:39.156868 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7be0d-2009-452a-99dd-b6251508de08 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:39.166083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 289/559] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:19:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:39.167035 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd40d8e-cd79-4e01-8ffe-e36269273f62 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:39.184376 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-70c7be0d-2009-452a-99dd-b6251508de08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:39.184376 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:39.184376 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:39.184376 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:39.184376 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:39.184376 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:39.184376 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:39.184376 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:39.184376 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:39.184376 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:39.184376 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:39.184376 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:39.184376 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:19:39.184376 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:19:39.184376 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:19:39.186135 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:19:39.186135 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:39.186135 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:39.186135 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:39.186135 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:39.186135 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:39.186135 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:39.186135 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:39.186135 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:39.186135 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:39.186135 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:39.186135 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:39.186135 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:39.186135 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:39.186135 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:39.186135 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:39.186135 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:39.187622 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:19:39.187622 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:19:39.187622 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:19:39.187622 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:19:39.187622 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:19:39.187622 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:19:39.187622 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:39.187622 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:39.197578 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 271/560] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:19:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:39.199305 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7be0d-2009-452a-99dd-b6251508de08 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:39.284647 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd40d8e-cd79-4e01-8ffe-e36269273f62 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:39.319988 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55334770-89da-4ad1-8fbb-1d3cd7553688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:39.320670 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55334770-89da-4ad1-8fbb-1d3cd7553688 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:39.320957 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55334770-89da-4ad1-8fbb-1d3cd7553688 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:39.321181 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7be0d-2009-452a-99dd-b6251508de08 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:39.321748 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55334770-89da-4ad1-8fbb-1d3cd7553688 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:39.322032 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55334770-89da-4ad1-8fbb-1d3cd7553688 None admin] RBAC: Adding query filter params (name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:39.322346 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55334770-89da-4ad1-8fbb-1d3cd7553688 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:39.323730 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55334770-89da-4ad1-8fbb-1d3cd7553688 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:39.332628 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 290/561] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:19:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:39.334149 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55334770-89da-4ad1-8fbb-1d3cd7553688 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:39.361219 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2f4e7-8a56-439c-bbed-74232243a229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:39.361995 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2f4e7-8a56-439c-bbed-74232243a229 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:39.362284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2f4e7-8a56-439c-bbed-74232243a229 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:39.362561 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2f4e7-8a56-439c-bbed-74232243a229 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:39.373957 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2f4e7-8a56-439c-bbed-74232243a229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:39.375430 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2f4e7-8a56-439c-bbed-74232243a229 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:39.396769 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-f3c2f4e7-8a56-439c-bbed-74232243a229 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:39.396769 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:39.396769 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:39.396769 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:39.396769 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:39.396769 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:39.396769 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:39.396769 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:39.396769 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:39.396769 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:39.396769 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:39.396769 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:39.396769 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:39.396769 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:39.396769 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:39.397920 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:39.397920 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:39.397920 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:39.397920 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:39.397920 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:39.397920 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:39.397920 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:39.397920 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:39.397920 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:39.397920 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:39.397920 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:39.397920 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:39.397920 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:39.397920 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:39.397920 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:39.397920 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:39.397920 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:39.398918 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:39.398918 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:39.398918 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:39.398918 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:39.401741 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 272/562] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:39.403608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebae8aa-27b0-4c53-a3c1-6cc01df74c10 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:39.403903 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebae8aa-27b0-4c53-a3c1-6cc01df74c10 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:39.404185 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebae8aa-27b0-4c53-a3c1-6cc01df74c10 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:39.405679 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 273/563] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:39.406965 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebae8aa-27b0-4c53-a3c1-6cc01df74c10 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:39.456741 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55334770-89da-4ad1-8fbb-1d3cd7553688 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:39.494199 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7afb0-a4bd-4893-8548-7cb26f7740bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:39.494886 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7afb0-a4bd-4893-8548-7cb26f7740bd None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:39.495170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7afb0-a4bd-4893-8548-7cb26f7740bd None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:39.495448 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7afb0-a4bd-4893-8548-7cb26f7740bd None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:39.496265 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7afb0-a4bd-4893-8548-7cb26f7740bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:39.496578 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7afb0-a4bd-4893-8548-7cb26f7740bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:39.498095 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7afb0-a4bd-4893-8548-7cb26f7740bd None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:39.511599 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 291/564] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:19:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:39.511599 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7afb0-a4bd-4893-8548-7cb26f7740bd None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:39.528140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebae8aa-27b0-4c53-a3c1-6cc01df74c10 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:39.568601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad6a61-916e-4e2b-8b51-1fa1e20ce897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:39.569449 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad6a61-916e-4e2b-8b51-1fa1e20ce897 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:39.569736 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad6a61-916e-4e2b-8b51-1fa1e20ce897 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:39.570010 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad6a61-916e-4e2b-8b51-1fa1e20ce897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:39.581458 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad6a61-916e-4e2b-8b51-1fa1e20ce897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:39.583520 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad6a61-916e-4e2b-8b51-1fa1e20ce897 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:39.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-f6ad6a61-916e-4e2b-8b51-1fa1e20ce897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:39.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:39.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:39.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:39.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:39.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:39.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:39.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:39.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:39.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:39.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:39.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:39.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:39.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:39.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:39.604180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:39.604180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:39.604180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:39.604180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:39.604180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:39.604180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:39.604180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:39.604180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:39.604180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:39.604180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:39.604180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:39.604180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:39.604180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:39.604180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:39.604180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:39.604180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:39.604180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:39.605300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:39.605300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:39.605300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:39.605300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:39.605300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 274/565] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:39.605934 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578c5ac-b3df-4db3-bde9-98a8917d9363 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:39.606434 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578c5ac-b3df-4db3-bde9-98a8917d9363 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:39.606556 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578c5ac-b3df-4db3-bde9-98a8917d9363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:39.625262 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-0578c5ac-b3df-4db3-bde9-98a8917d9363 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:39.626465 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-0578c5ac-b3df-4db3-bde9-98a8917d9363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:39.636211 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7afb0-a4bd-4893-8548-7cb26f7740bd None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:39.673689 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2c53c-1d4f-4948-a10d-f5cbe5ab986a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:39.674397 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2c53c-1d4f-4948-a10d-f5cbe5ab986a None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:39.674679 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2c53c-1d4f-4948-a10d-f5cbe5ab986a None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:39.674963 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2c53c-1d4f-4948-a10d-f5cbe5ab986a None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:39.675722 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2c53c-1d4f-4948-a10d-f5cbe5ab986a None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:39.676030 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2c53c-1d4f-4948-a10d-f5cbe5ab986a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:39.678316 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2c53c-1d4f-4948-a10d-f5cbe5ab986a None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:39.691591 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 292/566] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:39.693001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2c53c-1d4f-4948-a10d-f5cbe5ab986a None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:39.710298 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 275/567] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:39.711985 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578c5ac-b3df-4db3-bde9-98a8917d9363 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:39.797693 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2c53c-1d4f-4948-a10d-f5cbe5ab986a None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:39.824146 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578c5ac-b3df-4db3-bde9-98a8917d9363 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:39.832605 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f9b4f-f89c-4a6f-aa53-3a1861a6ca24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:39.833441 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f9b4f-f89c-4a6f-aa53-3a1861a6ca24 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:39.833737 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f9b4f-f89c-4a6f-aa53-3a1861a6ca24 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:39.834018 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f9b4f-f89c-4a6f-aa53-3a1861a6ca24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:39.834870 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f9b4f-f89c-4a6f-aa53-3a1861a6ca24 None admin] RBAC: Adding query filter params (role.id=7d8a1698372145a59d70d67ed7867f56, scope.project.id=eb2de9bea1cf451db5f8c697f480c480, user.id=dda2a8271a764e65bb97e316410b91b1) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:39.835185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f9b4f-f89c-4a6f-aa53-3a1861a6ca24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:39.836635 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f9b4f-f89c-4a6f-aa53-3a1861a6ca24 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:39.853400 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 293/568] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:19:39 2022] GET /identity/v3/role_assignments?user.id=dda2a8271a764e65bb97e316410b91b1&scope.project.id=eb2de9bea1cf451db5f8c697f480c480&role.id=7d8a1698372145a59d70d67ed7867f56 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:39.853400 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f9b4f-f89c-4a6f-aa53-3a1861a6ca24 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:39.859393 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8541170-8643-41d2-a967-ca02a9aef92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:39.860079 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8541170-8643-41d2-a967-ca02a9aef92d None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:39.860364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8541170-8643-41d2-a967-ca02a9aef92d None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:39.860642 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8541170-8643-41d2-a967-ca02a9aef92d None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:39.861405 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8541170-8643-41d2-a967-ca02a9aef92d None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:39.861750 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8541170-8643-41d2-a967-ca02a9aef92d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:39.863219 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8541170-8643-41d2-a967-ca02a9aef92d None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:39.877680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 276/569] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:39.877680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8541170-8643-41d2-a967-ca02a9aef92d None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:39.975989 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f9b4f-f89c-4a6f-aa53-3a1861a6ca24 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:39.983777 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8541170-8643-41d2-a967-ca02a9aef92d None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:40.014082 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37981cd-28c3-4ab7-9952-594c200b7bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:40.014912 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37981cd-28c3-4ab7-9952-594c200b7bfb None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:40.015193 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37981cd-28c3-4ab7-9952-594c200b7bfb None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:40.015478 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37981cd-28c3-4ab7-9952-594c200b7bfb None admin] PATH_INFO: `/v3/users/glance` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:40.019689 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216ed63-daa4-4a3c-9ff7-d20df0a750ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:40.021278 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216ed63-daa4-4a3c-9ff7-d20df0a750ea None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:40.021673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216ed63-daa4-4a3c-9ff7-d20df0a750ea None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:40.021954 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216ed63-daa4-4a3c-9ff7-d20df0a750ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:40.025157 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37981cd-28c3-4ab7-9952-594c200b7bfb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:40.026686 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37981cd-28c3-4ab7-9952-594c200b7bfb None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:40.032991 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216ed63-daa4-4a3c-9ff7-d20df0a750ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:40.040761 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-7216ed63-daa4-4a3c-9ff7-d20df0a750ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:40.040761 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:40.040761 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:40.040761 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:40.040761 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:40.040761 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:40.040761 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:40.040761 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:40.040761 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:40.040761 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:40.040761 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:40.040761 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:40.040761 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:40.040761 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:40.040761 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:40.040761 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:40.041886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:40.041886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:40.041886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:40.041886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:40.041886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:40.041886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:40.041886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:40.041886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:40.041886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:40.041886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:40.041886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:40.041886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:40.041886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:40.041886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:40.041886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:40.041886 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:40.042847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:40.042847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:40.042847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:40.042847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:40.042847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:40.042847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:40.042847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:40.042847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:40.042847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:40.042847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:40.042847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:40.042847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:40.042847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 277/570] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:19:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:40.043622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-b37981cd-28c3-4ab7-9952-594c200b7bfb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 15:19:40.043622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:40.043622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:40.043622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:40.043622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:40.043622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:40.043622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:40.043622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:40.043622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:40.043622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:40.043622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:40.043622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:40.043622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:19:40.043622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:19:40.043622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:19:40.043622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:19:40.044554 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:40.044554 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:40.044554 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:19:40.044554 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:40.044554 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:19:40.044554 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:40.044554 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:40.044554 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:40.044554 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:40.044554 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:40.044554 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:40.044554 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:40.044554 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:40.044554 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:40.044554 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:40.044554 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:40.044554 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:40.044554 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:40.047725 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:40.047725 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:40.047725 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:19:40.047725 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:19:40.047725 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:19:40.047725 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:19:40.047725 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:19:40.047725 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:19:40.047725 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 15:19:40.047725 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:40.049009 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956a522-2319-46a7-8fa2-d48d865f95ad None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:40.049009 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956a522-2319-46a7-8fa2-d48d865f95ad None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:40.049009 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956a522-2319-46a7-8fa2-d48d865f95ad None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:40.049427 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 294/571] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:19:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:40.049771 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 278/572] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:40.050057 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37981cd-28c3-4ab7-9952-594c200b7bfb None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:40.050680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956a522-2319-46a7-8fa2-d48d865f95ad None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:40.152481 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37981cd-28c3-4ab7-9952-594c200b7bfb None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:40.154128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956a522-2319-46a7-8fa2-d48d865f95ad None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:40.185874 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda337a-f203-42df-b84a-7e04eeb4d245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:40.186679 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda337a-f203-42df-b84a-7e04eeb4d245 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:40.186975 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda337a-f203-42df-b84a-7e04eeb4d245 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:40.187301 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda337a-f203-42df-b84a-7e04eeb4d245 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:40.188452 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3229eb7-1269-4dc3-90bb-06e36930e21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:40.189182 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3229eb7-1269-4dc3-90bb-06e36930e21c None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:40.189503 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3229eb7-1269-4dc3-90bb-06e36930e21c None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:40.189848 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3229eb7-1269-4dc3-90bb-06e36930e21c None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:40.190604 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3229eb7-1269-4dc3-90bb-06e36930e21c None admin] RBAC: Adding query filter params (name=service) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:40.190927 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3229eb7-1269-4dc3-90bb-06e36930e21c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:40.192871 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3229eb7-1269-4dc3-90bb-06e36930e21c None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:40.195741 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda337a-f203-42df-b84a-7e04eeb4d245 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:40.197181 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda337a-f203-42df-b84a-7e04eeb4d245 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:40.206587 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 279/573] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:19:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:40.206587 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e905e-840f-44c5-9209-31ba28b78648 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:40.206587 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e905e-840f-44c5-9209-31ba28b78648 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:40.206587 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e905e-840f-44c5-9209-31ba28b78648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:40.216009 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-cfda337a-f203-42df-b84a-7e04eeb4d245 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:19:40.216009 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:40.216009 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:40.216009 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:40.216009 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:40.216009 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:40.216009 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:40.216009 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:40.216009 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:40.216009 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:40.216009 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:40.216009 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:40.216009 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:19:40.216009 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:19:40.216009 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:19:40.216009 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:19:40.217195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:40.217195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:40.217195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:19:40.217195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:40.217195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:19:40.217195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:40.217195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:40.217195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:40.217195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:40.217195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:40.217195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:40.217195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:40.217195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:40.217195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:40.217195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:40.217195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:40.217195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:40.217195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:40.218335 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:40.218335 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:40.218335 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:19:40.218335 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:19:40.218335 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:19:40.218335 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:19:40.218335 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:19:40.218335 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:19:40.218335 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:19:40.218335 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:40.220909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-a24e905e-840f-44c5-9209-31ba28b78648 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:40.223292 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 295/574] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:19:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:40.223937 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-a24e905e-840f-44c5-9209-31ba28b78648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:40.224026 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda337a-f203-42df-b84a-7e04eeb4d245 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:40.301404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 280/575] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:40.301404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e905e-840f-44c5-9209-31ba28b78648 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:40.342098 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda337a-f203-42df-b84a-7e04eeb4d245 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:40.377875 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cb959-23f4-4838-88bb-760c654ca2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:40.378581 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cb959-23f4-4838-88bb-760c654ca2e5 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:40.378865 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cb959-23f4-4838-88bb-760c654ca2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:40.379138 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cb959-23f4-4838-88bb-760c654ca2e5 None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:40.380908 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002cb959-23f4-4838-88bb-760c654ca2e5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:40.381490 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002cb959-23f4-4838-88bb-760c654ca2e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:40.382984 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002cb959-23f4-4838-88bb-760c654ca2e5 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:40.398705 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e905e-840f-44c5-9209-31ba28b78648 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:40.407790 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 296/576] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 9 15:19:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:40.407790 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cb959-23f4-4838-88bb-760c654ca2e5 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:40.433453 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b01bf-0c17-4685-802a-f7e04a95ac36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:40.434446 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b01bf-0c17-4685-802a-f7e04a95ac36 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:40.434733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b01bf-0c17-4685-802a-f7e04a95ac36 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:40.435013 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b01bf-0c17-4685-802a-f7e04a95ac36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:40.445889 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b01bf-0c17-4685-802a-f7e04a95ac36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:40.447393 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b01bf-0c17-4685-802a-f7e04a95ac36 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:40.464878 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-900b01bf-0c17-4685-802a-f7e04a95ac36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:40.464878 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:40.464878 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:40.464878 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:40.464878 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:40.464878 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:40.464878 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:40.464878 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:40.464878 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:40.464878 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:40.464878 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:40.464878 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:40.464878 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:40.464878 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:40.464878 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:40.466070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:40.466070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:40.466070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:40.466070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:40.466070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:40.466070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:40.466070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:40.466070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:40.466070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:40.466070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:40.466070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:40.466070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:40.466070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:40.466070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:40.466070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:40.466070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:40.466070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:40.467103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:40.467103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:40.467103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:40.467103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:40.467103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 281/577] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:40.467103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b01bf-0c17-4685-802a-f7e04a95ac36 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:40.516674 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cb959-23f4-4838-88bb-760c654ca2e5 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:40.559246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e1a4b-262c-4757-be9e-c65ee580078f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:40.559928 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e1a4b-262c-4757-be9e-c65ee580078f None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:40.560214 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e1a4b-262c-4757-be9e-c65ee580078f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:40.560492 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e1a4b-262c-4757-be9e-c65ee580078f None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:40.561342 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e1a4b-262c-4757-be9e-c65ee580078f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:40.561732 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e1a4b-262c-4757-be9e-c65ee580078f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:40.563253 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e1a4b-262c-4757-be9e-c65ee580078f None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:40.568974 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b01bf-0c17-4685-802a-f7e04a95ac36 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:40.585435 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 297/578] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 9 15:19:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:40.586306 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e1a4b-262c-4757-be9e-c65ee580078f None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:40.610805 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ca5c4-78c9-41a2-88bf-c0e74961f2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:40.611613 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ca5c4-78c9-41a2-88bf-c0e74961f2a5 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:40.611896 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ca5c4-78c9-41a2-88bf-c0e74961f2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:40.612176 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ca5c4-78c9-41a2-88bf-c0e74961f2a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:40.624214 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ca5c4-78c9-41a2-88bf-c0e74961f2a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:40.632293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-3d4ca5c4-78c9-41a2-88bf-c0e74961f2a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:40.632293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:40.632293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:40.632293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:40.632293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:40.632293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:40.632293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:40.632293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:40.632293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:40.632293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:40.632293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:40.632293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:40.632293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:40.632293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:40.632293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:40.632293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:40.633720 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:40.633720 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:40.633720 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:40.633720 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:40.633720 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:40.633720 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:40.633720 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:40.633720 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:40.633720 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:40.633720 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:40.633720 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:40.633720 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:40.633720 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:40.633720 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:40.633720 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:40.633720 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:40.634879 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:40.634879 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:40.634879 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:40.634879 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:40.634879 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:40.634879 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:40.634879 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:40.634879 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:40.634879 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:40.634879 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:40.634879 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:40.634879 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:40.637756 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 282/579] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:19:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:40.638950 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ca5c4-78c9-41a2-88bf-c0e74961f2a5 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:40.699949 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e1a4b-262c-4757-be9e-c65ee580078f None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:40.734420 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193a49f-2035-41a5-8afa-759d476175b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:40.735225 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193a49f-2035-41a5-8afa-759d476175b3 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:40.735506 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193a49f-2035-41a5-8afa-759d476175b3 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:40.735780 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193a49f-2035-41a5-8afa-759d476175b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:40.746282 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193a49f-2035-41a5-8afa-759d476175b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:40.746674 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ca5c4-78c9-41a2-88bf-c0e74961f2a5 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:40.747762 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193a49f-2035-41a5-8afa-759d476175b3 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:40.765778 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-b193a49f-2035-41a5-8afa-759d476175b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:40.765778 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:40.765778 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:40.765778 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:40.765778 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:40.765778 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:40.765778 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:40.765778 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:40.765778 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:40.765778 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:40.765778 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:40.765778 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:40.765778 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:40.765778 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:40.765778 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:40.766859 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:40.766859 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:40.766859 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:40.766859 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:40.766859 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:40.766859 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:40.766859 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:40.766859 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:40.766859 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:40.766859 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:40.766859 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:40.766859 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:40.766859 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:40.766859 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:40.766859 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:40.766859 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:40.766859 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:40.767895 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:40.767895 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:40.767895 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:40.767895 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:40.767895 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 298/580] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:40.767895 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193a49f-2035-41a5-8afa-759d476175b3 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:40.784402 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d0888-21cc-47ef-8f74-a1baf90f6dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:40.785190 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d0888-21cc-47ef-8f74-a1baf90f6dec None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:40.785439 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d0888-21cc-47ef-8f74-a1baf90f6dec None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:40.785674 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d0888-21cc-47ef-8f74-a1baf90f6dec None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:40.786533 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d0888-21cc-47ef-8f74-a1baf90f6dec None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:40.786788 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d0888-21cc-47ef-8f74-a1baf90f6dec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:40.788112 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d0888-21cc-47ef-8f74-a1baf90f6dec None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:40.799983 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 283/581] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:40.800794 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d0888-21cc-47ef-8f74-a1baf90f6dec None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:40.872103 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193a49f-2035-41a5-8afa-759d476175b3 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:40.899833 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d0888-21cc-47ef-8f74-a1baf90f6dec None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:40.906508 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2aa70f-f48b-4365-a0d7-bcde986a0389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:40.907308 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aa70f-f48b-4365-a0d7-bcde986a0389 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:40.907591 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aa70f-f48b-4365-a0d7-bcde986a0389 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:40.907869 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aa70f-f48b-4365-a0d7-bcde986a0389 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:40.918944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2aa70f-f48b-4365-a0d7-bcde986a0389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:40.920404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2aa70f-f48b-4365-a0d7-bcde986a0389 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:40.933922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65994ea7-4504-4332-86be-cbcf916860fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:40.934980 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65994ea7-4504-4332-86be-cbcf916860fc None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:40.935269 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65994ea7-4504-4332-86be-cbcf916860fc None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:40.935544 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65994ea7-4504-4332-86be-cbcf916860fc None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:40.936299 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65994ea7-4504-4332-86be-cbcf916860fc None admin] RBAC: Adding query filter params (name=service) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:40.936607 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65994ea7-4504-4332-86be-cbcf916860fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:40.938003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65994ea7-4504-4332-86be-cbcf916860fc None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:40.938791 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-8f2aa70f-f48b-4365-a0d7-bcde986a0389 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:40.938791 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:40.938791 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:40.938791 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:40.938791 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:40.938791 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:40.938791 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:40.938791 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:40.938791 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:40.938791 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:40.938791 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:40.938791 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:40.938791 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:40.938791 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:40.938791 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:40.939759 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:40.939759 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:40.939759 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:40.939759 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:40.939759 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:40.939759 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:40.939759 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:40.939759 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:40.939759 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:40.939759 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:40.939759 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:40.939759 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:40.939759 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:40.939759 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:40.939759 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:40.939759 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:40.939759 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:40.940768 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:40.940768 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:40.940768 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:40.940768 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:40.940768 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 299/582] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:40.940768 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2aa70f-f48b-4365-a0d7-bcde986a0389 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:40.952040 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 284/583] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:19:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:40.954371 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65994ea7-4504-4332-86be-cbcf916860fc None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:41.047273 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2aa70f-f48b-4365-a0d7-bcde986a0389 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:41.054138 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65994ea7-4504-4332-86be-cbcf916860fc None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:41.081212 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668f599-bf41-4ef6-863a-48bbc9471c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:41.081920 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668f599-bf41-4ef6-863a-48bbc9471c77 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:41.082205 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668f599-bf41-4ef6-863a-48bbc9471c77 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:41.082483 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668f599-bf41-4ef6-863a-48bbc9471c77 None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:41.083945 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668f599-bf41-4ef6-863a-48bbc9471c77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:41.084266 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668f599-bf41-4ef6-863a-48bbc9471c77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:41.085685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668f599-bf41-4ef6-863a-48bbc9471c77 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:41.089052 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f96200-a0ca-463c-b0b4-1c30c787c807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:41.090078 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f96200-a0ca-463c-b0b4-1c30c787c807 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:41.090528 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f96200-a0ca-463c-b0b4-1c30c787c807 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:41.090967 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f96200-a0ca-463c-b0b4-1c30c787c807 None admin] PATH_INFO: `/v3/users/nova` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:41.102410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 300/584] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:41.102410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668f599-bf41-4ef6-863a-48bbc9471c77 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:41.102733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f96200-a0ca-463c-b0b4-1c30c787c807 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:41.102733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f96200-a0ca-463c-b0b4-1c30c787c807 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:41.117423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-46f96200-a0ca-463c-b0b4-1c30c787c807 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:19:41.117423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:41.117423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:41.117423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:41.117423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:41.117423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:41.117423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:41.117423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:41.117423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:41.117423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:41.117423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:41.117423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:41.117423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:19:41.117423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:19:41.117423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:19:41.117423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:19:41.118618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:41.118618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:41.118618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:19:41.118618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:41.118618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:19:41.118618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:41.118618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:41.118618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:41.118618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:41.118618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:41.118618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:41.118618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:41.118618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:41.118618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:41.118618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:41.118618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:41.118618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:41.118618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:41.120187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:41.120187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:41.120187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:19:41.120187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:19:41.120187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:19:41.120187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:19:41.120187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:19:41.120187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:19:41.120187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:19:41.120187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:41.120187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 285/585] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:19:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:41.120187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f96200-a0ca-463c-b0b4-1c30c787c807 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:41.205477 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668f599-bf41-4ef6-863a-48bbc9471c77 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:41.223986 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f96200-a0ca-463c-b0b4-1c30c787c807 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:41.240015 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab09ef-6b24-42a5-b07a-424bbbb3c0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:41.240468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab09ef-6b24-42a5-b07a-424bbbb3c0a1 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:41.240737 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab09ef-6b24-42a5-b07a-424bbbb3c0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:41.240955 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab09ef-6b24-42a5-b07a-424bbbb3c0a1 None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:41.241716 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab09ef-6b24-42a5-b07a-424bbbb3c0a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:41.242020 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab09ef-6b24-42a5-b07a-424bbbb3c0a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:41.243394 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab09ef-6b24-42a5-b07a-424bbbb3c0a1 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:41.255868 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 301/586] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:41.258762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38de949-a44a-48b1-8d23-723508a8d128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:41.259563 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38de949-a44a-48b1-8d23-723508a8d128 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:41.259850 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38de949-a44a-48b1-8d23-723508a8d128 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:41.260125 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38de949-a44a-48b1-8d23-723508a8d128 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:41.261162 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab09ef-6b24-42a5-b07a-424bbbb3c0a1 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:41.271739 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38de949-a44a-48b1-8d23-723508a8d128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:41.273252 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38de949-a44a-48b1-8d23-723508a8d128 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:41.291589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-c38de949-a44a-48b1-8d23-723508a8d128 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:41.291589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:41.291589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:41.291589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:41.291589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:41.291589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:41.291589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:41.291589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:41.291589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:41.291589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:41.291589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:41.291589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:41.291589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:41.291589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:41.291589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:41.292820 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:41.292820 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:41.292820 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:41.292820 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:41.292820 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:41.292820 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:41.292820 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:41.292820 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:41.292820 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:41.292820 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:41.292820 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:41.292820 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:41.292820 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:41.292820 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:41.292820 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:41.292820 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:41.292820 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:41.293877 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:41.293877 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:41.293877 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:41.293877 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:41.293877 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 286/587] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:41.294204 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38de949-a44a-48b1-8d23-723508a8d128 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:41.368055 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab09ef-6b24-42a5-b07a-424bbbb3c0a1 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:41.397263 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38de949-a44a-48b1-8d23-723508a8d128 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:41.401740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c242bb-52d7-4171-963d-adf6fa940e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:41.402536 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c242bb-52d7-4171-963d-adf6fa940e60 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:41.402819 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c242bb-52d7-4171-963d-adf6fa940e60 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:41.403093 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c242bb-52d7-4171-963d-adf6fa940e60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:41.409901 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c242bb-52d7-4171-963d-adf6fa940e60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:41.411978 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c242bb-52d7-4171-963d-adf6fa940e60 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:41.429646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-d3c242bb-52d7-4171-963d-adf6fa940e60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:41.429646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:41.429646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:41.429646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:41.429646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:41.429646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:41.429646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:41.429646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:41.429646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:41.429646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:41.429646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:41.429646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:41.429646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:19:41.429646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:19:41.429646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:19:41.430787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:19:41.430787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:41.430787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:41.430787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:41.430787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:41.430787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:41.430787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:41.430787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:41.430787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:41.430787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:41.430787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:41.430787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:41.430787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:41.430787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:41.430787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:41.430787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:41.430787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:41.432531 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:19:41.432531 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:19:41.432531 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:19:41.432531 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:19:41.432531 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:19:41.432531 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:19:41.432531 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:41.432531 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:41.432531 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 302/588] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:19:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:41.432531 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c242bb-52d7-4171-963d-adf6fa940e60 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:41.443671 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f386eb1-7cd7-40cf-9ea2-4f79d2ccbb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:41.444351 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f386eb1-7cd7-40cf-9ea2-4f79d2ccbb77 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:41.445025 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f386eb1-7cd7-40cf-9ea2-4f79d2ccbb77 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:41.445025 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f386eb1-7cd7-40cf-9ea2-4f79d2ccbb77 None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:41.445827 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f386eb1-7cd7-40cf-9ea2-4f79d2ccbb77 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:41.446140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f386eb1-7cd7-40cf-9ea2-4f79d2ccbb77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:41.447588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f386eb1-7cd7-40cf-9ea2-4f79d2ccbb77 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:41.472044 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 287/589] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:19:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:41.472044 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f386eb1-7cd7-40cf-9ea2-4f79d2ccbb77 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:41.547864 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c242bb-52d7-4171-963d-adf6fa940e60 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:41.576697 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f386eb1-7cd7-40cf-9ea2-4f79d2ccbb77 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:41.583544 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34698887-68dc-4d78-bad0-34be201d9541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:41.584576 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34698887-68dc-4d78-bad0-34be201d9541 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:41.585019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34698887-68dc-4d78-bad0-34be201d9541 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:41.585503 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34698887-68dc-4d78-bad0-34be201d9541 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:41.592933 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34698887-68dc-4d78-bad0-34be201d9541 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:41.594647 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34698887-68dc-4d78-bad0-34be201d9541 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:41.612161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-34698887-68dc-4d78-bad0-34be201d9541 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:41.612161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:41.612161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:41.612161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:41.612161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:41.612161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:41.612161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:41.612161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:41.612161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:41.612161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:41.612161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:41.612161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:41.612161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:19:41.612161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:19:41.612161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:19:41.613468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:19:41.613468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:41.613468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:41.613468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:41.613468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:41.613468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:41.613468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:41.613468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:41.613468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:41.613468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:41.613468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:41.613468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:41.613468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:41.613468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:41.613468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:41.613468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:41.613468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:41.615338 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:19:41.615338 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:19:41.615338 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:19:41.615338 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:19:41.615338 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:19:41.615338 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:19:41.615338 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:41.615338 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:41.621116 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 303/590] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:19:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:41.621116 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34698887-68dc-4d78-bad0-34be201d9541 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:41.623163 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d612b7-4b4d-4395-8da4-ebd4978687f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:41.624039 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d612b7-4b4d-4395-8da4-ebd4978687f8 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:41.625303 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d612b7-4b4d-4395-8da4-ebd4978687f8 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:41.625303 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d612b7-4b4d-4395-8da4-ebd4978687f8 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:41.625655 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d612b7-4b4d-4395-8da4-ebd4978687f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:41.625879 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d612b7-4b4d-4395-8da4-ebd4978687f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:41.627317 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d612b7-4b4d-4395-8da4-ebd4978687f8 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:41.641153 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 288/591] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:41.642522 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d612b7-4b4d-4395-8da4-ebd4978687f8 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:41.730882 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34698887-68dc-4d78-bad0-34be201d9541 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:41.743347 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d612b7-4b4d-4395-8da4-ebd4978687f8 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:41.765306 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58104d5-97c4-4661-92f3-f6496db87943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:41.765999 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58104d5-97c4-4661-92f3-f6496db87943 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:41.766283 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58104d5-97c4-4661-92f3-f6496db87943 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:41.766560 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58104d5-97c4-4661-92f3-f6496db87943 None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:41.767358 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58104d5-97c4-4661-92f3-f6496db87943 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:41.767671 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58104d5-97c4-4661-92f3-f6496db87943 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:41.769102 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58104d5-97c4-4661-92f3-f6496db87943 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:41.777967 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321234c-eed0-4f38-8830-1a12a7a8c84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:41.778778 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321234c-eed0-4f38-8830-1a12a7a8c84e None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:41.779060 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321234c-eed0-4f38-8830-1a12a7a8c84e None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:41.779327 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321234c-eed0-4f38-8830-1a12a7a8c84e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:41.787607 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 304/592] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:19:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:41.787607 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58104d5-97c4-4661-92f3-f6496db87943 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:41.791774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321234c-eed0-4f38-8830-1a12a7a8c84e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:41.792769 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321234c-eed0-4f38-8830-1a12a7a8c84e None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:41.811601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-5321234c-eed0-4f38-8830-1a12a7a8c84e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:41.811601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:41.811601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:41.811601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:41.811601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:41.811601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:41.811601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:41.811601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:41.811601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:41.811601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:41.811601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:41.811601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:41.811601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:41.811601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:41.811601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:41.812723 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:41.812723 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:41.812723 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:41.812723 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:41.812723 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:41.812723 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:41.812723 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:41.812723 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:41.812723 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:41.812723 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:41.812723 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:41.812723 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:41.812723 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:41.812723 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:41.812723 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:41.812723 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:41.812723 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:41.813876 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:41.813876 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:41.813876 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:41.813876 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:41.818202 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 289/593] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:41.819336 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321234c-eed0-4f38-8830-1a12a7a8c84e None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:41.897973 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58104d5-97c4-4661-92f3-f6496db87943 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:41.933607 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c3660-d387-41a1-8022-0c214f669566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:41.934300 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c3660-d387-41a1-8022-0c214f669566 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:41.934587 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c3660-d387-41a1-8022-0c214f669566 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:41.934884 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c3660-d387-41a1-8022-0c214f669566 None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:41.935689 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c3660-d387-41a1-8022-0c214f669566 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:41.936005 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c3660-d387-41a1-8022-0c214f669566 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:41.937523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c3660-d387-41a1-8022-0c214f669566 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:41.942786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321234c-eed0-4f38-8830-1a12a7a8c84e None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:41.951456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 305/594] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:19:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:41.952320 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c3660-d387-41a1-8022-0c214f669566 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:41.991369 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d71af-aa04-4147-a9c1-4186737c242a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:41.992441 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d71af-aa04-4147-a9c1-4186737c242a None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:41.993141 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d71af-aa04-4147-a9c1-4186737c242a None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:41.993629 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d71af-aa04-4147-a9c1-4186737c242a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:42.002510 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d71af-aa04-4147-a9c1-4186737c242a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:42.004699 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d71af-aa04-4147-a9c1-4186737c242a None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:42.022745 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-8f1d71af-aa04-4147-a9c1-4186737c242a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:19:42.022745 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:42.022745 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:42.022745 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:42.022745 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:42.022745 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:42.022745 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:42.022745 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:42.022745 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:42.022745 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:42.022745 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:42.022745 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:42.022745 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:19:42.022745 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:19:42.022745 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:19:42.022745 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:19:42.023925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:42.023925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:42.023925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:19:42.023925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:42.023925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:19:42.023925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:42.023925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:42.023925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:42.023925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:42.023925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:42.023925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:42.023925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:42.023925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:42.023925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:42.023925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:42.023925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:42.023925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:42.023925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:42.024979 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:42.024979 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:42.024979 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:19:42.024979 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:19:42.024979 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:19:42.024979 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:19:42.024979 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:19:42.024979 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:19:42.024979 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:19:42.024979 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:42.029350 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 290/595] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:19:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:42.030272 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d71af-aa04-4147-a9c1-4186737c242a None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:42.120161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c3660-d387-41a1-8022-0c214f669566 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:42.136030 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d71af-aa04-4147-a9c1-4186737c242a None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:42.171212 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fce27e-6026-4f78-9033-cc63340d662d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:42.171898 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fce27e-6026-4f78-9033-cc63340d662d None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:42.172186 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fce27e-6026-4f78-9033-cc63340d662d None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:42.172472 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fce27e-6026-4f78-9033-cc63340d662d None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:42.173208 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fce27e-6026-4f78-9033-cc63340d662d None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:42.173553 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fce27e-6026-4f78-9033-cc63340d662d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:42.174941 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fce27e-6026-4f78-9033-cc63340d662d None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:42.179164 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10c09d-4235-4d32-b740-dea06c647e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:42.180192 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10c09d-4235-4d32-b740-dea06c647e7b None admin] REQUEST_METHOD: `PUT` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:42.180623 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10c09d-4235-4d32-b740-dea06c647e7b None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:42.180983 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10c09d-4235-4d32-b740-dea06c647e7b None admin] PATH_INFO: `/v3/projects/eb2de9bea1cf451db5f8c697f480c480/users/9575eaad5f3f497094f508ebf1c5e656/roles/7d8a1698372145a59d70d67ed7867f56` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:42.188770 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 291/596] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:42.189681 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fce27e-6026-4f78-9033-cc63340d662d None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:42.198709 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10c09d-4235-4d32-b740-dea06c647e7b None admin] RBAC: Authorizing `identity:create_grant(project_id=eb2de9bea1cf451db5f8c697f480c480, user_id=9575eaad5f3f497094f508ebf1c5e656, role_id=7d8a1698372145a59d70d67ed7867f56)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:42.200178 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10c09d-4235-4d32-b740-dea06c647e7b None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:42.214093 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 306/597] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:19:41 2022] PUT /identity/v3/projects/eb2de9bea1cf451db5f8c697f480c480/users/9575eaad5f3f497094f508ebf1c5e656/roles/7d8a1698372145a59d70d67ed7867f56 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:19:42.214939 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10c09d-4235-4d32-b740-dea06c647e7b None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:42.320183 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fce27e-6026-4f78-9033-cc63340d662d None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:42.339732 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10c09d-4235-4d32-b740-dea06c647e7b None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:42.358321 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81bf08-486c-40af-b16e-bcd68534cf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:42.359246 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81bf08-486c-40af-b16e-bcd68534cf32 None admin] REQUEST_METHOD: `PUT` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:42.359536 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81bf08-486c-40af-b16e-bcd68534cf32 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:42.359820 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81bf08-486c-40af-b16e-bcd68534cf32 None admin] PATH_INFO: `/v3/projects/eb2de9bea1cf451db5f8c697f480c480/users/2d337bfaeac14e53872539cebff40ab9/roles/7d8a1698372145a59d70d67ed7867f56` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:42.377525 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81bf08-486c-40af-b16e-bcd68534cf32 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb2de9bea1cf451db5f8c697f480c480, user_id=2d337bfaeac14e53872539cebff40ab9, role_id=7d8a1698372145a59d70d67ed7867f56)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:42.379001 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81bf08-486c-40af-b16e-bcd68534cf32 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:42.379553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03175db7-8e79-479b-85f0-32aa898959e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:42.379995 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03175db7-8e79-479b-85f0-32aa898959e3 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:42.380348 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03175db7-8e79-479b-85f0-32aa898959e3 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:42.380694 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03175db7-8e79-479b-85f0-32aa898959e3 None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:42.381681 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03175db7-8e79-479b-85f0-32aa898959e3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:42.382056 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03175db7-8e79-479b-85f0-32aa898959e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:42.383594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03175db7-8e79-479b-85f0-32aa898959e3 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:42.404618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 292/598] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:19:42 2022] PUT /identity/v3/projects/eb2de9bea1cf451db5f8c697f480c480/users/2d337bfaeac14e53872539cebff40ab9/roles/7d8a1698372145a59d70d67ed7867f56 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:19:42.404618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f2aef-0787-4b5d-8bfc-c932ff3e42c9 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:42.404618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f2aef-0787-4b5d-8bfc-c932ff3e42c9 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:42.404618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f2aef-0787-4b5d-8bfc-c932ff3e42c9 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:42.405337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 293/599] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:42.406547 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 307/600] 10.222.0.48 () {56 vars in 1139 bytes} [Mon May 9 15:19:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:42.406691 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f2aef-0787-4b5d-8bfc-c932ff3e42c9 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:42.407415 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5f7fe-8eb4-4e81-8151-b2c08bcffc7c None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:42.407771 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5f7fe-8eb4-4e81-8151-b2c08bcffc7c None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:42.409528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5f7fe-8eb4-4e81-8151-b2c08bcffc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:42.429148 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-8ef5f7fe-8eb4-4e81-8151-b2c08bcffc7c None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:42.430656 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-8ef5f7fe-8eb4-4e81-8151-b2c08bcffc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:42.525700 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 308/601] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:42.526723 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5f7fe-8eb4-4e81-8151-b2c08bcffc7c None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:42.533152 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f2aef-0787-4b5d-8bfc-c932ff3e42c9 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:42.576583 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dedfa7-b7d7-4d34-92c8-a854ec731d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:42.577490 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dedfa7-b7d7-4d34-92c8-a854ec731d57 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:42.577842 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dedfa7-b7d7-4d34-92c8-a854ec731d57 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:42.578189 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dedfa7-b7d7-4d34-92c8-a854ec731d57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:42.586934 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dedfa7-b7d7-4d34-92c8-a854ec731d57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:42.588569 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dedfa7-b7d7-4d34-92c8-a854ec731d57 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:42.604753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-c7dedfa7-b7d7-4d34-92c8-a854ec731d57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:42.604753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:42.604753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:42.604753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:42.604753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:42.604753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:42.604753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:42.604753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:42.604753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:42.604753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:42.604753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:42.604753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:42.604753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:19:42.604753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:19:42.604753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:19:42.606054 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:19:42.606054 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:42.606054 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:42.606054 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:42.606054 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:42.606054 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:42.606054 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:42.606054 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:42.606054 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:42.606054 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:42.606054 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:42.606054 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:42.606054 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:42.606054 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:42.606054 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:42.606054 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:42.606054 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:42.607337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:19:42.607337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:19:42.607337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:19:42.607337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:19:42.607337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:19:42.607337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:19:42.607337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:42.607337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:42.608034 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 294/602] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:19:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:42.609415 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dedfa7-b7d7-4d34-92c8-a854ec731d57 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:42.652714 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5f7fe-8eb4-4e81-8151-b2c08bcffc7c None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:42.696594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1fdbe-112c-4366-8ebd-cd0515bbb86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:42.698337 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1fdbe-112c-4366-8ebd-cd0515bbb86d None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:42.698337 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1fdbe-112c-4366-8ebd-cd0515bbb86d None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:42.698337 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1fdbe-112c-4366-8ebd-cd0515bbb86d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:42.712299 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1fdbe-112c-4366-8ebd-cd0515bbb86d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:42.714079 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1fdbe-112c-4366-8ebd-cd0515bbb86d None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:42.741226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-f6e1fdbe-112c-4366-8ebd-cd0515bbb86d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:42.741226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:42.741226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:42.741226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:42.741226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:42.741226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:42.741226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:42.741226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:42.741226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:42.741226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:42.741226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:42.741226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:42.741226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:42.741226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:42.741226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:42.742528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:42.742528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:42.742528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:42.742528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:42.742528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:42.742528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:42.742528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:42.742528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:42.742528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:42.742528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:42.742528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:42.742528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:42.742528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:42.742528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:42.742528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:42.742528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:42.742528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:42.743768 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:42.743768 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:42.743768 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:42.743768 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:42.746244 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 309/603] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:42.751652 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dedfa7-b7d7-4d34-92c8-a854ec731d57 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:42.751870 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1fdbe-112c-4366-8ebd-cd0515bbb86d None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:42.820359 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6574678-d355-486c-aa9a-9349f1aa2691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:42.822008 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6574678-d355-486c-aa9a-9349f1aa2691 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:42.822438 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6574678-d355-486c-aa9a-9349f1aa2691 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:42.822852 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6574678-d355-486c-aa9a-9349f1aa2691 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:42.845621 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6574678-d355-486c-aa9a-9349f1aa2691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:42.858145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-e6574678-d355-486c-aa9a-9349f1aa2691 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:42.858145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:42.858145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:42.858145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:42.858145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:42.858145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:42.858145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:42.858145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:42.858145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:42.858145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:42.858145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:42.858145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:42.858145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:42.858145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:42.858145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:42.858145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:42.859270 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:42.859270 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:42.859270 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:42.859270 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:42.859270 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:42.859270 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:42.859270 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:42.859270 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:42.859270 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:42.859270 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:42.859270 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:42.859270 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:42.859270 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:42.859270 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:42.859270 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:42.859270 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:42.860200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:42.860200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:42.860200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:42.860200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:42.860200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:42.860200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:42.860200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:42.860200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:42.860200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:42.860200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:42.860200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:42.860200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:42.860200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 295/604] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:19:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:42.861650 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6574678-d355-486c-aa9a-9349f1aa2691 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:42.897314 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1fdbe-112c-4366-8ebd-cd0515bbb86d None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:42.937486 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f40e5-cd24-4f19-86b4-6250b2481f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:42.938264 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f40e5-cd24-4f19-86b4-6250b2481f6f None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:42.938456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f40e5-cd24-4f19-86b4-6250b2481f6f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:42.938712 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f40e5-cd24-4f19-86b4-6250b2481f6f None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:42.939538 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f40e5-cd24-4f19-86b4-6250b2481f6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:42.939849 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f40e5-cd24-4f19-86b4-6250b2481f6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:42.941329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f40e5-cd24-4f19-86b4-6250b2481f6f None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:42.955366 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 310/605] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:19:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:42.956313 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f40e5-cd24-4f19-86b4-6250b2481f6f None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:42.988813 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6574678-d355-486c-aa9a-9349f1aa2691 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:43.024841 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee290bd-5704-490d-b29f-1b56b0436462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:43.025567 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee290bd-5704-490d-b29f-1b56b0436462 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:43.025858 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee290bd-5704-490d-b29f-1b56b0436462 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:43.026137 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee290bd-5704-490d-b29f-1b56b0436462 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:43.026891 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee290bd-5704-490d-b29f-1b56b0436462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:43.027202 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee290bd-5704-490d-b29f-1b56b0436462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:43.028617 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee290bd-5704-490d-b29f-1b56b0436462 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:43.046783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 296/606] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:43.047719 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee290bd-5704-490d-b29f-1b56b0436462 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:43.067794 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f40e5-cd24-4f19-86b4-6250b2481f6f None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:43.104876 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf83b8-ed3e-42a8-ac1c-dae3893d8744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:43.105529 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf83b8-ed3e-42a8-ac1c-dae3893d8744 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:43.105823 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf83b8-ed3e-42a8-ac1c-dae3893d8744 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:43.106108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf83b8-ed3e-42a8-ac1c-dae3893d8744 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:43.106884 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf83b8-ed3e-42a8-ac1c-dae3893d8744 None admin] RBAC: Adding query filter params (name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:43.107198 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf83b8-ed3e-42a8-ac1c-dae3893d8744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:43.108591 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf83b8-ed3e-42a8-ac1c-dae3893d8744 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:43.123499 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 311/607] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:19:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:43.124467 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf83b8-ed3e-42a8-ac1c-dae3893d8744 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:43.156995 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee290bd-5704-490d-b29f-1b56b0436462 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:43.200655 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebd0d5-29ee-46a1-8ec6-03468bb85a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:43.202099 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebd0d5-29ee-46a1-8ec6-03468bb85a53 None admin] REQUEST_METHOD: `PUT` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:43.202392 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebd0d5-29ee-46a1-8ec6-03468bb85a53 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:43.202678 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebd0d5-29ee-46a1-8ec6-03468bb85a53 None admin] PATH_INFO: `/v3/projects/eb2de9bea1cf451db5f8c697f480c480/users/42dc38d6c3634b7496b1b7e99ca3f647/roles/7d8a1698372145a59d70d67ed7867f56` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:43.220257 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebd0d5-29ee-46a1-8ec6-03468bb85a53 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb2de9bea1cf451db5f8c697f480c480, user_id=42dc38d6c3634b7496b1b7e99ca3f647, role_id=7d8a1698372145a59d70d67ed7867f56)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:43.221745 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebd0d5-29ee-46a1-8ec6-03468bb85a53 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:43.240567 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 297/608] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:19:43 2022] PUT /identity/v3/projects/eb2de9bea1cf451db5f8c697f480c480/users/42dc38d6c3634b7496b1b7e99ca3f647/roles/7d8a1698372145a59d70d67ed7867f56 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:19:43.240798 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf83b8-ed3e-42a8-ac1c-dae3893d8744 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:43.241442 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebd0d5-29ee-46a1-8ec6-03468bb85a53 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:43.322197 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6dec6-d592-4836-8263-9bc9afbf8fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:43.323035 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6dec6-d592-4836-8263-9bc9afbf8fee None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:43.323321 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6dec6-d592-4836-8263-9bc9afbf8fee None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:43.323604 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6dec6-d592-4836-8263-9bc9afbf8fee None admin] PATH_INFO: `/v3/projects/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:43.338743 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6dec6-d592-4836-8263-9bc9afbf8fee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:43.340257 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6dec6-d592-4836-8263-9bc9afbf8fee None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:43.361256 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebd0d5-29ee-46a1-8ec6-03468bb85a53 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:43.377881 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-48c6dec6-d592-4836-8263-9bc9afbf8fee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:43.377881 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:43.377881 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:43.377881 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:43.377881 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:43.377881 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:43.377881 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:43.377881 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:43.377881 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:43.377881 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:43.377881 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:43.377881 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:43.377881 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:19:43.377881 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:19:43.377881 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:19:43.380332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:19:43.380332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:43.380332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:43.380332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:43.380332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:43.380332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:43.380332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:43.380332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:43.380332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:43.380332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:43.380332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:43.380332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:43.380332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:43.380332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:43.380332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:43.380332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:43.380332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:43.382757 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:19:43.382757 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:19:43.382757 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:19:43.382757 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:19:43.382757 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:19:43.382757 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:19:43.382757 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:43.382757 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:43.382757 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 312/609] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:19:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:43.390489 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6dec6-d592-4836-8263-9bc9afbf8fee None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:43.405670 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6921e8-d357-43ae-ad25-266492be79aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:43.406850 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6921e8-d357-43ae-ad25-266492be79aa None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:43.407314 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6921e8-d357-43ae-ad25-266492be79aa None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:43.407760 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6921e8-d357-43ae-ad25-266492be79aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:43.422900 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6921e8-d357-43ae-ad25-266492be79aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:43.425578 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6921e8-d357-43ae-ad25-266492be79aa None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:43.460125 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-6f6921e8-d357-43ae-ad25-266492be79aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:43.460125 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:43.460125 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:43.460125 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:43.460125 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:43.460125 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:43.460125 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:43.460125 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:43.460125 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:43.460125 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:43.460125 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:43.460125 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:43.460125 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:43.460125 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:43.460125 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:43.461443 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:43.461443 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:43.461443 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:43.461443 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:43.461443 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:43.461443 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:43.461443 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:43.461443 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:43.461443 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:43.461443 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:43.461443 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:43.461443 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:43.461443 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:43.461443 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:43.461443 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:43.461443 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:43.461443 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:43.462677 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:43.462677 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:43.462677 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:43.462677 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:43.465107 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 298/610] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:43.478463 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6921e8-d357-43ae-ad25-266492be79aa None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:43.572021 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6dec6-d592-4836-8263-9bc9afbf8fee None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:43.621798 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008adb2-08cb-4429-a9fc-b1f323378995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:43.622540 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008adb2-08cb-4429-a9fc-b1f323378995 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:43.622924 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008adb2-08cb-4429-a9fc-b1f323378995 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:43.623302 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008adb2-08cb-4429-a9fc-b1f323378995 None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:43.624590 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008adb2-08cb-4429-a9fc-b1f323378995 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:43.624590 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008adb2-08cb-4429-a9fc-b1f323378995 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:43.626182 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008adb2-08cb-4429-a9fc-b1f323378995 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:43.639315 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6921e8-d357-43ae-ad25-266492be79aa None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:43.639889 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 313/611] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:19:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:43.645946 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008adb2-08cb-4429-a9fc-b1f323378995 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:43.685058 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a789c-c747-4a00-8fa8-840d7541fc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:43.686118 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a789c-c747-4a00-8fa8-840d7541fc1a None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:43.688649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a789c-c747-4a00-8fa8-840d7541fc1a None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:43.690829 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a789c-c747-4a00-8fa8-840d7541fc1a None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:43.690829 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a789c-c747-4a00-8fa8-840d7541fc1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:43.691217 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a789c-c747-4a00-8fa8-840d7541fc1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:43.697825 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a789c-c747-4a00-8fa8-840d7541fc1a None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:43.718641 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 299/612] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:43.730832 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a789c-c747-4a00-8fa8-840d7541fc1a None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:43.824453 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008adb2-08cb-4429-a9fc-b1f323378995 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:43.896382 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b33220-3472-48b8-b553-2ee9fbf3d6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:43.897203 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b33220-3472-48b8-b553-2ee9fbf3d6ac None admin] REQUEST_METHOD: `PUT` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:43.897544 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b33220-3472-48b8-b553-2ee9fbf3d6ac None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:43.897781 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b33220-3472-48b8-b553-2ee9fbf3d6ac None admin] PATH_INFO: `/v3/projects/eb2de9bea1cf451db5f8c697f480c480/users/e9433a0b92c34247b4e539b96dc4d581/roles/7d8a1698372145a59d70d67ed7867f56` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:43.921365 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a789c-c747-4a00-8fa8-840d7541fc1a None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:43.924877 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b33220-3472-48b8-b553-2ee9fbf3d6ac None admin] RBAC: Authorizing `identity:create_grant(project_id=eb2de9bea1cf451db5f8c697f480c480, user_id=e9433a0b92c34247b4e539b96dc4d581, role_id=7d8a1698372145a59d70d67ed7867f56)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:43.927010 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b33220-3472-48b8-b553-2ee9fbf3d6ac None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:43.949028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 314/613] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:19:43 2022] PUT /identity/v3/projects/eb2de9bea1cf451db5f8c697f480c480/users/e9433a0b92c34247b4e539b96dc4d581/roles/7d8a1698372145a59d70d67ed7867f56 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:19:43.984969 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fac1d-4308-43f8-ab60-8a99c43c69a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:43.986052 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fac1d-4308-43f8-ab60-8a99c43c69a7 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:43.986337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fac1d-4308-43f8-ab60-8a99c43c69a7 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:43.986614 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fac1d-4308-43f8-ab60-8a99c43c69a7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:43.997481 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fac1d-4308-43f8-ab60-8a99c43c69a7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:43.999083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fac1d-4308-43f8-ab60-8a99c43c69a7 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:44.021989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-338fac1d-4308-43f8-ab60-8a99c43c69a7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:19:44.021989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:44.021989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:44.021989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:44.021989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:44.021989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:44.021989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:44.021989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:44.021989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:44.021989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:44.021989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:44.021989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:44.021989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:19:44.021989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:19:44.021989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:19:44.021989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:19:44.023216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:44.023216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:44.023216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:19:44.023216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:44.023216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:19:44.023216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:44.023216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:44.023216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:44.023216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:44.023216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:44.023216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:44.023216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:44.023216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:44.023216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:44.023216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:44.023216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:44.023216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:44.023216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:44.024339 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:44.024339 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:44.024339 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:19:44.024339 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:19:44.024339 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:19:44.024339 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:19:44.024339 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:19:44.024339 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:19:44.024339 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:19:44.024339 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:44.024339 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 300/614] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:19:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:19:44.029259 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b33220-3472-48b8-b553-2ee9fbf3d6ac None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:44.158273 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b33220-3472-48b8-b553-2ee9fbf3d6ac None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:44.197783 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525039d-d14b-47be-ac2b-39f6d5424f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:44.198479 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525039d-d14b-47be-ac2b-39f6d5424f3d None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:44.198762 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525039d-d14b-47be-ac2b-39f6d5424f3d None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:44.199035 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525039d-d14b-47be-ac2b-39f6d5424f3d None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:44.200257 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525039d-d14b-47be-ac2b-39f6d5424f3d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:44.200577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525039d-d14b-47be-ac2b-39f6d5424f3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:44.202063 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525039d-d14b-47be-ac2b-39f6d5424f3d None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:44.223940 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 315/615] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 9 15:19:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:44.229676 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fac1d-4308-43f8-ab60-8a99c43c69a7 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:44.366236 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fac1d-4308-43f8-ab60-8a99c43c69a7 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:44.407122 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacaf2a-ee5a-4093-a4f9-96d4e0ad42b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:44.408052 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacaf2a-ee5a-4093-a4f9-96d4e0ad42b3 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:44.408387 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacaf2a-ee5a-4093-a4f9-96d4e0ad42b3 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:44.408609 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacaf2a-ee5a-4093-a4f9-96d4e0ad42b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:44.421016 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacaf2a-ee5a-4093-a4f9-96d4e0ad42b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:44.422588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacaf2a-ee5a-4093-a4f9-96d4e0ad42b3 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:44.444284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-7dacaf2a-ee5a-4093-a4f9-96d4e0ad42b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:44.444284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:44.444284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:44.444284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:44.444284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:44.444284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:44.444284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:44.444284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:44.444284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:44.444284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:44.444284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:44.444284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:44.444284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:44.444284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:44.444284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:44.445342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:44.445342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:44.445342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:44.445342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:44.445342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:44.445342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:44.445342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:44.445342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:44.445342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:44.445342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:44.445342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:44.445342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:44.445342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:44.445342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:44.445342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:44.445342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:44.445342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:44.446460 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:44.446460 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:44.446460 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:44.446460 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:44.446460 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 301/616] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:44.451637 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525039d-d14b-47be-ac2b-39f6d5424f3d None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:44.564699 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525039d-d14b-47be-ac2b-39f6d5424f3d None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:44.604797 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77810558-3d34-4c87-ad94-df4a06327d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:44.605496 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77810558-3d34-4c87-ad94-df4a06327d85 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:44.605781 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77810558-3d34-4c87-ad94-df4a06327d85 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:44.606057 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77810558-3d34-4c87-ad94-df4a06327d85 None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:44.606795 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77810558-3d34-4c87-ad94-df4a06327d85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:44.607099 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77810558-3d34-4c87-ad94-df4a06327d85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:44.608466 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77810558-3d34-4c87-ad94-df4a06327d85 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:44.622555 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 316/617] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:44.628064 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacaf2a-ee5a-4093-a4f9-96d4e0ad42b3 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:44.754412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacaf2a-ee5a-4093-a4f9-96d4e0ad42b3 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:44.809652 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fd914-4be0-4a3a-9200-ac8dac0a9324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:44.810477 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fd914-4be0-4a3a-9200-ac8dac0a9324 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:44.810761 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fd914-4be0-4a3a-9200-ac8dac0a9324 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:44.811038 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fd914-4be0-4a3a-9200-ac8dac0a9324 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:44.822981 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05fd914-4be0-4a3a-9200-ac8dac0a9324 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:44.824544 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05fd914-4be0-4a3a-9200-ac8dac0a9324 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:44.841554 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-b05fd914-4be0-4a3a-9200-ac8dac0a9324 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:44.841554 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:44.841554 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:44.841554 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:44.841554 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:44.841554 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:44.841554 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:44.841554 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:44.841554 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:44.841554 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:44.841554 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:44.841554 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:44.841554 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:19:44.841554 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:19:44.841554 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:19:44.843299 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:19:44.843299 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:44.843299 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:44.843299 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:44.843299 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:44.843299 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:44.843299 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:44.843299 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:44.843299 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:44.843299 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:44.843299 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:44.843299 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:44.843299 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:44.843299 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:44.843299 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:44.843299 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:44.843299 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:44.844333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:19:44.844333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:19:44.844333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:19:44.844333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:19:44.844333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:19:44.844333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:19:44.844333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:44.844333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:44.844333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 302/618] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:19:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:44.849351 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77810558-3d34-4c87-ad94-df4a06327d85 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:44.960044 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77810558-3d34-4c87-ad94-df4a06327d85 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:44.995319 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e704a-825b-4a7a-9888-f6d960323bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:44.996049 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e704a-825b-4a7a-9888-f6d960323bc1 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:44.996386 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e704a-825b-4a7a-9888-f6d960323bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:44.996666 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e704a-825b-4a7a-9888-f6d960323bc1 None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:44.997500 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e704a-825b-4a7a-9888-f6d960323bc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:44.997810 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e704a-825b-4a7a-9888-f6d960323bc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:44.999253 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e704a-825b-4a7a-9888-f6d960323bc1 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:45.012721 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 317/619] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:19:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:45.018520 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fd914-4be0-4a3a-9200-ac8dac0a9324 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:45.040251 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb350070-d3ff-4eb6-b54a-79ce0e270e78 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:45.040617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb350070-d3ff-4eb6-b54a-79ce0e270e78 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:45.040833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb350070-d3ff-4eb6-b54a-79ce0e270e78 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:45.044170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 318/620] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:45.050261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affcd13-db4c-4e08-8a69-6830a6e3d5ae None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:45.050651 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affcd13-db4c-4e08-8a69-6830a6e3d5ae None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:45.050851 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affcd13-db4c-4e08-8a69-6830a6e3d5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:45.081699 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-7affcd13-db4c-4e08-8a69-6830a6e3d5ae None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:45.083815 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-7affcd13-db4c-4e08-8a69-6830a6e3d5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:45.152856 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fd914-4be0-4a3a-9200-ac8dac0a9324 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:45.171238 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 319/621] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:19:45.173524 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93a21e-99ab-4f08-b821-d34541374d61 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:45.174241 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93a21e-99ab-4f08-b821-d34541374d61 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:45.174701 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93a21e-99ab-4f08-b821-d34541374d61 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:45.176702 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 320/622] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:45.182968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee17eb-171e-41bd-8fc1-fda881ef74b1 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:45.183604 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee17eb-171e-41bd-8fc1-fda881ef74b1 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:45.184103 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee17eb-171e-41bd-8fc1-fda881ef74b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:45.198238 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2429b-28ec-4a47-91d7-de3aea7e72ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:45.199453 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2429b-28ec-4a47-91d7-de3aea7e72ef None admin] REQUEST_METHOD: `PUT` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:45.199738 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2429b-28ec-4a47-91d7-de3aea7e72ef None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:45.200020 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2429b-28ec-4a47-91d7-de3aea7e72ef None admin] PATH_INFO: `/v3/projects/eb2de9bea1cf451db5f8c697f480c480/users/dda2a8271a764e65bb97e316410b91b1/roles/7d8a1698372145a59d70d67ed7867f56` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:45.203700 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-9fee17eb-171e-41bd-8fc1-fda881ef74b1 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:45.205145 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-9fee17eb-171e-41bd-8fc1-fda881ef74b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:45.217584 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2429b-28ec-4a47-91d7-de3aea7e72ef None admin] RBAC: Authorizing `identity:create_grant(project_id=eb2de9bea1cf451db5f8c697f480c480, user_id=dda2a8271a764e65bb97e316410b91b1, role_id=7d8a1698372145a59d70d67ed7867f56)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:45.219341 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2429b-28ec-4a47-91d7-de3aea7e72ef None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:45.240223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 303/623] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:19:45 2022] PUT /identity/v3/projects/eb2de9bea1cf451db5f8c697f480c480/users/dda2a8271a764e65bb97e316410b91b1/roles/7d8a1698372145a59d70d67ed7867f56 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:19:45.241663 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2429b-28ec-4a47-91d7-de3aea7e72ef None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:45.292063 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 321/624] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:19:45.323002 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee17eb-171e-41bd-8fc1-fda881ef74b1 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:45.405736 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2429b-28ec-4a47-91d7-de3aea7e72ef None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:45.446425 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8087b2-e3fa-4118-bfe8-014b58b9fe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:45.447768 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8087b2-e3fa-4118-bfe8-014b58b9fe97 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:45.448280 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8087b2-e3fa-4118-bfe8-014b58b9fe97 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:45.448777 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8087b2-e3fa-4118-bfe8-014b58b9fe97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:45.462438 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8087b2-e3fa-4118-bfe8-014b58b9fe97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:45.471068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-9a8087b2-e3fa-4118-bfe8-014b58b9fe97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:45.471068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:45.471068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:45.471068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:45.471068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:45.471068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:45.471068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:45.471068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:45.471068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:45.471068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:45.471068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:45.471068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:45.471068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:45.471068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:45.471068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:45.471068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:45.472194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:45.472194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:45.472194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:45.472194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:45.472194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:45.472194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:45.472194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:45.472194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:45.472194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:45.472194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:45.472194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:45.472194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:45.472194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:45.472194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:45.472194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:45.472194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:45.473932 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:45.473932 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:45.473932 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:45.473932 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:45.473932 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:45.473932 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:45.473932 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:45.473932 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:45.473932 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:45.473932 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:45.473932 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:45.473932 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:45.477117 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 304/625] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:19:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:45.491189 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8087b2-e3fa-4118-bfe8-014b58b9fe97 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:45.521463 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee17eb-171e-41bd-8fc1-fda881ef74b1 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:45.558368 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6445dc0-9e5a-4fc4-9cf6-02d0932b35cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:45.559176 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6445dc0-9e5a-4fc4-9cf6-02d0932b35cb None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:45.559465 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6445dc0-9e5a-4fc4-9cf6-02d0932b35cb None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:45.559743 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6445dc0-9e5a-4fc4-9cf6-02d0932b35cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:45.571221 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6445dc0-9e5a-4fc4-9cf6-02d0932b35cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:45.579192 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-e6445dc0-9e5a-4fc4-9cf6-02d0932b35cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:45.579192 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:45.579192 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:45.579192 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:45.579192 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:45.579192 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:45.579192 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:45.579192 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:45.579192 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:45.579192 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:45.579192 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:45.579192 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:45.579192 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:45.579192 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:45.579192 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:45.579192 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:45.580284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:45.580284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:45.580284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:45.580284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:45.580284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:45.580284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:45.580284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:45.580284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:45.580284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:45.580284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:45.580284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:45.580284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:45.580284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:45.580284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:45.580284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:45.580284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:45.581213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:45.581213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:45.581213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:45.581213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:45.581213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:45.581213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:45.581213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:45.581213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:45.581213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:45.581213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:45.581213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:45.581213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:45.581213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 322/626] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:19:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:19:45.590964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6445dc0-9e5a-4fc4-9cf6-02d0932b35cb None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:45.661849 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8087b2-e3fa-4118-bfe8-014b58b9fe97 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:45.720772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6445dc0-9e5a-4fc4-9cf6-02d0932b35cb None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:45.741685 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f7bf4-c4ee-4e8b-bfd7-56abecd6924b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:45.742372 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f7bf4-c4ee-4e8b-bfd7-56abecd6924b None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:45.742658 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f7bf4-c4ee-4e8b-bfd7-56abecd6924b None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:45.742939 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f7bf4-c4ee-4e8b-bfd7-56abecd6924b None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:45.743704 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f7bf4-c4ee-4e8b-bfd7-56abecd6924b None admin] RBAC: Adding query filter params (name=service) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:45.744015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f7bf4-c4ee-4e8b-bfd7-56abecd6924b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:45.746540 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f7bf4-c4ee-4e8b-bfd7-56abecd6924b None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:45.761523 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 305/627] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:19:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:45.769557 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f7bf4-c4ee-4e8b-bfd7-56abecd6924b None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:45.789821 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca05af-fb58-4a4a-a234-c4aadeedad89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:45.790511 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca05af-fb58-4a4a-a234-c4aadeedad89 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:45.790796 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca05af-fb58-4a4a-a234-c4aadeedad89 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:45.791074 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca05af-fb58-4a4a-a234-c4aadeedad89 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:45.791847 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca05af-fb58-4a4a-a234-c4aadeedad89 None admin] RBAC: Adding query filter params (name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:45.792160 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca05af-fb58-4a4a-a234-c4aadeedad89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:45.795312 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca05af-fb58-4a4a-a234-c4aadeedad89 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:45.816207 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 323/628] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:19:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:45.821762 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca05af-fb58-4a4a-a234-c4aadeedad89 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:45.918319 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f7bf4-c4ee-4e8b-bfd7-56abecd6924b None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:45.966168 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a4ee8-a3f9-4424-82ff-1b43789ef0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:45.966990 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a4ee8-a3f9-4424-82ff-1b43789ef0e8 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:45.967280 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a4ee8-a3f9-4424-82ff-1b43789ef0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:45.967555 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a4ee8-a3f9-4424-82ff-1b43789ef0e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:45.994633 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a4ee8-a3f9-4424-82ff-1b43789ef0e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:45.996222 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a4ee8-a3f9-4424-82ff-1b43789ef0e8 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:46.017014 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca05af-fb58-4a4a-a234-c4aadeedad89 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:46.032140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-583a4ee8-a3f9-4424-82ff-1b43789ef0e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:46.032140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:46.032140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:46.032140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:46.032140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:46.032140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:46.032140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:46.032140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:46.032140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:46.032140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:46.032140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:46.032140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:46.032140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:46.032140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:46.032140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:46.034524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:46.034524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:46.034524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:46.034524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:46.034524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:46.034524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:46.034524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:46.034524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:46.034524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:46.034524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:46.034524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:46.034524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:46.034524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:46.034524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:46.034524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:46.034524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:46.034524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:46.037528 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:46.037528 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:46.037528 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:46.037528 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:46.037528 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 306/629] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:19:46.040834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a4ee8-a3f9-4424-82ff-1b43789ef0e8 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:46.063481 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788288a-c94c-4300-ac55-952fdfb9969a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:46.064304 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788288a-c94c-4300-ac55-952fdfb9969a None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:46.064592 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788288a-c94c-4300-ac55-952fdfb9969a None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:46.064873 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788288a-c94c-4300-ac55-952fdfb9969a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:46.086949 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788288a-c94c-4300-ac55-952fdfb9969a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:46.089610 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788288a-c94c-4300-ac55-952fdfb9969a None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:46.122257 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-9788288a-c94c-4300-ac55-952fdfb9969a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:46.122257 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:46.122257 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:46.122257 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:46.122257 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:46.122257 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:46.122257 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:46.122257 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:46.122257 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:46.122257 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:46.122257 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:46.122257 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:46.122257 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:46.122257 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:46.122257 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:46.124492 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:46.124492 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:46.124492 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:46.124492 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:46.124492 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:46.124492 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:46.124492 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:46.124492 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:46.124492 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:46.124492 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:46.124492 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:46.124492 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:46.124492 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:46.124492 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:46.124492 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:46.124492 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:46.124492 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:46.126786 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:46.126786 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:46.126786 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:46.126786 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:46.126786 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 324/630] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:46.134520 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788288a-c94c-4300-ac55-952fdfb9969a None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:46.195054 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a4ee8-a3f9-4424-82ff-1b43789ef0e8 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:46.250308 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc501525-4403-41ca-8db2-6cf9eee4671f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:46.251067 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc501525-4403-41ca-8db2-6cf9eee4671f None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:46.251353 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc501525-4403-41ca-8db2-6cf9eee4671f None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:46.251677 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc501525-4403-41ca-8db2-6cf9eee4671f None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:46.252430 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc501525-4403-41ca-8db2-6cf9eee4671f None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:46.252741 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc501525-4403-41ca-8db2-6cf9eee4671f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:46.254157 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc501525-4403-41ca-8db2-6cf9eee4671f None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:46.269829 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 307/631] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:46.276938 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc501525-4403-41ca-8db2-6cf9eee4671f None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:46.363789 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788288a-c94c-4300-ac55-952fdfb9969a None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:46.394126 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc501525-4403-41ca-8db2-6cf9eee4671f None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:46.405407 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3342c4b-df3d-44a4-8205-be33f814f3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:46.406097 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3342c4b-df3d-44a4-8205-be33f814f3ca None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:46.406383 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3342c4b-df3d-44a4-8205-be33f814f3ca None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:46.406670 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3342c4b-df3d-44a4-8205-be33f814f3ca None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:46.407407 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3342c4b-df3d-44a4-8205-be33f814f3ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:46.407718 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3342c4b-df3d-44a4-8205-be33f814f3ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:46.409100 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3342c4b-df3d-44a4-8205-be33f814f3ca None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:46.422157 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 325/632] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:46.423696 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69367bcd-bd5a-4a20-99f9-ac97850f0413 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:46.423988 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69367bcd-bd5a-4a20-99f9-ac97850f0413 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:46.424265 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69367bcd-bd5a-4a20-99f9-ac97850f0413 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:46.429362 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b463db5-89b6-46c7-9666-ec29af4f1e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:46.430270 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b463db5-89b6-46c7-9666-ec29af4f1e01 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:46.430561 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b463db5-89b6-46c7-9666-ec29af4f1e01 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:46.430841 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b463db5-89b6-46c7-9666-ec29af4f1e01 None admin] PATH_INFO: `/v3/users/glance` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:46.431120 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 326/633] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:46.431945 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69367bcd-bd5a-4a20-99f9-ac97850f0413 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:46.439124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b463db5-89b6-46c7-9666-ec29af4f1e01 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:46.440587 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b463db5-89b6-46c7-9666-ec29af4f1e01 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:46.458063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-0b463db5-89b6-46c7-9666-ec29af4f1e01 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 15:19:46.458063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:46.458063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:46.458063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:46.458063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:46.458063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:46.458063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:46.458063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:46.458063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:46.458063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:46.458063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:46.458063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:46.458063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:19:46.458063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:19:46.458063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:19:46.458063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:19:46.460649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:46.460649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:46.460649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:19:46.460649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:46.460649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:19:46.460649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:46.460649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:46.460649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:46.460649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:46.460649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:46.460649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:46.460649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:46.460649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:46.460649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:46.460649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:46.460649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:46.460649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:46.460649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:46.463176 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:46.463176 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:46.463176 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:19:46.463176 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:19:46.463176 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:19:46.463176 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:19:46.463176 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:19:46.463176 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:19:46.463176 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 15:19:46.463176 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:46.463176 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 308/634] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:19:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:46.463176 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ef667-94ba-482a-97a2-a01ccd55c758 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:46.463176 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ef667-94ba-482a-97a2-a01ccd55c758 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:46.464985 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ef667-94ba-482a-97a2-a01ccd55c758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:46.478787 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-480ef667-94ba-482a-97a2-a01ccd55c758 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:46.480003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-480ef667-94ba-482a-97a2-a01ccd55c758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:46.549955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 309/635] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:46.551893 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ef667-94ba-482a-97a2-a01ccd55c758 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:46.552885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69367bcd-bd5a-4a20-99f9-ac97850f0413 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:46.613234 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e889fcf-7192-4bbe-a0ab-b2a641e8e410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:46.614144 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e889fcf-7192-4bbe-a0ab-b2a641e8e410 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:46.614357 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e889fcf-7192-4bbe-a0ab-b2a641e8e410 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:46.615572 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e889fcf-7192-4bbe-a0ab-b2a641e8e410 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:46.625933 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e889fcf-7192-4bbe-a0ab-b2a641e8e410 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:46.627850 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e889fcf-7192-4bbe-a0ab-b2a641e8e410 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:46.647844 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-4e889fcf-7192-4bbe-a0ab-b2a641e8e410 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:19:46.647844 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:46.647844 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:46.647844 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:46.647844 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:46.647844 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:46.647844 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:46.647844 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:46.647844 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:46.647844 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:46.647844 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:46.647844 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:46.647844 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:19:46.647844 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:19:46.647844 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:19:46.647844 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:19:46.649019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:46.649019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:46.649019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:19:46.649019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:46.649019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:19:46.649019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:46.649019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:46.649019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:46.649019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:46.649019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:46.649019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:46.649019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:46.649019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:46.649019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:46.649019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:46.649019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:46.649019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:46.649019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:46.650404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:46.650404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:46.650404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:19:46.650404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:19:46.650404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:19:46.650404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:19:46.650404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:19:46.650404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:19:46.650404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:19:46.650404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:46.650404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 327/636] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:19:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:46.651608 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e889fcf-7192-4bbe-a0ab-b2a641e8e410 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:46.671785 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ef667-94ba-482a-97a2-a01ccd55c758 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:46.714145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf21efd-1754-4130-9a9c-5ad5e2d46d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:46.714853 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf21efd-1754-4130-9a9c-5ad5e2d46d37 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:46.715140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf21efd-1754-4130-9a9c-5ad5e2d46d37 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:46.715420 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf21efd-1754-4130-9a9c-5ad5e2d46d37 None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:46.716298 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf21efd-1754-4130-9a9c-5ad5e2d46d37 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:46.716611 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf21efd-1754-4130-9a9c-5ad5e2d46d37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:46.718143 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf21efd-1754-4130-9a9c-5ad5e2d46d37 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:46.742868 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 310/637] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 9 15:19:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:46.743855 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf21efd-1754-4130-9a9c-5ad5e2d46d37 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:46.790906 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e889fcf-7192-4bbe-a0ab-b2a641e8e410 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:46.837921 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ccceb-b7d3-44ea-a865-6c3298617cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:46.839346 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ccceb-b7d3-44ea-a865-6c3298617cad None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:46.839635 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ccceb-b7d3-44ea-a865-6c3298617cad None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:46.839910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ccceb-b7d3-44ea-a865-6c3298617cad None admin] PATH_INFO: `/v3/roles/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:46.855028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ccceb-b7d3-44ea-a865-6c3298617cad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:46.865229 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-e75ccceb-b7d3-44ea-a865-6c3298617cad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:46.865229 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:46.865229 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:46.865229 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:46.865229 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:46.865229 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:46.865229 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:46.865229 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:46.865229 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:46.865229 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:46.865229 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:46.865229 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:46.865229 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:46.865229 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:46.865229 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:46.865229 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:46.867140 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:46.867140 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:46.867140 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:46.867140 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:46.867140 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:46.867140 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:46.867140 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:46.867140 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:46.867140 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:46.867140 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:46.867140 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:46.867140 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:46.867140 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:46.867140 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:46.867140 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:46.867140 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:46.868614 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:46.868614 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:46.868614 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:46.868614 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:46.868614 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:46.868614 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:46.868614 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:46.868614 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:46.868614 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:46.868614 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:46.868614 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:46.868614 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:46.868614 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 328/638] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:19:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:46.868614 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ccceb-b7d3-44ea-a865-6c3298617cad None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:46.879119 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf21efd-1754-4130-9a9c-5ad5e2d46d37 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:46.917264 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6e25c-c70d-4c67-b004-07746e7e5e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:46.918002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6e25c-c70d-4c67-b004-07746e7e5e70 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:46.918343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6e25c-c70d-4c67-b004-07746e7e5e70 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:46.918623 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6e25c-c70d-4c67-b004-07746e7e5e70 None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:46.919487 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6e25c-c70d-4c67-b004-07746e7e5e70 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:46.919806 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6e25c-c70d-4c67-b004-07746e7e5e70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:46.921319 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6e25c-c70d-4c67-b004-07746e7e5e70 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:46.941394 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 311/639] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 9 15:19:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:46.943530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6e25c-c70d-4c67-b004-07746e7e5e70 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:47.006028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ccceb-b7d3-44ea-a865-6c3298617cad None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:47.046710 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d047d5-e5e3-4d17-91ad-b6e600a5cbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:47.047820 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d047d5-e5e3-4d17-91ad-b6e600a5cbaf None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:47.048396 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d047d5-e5e3-4d17-91ad-b6e600a5cbaf None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:47.048687 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d047d5-e5e3-4d17-91ad-b6e600a5cbaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:47.070516 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6e25c-c70d-4c67-b004-07746e7e5e70 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:47.120206 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c54745-46b8-46b8-b234-0d29d652cce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:47.120852 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c54745-46b8-46b8-b234-0d29d652cce7 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:47.121145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c54745-46b8-46b8-b234-0d29d652cce7 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:47.121575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c54745-46b8-46b8-b234-0d29d652cce7 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:47.122544 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c54745-46b8-46b8-b234-0d29d652cce7 None admin] RBAC: Adding query filter params (name=service) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:47.122913 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c54745-46b8-46b8-b234-0d29d652cce7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:47.125452 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c54745-46b8-46b8-b234-0d29d652cce7 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:47.128962 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d047d5-e5e3-4d17-91ad-b6e600a5cbaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:47.131208 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d047d5-e5e3-4d17-91ad-b6e600a5cbaf None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:47.143343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 312/640] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:19:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:47.144380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c54745-46b8-46b8-b234-0d29d652cce7 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:47.245167 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 329/641] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:19:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:19:47.246183 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d047d5-e5e3-4d17-91ad-b6e600a5cbaf None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:47.268421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c54745-46b8-46b8-b234-0d29d652cce7 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:47.309897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8876b56-aae9-4021-adc4-75f9a6aa9745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:47.310602 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8876b56-aae9-4021-adc4-75f9a6aa9745 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:47.310890 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8876b56-aae9-4021-adc4-75f9a6aa9745 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:47.311175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8876b56-aae9-4021-adc4-75f9a6aa9745 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:47.358060 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d047d5-e5e3-4d17-91ad-b6e600a5cbaf None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:47.391417 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8876b56-aae9-4021-adc4-75f9a6aa9745 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:47.393200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8876b56-aae9-4021-adc4-75f9a6aa9745 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:47.394230 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd313991-d4e1-4f1a-a104-d27495fb4d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:47.395563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd313991-d4e1-4f1a-a104-d27495fb4d73 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:47.395863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd313991-d4e1-4f1a-a104-d27495fb4d73 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:47.396148 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd313991-d4e1-4f1a-a104-d27495fb4d73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:47.407409 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd313991-d4e1-4f1a-a104-d27495fb4d73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:47.408943 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd313991-d4e1-4f1a-a104-d27495fb4d73 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:47.427121 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-bd313991-d4e1-4f1a-a104-d27495fb4d73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:47.427121 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:47.427121 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:47.427121 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:47.427121 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:47.427121 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:47.427121 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:47.427121 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:47.427121 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:47.427121 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:47.427121 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:47.427121 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:47.427121 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:47.427121 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:47.427121 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:47.428441 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:47.428441 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:47.428441 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:47.428441 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:47.428441 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:47.428441 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:47.428441 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:47.428441 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:47.428441 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:47.428441 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:47.428441 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:47.428441 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:47.428441 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:47.428441 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:47.428441 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:47.428441 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:47.428441 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:47.430282 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:47.430282 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:47.430282 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:47.430282 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:47.430282 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 330/642] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:47.430282 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd313991-d4e1-4f1a-a104-d27495fb4d73 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:47.527636 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 313/643] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:19:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:19:47.533640 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c50eb-4538-4cd5-a666-f0701718206c None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:47.534024 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c50eb-4538-4cd5-a666-f0701718206c None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:47.534342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c50eb-4538-4cd5-a666-f0701718206c None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:47.535799 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 314/644] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:47.541739 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c50eb-4538-4cd5-a666-f0701718206c None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:47.566717 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd313991-d4e1-4f1a-a104-d27495fb4d73 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:47.611854 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92be487-fb97-42dc-9149-942cfa0657d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:47.613010 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92be487-fb97-42dc-9149-942cfa0657d0 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:47.613467 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92be487-fb97-42dc-9149-942cfa0657d0 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:47.613838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92be487-fb97-42dc-9149-942cfa0657d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:47.626624 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92be487-fb97-42dc-9149-942cfa0657d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:47.628183 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92be487-fb97-42dc-9149-942cfa0657d0 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:47.649124 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-e92be487-fb97-42dc-9149-942cfa0657d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:47.649124 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:47.649124 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:47.649124 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:47.649124 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:47.649124 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:47.649124 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:47.649124 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:47.649124 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:47.649124 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:47.649124 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:47.649124 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:47.649124 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:47.649124 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:47.649124 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:47.650434 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:47.650434 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:47.650434 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:47.650434 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:47.650434 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:47.650434 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:47.650434 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:47.650434 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:47.650434 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:47.650434 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:47.650434 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:47.650434 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:47.650434 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:47.650434 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:47.650434 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:47.650434 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:47.650434 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:47.651793 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:47.651793 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:47.651793 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:47.651793 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:47.655063 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 331/645] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:47.655855 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92be487-fb97-42dc-9149-942cfa0657d0 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:47.694824 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c50eb-4538-4cd5-a666-f0701718206c None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:47.731392 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd017f-f5c3-46aa-9a73-b9230a2abf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:47.732072 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd017f-f5c3-46aa-9a73-b9230a2abf79 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:47.732378 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd017f-f5c3-46aa-9a73-b9230a2abf79 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:47.732623 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd017f-f5c3-46aa-9a73-b9230a2abf79 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:47.733400 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd017f-f5c3-46aa-9a73-b9230a2abf79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:47.733706 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd017f-f5c3-46aa-9a73-b9230a2abf79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:47.735106 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd017f-f5c3-46aa-9a73-b9230a2abf79 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:47.755592 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 315/646] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:47.755592 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f4c21-a9f6-4b21-92f8-a6a0b2d5a865 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:47.755592 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f4c21-a9f6-4b21-92f8-a6a0b2d5a865 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:47.755592 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f4c21-a9f6-4b21-92f8-a6a0b2d5a865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:47.775011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-ca6f4c21-a9f6-4b21-92f8-a6a0b2d5a865 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:47.776849 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-ca6f4c21-a9f6-4b21-92f8-a6a0b2d5a865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:47.794386 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92be487-fb97-42dc-9149-942cfa0657d0 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:47.836971 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac7d5b-dc94-48bc-a11a-a477f7b0b61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:47.837833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac7d5b-dc94-48bc-a11a-a477f7b0b61d None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:47.838198 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac7d5b-dc94-48bc-a11a-a477f7b0b61d None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:47.838471 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac7d5b-dc94-48bc-a11a-a477f7b0b61d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:47.849866 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac7d5b-dc94-48bc-a11a-a477f7b0b61d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:47.851338 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac7d5b-dc94-48bc-a11a-a477f7b0b61d None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:47.861301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 316/647] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:47.864732 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f4c21-a9f6-4b21-92f8-a6a0b2d5a865 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:47.884527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-74ac7d5b-dc94-48bc-a11a-a477f7b0b61d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:47.884527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:47.884527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:47.884527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:47.884527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:47.884527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:47.884527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:47.884527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:47.884527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:47.884527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:47.884527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:47.884527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:47.884527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:47.884527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:47.884527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:47.885807 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:47.885807 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:47.885807 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:47.885807 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:47.885807 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:47.885807 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:47.885807 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:47.885807 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:47.885807 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:47.885807 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:47.885807 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:47.885807 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:47.885807 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:47.885807 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:47.885807 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:47.885807 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:47.885807 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:47.886953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:47.886953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:47.886953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:47.886953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:47.886953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 332/648] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:47.887926 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac7d5b-dc94-48bc-a11a-a477f7b0b61d None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:47.994804 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f4c21-a9f6-4b21-92f8-a6a0b2d5a865 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:48.022474 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac7d5b-dc94-48bc-a11a-a477f7b0b61d None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:48.038274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb0fbc-5e68-40ce-b75e-91b249a86695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:48.038983 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb0fbc-5e68-40ce-b75e-91b249a86695 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:48.039327 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb0fbc-5e68-40ce-b75e-91b249a86695 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:48.039547 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb0fbc-5e68-40ce-b75e-91b249a86695 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:48.040452 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb0fbc-5e68-40ce-b75e-91b249a86695 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:48.040889 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb0fbc-5e68-40ce-b75e-91b249a86695 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:48.042352 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb0fbc-5e68-40ce-b75e-91b249a86695 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:48.055659 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 317/649] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:48.056835 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb0fbc-5e68-40ce-b75e-91b249a86695 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:48.078110 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e121b9-cca3-4017-af5d-f80c7c39328a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:48.078918 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e121b9-cca3-4017-af5d-f80c7c39328a None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:48.079202 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e121b9-cca3-4017-af5d-f80c7c39328a None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:48.079476 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e121b9-cca3-4017-af5d-f80c7c39328a None admin] PATH_INFO: `/v3/users/nova` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:48.088840 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e121b9-cca3-4017-af5d-f80c7c39328a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:48.091102 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e121b9-cca3-4017-af5d-f80c7c39328a None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:48.113551 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-21e121b9-cca3-4017-af5d-f80c7c39328a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:19:48.113551 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:48.113551 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:48.113551 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:48.113551 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:48.113551 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:48.113551 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:48.113551 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:48.113551 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:48.113551 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:48.113551 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:48.113551 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:48.113551 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:19:48.113551 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:19:48.113551 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:19:48.113551 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:19:48.115368 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:48.115368 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:48.115368 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:19:48.115368 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:48.115368 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:19:48.115368 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:48.115368 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:48.115368 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:48.115368 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:48.115368 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:48.115368 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:48.115368 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:48.115368 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:48.115368 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:48.115368 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:48.115368 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:48.115368 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:48.115368 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:48.118499 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:48.118499 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:48.118499 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:19:48.118499 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:19:48.118499 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:19:48.118499 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:19:48.118499 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:19:48.118499 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:19:48.118499 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:19:48.118499 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:48.118499 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 333/650] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:19:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:48.118499 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e121b9-cca3-4017-af5d-f80c7c39328a None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:48.190645 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb0fbc-5e68-40ce-b75e-91b249a86695 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:48.236751 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3665c0d-05c2-4b36-b9d5-6ddc6d16f028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:48.237881 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3665c0d-05c2-4b36-b9d5-6ddc6d16f028 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:48.238700 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3665c0d-05c2-4b36-b9d5-6ddc6d16f028 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:48.240245 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3665c0d-05c2-4b36-b9d5-6ddc6d16f028 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:48.241620 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3665c0d-05c2-4b36-b9d5-6ddc6d16f028 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:48.241957 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3665c0d-05c2-4b36-b9d5-6ddc6d16f028 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:48.244306 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3665c0d-05c2-4b36-b9d5-6ddc6d16f028 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:48.245284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e121b9-cca3-4017-af5d-f80c7c39328a None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:48.264471 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 318/651] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:48.266617 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86855eb-bee1-434b-8067-95380e575d94 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:48.267057 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86855eb-bee1-434b-8067-95380e575d94 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:48.267423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86855eb-bee1-434b-8067-95380e575d94 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:48.269597 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 319/652] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:48.270741 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86855eb-bee1-434b-8067-95380e575d94 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:48.295749 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db69dc4-9810-4bae-b2b2-d88da2b291e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:48.296566 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db69dc4-9810-4bae-b2b2-d88da2b291e0 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:48.296863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db69dc4-9810-4bae-b2b2-d88da2b291e0 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:48.297140 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db69dc4-9810-4bae-b2b2-d88da2b291e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:48.310755 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db69dc4-9810-4bae-b2b2-d88da2b291e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:48.319553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-4db69dc4-9810-4bae-b2b2-d88da2b291e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:48.319553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:48.319553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:48.319553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:48.319553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:48.319553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:48.319553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:48.319553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:48.319553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:48.319553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:48.319553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:48.319553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:48.319553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:48.319553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:48.319553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:48.319553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:48.320756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:48.320756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:48.320756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:48.320756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:48.320756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:48.320756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:48.320756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:48.320756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:48.320756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:48.320756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:48.320756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:48.320756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:48.320756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:48.320756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:48.320756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:48.320756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:48.322329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:48.322329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:48.322329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:48.322329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:48.322329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:48.322329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:48.322329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:48.322329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:48.322329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:48.322329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:48.322329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:48.322329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:48.322329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 334/653] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:19:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:48.323134 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db69dc4-9810-4bae-b2b2-d88da2b291e0 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:48.435476 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86855eb-bee1-434b-8067-95380e575d94 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:48.464206 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db69dc4-9810-4bae-b2b2-d88da2b291e0 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:48.477597 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20346587-36a7-4d6c-b3bd-5de7fd8bb9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:48.478466 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20346587-36a7-4d6c-b3bd-5de7fd8bb9c5 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:48.478755 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20346587-36a7-4d6c-b3bd-5de7fd8bb9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:48.479042 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20346587-36a7-4d6c-b3bd-5de7fd8bb9c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:48.487093 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20346587-36a7-4d6c-b3bd-5de7fd8bb9c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:48.488859 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20346587-36a7-4d6c-b3bd-5de7fd8bb9c5 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:48.505157 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ef9c9-52b5-40d8-b0e1-7f7546d47f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:48.505860 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ef9c9-52b5-40d8-b0e1-7f7546d47f77 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:48.506144 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ef9c9-52b5-40d8-b0e1-7f7546d47f77 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:48.506426 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ef9c9-52b5-40d8-b0e1-7f7546d47f77 None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:48.507402 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ef9c9-52b5-40d8-b0e1-7f7546d47f77 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:48.507747 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ef9c9-52b5-40d8-b0e1-7f7546d47f77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:48.509455 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ef9c9-52b5-40d8-b0e1-7f7546d47f77 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:48.509656 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-20346587-36a7-4d6c-b3bd-5de7fd8bb9c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:48.509656 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:48.509656 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:48.509656 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:48.509656 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:48.509656 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:48.509656 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:48.509656 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:48.509656 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:48.509656 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:48.509656 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:48.509656 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:48.509656 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:19:48.509656 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:19:48.509656 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:19:48.511364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:19:48.511364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:48.511364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:48.511364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:48.511364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:48.511364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:48.511364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:48.511364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:48.511364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:48.511364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:48.511364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:48.511364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:48.511364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:48.511364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:48.511364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:48.511364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:48.511364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:48.512550 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:19:48.512550 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:19:48.512550 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:19:48.512550 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:19:48.512550 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:19:48.512550 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:19:48.512550 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:48.512550 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:48.512550 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 320/654] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:19:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:48.512550 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20346587-36a7-4d6c-b3bd-5de7fd8bb9c5 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:48.533700 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 335/655] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:19:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:48.533700 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746ddc8-a87d-42dd-987d-cf6a462e29d4 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:48.534066 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746ddc8-a87d-42dd-987d-cf6a462e29d4 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:48.534412 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746ddc8-a87d-42dd-987d-cf6a462e29d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:48.557012 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-1746ddc8-a87d-42dd-987d-cf6a462e29d4 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:48.558458 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-1746ddc8-a87d-42dd-987d-cf6a462e29d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:48.669513 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 336/656] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:48.669513 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746ddc8-a87d-42dd-987d-cf6a462e29d4 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:48.669796 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20346587-36a7-4d6c-b3bd-5de7fd8bb9c5 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:48.711193 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852e210-0e69-4b5d-9290-4d8547d8ab41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:48.712010 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852e210-0e69-4b5d-9290-4d8547d8ab41 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:48.712294 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852e210-0e69-4b5d-9290-4d8547d8ab41 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:48.712575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852e210-0e69-4b5d-9290-4d8547d8ab41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:48.720512 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852e210-0e69-4b5d-9290-4d8547d8ab41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:48.722366 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852e210-0e69-4b5d-9290-4d8547d8ab41 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:48.739016 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-4852e210-0e69-4b5d-9290-4d8547d8ab41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:48.739016 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:48.739016 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:48.739016 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:48.739016 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:48.739016 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:48.739016 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:48.739016 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:48.739016 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:48.739016 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:48.739016 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:48.739016 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:48.739016 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:19:48.739016 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:19:48.739016 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:19:48.740575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:19:48.740575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:48.740575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:48.740575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:48.740575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:48.740575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:48.740575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:48.740575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:48.740575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:48.740575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:48.740575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:48.740575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:48.740575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:48.740575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:48.740575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:48.740575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:48.740575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:48.741922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:19:48.741922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:19:48.741922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:19:48.741922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:19:48.741922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:19:48.741922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:19:48.741922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:48.741922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:48.744268 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 321/657] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:19:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:48.745320 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852e210-0e69-4b5d-9290-4d8547d8ab41 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:48.838907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746ddc8-a87d-42dd-987d-cf6a462e29d4 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:48.879054 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c6f8c-a32f-4a0e-8d0a-581c93110b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:48.880553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c6f8c-a32f-4a0e-8d0a-581c93110b88 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:48.880863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c6f8c-a32f-4a0e-8d0a-581c93110b88 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:48.881144 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c6f8c-a32f-4a0e-8d0a-581c93110b88 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:48.881955 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c6f8c-a32f-4a0e-8d0a-581c93110b88 None admin] RBAC: Adding query filter params (name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:48.882265 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c6f8c-a32f-4a0e-8d0a-581c93110b88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:48.883667 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c6f8c-a32f-4a0e-8d0a-581c93110b88 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:48.888497 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852e210-0e69-4b5d-9290-4d8547d8ab41 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:48.892809 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 337/658] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:19:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:48.894435 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c6f8c-a32f-4a0e-8d0a-581c93110b88 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:48.936188 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c76a6-c2ac-4aa8-9dec-499c17d23013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:48.936963 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c76a6-c2ac-4aa8-9dec-499c17d23013 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:48.937316 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c76a6-c2ac-4aa8-9dec-499c17d23013 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:48.937631 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c76a6-c2ac-4aa8-9dec-499c17d23013 None admin] PATH_INFO: `/v3/projects` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:48.938441 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c76a6-c2ac-4aa8-9dec-499c17d23013 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:48.938809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c76a6-c2ac-4aa8-9dec-499c17d23013 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:48.940514 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c76a6-c2ac-4aa8-9dec-499c17d23013 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:48.956598 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 322/659] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:19:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:48.958230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c76a6-c2ac-4aa8-9dec-499c17d23013 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:49.022095 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c6f8c-a32f-4a0e-8d0a-581c93110b88 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:49.069881 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6270e-a350-478a-8fba-2ed7ae386ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:49.070900 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6270e-a350-478a-8fba-2ed7ae386ac5 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:49.071355 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6270e-a350-478a-8fba-2ed7ae386ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:49.071820 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6270e-a350-478a-8fba-2ed7ae386ac5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:49.089635 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c76a6-c2ac-4aa8-9dec-499c17d23013 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:49.141705 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2c643-45b0-445c-91bc-8b25fc447cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:49.142523 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2c643-45b0-445c-91bc-8b25fc447cd9 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:49.142840 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2c643-45b0-445c-91bc-8b25fc447cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:49.143123 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2c643-45b0-445c-91bc-8b25fc447cd9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:49.155787 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2c643-45b0-445c-91bc-8b25fc447cd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:49.164083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-cca2c643-45b0-445c-91bc-8b25fc447cd9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:49.164083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:49.164083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:49.164083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:49.164083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:49.164083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:49.164083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:49.164083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:49.164083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:49.164083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:49.164083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:49.164083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:49.164083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:49.164083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:49.164083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:49.164083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:49.166301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:49.166301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:49.166301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:49.166301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:49.166301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:49.166301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:49.166301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:49.166301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:49.166301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:49.166301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:49.166301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:49.166301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:49.166301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:49.166301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:49.166301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:49.166301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:49.168183 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:49.168183 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:49.168183 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:49.168183 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:49.168183 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:49.168183 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:49.168183 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:49.168183 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:49.168183 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:49.168183 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:49.168183 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:49.168183 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:49.168183 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 323/660] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:19:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:49.168183 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2c643-45b0-445c-91bc-8b25fc447cd9 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:49.179353 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6270e-a350-478a-8fba-2ed7ae386ac5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:49.180960 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6270e-a350-478a-8fba-2ed7ae386ac5 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:49.274737 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2c643-45b0-445c-91bc-8b25fc447cd9 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:49.283544 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 338/661] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:19:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:19:49.284399 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6270e-a350-478a-8fba-2ed7ae386ac5 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:49.311156 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02658054-ffa0-4002-99d3-7124550d5272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:49.311850 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02658054-ffa0-4002-99d3-7124550d5272 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:49.312145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02658054-ffa0-4002-99d3-7124550d5272 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:49.312418 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02658054-ffa0-4002-99d3-7124550d5272 None admin] PATH_INFO: `/v3/projects` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:49.313224 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02658054-ffa0-4002-99d3-7124550d5272 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:49.313569 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02658054-ffa0-4002-99d3-7124550d5272 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:49.315025 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02658054-ffa0-4002-99d3-7124550d5272 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:49.327788 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 324/662] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:19:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:49.328646 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02658054-ffa0-4002-99d3-7124550d5272 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:49.388565 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6270e-a350-478a-8fba-2ed7ae386ac5 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:49.422089 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcab1d1-af8e-43b5-b568-9d2eafc2cc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:49.422884 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcab1d1-af8e-43b5-b568-9d2eafc2cc88 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:49.423167 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcab1d1-af8e-43b5-b568-9d2eafc2cc88 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:49.423441 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcab1d1-af8e-43b5-b568-9d2eafc2cc88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:49.428747 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02658054-ffa0-4002-99d3-7124550d5272 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:49.433683 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcab1d1-af8e-43b5-b568-9d2eafc2cc88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:49.435135 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcab1d1-af8e-43b5-b568-9d2eafc2cc88 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:49.452890 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-8dcab1d1-af8e-43b5-b568-9d2eafc2cc88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:49.452890 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:49.452890 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:49.452890 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:49.452890 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:49.452890 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:49.452890 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:49.452890 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:49.452890 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:49.452890 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:49.452890 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:49.452890 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:49.452890 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:49.452890 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:49.452890 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:49.454224 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:49.454224 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:49.454224 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:49.454224 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:49.454224 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:49.454224 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:49.454224 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:49.454224 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:49.454224 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:49.454224 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:49.454224 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:49.454224 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:49.454224 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:49.454224 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:49.454224 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:49.454224 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:49.454224 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:49.455275 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:49.455275 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:49.455275 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:49.455275 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:49.455275 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 339/663] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:49.455275 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcab1d1-af8e-43b5-b568-9d2eafc2cc88 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:49.463182 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd931c-0349-4165-9669-3e00979f2cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:49.463849 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd931c-0349-4165-9669-3e00979f2cbd None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:49.464140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd931c-0349-4165-9669-3e00979f2cbd None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:49.464415 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd931c-0349-4165-9669-3e00979f2cbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:49.465256 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd931c-0349-4165-9669-3e00979f2cbd None admin] RBAC: Adding query filter params (role.id=7d8a1698372145a59d70d67ed7867f56, scope.project.id=eb2de9bea1cf451db5f8c697f480c480, user.id=9575eaad5f3f497094f508ebf1c5e656) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:49.465611 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd931c-0349-4165-9669-3e00979f2cbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:49.467041 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd931c-0349-4165-9669-3e00979f2cbd None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:49.472872 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 325/664] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:19:49 2022] GET /identity/v3/role_assignments?user.id=9575eaad5f3f497094f508ebf1c5e656&scope.project.id=eb2de9bea1cf451db5f8c697f480c480&role.id=7d8a1698372145a59d70d67ed7867f56 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:49.474719 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd931c-0349-4165-9669-3e00979f2cbd None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:49.567653 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcab1d1-af8e-43b5-b568-9d2eafc2cc88 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:49.588303 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd931c-0349-4165-9669-3e00979f2cbd None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:49.607044 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5e66a-59a0-4b42-b3e9-8d16b725d3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:49.607832 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5e66a-59a0-4b42-b3e9-8d16b725d3e2 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:49.608175 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5e66a-59a0-4b42-b3e9-8d16b725d3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:49.608407 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5e66a-59a0-4b42-b3e9-8d16b725d3e2 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:49.609201 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5e66a-59a0-4b42-b3e9-8d16b725d3e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:49.609564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5e66a-59a0-4b42-b3e9-8d16b725d3e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:49.611096 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5e66a-59a0-4b42-b3e9-8d16b725d3e2 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:49.626220 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 340/665] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:19:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:49.626220 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5e66a-59a0-4b42-b3e9-8d16b725d3e2 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:49.636727 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00718d59-ee72-4e9f-aaf3-38399ba5d146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:49.637607 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00718d59-ee72-4e9f-aaf3-38399ba5d146 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:49.637896 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00718d59-ee72-4e9f-aaf3-38399ba5d146 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:49.638176 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00718d59-ee72-4e9f-aaf3-38399ba5d146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:49.651128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00718d59-ee72-4e9f-aaf3-38399ba5d146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:49.652510 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00718d59-ee72-4e9f-aaf3-38399ba5d146 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:49.673998 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-00718d59-ee72-4e9f-aaf3-38399ba5d146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:49.673998 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:49.673998 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:49.673998 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:49.673998 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:49.673998 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:49.673998 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:49.673998 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:49.673998 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:49.673998 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:49.673998 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:49.673998 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:49.673998 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:49.673998 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:49.673998 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:49.675155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:49.675155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:49.675155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:49.675155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:49.675155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:49.675155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:49.675155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:49.675155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:49.675155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:49.675155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:49.675155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:49.675155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:49.675155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:49.675155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:49.675155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:49.675155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:49.675155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:49.676144 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:49.676144 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:49.676144 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:49.676144 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:49.676144 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 326/666] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:49.676144 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00718d59-ee72-4e9f-aaf3-38399ba5d146 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:49.764978 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5e66a-59a0-4b42-b3e9-8d16b725d3e2 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:49.823009 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011574f-5a15-492f-b9e6-fdad116d6c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:49.824085 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011574f-5a15-492f-b9e6-fdad116d6c1c None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:49.824562 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011574f-5a15-492f-b9e6-fdad116d6c1c None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:49.825020 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011574f-5a15-492f-b9e6-fdad116d6c1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:49.825498 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00718d59-ee72-4e9f-aaf3-38399ba5d146 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:49.826528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011574f-5a15-492f-b9e6-fdad116d6c1c None admin] RBAC: Adding query filter params (role.id=7d8a1698372145a59d70d67ed7867f56, scope.project.id=eb2de9bea1cf451db5f8c697f480c480, user.id=2d337bfaeac14e53872539cebff40ab9) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:49.827044 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011574f-5a15-492f-b9e6-fdad116d6c1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:49.829394 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011574f-5a15-492f-b9e6-fdad116d6c1c None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:49.840002 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 341/667] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:19:49 2022] GET /identity/v3/role_assignments?user.id=2d337bfaeac14e53872539cebff40ab9&scope.project.id=eb2de9bea1cf451db5f8c697f480c480&role.id=7d8a1698372145a59d70d67ed7867f56 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:49.841407 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011574f-5a15-492f-b9e6-fdad116d6c1c None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:49.899418 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63730b7f-033b-439c-8346-913d318c945b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:49.900561 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63730b7f-033b-439c-8346-913d318c945b None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:49.901048 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63730b7f-033b-439c-8346-913d318c945b None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:49.901645 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63730b7f-033b-439c-8346-913d318c945b None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:49.902874 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63730b7f-033b-439c-8346-913d318c945b None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:49.903497 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63730b7f-033b-439c-8346-913d318c945b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:49.905994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63730b7f-033b-439c-8346-913d318c945b None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:49.935644 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 327/668] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:49.935644 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63730b7f-033b-439c-8346-913d318c945b None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:50.057724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011574f-5a15-492f-b9e6-fdad116d6c1c None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:50.095609 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63730b7f-033b-439c-8346-913d318c945b None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:50.112206 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420c47c-8a4d-46f8-ab90-3d8efd78926b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:50.113401 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420c47c-8a4d-46f8-ab90-3d8efd78926b None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:50.115218 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420c47c-8a4d-46f8-ab90-3d8efd78926b None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:50.115910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420c47c-8a4d-46f8-ab90-3d8efd78926b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:50.129624 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420c47c-8a4d-46f8-ab90-3d8efd78926b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:50.131905 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420c47c-8a4d-46f8-ab90-3d8efd78926b None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:50.154860 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-d420c47c-8a4d-46f8-ab90-3d8efd78926b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:50.154860 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:50.154860 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:50.154860 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:50.154860 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:50.154860 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:50.154860 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:50.154860 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:50.154860 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:50.154860 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:50.154860 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:50.154860 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:50.154860 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:50.154860 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:50.154860 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:50.155944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:50.155944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:50.155944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:50.155944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:50.155944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:50.155944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:50.155944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:50.155944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:50.155944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:50.155944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:50.155944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:50.155944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:50.155944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:50.155944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:50.155944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:50.155944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:50.155944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:50.156985 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:50.156985 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:50.156985 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:50.156985 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:50.159587 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 342/669] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:50.160836 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420c47c-8a4d-46f8-ab90-3d8efd78926b None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:50.289746 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420c47c-8a4d-46f8-ab90-3d8efd78926b None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:50.325710 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475679d-abca-4bc3-962b-39b9883ebe25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:50.326519 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475679d-abca-4bc3-962b-39b9883ebe25 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:50.326839 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475679d-abca-4bc3-962b-39b9883ebe25 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:50.327120 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475679d-abca-4bc3-962b-39b9883ebe25 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:50.336053 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475679d-abca-4bc3-962b-39b9883ebe25 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:50.337558 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475679d-abca-4bc3-962b-39b9883ebe25 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:50.339889 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84702f-05b8-4410-b512-1719c96091c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:50.340914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84702f-05b8-4410-b512-1719c96091c1 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:50.341414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84702f-05b8-4410-b512-1719c96091c1 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:50.341878 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84702f-05b8-4410-b512-1719c96091c1 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:50.343037 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84702f-05b8-4410-b512-1719c96091c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:50.343569 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84702f-05b8-4410-b512-1719c96091c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:50.345930 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84702f-05b8-4410-b512-1719c96091c1 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:50.353443 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-c475679d-abca-4bc3-962b-39b9883ebe25 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:19:50.353443 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:50.353443 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:50.353443 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:50.353443 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:50.353443 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:50.353443 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:50.353443 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:50.353443 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:50.353443 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:50.353443 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:50.353443 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:50.353443 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:19:50.353443 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:19:50.353443 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:19:50.353443 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:19:50.354563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:50.354563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:50.354563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:19:50.354563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:50.354563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:19:50.354563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:50.354563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:50.354563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:50.354563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:50.354563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:50.354563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:50.354563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:50.354563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:50.354563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:50.354563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:50.354563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:50.354563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:50.354563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:50.355646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:50.355646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:50.355646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:19:50.355646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:19:50.355646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:19:50.355646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:19:50.355646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:19:50.355646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:19:50.355646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:19:50.355646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:50.355646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 343/670] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:19:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:50.356555 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475679d-abca-4bc3-962b-39b9883ebe25 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:50.368360 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 328/671] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:50.369914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84702f-05b8-4410-b512-1719c96091c1 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:50.487239 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475679d-abca-4bc3-962b-39b9883ebe25 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:50.525481 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32523a08-4b6b-44a2-8d8f-bb65f8f45a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:50.526475 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32523a08-4b6b-44a2-8d8f-bb65f8f45a39 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:50.526975 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32523a08-4b6b-44a2-8d8f-bb65f8f45a39 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:50.527465 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32523a08-4b6b-44a2-8d8f-bb65f8f45a39 None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:50.528404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32523a08-4b6b-44a2-8d8f-bb65f8f45a39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:50.528911 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32523a08-4b6b-44a2-8d8f-bb65f8f45a39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:50.530549 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32523a08-4b6b-44a2-8d8f-bb65f8f45a39 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:50.546185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 344/672] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:50.547296 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32523a08-4b6b-44a2-8d8f-bb65f8f45a39 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:50.560187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84702f-05b8-4410-b512-1719c96091c1 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:50.624205 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c4b80-f6ec-42a3-8a32-21ab078ffadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:50.625707 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c4b80-f6ec-42a3-8a32-21ab078ffadd None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:50.626142 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c4b80-f6ec-42a3-8a32-21ab078ffadd None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:50.626623 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c4b80-f6ec-42a3-8a32-21ab078ffadd None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:50.628425 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c4b80-f6ec-42a3-8a32-21ab078ffadd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:50.629696 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c4b80-f6ec-42a3-8a32-21ab078ffadd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:50.631920 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c4b80-f6ec-42a3-8a32-21ab078ffadd None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:50.663260 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32523a08-4b6b-44a2-8d8f-bb65f8f45a39 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:50.669736 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 329/673] 10.222.0.48 () {56 vars in 1139 bytes} [Mon May 9 15:19:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:50.669736 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c4b80-f6ec-42a3-8a32-21ab078ffadd None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:50.710151 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb60afb-072d-4825-b5df-5bf3584c2f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:50.711358 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb60afb-072d-4825-b5df-5bf3584c2f70 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:50.711884 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb60afb-072d-4825-b5df-5bf3584c2f70 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:50.712380 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb60afb-072d-4825-b5df-5bf3584c2f70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:50.720218 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb60afb-072d-4825-b5df-5bf3584c2f70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:50.722186 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb60afb-072d-4825-b5df-5bf3584c2f70 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:50.737463 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-6eb60afb-072d-4825-b5df-5bf3584c2f70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:50.737463 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:50.737463 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:50.737463 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:50.737463 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:50.737463 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:50.737463 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:50.737463 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:50.737463 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:50.737463 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:50.737463 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:50.737463 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:50.737463 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:19:50.737463 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:19:50.737463 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:19:50.738527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:19:50.738527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:50.738527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:50.738527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:50.738527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:50.738527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:50.738527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:50.738527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:50.738527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:50.738527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:50.738527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:50.738527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:50.738527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:50.738527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:50.738527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:50.738527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:50.738527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:50.740284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:19:50.740284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:19:50.740284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:19:50.740284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:19:50.740284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:19:50.740284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:19:50.740284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:50.740284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:50.747573 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 345/674] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:19:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:50.748878 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb60afb-072d-4825-b5df-5bf3584c2f70 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:50.855741 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c4b80-f6ec-42a3-8a32-21ab078ffadd None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:50.860850 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb60afb-072d-4825-b5df-5bf3584c2f70 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:50.899930 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2cfbe-32a1-4615-8fa7-1005870f9d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:50.901015 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2cfbe-32a1-4615-8fa7-1005870f9d83 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:50.901584 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2cfbe-32a1-4615-8fa7-1005870f9d83 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:50.902084 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2cfbe-32a1-4615-8fa7-1005870f9d83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:50.919337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ca43d-e5b0-40b5-8fc0-978c7d1a9e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:50.920788 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ca43d-e5b0-40b5-8fc0-978c7d1a9e58 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:50.921351 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ca43d-e5b0-40b5-8fc0-978c7d1a9e58 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:50.921961 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ca43d-e5b0-40b5-8fc0-978c7d1a9e58 None admin] PATH_INFO: `/v3/users/swift` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:50.938800 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ca43d-e5b0-40b5-8fc0-978c7d1a9e58 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:50.942085 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ca43d-e5b0-40b5-8fc0-978c7d1a9e58 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:50.972323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-e45ca43d-e5b0-40b5-8fc0-978c7d1a9e58 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:19:50.972323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:50.972323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:50.972323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:50.972323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:50.972323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:50.972323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:50.972323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:50.972323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:50.972323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:50.972323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:50.972323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:50.972323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:19:50.972323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:19:50.972323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:19:50.972323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:19:50.973964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:50.973964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:50.973964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:19:50.973964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:50.973964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:19:50.973964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:50.973964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:50.973964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:50.973964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:50.973964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:50.973964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:50.973964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:50.973964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:50.973964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:50.973964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:50.973964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:50.973964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:50.973964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:50.975060 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:50.975060 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:50.975060 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:19:50.975060 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:19:50.975060 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:19:50.975060 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:19:50.975060 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:19:50.975060 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:19:50.975060 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:19:50.975060 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:50.975673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 330/675] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:19:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:50.976774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ca43d-e5b0-40b5-8fc0-978c7d1a9e58 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:51.010515 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2cfbe-32a1-4615-8fa7-1005870f9d83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:51.013059 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2cfbe-32a1-4615-8fa7-1005870f9d83 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:51.156745 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ca43d-e5b0-40b5-8fc0-978c7d1a9e58 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:51.201232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8128b33-da7b-450e-8d9c-1d88f98a357a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:51.202444 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8128b33-da7b-450e-8d9c-1d88f98a357a None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:51.209412 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 346/676] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:19:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:19:51.209412 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2cfbe-32a1-4615-8fa7-1005870f9d83 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:51.210438 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8128b33-da7b-450e-8d9c-1d88f98a357a None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:51.211620 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8128b33-da7b-450e-8d9c-1d88f98a357a None admin] PATH_INFO: `/v3/projects` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:51.213686 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8128b33-da7b-450e-8d9c-1d88f98a357a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:51.214586 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8128b33-da7b-450e-8d9c-1d88f98a357a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:51.217645 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8128b33-da7b-450e-8d9c-1d88f98a357a None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:51.240434 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 331/677] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:19:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:51.241583 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8128b33-da7b-450e-8d9c-1d88f98a357a None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:51.380839 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8128b33-da7b-450e-8d9c-1d88f98a357a None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:51.393328 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2cfbe-32a1-4615-8fa7-1005870f9d83 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:51.427945 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a94d64-3fe3-40a5-a3e3-6d17b4460802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:51.429137 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a94d64-3fe3-40a5-a3e3-6d17b4460802 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:51.430497 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a94d64-3fe3-40a5-a3e3-6d17b4460802 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:51.431231 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a94d64-3fe3-40a5-a3e3-6d17b4460802 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:51.450112 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a94d64-3fe3-40a5-a3e3-6d17b4460802 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:51.452864 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a94d64-3fe3-40a5-a3e3-6d17b4460802 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:51.453663 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5498952-9e2d-4209-a55d-ce9c23ffc01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:51.454730 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5498952-9e2d-4209-a55d-ce9c23ffc01d None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:51.455231 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5498952-9e2d-4209-a55d-ce9c23ffc01d None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:51.456182 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5498952-9e2d-4209-a55d-ce9c23ffc01d None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:51.457762 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5498952-9e2d-4209-a55d-ce9c23ffc01d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:51.458645 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5498952-9e2d-4209-a55d-ce9c23ffc01d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:51.460370 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5498952-9e2d-4209-a55d-ce9c23ffc01d None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:51.482294 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 347/678] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 9 15:19:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:51.483576 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5498952-9e2d-4209-a55d-ce9c23ffc01d None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:51.485263 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-a5a94d64-3fe3-40a5-a3e3-6d17b4460802 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:51.485263 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:51.485263 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:51.485263 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:51.485263 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:51.485263 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:51.485263 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:51.485263 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:51.485263 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:51.485263 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:51.485263 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:51.485263 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:51.485263 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:51.485263 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:51.485263 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:51.486323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:51.486323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:51.486323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:51.486323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:51.486323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:51.486323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:51.486323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:51.486323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:51.486323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:51.486323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:51.486323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:51.486323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:51.486323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:51.486323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:51.486323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:51.486323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:51.486323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:51.487384 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:51.487384 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:51.487384 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:51.487384 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:51.493688 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 332/679] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:51.495188 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a94d64-3fe3-40a5-a3e3-6d17b4460802 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:51.619453 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5498952-9e2d-4209-a55d-ce9c23ffc01d None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:51.663378 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1172f15-f024-47e2-8c9c-55fc9b88632c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:51.664421 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1172f15-f024-47e2-8c9c-55fc9b88632c None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:51.665110 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1172f15-f024-47e2-8c9c-55fc9b88632c None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:51.665651 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1172f15-f024-47e2-8c9c-55fc9b88632c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:51.667077 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1172f15-f024-47e2-8c9c-55fc9b88632c None admin] RBAC: Adding query filter params (role.id=7d8a1698372145a59d70d67ed7867f56, scope.project.id=eb2de9bea1cf451db5f8c697f480c480, user.id=42dc38d6c3634b7496b1b7e99ca3f647) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:51.667623 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1172f15-f024-47e2-8c9c-55fc9b88632c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:51.669300 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1172f15-f024-47e2-8c9c-55fc9b88632c None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:51.685798 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 348/680] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:19:51 2022] GET /identity/v3/role_assignments?user.id=42dc38d6c3634b7496b1b7e99ca3f647&scope.project.id=eb2de9bea1cf451db5f8c697f480c480&role.id=7d8a1698372145a59d70d67ed7867f56 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:51.687147 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1172f15-f024-47e2-8c9c-55fc9b88632c None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:51.717951 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a94d64-3fe3-40a5-a3e3-6d17b4460802 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:51.850088 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81d931-7fa9-4764-addb-8ead41f37263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:51.851243 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81d931-7fa9-4764-addb-8ead41f37263 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:51.851777 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81d931-7fa9-4764-addb-8ead41f37263 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:51.852271 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81d931-7fa9-4764-addb-8ead41f37263 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:51.961543 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1172f15-f024-47e2-8c9c-55fc9b88632c None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:52.005143 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81d931-7fa9-4764-addb-8ead41f37263 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:52.007426 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81d931-7fa9-4764-addb-8ead41f37263 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:52.036269 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62e0d5-9b69-492a-98c1-7cf43a2e5993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:52.037466 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62e0d5-9b69-492a-98c1-7cf43a2e5993 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:52.038520 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62e0d5-9b69-492a-98c1-7cf43a2e5993 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:52.039024 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62e0d5-9b69-492a-98c1-7cf43a2e5993 None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:52.040470 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62e0d5-9b69-492a-98c1-7cf43a2e5993 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:52.041013 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62e0d5-9b69-492a-98c1-7cf43a2e5993 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:52.044852 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62e0d5-9b69-492a-98c1-7cf43a2e5993 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:52.080103 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 349/681] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:52.088640 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62e0d5-9b69-492a-98c1-7cf43a2e5993 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:52.168654 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 333/682] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:19:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:19:52.177217 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81d931-7fa9-4764-addb-8ead41f37263 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:52.289685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62e0d5-9b69-492a-98c1-7cf43a2e5993 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:52.352346 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a5931-4a99-436f-98cc-3275d7681a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:52.354803 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a5931-4a99-436f-98cc-3275d7681a1d None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:52.355305 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a5931-4a99-436f-98cc-3275d7681a1d None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:52.355943 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a5931-4a99-436f-98cc-3275d7681a1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:52.369151 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a5931-4a99-436f-98cc-3275d7681a1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:52.371735 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a5931-4a99-436f-98cc-3275d7681a1d None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:52.387832 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81d931-7fa9-4764-addb-8ead41f37263 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:52.400594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-610a5931-4a99-436f-98cc-3275d7681a1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:52.400594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:52.400594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:52.400594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:52.400594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:52.400594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:52.400594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:52.400594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:52.400594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:52.400594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:52.400594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:52.400594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:52.400594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:19:52.400594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:19:52.400594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:19:52.402174 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:19:52.402174 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:52.402174 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:52.402174 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:52.402174 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:52.402174 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:52.402174 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:52.402174 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:52.402174 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:52.402174 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:52.402174 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:52.402174 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:52.402174 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:52.402174 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:52.402174 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:52.402174 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:52.402174 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:52.403246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:19:52.403246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:19:52.403246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:19:52.403246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:19:52.403246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:19:52.403246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:19:52.403246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:52.403246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:52.403246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 350/683] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:19:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:52.417509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a5931-4a99-436f-98cc-3275d7681a1d None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:52.462530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0a964-2890-4bb3-85f3-56b8af812cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:52.463963 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0a964-2890-4bb3-85f3-56b8af812cd8 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:52.464519 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0a964-2890-4bb3-85f3-56b8af812cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:52.465047 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0a964-2890-4bb3-85f3-56b8af812cd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:52.484600 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0a964-2890-4bb3-85f3-56b8af812cd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:52.487372 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0a964-2890-4bb3-85f3-56b8af812cd8 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:52.523276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-32b0a964-2890-4bb3-85f3-56b8af812cd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:52.523276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:52.523276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:52.523276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:52.523276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:52.523276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:52.523276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:52.523276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:52.523276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:52.523276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:52.523276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:52.523276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:52.523276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:52.523276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:52.523276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:52.525665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:52.525665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:52.525665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:52.525665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:52.525665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:52.525665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:52.525665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:52.525665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:52.525665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:52.525665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:52.525665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:52.525665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:52.525665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:52.525665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:52.525665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:52.525665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:52.525665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:52.528004 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:52.528004 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:52.528004 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:52.528004 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:52.528004 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 334/684] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:19:52.546419 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0a964-2890-4bb3-85f3-56b8af812cd8 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:52.620412 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a5931-4a99-436f-98cc-3275d7681a1d None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:52.679708 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd07f3-921f-4754-bd4d-dd8c5ff01a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:52.680756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd07f3-921f-4754-bd4d-dd8c5ff01a2f None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:52.681206 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd07f3-921f-4754-bd4d-dd8c5ff01a2f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:52.681777 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd07f3-921f-4754-bd4d-dd8c5ff01a2f None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:52.683256 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd07f3-921f-4754-bd4d-dd8c5ff01a2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:52.683767 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd07f3-921f-4754-bd4d-dd8c5ff01a2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:52.686369 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedd07f3-921f-4754-bd4d-dd8c5ff01a2f None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:52.710509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 351/685] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:19:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:52.712865 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a85c5-2f02-4d9f-b8d3-a8abfd436438 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:52.713328 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a85c5-2f02-4d9f-b8d3-a8abfd436438 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:52.713832 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a85c5-2f02-4d9f-b8d3-a8abfd436438 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:52.716681 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 352/686] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:52.718061 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a85c5-2f02-4d9f-b8d3-a8abfd436438 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:52.729186 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0a964-2890-4bb3-85f3-56b8af812cd8 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:52.790661 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7a8eb-502e-429e-97af-59292753fad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:52.791719 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7a8eb-502e-429e-97af-59292753fad7 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:52.792176 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7a8eb-502e-429e-97af-59292753fad7 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:52.792619 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7a8eb-502e-429e-97af-59292753fad7 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:52.793808 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7a8eb-502e-429e-97af-59292753fad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:52.794277 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7a8eb-502e-429e-97af-59292753fad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:52.796228 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7a8eb-502e-429e-97af-59292753fad7 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:52.811180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 335/687] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:52.812485 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbfd2d-55d6-457d-804a-e045dbeb452c None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:52.812757 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbfd2d-55d6-457d-804a-e045dbeb452c None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:52.813028 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbfd2d-55d6-457d-804a-e045dbeb452c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:52.832036 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-80bbfd2d-55d6-457d-804a-e045dbeb452c None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:52.833925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-80bbfd2d-55d6-457d-804a-e045dbeb452c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:52.868860 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a85c5-2f02-4d9f-b8d3-a8abfd436438 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:52.903577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a826c-6804-4f9f-85e6-72096e6a9f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:52.904241 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a826c-6804-4f9f-85e6-72096e6a9f8d None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:52.904524 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a826c-6804-4f9f-85e6-72096e6a9f8d None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:52.904796 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a826c-6804-4f9f-85e6-72096e6a9f8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:52.905675 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a826c-6804-4f9f-85e6-72096e6a9f8d None admin] RBAC: Adding query filter params (role.id=7d8a1698372145a59d70d67ed7867f56, scope.project.id=eb2de9bea1cf451db5f8c697f480c480, user.id=e9433a0b92c34247b4e539b96dc4d581) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:52.906005 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a826c-6804-4f9f-85e6-72096e6a9f8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:52.907410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a826c-6804-4f9f-85e6-72096e6a9f8d None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:52.921185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 353/688] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:19:52 2022] GET /identity/v3/role_assignments?user.id=e9433a0b92c34247b4e539b96dc4d581&scope.project.id=eb2de9bea1cf451db5f8c697f480c480&role.id=7d8a1698372145a59d70d67ed7867f56 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:52.921185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2cc6e-cb28-4dab-9a19-2f341f0f82d9 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:52.921185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2cc6e-cb28-4dab-9a19-2f341f0f82d9 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:52.921185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2cc6e-cb28-4dab-9a19-2f341f0f82d9 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:52.921185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 354/689] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:52.921185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2cc6e-cb28-4dab-9a19-2f341f0f82d9 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:52.957543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 336/690] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:52.961571 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e82a3f-e214-40c1-a35d-d1c530da5f1e None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:52.962274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e82a3f-e214-40c1-a35d-d1c530da5f1e None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:52.962793 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e82a3f-e214-40c1-a35d-d1c530da5f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:52.996151 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-d1e82a3f-e214-40c1-a35d-d1c530da5f1e None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:52.997546 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-d1e82a3f-e214-40c1-a35d-d1c530da5f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:53.088516 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2cc6e-cb28-4dab-9a19-2f341f0f82d9 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:53.141028 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 337/691] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:53.142760 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e82a3f-e214-40c1-a35d-d1c530da5f1e None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:53.157445 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca443c-9870-4dde-aeda-bc0f9c811079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:53.157445 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca443c-9870-4dde-aeda-bc0f9c811079 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:53.157784 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca443c-9870-4dde-aeda-bc0f9c811079 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:53.158087 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca443c-9870-4dde-aeda-bc0f9c811079 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:53.170225 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca443c-9870-4dde-aeda-bc0f9c811079 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:53.172685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca443c-9870-4dde-aeda-bc0f9c811079 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:53.197185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-c6ca443c-9870-4dde-aeda-bc0f9c811079 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:53.197185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:53.197185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:53.197185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:53.197185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:53.197185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:53.197185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:53.197185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:53.197185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:53.197185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:53.197185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:53.197185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:53.197185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:19:53.197185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:19:53.197185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:19:53.198329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:19:53.198329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:53.198329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:53.198329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:53.198329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:53.198329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:53.198329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:53.198329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:53.198329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:53.198329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:53.198329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:53.198329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:53.198329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:53.198329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:53.198329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:53.198329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:53.198329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:53.199338 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:19:53.199338 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:19:53.199338 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:19:53.199338 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:19:53.199338 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:19:53.199338 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:19:53.199338 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:53.199338 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:53.202137 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 355/692] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:19:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:53.203390 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca443c-9870-4dde-aeda-bc0f9c811079 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:53.292274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e82a3f-e214-40c1-a35d-d1c530da5f1e None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:53.358867 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca443c-9870-4dde-aeda-bc0f9c811079 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:53.368607 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b5b49-5348-4bdd-8290-ce1c5de6d0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:53.370191 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b5b49-5348-4bdd-8290-ce1c5de6d0d8 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:53.370503 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b5b49-5348-4bdd-8290-ce1c5de6d0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:53.370813 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b5b49-5348-4bdd-8290-ce1c5de6d0d8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:53.371576 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b5b49-5348-4bdd-8290-ce1c5de6d0d8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:53.372986 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b5b49-5348-4bdd-8290-ce1c5de6d0d8 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:53.392701 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-288b5b49-5348-4bdd-8290-ce1c5de6d0d8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:19:53.392701 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:53.392701 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:19:53.392701 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:19:53.392701 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:19:53.392701 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:19:53.392701 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:19:53.392701 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:19:53.392701 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:19:53.392701 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:53.392701 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:19:53.392701 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:53.392701 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:53.392701 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:53.392701 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:53.392701 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:53.394323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:53.394323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:53.394323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:53.394323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:53.394323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:53.394323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:53.394323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:53.394323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:19:53.394323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:19:53.394323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:19:53.394323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:19:53.394323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:53.394323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:53.394323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:53.394323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:53.394323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:53.396224 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:53.396224 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:53.396224 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:53.396224 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:53.396224 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:53.396224 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:53.396224 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:53.396224 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:53.396224 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:53.396224 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:53.396224 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:53.396224 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:19:53.396224 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:19:53.396224 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:19:53.396224 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:53.399244 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 338/693] 10.222.0.48 () {56 vars in 1129 bytes} [Mon May 9 15:19:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:53.400495 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b5b49-5348-4bdd-8290-ce1c5de6d0d8 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:53.413483 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465086fc-c74e-47a9-a279-fd1b20709e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:53.414297 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465086fc-c74e-47a9-a279-fd1b20709e0f None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:53.414588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465086fc-c74e-47a9-a279-fd1b20709e0f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:53.414879 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465086fc-c74e-47a9-a279-fd1b20709e0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:53.428941 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465086fc-c74e-47a9-a279-fd1b20709e0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:53.430933 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465086fc-c74e-47a9-a279-fd1b20709e0f None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:53.454052 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-465086fc-c74e-47a9-a279-fd1b20709e0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:53.454052 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:53.454052 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:53.454052 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:53.454052 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:53.454052 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:53.454052 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:53.454052 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:53.454052 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:53.454052 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:53.454052 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:53.454052 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:53.454052 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:53.454052 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:53.454052 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:53.455150 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:53.455150 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:53.455150 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:53.455150 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:53.455150 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:53.455150 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:53.455150 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:53.455150 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:53.455150 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:53.455150 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:53.455150 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:53.455150 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:53.455150 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:53.455150 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:53.455150 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:53.455150 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:53.455150 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:53.456174 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:53.456174 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:53.456174 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:53.456174 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:53.458317 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 356/694] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:53.459959 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465086fc-c74e-47a9-a279-fd1b20709e0f None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:53.527249 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b5b49-5348-4bdd-8290-ce1c5de6d0d8 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:53.573751 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf02ea-ddd7-4558-a474-07fd6c55270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:53.574574 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf02ea-ddd7-4558-a474-07fd6c55270d None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:53.574875 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf02ea-ddd7-4558-a474-07fd6c55270d None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:53.575173 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf02ea-ddd7-4558-a474-07fd6c55270d None admin] PATH_INFO: `/v3/projects` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:53.576245 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf02ea-ddd7-4558-a474-07fd6c55270d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:53.576580 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf02ea-ddd7-4558-a474-07fd6c55270d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:53.578451 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf02ea-ddd7-4558-a474-07fd6c55270d None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:53.592948 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 339/695] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:19:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:53.593964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf02ea-ddd7-4558-a474-07fd6c55270d None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:53.603004 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465086fc-c74e-47a9-a279-fd1b20709e0f None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:53.655667 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7117bf-70c0-4c16-ab81-4b84169203ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:53.656714 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7117bf-70c0-4c16-ab81-4b84169203ce None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:53.657735 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7117bf-70c0-4c16-ab81-4b84169203ce None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:53.658245 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7117bf-70c0-4c16-ab81-4b84169203ce None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:53.659433 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7117bf-70c0-4c16-ab81-4b84169203ce None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:53.660107 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7117bf-70c0-4c16-ab81-4b84169203ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:53.662503 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7117bf-70c0-4c16-ab81-4b84169203ce None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:53.674352 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 357/696] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 9 15:19:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:53.674979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7117bf-70c0-4c16-ab81-4b84169203ce None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:53.750221 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf02ea-ddd7-4558-a474-07fd6c55270d None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:53.799293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17f648-ddfd-4d06-86bd-9dd7d5b2f50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:53.800124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17f648-ddfd-4d06-86bd-9dd7d5b2f50f None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:53.800415 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17f648-ddfd-4d06-86bd-9dd7d5b2f50f None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:53.800697 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17f648-ddfd-4d06-86bd-9dd7d5b2f50f None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:53.802211 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17f648-ddfd-4d06-86bd-9dd7d5b2f50f None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:53.802797 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17f648-ddfd-4d06-86bd-9dd7d5b2f50f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:53.804645 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17f648-ddfd-4d06-86bd-9dd7d5b2f50f None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:53.809740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7117bf-70c0-4c16-ab81-4b84169203ce None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:53.820809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 340/697] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:53.822505 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17f648-ddfd-4d06-86bd-9dd7d5b2f50f None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:53.859882 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294ab77-0cbb-4e67-8276-4f2f2642bc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:53.860597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294ab77-0cbb-4e67-8276-4f2f2642bc9d None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:53.860938 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294ab77-0cbb-4e67-8276-4f2f2642bc9d None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:53.861361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294ab77-0cbb-4e67-8276-4f2f2642bc9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:53.862315 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294ab77-0cbb-4e67-8276-4f2f2642bc9d None admin] RBAC: Adding query filter params (role.id=7d8a1698372145a59d70d67ed7867f56, scope.project.id=eb2de9bea1cf451db5f8c697f480c480, user.id=dda2a8271a764e65bb97e316410b91b1) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:53.862768 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294ab77-0cbb-4e67-8276-4f2f2642bc9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:53.866029 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294ab77-0cbb-4e67-8276-4f2f2642bc9d None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:53.875025 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 358/698] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:19:53 2022] GET /identity/v3/role_assignments?user.id=dda2a8271a764e65bb97e316410b91b1&scope.project.id=eb2de9bea1cf451db5f8c697f480c480&role.id=7d8a1698372145a59d70d67ed7867f56 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:53.876477 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294ab77-0cbb-4e67-8276-4f2f2642bc9d None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:54.024661 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294ab77-0cbb-4e67-8276-4f2f2642bc9d None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:54.076051 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b869109-0eef-4560-a642-3505b028711b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:54.076773 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b869109-0eef-4560-a642-3505b028711b None admin] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:54.077096 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b869109-0eef-4560-a642-3505b028711b None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:54.077546 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b869109-0eef-4560-a642-3505b028711b None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:54.078305 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b869109-0eef-4560-a642-3505b028711b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:54.080543 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b869109-0eef-4560-a642-3505b028711b None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:54.117090 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 359/699] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:19:53 2022] POST /identity/v3/users => generated 254 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:19:54.132466 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17f648-ddfd-4d06-86bd-9dd7d5b2f50f None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:54.200080 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac796a-8cfb-4576-a83d-d5d2ac3148fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:54.200794 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac796a-8cfb-4576-a83d-d5d2ac3148fe None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:54.201082 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac796a-8cfb-4576-a83d-d5d2ac3148fe None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:54.201362 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac796a-8cfb-4576-a83d-d5d2ac3148fe None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:54.202238 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac796a-8cfb-4576-a83d-d5d2ac3148fe None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:54.202684 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac796a-8cfb-4576-a83d-d5d2ac3148fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:54.204086 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac796a-8cfb-4576-a83d-d5d2ac3148fe None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:54.213190 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 341/700] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 9 15:19:53 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:55.404799 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d382fa-e4d4-4576-8930-4abdf395f6bc None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:55.405480 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d382fa-e4d4-4576-8930-4abdf395f6bc None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:55.405480 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d382fa-e4d4-4576-8930-4abdf395f6bc None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:55.407029 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 360/701] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:55.413278 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27732d80-912e-47c9-acbe-2f215af079ac None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:55.413884 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27732d80-912e-47c9-acbe-2f215af079ac None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:55.413884 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27732d80-912e-47c9-acbe-2f215af079ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:55.440698 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-27732d80-912e-47c9-acbe-2f215af079ac None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:55.442885 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-27732d80-912e-47c9-acbe-2f215af079ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:55.580326 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 342/702] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:19:55.630397 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d382fa-e4d4-4576-8930-4abdf395f6bc None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:55.840207 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d382fa-e4d4-4576-8930-4abdf395f6bc None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:55.915114 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb329c97-0dd8-4d33-8289-5321b1872c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:55.916345 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb329c97-0dd8-4d33-8289-5321b1872c0b None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:55.916854 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb329c97-0dd8-4d33-8289-5321b1872c0b None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:55.917350 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb329c97-0dd8-4d33-8289-5321b1872c0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:55.945781 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb329c97-0dd8-4d33-8289-5321b1872c0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:55.959126 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-cb329c97-0dd8-4d33-8289-5321b1872c0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:19:55.959126 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:55.959126 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:55.959126 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:55.959126 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:55.959126 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:55.959126 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:55.959126 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:55.959126 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:55.959126 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:55.959126 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:55.959126 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:55.959126 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:55.959126 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:55.959126 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:55.959126 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:55.960318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:55.960318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:55.960318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:55.960318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:55.960318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:55.960318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:55.960318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:55.960318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:55.960318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:55.960318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:55.960318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:55.960318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:55.960318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:55.960318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:55.960318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:55.960318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:55.961280 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:55.961280 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:55.961280 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:55.961280 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:55.961280 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:55.961280 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:55.961280 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:55.961280 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:55.961280 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:55.961280 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:55.961280 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:19:55.961280 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:55.961280 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 361/703] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:19:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:55.968746 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27732d80-912e-47c9-acbe-2f215af079ac None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:56.015349 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab235b-7899-4a91-8f2f-17450fad593e None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:56.015698 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab235b-7899-4a91-8f2f-17450fad593e None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:56.015904 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab235b-7899-4a91-8f2f-17450fad593e None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:56.017629 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 362/704] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:19:56.025026 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4740e-13eb-4cd4-9319-dde040a68fe8 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:56.025310 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4740e-13eb-4cd4-9319-dde040a68fe8 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:56.025611 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4740e-13eb-4cd4-9319-dde040a68fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:56.056270 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-31f4740e-13eb-4cd4-9319-dde040a68fe8 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:56.059747 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-31f4740e-13eb-4cd4-9319-dde040a68fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:56.213818 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 363/705] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:56.240135 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27732d80-912e-47c9-acbe-2f215af079ac None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:56.243154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4740e-13eb-4cd4-9319-dde040a68fe8 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:56.320191 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009594e-8974-4bef-bf61-091e884c9685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:56.321329 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009594e-8974-4bef-bf61-091e884c9685 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:56.321873 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009594e-8974-4bef-bf61-091e884c9685 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:56.322394 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009594e-8974-4bef-bf61-091e884c9685 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:56.323409 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009594e-8974-4bef-bf61-091e884c9685 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:56.323944 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009594e-8974-4bef-bf61-091e884c9685 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:56.325636 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009594e-8974-4bef-bf61-091e884c9685 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:56.345425 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 343/706] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:19:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:56.353753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009594e-8974-4bef-bf61-091e884c9685 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:56.387270 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4740e-13eb-4cd4-9319-dde040a68fe8 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:56.432002 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d044eca-6f32-4fba-acc9-98f80beacbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:56.432941 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d044eca-6f32-4fba-acc9-98f80beacbd0 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:56.433249 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d044eca-6f32-4fba-acc9-98f80beacbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:56.433594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d044eca-6f32-4fba-acc9-98f80beacbd0 None admin] PATH_INFO: `/v3/services/network` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:56.434545 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d044eca-6f32-4fba-acc9-98f80beacbd0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:56.436196 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d044eca-6f32-4fba-acc9-98f80beacbd0 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:56.454956 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-0d044eca-6f32-4fba-acc9-98f80beacbd0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:19:56.454956 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:56.454956 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:19:56.454956 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:19:56.454956 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:19:56.454956 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:19:56.454956 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:19:56.454956 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:19:56.454956 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:19:56.454956 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:56.454956 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:19:56.454956 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:56.454956 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:56.454956 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:56.454956 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:56.454956 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:56.454956 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:56.456271 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:56.456271 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:56.456271 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:56.456271 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:56.456271 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:56.456271 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:56.456271 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:19:56.456271 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:19:56.456271 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:19:56.456271 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:19:56.456271 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:56.456271 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:56.456271 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:56.456271 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:56.456271 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:56.456271 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:56.458108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:56.458108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:56.458108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:56.458108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:56.458108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:56.458108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:56.458108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:56.458108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:56.458108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:56.458108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:56.458108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:19:56.458108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:19:56.458108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:19:56.458108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:56.461558 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 364/707] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:19:56 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:56.465205 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d044eca-6f32-4fba-acc9-98f80beacbd0 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:56.606689 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d044eca-6f32-4fba-acc9-98f80beacbd0 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:56.647867 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009594e-8974-4bef-bf61-091e884c9685 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:56.674357 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555dcda-f276-4f48-ba70-01fbb16221c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:56.675283 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555dcda-f276-4f48-ba70-01fbb16221c1 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:56.675578 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555dcda-f276-4f48-ba70-01fbb16221c1 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:56.675858 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555dcda-f276-4f48-ba70-01fbb16221c1 None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:56.677399 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555dcda-f276-4f48-ba70-01fbb16221c1 None admin] RBAC: Adding query filter params (name=network) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:56.677802 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555dcda-f276-4f48-ba70-01fbb16221c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:56.679625 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555dcda-f276-4f48-ba70-01fbb16221c1 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:56.690303 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 365/708] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:19:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:56.693865 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555dcda-f276-4f48-ba70-01fbb16221c1 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:56.758521 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f24aa-b7ef-4eab-b1b6-ffcc185ecd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:56.759263 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f24aa-b7ef-4eab-b1b6-ffcc185ecd23 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:56.759552 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f24aa-b7ef-4eab-b1b6-ffcc185ecd23 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:56.759835 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f24aa-b7ef-4eab-b1b6-ffcc185ecd23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:56.772434 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f24aa-b7ef-4eab-b1b6-ffcc185ecd23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:56.774008 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f24aa-b7ef-4eab-b1b6-ffcc185ecd23 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:56.792944 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-f82f24aa-b7ef-4eab-b1b6-ffcc185ecd23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:56.792944 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:56.792944 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:56.792944 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:56.792944 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:56.792944 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:56.792944 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:56.792944 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:56.792944 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:56.792944 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:56.792944 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:56.792944 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:56.792944 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:56.792944 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:56.792944 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:56.795389 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:56.795389 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:56.795389 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:56.795389 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:56.795389 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:56.795389 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:56.795389 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:56.795389 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:56.795389 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:56.795389 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:56.795389 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:56.795389 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:56.795389 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:56.795389 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:56.795389 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:56.795389 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:56.795389 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:56.797908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:56.797908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:56.797908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:56.797908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:56.797908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 344/709] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 441 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:19:56.801586 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f24aa-b7ef-4eab-b1b6-ffcc185ecd23 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:56.878443 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555dcda-f276-4f48-ba70-01fbb16221c1 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:56.946415 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb056be5-025d-4b8f-be45-a7a9812d878b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:56.947122 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb056be5-025d-4b8f-be45-a7a9812d878b None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:56.947481 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb056be5-025d-4b8f-be45-a7a9812d878b None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:56.947762 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb056be5-025d-4b8f-be45-a7a9812d878b None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:56.948573 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb056be5-025d-4b8f-be45-a7a9812d878b None admin] RBAC: Adding query filter params (type=network) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:56.948891 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb056be5-025d-4b8f-be45-a7a9812d878b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:56.950387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb056be5-025d-4b8f-be45-a7a9812d878b None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:56.957957 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 366/710] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:19:56 2022] GET /identity/v3/services?type=network => generated 124 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:57.009930 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f24aa-b7ef-4eab-b1b6-ffcc185ecd23 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:57.069980 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3694173-9e81-465a-8e04-7d9637ab16a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:57.070746 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3694173-9e81-465a-8e04-7d9637ab16a0 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:57.071032 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3694173-9e81-465a-8e04-7d9637ab16a0 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:57.071320 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3694173-9e81-465a-8e04-7d9637ab16a0 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:57.072072 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3694173-9e81-465a-8e04-7d9637ab16a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:57.072378 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3694173-9e81-465a-8e04-7d9637ab16a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:57.073996 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3694173-9e81-465a-8e04-7d9637ab16a0 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:57.089863 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 345/711] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:19:57.095608 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb056be5-025d-4b8f-be45-a7a9812d878b None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:57.288148 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a727ca-74fb-461a-b7ab-89b81e76a408 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:57.289939 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a727ca-74fb-461a-b7ab-89b81e76a408 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:57.290963 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a727ca-74fb-461a-b7ab-89b81e76a408 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:57.293857 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb056be5-025d-4b8f-be45-a7a9812d878b None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:57.295613 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 346/712] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:19:57.301148 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbcd0c-4334-4dff-a200-5b59c6c643cc None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:57.301644 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbcd0c-4334-4dff-a200-5b59c6c643cc None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:57.302020 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbcd0c-4334-4dff-a200-5b59c6c643cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:57.338535 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-8cfbcd0c-4334-4dff-a200-5b59c6c643cc None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:57.339858 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-8cfbcd0c-4334-4dff-a200-5b59c6c643cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:57.346909 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852f6a7-243d-4cfa-958a-eae2bffefb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:57.348857 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852f6a7-243d-4cfa-958a-eae2bffefb02 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:57.349395 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852f6a7-243d-4cfa-958a-eae2bffefb02 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:57.349986 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852f6a7-243d-4cfa-958a-eae2bffefb02 None admin] PATH_INFO: `/v3/users/nova` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:57.363922 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1852f6a7-243d-4cfa-958a-eae2bffefb02 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:57.367144 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1852f6a7-243d-4cfa-958a-eae2bffefb02 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:57.391112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-1852f6a7-243d-4cfa-958a-eae2bffefb02 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:19:57.391112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:57.391112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:57.391112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:57.391112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:57.391112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:57.391112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:57.391112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:57.391112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:57.391112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:57.391112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:57.391112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:57.391112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:19:57.391112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:19:57.391112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:19:57.391112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:19:57.392361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:57.392361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:57.392361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:19:57.392361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:57.392361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:19:57.392361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:57.392361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:57.392361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:57.392361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:57.392361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:57.392361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:57.392361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:57.392361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:57.392361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:57.392361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:57.392361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:57.392361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:57.392361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:57.394097 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:57.394097 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:57.394097 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:19:57.394097 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:19:57.394097 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:19:57.394097 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:19:57.394097 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:19:57.394097 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:19:57.394097 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:19:57.394097 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:57.394097 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 367/713] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:19:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:57.402782 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852f6a7-243d-4cfa-958a-eae2bffefb02 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:57.499326 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 347/714] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:57.522517 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852f6a7-243d-4cfa-958a-eae2bffefb02 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:57.560552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d79b84-a885-4f55-81ee-ee72d1a728a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:57.561329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d79b84-a885-4f55-81ee-ee72d1a728a8 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:57.561688 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d79b84-a885-4f55-81ee-ee72d1a728a8 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:57.561975 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d79b84-a885-4f55-81ee-ee72d1a728a8 None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:57.562845 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d79b84-a885-4f55-81ee-ee72d1a728a8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:57.563160 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d79b84-a885-4f55-81ee-ee72d1a728a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:57.563518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbcd0c-4334-4dff-a200-5b59c6c643cc None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:57.564631 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d79b84-a885-4f55-81ee-ee72d1a728a8 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:57.588055 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 368/715] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:19:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:57.594396 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d79b84-a885-4f55-81ee-ee72d1a728a8 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:57.722409 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d79b84-a885-4f55-81ee-ee72d1a728a8 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:57.767300 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593a0eb-6805-4d9b-b696-1f532be7d2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:57.767977 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593a0eb-6805-4d9b-b696-1f532be7d2e7 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:57.768329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593a0eb-6805-4d9b-b696-1f532be7d2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:57.768605 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593a0eb-6805-4d9b-b696-1f532be7d2e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:57.791787 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbcd0c-4334-4dff-a200-5b59c6c643cc None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:57.836234 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7039724-4d3b-4ba1-aef7-3a5b566cfa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:57.836959 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7039724-4d3b-4ba1-aef7-3a5b566cfa33 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:57.837241 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7039724-4d3b-4ba1-aef7-3a5b566cfa33 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:57.837549 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7039724-4d3b-4ba1-aef7-3a5b566cfa33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:57.853347 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7039724-4d3b-4ba1-aef7-3a5b566cfa33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:57.868783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-c7039724-4d3b-4ba1-aef7-3a5b566cfa33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:19:57.868783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:57.868783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:57.868783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:57.868783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:57.868783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:57.868783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:57.868783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:57.868783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:57.868783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:57.868783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:57.868783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:57.868783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:57.868783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:57.868783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:57.868783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:57.870015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:57.870015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:57.870015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:57.870015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:57.870015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:57.870015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:57.870015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:57.870015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:57.870015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:57.870015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:57.870015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:57.870015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:57.870015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:57.870015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:57.870015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:57.870015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:57.870976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:57.870976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:57.870976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:57.870976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:57.870976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:57.870976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:57.870976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:57.870976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:57.870976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:57.870976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:57.870976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:19:57.870976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:57.870976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 348/716] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:19:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:57.872368 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec7350-2a3d-48ba-8fe6-bc2ecc667ca6 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:57.872368 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec7350-2a3d-48ba-8fe6-bc2ecc667ca6 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:57.872368 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec7350-2a3d-48ba-8fe6-bc2ecc667ca6 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:57.878333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 349/717] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:57.878333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247360e-34f3-43bf-aafc-5da9e33f463d None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:57.878333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247360e-34f3-43bf-aafc-5da9e33f463d None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:57.878333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247360e-34f3-43bf-aafc-5da9e33f463d None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:57.878333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 350/718] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:19:57.880695 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247360e-34f3-43bf-aafc-5da9e33f463d None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:57.915221 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593a0eb-6805-4d9b-b696-1f532be7d2e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:57.917903 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593a0eb-6805-4d9b-b696-1f532be7d2e7 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:58.011390 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247360e-34f3-43bf-aafc-5da9e33f463d None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:58.043720 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 369/719] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:19:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:19:58.045550 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17b581-1236-441a-aa7c-adc43f4455b7 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:58.045904 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17b581-1236-441a-aa7c-adc43f4455b7 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:58.046257 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17b581-1236-441a-aa7c-adc43f4455b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:58.062878 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8264a03-cbe2-486a-a1d3-7cdc5b613535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:58.063984 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8264a03-cbe2-486a-a1d3-7cdc5b613535 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:58.064323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8264a03-cbe2-486a-a1d3-7cdc5b613535 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:58.064600 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-3b17b581-1236-441a-aa7c-adc43f4455b7 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:58.064717 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8264a03-cbe2-486a-a1d3-7cdc5b613535 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:58.065716 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8264a03-cbe2-486a-a1d3-7cdc5b613535 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:58.065864 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-3b17b581-1236-441a-aa7c-adc43f4455b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:58.066083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8264a03-cbe2-486a-a1d3-7cdc5b613535 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:58.069088 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8264a03-cbe2-486a-a1d3-7cdc5b613535 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:58.084294 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 351/720] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:19:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:58.084294 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87748dab-e89e-4be3-a80b-e4e9a7e0da68 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:58.084294 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87748dab-e89e-4be3-a80b-e4e9a7e0da68 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:58.084294 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87748dab-e89e-4be3-a80b-e4e9a7e0da68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:58.098987 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-87748dab-e89e-4be3-a80b-e4e9a7e0da68 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:19:58.100096 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-87748dab-e89e-4be3-a80b-e4e9a7e0da68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:19:58.177401 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 370/721] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:58.177401 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17b581-1236-441a-aa7c-adc43f4455b7 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:58.217027 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 352/722] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:19:58.237408 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87748dab-e89e-4be3-a80b-e4e9a7e0da68 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:58.327670 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17b581-1236-441a-aa7c-adc43f4455b7 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:58.376303 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61342fd-4793-4445-8594-13f7438fca7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:58.377250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61342fd-4793-4445-8594-13f7438fca7f None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:58.377926 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61342fd-4793-4445-8594-13f7438fca7f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:58.378299 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61342fd-4793-4445-8594-13f7438fca7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:58.381482 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87748dab-e89e-4be3-a80b-e4e9a7e0da68 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:58.392281 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61342fd-4793-4445-8594-13f7438fca7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:58.393818 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61342fd-4793-4445-8594-13f7438fca7f None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:58.414322 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-b61342fd-4793-4445-8594-13f7438fca7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:58.414322 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:58.414322 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:58.414322 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:58.414322 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:58.414322 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:58.414322 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:58.414322 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:58.414322 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:58.414322 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:58.414322 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:58.414322 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:58.414322 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:58.414322 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:58.414322 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:58.415408 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:58.415408 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:58.415408 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:58.415408 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:58.415408 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:58.415408 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:58.415408 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:58.415408 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:58.415408 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:58.415408 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:58.415408 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:58.415408 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:58.415408 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:58.415408 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:58.415408 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:58.415408 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:58.415408 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:58.417028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:58.417028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:58.417028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:58.417028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:58.417028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 371/723] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:58.417028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61342fd-4793-4445-8594-13f7438fca7f None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:58.442955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba24d0c-8ce7-4b64-a6a5-233e672b9a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:58.443937 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba24d0c-8ce7-4b64-a6a5-233e672b9a76 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:58.444222 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba24d0c-8ce7-4b64-a6a5-233e672b9a76 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:58.444509 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba24d0c-8ce7-4b64-a6a5-233e672b9a76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:58.456050 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba24d0c-8ce7-4b64-a6a5-233e672b9a76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:58.458145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba24d0c-8ce7-4b64-a6a5-233e672b9a76 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:58.477570 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-fba24d0c-8ce7-4b64-a6a5-233e672b9a76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:58.477570 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:58.477570 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:58.477570 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:58.477570 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:58.477570 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:58.477570 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:58.477570 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:58.477570 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:58.477570 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:58.477570 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:58.477570 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:58.477570 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:58.477570 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:58.477570 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:58.479558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:58.479558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:58.479558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:58.479558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:58.479558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:58.479558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:58.479558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:58.479558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:58.479558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:58.479558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:58.479558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:58.479558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:58.479558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:58.479558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:58.479558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:58.479558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:58.479558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:58.482352 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:58.482352 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:58.482352 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:58.482352 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:58.484286 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 353/724] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:58.484900 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba24d0c-8ce7-4b64-a6a5-233e672b9a76 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:58.541934 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61342fd-4793-4445-8594-13f7438fca7f None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:58.594695 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ac5e4-9654-4384-94ca-1f2ef76b00a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:58.595379 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ac5e4-9654-4384-94ca-1f2ef76b00a3 None admin] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:58.595663 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ac5e4-9654-4384-94ca-1f2ef76b00a3 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:58.596011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ac5e4-9654-4384-94ca-1f2ef76b00a3 None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:58.596763 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ac5e4-9654-4384-94ca-1f2ef76b00a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:58.598593 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ac5e4-9654-4384-94ca-1f2ef76b00a3 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:58.617095 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 372/725] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:19:58 2022] POST /identity/v3/services => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:19:58.618017 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ac5e4-9654-4384-94ca-1f2ef76b00a3 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:58.651050 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba24d0c-8ce7-4b64-a6a5-233e672b9a76 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:58.735076 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699795d-b0df-46ae-9f19-99a95c8f7631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:58.736656 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699795d-b0df-46ae-9f19-99a95c8f7631 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:58.737224 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699795d-b0df-46ae-9f19-99a95c8f7631 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:58.737770 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699795d-b0df-46ae-9f19-99a95c8f7631 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:58.751335 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ac5e4-9654-4384-94ca-1f2ef76b00a3 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:58.757946 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699795d-b0df-46ae-9f19-99a95c8f7631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:19:58.771153 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-5699795d-b0df-46ae-9f19-99a95c8f7631 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:58.771153 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:58.771153 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:58.771153 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:58.771153 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:58.771153 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:58.771153 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:58.771153 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:58.771153 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:58.771153 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:58.771153 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:58.771153 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:58.771153 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:19:58.771153 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:19:58.771153 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:19:58.771153 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:19:58.772801 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:19:58.772801 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:19:58.772801 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:19:58.772801 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:19:58.772801 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:58.772801 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:58.772801 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:58.772801 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:58.772801 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:58.772801 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:58.772801 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:58.772801 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:58.772801 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:58.772801 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:58.772801 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:58.772801 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:58.774034 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:58.774034 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:58.774034 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:58.774034 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:58.774034 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:19:58.774034 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:19:58.774034 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:19:58.774034 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:19:58.774034 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:19:58.774034 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:19:58.774034 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:19:58.774034 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:58.777783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 354/726] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:19:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:58.779273 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699795d-b0df-46ae-9f19-99a95c8f7631 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:58.792169 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0a733-3a16-4713-8414-acf6ae6780a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:58.792917 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0a733-3a16-4713-8414-acf6ae6780a8 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:58.793210 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0a733-3a16-4713-8414-acf6ae6780a8 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:58.793588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0a733-3a16-4713-8414-acf6ae6780a8 None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:58.794322 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0a733-3a16-4713-8414-acf6ae6780a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:58.794682 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0a733-3a16-4713-8414-acf6ae6780a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:58.796149 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0a733-3a16-4713-8414-acf6ae6780a8 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:58.812650 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 373/727] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:58.813677 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0a733-3a16-4713-8414-acf6ae6780a8 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:58.954576 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699795d-b0df-46ae-9f19-99a95c8f7631 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:58.983067 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0a733-3a16-4713-8414-acf6ae6780a8 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:59.007501 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d42ce-fefd-447c-bd03-49416503b0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:59.008215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d42ce-fefd-447c-bd03-49416503b0c4 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:59.008612 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d42ce-fefd-447c-bd03-49416503b0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:59.009063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d42ce-fefd-447c-bd03-49416503b0c4 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:59.009969 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d42ce-fefd-447c-bd03-49416503b0c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:59.010506 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d42ce-fefd-447c-bd03-49416503b0c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:59.012793 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d42ce-fefd-447c-bd03-49416503b0c4 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:59.029336 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 355/728] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:59.030558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d42ce-fefd-447c-bd03-49416503b0c4 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:59.041566 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ddf96-431e-43cb-b721-9053f58742b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:59.042508 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ddf96-431e-43cb-b721-9053f58742b5 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:59.042802 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ddf96-431e-43cb-b721-9053f58742b5 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:59.043095 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ddf96-431e-43cb-b721-9053f58742b5 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:59.043901 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ddf96-431e-43cb-b721-9053f58742b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:59.044368 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ddf96-431e-43cb-b721-9053f58742b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:59.046509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ddf96-431e-43cb-b721-9053f58742b5 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:59.061478 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 374/729] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:19:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:59.062934 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ddf96-431e-43cb-b721-9053f58742b5 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:59.183741 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d42ce-fefd-447c-bd03-49416503b0c4 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:59.226226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ddf96-431e-43cb-b721-9053f58742b5 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:59.234021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad28ad7-6329-4056-8c2c-b854ea43f81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:59.235027 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad28ad7-6329-4056-8c2c-b854ea43f81a None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:59.235469 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad28ad7-6329-4056-8c2c-b854ea43f81a None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:59.235963 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad28ad7-6329-4056-8c2c-b854ea43f81a None admin] PATH_INFO: `/v3/projects/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:59.246992 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad28ad7-6329-4056-8c2c-b854ea43f81a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:59.249186 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad28ad7-6329-4056-8c2c-b854ea43f81a None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:59.272921 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9406009-57e5-415e-ae09-f0a47fcb2ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:59.273917 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9406009-57e5-415e-ae09-f0a47fcb2ebb None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:59.274213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9406009-57e5-415e-ae09-f0a47fcb2ebb None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:59.274497 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9406009-57e5-415e-ae09-f0a47fcb2ebb None admin] PATH_INFO: `/v3/users/swift` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:59.277152 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-cad28ad7-6329-4056-8c2c-b854ea43f81a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:59.277152 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:59.277152 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:59.277152 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:59.277152 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:59.277152 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:59.277152 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:59.277152 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:59.277152 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:59.277152 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:59.277152 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:59.277152 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:59.277152 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:19:59.277152 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:19:59.277152 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:19:59.279149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:19:59.279149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:59.279149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:59.279149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:59.279149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:59.279149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:59.279149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:59.279149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:59.279149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:59.279149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:59.279149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:59.279149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:59.279149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:59.279149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:59.279149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:59.279149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:59.279149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:59.281310 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:19:59.281310 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:19:59.281310 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:19:59.281310 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:19:59.281310 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:19:59.281310 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:19:59.281310 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:19:59.281310 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:59.281310 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 356/730] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:19:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:59.281310 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad28ad7-6329-4056-8c2c-b854ea43f81a None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:59.291238 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9406009-57e5-415e-ae09-f0a47fcb2ebb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:59.293657 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9406009-57e5-415e-ae09-f0a47fcb2ebb None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:59.310367 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-b9406009-57e5-415e-ae09-f0a47fcb2ebb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:19:59.310367 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:59.310367 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:59.310367 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:59.310367 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:59.310367 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:59.310367 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:59.310367 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:59.310367 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:59.310367 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:59.310367 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:59.310367 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:59.310367 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:19:59.310367 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:19:59.310367 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:19:59.310367 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:19:59.311907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:59.311907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:59.311907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:19:59.311907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:59.311907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:19:59.311907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:19:59.311907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:59.311907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:59.311907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:59.311907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:59.311907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:59.311907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:19:59.311907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:59.311907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:59.311907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:59.311907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:59.311907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:59.311907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:59.314103 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:59.314103 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:59.314103 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:19:59.314103 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:19:59.314103 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:19:59.314103 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:19:59.314103 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:19:59.314103 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:19:59.314103 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:19:59.314103 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:19:59.315667 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 375/731] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:19:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:59.319883 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9406009-57e5-415e-ae09-f0a47fcb2ebb None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:59.411685 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad28ad7-6329-4056-8c2c-b854ea43f81a None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:59.452214 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9406009-57e5-415e-ae09-f0a47fcb2ebb None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:59.454914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600872e-3f98-4fa0-ac91-d194716a8e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:59.456308 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600872e-3f98-4fa0-ac91-d194716a8e25 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:59.456850 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600872e-3f98-4fa0-ac91-d194716a8e25 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:59.458025 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600872e-3f98-4fa0-ac91-d194716a8e25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:59.471560 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600872e-3f98-4fa0-ac91-d194716a8e25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:59.474185 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600872e-3f98-4fa0-ac91-d194716a8e25 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:59.493302 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8721cf1-38c6-4922-afae-7bfad8d81702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:59.493927 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8721cf1-38c6-4922-afae-7bfad8d81702 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:59.494220 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8721cf1-38c6-4922-afae-7bfad8d81702 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:59.494506 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8721cf1-38c6-4922-afae-7bfad8d81702 None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:59.495326 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8721cf1-38c6-4922-afae-7bfad8d81702 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:59.495644 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8721cf1-38c6-4922-afae-7bfad8d81702 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:59.496865 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-7600872e-3f98-4fa0-ac91-d194716a8e25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:59.496865 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:19:59.496865 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:19:59.496865 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:19:59.496865 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:19:59.496865 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:19:59.496865 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:19:59.496865 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:19:59.496865 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:19:59.496865 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:19:59.496865 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:19:59.496865 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:19:59.496865 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:19:59.496865 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:19:59.496865 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:19:59.497935 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:19:59.497935 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:19:59.497935 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:19:59.497935 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:19:59.497935 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:19:59.497935 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:19:59.497935 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:19:59.497935 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:19:59.497935 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:19:59.497935 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:19:59.497935 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:19:59.497935 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:19:59.497935 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:19:59.497935 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:19:59.497935 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:19:59.497935 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:19:59.497935 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:19:59.499020 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:19:59.499020 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:19:59.499020 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:19:59.499020 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:19:59.499281 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8721cf1-38c6-4922-afae-7bfad8d81702 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:59.501818 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 357/732] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:19:59.503116 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600872e-3f98-4fa0-ac91-d194716a8e25 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:59.522457 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 376/733] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:19:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:59.523456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8721cf1-38c6-4922-afae-7bfad8d81702 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:59.639824 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600872e-3f98-4fa0-ac91-d194716a8e25 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:59.641015 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8721cf1-38c6-4922-afae-7bfad8d81702 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:59.682727 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cf3f6-6379-47e0-9686-18022e8cb6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:59.683533 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cf3f6-6379-47e0-9686-18022e8cb6fe None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:59.683893 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cf3f6-6379-47e0-9686-18022e8cb6fe None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:59.684185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cf3f6-6379-47e0-9686-18022e8cb6fe None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:59.684922 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cf3f6-6379-47e0-9686-18022e8cb6fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:59.685284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cf3f6-6379-47e0-9686-18022e8cb6fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:59.686758 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cf3f6-6379-47e0-9686-18022e8cb6fe None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:59.704893 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 377/734] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:59.705929 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cf3f6-6379-47e0-9686-18022e8cb6fe None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:59.717523 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b4791-8a22-44ca-b875-13d077739dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:59.719462 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b4791-8a22-44ca-b875-13d077739dee None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:59.720471 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b4791-8a22-44ca-b875-13d077739dee None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:59.721472 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b4791-8a22-44ca-b875-13d077739dee None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:59.724419 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b4791-8a22-44ca-b875-13d077739dee None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:59.725648 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b4791-8a22-44ca-b875-13d077739dee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:59.729318 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b4791-8a22-44ca-b875-13d077739dee None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:59.767080 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 358/735] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 9 15:19:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:59.769069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b4791-8a22-44ca-b875-13d077739dee None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:59.824248 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cf3f6-6379-47e0-9686-18022e8cb6fe None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:59.863065 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f8aab-246d-4f4c-ad15-505db5f4a0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:59.864859 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f8aab-246d-4f4c-ad15-505db5f4a0c6 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:59.865305 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f8aab-246d-4f4c-ad15-505db5f4a0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:59.865800 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f8aab-246d-4f4c-ad15-505db5f4a0c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:59.866822 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f8aab-246d-4f4c-ad15-505db5f4a0c6 None admin] RBAC: Adding query filter params (role.id=9aaa841361294b9c9b275ca1be0ed89c, scope.project.id=eb2de9bea1cf451db5f8c697f480c480, user.id=42dc38d6c3634b7496b1b7e99ca3f647) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:19:59.867308 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f8aab-246d-4f4c-ad15-505db5f4a0c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:59.868989 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f8aab-246d-4f4c-ad15-505db5f4a0c6 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:19:59.876581 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 378/736] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:19:59 2022] GET /identity/v3/role_assignments?user.id=42dc38d6c3634b7496b1b7e99ca3f647&scope.project.id=eb2de9bea1cf451db5f8c697f480c480&role.id=9aaa841361294b9c9b275ca1be0ed89c => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:19:59.877536 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f8aab-246d-4f4c-ad15-505db5f4a0c6 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:19:59.915471 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b4791-8a22-44ca-b875-13d077739dee None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:19:59.969844 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2a18e-9cb7-4f60-88c1-b0a171612715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:19:59.972329 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2a18e-9cb7-4f60-88c1-b0a171612715 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:19:59.973197 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2a18e-9cb7-4f60-88c1-b0a171612715 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:19:59.973679 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2a18e-9cb7-4f60-88c1-b0a171612715 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:19:59.984771 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2a18e-9cb7-4f60-88c1-b0a171612715 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:19:59.987033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2a18e-9cb7-4f60-88c1-b0a171612715 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:00.010882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-68c2a18e-9cb7-4f60-88c1-b0a171612715 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:20:00.010882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:00.010882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:00.010882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:00.010882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:00.010882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:00.010882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:00.010882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:00.010882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:00.010882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:00.010882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:00.010882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:00.010882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:20:00.010882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:20:00.010882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:20:00.010882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:20:00.012232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:00.012232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:00.012232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:20:00.012232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:00.012232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:20:00.012232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:00.012232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:00.012232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:00.012232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:00.012232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:00.012232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:00.012232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:00.012232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:00.012232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:00.012232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:00.012232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:00.012232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:00.012232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:00.013814 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:00.013814 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:00.013814 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:20:00.013814 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:20:00.013814 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:20:00.013814 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:20:00.013814 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:20:00.013814 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:20:00.013814 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:20:00.013814 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:00.015575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 359/737] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:19:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:00.017244 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a88cbb-119e-48ab-bbfe-d497099212f8 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:00.017546 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a88cbb-119e-48ab-bbfe-d497099212f8 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:00.017928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a88cbb-119e-48ab-bbfe-d497099212f8 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:00.018802 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f8aab-246d-4f4c-ad15-505db5f4a0c6 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:00.025263 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 360/738] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:00.026384 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a88cbb-119e-48ab-bbfe-d497099212f8 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:00.083007 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570909c4-b284-4295-a9ec-0e1c4eb99e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:00.084135 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570909c4-b284-4295-a9ec-0e1c4eb99e09 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:00.084544 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570909c4-b284-4295-a9ec-0e1c4eb99e09 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:00.084935 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570909c4-b284-4295-a9ec-0e1c4eb99e09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:00.170493 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a88cbb-119e-48ab-bbfe-d497099212f8 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:00.195572 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570909c4-b284-4295-a9ec-0e1c4eb99e09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:00.197257 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570909c4-b284-4295-a9ec-0e1c4eb99e09 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:00.228911 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff296811-9e30-400f-8faa-cf071ac71ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:00.230922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff296811-9e30-400f-8faa-cf071ac71ee5 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:00.231434 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff296811-9e30-400f-8faa-cf071ac71ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:00.231948 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff296811-9e30-400f-8faa-cf071ac71ee5 None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:00.234131 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff296811-9e30-400f-8faa-cf071ac71ee5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:00.234892 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff296811-9e30-400f-8faa-cf071ac71ee5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:00.238016 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff296811-9e30-400f-8faa-cf071ac71ee5 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:00.281960 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 361/739] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 9 15:20:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:00.285181 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf636e-7870-41b6-a2f4-21999f44ac5c None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:00.290039 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf636e-7870-41b6-a2f4-21999f44ac5c None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:00.290627 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf636e-7870-41b6-a2f4-21999f44ac5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:00.318813 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-ecbf636e-7870-41b6-a2f4-21999f44ac5c None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:00.320244 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-ecbf636e-7870-41b6-a2f4-21999f44ac5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:00.378890 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 379/740] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:19:59 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:20:00.380578 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570909c4-b284-4295-a9ec-0e1c4eb99e09 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:00.451228 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 362/741] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:20:00.452552 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf636e-7870-41b6-a2f4-21999f44ac5c None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:00.543165 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570909c4-b284-4295-a9ec-0e1c4eb99e09 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:00.607896 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765736a3-ba16-4f3e-a973-1b42c8a9086c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:00.609042 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765736a3-ba16-4f3e-a973-1b42c8a9086c None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:00.609934 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765736a3-ba16-4f3e-a973-1b42c8a9086c None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:00.610423 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765736a3-ba16-4f3e-a973-1b42c8a9086c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:00.667932 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf636e-7870-41b6-a2f4-21999f44ac5c None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:00.718074 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765736a3-ba16-4f3e-a973-1b42c8a9086c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:00.720131 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765736a3-ba16-4f3e-a973-1b42c8a9086c None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:00.729074 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca16c76-394e-4a8a-8b8d-425df1a0e9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:00.731283 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca16c76-394e-4a8a-8b8d-425df1a0e9ce None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:00.731823 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca16c76-394e-4a8a-8b8d-425df1a0e9ce None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:00.733176 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca16c76-394e-4a8a-8b8d-425df1a0e9ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:00.762228 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca16c76-394e-4a8a-8b8d-425df1a0e9ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:00.763722 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca16c76-394e-4a8a-8b8d-425df1a0e9ce None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:00.796097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-bca16c76-394e-4a8a-8b8d-425df1a0e9ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:00.796097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:00.796097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:00.796097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:00.796097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:00.796097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:00.796097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:00.796097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:00.796097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:00.796097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:00.796097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:00.796097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:00.796097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:00.796097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:00.796097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:00.797145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:00.797145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:00.797145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:00.797145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:00.797145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:00.797145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:00.797145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:00.797145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:00.797145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:00.797145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:00.797145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:00.797145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:00.797145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:00.797145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:00.797145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:00.797145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:00.797145 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:00.798204 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:00.798204 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:00.798204 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:00.798204 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:00.798204 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 363/742] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:00.802750 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca16c76-394e-4a8a-8b8d-425df1a0e9ce None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:00.909085 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 380/743] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:20:00 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:20:00.910104 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765736a3-ba16-4f3e-a973-1b42c8a9086c None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:00.952619 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca16c76-394e-4a8a-8b8d-425df1a0e9ce None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:01.021912 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1269892-24c5-4534-ad49-8cf81643225c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:01.023257 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1269892-24c5-4534-ad49-8cf81643225c None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:01.023682 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1269892-24c5-4534-ad49-8cf81643225c None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:01.024023 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1269892-24c5-4534-ad49-8cf81643225c None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:01.025177 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1269892-24c5-4534-ad49-8cf81643225c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:01.027230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1269892-24c5-4534-ad49-8cf81643225c None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:01.062089 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 364/744] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:20:00 2022] POST /identity/v3/services => generated 240 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:20:01.063280 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1269892-24c5-4534-ad49-8cf81643225c None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:01.311953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765736a3-ba16-4f3e-a973-1b42c8a9086c None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:01.344689 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1269892-24c5-4534-ad49-8cf81643225c None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:01.376117 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f7840-3528-40b4-8298-a16291337a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:01.376814 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f7840-3528-40b4-8298-a16291337a2b None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:01.377114 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f7840-3528-40b4-8298-a16291337a2b None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:01.377493 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f7840-3528-40b4-8298-a16291337a2b None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:01.378167 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f7840-3528-40b4-8298-a16291337a2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:01.378482 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f7840-3528-40b4-8298-a16291337a2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:01.380226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f7840-3528-40b4-8298-a16291337a2b None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:01.401474 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 381/745] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 490 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:01.402391 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc8c03-5311-4539-9936-5b303e55dfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:01.403132 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef0da4-8be6-4757-80b2-e6c36c062252 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:01.403433 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef0da4-8be6-4757-80b2-e6c36c062252 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:01.403742 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef0da4-8be6-4757-80b2-e6c36c062252 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:01.404183 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc8c03-5311-4539-9936-5b303e55dfe9 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:01.404830 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc8c03-5311-4539-9936-5b303e55dfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:01.405404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc8c03-5311-4539-9936-5b303e55dfe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:01.405569 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 382/746] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:01.414984 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef0da4-8be6-4757-80b2-e6c36c062252 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:01.422319 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc8c03-5311-4539-9936-5b303e55dfe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:01.424821 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc8c03-5311-4539-9936-5b303e55dfe9 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:01.469128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-9fcc8c03-5311-4539-9936-5b303e55dfe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:01.469128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:01.469128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:01.469128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:01.469128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:01.469128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:01.469128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:01.469128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:01.469128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:01.469128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:01.469128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:01.469128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:01.469128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:01.469128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:01.469128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:01.470442 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:01.470442 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:01.470442 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:01.470442 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:01.470442 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:01.470442 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:01.470442 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:01.470442 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:01.470442 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:01.470442 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:01.470442 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:01.470442 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:01.470442 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:01.470442 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:01.470442 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:01.470442 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:01.470442 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:01.471576 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:01.471576 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:01.471576 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:01.471576 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:01.471576 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 365/747] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:01.477397 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3920bd2-2afe-4f29-ab05-d1c0ad6d30f5 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:01.479330 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3920bd2-2afe-4f29-ab05-d1c0ad6d30f5 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:01.479741 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3920bd2-2afe-4f29-ab05-d1c0ad6d30f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:01.502588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-e3920bd2-2afe-4f29-ab05-d1c0ad6d30f5 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:01.504219 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-e3920bd2-2afe-4f29-ab05-d1c0ad6d30f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:01.550134 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef0da4-8be6-4757-80b2-e6c36c062252 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:01.588033 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a895a-195c-4350-987c-3db1671ceb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:01.588889 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a895a-195c-4350-987c-3db1671ceb9c None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:01.589121 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a895a-195c-4350-987c-3db1671ceb9c None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:01.589415 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a895a-195c-4350-987c-3db1671ceb9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:01.593751 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 366/748] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:01.595085 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3920bd2-2afe-4f29-ab05-d1c0ad6d30f5 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:01.605335 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a895a-195c-4350-987c-3db1671ceb9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:01.606834 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a895a-195c-4350-987c-3db1671ceb9c None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:01.633969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-991a895a-195c-4350-987c-3db1671ceb9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:01.633969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:01.633969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:01.633969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:01.633969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:01.633969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:01.633969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:01.633969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:01.633969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:01.633969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:01.633969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:01.633969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:01.633969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:20:01.633969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:20:01.633969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:20:01.635214 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:20:01.635214 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:01.635214 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:01.635214 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:01.635214 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:01.635214 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:01.635214 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:01.635214 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:01.635214 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:01.635214 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:01.635214 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:01.635214 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:01.635214 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:01.635214 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:01.635214 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:01.635214 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:01.635214 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:01.636334 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:20:01.636334 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:20:01.636334 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:20:01.636334 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:20:01.636334 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:20:01.636334 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:20:01.636334 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:01.636334 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:01.636334 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 383/749] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:20:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:01.641326 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a895a-195c-4350-987c-3db1671ceb9c None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:01.715049 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3920bd2-2afe-4f29-ab05-d1c0ad6d30f5 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:01.751327 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a895a-195c-4350-987c-3db1671ceb9c None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:01.752884 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c4f94-2a6d-45c5-af7f-e7047c6b2edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:01.753856 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c4f94-2a6d-45c5-af7f-e7047c6b2edd None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:01.755037 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c4f94-2a6d-45c5-af7f-e7047c6b2edd None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:01.755658 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c4f94-2a6d-45c5-af7f-e7047c6b2edd None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:01.756955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c4f94-2a6d-45c5-af7f-e7047c6b2edd None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:01.757756 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c4f94-2a6d-45c5-af7f-e7047c6b2edd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:01.760075 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c4f94-2a6d-45c5-af7f-e7047c6b2edd None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:01.780856 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 367/750] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:01.782558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c4f94-2a6d-45c5-af7f-e7047c6b2edd None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:01.789879 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516da7c-572b-4f40-8a58-e2827aa6b56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:01.790577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516da7c-572b-4f40-8a58-e2827aa6b56d None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:01.790859 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516da7c-572b-4f40-8a58-e2827aa6b56d None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:01.791144 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516da7c-572b-4f40-8a58-e2827aa6b56d None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:01.791947 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516da7c-572b-4f40-8a58-e2827aa6b56d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:01.792270 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516da7c-572b-4f40-8a58-e2827aa6b56d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:01.794226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516da7c-572b-4f40-8a58-e2827aa6b56d None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:01.808444 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 384/751] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:20:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:01.809525 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516da7c-572b-4f40-8a58-e2827aa6b56d None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:01.936191 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516da7c-572b-4f40-8a58-e2827aa6b56d None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:01.951546 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c4f94-2a6d-45c5-af7f-e7047c6b2edd None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:01.983725 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96def45b-07b2-43c5-87cc-6952b03ac93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:01.984758 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96def45b-07b2-43c5-87cc-6952b03ac93a None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:01.985048 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96def45b-07b2-43c5-87cc-6952b03ac93a None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:01.985332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96def45b-07b2-43c5-87cc-6952b03ac93a None admin] PATH_INFO: `/v3/projects/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:01.998080 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96def45b-07b2-43c5-87cc-6952b03ac93a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:02.000306 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96def45b-07b2-43c5-87cc-6952b03ac93a None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:02.001179 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc1e6c-511d-4e10-ab14-227d369a9a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:02.002136 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc1e6c-511d-4e10-ab14-227d369a9a74 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:02.002490 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc1e6c-511d-4e10-ab14-227d369a9a74 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:02.002842 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc1e6c-511d-4e10-ab14-227d369a9a74 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:02.003588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc1e6c-511d-4e10-ab14-227d369a9a74 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:02.005115 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc1e6c-511d-4e10-ab14-227d369a9a74 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:02.018579 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-10cc1e6c-511d-4e10-ab14-227d369a9a74 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:20:02.018579 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:02.018579 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:20:02.018579 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:20:02.018579 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:20:02.018579 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:20:02.018579 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:20:02.018579 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:02.018579 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:20:02.018579 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:02.018579 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:20:02.018579 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:02.018579 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:02.018579 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:02.018579 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:02.018579 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:02.020530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:02.020530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:02.020530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:02.020530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:02.020530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:02.020530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:02.020530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:02.020530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:20:02.020530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:20:02.020530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:20:02.020530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:20:02.020530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:02.020530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:02.020530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:02.020530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:02.020530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:02.023160 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:02.023160 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:02.023160 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:02.023160 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:02.023160 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:02.023160 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:02.023160 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:02.023160 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:02.023160 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:02.023160 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:02.023160 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:02.023160 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:20:02.023160 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:02.023160 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:20:02.023160 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:02.025339 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-96def45b-07b2-43c5-87cc-6952b03ac93a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:02.025339 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:02.025339 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:02.025339 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:02.025339 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:02.025339 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:02.025339 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:02.025339 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:02.025339 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:02.025339 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:02.025339 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:02.025339 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:02.025339 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:20:02.025339 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:20:02.025339 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:20:02.034594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:20:02.034594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:02.034594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:02.034594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:02.034594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:02.034594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:02.034594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:02.034594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:02.034594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:02.034594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:02.034594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:02.034594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:02.034594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:02.034594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:02.034594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:02.034594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:02.034594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:02.037320 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:20:02.037320 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:20:02.037320 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:20:02.037320 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:20:02.037320 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:20:02.037320 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:20:02.037320 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:02.037320 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:02.037320 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 385/752] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:20:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:02.037320 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96def45b-07b2-43c5-87cc-6952b03ac93a None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:02.038927 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 368/753] 10.222.0.48 () {56 vars in 1129 bytes} [Mon May 9 15:20:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:02.038927 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc1e6c-511d-4e10-ab14-227d369a9a74 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:02.163963 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96def45b-07b2-43c5-87cc-6952b03ac93a None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:02.179758 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc1e6c-511d-4e10-ab14-227d369a9a74 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:02.227786 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fe569-b855-4139-b433-e8c406c4a66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:02.229024 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fe569-b855-4139-b433-e8c406c4a66b None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:02.229592 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fe569-b855-4139-b433-e8c406c4a66b None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:02.230261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fe569-b855-4139-b433-e8c406c4a66b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:02.231916 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fe569-b855-4139-b433-e8c406c4a66b None admin] RBAC: Adding query filter params (role.id=9aaa841361294b9c9b275ca1be0ed89c, scope.project.id=eb2de9bea1cf451db5f8c697f480c480, user.id=dda2a8271a764e65bb97e316410b91b1) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:02.232268 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d37c1-0457-4b64-9691-6f9e7aa77345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:02.232942 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fe569-b855-4139-b433-e8c406c4a66b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:02.233068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d37c1-0457-4b64-9691-6f9e7aa77345 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:02.233348 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d37c1-0457-4b64-9691-6f9e7aa77345 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:02.233729 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d37c1-0457-4b64-9691-6f9e7aa77345 None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:02.234642 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d37c1-0457-4b64-9691-6f9e7aa77345 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:02.234972 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d37c1-0457-4b64-9691-6f9e7aa77345 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:02.236612 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d37c1-0457-4b64-9691-6f9e7aa77345 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:02.236752 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fe569-b855-4139-b433-e8c406c4a66b None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:02.244634 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 369/754] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 9 15:20:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:02.245715 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d37c1-0457-4b64-9691-6f9e7aa77345 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:02.253141 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 386/755] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:20:02 2022] GET /identity/v3/role_assignments?user.id=dda2a8271a764e65bb97e316410b91b1&scope.project.id=eb2de9bea1cf451db5f8c697f480c480&role.id=9aaa841361294b9c9b275ca1be0ed89c => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:02.254585 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fe569-b855-4139-b433-e8c406c4a66b None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:02.438850 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d37c1-0457-4b64-9691-6f9e7aa77345 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:02.440368 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fe569-b855-4139-b433-e8c406c4a66b None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:02.495847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6c6f2-48cc-4383-9bc8-b217aaf70320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:02.496695 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6c6f2-48cc-4383-9bc8-b217aaf70320 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:02.497069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6c6f2-48cc-4383-9bc8-b217aaf70320 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:02.497495 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6c6f2-48cc-4383-9bc8-b217aaf70320 None admin] PATH_INFO: `/v3/projects` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:02.498573 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6c6f2-48cc-4383-9bc8-b217aaf70320 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:02.499012 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6c6f2-48cc-4383-9bc8-b217aaf70320 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:02.500845 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6c6f2-48cc-4383-9bc8-b217aaf70320 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:02.516558 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629efdef-4a6b-4adc-ba51-6bb4cc052b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:02.517342 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629efdef-4a6b-4adc-ba51-6bb4cc052b4f None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:02.517664 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629efdef-4a6b-4adc-ba51-6bb4cc052b4f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:02.517921 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629efdef-4a6b-4adc-ba51-6bb4cc052b4f None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:02.518708 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629efdef-4a6b-4adc-ba51-6bb4cc052b4f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:02.519023 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629efdef-4a6b-4adc-ba51-6bb4cc052b4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:02.519568 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 370/756] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:20:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:02.520836 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629efdef-4a6b-4adc-ba51-6bb4cc052b4f None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:02.526478 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6c6f2-48cc-4383-9bc8-b217aaf70320 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:02.539315 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 387/757] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 9 15:20:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:02.539315 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629efdef-4a6b-4adc-ba51-6bb4cc052b4f None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:02.649159 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6c6f2-48cc-4383-9bc8-b217aaf70320 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:02.663199 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629efdef-4a6b-4adc-ba51-6bb4cc052b4f None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:02.688976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3373d3-ebe0-468d-8334-330252f2501a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:02.689691 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3373d3-ebe0-468d-8334-330252f2501a None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:02.690003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3373d3-ebe0-468d-8334-330252f2501a None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:02.690313 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3373d3-ebe0-468d-8334-330252f2501a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:02.691225 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3373d3-ebe0-468d-8334-330252f2501a None admin] RBAC: Adding query filter params (role.id=7d8a1698372145a59d70d67ed7867f56, scope.project.id=eb2de9bea1cf451db5f8c697f480c480, user.id=ed964c5d606a4934b5bd9bd5890562ad) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:02.692143 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3373d3-ebe0-468d-8334-330252f2501a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:02.693948 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3373d3-ebe0-468d-8334-330252f2501a None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:02.701049 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 371/758] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:20:02 2022] GET /identity/v3/role_assignments?user.id=ed964c5d606a4934b5bd9bd5890562ad&scope.project.id=eb2de9bea1cf451db5f8c697f480c480&role.id=7d8a1698372145a59d70d67ed7867f56 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:02.703822 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5f33f-d57b-4360-b136-ee1025c7783d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:02.704571 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5f33f-d57b-4360-b136-ee1025c7783d None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:02.704859 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5f33f-d57b-4360-b136-ee1025c7783d None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:02.705134 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5f33f-d57b-4360-b136-ee1025c7783d None admin] PATH_INFO: `/v3/endpoints` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:02.706069 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5f33f-d57b-4360-b136-ee1025c7783d None admin] RBAC: Adding query filter params (interface=public, service_id=a1e01754f1094eb4aca9d1cdc890584e, region_id=RegionOne) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:02.706409 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5f33f-d57b-4360-b136-ee1025c7783d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:02.708500 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5f33f-d57b-4360-b136-ee1025c7783d None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:02.721668 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 388/759] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:20:02 2022] GET /identity/v3/endpoints?service_id=a1e01754f1094eb4aca9d1cdc890584e&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:02.727816 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3373d3-ebe0-468d-8334-330252f2501a None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:02.876757 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3373d3-ebe0-468d-8334-330252f2501a None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:02.935359 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe319d33-a56c-4758-a863-e9ae765b0937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:02.936622 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe319d33-a56c-4758-a863-e9ae765b0937 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:02.937214 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe319d33-a56c-4758-a863-e9ae765b0937 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:02.937735 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe319d33-a56c-4758-a863-e9ae765b0937 None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:02.938720 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe319d33-a56c-4758-a863-e9ae765b0937 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:02.940407 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe319d33-a56c-4758-a863-e9ae765b0937 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:02.947439 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 372/760] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:20:02 2022] GET /identity/v3/services => generated 772 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:02.959320 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578d6f1-0a7f-4862-896e-cca0dca358ef None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:02.959857 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578d6f1-0a7f-4862-896e-cca0dca358ef None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:02.959978 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578d6f1-0a7f-4862-896e-cca0dca358ef None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:02.961477 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 389/761] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:02.967617 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88fcca-be1b-43b9-9d3b-c6312f7ff078 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:02.968022 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88fcca-be1b-43b9-9d3b-c6312f7ff078 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:02.968243 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88fcca-be1b-43b9-9d3b-c6312f7ff078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:02.987774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-1c88fcca-be1b-43b9-9d3b-c6312f7ff078 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:02.990343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-1c88fcca-be1b-43b9-9d3b-c6312f7ff078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:03.073613 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 373/762] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:03.099268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578d6f1-0a7f-4862-896e-cca0dca358ef None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:03.262848 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578d6f1-0a7f-4862-896e-cca0dca358ef None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:03.309969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d311cb-c50d-4835-9c88-87296e6210fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:03.310847 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d311cb-c50d-4835-9c88-87296e6210fb None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:03.311162 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d311cb-c50d-4835-9c88-87296e6210fb None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:03.311447 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d311cb-c50d-4835-9c88-87296e6210fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:03.329933 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d311cb-c50d-4835-9c88-87296e6210fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:20:03.338326 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-27d311cb-c50d-4835-9c88-87296e6210fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:20:03.338326 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:03.338326 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:03.338326 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:03.338326 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:03.338326 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:03.338326 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:03.338326 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:03.338326 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:03.338326 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:03.338326 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:03.338326 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:03.338326 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:20:03.338326 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:20:03.338326 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:20:03.338326 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:20:03.339597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:20:03.339597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:20:03.339597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:20:03.339597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:20:03.339597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:03.339597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:03.339597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:03.339597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:03.339597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:03.339597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:03.339597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:03.339597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:03.339597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:03.339597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:03.339597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:03.339597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:03.340568 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:03.340568 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:03.340568 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:03.340568 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:03.340568 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:20:03.340568 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:20:03.340568 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:20:03.340568 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:20:03.340568 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:20:03.340568 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:20:03.340568 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:20:03.340568 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:03.340568 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 390/763] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:20:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:03.346820 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88fcca-be1b-43b9-9d3b-c6312f7ff078 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:03.474629 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88fcca-be1b-43b9-9d3b-c6312f7ff078 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:03.517764 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66525e-a786-4e17-b9bb-9718247712de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:03.518398 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66525e-a786-4e17-b9bb-9718247712de None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:03.518687 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66525e-a786-4e17-b9bb-9718247712de None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:03.518970 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66525e-a786-4e17-b9bb-9718247712de None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:03.520347 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66525e-a786-4e17-b9bb-9718247712de None admin] RBAC: Adding query filter params (name=admin) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:03.520667 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66525e-a786-4e17-b9bb-9718247712de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:03.522179 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66525e-a786-4e17-b9bb-9718247712de None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:03.532842 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 374/764] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:20:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:03.539073 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d311cb-c50d-4835-9c88-87296e6210fb None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:03.687279 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d311cb-c50d-4835-9c88-87296e6210fb None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:03.733620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fd2bd-f83c-4d4c-8453-730bad0379a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:03.734437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fd2bd-f83c-4d4c-8453-730bad0379a8 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:03.734728 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fd2bd-f83c-4d4c-8453-730bad0379a8 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:03.735010 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fd2bd-f83c-4d4c-8453-730bad0379a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:03.747775 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fd2bd-f83c-4d4c-8453-730bad0379a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:03.749235 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fd2bd-f83c-4d4c-8453-730bad0379a8 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:03.772089 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-882fd2bd-f83c-4d4c-8453-730bad0379a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:03.772089 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:03.772089 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:03.772089 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:03.772089 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:03.772089 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:03.772089 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:03.772089 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:03.772089 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:03.772089 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:03.772089 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:03.772089 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:03.772089 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:03.772089 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:03.772089 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:03.774355 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:03.774355 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:03.774355 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:03.774355 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:03.774355 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:03.774355 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:03.774355 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:03.774355 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:03.774355 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:03.774355 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:03.774355 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:03.774355 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:03.774355 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:03.774355 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:03.774355 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:03.774355 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:03.774355 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:03.776606 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:03.776606 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:03.776606 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:03.776606 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:03.781494 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 391/765] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:03.781787 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66525e-a786-4e17-b9bb-9718247712de None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:03.977397 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66525e-a786-4e17-b9bb-9718247712de None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:04.029508 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92d460-2bc4-47b3-96e7-503949db3e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:04.029508 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92d460-2bc4-47b3-96e7-503949db3e77 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:04.029508 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92d460-2bc4-47b3-96e7-503949db3e77 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:04.029508 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92d460-2bc4-47b3-96e7-503949db3e77 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:04.030668 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92d460-2bc4-47b3-96e7-503949db3e77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:04.030668 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92d460-2bc4-47b3-96e7-503949db3e77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:04.030668 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92d460-2bc4-47b3-96e7-503949db3e77 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:04.040523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f71c9-8479-46f3-98a4-dbc781ebd5f0 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:04.041494 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f71c9-8479-46f3-98a4-dbc781ebd5f0 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:04.041494 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f71c9-8479-46f3-98a4-dbc781ebd5f0 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:04.046378 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 392/766] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:04.053577 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 375/767] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:04.053974 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fabcaf-c7a6-445e-89ed-80774fe90198 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:04.053974 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fabcaf-c7a6-445e-89ed-80774fe90198 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:04.053974 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fabcaf-c7a6-445e-89ed-80774fe90198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:04.056812 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92d460-2bc4-47b3-96e7-503949db3e77 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:04.087082 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-c5fabcaf-c7a6-445e-89ed-80774fe90198 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:04.088311 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-c5fabcaf-c7a6-445e-89ed-80774fe90198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:04.222171 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 393/768] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:04.233220 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92d460-2bc4-47b3-96e7-503949db3e77 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:04.266075 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fabcaf-c7a6-445e-89ed-80774fe90198 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:04.278998 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25256e-0801-4cfe-8e94-eac9c5040b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:04.279871 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25256e-0801-4cfe-8e94-eac9c5040b92 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:04.280133 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25256e-0801-4cfe-8e94-eac9c5040b92 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:04.280399 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25256e-0801-4cfe-8e94-eac9c5040b92 None admin] PATH_INFO: `/v3/users/nova` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:04.293608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25256e-0801-4cfe-8e94-eac9c5040b92 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:04.295059 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25256e-0801-4cfe-8e94-eac9c5040b92 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:04.320524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-9d25256e-0801-4cfe-8e94-eac9c5040b92 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:20:04.320524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:04.320524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:04.320524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:04.320524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:04.320524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:04.320524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:04.320524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:04.320524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:04.320524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:04.320524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:04.320524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:04.320524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:20:04.320524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:20:04.320524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:20:04.320524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:20:04.322616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:04.322616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:04.322616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:20:04.322616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:04.322616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:20:04.322616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:04.322616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:04.322616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:04.322616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:04.322616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:04.322616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:04.322616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:04.322616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:04.322616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:04.322616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:04.322616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:04.322616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:04.322616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:04.324733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:04.324733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:04.324733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:20:04.324733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:20:04.324733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:20:04.324733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:20:04.324733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:20:04.324733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:20:04.324733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:20:04.324733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:04.333083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 376/769] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:20:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:04.336362 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25256e-0801-4cfe-8e94-eac9c5040b92 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:04.438757 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fabcaf-c7a6-445e-89ed-80774fe90198 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:04.505210 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25256e-0801-4cfe-8e94-eac9c5040b92 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:04.511532 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba015f-aa26-4082-8f8b-db273d19ca06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:04.512347 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba015f-aa26-4082-8f8b-db273d19ca06 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:04.512622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba015f-aa26-4082-8f8b-db273d19ca06 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:04.512908 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba015f-aa26-4082-8f8b-db273d19ca06 None admin] PATH_INFO: `/v3/services/network` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:04.513615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba015f-aa26-4082-8f8b-db273d19ca06 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:04.514981 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba015f-aa26-4082-8f8b-db273d19ca06 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:04.536138 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-56ba015f-aa26-4082-8f8b-db273d19ca06 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:20:04.536138 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:04.536138 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:20:04.536138 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:20:04.536138 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:20:04.536138 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:20:04.536138 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:20:04.536138 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:04.536138 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:20:04.536138 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:04.536138 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:20:04.536138 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:04.536138 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:04.536138 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:04.536138 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:04.536138 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:04.536138 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:04.537305 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:04.537305 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:04.537305 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:04.537305 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:04.537305 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:04.537305 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:04.537305 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:20:04.537305 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:20:04.537305 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:20:04.537305 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:20:04.537305 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:04.537305 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:04.537305 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:04.537305 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:04.537305 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:04.537305 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:04.538300 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:04.538300 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:04.538300 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:04.538300 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:04.538300 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:04.538300 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:04.538300 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:04.538300 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:04.538300 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:04.538300 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:04.538300 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:20:04.538300 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:04.538300 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:20:04.538300 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:04.542513 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 394/770] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:20:04 2022] GET /identity/v3/services/network => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:04.545247 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba015f-aa26-4082-8f8b-db273d19ca06 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:04.559182 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc593953-dd87-4f16-b813-bb5410c3736d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:04.560200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc593953-dd87-4f16-b813-bb5410c3736d None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:04.560719 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc593953-dd87-4f16-b813-bb5410c3736d None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:04.561236 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc593953-dd87-4f16-b813-bb5410c3736d None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:04.562847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc593953-dd87-4f16-b813-bb5410c3736d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:04.563384 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc593953-dd87-4f16-b813-bb5410c3736d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:04.565078 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc593953-dd87-4f16-b813-bb5410c3736d None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:04.586065 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 377/771] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:20:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:04.592719 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc593953-dd87-4f16-b813-bb5410c3736d None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:04.751582 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba015f-aa26-4082-8f8b-db273d19ca06 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:04.763917 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc593953-dd87-4f16-b813-bb5410c3736d None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:04.810025 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440d123-2afa-4292-a124-6fa4b5908ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:04.810677 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440d123-2afa-4292-a124-6fa4b5908ddf None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:04.810971 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440d123-2afa-4292-a124-6fa4b5908ddf None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:04.811254 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440d123-2afa-4292-a124-6fa4b5908ddf None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:04.811993 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440d123-2afa-4292-a124-6fa4b5908ddf None admin] RBAC: Adding query filter params (name=network) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:04.812304 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440d123-2afa-4292-a124-6fa4b5908ddf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:04.814825 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440d123-2afa-4292-a124-6fa4b5908ddf None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:04.824053 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba18f3-7330-489d-9936-cf3bb05a2810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:04.824872 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba18f3-7330-489d-9936-cf3bb05a2810 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:04.825150 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba18f3-7330-489d-9936-cf3bb05a2810 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:04.825438 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba18f3-7330-489d-9936-cf3bb05a2810 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:04.830234 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 395/772] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:20:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:04.838448 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440d123-2afa-4292-a124-6fa4b5908ddf None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:04.841721 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba18f3-7330-489d-9936-cf3bb05a2810 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:04.843199 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba18f3-7330-489d-9936-cf3bb05a2810 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:04.866834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-6dba18f3-7330-489d-9936-cf3bb05a2810 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:04.866834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:04.866834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:04.866834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:04.866834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:04.866834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:04.866834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:04.866834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:04.866834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:04.866834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:04.866834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:04.866834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:04.866834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:04.866834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:04.866834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:04.867893 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:04.867893 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:04.867893 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:04.867893 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:04.867893 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:04.867893 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:04.867893 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:04.867893 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:04.867893 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:04.867893 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:04.867893 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:04.867893 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:04.867893 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:04.867893 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:04.867893 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:04.867893 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:04.867893 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:04.868918 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:04.868918 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:04.868918 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:04.868918 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:04.868918 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 378/773] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:04.875474 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba18f3-7330-489d-9936-cf3bb05a2810 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:05.021394 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440d123-2afa-4292-a124-6fa4b5908ddf None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:05.047204 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba18f3-7330-489d-9936-cf3bb05a2810 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:05.065166 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ccd47-c522-454f-a181-84e0b63692c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:05.065906 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ccd47-c522-454f-a181-84e0b63692c0 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:05.066094 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ccd47-c522-454f-a181-84e0b63692c0 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:05.066384 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ccd47-c522-454f-a181-84e0b63692c0 None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:05.068314 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ccd47-c522-454f-a181-84e0b63692c0 None admin] RBAC: Adding query filter params (type=network) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:05.068723 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ccd47-c522-454f-a181-84e0b63692c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:05.070289 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ccd47-c522-454f-a181-84e0b63692c0 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:05.087324 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 396/774] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:20:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:05.097357 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ccd47-c522-454f-a181-84e0b63692c0 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:05.136595 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88b6a6-f680-495a-b04a-82ec68be8b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:05.137300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88b6a6-f680-495a-b04a-82ec68be8b15 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:05.137696 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88b6a6-f680-495a-b04a-82ec68be8b15 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:05.138054 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88b6a6-f680-495a-b04a-82ec68be8b15 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:05.138804 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88b6a6-f680-495a-b04a-82ec68be8b15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:05.139120 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88b6a6-f680-495a-b04a-82ec68be8b15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:05.141903 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88b6a6-f680-495a-b04a-82ec68be8b15 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:05.170779 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 379/775] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:05.178781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88b6a6-f680-495a-b04a-82ec68be8b15 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:05.306202 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88b6a6-f680-495a-b04a-82ec68be8b15 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:05.332494 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ccd47-c522-454f-a181-84e0b63692c0 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:05.374001 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedd8f3-fafe-40ad-86c9-b65444f4c27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:05.374873 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedd8f3-fafe-40ad-86c9-b65444f4c27f None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:05.375165 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedd8f3-fafe-40ad-86c9-b65444f4c27f None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:05.375446 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedd8f3-fafe-40ad-86c9-b65444f4c27f None admin] PATH_INFO: `/v3/projects/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:05.386560 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedd8f3-fafe-40ad-86c9-b65444f4c27f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:05.388782 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedd8f3-fafe-40ad-86c9-b65444f4c27f None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:05.405325 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-feedd8f3-fafe-40ad-86c9-b65444f4c27f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:05.405325 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:05.405325 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:05.405325 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:05.405325 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:05.405325 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:05.405325 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:05.405325 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:05.405325 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:05.405325 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:05.405325 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:05.405325 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:05.405325 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:20:05.405325 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:20:05.405325 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:20:05.406423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:20:05.406423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:05.406423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:05.406423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:05.406423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:05.406423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:05.406423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:05.406423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:05.406423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:05.406423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:05.406423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:05.406423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:05.406423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:05.406423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:05.406423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:05.406423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:05.406423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:05.407437 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:20:05.407437 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:20:05.407437 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:20:05.407437 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:20:05.407437 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:20:05.407437 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:20:05.407437 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:05.407437 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:05.407918 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4a738-7654-4f03-9c9a-73e5024fd032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:05.407918 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4a738-7654-4f03-9c9a-73e5024fd032 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:05.408101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 380/776] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:20:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:05.408178 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4a738-7654-4f03-9c9a-73e5024fd032 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:05.408178 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4a738-7654-4f03-9c9a-73e5024fd032 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:05.408178 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4a738-7654-4f03-9c9a-73e5024fd032 None admin] RBAC: Adding query filter params (interface=public, service_id=a80326c4f17a4753a0a3d38744074683, region_id=RegionOne) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:05.408418 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4a738-7654-4f03-9c9a-73e5024fd032 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:05.412368 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4a738-7654-4f03-9c9a-73e5024fd032 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:05.413487 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedd8f3-fafe-40ad-86c9-b65444f4c27f None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:05.420975 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 397/777] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:20:05 2022] GET /identity/v3/endpoints?service_id=a80326c4f17a4753a0a3d38744074683&interface=public®ion_id=RegionOne => generated 194 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:05.427966 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4a738-7654-4f03-9c9a-73e5024fd032 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:05.558475 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedd8f3-fafe-40ad-86c9-b65444f4c27f None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:05.559541 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4a738-7654-4f03-9c9a-73e5024fd032 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:05.597602 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec951e-0890-408b-a84c-a17f259b3771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:05.598947 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec951e-0890-408b-a84c-a17f259b3771 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:05.599250 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec951e-0890-408b-a84c-a17f259b3771 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:05.599537 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec951e-0890-408b-a84c-a17f259b3771 None admin] PATH_INFO: `/v3/projects` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:05.600360 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec951e-0890-408b-a84c-a17f259b3771 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:05.600682 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec951e-0890-408b-a84c-a17f259b3771 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:05.602174 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec951e-0890-408b-a84c-a17f259b3771 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:05.604068 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97d690-d600-4dd3-8fae-577eeae82b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:05.605397 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97d690-d600-4dd3-8fae-577eeae82b1b None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:05.605860 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97d690-d600-4dd3-8fae-577eeae82b1b None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:05.606305 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97d690-d600-4dd3-8fae-577eeae82b1b None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:05.607177 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97d690-d600-4dd3-8fae-577eeae82b1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:05.608713 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97d690-d600-4dd3-8fae-577eeae82b1b None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:05.616386 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 398/778] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:20:05 2022] GET /identity/v3/services => generated 772 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:05.618032 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82c227-af38-474e-93bf-48c392fbf977 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:05.618511 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82c227-af38-474e-93bf-48c392fbf977 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:05.618968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82c227-af38-474e-93bf-48c392fbf977 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:05.620878 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 399/779] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:05.625424 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 381/780] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:20:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:05.627128 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce98dc-c46a-4db8-92a1-254516a0ed64 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:05.627574 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce98dc-c46a-4db8-92a1-254516a0ed64 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:05.628025 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce98dc-c46a-4db8-92a1-254516a0ed64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:05.628786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec951e-0890-408b-a84c-a17f259b3771 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:05.648251 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-57ce98dc-c46a-4db8-92a1-254516a0ed64 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:05.649774 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-57ce98dc-c46a-4db8-92a1-254516a0ed64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:05.723276 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 400/781] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:05.742128 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e96e91-a8ea-4deb-83f1-f42ecb846c7f None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:05.742497 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e96e91-a8ea-4deb-83f1-f42ecb846c7f None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:05.742683 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e96e91-a8ea-4deb-83f1-f42ecb846c7f None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:05.744942 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 401/782] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:20:05.750485 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e96e91-a8ea-4deb-83f1-f42ecb846c7f None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:05.806095 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec951e-0890-408b-a84c-a17f259b3771 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:05.843403 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1260c-82f1-4e83-b544-3286646313ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:05.844752 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1260c-82f1-4e83-b544-3286646313ba None admin] REQUEST_METHOD: `PUT` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:05.845252 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1260c-82f1-4e83-b544-3286646313ba None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:05.845787 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1260c-82f1-4e83-b544-3286646313ba None admin] PATH_INFO: `/v3/projects/eb2de9bea1cf451db5f8c697f480c480/users/42dc38d6c3634b7496b1b7e99ca3f647/roles/9aaa841361294b9c9b275ca1be0ed89c` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:05.848422 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1260c-82f1-4e83-b544-3286646313ba None admin] RBAC: Authorizing `identity:create_grant(project_id=eb2de9bea1cf451db5f8c697f480c480, user_id=42dc38d6c3634b7496b1b7e99ca3f647, role_id=9aaa841361294b9c9b275ca1be0ed89c)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:05.850316 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1260c-82f1-4e83-b544-3286646313ba None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:05.867395 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e96e91-a8ea-4deb-83f1-f42ecb846c7f None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:05.869943 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 382/783] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:20:05 2022] PUT /identity/v3/projects/eb2de9bea1cf451db5f8c697f480c480/users/42dc38d6c3634b7496b1b7e99ca3f647/roles/9aaa841361294b9c9b275ca1be0ed89c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:20:05.872772 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58755f81-b97f-4712-ba4d-46a003fec8ed None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:05.873416 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58755f81-b97f-4712-ba4d-46a003fec8ed None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:05.873934 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58755f81-b97f-4712-ba4d-46a003fec8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:05.900083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-58755f81-b97f-4712-ba4d-46a003fec8ed None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:05.902571 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-58755f81-b97f-4712-ba4d-46a003fec8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:05.920159 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85005f0e-a493-40b3-9183-e663bd9fa584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:05.922286 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85005f0e-a493-40b3-9183-e663bd9fa584 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:05.922895 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85005f0e-a493-40b3-9183-e663bd9fa584 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:05.923691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85005f0e-a493-40b3-9183-e663bd9fa584 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:05.940705 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85005f0e-a493-40b3-9183-e663bd9fa584 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:20:05.952356 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-85005f0e-a493-40b3-9183-e663bd9fa584 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:20:05.952356 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:05.952356 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:05.952356 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:05.952356 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:05.952356 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:05.952356 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:05.952356 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:05.952356 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:05.952356 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:05.952356 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:05.952356 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:05.952356 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:20:05.952356 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:20:05.952356 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:20:05.952356 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:20:05.953588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:20:05.953588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:20:05.953588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:20:05.953588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:20:05.953588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:05.953588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:05.953588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:05.953588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:05.953588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:05.953588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:05.953588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:05.953588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:05.953588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:05.953588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:05.953588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:05.953588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:05.954670 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:05.954670 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:05.954670 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:05.954670 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:05.954670 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:20:05.954670 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:20:05.954670 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:20:05.954670 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:20:05.954670 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:20:05.954670 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:20:05.954670 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:20:05.954670 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:05.959063 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 402/784] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:20:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:05.966384 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85005f0e-a493-40b3-9183-e663bd9fa584 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:05.998949 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 383/785] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:06.023846 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58755f81-b97f-4712-ba4d-46a003fec8ed None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:06.106049 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85005f0e-a493-40b3-9183-e663bd9fa584 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:06.156274 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89425da6-246f-453e-bf8e-80d4e0297ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:06.157727 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89425da6-246f-453e-bf8e-80d4e0297ef8 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:06.158136 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89425da6-246f-453e-bf8e-80d4e0297ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:06.158722 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89425da6-246f-453e-bf8e-80d4e0297ef8 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:06.159941 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89425da6-246f-453e-bf8e-80d4e0297ef8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:06.161038 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89425da6-246f-453e-bf8e-80d4e0297ef8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:06.163659 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89425da6-246f-453e-bf8e-80d4e0297ef8 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:06.167194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58755f81-b97f-4712-ba4d-46a003fec8ed None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:06.177477 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 403/786] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:20:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:06.180052 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230706f-04f3-40b7-a95a-0d01a4719d82 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:06.180521 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230706f-04f3-40b7-a95a-0d01a4719d82 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:06.180931 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230706f-04f3-40b7-a95a-0d01a4719d82 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:06.189039 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 404/787] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:06 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:06.194078 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230706f-04f3-40b7-a95a-0d01a4719d82 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:06.236021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a80e7-408b-483a-a50d-8a0a506eddf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:06.237326 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a80e7-408b-483a-a50d-8a0a506eddf0 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:06.237917 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a80e7-408b-483a-a50d-8a0a506eddf0 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:06.239262 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a80e7-408b-483a-a50d-8a0a506eddf0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:06.257714 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a80e7-408b-483a-a50d-8a0a506eddf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:20:06.270356 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-008a80e7-408b-483a-a50d-8a0a506eddf0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:20:06.270356 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:06.270356 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:06.270356 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:06.270356 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:06.270356 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:06.270356 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:06.270356 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:06.270356 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:06.270356 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:06.270356 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:06.270356 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:06.270356 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:20:06.270356 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:20:06.270356 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:20:06.270356 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:20:06.271482 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:20:06.271482 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:20:06.271482 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:20:06.271482 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:20:06.271482 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:06.271482 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:06.271482 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:06.271482 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:06.271482 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:06.271482 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:06.271482 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:06.271482 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:06.271482 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:06.271482 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:06.271482 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:06.271482 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:06.272474 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:06.272474 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:06.272474 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:06.272474 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:06.272474 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:20:06.272474 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:20:06.272474 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:20:06.272474 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:20:06.272474 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:20:06.272474 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:20:06.272474 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:20:06.272474 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:06.274967 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 384/788] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:20:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:06.280498 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5277975-3242-4083-bc16-25426b31adec None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:06.280498 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5277975-3242-4083-bc16-25426b31adec None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:06.280498 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5277975-3242-4083-bc16-25426b31adec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:06.298307 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-c5277975-3242-4083-bc16-25426b31adec None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:06.299520 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-c5277975-3242-4083-bc16-25426b31adec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:06.346449 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230706f-04f3-40b7-a95a-0d01a4719d82 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:06.371294 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 385/789] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:06.378059 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5277975-3242-4083-bc16-25426b31adec None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:06.398184 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36b35c-1247-4cba-9b0a-d3bc4b1c84d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:06.399309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36b35c-1247-4cba-9b0a-d3bc4b1c84d8 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:06.399778 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36b35c-1247-4cba-9b0a-d3bc4b1c84d8 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:06.400232 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36b35c-1247-4cba-9b0a-d3bc4b1c84d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:06.416129 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36b35c-1247-4cba-9b0a-d3bc4b1c84d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:06.417509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36b35c-1247-4cba-9b0a-d3bc4b1c84d8 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:06.435575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-be36b35c-1247-4cba-9b0a-d3bc4b1c84d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:06.435575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:06.435575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:06.435575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:06.435575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:06.435575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:06.435575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:06.435575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:06.435575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:06.435575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:06.435575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:06.435575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:06.435575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:06.435575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:06.435575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:06.436866 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:06.436866 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:06.436866 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:06.436866 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:06.436866 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:06.436866 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:06.436866 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:06.436866 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:06.436866 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:06.436866 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:06.436866 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:06.436866 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:06.436866 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:06.436866 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:06.436866 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:06.436866 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:06.436866 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:06.443487 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:06.443487 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:06.443487 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:06.443487 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:06.443487 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 405/790] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:06.443487 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36b35c-1247-4cba-9b0a-d3bc4b1c84d8 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:06.512620 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5277975-3242-4083-bc16-25426b31adec None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:06.549122 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36b35c-1247-4cba-9b0a-d3bc4b1c84d8 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:06.557187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff41c56-88e2-4903-abbb-a8dbfaf326b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:06.558260 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff41c56-88e2-4903-abbb-a8dbfaf326b0 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:06.558788 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff41c56-88e2-4903-abbb-a8dbfaf326b0 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:06.559345 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff41c56-88e2-4903-abbb-a8dbfaf326b0 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:06.560332 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff41c56-88e2-4903-abbb-a8dbfaf326b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:06.560891 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff41c56-88e2-4903-abbb-a8dbfaf326b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:06.562523 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff41c56-88e2-4903-abbb-a8dbfaf326b0 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:06.576314 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 386/791] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:20:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:06.576628 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff41c56-88e2-4903-abbb-a8dbfaf326b0 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:06.594704 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab833d-f086-4d13-8a84-10bba38e5937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:06.595686 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab833d-f086-4d13-8a84-10bba38e5937 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:06.596314 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab833d-f086-4d13-8a84-10bba38e5937 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:06.596624 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab833d-f086-4d13-8a84-10bba38e5937 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:06.597637 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab833d-f086-4d13-8a84-10bba38e5937 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:06.599946 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab833d-f086-4d13-8a84-10bba38e5937 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:06.617617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-44ab833d-f086-4d13-8a84-10bba38e5937 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:20:06.617617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:06.617617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:20:06.617617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:20:06.617617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:20:06.617617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:20:06.617617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:20:06.617617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:06.617617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:20:06.617617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:06.617617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:20:06.617617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:06.617617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:06.617617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:06.617617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:06.617617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:06.618762 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:06.618762 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:06.618762 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:06.618762 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:06.618762 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:06.618762 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:06.618762 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:06.618762 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:20:06.618762 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:20:06.618762 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:20:06.618762 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:20:06.618762 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:06.618762 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:06.618762 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:06.618762 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:06.618762 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:06.619724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:06.619724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:06.619724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:06.619724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:06.619724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:06.619724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:06.619724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:06.619724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:06.619724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:06.619724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:06.619724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:06.619724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:20:06.619724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:06.619724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:20:06.619724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:06.625534 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 406/792] 10.222.0.48 () {56 vars in 1129 bytes} [Mon May 9 15:20:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:06.626464 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab833d-f086-4d13-8a84-10bba38e5937 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:06.687975 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff41c56-88e2-4903-abbb-a8dbfaf326b0 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:06.726803 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c3791-2415-49fc-85ea-e91f91e42041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:06.727513 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c3791-2415-49fc-85ea-e91f91e42041 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:06.727801 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c3791-2415-49fc-85ea-e91f91e42041 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:06.728077 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c3791-2415-49fc-85ea-e91f91e42041 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:06.728816 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c3791-2415-49fc-85ea-e91f91e42041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:06.729124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c3791-2415-49fc-85ea-e91f91e42041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:06.730631 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c3791-2415-49fc-85ea-e91f91e42041 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:06.744627 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 387/793] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:06.745691 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c3791-2415-49fc-85ea-e91f91e42041 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:06.756459 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab833d-f086-4d13-8a84-10bba38e5937 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:06.805632 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b06044-67ed-4ec7-ad28-3e00ac45e32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:06.806470 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b06044-67ed-4ec7-ad28-3e00ac45e32d None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:06.806758 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b06044-67ed-4ec7-ad28-3e00ac45e32d None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:06.807038 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b06044-67ed-4ec7-ad28-3e00ac45e32d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:06.824302 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b06044-67ed-4ec7-ad28-3e00ac45e32d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:06.826134 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b06044-67ed-4ec7-ad28-3e00ac45e32d None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:06.855076 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-e6b06044-67ed-4ec7-ad28-3e00ac45e32d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:06.855076 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:06.855076 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:06.855076 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:06.855076 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:06.855076 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:06.855076 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:06.855076 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:06.855076 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:06.855076 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:06.855076 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:06.855076 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:06.855076 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:06.855076 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:06.855076 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:06.869456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:06.869456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:06.869456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:06.869456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:06.869456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:06.869456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:06.869456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:06.869456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:06.869456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:06.869456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:06.869456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:06.869456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:06.869456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:06.869456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:06.869456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:06.869456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:06.869456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:06.872000 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:06.872000 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:06.872000 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:06.872000 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:06.872000 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 407/794] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:06.872000 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b06044-67ed-4ec7-ad28-3e00ac45e32d None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:06.880897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c3791-2415-49fc-85ea-e91f91e42041 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:06.930233 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b69c0-165b-4965-98cb-465edd98417a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:06.931408 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b69c0-165b-4965-98cb-465edd98417a None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:06.931839 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b69c0-165b-4965-98cb-465edd98417a None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:06.932246 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b69c0-165b-4965-98cb-465edd98417a None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:06.932967 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b69c0-165b-4965-98cb-465edd98417a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:06.933278 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b69c0-165b-4965-98cb-465edd98417a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:06.935727 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b69c0-165b-4965-98cb-465edd98417a None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:06.945761 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 388/795] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 9 15:20:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:06.946648 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b69c0-165b-4965-98cb-465edd98417a None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:06.970745 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b06044-67ed-4ec7-ad28-3e00ac45e32d None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:07.007605 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0f2d3-5513-4b66-9ed3-160d06de992b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:07.008459 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0f2d3-5513-4b66-9ed3-160d06de992b None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:07.008750 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0f2d3-5513-4b66-9ed3-160d06de992b None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:07.009029 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0f2d3-5513-4b66-9ed3-160d06de992b None admin] PATH_INFO: `/v3/users/swift` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:07.017233 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0f2d3-5513-4b66-9ed3-160d06de992b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:07.018774 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0f2d3-5513-4b66-9ed3-160d06de992b None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:07.035552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-c2a0f2d3-5513-4b66-9ed3-160d06de992b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:20:07.035552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:07.035552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:07.035552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:07.035552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:07.035552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:07.035552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:07.035552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:07.035552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:07.035552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:07.035552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:07.035552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:07.035552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:20:07.035552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:20:07.035552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:20:07.035552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:20:07.038811 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:07.038811 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:07.038811 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:20:07.038811 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:07.038811 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:20:07.038811 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:07.038811 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:07.038811 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:07.038811 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:07.038811 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:07.038811 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:07.038811 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:07.038811 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:07.038811 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:07.038811 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:07.038811 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:07.038811 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:07.038811 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:07.041329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:07.041329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:07.041329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:20:07.041329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:20:07.041329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:20:07.041329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:20:07.041329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:20:07.041329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:20:07.041329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:20:07.041329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:07.041329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 408/796] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:20:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:07.041329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0f2d3-5513-4b66-9ed3-160d06de992b None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:07.049424 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b69c0-165b-4965-98cb-465edd98417a None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:07.081291 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ae182-4fd4-4757-ab62-4f3aced52fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:07.082086 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ae182-4fd4-4757-ab62-4f3aced52fdc None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:07.082878 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ae182-4fd4-4757-ab62-4f3aced52fdc None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:07.082878 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ae182-4fd4-4757-ab62-4f3aced52fdc None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:07.083619 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ae182-4fd4-4757-ab62-4f3aced52fdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:07.083928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ae182-4fd4-4757-ab62-4f3aced52fdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:07.085300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ae182-4fd4-4757-ab62-4f3aced52fdc None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:07.101642 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 389/797] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:07.102580 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ae182-4fd4-4757-ab62-4f3aced52fdc None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:07.147846 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0f2d3-5513-4b66-9ed3-160d06de992b None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:07.194550 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a1ef9-04b8-4183-9461-c3ae55e8ea0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:07.195705 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a1ef9-04b8-4183-9461-c3ae55e8ea0d None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:07.196072 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a1ef9-04b8-4183-9461-c3ae55e8ea0d None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:07.196361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a1ef9-04b8-4183-9461-c3ae55e8ea0d None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:07.197162 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a1ef9-04b8-4183-9461-c3ae55e8ea0d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:07.197605 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a1ef9-04b8-4183-9461-c3ae55e8ea0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:07.199544 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a1ef9-04b8-4183-9461-c3ae55e8ea0d None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:07.207242 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 409/798] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 9 15:20:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:07.208448 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a1ef9-04b8-4183-9461-c3ae55e8ea0d None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:07.227087 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ae182-4fd4-4757-ab62-4f3aced52fdc None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:07.273411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251fc11-c140-4f41-ba57-f6cbff36a511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:07.274104 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251fc11-c140-4f41-ba57-f6cbff36a511 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:07.274392 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251fc11-c140-4f41-ba57-f6cbff36a511 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:07.275043 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251fc11-c140-4f41-ba57-f6cbff36a511 None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:07.276229 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251fc11-c140-4f41-ba57-f6cbff36a511 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:07.276553 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251fc11-c140-4f41-ba57-f6cbff36a511 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:07.278517 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251fc11-c140-4f41-ba57-f6cbff36a511 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:07.302753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 390/799] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 9 15:20:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:07.304329 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251fc11-c140-4f41-ba57-f6cbff36a511 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:07.343003 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a1ef9-04b8-4183-9461-c3ae55e8ea0d None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:07.386311 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eac473-326a-455d-aab7-70b80df5accf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:07.387133 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eac473-326a-455d-aab7-70b80df5accf None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:07.387584 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eac473-326a-455d-aab7-70b80df5accf None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:07.387860 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eac473-326a-455d-aab7-70b80df5accf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:07.398450 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eac473-326a-455d-aab7-70b80df5accf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:07.400389 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eac473-326a-455d-aab7-70b80df5accf None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:07.420498 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-25eac473-326a-455d-aab7-70b80df5accf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:20:07.420498 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:07.420498 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:07.420498 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:07.420498 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:07.420498 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:07.420498 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:07.420498 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:07.420498 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:07.420498 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:07.420498 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:07.420498 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:07.420498 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:20:07.420498 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:20:07.420498 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:20:07.420498 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:20:07.423044 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:07.423044 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:07.423044 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:20:07.423044 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:07.423044 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:20:07.423044 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:07.423044 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:07.423044 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:07.423044 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:07.423044 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:07.423044 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:07.423044 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:07.423044 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:07.423044 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:07.423044 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:07.423044 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:07.423044 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:07.423044 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:07.425705 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:07.425705 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:07.425705 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:20:07.425705 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:20:07.425705 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:20:07.425705 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:20:07.425705 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:20:07.425705 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:20:07.425705 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:20:07.425705 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:07.425705 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 410/800] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:20:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:07.438800 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eac473-326a-455d-aab7-70b80df5accf None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:07.438987 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251fc11-c140-4f41-ba57-f6cbff36a511 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:07.470744 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f134f-ecab-463b-9f0c-07a7d2ec545e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:07.471424 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f134f-ecab-463b-9f0c-07a7d2ec545e None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:07.471713 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f134f-ecab-463b-9f0c-07a7d2ec545e None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:07.471994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f134f-ecab-463b-9f0c-07a7d2ec545e None admin] PATH_INFO: `/v3/endpoints` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:07.472810 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f134f-ecab-463b-9f0c-07a7d2ec545e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:07.474922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f134f-ecab-463b-9f0c-07a7d2ec545e None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:07.504668 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 391/801] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:20:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:20:07.505809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f134f-ecab-463b-9f0c-07a7d2ec545e None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:07.575403 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eac473-326a-455d-aab7-70b80df5accf None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:07.642066 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6ea08-aae1-4a20-b468-7e1821e0b74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:07.642907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6ea08-aae1-4a20-b468-7e1821e0b74f None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:07.643177 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6ea08-aae1-4a20-b468-7e1821e0b74f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:07.646414 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6ea08-aae1-4a20-b468-7e1821e0b74f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:07.671054 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6ea08-aae1-4a20-b468-7e1821e0b74f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:07.672452 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6ea08-aae1-4a20-b468-7e1821e0b74f None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:07.711260 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-c6d6ea08-aae1-4a20-b468-7e1821e0b74f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:07.711260 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:07.711260 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:07.711260 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:07.711260 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:07.711260 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:07.711260 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:07.711260 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:07.711260 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:07.711260 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:07.711260 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:07.711260 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:07.711260 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:07.711260 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:07.711260 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:07.713829 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:07.713829 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:07.713829 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:07.713829 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:07.713829 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:07.713829 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:07.713829 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:07.713829 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:07.713829 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:07.713829 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:07.713829 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:07.713829 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:07.713829 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:07.713829 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:07.713829 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:07.713829 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:07.713829 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:07.716250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:07.716250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:07.716250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:07.716250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:07.716250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 411/802] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:07.721702 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6ea08-aae1-4a20-b468-7e1821e0b74f None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:07.740987 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f134f-ecab-463b-9f0c-07a7d2ec545e None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:07.778153 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccad083-44a8-4827-8614-6e8575fc79bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:07.778840 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccad083-44a8-4827-8614-6e8575fc79bb None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:07.779127 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccad083-44a8-4827-8614-6e8575fc79bb None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:07.779407 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccad083-44a8-4827-8614-6e8575fc79bb None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:07.780269 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccad083-44a8-4827-8614-6e8575fc79bb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:07.780588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccad083-44a8-4827-8614-6e8575fc79bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:07.782071 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccad083-44a8-4827-8614-6e8575fc79bb None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:07.800992 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 392/803] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 9 15:20:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:07.819043 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccad083-44a8-4827-8614-6e8575fc79bb None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:07.831764 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6ea08-aae1-4a20-b468-7e1821e0b74f None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:07.867890 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccde568-37ff-4f2a-9e38-d8e25a3befee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:07.868581 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccde568-37ff-4f2a-9e38-d8e25a3befee None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:07.868866 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccde568-37ff-4f2a-9e38-d8e25a3befee None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:07.869153 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccde568-37ff-4f2a-9e38-d8e25a3befee None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:07.869933 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccde568-37ff-4f2a-9e38-d8e25a3befee None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:07.870246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccde568-37ff-4f2a-9e38-d8e25a3befee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:07.871704 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccde568-37ff-4f2a-9e38-d8e25a3befee None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:07.886388 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 412/804] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:07.897411 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccde568-37ff-4f2a-9e38-d8e25a3befee None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:07.982544 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccad083-44a8-4827-8614-6e8575fc79bb None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:08.007627 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccde568-37ff-4f2a-9e38-d8e25a3befee None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:08.046669 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6ae6a-b746-45c4-9f78-16a6ce880c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:08.047684 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6ae6a-b746-45c4-9f78-16a6ce880c58 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:08.047970 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6ae6a-b746-45c4-9f78-16a6ce880c58 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:08.048242 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6ae6a-b746-45c4-9f78-16a6ce880c58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:08.060223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70b2c6-6fa9-4b0a-9365-d62f5897a26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:08.061055 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70b2c6-6fa9-4b0a-9365-d62f5897a26f None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:08.061338 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70b2c6-6fa9-4b0a-9365-d62f5897a26f None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:08.061645 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70b2c6-6fa9-4b0a-9365-d62f5897a26f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:08.071497 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a6ae6a-b746-45c4-9f78-16a6ce880c58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:08.072970 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a6ae6a-b746-45c4-9f78-16a6ce880c58 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:08.085597 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70b2c6-6fa9-4b0a-9365-d62f5897a26f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:08.087055 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70b2c6-6fa9-4b0a-9365-d62f5897a26f None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:08.107405 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-c5a6ae6a-b746-45c4-9f78-16a6ce880c58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:08.107405 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:08.107405 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:08.107405 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:08.107405 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:08.107405 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:08.107405 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:08.107405 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:08.107405 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:08.107405 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:08.107405 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:08.107405 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:08.107405 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:20:08.107405 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:20:08.107405 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:20:08.108527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:20:08.108527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:08.108527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:08.108527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:08.108527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:08.108527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:08.108527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:08.108527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:08.108527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:08.108527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:08.108527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:08.108527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:08.108527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:08.108527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:08.108527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:08.108527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:08.108527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:08.110580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:20:08.110580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:20:08.110580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:20:08.110580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:20:08.110580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:20:08.110580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:20:08.110580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:08.110580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:08.110580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 413/805] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:20:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:08.119081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6ae6a-b746-45c4-9f78-16a6ce880c58 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:08.123908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-9a70b2c6-6fa9-4b0a-9365-d62f5897a26f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:08.123908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:08.123908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:08.123908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:08.123908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:08.123908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:08.123908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:08.123908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:08.123908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:08.123908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:08.123908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:08.123908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:08.123908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:08.123908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:08.123908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:08.124949 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:08.124949 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:08.124949 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:08.124949 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:08.124949 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:08.124949 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:08.124949 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:08.124949 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:08.124949 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:08.124949 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:08.124949 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:08.124949 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:08.124949 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:08.124949 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:08.124949 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:08.124949 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:08.124949 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:08.127824 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:08.127824 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:08.127824 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:08.127824 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:08.127824 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 393/806] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:08.137071 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70b2c6-6fa9-4b0a-9365-d62f5897a26f None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:08.236524 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6ae6a-b746-45c4-9f78-16a6ce880c58 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:08.286190 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a28a0-4a8e-449f-9e82-8b75e8893d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:08.286590 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a28a0-4a8e-449f-9e82-8b75e8893d76 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:08.286841 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a28a0-4a8e-449f-9e82-8b75e8893d76 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:08.289400 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a28a0-4a8e-449f-9e82-8b75e8893d76 None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:08.289400 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a28a0-4a8e-449f-9e82-8b75e8893d76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:08.289400 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a28a0-4a8e-449f-9e82-8b75e8893d76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:08.289987 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a28a0-4a8e-449f-9e82-8b75e8893d76 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:08.317539 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 414/807] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:20:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:08.323978 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a28a0-4a8e-449f-9e82-8b75e8893d76 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:08.367099 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70b2c6-6fa9-4b0a-9365-d62f5897a26f None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:08.439140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c912187-eeb4-41d3-b8fe-b173d2e67921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:08.439851 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c912187-eeb4-41d3-b8fe-b173d2e67921 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:08.440163 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c912187-eeb4-41d3-b8fe-b173d2e67921 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:08.440410 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c912187-eeb4-41d3-b8fe-b173d2e67921 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:08.441182 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c912187-eeb4-41d3-b8fe-b173d2e67921 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:08.445411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c912187-eeb4-41d3-b8fe-b173d2e67921 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:08.445411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c912187-eeb4-41d3-b8fe-b173d2e67921 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:08.459521 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 394/808] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:08.469399 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c912187-eeb4-41d3-b8fe-b173d2e67921 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:08.530257 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a28a0-4a8e-449f-9e82-8b75e8893d76 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:08.577516 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0553a-f7a9-4fe0-ab8c-7d4578788892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:08.578914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0553a-f7a9-4fe0-ab8c-7d4578788892 None admin] REQUEST_METHOD: `PUT` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:08.579444 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0553a-f7a9-4fe0-ab8c-7d4578788892 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:08.579970 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0553a-f7a9-4fe0-ab8c-7d4578788892 None admin] PATH_INFO: `/v3/projects/eb2de9bea1cf451db5f8c697f480c480/users/dda2a8271a764e65bb97e316410b91b1/roles/9aaa841361294b9c9b275ca1be0ed89c` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:08.582721 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0553a-f7a9-4fe0-ab8c-7d4578788892 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb2de9bea1cf451db5f8c697f480c480, user_id=dda2a8271a764e65bb97e316410b91b1, role_id=9aaa841361294b9c9b275ca1be0ed89c)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:08.584645 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0553a-f7a9-4fe0-ab8c-7d4578788892 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:08.603140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c912187-eeb4-41d3-b8fe-b173d2e67921 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:08.612885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 415/809] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:20:08 2022] PUT /identity/v3/projects/eb2de9bea1cf451db5f8c697f480c480/users/dda2a8271a764e65bb97e316410b91b1/roles/9aaa841361294b9c9b275ca1be0ed89c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:20:08.616578 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a44690-0578-4d78-8bd0-7c4cdba28b75 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:08.621124 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a44690-0578-4d78-8bd0-7c4cdba28b75 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:08.621124 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a44690-0578-4d78-8bd0-7c4cdba28b75 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:08.621124 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 416/810] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:08.626389 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327a47c-836d-430d-b77b-1105726dd42e None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:08.626797 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327a47c-836d-430d-b77b-1105726dd42e None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:08.627190 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327a47c-836d-430d-b77b-1105726dd42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:08.655699 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf86a6-1387-4c77-ba97-c77b3a4d3ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:08.656524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf86a6-1387-4c77-ba97-c77b3a4d3ee5 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:08.656810 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf86a6-1387-4c77-ba97-c77b3a4d3ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:08.657137 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf86a6-1387-4c77-ba97-c77b3a4d3ee5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:08.658717 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-0327a47c-836d-430d-b77b-1105726dd42e None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:08.665724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-0327a47c-836d-430d-b77b-1105726dd42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:08.667482 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf86a6-1387-4c77-ba97-c77b3a4d3ee5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:08.670318 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf86a6-1387-4c77-ba97-c77b3a4d3ee5 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:08.686989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-1aaf86a6-1387-4c77-ba97-c77b3a4d3ee5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:08.686989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:08.686989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:08.686989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:08.686989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:08.686989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:08.686989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:08.686989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:08.686989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:08.686989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:08.686989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:08.686989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:08.686989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:20:08.686989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:20:08.686989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:20:08.688094 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:20:08.688094 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:08.688094 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:08.688094 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:08.688094 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:08.688094 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:08.688094 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:08.688094 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:08.688094 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:08.688094 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:08.688094 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:08.688094 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:08.688094 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:08.688094 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:08.688094 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:08.688094 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:08.688094 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:08.689600 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:20:08.689600 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:20:08.689600 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:20:08.689600 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:20:08.689600 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:20:08.689600 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:20:08.689600 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:08.689600 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:08.689600 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 395/811] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:20:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:08.690283 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995db2e-0196-4ab5-8d4e-7d785066d224 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:08.690574 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995db2e-0196-4ab5-8d4e-7d785066d224 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:08.693293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995db2e-0196-4ab5-8d4e-7d785066d224 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:08.693293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 396/812] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:08.696579 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995db2e-0196-4ab5-8d4e-7d785066d224 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:08.758725 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 417/813] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:08.760285 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e2e32-d44a-4ff6-b0de-acce84edc52c None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:08.760645 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e2e32-d44a-4ff6-b0de-acce84edc52c None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:08.760994 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e2e32-d44a-4ff6-b0de-acce84edc52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:08.781261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-0b0e2e32-d44a-4ff6-b0de-acce84edc52c None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:08.782536 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-0b0e2e32-d44a-4ff6-b0de-acce84edc52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:08.876563 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995db2e-0196-4ab5-8d4e-7d785066d224 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:08.878024 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 418/814] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:08.880909 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e2e32-d44a-4ff6-b0de-acce84edc52c None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:08.915606 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a418858-f87e-41a5-8e24-9e5b36ba6a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:08.916271 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a418858-f87e-41a5-8e24-9e5b36ba6a39 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:08.916564 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a418858-f87e-41a5-8e24-9e5b36ba6a39 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:08.916845 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a418858-f87e-41a5-8e24-9e5b36ba6a39 None admin] PATH_INFO: `/v3/projects` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:08.917705 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a418858-f87e-41a5-8e24-9e5b36ba6a39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:08.918017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a418858-f87e-41a5-8e24-9e5b36ba6a39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:08.919553 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a418858-f87e-41a5-8e24-9e5b36ba6a39 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:08.934061 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 397/815] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:20:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:08.935100 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a418858-f87e-41a5-8e24-9e5b36ba6a39 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:09.016382 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e2e32-d44a-4ff6-b0de-acce84edc52c None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:09.048608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a418858-f87e-41a5-8e24-9e5b36ba6a39 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:09.062130 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3def2e-624e-4221-884b-5f63bb8c4ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:09.063475 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3def2e-624e-4221-884b-5f63bb8c4ad9 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:09.063922 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3def2e-624e-4221-884b-5f63bb8c4ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:09.064551 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3def2e-624e-4221-884b-5f63bb8c4ad9 None admin] PATH_INFO: `/v3/services/network` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:09.065918 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3def2e-624e-4221-884b-5f63bb8c4ad9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:09.068131 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3def2e-624e-4221-884b-5f63bb8c4ad9 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:09.084831 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-4c3def2e-624e-4221-884b-5f63bb8c4ad9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:20:09.084831 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:09.084831 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:20:09.084831 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:20:09.084831 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:20:09.084831 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:20:09.084831 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:20:09.084831 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:09.084831 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:20:09.084831 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:09.084831 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:20:09.084831 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:09.084831 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:09.084831 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:09.084831 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:09.084831 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:09.084831 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:09.086258 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:09.086258 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:09.086258 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:09.086258 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:09.086258 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:09.086258 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:09.086258 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:20:09.086258 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:20:09.086258 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:20:09.086258 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:20:09.086258 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:09.086258 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:09.086258 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:09.086258 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:09.086258 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:09.086258 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:09.087437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:09.087437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:09.087437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:09.087437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:09.087437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:09.087437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:09.087437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:09.087437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:09.087437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:09.087437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:09.087437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:20:09.087437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:09.087437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:20:09.087437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:09.089560 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2124f93-6ec1-44d5-8b53-2d021e9f4cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:09.090365 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 419/816] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:20:08 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:09.090521 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2124f93-6ec1-44d5-8b53-2d021e9f4cb3 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:09.090986 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2124f93-6ec1-44d5-8b53-2d021e9f4cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:09.091371 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2124f93-6ec1-44d5-8b53-2d021e9f4cb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:09.091875 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3def2e-624e-4221-884b-5f63bb8c4ad9 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:09.103809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2124f93-6ec1-44d5-8b53-2d021e9f4cb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:20:09.112175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-c2124f93-6ec1-44d5-8b53-2d021e9f4cb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:20:09.112175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:09.112175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:09.112175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:09.112175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:09.112175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:09.112175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:09.112175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:09.112175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:09.112175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:09.112175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:09.112175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:09.112175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:20:09.112175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:20:09.112175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:20:09.112175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:20:09.114289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:20:09.114289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:20:09.114289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:20:09.114289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:20:09.114289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:09.114289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:09.114289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:09.114289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:09.114289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:09.114289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:09.114289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:09.114289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:09.114289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:09.114289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:09.114289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:09.114289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:09.115587 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:09.115587 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:09.115587 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:09.115587 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:09.115587 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:20:09.115587 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:20:09.115587 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:20:09.115587 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:20:09.115587 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:20:09.115587 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:20:09.115587 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:20:09.115587 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:09.116315 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 398/817] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:20:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:09.117528 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2124f93-6ec1-44d5-8b53-2d021e9f4cb3 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:09.234512 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2124f93-6ec1-44d5-8b53-2d021e9f4cb3 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:09.241254 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3def2e-624e-4221-884b-5f63bb8c4ad9 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:09.277348 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2e27a-da8c-4de6-9e85-01f5a478b02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:09.278319 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2e27a-da8c-4de6-9e85-01f5a478b02d None admin] REQUEST_METHOD: `PUT` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:09.278601 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2e27a-da8c-4de6-9e85-01f5a478b02d None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:09.278878 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2e27a-da8c-4de6-9e85-01f5a478b02d None admin] PATH_INFO: `/v3/projects/eb2de9bea1cf451db5f8c697f480c480/users/ed964c5d606a4934b5bd9bd5890562ad/roles/7d8a1698372145a59d70d67ed7867f56` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:09.283802 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38acd56-2ad0-407d-9e8b-456c5f5e180f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:09.284661 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38acd56-2ad0-407d-9e8b-456c5f5e180f None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:09.285178 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38acd56-2ad0-407d-9e8b-456c5f5e180f None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:09.286302 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38acd56-2ad0-407d-9e8b-456c5f5e180f None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:09.287279 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38acd56-2ad0-407d-9e8b-456c5f5e180f None admin] RBAC: Adding query filter params (name=network) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:09.287767 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38acd56-2ad0-407d-9e8b-456c5f5e180f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:09.289398 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38acd56-2ad0-407d-9e8b-456c5f5e180f None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:09.294772 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 399/818] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:20:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:09.295933 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38acd56-2ad0-407d-9e8b-456c5f5e180f None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:09.297681 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2e27a-da8c-4de6-9e85-01f5a478b02d None admin] RBAC: Authorizing `identity:create_grant(project_id=eb2de9bea1cf451db5f8c697f480c480, user_id=ed964c5d606a4934b5bd9bd5890562ad, role_id=7d8a1698372145a59d70d67ed7867f56)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:09.299473 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2e27a-da8c-4de6-9e85-01f5a478b02d None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:09.325425 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 420/819] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:20:09 2022] PUT /identity/v3/projects/eb2de9bea1cf451db5f8c697f480c480/users/ed964c5d606a4934b5bd9bd5890562ad/roles/7d8a1698372145a59d70d67ed7867f56 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:20:09.325425 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2e27a-da8c-4de6-9e85-01f5a478b02d None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:09.470226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2e27a-da8c-4de6-9e85-01f5a478b02d None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:09.536828 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f6cab-11dc-4ce3-bbc5-6f092c60e4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:09.536828 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f6cab-11dc-4ce3-bbc5-6f092c60e4f9 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:09.537425 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f6cab-11dc-4ce3-bbc5-6f092c60e4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:09.537909 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f6cab-11dc-4ce3-bbc5-6f092c60e4f9 None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:09.540050 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f6cab-11dc-4ce3-bbc5-6f092c60e4f9 None admin] RBAC: Adding query filter params (type=network) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:09.540050 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f6cab-11dc-4ce3-bbc5-6f092c60e4f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:09.540710 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f6cab-11dc-4ce3-bbc5-6f092c60e4f9 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:09.553751 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 421/820] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:20:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:09.556171 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f6cab-11dc-4ce3-bbc5-6f092c60e4f9 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:09.561517 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38acd56-2ad0-407d-9e8b-456c5f5e180f None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:09.622468 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309c5a3-1b2a-44aa-9868-ba8bfb96ad4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:09.623182 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309c5a3-1b2a-44aa-9868-ba8bfb96ad4d None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:09.623534 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309c5a3-1b2a-44aa-9868-ba8bfb96ad4d None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:09.623826 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309c5a3-1b2a-44aa-9868-ba8bfb96ad4d None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:09.624949 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309c5a3-1b2a-44aa-9868-ba8bfb96ad4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:09.625278 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309c5a3-1b2a-44aa-9868-ba8bfb96ad4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:09.627155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309c5a3-1b2a-44aa-9868-ba8bfb96ad4d None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:09.640577 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 400/821] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:20:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:09.649677 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309c5a3-1b2a-44aa-9868-ba8bfb96ad4d None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:09.739065 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f6cab-11dc-4ce3-bbc5-6f092c60e4f9 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:09.814093 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2392f9-86e5-4841-b62d-0ea63e597035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:09.815185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2392f9-86e5-4841-b62d-0ea63e597035 None admin] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:09.815710 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2392f9-86e5-4841-b62d-0ea63e597035 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:09.816211 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2392f9-86e5-4841-b62d-0ea63e597035 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:09.817361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2392f9-86e5-4841-b62d-0ea63e597035 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:09.825402 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2392f9-86e5-4841-b62d-0ea63e597035 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:09.826251 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309c5a3-1b2a-44aa-9868-ba8bfb96ad4d None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:09.862840 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840931b-2996-42ab-98e1-4154f28d2791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:09.864189 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840931b-2996-42ab-98e1-4154f28d2791 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:09.864899 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840931b-2996-42ab-98e1-4154f28d2791 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:09.865340 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840931b-2996-42ab-98e1-4154f28d2791 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:09.877470 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840931b-2996-42ab-98e1-4154f28d2791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:09.879385 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840931b-2996-42ab-98e1-4154f28d2791 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:09.891327 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 422/822] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:20:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:20:09.897887 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-5840931b-2996-42ab-98e1-4154f28d2791 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:09.897887 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:09.897887 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:09.897887 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:09.897887 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:09.897887 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:09.897887 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:09.897887 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:09.897887 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:09.897887 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:09.897887 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:09.897887 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:09.897887 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:09.897887 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:09.897887 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:09.898994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:09.898994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:09.898994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:09.898994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:09.898994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:09.898994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:09.898994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:09.898994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:09.898994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:09.898994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:09.898994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:09.898994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:09.898994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:09.898994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:09.898994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:09.898994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:09.898994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:09.900017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:09.900017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:09.900017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:09.900017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:09.900017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 401/823] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:09.906183 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2392f9-86e5-4841-b62d-0ea63e597035 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:10.065638 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2392f9-86e5-4841-b62d-0ea63e597035 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:10.105264 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2111564-b605-48eb-a71b-c1d86145a5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:10.105980 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2111564-b605-48eb-a71b-c1d86145a5ae None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:10.106269 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2111564-b605-48eb-a71b-c1d86145a5ae None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:10.106552 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2111564-b605-48eb-a71b-c1d86145a5ae None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:10.107307 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2111564-b605-48eb-a71b-c1d86145a5ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:10.107620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2111564-b605-48eb-a71b-c1d86145a5ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:10.109018 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2111564-b605-48eb-a71b-c1d86145a5ae None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:10.123292 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 423/824] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:10.129449 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840931b-2996-42ab-98e1-4154f28d2791 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:10.251989 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840931b-2996-42ab-98e1-4154f28d2791 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:10.292094 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25330543-0693-4a20-b23c-b8f5f29a2476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:10.292910 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25330543-0693-4a20-b23c-b8f5f29a2476 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:10.293200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25330543-0693-4a20-b23c-b8f5f29a2476 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:10.293509 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25330543-0693-4a20-b23c-b8f5f29a2476 None admin] PATH_INFO: `/v3/users/nova` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:10.305747 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25330543-0693-4a20-b23c-b8f5f29a2476 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:10.307224 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25330543-0693-4a20-b23c-b8f5f29a2476 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:10.322925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-25330543-0693-4a20-b23c-b8f5f29a2476 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:20:10.322925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:10.322925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:10.322925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:10.322925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:10.322925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:10.322925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:10.322925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:10.322925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:10.322925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:10.322925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:10.322925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:10.322925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:20:10.322925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:20:10.322925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:20:10.322925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:20:10.323992 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:10.323992 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:10.323992 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:20:10.323992 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:10.323992 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:20:10.323992 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:10.323992 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:10.323992 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:10.323992 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:10.323992 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:10.323992 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:10.323992 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:10.323992 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:10.323992 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:10.323992 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:10.323992 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:10.323992 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:10.323992 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:10.325124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:10.325124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:10.325124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:20:10.325124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:20:10.325124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:20:10.325124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:20:10.325124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:20:10.325124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:20:10.325124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:20:10.325124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:10.325124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 402/825] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:20:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:10.333396 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2111564-b605-48eb-a71b-c1d86145a5ae None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:10.376834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe0b7c-1875-40a2-abb7-82def76378df None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:10.377189 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe0b7c-1875-40a2-abb7-82def76378df None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:10.377585 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe0b7c-1875-40a2-abb7-82def76378df None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:10.379369 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 403/826] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:10.384475 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb56db-fe26-4ea5-b098-8bc8ee27ebc5 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:10.384763 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb56db-fe26-4ea5-b098-8bc8ee27ebc5 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:10.385046 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb56db-fe26-4ea5-b098-8bc8ee27ebc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:10.404101 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-2bcb56db-fe26-4ea5-b098-8bc8ee27ebc5 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:10.405301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-2bcb56db-fe26-4ea5-b098-8bc8ee27ebc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:10.467169 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2111564-b605-48eb-a71b-c1d86145a5ae None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:10.507059 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392541c9-0021-4ad7-b996-9119d3f2f014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:10.507767 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392541c9-0021-4ad7-b996-9119d3f2f014 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:10.508057 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392541c9-0021-4ad7-b996-9119d3f2f014 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:10.508336 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392541c9-0021-4ad7-b996-9119d3f2f014 None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:10.509211 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392541c9-0021-4ad7-b996-9119d3f2f014 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:10.509555 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392541c9-0021-4ad7-b996-9119d3f2f014 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:10.509727 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 404/827] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:20:10.511127 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392541c9-0021-4ad7-b996-9119d3f2f014 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:10.533405 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb56db-fe26-4ea5-b098-8bc8ee27ebc5 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:10.539190 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 424/828] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:20:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:10.544705 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392541c9-0021-4ad7-b996-9119d3f2f014 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:10.651177 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb56db-fe26-4ea5-b098-8bc8ee27ebc5 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:10.688065 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2120c-c3a2-41d7-82d0-c035d8ff4159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:10.688875 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2120c-c3a2-41d7-82d0-c035d8ff4159 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:10.689162 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2120c-c3a2-41d7-82d0-c035d8ff4159 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:10.689484 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2120c-c3a2-41d7-82d0-c035d8ff4159 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:10.690153 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2120c-c3a2-41d7-82d0-c035d8ff4159 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:10.690510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392541c9-0021-4ad7-b996-9119d3f2f014 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:10.692259 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2120c-c3a2-41d7-82d0-c035d8ff4159 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:10.708276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-b7d2120c-c3a2-41d7-82d0-c035d8ff4159 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:20:10.708276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:10.708276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:20:10.708276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:20:10.708276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:20:10.708276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:20:10.708276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:20:10.708276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:10.708276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:20:10.708276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:10.708276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:20:10.708276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:10.708276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:10.708276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:10.708276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:10.708276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:10.708276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:10.709548 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:10.709548 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:10.709548 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:10.709548 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:10.709548 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:10.709548 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:10.709548 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:20:10.709548 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:20:10.709548 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:20:10.709548 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:20:10.709548 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:10.709548 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:10.709548 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:10.709548 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:10.709548 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:10.709548 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:10.711140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:10.711140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:10.711140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:10.711140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:10.711140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:10.711140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:10.711140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:10.711140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:10.711140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:10.711140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:10.711140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:20:10.711140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:10.711140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:20:10.711140 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:10.713456 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 405/829] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:20:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:10.716427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2120c-c3a2-41d7-82d0-c035d8ff4159 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:10.737016 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194e562-059b-45c0-a713-25b581c26657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:10.738526 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194e562-059b-45c0-a713-25b581c26657 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:10.738653 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194e562-059b-45c0-a713-25b581c26657 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:10.738930 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194e562-059b-45c0-a713-25b581c26657 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:10.835333 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194e562-059b-45c0-a713-25b581c26657 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:10.835696 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2120c-c3a2-41d7-82d0-c035d8ff4159 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:10.837627 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194e562-059b-45c0-a713-25b581c26657 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:10.870581 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d5a61-9800-49e9-99cc-cc22514f852d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:10.871316 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d5a61-9800-49e9-99cc-cc22514f852d None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:10.871672 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d5a61-9800-49e9-99cc-cc22514f852d None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:10.872038 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d5a61-9800-49e9-99cc-cc22514f852d None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:10.872825 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d5a61-9800-49e9-99cc-cc22514f852d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:10.873199 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d5a61-9800-49e9-99cc-cc22514f852d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:10.874909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d5a61-9800-49e9-99cc-cc22514f852d None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:10.884856 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 406/830] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:20:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:10.886169 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d5a61-9800-49e9-99cc-cc22514f852d None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:10.970317 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 425/831] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:20:10 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:20:10.977413 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194e562-059b-45c0-a713-25b581c26657 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:10.994917 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d5a61-9800-49e9-99cc-cc22514f852d None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:11.038601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073893bc-aa51-49c0-a884-1d3e08032190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:11.039666 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073893bc-aa51-49c0-a884-1d3e08032190 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:11.040464 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073893bc-aa51-49c0-a884-1d3e08032190 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:11.040967 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073893bc-aa51-49c0-a884-1d3e08032190 None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:11.042208 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073893bc-aa51-49c0-a884-1d3e08032190 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:11.042595 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073893bc-aa51-49c0-a884-1d3e08032190 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:11.044075 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073893bc-aa51-49c0-a884-1d3e08032190 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:11.057586 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 407/832] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:20:10 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:11.085135 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194e562-059b-45c0-a713-25b581c26657 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:11.126136 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34ffae-f87e-4139-8d79-72a892cc4d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:11.127280 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34ffae-f87e-4139-8d79-72a892cc4d0b None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:11.127754 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34ffae-f87e-4139-8d79-72a892cc4d0b None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:11.128253 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34ffae-f87e-4139-8d79-72a892cc4d0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:11.141439 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34ffae-f87e-4139-8d79-72a892cc4d0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:11.143518 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34ffae-f87e-4139-8d79-72a892cc4d0b None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:11.165673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-9e34ffae-f87e-4139-8d79-72a892cc4d0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:11.165673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:11.165673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:11.165673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:11.165673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:11.165673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:11.165673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:11.165673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:11.165673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:11.165673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:11.165673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:11.165673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:11.165673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:11.165673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:11.165673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:11.166885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:11.166885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:11.166885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:11.166885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:11.166885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:11.166885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:11.166885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:11.166885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:11.166885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:11.166885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:11.166885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:11.166885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:11.166885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:11.166885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:11.166885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:11.166885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:11.166885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:11.168069 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:11.168069 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:11.168069 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:11.168069 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:11.170332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 426/833] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:11.177073 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073893bc-aa51-49c0-a884-1d3e08032190 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:11.266857 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a45b5c-eb4c-456c-85c8-f4af9cea4395 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:11.267060 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a45b5c-eb4c-456c-85c8-f4af9cea4395 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:11.267327 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a45b5c-eb4c-456c-85c8-f4af9cea4395 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:11.269010 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 427/834] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:20:11.275712 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f9eb6-e030-4c8f-9af1-6fb2224165ea None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:11.275930 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f9eb6-e030-4c8f-9af1-6fb2224165ea None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:11.276178 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f9eb6-e030-4c8f-9af1-6fb2224165ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:11.293583 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-cd4f9eb6-e030-4c8f-9af1-6fb2224165ea None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:11.294789 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-cd4f9eb6-e030-4c8f-9af1-6fb2224165ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:11.321178 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073893bc-aa51-49c0-a884-1d3e08032190 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:11.361840 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dfed5-9bc1-4265-bb2c-c9615b26e0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:11.362515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dfed5-9bc1-4265-bb2c-c9615b26e0a8 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:11.362801 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dfed5-9bc1-4265-bb2c-c9615b26e0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:11.363085 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dfed5-9bc1-4265-bb2c-c9615b26e0a8 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:11.364887 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676dfed5-9bc1-4265-bb2c-c9615b26e0a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:11.365204 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676dfed5-9bc1-4265-bb2c-c9615b26e0a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:11.367108 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676dfed5-9bc1-4265-bb2c-c9615b26e0a8 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:11.382157 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 428/835] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:11.389529 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 408/836] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:11.390939 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dfed5-9bc1-4265-bb2c-c9615b26e0a8 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:11.411961 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f9eb6-e030-4c8f-9af1-6fb2224165ea None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:11.519993 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dfed5-9bc1-4265-bb2c-c9615b26e0a8 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:11.525726 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f9eb6-e030-4c8f-9af1-6fb2224165ea None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:11.571416 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5fa6d-3a50-432e-9312-bd73578ee90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:11.572317 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5fa6d-3a50-432e-9312-bd73578ee90b None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:11.572690 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5fa6d-3a50-432e-9312-bd73578ee90b None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:11.573028 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5fa6d-3a50-432e-9312-bd73578ee90b None admin] PATH_INFO: `/v3/projects/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:11.577522 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda8163-16d0-4cec-a6ae-5b1b25c16cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:11.578658 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda8163-16d0-4cec-a6ae-5b1b25c16cda None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:11.579145 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda8163-16d0-4cec-a6ae-5b1b25c16cda None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:11.579609 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda8163-16d0-4cec-a6ae-5b1b25c16cda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:11.581265 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5fa6d-3a50-432e-9312-bd73578ee90b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:11.583520 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5fa6d-3a50-432e-9312-bd73578ee90b None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:11.594164 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda8163-16d0-4cec-a6ae-5b1b25c16cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:20:11.598414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-eda5fa6d-3a50-432e-9312-bd73578ee90b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:11.598414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:11.598414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:11.598414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:11.598414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:11.598414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:11.598414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:11.598414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:11.598414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:11.598414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:11.598414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:11.598414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:11.598414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:20:11.598414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:20:11.598414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:20:11.599716 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:20:11.599716 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:11.599716 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:11.599716 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:11.599716 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:11.599716 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:11.599716 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:11.599716 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:11.599716 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:11.599716 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:11.599716 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:11.599716 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:11.599716 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:11.599716 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:11.599716 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:11.599716 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:11.599716 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:11.600775 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:20:11.600775 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:20:11.600775 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:20:11.600775 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:20:11.600775 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:20:11.600775 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:20:11.600775 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:11.600775 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:11.604805 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 409/837] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:20:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:11.605826 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5fa6d-3a50-432e-9312-bd73578ee90b None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:11.606298 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-5eda8163-16d0-4cec-a6ae-5b1b25c16cda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:20:11.606298 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:11.606298 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:11.606298 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:11.606298 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:11.606298 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:11.606298 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:11.606298 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:11.606298 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:11.606298 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:11.606298 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:11.606298 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:11.606298 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:20:11.606298 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:20:11.606298 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:20:11.606298 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:20:11.607575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:20:11.607575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:20:11.607575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:20:11.607575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:20:11.607575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:11.607575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:11.607575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:11.607575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:11.607575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:11.607575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:11.607575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:11.607575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:11.607575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:11.607575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:11.607575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:11.607575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:11.608740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:11.608740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:11.608740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:11.608740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:11.608740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:20:11.608740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:20:11.608740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:20:11.608740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:20:11.608740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:20:11.608740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:20:11.608740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:20:11.608740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:11.618504 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 429/838] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:20:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:11.619114 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda8163-16d0-4cec-a6ae-5b1b25c16cda None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:11.737347 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5fa6d-3a50-432e-9312-bd73578ee90b None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:11.743137 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda8163-16d0-4cec-a6ae-5b1b25c16cda None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:11.779801 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc138311-885a-4b1b-91a8-22df05acd8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:11.780151 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e9294-8ae2-471b-9def-9c68b1a904ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:11.780783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e9294-8ae2-471b-9def-9c68b1a904ba None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:11.781071 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e9294-8ae2-471b-9def-9c68b1a904ba None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:11.781348 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e9294-8ae2-471b-9def-9c68b1a904ba None admin] PATH_INFO: `/v3/projects` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:11.781767 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc138311-885a-4b1b-91a8-22df05acd8bf None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:11.782189 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e9294-8ae2-471b-9def-9c68b1a904ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:11.782502 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e9294-8ae2-471b-9def-9c68b1a904ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:11.782613 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc138311-885a-4b1b-91a8-22df05acd8bf None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:11.783093 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc138311-885a-4b1b-91a8-22df05acd8bf None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:11.783928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e9294-8ae2-471b-9def-9c68b1a904ba None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:11.784332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc138311-885a-4b1b-91a8-22df05acd8bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:11.784847 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc138311-885a-4b1b-91a8-22df05acd8bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:11.786678 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc138311-885a-4b1b-91a8-22df05acd8bf None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:11.800258 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 430/840] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:20:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:11.801450 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 410/840] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:20:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:11.804293 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc138311-885a-4b1b-91a8-22df05acd8bf None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:11.804431 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e9294-8ae2-471b-9def-9c68b1a904ba None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:11.914931 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc138311-885a-4b1b-91a8-22df05acd8bf None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:11.922741 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e9294-8ae2-471b-9def-9c68b1a904ba None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:11.949156 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c49af-220b-4eaf-ac98-88bfd10a39ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:11.950003 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c49af-220b-4eaf-ac98-88bfd10a39ba None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:11.950305 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c49af-220b-4eaf-ac98-88bfd10a39ba None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:11.950588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c49af-220b-4eaf-ac98-88bfd10a39ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:11.960316 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a35557-ef40-410c-b46d-cd06c1c2146e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:11.960998 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a35557-ef40-410c-b46d-cd06c1c2146e None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:11.961292 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a35557-ef40-410c-b46d-cd06c1c2146e None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:11.961604 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a35557-ef40-410c-b46d-cd06c1c2146e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:11.962457 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a35557-ef40-410c-b46d-cd06c1c2146e None admin] RBAC: Adding query filter params (role.id=9aaa841361294b9c9b275ca1be0ed89c, scope.project.id=eb2de9bea1cf451db5f8c697f480c480, user.id=42dc38d6c3634b7496b1b7e99ca3f647) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:11.962780 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a35557-ef40-410c-b46d-cd06c1c2146e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:11.963062 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c49af-220b-4eaf-ac98-88bfd10a39ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:11.964229 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a35557-ef40-410c-b46d-cd06c1c2146e None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:11.964499 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c49af-220b-4eaf-ac98-88bfd10a39ba None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:11.970565 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 411/841] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:20:11 2022] GET /identity/v3/role_assignments?user.id=42dc38d6c3634b7496b1b7e99ca3f647&scope.project.id=eb2de9bea1cf451db5f8c697f480c480&role.id=9aaa841361294b9c9b275ca1be0ed89c => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:11.972187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c69c5a-4fce-4ecf-95c1-f384a3569bce None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:11.974014 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c69c5a-4fce-4ecf-95c1-f384a3569bce None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:11.974360 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c69c5a-4fce-4ecf-95c1-f384a3569bce None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:11.975964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 412/842] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:11.981817 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303b2c0-3a0a-423e-a020-db435010fc52 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:11.982187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303b2c0-3a0a-423e-a020-db435010fc52 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:11.982384 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303b2c0-3a0a-423e-a020-db435010fc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:11.991632 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-a59c49af-220b-4eaf-ac98-88bfd10a39ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:11.991632 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:11.991632 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:11.991632 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:11.991632 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:11.991632 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:11.991632 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:11.991632 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:11.991632 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:11.991632 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:11.991632 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:11.991632 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:11.991632 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:11.991632 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:11.991632 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:11.992729 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:11.992729 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:11.992729 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:11.992729 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:11.992729 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:11.992729 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:11.992729 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:11.992729 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:11.992729 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:11.992729 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:11.992729 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:11.992729 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:11.992729 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:11.992729 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:11.992729 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:11.992729 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:11.992729 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:11.994186 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:11.994186 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:11.994186 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:11.994186 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:12.001293 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 431/843] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:12.002118 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-2303b2c0-3a0a-423e-a020-db435010fc52 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:12.002897 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c49af-220b-4eaf-ac98-88bfd10a39ba None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:12.003383 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-2303b2c0-3a0a-423e-a020-db435010fc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:12.085953 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 413/844] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:20:12.103728 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303b2c0-3a0a-423e-a020-db435010fc52 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:12.119463 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c49af-220b-4eaf-ac98-88bfd10a39ba None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:12.157962 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf66e7-90a7-4923-8e70-895450daff82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:12.158682 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf66e7-90a7-4923-8e70-895450daff82 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:12.158991 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf66e7-90a7-4923-8e70-895450daff82 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:12.159234 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf66e7-90a7-4923-8e70-895450daff82 None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:12.160100 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf66e7-90a7-4923-8e70-895450daff82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:12.160990 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf66e7-90a7-4923-8e70-895450daff82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:12.162854 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf66e7-90a7-4923-8e70-895450daff82 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:12.177442 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 432/845] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:12.183572 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf66e7-90a7-4923-8e70-895450daff82 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:12.248272 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303b2c0-3a0a-423e-a020-db435010fc52 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:12.294929 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6feaa-92da-477a-8210-adace9954f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:12.296164 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6feaa-92da-477a-8210-adace9954f0c None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:12.296457 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6feaa-92da-477a-8210-adace9954f0c None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:12.297199 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6feaa-92da-477a-8210-adace9954f0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:12.312524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6feaa-92da-477a-8210-adace9954f0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:20:12.316997 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf66e7-90a7-4923-8e70-895450daff82 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:12.322752 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-b8e6feaa-92da-477a-8210-adace9954f0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:20:12.322752 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:12.322752 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:12.322752 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:12.322752 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:12.322752 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:12.322752 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:12.322752 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:12.322752 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:12.322752 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:12.322752 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:12.322752 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:12.322752 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:20:12.322752 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:20:12.322752 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:20:12.322752 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:20:12.323827 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:20:12.323827 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:20:12.323827 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:20:12.323827 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:20:12.323827 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:12.323827 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:12.323827 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:12.323827 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:12.323827 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:12.323827 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:12.323827 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:12.323827 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:12.323827 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:12.323827 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:12.323827 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:12.323827 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:12.324762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:12.324762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:12.324762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:12.324762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:12.324762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:20:12.324762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:20:12.324762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:20:12.324762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:20:12.324762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:20:12.324762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:20:12.324762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:20:12.324762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:12.324762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 414/846] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:20:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:12.330168 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6feaa-92da-477a-8210-adace9954f0c None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:12.365600 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceab2b-1098-477e-8ab3-8fc115a4bb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:12.366410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceab2b-1098-477e-8ab3-8fc115a4bb62 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:12.366699 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceab2b-1098-477e-8ab3-8fc115a4bb62 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:12.366978 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceab2b-1098-477e-8ab3-8fc115a4bb62 None admin] PATH_INFO: `/v3/users/swift` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:12.377033 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceab2b-1098-477e-8ab3-8fc115a4bb62 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:12.378643 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceab2b-1098-477e-8ab3-8fc115a4bb62 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:12.395474 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-5bceab2b-1098-477e-8ab3-8fc115a4bb62 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:20:12.395474 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:12.395474 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:12.395474 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:12.395474 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:12.395474 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:12.395474 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:12.395474 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:12.395474 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:12.395474 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:12.395474 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:12.395474 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:12.395474 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:20:12.395474 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:20:12.395474 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:20:12.395474 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:20:12.398863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:12.398863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:12.398863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:20:12.398863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:12.398863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:20:12.398863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:12.398863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:12.398863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:12.398863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:12.398863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:12.398863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:12.398863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:12.398863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:12.398863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:12.398863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:12.398863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:12.398863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:12.398863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:12.401968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:12.401968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:12.401968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:20:12.401968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:20:12.401968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:20:12.401968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:20:12.401968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:20:12.401968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:20:12.401968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:20:12.401968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:12.401968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 433/847] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:20:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:12.409934 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceab2b-1098-477e-8ab3-8fc115a4bb62 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:12.446772 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6feaa-92da-477a-8210-adace9954f0c None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:12.483058 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274da7a9-d183-4ac8-b930-31961ba4d6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:12.483745 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274da7a9-d183-4ac8-b930-31961ba4d6ed None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:12.484035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274da7a9-d183-4ac8-b930-31961ba4d6ed None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:12.484318 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274da7a9-d183-4ac8-b930-31961ba4d6ed None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:12.485089 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274da7a9-d183-4ac8-b930-31961ba4d6ed None admin] RBAC: Adding query filter params (name=service) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:12.485433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274da7a9-d183-4ac8-b930-31961ba4d6ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:12.486879 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274da7a9-d183-4ac8-b930-31961ba4d6ed None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:12.500945 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 415/848] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:20:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:12.501931 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274da7a9-d183-4ac8-b930-31961ba4d6ed None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:12.515599 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceab2b-1098-477e-8ab3-8fc115a4bb62 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:12.557390 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c55c24-47d9-4219-a75d-a12edd169007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:12.557390 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c55c24-47d9-4219-a75d-a12edd169007 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:12.557390 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c55c24-47d9-4219-a75d-a12edd169007 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:12.557390 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c55c24-47d9-4219-a75d-a12edd169007 None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:12.558141 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c55c24-47d9-4219-a75d-a12edd169007 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:12.558141 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c55c24-47d9-4219-a75d-a12edd169007 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:12.558141 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c55c24-47d9-4219-a75d-a12edd169007 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:12.580090 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 434/849] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 9 15:20:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:12.581023 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c55c24-47d9-4219-a75d-a12edd169007 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:12.606986 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274da7a9-d183-4ac8-b930-31961ba4d6ed None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:12.643461 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae37037-aab6-47ee-97ae-0974f33502a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:12.644185 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae37037-aab6-47ee-97ae-0974f33502a0 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:12.644995 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae37037-aab6-47ee-97ae-0974f33502a0 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:12.645348 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae37037-aab6-47ee-97ae-0974f33502a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:12.657361 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae37037-aab6-47ee-97ae-0974f33502a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:12.658858 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae37037-aab6-47ee-97ae-0974f33502a0 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:12.677803 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-fae37037-aab6-47ee-97ae-0974f33502a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:12.677803 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:12.677803 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:12.677803 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:12.677803 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:12.677803 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:12.677803 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:12.677803 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:12.677803 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:12.677803 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:12.677803 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:12.677803 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:12.677803 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:12.677803 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:12.677803 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:12.680011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:12.680011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:12.680011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:12.680011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:12.680011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:12.680011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:12.680011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:12.680011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:12.680011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:12.680011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:12.680011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:12.680011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:12.680011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:12.680011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:12.680011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:12.680011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:12.680011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:12.682274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:12.682274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:12.682274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:12.682274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:12.689420 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 416/850] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:12.689420 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae37037-aab6-47ee-97ae-0974f33502a0 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:12.689895 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c55c24-47d9-4219-a75d-a12edd169007 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:12.722737 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d570f4-7d78-47c6-b9e5-934cbbf8d208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:12.723400 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d570f4-7d78-47c6-b9e5-934cbbf8d208 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:12.723685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d570f4-7d78-47c6-b9e5-934cbbf8d208 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:12.723964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d570f4-7d78-47c6-b9e5-934cbbf8d208 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:12.790255 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae37037-aab6-47ee-97ae-0974f33502a0 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:12.795480 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d570f4-7d78-47c6-b9e5-934cbbf8d208 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:12.797001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d570f4-7d78-47c6-b9e5-934cbbf8d208 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:12.827279 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598843b-58fe-446e-a856-6d2e5c5145de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:12.827961 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598843b-58fe-446e-a856-6d2e5c5145de None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:12.828251 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598843b-58fe-446e-a856-6d2e5c5145de None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:12.828535 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598843b-58fe-446e-a856-6d2e5c5145de None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:12.829279 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598843b-58fe-446e-a856-6d2e5c5145de None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:12.829624 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598843b-58fe-446e-a856-6d2e5c5145de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:12.831033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598843b-58fe-446e-a856-6d2e5c5145de None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:12.849635 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 417/851] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:12.850673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598843b-58fe-446e-a856-6d2e5c5145de None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:12.917625 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 435/852] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:20:12 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:20:12.918575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d570f4-7d78-47c6-b9e5-934cbbf8d208 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:12.979230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598843b-58fe-446e-a856-6d2e5c5145de None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:13.029931 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c628a-5de8-4d7f-a70f-5713e9f9d7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:13.030981 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c628a-5de8-4d7f-a70f-5713e9f9d7e7 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:13.031692 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c628a-5de8-4d7f-a70f-5713e9f9d7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:13.031984 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c628a-5de8-4d7f-a70f-5713e9f9d7e7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:13.034669 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d570f4-7d78-47c6-b9e5-934cbbf8d208 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:13.042751 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c628a-5de8-4d7f-a70f-5713e9f9d7e7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:13.044855 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c628a-5de8-4d7f-a70f-5713e9f9d7e7 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:13.067053 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-5f8c628a-5de8-4d7f-a70f-5713e9f9d7e7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:20:13.067053 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:13.067053 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:13.067053 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:13.067053 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:13.067053 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:13.067053 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:13.067053 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:13.067053 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:13.067053 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:13.067053 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:13.067053 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:13.067053 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:20:13.067053 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:20:13.067053 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:20:13.067053 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:20:13.073970 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:13.073970 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:13.073970 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:20:13.073970 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:13.073970 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:20:13.073970 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:13.073970 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:13.073970 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:13.073970 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:13.073970 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:13.073970 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:13.073970 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:13.073970 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:13.073970 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:13.073970 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:13.073970 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:13.073970 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:13.073970 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:13.075097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:13.075097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:13.075097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:20:13.075097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:20:13.075097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:20:13.075097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:20:13.075097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:20:13.075097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:20:13.075097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:20:13.075097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:13.075097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 418/853] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:20:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:13.075097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c628a-5de8-4d7f-a70f-5713e9f9d7e7 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:13.086179 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23ad7b-a57e-47a9-9eef-bcf212e65768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:13.087450 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23ad7b-a57e-47a9-9eef-bcf212e65768 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:13.088496 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23ad7b-a57e-47a9-9eef-bcf212e65768 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:13.089000 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23ad7b-a57e-47a9-9eef-bcf212e65768 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:13.104723 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23ad7b-a57e-47a9-9eef-bcf212e65768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:13.107477 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23ad7b-a57e-47a9-9eef-bcf212e65768 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:13.136246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-2d23ad7b-a57e-47a9-9eef-bcf212e65768 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:13.136246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:13.136246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:13.136246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:13.136246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:13.136246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:13.136246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:13.136246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:13.136246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:13.136246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:13.136246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:13.136246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:13.136246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:13.136246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:13.136246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:13.137404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:13.137404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:13.137404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:13.137404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:13.137404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:13.137404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:13.137404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:13.137404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:13.137404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:13.137404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:13.137404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:13.137404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:13.137404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:13.137404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:13.137404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:13.137404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:13.137404 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:13.138468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:13.138468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:13.138468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:13.138468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:13.145586 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 436/854] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:13.145586 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23ad7b-a57e-47a9-9eef-bcf212e65768 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:13.216494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c628a-5de8-4d7f-a70f-5713e9f9d7e7 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:13.263934 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85064d04-172b-4d7e-879a-cd4987b2f074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:13.265029 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85064d04-172b-4d7e-879a-cd4987b2f074 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:13.265478 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85064d04-172b-4d7e-879a-cd4987b2f074 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:13.266421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85064d04-172b-4d7e-879a-cd4987b2f074 None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:13.267802 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85064d04-172b-4d7e-879a-cd4987b2f074 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:13.268251 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85064d04-172b-4d7e-879a-cd4987b2f074 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:13.271073 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85064d04-172b-4d7e-879a-cd4987b2f074 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:13.291798 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23ad7b-a57e-47a9-9eef-bcf212e65768 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:13.295994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 419/855] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 9 15:20:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:13.302334 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85064d04-172b-4d7e-879a-cd4987b2f074 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:13.335465 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a11514-f7da-4ffa-95af-726e4d27b715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:13.336640 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a11514-f7da-4ffa-95af-726e4d27b715 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:13.337133 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a11514-f7da-4ffa-95af-726e4d27b715 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:13.337658 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a11514-f7da-4ffa-95af-726e4d27b715 None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:13.338632 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a11514-f7da-4ffa-95af-726e4d27b715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:13.339159 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a11514-f7da-4ffa-95af-726e4d27b715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:13.340763 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a11514-f7da-4ffa-95af-726e4d27b715 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:13.354587 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 437/856] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:13.360580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a11514-f7da-4ffa-95af-726e4d27b715 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:13.434312 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85064d04-172b-4d7e-879a-cd4987b2f074 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:13.479778 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695e47a-7b8c-476d-aeca-74fc73c38f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:13.480768 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695e47a-7b8c-476d-aeca-74fc73c38f65 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:13.481240 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695e47a-7b8c-476d-aeca-74fc73c38f65 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:13.481721 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695e47a-7b8c-476d-aeca-74fc73c38f65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:13.497349 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a11514-f7da-4ffa-95af-726e4d27b715 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:13.546011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff4d7a-43d0-44b7-afbb-af7a65455762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:13.546853 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff4d7a-43d0-44b7-afbb-af7a65455762 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:13.547134 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff4d7a-43d0-44b7-afbb-af7a65455762 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:13.547413 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff4d7a-43d0-44b7-afbb-af7a65455762 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:13.555975 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff4d7a-43d0-44b7-afbb-af7a65455762 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:13.557456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff4d7a-43d0-44b7-afbb-af7a65455762 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:13.567940 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695e47a-7b8c-476d-aeca-74fc73c38f65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:13.569451 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c695e47a-7b8c-476d-aeca-74fc73c38f65 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:13.572733 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-98ff4d7a-43d0-44b7-afbb-af7a65455762 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:13.572733 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:13.572733 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:13.572733 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:13.572733 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:13.572733 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:13.572733 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:13.572733 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:13.572733 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:13.572733 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:13.572733 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:13.572733 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:13.572733 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:20:13.572733 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:20:13.572733 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:20:13.574421 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:20:13.574421 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:13.574421 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:13.574421 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:13.574421 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:13.574421 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:13.574421 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:13.574421 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:13.574421 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:13.574421 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:13.574421 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:13.574421 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:13.574421 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:13.574421 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:13.574421 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:13.574421 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:13.574421 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:13.576159 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:20:13.576159 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:20:13.576159 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:20:13.576159 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:20:13.576159 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:20:13.576159 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:20:13.576159 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:13.576159 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:13.576159 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 438/857] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:20:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:13.576159 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf44ed7-acb7-457c-8229-b53a322ef1a7 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:13.576159 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf44ed7-acb7-457c-8229-b53a322ef1a7 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:13.577172 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf44ed7-acb7-457c-8229-b53a322ef1a7 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:13.578104 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 439/858] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:13.584494 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf44ed7-acb7-457c-8229-b53a322ef1a7 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:13.706085 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 420/859] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:20:13 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:20:13.706085 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d493ca-7a83-4c99-ada8-4b9559206ac6 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:13.706085 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d493ca-7a83-4c99-ada8-4b9559206ac6 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:13.706085 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d493ca-7a83-4c99-ada8-4b9559206ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:13.723315 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-b8d493ca-7a83-4c99-ada8-4b9559206ac6 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:13.725142 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-b8d493ca-7a83-4c99-ada8-4b9559206ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:13.731037 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf44ed7-acb7-457c-8229-b53a322ef1a7 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:13.777823 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c18ff-7474-436f-a553-dfcaf29ab53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:13.778819 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c18ff-7474-436f-a553-dfcaf29ab53a None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:13.779245 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c18ff-7474-436f-a553-dfcaf29ab53a None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:13.779691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c18ff-7474-436f-a553-dfcaf29ab53a None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:13.780938 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c18ff-7474-436f-a553-dfcaf29ab53a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:13.781472 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c18ff-7474-436f-a553-dfcaf29ab53a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:13.783801 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c18ff-7474-436f-a553-dfcaf29ab53a None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:13.801879 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 440/860] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:20:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:13.803244 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c18ff-7474-436f-a553-dfcaf29ab53a None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:13.821414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 421/861] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:13.821414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d493ca-7a83-4c99-ada8-4b9559206ac6 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:13.933026 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c18ff-7474-436f-a553-dfcaf29ab53a None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:13.948722 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d493ca-7a83-4c99-ada8-4b9559206ac6 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:13.980239 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0439adf-ed4b-4ed7-ae0a-895b0dd8ffee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:13.981654 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0439adf-ed4b-4ed7-ae0a-895b0dd8ffee None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:13.981849 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0439adf-ed4b-4ed7-ae0a-895b0dd8ffee None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:13.982056 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0439adf-ed4b-4ed7-ae0a-895b0dd8ffee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:13.989755 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc5404-f172-4596-86db-6d2c8700b972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:13.990439 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc5404-f172-4596-86db-6d2c8700b972 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:13.990765 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc5404-f172-4596-86db-6d2c8700b972 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:13.991015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc5404-f172-4596-86db-6d2c8700b972 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:13.991850 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc5404-f172-4596-86db-6d2c8700b972 None admin] RBAC: Adding query filter params (role.id=9aaa841361294b9c9b275ca1be0ed89c, scope.project.id=eb2de9bea1cf451db5f8c697f480c480, user.id=dda2a8271a764e65bb97e316410b91b1) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:13.992169 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc5404-f172-4596-86db-6d2c8700b972 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:13.993688 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc5404-f172-4596-86db-6d2c8700b972 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:13.996570 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0439adf-ed4b-4ed7-ae0a-895b0dd8ffee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:13.998171 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0439adf-ed4b-4ed7-ae0a-895b0dd8ffee None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:14.009769 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 422/862] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:20:13 2022] GET /identity/v3/role_assignments?user.id=dda2a8271a764e65bb97e316410b91b1&scope.project.id=eb2de9bea1cf451db5f8c697f480c480&role.id=9aaa841361294b9c9b275ca1be0ed89c => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:14.009769 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc5404-f172-4596-86db-6d2c8700b972 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:14.027979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-f0439adf-ed4b-4ed7-ae0a-895b0dd8ffee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:14.027979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:14.027979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:14.027979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:14.027979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:14.027979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:14.027979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:14.027979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:14.027979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:14.027979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:14.027979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:14.027979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:14.027979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:14.027979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:14.027979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:14.029246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:14.029246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:14.029246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:14.029246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:14.029246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:14.029246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:14.029246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:14.029246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:14.029246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:14.029246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:14.029246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:14.029246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:14.029246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:14.029246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:14.029246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:14.029246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:14.029246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:14.030335 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:14.030335 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:14.030335 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:14.030335 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:14.030335 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 441/863] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:14.037033 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0439adf-ed4b-4ed7-ae0a-895b0dd8ffee None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:14.171360 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc5404-f172-4596-86db-6d2c8700b972 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:14.203410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0439adf-ed4b-4ed7-ae0a-895b0dd8ffee None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:14.221147 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837100c8-146e-459e-84ca-aa286bb8e576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:14.223263 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837100c8-146e-459e-84ca-aa286bb8e576 None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:14.223784 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837100c8-146e-459e-84ca-aa286bb8e576 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:14.224254 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837100c8-146e-459e-84ca-aa286bb8e576 None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:14.225257 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837100c8-146e-459e-84ca-aa286bb8e576 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:14.228100 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837100c8-146e-459e-84ca-aa286bb8e576 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:14.248198 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 423/864] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:20:14 2022] POST /identity/v3/services => generated 251 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:20:14.260541 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065b142-b85e-4154-bd66-8b9b319e3041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:14.261581 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065b142-b85e-4154-bd66-8b9b319e3041 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:14.262028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065b142-b85e-4154-bd66-8b9b319e3041 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:14.262670 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065b142-b85e-4154-bd66-8b9b319e3041 None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:14.263261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065b142-b85e-4154-bd66-8b9b319e3041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:14.263754 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065b142-b85e-4154-bd66-8b9b319e3041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:14.265329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065b142-b85e-4154-bd66-8b9b319e3041 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:14.283865 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 442/865] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:14.293697 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837100c8-146e-459e-84ca-aa286bb8e576 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:14.467292 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837100c8-146e-459e-84ca-aa286bb8e576 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:14.511654 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed697e-cbb9-47e4-b711-577eb63412d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:14.512530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed697e-cbb9-47e4-b711-577eb63412d6 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:14.512777 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed697e-cbb9-47e4-b711-577eb63412d6 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:14.513059 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed697e-cbb9-47e4-b711-577eb63412d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:14.523381 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed697e-cbb9-47e4-b711-577eb63412d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:14.526020 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed697e-cbb9-47e4-b711-577eb63412d6 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:14.542885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7864fd5-ba47-4b1f-b371-9aca46a716af None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:14.543451 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7864fd5-ba47-4b1f-b371-9aca46a716af None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:14.543451 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7864fd5-ba47-4b1f-b371-9aca46a716af None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:14.544804 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 443/866] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:14.549271 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-31ed697e-cbb9-47e4-b711-577eb63412d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:14.549271 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:14.549271 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:14.549271 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:14.549271 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:14.549271 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:14.549271 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:14.549271 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:14.549271 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:14.549271 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:14.549271 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:14.549271 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:14.549271 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:20:14.549271 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:20:14.549271 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:20:14.550547 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:20:14.550547 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:14.550547 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:14.550547 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:14.550547 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:14.550547 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:14.550547 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:14.550547 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:14.550547 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:14.550547 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:14.550547 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:14.550547 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:14.550547 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:14.550547 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:14.550547 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:14.550547 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:14.550547 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:14.551742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:20:14.551742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:20:14.551742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:20:14.551742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:20:14.551742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:20:14.551742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:20:14.551742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:14.551742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:14.552309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aec8d4-6744-4091-93bf-897e2d93acf7 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:14.552309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aec8d4-6744-4091-93bf-897e2d93acf7 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:14.552309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aec8d4-6744-4091-93bf-897e2d93acf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:14.557402 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 424/867] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:20:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:14.557697 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed697e-cbb9-47e4-b711-577eb63412d6 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:14.577597 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-c1aec8d4-6744-4091-93bf-897e2d93acf7 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:14.578935 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-c1aec8d4-6744-4091-93bf-897e2d93acf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:14.654991 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 444/868] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:14 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:20:14.671114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed697e-cbb9-47e4-b711-577eb63412d6 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:14.681474 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aec8d4-6744-4091-93bf-897e2d93acf7 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:14.713574 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807673d-1406-4a32-b71b-fbd587ad77f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:14.714599 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807673d-1406-4a32-b71b-fbd587ad77f4 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:14.715160 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807673d-1406-4a32-b71b-fbd587ad77f4 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:14.715451 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807673d-1406-4a32-b71b-fbd587ad77f4 None admin] PATH_INFO: `/v3/projects` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:14.716503 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807673d-1406-4a32-b71b-fbd587ad77f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:14.717167 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807673d-1406-4a32-b71b-fbd587ad77f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:14.718990 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807673d-1406-4a32-b71b-fbd587ad77f4 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:14.747773 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 425/869] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:20:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:14.749352 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807673d-1406-4a32-b71b-fbd587ad77f4 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:14.807972 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aec8d4-6744-4091-93bf-897e2d93acf7 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:14.850030 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7acfa-33eb-4830-8321-f9a9097921f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:14.850910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7acfa-33eb-4830-8321-f9a9097921f3 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:14.851204 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7acfa-33eb-4830-8321-f9a9097921f3 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:14.851483 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7acfa-33eb-4830-8321-f9a9097921f3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:14.852165 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7acfa-33eb-4830-8321-f9a9097921f3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:14.853593 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7acfa-33eb-4830-8321-f9a9097921f3 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:14.868011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-82f7acfa-33eb-4830-8321-f9a9097921f3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:20:14.868011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:14.868011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:20:14.868011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:20:14.868011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:20:14.868011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:20:14.868011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:20:14.868011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:14.868011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:20:14.868011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:14.868011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:20:14.868011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:14.868011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:14.868011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:14.868011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:14.868011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:14.869459 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:14.869459 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:14.869459 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:14.869459 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:14.869459 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:14.869459 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:14.869459 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:14.869459 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:20:14.869459 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:20:14.869459 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:20:14.869459 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:20:14.869459 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:14.869459 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:14.869459 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:14.869459 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:14.869459 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:14.871211 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:14.871211 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:14.871211 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:14.871211 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:14.871211 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:14.871211 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:14.871211 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:14.871211 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:14.871211 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:14.871211 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:14.871211 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:14.871211 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:20:14.871211 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:14.871211 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:20:14.871211 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:14.875199 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 445/870] 10.222.0.48 () {56 vars in 1132 bytes} [Mon May 9 15:20:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:14.875517 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7acfa-33eb-4830-8321-f9a9097921f3 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:14.890227 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807673d-1406-4a32-b71b-fbd587ad77f4 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:14.927507 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3bc03-caf0-43a2-a234-274a1df78fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:14.928583 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3bc03-caf0-43a2-a234-274a1df78fb1 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:14.929115 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3bc03-caf0-43a2-a234-274a1df78fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:14.929667 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3bc03-caf0-43a2-a234-274a1df78fb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:14.930754 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3bc03-caf0-43a2-a234-274a1df78fb1 None admin] RBAC: Adding query filter params (role.id=7d8a1698372145a59d70d67ed7867f56, scope.project.id=eb2de9bea1cf451db5f8c697f480c480, user.id=ed964c5d606a4934b5bd9bd5890562ad) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:14.931316 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3bc03-caf0-43a2-a234-274a1df78fb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:14.932995 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3bc03-caf0-43a2-a234-274a1df78fb1 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:14.940322 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 426/871] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:20:14 2022] GET /identity/v3/role_assignments?user.id=ed964c5d606a4934b5bd9bd5890562ad&scope.project.id=eb2de9bea1cf451db5f8c697f480c480&role.id=7d8a1698372145a59d70d67ed7867f56 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:14.997663 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7acfa-33eb-4830-8321-f9a9097921f3 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:15.041958 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c04195-5ced-4cd9-a252-173d0319db2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:15.042658 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c04195-5ced-4cd9-a252-173d0319db2e None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:15.042951 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c04195-5ced-4cd9-a252-173d0319db2e None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:15.043239 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c04195-5ced-4cd9-a252-173d0319db2e None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:15.044065 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c04195-5ced-4cd9-a252-173d0319db2e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:15.044383 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c04195-5ced-4cd9-a252-173d0319db2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:15.046310 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c04195-5ced-4cd9-a252-173d0319db2e None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:15.054489 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 446/872] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:20:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:15.061265 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3bc03-caf0-43a2-a234-274a1df78fb1 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:15.182745 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3bc03-caf0-43a2-a234-274a1df78fb1 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:15.225040 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290158a-9226-458e-956b-6bb18f3b87df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:15.225843 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290158a-9226-458e-956b-6bb18f3b87df None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:15.226130 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290158a-9226-458e-956b-6bb18f3b87df None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:15.226424 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290158a-9226-458e-956b-6bb18f3b87df None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:15.227247 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290158a-9226-458e-956b-6bb18f3b87df None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:15.227564 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290158a-9226-458e-956b-6bb18f3b87df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:15.229039 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290158a-9226-458e-956b-6bb18f3b87df None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:15.235115 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 427/873] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:20:15 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:16.560277 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e28bd-fdd7-4207-b3e1-63f269368865 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:16.560838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e28bd-fdd7-4207-b3e1-63f269368865 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:16.560938 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e28bd-fdd7-4207-b3e1-63f269368865 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:16.562673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 447/874] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:16.588776 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df21d3-4776-40d9-a838-7c8ddb7c81f0 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:16.588776 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df21d3-4776-40d9-a838-7c8ddb7c81f0 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:16.588776 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df21d3-4776-40d9-a838-7c8ddb7c81f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:16.614792 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-60df21d3-4776-40d9-a838-7c8ddb7c81f0 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:16.616947 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-60df21d3-4776-40d9-a838-7c8ddb7c81f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:16.687306 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 428/875] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:16 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:20:16.710669 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e28bd-fdd7-4207-b3e1-63f269368865 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:16.718733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701b869-14ad-4690-b418-6d37b1ca30a4 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:16.719036 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701b869-14ad-4690-b418-6d37b1ca30a4 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:16.719322 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701b869-14ad-4690-b418-6d37b1ca30a4 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:16.720979 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 429/876] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:20:16.726707 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495fe78-02e5-4540-bf3e-3ba56d91b34c None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:16.727004 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495fe78-02e5-4540-bf3e-3ba56d91b34c None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:16.727290 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495fe78-02e5-4540-bf3e-3ba56d91b34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:16.747641 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-7495fe78-02e5-4540-bf3e-3ba56d91b34c None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:16.748853 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-7495fe78-02e5-4540-bf3e-3ba56d91b34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:16.826079 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 430/877] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:16 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:20:16.853562 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495fe78-02e5-4540-bf3e-3ba56d91b34c None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:16.864002 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e28bd-fdd7-4207-b3e1-63f269368865 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:16.909025 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ad73d-848b-4405-8ed2-d22feeec97f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:16.910653 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ad73d-848b-4405-8ed2-d22feeec97f0 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:16.910952 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ad73d-848b-4405-8ed2-d22feeec97f0 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:16.911422 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ad73d-848b-4405-8ed2-d22feeec97f0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:16.912271 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ad73d-848b-4405-8ed2-d22feeec97f0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:16.914319 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ad73d-848b-4405-8ed2-d22feeec97f0 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:16.928979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-511ad73d-848b-4405-8ed2-d22feeec97f0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:20:16.928979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:16.928979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:20:16.928979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:20:16.928979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:20:16.928979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:20:16.928979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:20:16.928979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:16.928979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:20:16.928979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:16.928979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:20:16.928979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:16.928979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:16.928979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:16.928979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:16.928979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:16.928979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:16.929885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:16.929885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:16.929885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:16.929885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:16.929885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:16.929885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:16.929885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:20:16.929885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:20:16.929885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:20:16.929885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:20:16.929885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:16.929885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:16.929885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:16.929885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:16.929885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:16.929885 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:16.930912 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:16.930912 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:16.930912 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:16.930912 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:16.930912 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:16.930912 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:16.930912 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:16.930912 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:16.930912 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:16.930912 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:16.930912 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:20:16.930912 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:16.930912 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:20:16.930912 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:16.930912 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 448/878] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:20:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:16.936955 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ad73d-848b-4405-8ed2-d22feeec97f0 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:16.963056 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495fe78-02e5-4540-bf3e-3ba56d91b34c None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:16.998382 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524422ab-6b03-4e0d-a598-18d7936f3a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:16.999279 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524422ab-6b03-4e0d-a598-18d7936f3a91 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:16.999570 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524422ab-6b03-4e0d-a598-18d7936f3a91 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:16.999911 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524422ab-6b03-4e0d-a598-18d7936f3a91 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:17.000690 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524422ab-6b03-4e0d-a598-18d7936f3a91 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:17.002082 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524422ab-6b03-4e0d-a598-18d7936f3a91 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:17.014052 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-524422ab-6b03-4e0d-a598-18d7936f3a91 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:20:17.014052 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:17.014052 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:20:17.014052 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:20:17.014052 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:20:17.014052 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:20:17.014052 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:20:17.014052 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:17.014052 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:20:17.014052 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:17.014052 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:20:17.014052 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:17.014052 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:17.014052 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:17.014052 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:17.014052 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:17.014052 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:17.016217 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:17.016217 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:17.016217 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:17.016217 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:17.016217 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:17.016217 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:17.016217 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:20:17.016217 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:20:17.016217 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:20:17.016217 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:20:17.016217 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:17.016217 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:17.016217 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:17.016217 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:17.016217 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:17.016217 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:17.018175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:17.018175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:17.018175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:17.018175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:17.018175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:17.018175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:17.018175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:17.018175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:17.018175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:17.018175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:17.018175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:20:17.018175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:17.018175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:20:17.018175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:17.021617 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 431/879] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:20:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:17.022326 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524422ab-6b03-4e0d-a598-18d7936f3a91 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:17.042033 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ad73d-848b-4405-8ed2-d22feeec97f0 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:17.077532 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f21fa-54db-42d6-888e-4a1728e37eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:17.078476 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f21fa-54db-42d6-888e-4a1728e37eb0 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:17.078938 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f21fa-54db-42d6-888e-4a1728e37eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:17.079411 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f21fa-54db-42d6-888e-4a1728e37eb0 None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:17.080316 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f21fa-54db-42d6-888e-4a1728e37eb0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:17.080804 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f21fa-54db-42d6-888e-4a1728e37eb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:17.082914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f21fa-54db-42d6-888e-4a1728e37eb0 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:17.092865 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 449/880] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:20:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:17.094080 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f21fa-54db-42d6-888e-4a1728e37eb0 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:17.127757 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524422ab-6b03-4e0d-a598-18d7936f3a91 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:17.169017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f25efe-afbc-4d54-b94d-e6d2cfe223f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:17.169790 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f25efe-afbc-4d54-b94d-e6d2cfe223f5 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:17.170093 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f25efe-afbc-4d54-b94d-e6d2cfe223f5 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:17.170393 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f25efe-afbc-4d54-b94d-e6d2cfe223f5 None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:17.171186 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f25efe-afbc-4d54-b94d-e6d2cfe223f5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:17.171498 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f25efe-afbc-4d54-b94d-e6d2cfe223f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:17.173042 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f25efe-afbc-4d54-b94d-e6d2cfe223f5 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:17.184690 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 432/881] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:20:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:17.185878 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f25efe-afbc-4d54-b94d-e6d2cfe223f5 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:17.210829 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f21fa-54db-42d6-888e-4a1728e37eb0 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:17.251533 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39111571-02a1-416a-be4f-7b434a693c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:17.252524 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39111571-02a1-416a-be4f-7b434a693c0e None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:17.252998 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39111571-02a1-416a-be4f-7b434a693c0e None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:17.253519 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39111571-02a1-416a-be4f-7b434a693c0e None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:17.255017 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39111571-02a1-416a-be4f-7b434a693c0e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:17.255634 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39111571-02a1-416a-be4f-7b434a693c0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:17.257515 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39111571-02a1-416a-be4f-7b434a693c0e None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:17.269510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 450/882] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:20:17 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:17.315360 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f25efe-afbc-4d54-b94d-e6d2cfe223f5 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:17.359603 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af545b-6b9b-4b1f-b314-f99e790bd8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:17.360215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af545b-6b9b-4b1f-b314-f99e790bd8e0 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:17.360499 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af545b-6b9b-4b1f-b314-f99e790bd8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:17.360807 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af545b-6b9b-4b1f-b314-f99e790bd8e0 None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:17.361645 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af545b-6b9b-4b1f-b314-f99e790bd8e0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:17.361964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af545b-6b9b-4b1f-b314-f99e790bd8e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:17.364010 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af545b-6b9b-4b1f-b314-f99e790bd8e0 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:17.370555 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 433/883] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:20:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:17.376567 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39111571-02a1-416a-be4f-7b434a693c0e None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:17.497474 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39111571-02a1-416a-be4f-7b434a693c0e None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:17.543978 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff06177-9884-4d97-9ac2-807efadc484e None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:17.544305 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff06177-9884-4d97-9ac2-807efadc484e None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:17.544591 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff06177-9884-4d97-9ac2-807efadc484e None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:17.546665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 434/884] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:20:17.552664 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af4d6a-ab12-40aa-bdff-c2f305c859fa None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:17.552986 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af4d6a-ab12-40aa-bdff-c2f305c859fa None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:17.553080 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c86869-e00e-4174-bc1b-9339ca11bdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:17.553303 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af4d6a-ab12-40aa-bdff-c2f305c859fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:17.553834 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c86869-e00e-4174-bc1b-9339ca11bdc9 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:17.554153 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c86869-e00e-4174-bc1b-9339ca11bdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:17.554440 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c86869-e00e-4174-bc1b-9339ca11bdc9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:17.555527 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c86869-e00e-4174-bc1b-9339ca11bdc9 None admin] RBAC: Adding query filter params (interface=public, service_id=3b941a35065a471e94de53a205303736, region_id=RegionOne) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:17.556014 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c86869-e00e-4174-bc1b-9339ca11bdc9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:17.557553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c86869-e00e-4174-bc1b-9339ca11bdc9 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:17.565218 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 451/885] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:20:17 2022] GET /identity/v3/endpoints?service_id=3b941a35065a471e94de53a205303736&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:17.571659 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c86869-e00e-4174-bc1b-9339ca11bdc9 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:17.572586 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-28af4d6a-ab12-40aa-bdff-c2f305c859fa None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:17.574052 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-28af4d6a-ab12-40aa-bdff-c2f305c859fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:17.650484 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 435/886] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:17 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:17.676335 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af4d6a-ab12-40aa-bdff-c2f305c859fa None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:17.717872 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c86869-e00e-4174-bc1b-9339ca11bdc9 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:17.759221 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c9e9d-63d1-4016-bd93-c8330ad460d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:17.760179 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c9e9d-63d1-4016-bd93-c8330ad460d9 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:17.760612 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c9e9d-63d1-4016-bd93-c8330ad460d9 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:17.761031 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c9e9d-63d1-4016-bd93-c8330ad460d9 None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:17.761920 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c9e9d-63d1-4016-bd93-c8330ad460d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:17.763467 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c9e9d-63d1-4016-bd93-c8330ad460d9 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:17.770295 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 452/887] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:20:17 2022] GET /identity/v3/services => generated 1011 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 15:20:17.771795 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04d5c2-b916-49dc-9d77-7a1a2293c01e None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:17.772094 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04d5c2-b916-49dc-9d77-7a1a2293c01e None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:17.772375 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04d5c2-b916-49dc-9d77-7a1a2293c01e None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:17.773738 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 453/888] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:17.781764 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607ecc4-7fc2-4c78-bbc9-1cebfcd52c08 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:17.782382 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607ecc4-7fc2-4c78-bbc9-1cebfcd52c08 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:17.782898 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607ecc4-7fc2-4c78-bbc9-1cebfcd52c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:17.807620 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af4d6a-ab12-40aa-bdff-c2f305c859fa None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:17.812342 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-0607ecc4-7fc2-4c78-bbc9-1cebfcd52c08 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:17.814450 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-0607ecc4-7fc2-4c78-bbc9-1cebfcd52c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:17.856942 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31302aba-a84a-4d13-a565-ac8c6f6d8780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:17.857913 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31302aba-a84a-4d13-a565-ac8c6f6d8780 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:17.858253 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31302aba-a84a-4d13-a565-ac8c6f6d8780 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:17.858539 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31302aba-a84a-4d13-a565-ac8c6f6d8780 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:17.874525 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31302aba-a84a-4d13-a565-ac8c6f6d8780 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:20:17.883964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-31302aba-a84a-4d13-a565-ac8c6f6d8780 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:20:17.883964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:17.883964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:17.883964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:17.883964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:17.883964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:17.883964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:17.883964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:17.883964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:17.883964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:17.883964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:17.883964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:17.883964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:20:17.883964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:20:17.883964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:20:17.883964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:20:17.885200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:20:17.885200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:20:17.885200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:20:17.885200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:20:17.885200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:17.885200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:17.885200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:17.885200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:17.885200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:17.885200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:17.885200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:17.885200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:17.885200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:17.885200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:17.885200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:17.885200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:17.886266 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:17.886266 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:17.886266 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:17.886266 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:17.886266 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:20:17.886266 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:20:17.886266 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:20:17.886266 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:20:17.886266 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:20:17.886266 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:20:17.886266 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:20:17.886266 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:17.889809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 436/889] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 9 15:20:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:17.891864 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31302aba-a84a-4d13-a565-ac8c6f6d8780 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:17.933838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 454/890] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:17 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:17.953261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607ecc4-7fc2-4c78-bbc9-1cebfcd52c08 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:18.048437 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31302aba-a84a-4d13-a565-ac8c6f6d8780 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:18.089687 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e058b0b-6892-4329-b454-5d4cb3eb5e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:18.090313 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e058b0b-6892-4329-b454-5d4cb3eb5e8b None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:18.090604 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e058b0b-6892-4329-b454-5d4cb3eb5e8b None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:18.090889 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e058b0b-6892-4329-b454-5d4cb3eb5e8b None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:18.091789 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e058b0b-6892-4329-b454-5d4cb3eb5e8b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:18.092109 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e058b0b-6892-4329-b454-5d4cb3eb5e8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:18.093590 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e058b0b-6892-4329-b454-5d4cb3eb5e8b None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:18.097103 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607ecc4-7fc2-4c78-bbc9-1cebfcd52c08 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:18.104824 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 437/891] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:20:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:18.112437 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e058b0b-6892-4329-b454-5d4cb3eb5e8b None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:18.149641 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed4e32-012e-4aa9-b8da-bc195ed404f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:18.151721 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed4e32-012e-4aa9-b8da-bc195ed404f6 None admin] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:18.152584 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed4e32-012e-4aa9-b8da-bc195ed404f6 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:18.153540 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed4e32-012e-4aa9-b8da-bc195ed404f6 None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:18.155868 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed4e32-012e-4aa9-b8da-bc195ed404f6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:18.158126 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed4e32-012e-4aa9-b8da-bc195ed404f6 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:18.186605 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 455/892] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:20:17 2022] POST /identity/v3/services => generated 269 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:20:18.260001 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e058b0b-6892-4329-b454-5d4cb3eb5e8b None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:18.317588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214836a5-3794-461a-be99-f98656683a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:18.319268 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214836a5-3794-461a-be99-f98656683a3e None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:18.320036 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214836a5-3794-461a-be99-f98656683a3e None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:18.320773 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214836a5-3794-461a-be99-f98656683a3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:18.339135 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214836a5-3794-461a-be99-f98656683a3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:18.342506 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214836a5-3794-461a-be99-f98656683a3e None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:18.367559 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-214836a5-3794-461a-be99-f98656683a3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:18.367559 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:18.367559 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:18.367559 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:18.367559 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:18.367559 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:18.367559 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:18.367559 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:18.367559 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:18.367559 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:18.367559 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:18.367559 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:18.367559 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:18.367559 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:18.367559 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:18.368381 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:18.368381 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:18.368381 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:18.368381 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:18.368381 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:18.368381 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:18.368381 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:18.368381 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:18.368381 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:18.368381 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:18.368381 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:18.368381 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:18.368381 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:18.368381 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:18.368381 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:18.368381 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:18.368381 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:18.369131 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:18.369131 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:18.369131 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:18.369131 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:18.371602 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 438/893] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:18.378536 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed4e32-012e-4aa9-b8da-bc195ed404f6 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:18.539912 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed4e32-012e-4aa9-b8da-bc195ed404f6 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:18.577034 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41949b-2f9f-4043-809b-828afba760c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:18.577869 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41949b-2f9f-4043-809b-828afba760c1 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:18.578088 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41949b-2f9f-4043-809b-828afba760c1 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:18.578372 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41949b-2f9f-4043-809b-828afba760c1 None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:18.579284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41949b-2f9f-4043-809b-828afba760c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:18.579600 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41949b-2f9f-4043-809b-828afba760c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:18.580997 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41949b-2f9f-4043-809b-828afba760c1 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:18.595601 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 456/894] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:18.602246 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214836a5-3794-461a-be99-f98656683a3e None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:18.714066 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214836a5-3794-461a-be99-f98656683a3e None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:18.753669 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ca189-6e9e-4906-bb7c-5d45a72b34d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:18.754987 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ca189-6e9e-4906-bb7c-5d45a72b34d2 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:18.755297 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ca189-6e9e-4906-bb7c-5d45a72b34d2 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:18.755582 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ca189-6e9e-4906-bb7c-5d45a72b34d2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:18.764298 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ca189-6e9e-4906-bb7c-5d45a72b34d2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:18.765792 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ca189-6e9e-4906-bb7c-5d45a72b34d2 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:18.781665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-686ca189-6e9e-4906-bb7c-5d45a72b34d2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:20:18.781665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:18.781665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:18.781665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:18.781665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:18.781665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:18.781665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:18.781665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:18.781665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:18.781665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:18.781665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:18.781665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:18.781665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:20:18.781665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:20:18.781665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:20:18.781665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:20:18.782618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:18.782618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:18.782618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:20:18.782618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:18.782618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:20:18.782618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:18.782618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:18.782618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:18.782618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:18.782618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:18.782618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:18.782618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:18.782618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:18.782618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:18.782618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:18.782618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:18.782618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:18.782618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:18.783494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:18.783494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:18.783494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:20:18.783494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:20:18.783494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:20:18.783494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:20:18.783494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:20:18.783494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:20:18.783494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:20:18.783494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:18.783494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 439/895] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:20:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:18.790784 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41949b-2f9f-4043-809b-828afba760c1 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:18.914902 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41949b-2f9f-4043-809b-828afba760c1 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:18.950070 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671645a9-b8f6-4844-9bc5-5b74015a6919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:18.950749 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671645a9-b8f6-4844-9bc5-5b74015a6919 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:18.951031 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671645a9-b8f6-4844-9bc5-5b74015a6919 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:18.951303 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671645a9-b8f6-4844-9bc5-5b74015a6919 None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:18.952152 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671645a9-b8f6-4844-9bc5-5b74015a6919 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:18.952460 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671645a9-b8f6-4844-9bc5-5b74015a6919 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:18.954020 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671645a9-b8f6-4844-9bc5-5b74015a6919 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:18.974190 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 457/896] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 9 15:20:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:18.980010 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ca189-6e9e-4906-bb7c-5d45a72b34d2 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:19.100019 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ca189-6e9e-4906-bb7c-5d45a72b34d2 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:19.139972 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca94bb-0c68-46cb-84ff-ca49a848ce8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:19.141068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca94bb-0c68-46cb-84ff-ca49a848ce8a None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:19.141588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca94bb-0c68-46cb-84ff-ca49a848ce8a None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:19.142086 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca94bb-0c68-46cb-84ff-ca49a848ce8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:19.229051 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca94bb-0c68-46cb-84ff-ca49a848ce8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:19.230559 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca94bb-0c68-46cb-84ff-ca49a848ce8a None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:19.341114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 440/897] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:20:18 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:20:19.346962 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671645a9-b8f6-4844-9bc5-5b74015a6919 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:19.513723 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671645a9-b8f6-4844-9bc5-5b74015a6919 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:19.574004 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc4cef-df93-489b-a61f-055049de4da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:19.574831 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc4cef-df93-489b-a61f-055049de4da5 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:19.575117 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc4cef-df93-489b-a61f-055049de4da5 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:19.575391 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc4cef-df93-489b-a61f-055049de4da5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:19.586914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc4cef-df93-489b-a61f-055049de4da5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:19.588387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc4cef-df93-489b-a61f-055049de4da5 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:19.607043 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-c5bc4cef-df93-489b-a61f-055049de4da5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:19.607043 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:19.607043 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:19.607043 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:19.607043 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:19.607043 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:19.607043 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:19.607043 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:19.607043 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:19.607043 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:19.607043 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:19.607043 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:19.607043 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:19.607043 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:19.607043 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:19.607910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:19.607910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:19.607910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:19.607910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:19.607910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:19.607910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:19.607910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:19.607910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:19.607910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:19.607910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:19.607910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:19.607910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:19.607910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:19.607910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:19.607910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:19.607910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:19.607910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:19.608790 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:19.608790 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:19.608790 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:19.608790 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:19.608790 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 458/898] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:19.617941 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca94bb-0c68-46cb-84ff-ca49a848ce8a None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:19.736570 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f22e7d-456f-40b7-b6aa-45321789065b None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:19.736904 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f22e7d-456f-40b7-b6aa-45321789065b None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:19.737136 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f22e7d-456f-40b7-b6aa-45321789065b None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:19.739961 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 459/899] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:19.745754 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2351641-2939-40da-b182-ccb8d126cdbd None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:19.746050 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2351641-2939-40da-b182-ccb8d126cdbd None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:19.746341 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2351641-2939-40da-b182-ccb8d126cdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:19.765523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-d2351641-2939-40da-b182-ccb8d126cdbd None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:19.766681 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-d2351641-2939-40da-b182-ccb8d126cdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:19.767228 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca94bb-0c68-46cb-84ff-ca49a848ce8a None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:19.803935 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dccae3-f495-4f05-b271-25bfb518b29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:19.804634 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dccae3-f495-4f05-b271-25bfb518b29e None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:19.804927 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dccae3-f495-4f05-b271-25bfb518b29e None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:19.805207 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dccae3-f495-4f05-b271-25bfb518b29e None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:19.806031 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dccae3-f495-4f05-b271-25bfb518b29e None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:19.806344 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dccae3-f495-4f05-b271-25bfb518b29e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:19.807739 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dccae3-f495-4f05-b271-25bfb518b29e None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:19.820817 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 441/900] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:19.830635 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dccae3-f495-4f05-b271-25bfb518b29e None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:19.845494 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 460/901] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:20:19.869461 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2351641-2939-40da-b182-ccb8d126cdbd None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:19.958071 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dccae3-f495-4f05-b271-25bfb518b29e None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:19.993841 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2351641-2939-40da-b182-ccb8d126cdbd None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:19.995518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a1cd7-72b0-4f03-b32e-e3733b846237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:19.996341 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a1cd7-72b0-4f03-b32e-e3733b846237 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:19.996638 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a1cd7-72b0-4f03-b32e-e3733b846237 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:19.996921 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a1cd7-72b0-4f03-b32e-e3733b846237 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:20.006556 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a1cd7-72b0-4f03-b32e-e3733b846237 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:20.008068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a1cd7-72b0-4f03-b32e-e3733b846237 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:20.024063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-e51a1cd7-72b0-4f03-b32e-e3733b846237 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:20.024063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:20.024063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:20.024063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:20.024063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:20.024063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:20.024063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:20.024063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:20.024063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:20.024063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:20.024063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:20.024063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:20.024063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:20:20.024063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:20:20.024063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:20:20.024909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:20:20.024909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:20.024909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:20.024909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:20.024909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:20.024909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:20.024909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:20.024909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:20.024909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:20.024909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:20.024909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:20.024909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:20.024909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:20.024909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:20.024909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:20.024909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:20.024909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:20.025714 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:20:20.025714 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:20:20.025714 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:20:20.025714 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:20:20.025714 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:20:20.025714 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:20:20.025714 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:20.025714 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:20.030329 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 442/902] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:20:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:20.031387 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a1cd7-72b0-4f03-b32e-e3733b846237 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:20.036551 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8725b-e7ff-4449-9e27-ccbd5bd8bc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:20.037565 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8725b-e7ff-4449-9e27-ccbd5bd8bc0f None admin] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:20.038050 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8725b-e7ff-4449-9e27-ccbd5bd8bc0f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:20.038588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8725b-e7ff-4449-9e27-ccbd5bd8bc0f None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:20.039575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8725b-e7ff-4449-9e27-ccbd5bd8bc0f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:20.041165 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8725b-e7ff-4449-9e27-ccbd5bd8bc0f None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:20.064801 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 461/903] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:20:19 2022] POST /identity/v3/services => generated 241 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:20:20.170478 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a1cd7-72b0-4f03-b32e-e3733b846237 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:20.227132 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0a7e8-f05c-4f4c-ba5c-7e519b8458ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:20.227862 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0a7e8-f05c-4f4c-ba5c-7e519b8458ae None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:20.228147 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0a7e8-f05c-4f4c-ba5c-7e519b8458ae None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:20.228426 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0a7e8-f05c-4f4c-ba5c-7e519b8458ae None admin] PATH_INFO: `/v3/projects` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:20.229266 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0a7e8-f05c-4f4c-ba5c-7e519b8458ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:20.229674 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0a7e8-f05c-4f4c-ba5c-7e519b8458ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:20.231221 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0a7e8-f05c-4f4c-ba5c-7e519b8458ae None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:20.247563 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 443/904] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:20:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:20.253258 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8725b-e7ff-4449-9e27-ccbd5bd8bc0f None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:20.362671 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8725b-e7ff-4449-9e27-ccbd5bd8bc0f None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:20.400262 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49858f-270f-4efe-ac66-c3edc11bf533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:20.400970 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49858f-270f-4efe-ac66-c3edc11bf533 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:20.401253 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49858f-270f-4efe-ac66-c3edc11bf533 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:20.401560 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49858f-270f-4efe-ac66-c3edc11bf533 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:20.402413 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49858f-270f-4efe-ac66-c3edc11bf533 None admin] RBAC: Adding query filter params (role.id=fbc2125af36f44b0913c866ea5f56ca5, scope.project.id=eb2de9bea1cf451db5f8c697f480c480, user.id=ed964c5d606a4934b5bd9bd5890562ad) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:20.402771 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49858f-270f-4efe-ac66-c3edc11bf533 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:20.404292 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49858f-270f-4efe-ac66-c3edc11bf533 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:20.410965 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 462/905] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:20:20 2022] GET /identity/v3/role_assignments?user.id=ed964c5d606a4934b5bd9bd5890562ad&scope.project.id=eb2de9bea1cf451db5f8c697f480c480&role.id=fbc2125af36f44b0913c866ea5f56ca5 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:20.415265 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e714574-0c2e-45e2-98ab-fc193096f08b None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:20.415727 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e714574-0c2e-45e2-98ab-fc193096f08b None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:20.416110 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e714574-0c2e-45e2-98ab-fc193096f08b None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:20.418099 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 444/906] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:20.423672 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e914c-6f8a-460e-b949-64cf2944b222 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:20.423964 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e914c-6f8a-460e-b949-64cf2944b222 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:20.424257 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e914c-6f8a-460e-b949-64cf2944b222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:20.443318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-ae7e914c-6f8a-460e-b949-64cf2944b222 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:20.444608 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-ae7e914c-6f8a-460e-b949-64cf2944b222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:20.533179 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 463/907] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:20.560332 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e714574-0c2e-45e2-98ab-fc193096f08b None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:20.713208 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e714574-0c2e-45e2-98ab-fc193096f08b None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:20.748165 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b96283-92d6-451c-aef0-611a3900a535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:20.748981 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b96283-92d6-451c-aef0-611a3900a535 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:20.749262 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b96283-92d6-451c-aef0-611a3900a535 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:20.749571 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b96283-92d6-451c-aef0-611a3900a535 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:20.750237 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b96283-92d6-451c-aef0-611a3900a535 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:20.751617 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b96283-92d6-451c-aef0-611a3900a535 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:20.764847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-55b96283-92d6-451c-aef0-611a3900a535 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:20:20.764847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:20.764847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:20:20.764847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:20:20.764847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:20:20.764847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:20:20.764847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:20:20.764847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:20.764847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:20:20.764847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:20.764847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:20:20.764847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:20.764847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:20.764847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:20.764847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:20.764847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:20.764847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:20.765809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:20.765809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:20.765809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:20.765809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:20.765809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:20.765809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:20.765809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:20:20.765809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:20:20.765809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:20:20.765809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:20:20.765809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:20.765809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:20.765809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:20.765809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:20.765809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:20.765809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:20.766584 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:20.766584 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:20.766584 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:20.766584 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:20.766584 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:20.766584 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:20.766584 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:20.766584 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:20.766584 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:20.766584 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:20.766584 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:20:20.766584 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:20.766584 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:20:20.766584 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:20.766584 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 445/908] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:20:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:20.775956 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e914c-6f8a-460e-b949-64cf2944b222 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:20.941645 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e914c-6f8a-460e-b949-64cf2944b222 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:20.998361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f211082-e081-4b60-9d64-3210412ba239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:20.999330 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f211082-e081-4b60-9d64-3210412ba239 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:20.999774 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f211082-e081-4b60-9d64-3210412ba239 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:21.000222 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f211082-e081-4b60-9d64-3210412ba239 None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:21.001456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f211082-e081-4b60-9d64-3210412ba239 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:21.002040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f211082-e081-4b60-9d64-3210412ba239 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:21.004929 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f211082-e081-4b60-9d64-3210412ba239 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:21.005293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbfdcf-6275-4b4c-8ace-623f7c871bc9 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:21.005826 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbfdcf-6275-4b4c-8ace-623f7c871bc9 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:21.005971 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbfdcf-6275-4b4c-8ace-623f7c871bc9 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:21.011533 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 446/909] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:21.013278 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab6a1f-eaa9-458d-ab55-f7c3a0f4e7d2 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:21.013597 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab6a1f-eaa9-458d-ab55-f7c3a0f4e7d2 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:21.013850 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 464/910] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:20:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:21.013999 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab6a1f-eaa9-458d-ab55-f7c3a0f4e7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:21.023117 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f211082-e081-4b60-9d64-3210412ba239 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:21.031901 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-7eab6a1f-eaa9-458d-ab55-f7c3a0f4e7d2 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:21.033099 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-7eab6a1f-eaa9-458d-ab55-f7c3a0f4e7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:21.113512 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 447/911] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:20:21.129071 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab6a1f-eaa9-458d-ab55-f7c3a0f4e7d2 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:21.199125 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f211082-e081-4b60-9d64-3210412ba239 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:21.247323 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65773ca4-9c95-4e97-8069-47989a3d5603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:21.248147 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65773ca4-9c95-4e97-8069-47989a3d5603 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:21.248499 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65773ca4-9c95-4e97-8069-47989a3d5603 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:21.248726 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65773ca4-9c95-4e97-8069-47989a3d5603 None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:21.249648 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65773ca4-9c95-4e97-8069-47989a3d5603 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:21.249963 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65773ca4-9c95-4e97-8069-47989a3d5603 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:21.251769 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65773ca4-9c95-4e97-8069-47989a3d5603 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:21.260755 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab6a1f-eaa9-458d-ab55-f7c3a0f4e7d2 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:21.261459 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 465/912] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:20:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:21.265151 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65773ca4-9c95-4e97-8069-47989a3d5603 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:21.314412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5c45d-8160-468b-b2fa-c789264bccc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:21.315625 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5c45d-8160-468b-b2fa-c789264bccc5 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:21.317034 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5c45d-8160-468b-b2fa-c789264bccc5 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:21.317549 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5c45d-8160-468b-b2fa-c789264bccc5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:21.318428 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5c45d-8160-468b-b2fa-c789264bccc5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:21.320034 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5c45d-8160-468b-b2fa-c789264bccc5 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:21.336575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-d9f5c45d-8160-468b-b2fa-c789264bccc5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:20:21.336575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:21.336575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:20:21.336575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:20:21.336575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:20:21.336575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:20:21.336575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:20:21.336575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:21.336575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:20:21.336575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:21.336575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:20:21.336575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:21.336575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:21.336575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:21.336575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:21.336575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:21.337518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:21.337518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:21.337518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:21.337518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:21.337518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:21.337518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:21.337518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:21.337518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:20:21.337518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:20:21.337518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:20:21.337518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:20:21.337518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:21.337518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:21.337518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:21.337518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:21.337518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:21.338279 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:21.338279 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:21.338279 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:21.338279 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:21.338279 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:21.338279 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:21.338279 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:21.338279 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:21.338279 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:21.338279 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:21.338279 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:21.338279 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:20:21.338279 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:21.338279 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:20:21.338279 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:21.341063 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 448/913] 10.222.0.48 () {56 vars in 1132 bytes} [Mon May 9 15:20:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:21.350379 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5c45d-8160-468b-b2fa-c789264bccc5 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:21.412519 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65773ca4-9c95-4e97-8069-47989a3d5603 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:21.449136 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a74d5c-55c8-4d33-ba62-2a5fdf21adbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:21.449843 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a74d5c-55c8-4d33-ba62-2a5fdf21adbf None admin] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:21.450131 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a74d5c-55c8-4d33-ba62-2a5fdf21adbf None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:21.450413 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a74d5c-55c8-4d33-ba62-2a5fdf21adbf None admin] PATH_INFO: `/v3/endpoints` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:21.451173 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a74d5c-55c8-4d33-ba62-2a5fdf21adbf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:21.452640 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a74d5c-55c8-4d33-ba62-2a5fdf21adbf None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:21.468979 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5c45d-8160-468b-b2fa-c789264bccc5 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:21.486270 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 466/914] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:20:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:20:21.524495 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209fbdd-35ad-4834-9999-0f7aedbb2f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:21.525107 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209fbdd-35ad-4834-9999-0f7aedbb2f15 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:21.525409 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209fbdd-35ad-4834-9999-0f7aedbb2f15 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:21.525696 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209fbdd-35ad-4834-9999-0f7aedbb2f15 None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:21.526436 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6209fbdd-35ad-4834-9999-0f7aedbb2f15 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:21.526746 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6209fbdd-35ad-4834-9999-0f7aedbb2f15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:21.528175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6209fbdd-35ad-4834-9999-0f7aedbb2f15 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:21.539726 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 449/915] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:20:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:21.548634 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a74d5c-55c8-4d33-ba62-2a5fdf21adbf None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:21.679502 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a74d5c-55c8-4d33-ba62-2a5fdf21adbf None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:21.718717 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285f8d3-253b-4ef4-86ca-d5336f7e0205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:21.719438 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285f8d3-253b-4ef4-86ca-d5336f7e0205 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:21.719728 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285f8d3-253b-4ef4-86ca-d5336f7e0205 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:21.720014 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285f8d3-253b-4ef4-86ca-d5336f7e0205 None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:21.720756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285f8d3-253b-4ef4-86ca-d5336f7e0205 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:21.721076 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285f8d3-253b-4ef4-86ca-d5336f7e0205 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:21.722673 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285f8d3-253b-4ef4-86ca-d5336f7e0205 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:21.728812 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 467/916] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:20:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:21.737772 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209fbdd-35ad-4834-9999-0f7aedbb2f15 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:21.885902 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209fbdd-35ad-4834-9999-0f7aedbb2f15 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:21.930005 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd55e5-7399-43ca-890e-b31e1cc9bbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:21.930915 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd55e5-7399-43ca-890e-b31e1cc9bbed None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:21.931215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd55e5-7399-43ca-890e-b31e1cc9bbed None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:21.931586 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd55e5-7399-43ca-890e-b31e1cc9bbed None admin] PATH_INFO: `/v3/endpoints` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:21.932878 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd55e5-7399-43ca-890e-b31e1cc9bbed None admin] RBAC: Adding query filter params (interface=public, service_id=3ef60c8b935a459e8161bdce0bed33b4, region_id=RegionOne) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:21.933233 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd55e5-7399-43ca-890e-b31e1cc9bbed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:21.935572 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd55e5-7399-43ca-890e-b31e1cc9bbed None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:21.949827 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 450/917] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:20:21 2022] GET /identity/v3/endpoints?service_id=3ef60c8b935a459e8161bdce0bed33b4&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:21.955100 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285f8d3-253b-4ef4-86ca-d5336f7e0205 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:22.072491 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285f8d3-253b-4ef4-86ca-d5336f7e0205 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:22.110671 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0aed9-b198-4949-8a0e-2cc85b117c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:22.111353 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0aed9-b198-4949-8a0e-2cc85b117c5a None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:22.111641 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0aed9-b198-4949-8a0e-2cc85b117c5a None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:22.111918 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0aed9-b198-4949-8a0e-2cc85b117c5a None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:22.112614 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0aed9-b198-4949-8a0e-2cc85b117c5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:22.114992 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0aed9-b198-4949-8a0e-2cc85b117c5a None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:22.122242 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 468/918] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:20:21 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:20:22.855732 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43764735-7f0a-4fb1-bb6e-05aa9da6f3bf None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:22.856463 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43764735-7f0a-4fb1-bb6e-05aa9da6f3bf None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:22.856463 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43764735-7f0a-4fb1-bb6e-05aa9da6f3bf None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:22.857903 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 451/919] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:22.864303 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e18cc2-7d69-4d99-b9fd-b35ef06e6ba4 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:22.865249 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e18cc2-7d69-4d99-b9fd-b35ef06e6ba4 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:22.865795 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e18cc2-7d69-4d99-b9fd-b35ef06e6ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:22.883067 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a5532-2719-45f0-9c6a-8e4f8862121b None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:22.883809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a5532-2719-45f0-9c6a-8e4f8862121b None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:22.884288 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a5532-2719-45f0-9c6a-8e4f8862121b None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:22.884612 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-18e18cc2-7d69-4d99-b9fd-b35ef06e6ba4 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:22.885876 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-18e18cc2-7d69-4d99-b9fd-b35ef06e6ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:22.886649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 452/920] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:20:22.894213 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd7485-0626-476e-8e91-1e52b52be63c None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:22.895283 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd7485-0626-476e-8e91-1e52b52be63c None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:22.895786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd7485-0626-476e-8e91-1e52b52be63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:22.918607 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-0bfd7485-0626-476e-8e91-1e52b52be63c None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:22.920629 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-0bfd7485-0626-476e-8e91-1e52b52be63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:22.973498 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 469/921] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:23.000427 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e18cc2-7d69-4d99-b9fd-b35ef06e6ba4 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:23.008544 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 453/922] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:20:23.031898 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd7485-0626-476e-8e91-1e52b52be63c None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:23.131806 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e18cc2-7d69-4d99-b9fd-b35ef06e6ba4 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:23.177278 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ee16c-3adc-4610-b7d8-5185ce9607f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:23.178327 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ee16c-3adc-4610-b7d8-5185ce9607f6 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:23.178666 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ee16c-3adc-4610-b7d8-5185ce9607f6 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:23.179039 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ee16c-3adc-4610-b7d8-5185ce9607f6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:23.193053 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ee16c-3adc-4610-b7d8-5185ce9607f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:20:23.198214 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd7485-0626-476e-8e91-1e52b52be63c None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:23.201951 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-c28ee16c-3adc-4610-b7d8-5185ce9607f6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:20:23.201951 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:23.201951 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:23.201951 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:23.201951 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:23.201951 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:23.201951 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:23.201951 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:23.201951 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:23.201951 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:23.201951 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:23.201951 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:23.201951 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:20:23.201951 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:20:23.201951 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:20:23.201951 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:20:23.203618 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:20:23.203618 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:20:23.203618 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:20:23.203618 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:20:23.203618 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:23.203618 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:23.203618 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:23.203618 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:23.203618 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:23.203618 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:23.203618 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:23.203618 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:23.203618 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:23.203618 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:23.203618 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:23.203618 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:23.205772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:23.205772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:23.205772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:23.205772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:23.205772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:20:23.205772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:20:23.205772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:20:23.205772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:20:23.205772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:20:23.205772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:20:23.205772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:20:23.205772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:23.209615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 470/923] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 9 15:20:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:23.214656 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ee16c-3adc-4610-b7d8-5185ce9607f6 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:23.266331 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15dd3ff-1728-4fe0-997c-55e5294250f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:23.267602 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dd3ff-1728-4fe0-997c-55e5294250f8 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:23.268112 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dd3ff-1728-4fe0-997c-55e5294250f8 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:23.268585 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dd3ff-1728-4fe0-997c-55e5294250f8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:23.269746 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15dd3ff-1728-4fe0-997c-55e5294250f8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:23.271536 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15dd3ff-1728-4fe0-997c-55e5294250f8 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:23.285215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-b15dd3ff-1728-4fe0-997c-55e5294250f8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:20:23.285215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:23.285215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:20:23.285215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:20:23.285215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:20:23.285215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:20:23.285215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:20:23.285215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:23.285215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:20:23.285215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:23.285215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:20:23.285215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:23.285215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:23.285215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:23.285215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:23.285215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:23.285215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:23.286307 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:23.286307 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:23.286307 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:23.286307 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:23.286307 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:23.286307 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:23.286307 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:20:23.286307 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:20:23.286307 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:20:23.286307 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:20:23.286307 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:23.286307 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:23.286307 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:23.286307 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:23.286307 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:23.286307 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:23.287049 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:23.287049 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:23.287049 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:23.287049 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:23.287049 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:23.287049 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:23.287049 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:23.287049 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:23.287049 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:23.287049 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:23.287049 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:20:23.287049 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:23.287049 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:20:23.287049 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:23.294560 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 454/924] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:20:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:23.296553 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15dd3ff-1728-4fe0-997c-55e5294250f8 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:23.432479 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ee16c-3adc-4610-b7d8-5185ce9607f6 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:23.461950 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15dd3ff-1728-4fe0-997c-55e5294250f8 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:23.483741 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e69733-8b92-4805-b83c-5929662ca245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:23.485057 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e69733-8b92-4805-b83c-5929662ca245 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:23.485609 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e69733-8b92-4805-b83c-5929662ca245 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:23.486628 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e69733-8b92-4805-b83c-5929662ca245 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:23.488633 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e69733-8b92-4805-b83c-5929662ca245 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:23.489219 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e69733-8b92-4805-b83c-5929662ca245 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:23.492667 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e69733-8b92-4805-b83c-5929662ca245 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:23.509604 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 471/925] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:20:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:23.513498 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e69733-8b92-4805-b83c-5929662ca245 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:23.521212 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069107d9-91d4-415f-b3e3-e89b3933f4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:23.522337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069107d9-91d4-415f-b3e3-e89b3933f4e8 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:23.522831 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069107d9-91d4-415f-b3e3-e89b3933f4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:23.523323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069107d9-91d4-415f-b3e3-e89b3933f4e8 None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:23.524316 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069107d9-91d4-415f-b3e3-e89b3933f4e8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:23.524859 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069107d9-91d4-415f-b3e3-e89b3933f4e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:23.526598 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069107d9-91d4-415f-b3e3-e89b3933f4e8 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:23.540833 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 455/926] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:20:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:23.544751 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069107d9-91d4-415f-b3e3-e89b3933f4e8 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:23.652314 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e69733-8b92-4805-b83c-5929662ca245 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:23.685142 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069107d9-91d4-415f-b3e3-e89b3933f4e8 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:23.698011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e1225-c20c-40c0-b4d6-c02412c882de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:23.699115 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e1225-c20c-40c0-b4d6-c02412c882de None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:23.699408 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e1225-c20c-40c0-b4d6-c02412c882de None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:23.699691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e1225-c20c-40c0-b4d6-c02412c882de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:23.714655 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e1225-c20c-40c0-b4d6-c02412c882de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:23.716457 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e1225-c20c-40c0-b4d6-c02412c882de None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:23.726841 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545fd93-c371-4f4a-9818-72d1081e5fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:23.728033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545fd93-c371-4f4a-9818-72d1081e5fb3 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:23.728609 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545fd93-c371-4f4a-9818-72d1081e5fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:23.729104 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545fd93-c371-4f4a-9818-72d1081e5fb3 None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:23.730485 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545fd93-c371-4f4a-9818-72d1081e5fb3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:23.730871 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545fd93-c371-4f4a-9818-72d1081e5fb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:23.732435 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545fd93-c371-4f4a-9818-72d1081e5fb3 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:23.737251 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-475e1225-c20c-40c0-b4d6-c02412c882de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:23.737251 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:23.737251 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:23.737251 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:23.737251 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:23.737251 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:23.737251 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:23.737251 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:23.737251 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:23.737251 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:23.737251 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:23.737251 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:23.737251 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:23.737251 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:23.737251 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:23.738269 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:23.738269 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:23.738269 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:23.738269 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:23.738269 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:23.738269 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:23.738269 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:23.738269 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:23.738269 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:23.738269 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:23.738269 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:23.738269 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:23.738269 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:23.738269 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:23.738269 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:23.738269 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:23.738269 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:23.739053 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:23.739053 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:23.739053 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:23.739053 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:23.741832 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 456/927] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:20:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:23.744145 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 472/928] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:23.745672 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545fd93-c371-4f4a-9818-72d1081e5fb3 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:23.748354 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e1225-c20c-40c0-b4d6-c02412c882de None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:23.900695 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e1225-c20c-40c0-b4d6-c02412c882de None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:23.929413 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545fd93-c371-4f4a-9818-72d1081e5fb3 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:23.942015 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa91f29-4b92-4717-a1b8-1e217d02fdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:23.943077 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa91f29-4b92-4717-a1b8-1e217d02fdf2 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:23.943564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa91f29-4b92-4717-a1b8-1e217d02fdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:23.944041 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa91f29-4b92-4717-a1b8-1e217d02fdf2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:23.945057 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa91f29-4b92-4717-a1b8-1e217d02fdf2 None admin] RBAC: Adding query filter params (interface=public, service_id=3fed8ff0e7b14ee78bd5b5a8b60c5831, region_id=RegionOne) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:23.945646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa91f29-4b92-4717-a1b8-1e217d02fdf2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:23.947287 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa91f29-4b92-4717-a1b8-1e217d02fdf2 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:23.957485 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 473/929] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:20:23 2022] GET /identity/v3/endpoints?service_id=3fed8ff0e7b14ee78bd5b5a8b60c5831&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:23.960069 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa91f29-4b92-4717-a1b8-1e217d02fdf2 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:23.997446 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7040a-5ac3-4554-a9c9-de88c9ee51fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:23.998453 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7040a-5ac3-4554-a9c9-de88c9ee51fb None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:23.998883 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7040a-5ac3-4554-a9c9-de88c9ee51fb None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:23.999315 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7040a-5ac3-4554-a9c9-de88c9ee51fb None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:24.001824 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7040a-5ac3-4554-a9c9-de88c9ee51fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:24.002320 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7040a-5ac3-4554-a9c9-de88c9ee51fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:24.004626 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7040a-5ac3-4554-a9c9-de88c9ee51fb None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:24.029669 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 457/930] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:24.037767 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7040a-5ac3-4554-a9c9-de88c9ee51fb None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:24.092443 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa91f29-4b92-4717-a1b8-1e217d02fdf2 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:24.127013 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2680b92-5a10-4322-b1ed-70d1b64cdc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:24.127689 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2680b92-5a10-4322-b1ed-70d1b64cdc2c None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:24.127995 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2680b92-5a10-4322-b1ed-70d1b64cdc2c None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:24.128237 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2680b92-5a10-4322-b1ed-70d1b64cdc2c None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:24.129382 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2680b92-5a10-4322-b1ed-70d1b64cdc2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:24.130770 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2680b92-5a10-4322-b1ed-70d1b64cdc2c None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:24.137849 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 474/931] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:20:23 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:20:24.139158 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ccbe0-0866-4449-8cd6-c921e4ce5c06 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:24.139445 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ccbe0-0866-4449-8cd6-c921e4ce5c06 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:24.139717 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ccbe0-0866-4449-8cd6-c921e4ce5c06 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:24.141195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 475/932] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:24.148566 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccf176-8911-42dc-a28c-bc66dea7a3ff None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:24.148880 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccf176-8911-42dc-a28c-bc66dea7a3ff None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:24.149126 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccf176-8911-42dc-a28c-bc66dea7a3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:24.174594 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7040a-5ac3-4554-a9c9-de88c9ee51fb None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:24.180997 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-81ccf176-8911-42dc-a28c-bc66dea7a3ff None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:24.182887 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-81ccf176-8911-42dc-a28c-bc66dea7a3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:24.219805 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b17d42-d37a-44a1-833b-8710bd49a9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:24.221260 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b17d42-d37a-44a1-833b-8710bd49a9b0 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:24.221732 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b17d42-d37a-44a1-833b-8710bd49a9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:24.222722 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b17d42-d37a-44a1-833b-8710bd49a9b0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:24.234033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b17d42-d37a-44a1-833b-8710bd49a9b0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:24.236177 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b17d42-d37a-44a1-833b-8710bd49a9b0 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:24.265673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-c5b17d42-d37a-44a1-833b-8710bd49a9b0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:20:24.265673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:24.265673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:24.265673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:24.265673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:24.265673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:24.265673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:24.265673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:24.265673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:24.265673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:24.265673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:24.265673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:24.265673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:20:24.265673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:20:24.265673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:20:24.265673 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:20:24.266680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:24.266680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:24.266680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:20:24.266680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:24.266680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:20:24.266680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:24.266680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:24.266680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:24.266680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:24.266680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:24.266680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:24.266680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:24.266680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:24.266680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:24.266680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:24.266680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:24.266680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:24.266680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:24.267621 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:24.267621 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:24.267621 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:20:24.267621 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:20:24.267621 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:20:24.267621 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:20:24.267621 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:20:24.267621 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:20:24.267621 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:20:24.267621 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:24.270641 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 458/933] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:20:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:24.278942 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b17d42-d37a-44a1-833b-8710bd49a9b0 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:24.310350 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 476/934] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:20:24.335661 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccf176-8911-42dc-a28c-bc66dea7a3ff None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:24.435444 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b17d42-d37a-44a1-833b-8710bd49a9b0 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:24.481255 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccf176-8911-42dc-a28c-bc66dea7a3ff None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:24.486923 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a45a81-0e5f-411d-8fa3-562068b263cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:24.488033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a45a81-0e5f-411d-8fa3-562068b263cd None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:24.488501 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a45a81-0e5f-411d-8fa3-562068b263cd None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:24.489795 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a45a81-0e5f-411d-8fa3-562068b263cd None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:24.490954 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a45a81-0e5f-411d-8fa3-562068b263cd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:24.491831 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a45a81-0e5f-411d-8fa3-562068b263cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:24.494339 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a45a81-0e5f-411d-8fa3-562068b263cd None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:24.518386 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 459/935] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 9 15:20:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:24.524175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a45a81-0e5f-411d-8fa3-562068b263cd None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:24.528942 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967d0af-4f56-44ab-89d2-1dc9a51bd079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:24.529689 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967d0af-4f56-44ab-89d2-1dc9a51bd079 None admin] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:24.529975 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967d0af-4f56-44ab-89d2-1dc9a51bd079 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:24.530254 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967d0af-4f56-44ab-89d2-1dc9a51bd079 None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:24.530976 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967d0af-4f56-44ab-89d2-1dc9a51bd079 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:24.532484 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967d0af-4f56-44ab-89d2-1dc9a51bd079 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:24.533947 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: WARNING keystone.server.flask.common [None req-7967d0af-4f56-44ab-89d2-1dc9a51bd079 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 09 15:20:24.553868 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.sql.core [None req-7967d0af-4f56-44ab-89d2-1dc9a51bd079 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 15:20:24.553868 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 09 15:20:24.553868 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [parameters: {'id': '31afd549d4554d2d818ca1dc16694951', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 09 15:20:24.553868 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=143281) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 15:20:24.576734 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-7967d0af-4f56-44ab-89d2-1dc9a51bd079 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 31afd549d4554d2d818ca1dc16694951.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 31afd549d4554d2d818ca1dc16694951. May 09 15:20:24.576734 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:24.576734 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:20:24.576734 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:20:24.576734 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:20:24.576734 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:20:24.576734 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:20:24.576734 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:20:24.576734 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:20:24.576734 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application conn.query(q) May 09 15:20:24.576734 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:20:24.576734 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:20:24.576734 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:20:24.577598 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application result.read() May 09 15:20:24.577598 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:20:24.577598 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:20:24.577598 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:20:24.577598 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:20:24.577598 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:20:24.577598 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:20:24.577598 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:20:24.577598 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:20:24.577598 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 15:20:24.577598 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:24.577598 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 15:20:24.577598 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:24.577598 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:24.577598 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 15:20:24.577598 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 15:20:24.577598 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 09 15:20:24.577598 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return project_ref.to_dict() May 09 15:20:24.578481 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:20:24.578481 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application next(self.gen) May 09 15:20:24.578481 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 15:20:24.578481 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application yield resource May 09 15:20:24.578481 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:20:24.578481 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application next(self.gen) May 09 15:20:24.578481 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 15:20:24.578481 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self.session.rollback() May 09 15:20:24.578481 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 15:20:24.578481 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self.force_reraise() May 09 15:20:24.578481 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 15:20:24.578481 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise self.value May 09 15:20:24.578481 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 15:20:24.578481 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 15:20:24.578481 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 15:20:24.578481 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application session.commit() May 09 15:20:24.578481 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 15:20:24.579634 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 15:20:24.579634 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 15:20:24.579634 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self._prepare_impl() May 09 15:20:24.579634 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 15:20:24.579634 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self.session.flush() May 09 15:20:24.579634 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 15:20:24.579634 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self._flush(objects) May 09 15:20:24.579634 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 15:20:24.579634 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 15:20:24.579634 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 15:20:24.579634 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application compat.raise_( May 09 15:20:24.579634 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:20:24.579634 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception May 09 15:20:24.579634 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 15:20:24.579634 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application flush_context.execute() May 09 15:20:24.579634 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 15:20:24.579634 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rec.execute(self) May 09 15:20:24.580525 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 15:20:24.580525 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 15:20:24.580525 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 15:20:24.580525 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 15:20:24.580525 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 09 15:20:24.580525 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application c = connection._execute_20( May 09 15:20:24.580525 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 15:20:24.580525 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 15:20:24.580525 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 15:20:24.580525 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 15:20:24.580525 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 15:20:24.580525 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 15:20:24.580525 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 15:20:24.580525 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 15:20:24.580525 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 15:20:24.581244 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 15:20:24.581244 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:20:24.581244 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception May 09 15:20:24.581244 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:20:24.581244 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:20:24.581244 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:20:24.581244 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:20:24.581244 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:20:24.581244 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:20:24.581244 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:20:24.581244 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application conn.query(q) May 09 15:20:24.581244 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:20:24.581244 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:20:24.581244 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:20:24.581244 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application result.read() May 09 15:20:24.581244 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:20:24.581244 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:20:24.582801 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:20:24.582801 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:20:24.582801 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:20:24.582801 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:20:24.582801 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:20:24.582801 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:20:24.582801 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 15:20:24.582801 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 09 15:20:24.582801 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [parameters: {'id': '31afd549d4554d2d818ca1dc16694951', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 09 15:20:24.582801 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 15:20:24.582801 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:24.582801 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:20:24.582801 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:24.582801 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:24.582801 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 09 15:20:24.585028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 09 15:20:24.585028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 15:20:24.585028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 15:20:24.585028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 09 15:20:24.585028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:24.585028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:20:24.585028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:24.585028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:24.585028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:24.585028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:24.585028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:24.585028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:24.585028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:24.585028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:24.585028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:24.585028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:24.585028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:24.587186 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:24.587186 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 09 15:20:24.587186 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 09 15:20:24.587186 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:24.587186 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:24.587186 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 09 15:20:24.587186 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.Conflict( May 09 15:20:24.587186 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 31afd549d4554d2d818ca1dc16694951. May 09 15:20:24.587186 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:24.587186 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 477/936] 10.222.0.48 () {60 vars in 1140 bytes} [Mon May 9 15:20:24 2022] POST /identity/v3/projects => generated 262 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:24.588595 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967d0af-4f56-44ab-89d2-1dc9a51bd079 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:24.654636 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a45a81-0e5f-411d-8fa3-562068b263cd None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:24.691110 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3de45-51f9-4f64-bcf1-a79c308a2050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:24.691908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3de45-51f9-4f64-bcf1-a79c308a2050 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:24.692202 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3de45-51f9-4f64-bcf1-a79c308a2050 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:24.692677 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3de45-51f9-4f64-bcf1-a79c308a2050 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:24.701915 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967d0af-4f56-44ab-89d2-1dc9a51bd079 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:24.703097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3de45-51f9-4f64-bcf1-a79c308a2050 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:24.704573 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3de45-51f9-4f64-bcf1-a79c308a2050 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:24.724870 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-fac3de45-51f9-4f64-bcf1-a79c308a2050 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:24.724870 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:24.724870 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:24.724870 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:24.724870 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:24.724870 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:24.724870 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:24.724870 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:24.724870 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:24.724870 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:24.724870 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:24.724870 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:24.724870 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:24.724870 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:24.724870 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:24.726863 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:24.726863 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:24.726863 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:24.726863 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:24.726863 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:24.726863 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:24.726863 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:24.726863 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:24.726863 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:24.726863 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:24.726863 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:24.726863 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:24.726863 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:24.726863 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:24.726863 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:24.726863 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:24.726863 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:24.728003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:24.728003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:24.728003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:24.728003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:24.728003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 460/937] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:24.728003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9786bf2-8b83-4f96-aae0-03cab62cbe3c None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:24.728554 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9786bf2-8b83-4f96-aae0-03cab62cbe3c None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:24.728554 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9786bf2-8b83-4f96-aae0-03cab62cbe3c None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:24.730019 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 461/938] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:24.734756 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9786bf2-8b83-4f96-aae0-03cab62cbe3c None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:24.750674 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78c091-e7e2-49d2-93ba-b8784b88426f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:24.751505 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78c091-e7e2-49d2-93ba-b8784b88426f None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:24.751786 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78c091-e7e2-49d2-93ba-b8784b88426f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:24.752069 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78c091-e7e2-49d2-93ba-b8784b88426f None admin] PATH_INFO: `/v3/projects/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:24.760225 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78c091-e7e2-49d2-93ba-b8784b88426f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:24.761967 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78c091-e7e2-49d2-93ba-b8784b88426f None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:24.777698 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-4f78c091-e7e2-49d2-93ba-b8784b88426f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:24.777698 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:24.777698 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:24.777698 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:24.777698 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:24.777698 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:24.777698 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:24.777698 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:24.777698 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:24.777698 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:24.777698 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:24.777698 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:24.777698 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:20:24.777698 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:20:24.777698 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:20:24.778656 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:20:24.778656 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:24.778656 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:24.778656 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:24.778656 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:24.778656 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:24.778656 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:24.778656 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:24.778656 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:24.778656 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:24.778656 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:24.778656 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:24.778656 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:24.778656 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:24.778656 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:24.778656 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:24.778656 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:24.779467 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:20:24.779467 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:20:24.779467 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:20:24.779467 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:20:24.779467 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:20:24.779467 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:20:24.779467 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:24.779467 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:24.783963 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 478/939] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:20:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:24.785284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a2cbc-6ecb-4b9d-9122-503ac2590c81 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:24.785612 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a2cbc-6ecb-4b9d-9122-503ac2590c81 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:24.785891 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a2cbc-6ecb-4b9d-9122-503ac2590c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:24.807512 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-1f2a2cbc-6ecb-4b9d-9122-503ac2590c81 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:24.809010 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-1f2a2cbc-6ecb-4b9d-9122-503ac2590c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:24.874449 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9786bf2-8b83-4f96-aae0-03cab62cbe3c None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:24.887850 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 479/940] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:24.889036 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a2cbc-6ecb-4b9d-9122-503ac2590c81 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:24.912589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f597d-73bb-43eb-8aca-73c8695ce306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:24.913271 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f597d-73bb-43eb-8aca-73c8695ce306 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:24.913590 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f597d-73bb-43eb-8aca-73c8695ce306 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:24.913927 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f597d-73bb-43eb-8aca-73c8695ce306 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:24.914674 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f597d-73bb-43eb-8aca-73c8695ce306 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:24.915039 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f597d-73bb-43eb-8aca-73c8695ce306 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:24.916487 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f597d-73bb-43eb-8aca-73c8695ce306 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:24.929123 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 462/941] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:24.930030 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f597d-73bb-43eb-8aca-73c8695ce306 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:25.003149 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a2cbc-6ecb-4b9d-9122-503ac2590c81 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:25.032996 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f597d-73bb-43eb-8aca-73c8695ce306 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:25.039811 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf847f-3d4a-425f-8da4-12c20cf3b930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:25.040484 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf847f-3d4a-425f-8da4-12c20cf3b930 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:25.040821 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf847f-3d4a-425f-8da4-12c20cf3b930 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:25.041107 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf847f-3d4a-425f-8da4-12c20cf3b930 None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:25.041941 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf847f-3d4a-425f-8da4-12c20cf3b930 None admin] RBAC: Adding query filter params (name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:25.042256 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf847f-3d4a-425f-8da4-12c20cf3b930 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:25.043693 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf847f-3d4a-425f-8da4-12c20cf3b930 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:25.064541 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 480/942] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:20:24 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:25.065701 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf847f-3d4a-425f-8da4-12c20cf3b930 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:25.076911 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f68719-6719-4f3b-9bf9-dc906c244670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:25.078151 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f68719-6719-4f3b-9bf9-dc906c244670 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:25.078623 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f68719-6719-4f3b-9bf9-dc906c244670 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:25.079109 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f68719-6719-4f3b-9bf9-dc906c244670 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:25.079977 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f68719-6719-4f3b-9bf9-dc906c244670 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:25.082233 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f68719-6719-4f3b-9bf9-dc906c244670 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:25.095843 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-c8f68719-6719-4f3b-9bf9-dc906c244670 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:20:25.095843 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:25.095843 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:20:25.095843 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:20:25.095843 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:20:25.095843 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:20:25.095843 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:20:25.095843 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:25.095843 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:20:25.095843 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:25.095843 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:20:25.095843 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:25.095843 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:25.095843 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:25.095843 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:25.095843 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:25.096955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:25.096955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:25.096955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:25.096955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:25.096955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:25.096955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:25.096955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:25.096955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:20:25.096955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:20:25.096955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:20:25.096955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:20:25.096955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:25.096955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:25.096955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:25.096955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:25.096955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:25.097922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:25.097922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:25.097922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:25.097922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:25.097922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:25.097922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:25.097922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:25.097922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:25.097922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:25.097922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:25.097922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:25.097922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:20:25.097922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:25.097922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:20:25.097922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:25.105824 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 463/943] 10.222.0.48 () {56 vars in 1132 bytes} [Mon May 9 15:20:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:25.107077 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f68719-6719-4f3b-9bf9-dc906c244670 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:25.215335 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf847f-3d4a-425f-8da4-12c20cf3b930 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:25.218779 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f68719-6719-4f3b-9bf9-dc906c244670 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:25.256454 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce35d68-b04e-418f-9e20-764d85cf313c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:25.257177 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce35d68-b04e-418f-9e20-764d85cf313c None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:25.257579 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce35d68-b04e-418f-9e20-764d85cf313c None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:25.257933 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce35d68-b04e-418f-9e20-764d85cf313c None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:25.258765 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce35d68-b04e-418f-9e20-764d85cf313c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:25.259155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce35d68-b04e-418f-9e20-764d85cf313c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:25.260614 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce35d68-b04e-418f-9e20-764d85cf313c None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:25.262226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b53b0-c07c-47f0-8bd6-f1a992dcafd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:25.263710 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b53b0-c07c-47f0-8bd6-f1a992dcafd0 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:25.264179 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b53b0-c07c-47f0-8bd6-f1a992dcafd0 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:25.264915 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b53b0-c07c-47f0-8bd6-f1a992dcafd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:25.272046 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 464/944] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:20:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:25.273132 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce35d68-b04e-418f-9e20-764d85cf313c None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:25.274643 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b53b0-c07c-47f0-8bd6-f1a992dcafd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:25.276535 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b53b0-c07c-47f0-8bd6-f1a992dcafd0 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:25.298691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-290b53b0-c07c-47f0-8bd6-f1a992dcafd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:25.298691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:25.298691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:25.298691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:25.298691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:25.298691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:25.298691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:25.298691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:25.298691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:25.298691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:25.298691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:25.298691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:25.298691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:20:25.298691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:20:25.298691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:20:25.299553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:20:25.299553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:25.299553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:25.299553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:25.299553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:25.299553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:25.299553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:25.299553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:25.299553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:25.299553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:25.299553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:25.299553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:25.299553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:25.299553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:25.299553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:25.299553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:25.299553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:25.300941 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:20:25.300941 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:20:25.300941 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:20:25.300941 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:20:25.300941 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:20:25.300941 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:20:25.300941 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:25.300941 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:25.302997 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 481/945] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:20:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:25.308579 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b53b0-c07c-47f0-8bd6-f1a992dcafd0 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:25.398745 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce35d68-b04e-418f-9e20-764d85cf313c None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:25.443898 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b53b0-c07c-47f0-8bd6-f1a992dcafd0 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:25.444453 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60c913-c0a1-4f06-ba12-a51fad4911ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:25.445134 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60c913-c0a1-4f06-ba12-a51fad4911ba None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:25.445439 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60c913-c0a1-4f06-ba12-a51fad4911ba None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:25.445715 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60c913-c0a1-4f06-ba12-a51fad4911ba None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:25.446432 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60c913-c0a1-4f06-ba12-a51fad4911ba None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:25.446892 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60c913-c0a1-4f06-ba12-a51fad4911ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:25.449143 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60c913-c0a1-4f06-ba12-a51fad4911ba None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:25.459914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 465/946] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:20:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:25.462462 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60c913-c0a1-4f06-ba12-a51fad4911ba None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:25.491501 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e3a31-4ac0-4c96-8581-661b50e0b95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:25.491501 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e3a31-4ac0-4c96-8581-661b50e0b95f None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:25.491501 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e3a31-4ac0-4c96-8581-661b50e0b95f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:25.491850 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e3a31-4ac0-4c96-8581-661b50e0b95f None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:25.492388 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e3a31-4ac0-4c96-8581-661b50e0b95f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:25.492700 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e3a31-4ac0-4c96-8581-661b50e0b95f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:25.494436 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e3a31-4ac0-4c96-8581-661b50e0b95f None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:25.511515 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 482/947] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:20:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:25.517787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e3a31-4ac0-4c96-8581-661b50e0b95f None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:25.585196 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60c913-c0a1-4f06-ba12-a51fad4911ba None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:25.623980 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80daaff8-052f-47b7-8da3-5adaeaf79b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:25.624684 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80daaff8-052f-47b7-8da3-5adaeaf79b66 None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:25.624976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80daaff8-052f-47b7-8da3-5adaeaf79b66 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:25.625257 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80daaff8-052f-47b7-8da3-5adaeaf79b66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:25.626054 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80daaff8-052f-47b7-8da3-5adaeaf79b66 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:25.627435 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80daaff8-052f-47b7-8da3-5adaeaf79b66 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:25.641393 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e3a31-4ac0-4c96-8581-661b50e0b95f None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:25.655393 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 466/948] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:20:25 2022] POST /identity/v3/endpoints => generated 347 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:20:25.698523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f9033-c701-4b5e-bc51-2bc1a81945e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:25.699443 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f9033-c701-4b5e-bc51-2bc1a81945e0 None admin] REQUEST_METHOD: `PUT` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:25.699729 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f9033-c701-4b5e-bc51-2bc1a81945e0 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:25.700001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f9033-c701-4b5e-bc51-2bc1a81945e0 None admin] PATH_INFO: `/v3/projects/eb2de9bea1cf451db5f8c697f480c480/users/ed964c5d606a4934b5bd9bd5890562ad/roles/fbc2125af36f44b0913c866ea5f56ca5` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:25.702482 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f9033-c701-4b5e-bc51-2bc1a81945e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb2de9bea1cf451db5f8c697f480c480, user_id=ed964c5d606a4934b5bd9bd5890562ad, role_id=fbc2125af36f44b0913c866ea5f56ca5)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:25.703954 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f9033-c701-4b5e-bc51-2bc1a81945e0 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:25.722682 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 483/949] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:20:25 2022] PUT /identity/v3/projects/eb2de9bea1cf451db5f8c697f480c480/users/ed964c5d606a4934b5bd9bd5890562ad/roles/fbc2125af36f44b0913c866ea5f56ca5 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:20:26.676686 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c7db3-fea6-4035-bf40-3d645ee2dfcc None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:26.677192 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c7db3-fea6-4035-bf40-3d645ee2dfcc None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:26.677265 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c7db3-fea6-4035-bf40-3d645ee2dfcc None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:26.678968 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 467/950] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:26.684703 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23077300-cf36-4c4f-a28a-21a38ffb23c3 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:26.685210 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23077300-cf36-4c4f-a28a-21a38ffb23c3 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:26.685287 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23077300-cf36-4c4f-a28a-21a38ffb23c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:26.703170 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-23077300-cf36-4c4f-a28a-21a38ffb23c3 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:26.704393 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-23077300-cf36-4c4f-a28a-21a38ffb23c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:26.781479 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 484/951] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:26.799453 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c7db3-fea6-4035-bf40-3d645ee2dfcc None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:26.913772 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c7db3-fea6-4035-bf40-3d645ee2dfcc None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:26.953519 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3d42c-c635-4c49-a04a-e87d6e36492d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:26.954334 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3d42c-c635-4c49-a04a-e87d6e36492d None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:26.954624 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3d42c-c635-4c49-a04a-e87d6e36492d None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:26.954908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3d42c-c635-4c49-a04a-e87d6e36492d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:26.955571 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c3d42c-c635-4c49-a04a-e87d6e36492d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:26.958044 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c3d42c-c635-4c49-a04a-e87d6e36492d None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:26.970670 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-40c3d42c-c635-4c49-a04a-e87d6e36492d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:20:26.970670 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:26.970670 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:20:26.970670 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:20:26.970670 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:20:26.970670 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:20:26.970670 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:20:26.970670 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:26.970670 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:20:26.970670 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:26.970670 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:20:26.970670 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:26.970670 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:26.970670 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:26.970670 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:26.970670 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:26.970670 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:26.971646 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:26.971646 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:26.971646 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:26.971646 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:26.971646 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:26.971646 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:26.971646 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:20:26.971646 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:20:26.971646 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:20:26.971646 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:20:26.971646 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:26.971646 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:26.971646 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:26.971646 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:26.971646 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:26.971646 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:26.973021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:26.973021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:26.973021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:26.973021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:26.973021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:26.973021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:26.973021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:26.973021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:26.973021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:26.973021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:26.973021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:20:26.973021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:26.973021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:20:26.973021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:26.977491 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 468/952] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:20:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:26.979807 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23077300-cf36-4c4f-a28a-21a38ffb23c3 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:27.092676 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23077300-cf36-4c4f-a28a-21a38ffb23c3 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:27.131596 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73bf98-c1e4-4fd9-a5a4-65e58a5cdb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:27.132281 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73bf98-c1e4-4fd9-a5a4-65e58a5cdb79 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:27.132572 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73bf98-c1e4-4fd9-a5a4-65e58a5cdb79 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:27.132855 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73bf98-c1e4-4fd9-a5a4-65e58a5cdb79 None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:27.133611 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73bf98-c1e4-4fd9-a5a4-65e58a5cdb79 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:27.133926 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73bf98-c1e4-4fd9-a5a4-65e58a5cdb79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:27.135295 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73bf98-c1e4-4fd9-a5a4-65e58a5cdb79 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:27.145546 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 485/953] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:20:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:27.148076 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3d42c-c635-4c49-a04a-e87d6e36492d None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:27.251584 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3d42c-c635-4c49-a04a-e87d6e36492d None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:27.295731 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f9cb3-89d6-4d0b-88f9-b583552ddb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:27.296694 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f9cb3-89d6-4d0b-88f9-b583552ddb96 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:27.297158 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f9cb3-89d6-4d0b-88f9-b583552ddb96 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:27.297640 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f9cb3-89d6-4d0b-88f9-b583552ddb96 None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:27.298680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f9cb3-89d6-4d0b-88f9-b583552ddb96 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:27.299197 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f9cb3-89d6-4d0b-88f9-b583552ddb96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:27.300859 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f9cb3-89d6-4d0b-88f9-b583552ddb96 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:27.306523 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 469/954] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:20:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:27.315448 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73bf98-c1e4-4fd9-a5a4-65e58a5cdb79 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:27.430049 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73bf98-c1e4-4fd9-a5a4-65e58a5cdb79 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:27.465610 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd15e81-0470-4efe-970b-ad043ce394ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:27.466284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd15e81-0470-4efe-970b-ad043ce394ed None admin] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:27.466571 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd15e81-0470-4efe-970b-ad043ce394ed None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:27.466846 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd15e81-0470-4efe-970b-ad043ce394ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:27.467599 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd15e81-0470-4efe-970b-ad043ce394ed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:27.469044 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd15e81-0470-4efe-970b-ad043ce394ed None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:27.496940 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 486/955] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:20:27 2022] POST /identity/v3/endpoints => generated 349 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:20:27.538338 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1922ac-78bf-4249-81c9-4f8ac48db115 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:27.538647 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1922ac-78bf-4249-81c9-4f8ac48db115 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:27.538897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1922ac-78bf-4249-81c9-4f8ac48db115 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:27.540720 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 470/956] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:27.547729 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143ebce-980b-4589-9291-e459f4356cac None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:27.548016 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143ebce-980b-4589-9291-e459f4356cac None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:27.548354 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143ebce-980b-4589-9291-e459f4356cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:27.572185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-5143ebce-980b-4589-9291-e459f4356cac None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:27.573469 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-5143ebce-980b-4589-9291-e459f4356cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:27.666728 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 487/957] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:27.696541 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1922ac-78bf-4249-81c9-4f8ac48db115 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:27.804388 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1922ac-78bf-4249-81c9-4f8ac48db115 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:27.841627 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33029db-9b87-45e3-864a-e05a1b64ad2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:27.842661 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33029db-9b87-45e3-864a-e05a1b64ad2b None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:27.843153 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33029db-9b87-45e3-864a-e05a1b64ad2b None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:27.843608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33029db-9b87-45e3-864a-e05a1b64ad2b None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:27.844531 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33029db-9b87-45e3-864a-e05a1b64ad2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:27.846278 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33029db-9b87-45e3-864a-e05a1b64ad2b None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:27.848009 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: WARNING keystone.server.flask.common [None req-f33029db-9b87-45e3-864a-e05a1b64ad2b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 09 15:20:27.863934 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.sql.core [None req-f33029db-9b87-45e3-864a-e05a1b64ad2b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 15:20:27.863934 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 09 15:20:27.863934 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [parameters: {'user_id': '2302d4f591ba4ce0ab703a3fd8289389', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 09 15:20:27.863934 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=143282) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 15:20:27.872733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-f33029db-9b87-45e3-864a-e05a1b64ad2b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 09 15:20:27.872733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:27.872733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:20:27.872733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:20:27.872733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:20:27.872733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:20:27.872733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:20:27.872733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:20:27.872733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:20:27.872733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application conn.query(q) May 09 15:20:27.872733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:20:27.872733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:20:27.872733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:20:27.872733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application result.read() May 09 15:20:27.872733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:20:27.873839 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:20:27.873839 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:20:27.873839 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:20:27.873839 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:20:27.873839 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:20:27.873839 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:20:27.873839 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:20:27.873839 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 15:20:27.873839 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:27.873839 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 15:20:27.873839 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:27.873839 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:27.873839 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 15:20:27.873839 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 15:20:27.873839 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 09 15:20:27.873839 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 09 15:20:27.873839 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:20:27.873839 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application next(self.gen) May 09 15:20:27.874928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 15:20:27.874928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application yield resource May 09 15:20:27.874928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:20:27.874928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application next(self.gen) May 09 15:20:27.874928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 15:20:27.874928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self.session.rollback() May 09 15:20:27.874928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 15:20:27.874928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self.force_reraise() May 09 15:20:27.874928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 15:20:27.874928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise self.value May 09 15:20:27.874928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 15:20:27.874928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 15:20:27.874928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 15:20:27.874928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application session.commit() May 09 15:20:27.874928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 15:20:27.874928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 15:20:27.874928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 15:20:27.875781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._prepare_impl() May 09 15:20:27.875781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 15:20:27.875781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self.session.flush() May 09 15:20:27.875781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 15:20:27.875781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._flush(objects) May 09 15:20:27.875781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 15:20:27.875781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 15:20:27.875781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 15:20:27.875781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application compat.raise_( May 09 15:20:27.875781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:20:27.875781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception May 09 15:20:27.875781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 15:20:27.875781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application flush_context.execute() May 09 15:20:27.875781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 15:20:27.875781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rec.execute(self) May 09 15:20:27.875781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 15:20:27.875781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 15:20:27.876588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 15:20:27.876588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 15:20:27.876588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 09 15:20:27.876588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application result = connection._execute_20( May 09 15:20:27.876588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 15:20:27.876588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 15:20:27.876588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 15:20:27.876588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 15:20:27.876588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 15:20:27.876588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 15:20:27.876588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 15:20:27.876588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 15:20:27.876588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 15:20:27.876588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 15:20:27.876588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:20:27.876588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception May 09 15:20:27.877364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:20:27.877364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:20:27.877364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:20:27.877364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:20:27.877364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:20:27.877364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:20:27.877364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:20:27.877364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application conn.query(q) May 09 15:20:27.877364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:20:27.877364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:20:27.877364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:20:27.877364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application result.read() May 09 15:20:27.877364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:20:27.877364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:20:27.877364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:20:27.877364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:20:27.878449 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:20:27.878449 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:20:27.878449 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:20:27.878449 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:20:27.878449 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 15:20:27.878449 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 09 15:20:27.878449 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [parameters: {'user_id': '2302d4f591ba4ce0ab703a3fd8289389', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 09 15:20:27.878449 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 15:20:27.878449 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:27.878449 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:20:27.878449 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:27.878449 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:27.878449 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:27.878449 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:27.878449 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:27.879378 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:27.879378 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:27.879378 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:27.879378 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:27.879378 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:27.879378 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:27.879378 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:27.879378 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 09 15:20:27.879378 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 09 15:20:27.879378 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:27.879378 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:27.879378 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:20:27.879378 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:27.879378 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:20:27.879378 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:27.879378 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 09 15:20:27.879378 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 09 15:20:27.880571 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 09 15:20:27.880571 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 09 15:20:27.880571 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 15:20:27.880571 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 15:20:27.880571 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 09 15:20:27.880571 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:27.882906 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 471/958] 10.222.0.48 () {60 vars in 1131 bytes} [Mon May 9 15:20:27 2022] POST /identity/v3/users => generated 160 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:27.890729 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143ebce-980b-4589-9291-e459f4356cac None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:28.023281 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143ebce-980b-4589-9291-e459f4356cac None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:28.037693 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f56ff-8995-4015-b00b-1dfda49d182c None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:28.038144 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f56ff-8995-4015-b00b-1dfda49d182c None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:28.038433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f56ff-8995-4015-b00b-1dfda49d182c None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:28.046089 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 472/959] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:28.049566 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71545048-49ae-41f1-9ebe-6167ee2a4a31 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:28.049859 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71545048-49ae-41f1-9ebe-6167ee2a4a31 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:28.050180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71545048-49ae-41f1-9ebe-6167ee2a4a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:28.061624 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492e2a1-a82d-4940-b258-eef565f34697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:28.062925 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492e2a1-a82d-4940-b258-eef565f34697 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:28.063218 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492e2a1-a82d-4940-b258-eef565f34697 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:28.063670 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492e2a1-a82d-4940-b258-eef565f34697 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:28.068385 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-71545048-49ae-41f1-9ebe-6167ee2a4a31 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:28.069960 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-71545048-49ae-41f1-9ebe-6167ee2a4a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:28.072374 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492e2a1-a82d-4940-b258-eef565f34697 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:28.079502 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492e2a1-a82d-4940-b258-eef565f34697 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:28.102450 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-5492e2a1-a82d-4940-b258-eef565f34697 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:20:28.102450 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:28.102450 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:28.102450 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:28.102450 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:28.102450 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:28.102450 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:28.102450 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:28.102450 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:28.102450 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:28.102450 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:28.102450 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:28.102450 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:20:28.102450 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:20:28.102450 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:20:28.102450 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:20:28.103615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:28.103615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:28.103615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:20:28.103615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:28.103615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:20:28.103615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:28.103615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:28.103615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:28.103615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:28.103615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:28.103615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:28.103615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:28.103615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:28.103615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:28.103615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:28.103615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:28.103615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:28.103615 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:28.104685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:28.104685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:28.104685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:20:28.104685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:20:28.104685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:20:28.104685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:20:28.104685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:20:28.104685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:20:28.104685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:20:28.104685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:28.104685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 488/960] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:20:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:28.109797 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492e2a1-a82d-4940-b258-eef565f34697 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:28.148041 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 473/961] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:28.158582 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d44799-2fb7-47f7-836c-872dd3f8c875 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:28.158872 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d44799-2fb7-47f7-836c-872dd3f8c875 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:28.159152 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d44799-2fb7-47f7-836c-872dd3f8c875 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:28.161670 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 474/962] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:20:28.166775 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ca5e9-7975-44bb-963a-e33a763c6db7 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:28.167065 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ca5e9-7975-44bb-963a-e33a763c6db7 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:28.167343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ca5e9-7975-44bb-963a-e33a763c6db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:28.186070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-834ca5e9-7975-44bb-963a-e33a763c6db7 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:28.188249 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-834ca5e9-7975-44bb-963a-e33a763c6db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:28.248197 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492e2a1-a82d-4940-b258-eef565f34697 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:28.262427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 475/963] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:28.271285 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ca5e9-7975-44bb-963a-e33a763c6db7 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:28.290164 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c88714-6427-4c99-9042-5378ebfa17fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:28.290780 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c88714-6427-4c99-9042-5378ebfa17fa None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:28.291065 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c88714-6427-4c99-9042-5378ebfa17fa None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:28.291341 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c88714-6427-4c99-9042-5378ebfa17fa None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:28.292168 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c88714-6427-4c99-9042-5378ebfa17fa None admin] RBAC: Adding query filter params (name=cinder) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:28.292810 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c88714-6427-4c99-9042-5378ebfa17fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:28.294575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c88714-6427-4c99-9042-5378ebfa17fa None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:28.334654 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 489/964] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:20:28 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:28.335542 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c88714-6427-4c99-9042-5378ebfa17fa None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:28.394713 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ca5e9-7975-44bb-963a-e33a763c6db7 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:28.434176 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa983af1-c230-434f-8ef8-eb66561ff31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:28.435380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa983af1-c230-434f-8ef8-eb66561ff31e None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:28.435891 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa983af1-c230-434f-8ef8-eb66561ff31e None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:28.436363 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa983af1-c230-434f-8ef8-eb66561ff31e None admin] PATH_INFO: `/v3/services/compute` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:28.437315 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa983af1-c230-434f-8ef8-eb66561ff31e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:28.439220 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa983af1-c230-434f-8ef8-eb66561ff31e None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:28.452894 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-aa983af1-c230-434f-8ef8-eb66561ff31e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:20:28.452894 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:28.452894 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:20:28.452894 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:20:28.452894 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:20:28.452894 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:20:28.452894 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:20:28.452894 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:28.452894 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:20:28.452894 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:28.452894 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:20:28.452894 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:28.452894 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:28.452894 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:28.452894 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:28.452894 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:28.452894 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:28.453931 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:28.453931 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:28.453931 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:28.453931 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:28.453931 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:28.453931 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:28.453931 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:20:28.453931 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:20:28.453931 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:20:28.453931 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:20:28.453931 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:28.453931 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:28.453931 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:28.453931 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:28.453931 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:28.453931 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:28.454695 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:28.454695 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:28.454695 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:28.454695 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:28.454695 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:28.454695 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:28.454695 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:28.454695 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:28.454695 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:28.454695 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:28.454695 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:20:28.454695 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:28.454695 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:20:28.454695 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:28.455394 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c88714-6427-4c99-9042-5378ebfa17fa None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:28.462860 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 476/965] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:20:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:28.464147 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa983af1-c230-434f-8ef8-eb66561ff31e None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:28.495273 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274e99f-a833-4004-9c35-3abd29bae23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:28.496114 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274e99f-a833-4004-9c35-3abd29bae23f None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:28.496401 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274e99f-a833-4004-9c35-3abd29bae23f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:28.496761 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274e99f-a833-4004-9c35-3abd29bae23f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:28.512263 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274e99f-a833-4004-9c35-3abd29bae23f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:20:28.518250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-0274e99f-a833-4004-9c35-3abd29bae23f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:20:28.518250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:28.518250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:28.518250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:28.518250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:28.518250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:28.518250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:28.518250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:28.518250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:28.518250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:28.518250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:28.518250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:28.518250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:20:28.518250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:20:28.518250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:20:28.518250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:20:28.519747 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:20:28.519747 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:20:28.519747 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:20:28.519747 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:20:28.519747 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:28.519747 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:28.519747 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:28.519747 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:28.519747 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:28.519747 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:28.519747 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:28.519747 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:28.519747 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:28.519747 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:28.519747 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:28.519747 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:28.520608 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:28.520608 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:28.520608 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:28.520608 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:28.520608 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:20:28.520608 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:20:28.520608 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:20:28.520608 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:20:28.520608 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:20:28.520608 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:20:28.520608 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:20:28.520608 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:28.525602 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 490/966] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 9 15:20:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:28.526899 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274e99f-a833-4004-9c35-3abd29bae23f None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:28.629576 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa983af1-c230-434f-8ef8-eb66561ff31e None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:28.678122 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274e99f-a833-4004-9c35-3abd29bae23f None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:28.680982 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c661b-5b80-4e4d-9f00-1e6618ee05d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:28.681698 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c661b-5b80-4e4d-9f00-1e6618ee05d7 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:28.681987 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c661b-5b80-4e4d-9f00-1e6618ee05d7 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:28.682263 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c661b-5b80-4e4d-9f00-1e6618ee05d7 None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:28.683033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c661b-5b80-4e4d-9f00-1e6618ee05d7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:28.683299 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c661b-5b80-4e4d-9f00-1e6618ee05d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:28.684670 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c661b-5b80-4e4d-9f00-1e6618ee05d7 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:28.693317 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 477/967] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:20:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:28.698769 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c661b-5b80-4e4d-9f00-1e6618ee05d7 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:28.718628 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af197342-9a37-4027-a7ae-8652bdc162e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:28.719331 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af197342-9a37-4027-a7ae-8652bdc162e4 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:28.719609 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af197342-9a37-4027-a7ae-8652bdc162e4 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:28.719896 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af197342-9a37-4027-a7ae-8652bdc162e4 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:28.720666 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af197342-9a37-4027-a7ae-8652bdc162e4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:28.720983 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af197342-9a37-4027-a7ae-8652bdc162e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:28.722453 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af197342-9a37-4027-a7ae-8652bdc162e4 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:28.731468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 491/968] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:20:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:28.738079 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af197342-9a37-4027-a7ae-8652bdc162e4 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:28.816422 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c661b-5b80-4e4d-9f00-1e6618ee05d7 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:28.850110 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af197342-9a37-4027-a7ae-8652bdc162e4 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:28.854782 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65084ca0-e2d9-4d02-a923-b15968b74261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:28.855460 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65084ca0-e2d9-4d02-a923-b15968b74261 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:28.855750 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65084ca0-e2d9-4d02-a923-b15968b74261 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:28.856034 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65084ca0-e2d9-4d02-a923-b15968b74261 None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:28.856755 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65084ca0-e2d9-4d02-a923-b15968b74261 None admin] RBAC: Adding query filter params (type=compute) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:28.857068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65084ca0-e2d9-4d02-a923-b15968b74261 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:28.858515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65084ca0-e2d9-4d02-a923-b15968b74261 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:28.863618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 478/969] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:20:28 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:28.904882 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cc279-7a4e-40fa-a83e-396626414a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:28.905756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cc279-7a4e-40fa-a83e-396626414a49 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:28.906077 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cc279-7a4e-40fa-a83e-396626414a49 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:28.906323 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2cc279-7a4e-40fa-a83e-396626414a49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:28.923115 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2cc279-7a4e-40fa-a83e-396626414a49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:28.924653 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2cc279-7a4e-40fa-a83e-396626414a49 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:28.945938 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-2c2cc279-7a4e-40fa-a83e-396626414a49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:28.945938 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:28.945938 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:28.945938 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:28.945938 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:28.945938 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:28.945938 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:28.945938 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:28.945938 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:28.945938 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:28.945938 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:28.945938 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:28.945938 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:28.945938 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:28.945938 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:28.947001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:28.947001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:28.947001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:28.947001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:28.947001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:28.947001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:28.947001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:28.947001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:28.947001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:28.947001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:28.947001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:28.947001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:28.947001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:28.947001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:28.947001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:28.947001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:28.947001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:28.948088 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:28.948088 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:28.948088 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:28.948088 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:28.949943 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 492/970] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:28.955760 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65084ca0-e2d9-4d02-a923-b15968b74261 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:29.086003 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65084ca0-e2d9-4d02-a923-b15968b74261 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:29.123090 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1185ad5-eccf-492a-9326-20308ebd68a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:29.123766 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1185ad5-eccf-492a-9326-20308ebd68a3 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:29.124051 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1185ad5-eccf-492a-9326-20308ebd68a3 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:29.124331 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1185ad5-eccf-492a-9326-20308ebd68a3 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:29.125059 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1185ad5-eccf-492a-9326-20308ebd68a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:29.125388 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1185ad5-eccf-492a-9326-20308ebd68a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:29.126780 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1185ad5-eccf-492a-9326-20308ebd68a3 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:29.144174 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 479/971] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:29.150625 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cc279-7a4e-40fa-a83e-396626414a49 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:29.263149 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2cc279-7a4e-40fa-a83e-396626414a49 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:29.301893 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ddf84-3c5a-42df-ae09-8d13fc4252a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:29.302722 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ddf84-3c5a-42df-ae09-8d13fc4252a0 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:29.303005 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ddf84-3c5a-42df-ae09-8d13fc4252a0 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:29.303290 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ddf84-3c5a-42df-ae09-8d13fc4252a0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:29.311782 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ddf84-3c5a-42df-ae09-8d13fc4252a0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:29.313110 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ddf84-3c5a-42df-ae09-8d13fc4252a0 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:29.330751 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-b52ddf84-3c5a-42df-ae09-8d13fc4252a0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:20:29.330751 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:29.330751 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:29.330751 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:29.330751 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:29.330751 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:29.330751 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:29.330751 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:29.330751 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:29.330751 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:29.330751 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:29.330751 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:29.330751 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:20:29.330751 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:20:29.330751 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:20:29.330751 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:20:29.331713 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:29.331713 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:29.331713 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:20:29.331713 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:29.331713 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:20:29.331713 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:29.331713 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:29.331713 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:29.331713 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:29.331713 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:29.331713 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:29.331713 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:29.331713 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:29.331713 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:29.331713 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:29.331713 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:29.331713 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:29.331713 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:29.332577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:29.332577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:29.332577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:20:29.332577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:20:29.332577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:20:29.332577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:20:29.332577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:20:29.332577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:20:29.332577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:20:29.332577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:29.332577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 493/972] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:20:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:29.339598 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1185ad5-eccf-492a-9326-20308ebd68a3 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:29.458709 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1185ad5-eccf-492a-9326-20308ebd68a3 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:29.494870 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf7980-d0f6-42cc-a05e-fbcb9f480df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:29.495644 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf7980-d0f6-42cc-a05e-fbcb9f480df3 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:29.496008 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf7980-d0f6-42cc-a05e-fbcb9f480df3 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:29.496363 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf7980-d0f6-42cc-a05e-fbcb9f480df3 None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:29.497296 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf7980-d0f6-42cc-a05e-fbcb9f480df3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:29.497709 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf7980-d0f6-42cc-a05e-fbcb9f480df3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:29.499224 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf7980-d0f6-42cc-a05e-fbcb9f480df3 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:29.521128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 480/973] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 9 15:20:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:29.528414 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ddf84-3c5a-42df-ae09-8d13fc4252a0 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:29.647028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ddf84-3c5a-42df-ae09-8d13fc4252a0 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:29.683113 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29849790-85e9-4475-a080-e332a47d49d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:29.684208 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29849790-85e9-4475-a080-e332a47d49d1 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:29.684701 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29849790-85e9-4475-a080-e332a47d49d1 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:29.685204 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29849790-85e9-4475-a080-e332a47d49d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:29.787101 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29849790-85e9-4475-a080-e332a47d49d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:29.788648 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29849790-85e9-4475-a080-e332a47d49d1 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:29.890398 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad971b-9a50-4bf1-88a9-eaf7aa77011f None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:29.891514 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad971b-9a50-4bf1-88a9-eaf7aa77011f None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:29.891514 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad971b-9a50-4bf1-88a9-eaf7aa77011f None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:29.893392 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 481/974] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:20:29.898270 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4061d0d-9129-4d34-89ab-8d11f9953c48 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:29.898504 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4061d0d-9129-4d34-89ab-8d11f9953c48 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:29.898754 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4061d0d-9129-4d34-89ab-8d11f9953c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:29.903352 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 494/975] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:20:29 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:20:29.908770 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29849790-85e9-4475-a080-e332a47d49d1 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:29.920266 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-d4061d0d-9129-4d34-89ab-8d11f9953c48 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:29.921741 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-d4061d0d-9129-4d34-89ab-8d11f9953c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:30.007121 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 482/976] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:20:30.029215 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29849790-85e9-4475-a080-e332a47d49d1 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:30.031256 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4061d0d-9129-4d34-89ab-8d11f9953c48 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:30.064359 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fbc04-ea2e-4bec-b2bb-4618164205e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:30.065179 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fbc04-ea2e-4bec-b2bb-4618164205e4 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:30.065497 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fbc04-ea2e-4bec-b2bb-4618164205e4 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:30.065822 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fbc04-ea2e-4bec-b2bb-4618164205e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:30.077105 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fbc04-ea2e-4bec-b2bb-4618164205e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:30.078608 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fbc04-ea2e-4bec-b2bb-4618164205e4 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:30.099510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-4c5fbc04-ea2e-4bec-b2bb-4618164205e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:30.099510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:30.099510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:30.099510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:30.099510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:30.099510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:30.099510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:30.099510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:30.099510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:30.099510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:30.099510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:30.099510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:30.099510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:30.099510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:30.099510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:30.100599 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:30.100599 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:30.100599 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:30.100599 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:30.100599 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:30.100599 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:30.100599 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:30.100599 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:30.100599 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:30.100599 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:30.100599 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:30.100599 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:30.100599 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:30.100599 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:30.100599 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:30.100599 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:30.100599 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:30.102296 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:30.102296 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:30.102296 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:30.102296 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:30.102296 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 495/977] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:30.106336 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fbc04-ea2e-4bec-b2bb-4618164205e4 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:30.142513 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4061d0d-9129-4d34-89ab-8d11f9953c48 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:30.179283 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5da1f-12aa-4656-b37d-5d6a47be659e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:30.180028 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5da1f-12aa-4656-b37d-5d6a47be659e None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:30.180319 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5da1f-12aa-4656-b37d-5d6a47be659e None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:30.180603 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5da1f-12aa-4656-b37d-5d6a47be659e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:30.181272 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5da1f-12aa-4656-b37d-5d6a47be659e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:30.182696 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5da1f-12aa-4656-b37d-5d6a47be659e None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:30.195461 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-c7d5da1f-12aa-4656-b37d-5d6a47be659e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:20:30.195461 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:30.195461 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:20:30.195461 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:20:30.195461 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:20:30.195461 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:20:30.195461 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:20:30.195461 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:30.195461 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:20:30.195461 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:30.195461 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:20:30.195461 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:30.195461 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:30.195461 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:30.195461 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:30.195461 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:30.195461 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:30.196413 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:30.196413 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:30.196413 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:30.196413 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:30.196413 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:30.196413 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:30.196413 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:20:30.196413 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:20:30.196413 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:20:30.196413 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:20:30.196413 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:30.196413 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:30.196413 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:30.196413 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:30.196413 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:30.196413 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:30.197194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:30.197194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:30.197194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:30.197194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:30.197194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:30.197194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:30.197194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:30.197194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:30.197194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:30.197194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:30.197194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:20:30.197194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:30.197194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:20:30.197194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:30.197194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 483/978] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:20:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:30.207090 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5da1f-12aa-4656-b37d-5d6a47be659e None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:30.210451 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fbc04-ea2e-4bec-b2bb-4618164205e4 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:30.245319 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075b73e-2020-4b71-a58e-458c15bcb6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:30.246022 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075b73e-2020-4b71-a58e-458c15bcb6bf None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:30.246309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075b73e-2020-4b71-a58e-458c15bcb6bf None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:30.246589 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075b73e-2020-4b71-a58e-458c15bcb6bf None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:30.247576 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075b73e-2020-4b71-a58e-458c15bcb6bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:30.247677 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075b73e-2020-4b71-a58e-458c15bcb6bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:30.249017 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075b73e-2020-4b71-a58e-458c15bcb6bf None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:30.263589 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 496/979] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:30.269250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075b73e-2020-4b71-a58e-458c15bcb6bf None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:30.312482 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5da1f-12aa-4656-b37d-5d6a47be659e None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:30.348182 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bb4b6-cd69-4ffb-8559-394b46f0c8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:30.348854 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bb4b6-cd69-4ffb-8559-394b46f0c8d8 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:30.349135 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bb4b6-cd69-4ffb-8559-394b46f0c8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:30.349439 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bb4b6-cd69-4ffb-8559-394b46f0c8d8 None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:30.350164 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bb4b6-cd69-4ffb-8559-394b46f0c8d8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:30.350468 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bb4b6-cd69-4ffb-8559-394b46f0c8d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:30.351847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bb4b6-cd69-4ffb-8559-394b46f0c8d8 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:30.357362 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 484/980] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:20:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:30.363033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bb4b6-cd69-4ffb-8559-394b46f0c8d8 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:30.387771 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075b73e-2020-4b71-a58e-458c15bcb6bf None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:30.425032 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24156d-cdab-41a4-89e8-60d09de5bbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:30.426529 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24156d-cdab-41a4-89e8-60d09de5bbdc None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:30.426870 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24156d-cdab-41a4-89e8-60d09de5bbdc None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:30.427200 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24156d-cdab-41a4-89e8-60d09de5bbdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:30.435422 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24156d-cdab-41a4-89e8-60d09de5bbdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:30.437126 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24156d-cdab-41a4-89e8-60d09de5bbdc None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:30.453104 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-5b24156d-cdab-41a4-89e8-60d09de5bbdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:30.453104 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:30.453104 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:30.453104 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:30.453104 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:30.453104 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:30.453104 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:30.453104 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:30.453104 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:30.453104 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:30.453104 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:30.453104 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:30.453104 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:20:30.453104 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:20:30.453104 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:20:30.454329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:20:30.454329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:30.454329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:30.454329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:30.454329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:30.454329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:30.454329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:30.454329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:30.454329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:30.454329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:30.454329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:30.454329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:30.454329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:30.454329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:30.454329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:30.454329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:30.454329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:30.455588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:20:30.455588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:20:30.455588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:20:30.455588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:20:30.455588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:20:30.455588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:20:30.455588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:30.455588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:30.455588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 497/981] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:20:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:30.461845 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24156d-cdab-41a4-89e8-60d09de5bbdc None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:30.504049 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bb4b6-cd69-4ffb-8559-394b46f0c8d8 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:30.554231 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5657153-dcd6-40f9-bcf0-e1c2f1c9fdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:30.554921 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5657153-dcd6-40f9-bcf0-e1c2f1c9fdd0 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:30.555209 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5657153-dcd6-40f9-bcf0-e1c2f1c9fdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:30.555499 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5657153-dcd6-40f9-bcf0-e1c2f1c9fdd0 None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:30.556704 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5657153-dcd6-40f9-bcf0-e1c2f1c9fdd0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:30.557022 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5657153-dcd6-40f9-bcf0-e1c2f1c9fdd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:30.558472 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5657153-dcd6-40f9-bcf0-e1c2f1c9fdd0 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:30.564301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 485/982] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:20:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:30.572706 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5657153-dcd6-40f9-bcf0-e1c2f1c9fdd0 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:30.597827 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24156d-cdab-41a4-89e8-60d09de5bbdc None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:30.657753 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63ae86-8e98-4e5f-a086-631f31434154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:30.658937 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63ae86-8e98-4e5f-a086-631f31434154 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:30.659429 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63ae86-8e98-4e5f-a086-631f31434154 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:30.660015 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63ae86-8e98-4e5f-a086-631f31434154 None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:30.661499 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63ae86-8e98-4e5f-a086-631f31434154 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:30.662087 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63ae86-8e98-4e5f-a086-631f31434154 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:30.664869 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63ae86-8e98-4e5f-a086-631f31434154 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:30.685678 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5657153-dcd6-40f9-bcf0-e1c2f1c9fdd0 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:30.685973 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 498/983] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:20:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:30.692287 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63ae86-8e98-4e5f-a086-631f31434154 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:30.725095 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004da54-f35d-4e1b-ae0a-17dcfffc2f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:30.725898 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004da54-f35d-4e1b-ae0a-17dcfffc2f56 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:30.726170 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004da54-f35d-4e1b-ae0a-17dcfffc2f56 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:30.726450 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004da54-f35d-4e1b-ae0a-17dcfffc2f56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:30.727258 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004da54-f35d-4e1b-ae0a-17dcfffc2f56 None admin] RBAC: Adding query filter params (interface=admin, service_id=3fed8ff0e7b14ee78bd5b5a8b60c5831, region_id=RegionOne) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:30.727572 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004da54-f35d-4e1b-ae0a-17dcfffc2f56 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:30.728956 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004da54-f35d-4e1b-ae0a-17dcfffc2f56 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:30.738642 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 486/984] 10.222.0.48 () {56 vars in 1249 bytes} [Mon May 9 15:20:30 2022] GET /identity/v3/endpoints?service_id=3fed8ff0e7b14ee78bd5b5a8b60c5831&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:30.740261 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004da54-f35d-4e1b-ae0a-17dcfffc2f56 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:30.837621 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63ae86-8e98-4e5f-a086-631f31434154 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:30.884879 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec1b60-75c5-4ca3-8bb3-91d2e00e1c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:30.885293 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004da54-f35d-4e1b-ae0a-17dcfffc2f56 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:30.885569 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec1b60-75c5-4ca3-8bb3-91d2e00e1c57 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:30.885856 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec1b60-75c5-4ca3-8bb3-91d2e00e1c57 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:30.886137 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec1b60-75c5-4ca3-8bb3-91d2e00e1c57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:30.886975 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec1b60-75c5-4ca3-8bb3-91d2e00e1c57 None admin] RBAC: Adding query filter params (role.id=fbc2125af36f44b0913c866ea5f56ca5, scope.project.id=eb2de9bea1cf451db5f8c697f480c480, user.id=ed964c5d606a4934b5bd9bd5890562ad) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:30.887291 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec1b60-75c5-4ca3-8bb3-91d2e00e1c57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:30.888726 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec1b60-75c5-4ca3-8bb3-91d2e00e1c57 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:30.905415 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 499/985] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:20:30 2022] GET /identity/v3/role_assignments?user.id=ed964c5d606a4934b5bd9bd5890562ad&scope.project.id=eb2de9bea1cf451db5f8c697f480c480&role.id=fbc2125af36f44b0913c866ea5f56ca5 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:30.921700 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230699dd-78e3-4511-85ce-eb9bd88a760f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:30.922389 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230699dd-78e3-4511-85ce-eb9bd88a760f None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:30.922677 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230699dd-78e3-4511-85ce-eb9bd88a760f None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:30.922955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230699dd-78e3-4511-85ce-eb9bd88a760f None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:30.923656 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230699dd-78e3-4511-85ce-eb9bd88a760f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:30.925062 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230699dd-78e3-4511-85ce-eb9bd88a760f None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:30.932080 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 487/986] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:20:30 2022] GET /identity/v3/services => generated 1497 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:20:31.252613 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670bcb0-b5e2-4785-bdbc-270a48a0af1d None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:31.253161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670bcb0-b5e2-4785-bdbc-270a48a0af1d None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:31.253161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670bcb0-b5e2-4785-bdbc-270a48a0af1d None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:31.255353 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 500/987] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:31.260728 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2540f5b-a95c-4085-bc23-15463020fd07 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:31.261029 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2540f5b-a95c-4085-bc23-15463020fd07 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:31.261315 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2540f5b-a95c-4085-bc23-15463020fd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:31.278665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-a2540f5b-a95c-4085-bc23-15463020fd07 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:31.279871 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-a2540f5b-a95c-4085-bc23-15463020fd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:31.349443 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 488/988] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:31.373681 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670bcb0-b5e2-4785-bdbc-270a48a0af1d None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:31.487225 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670bcb0-b5e2-4785-bdbc-270a48a0af1d None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:31.523079 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4762ed5-c3fa-4106-b81f-e9bce740f110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:31.523675 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4762ed5-c3fa-4106-b81f-e9bce740f110 None admin] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:31.523962 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4762ed5-c3fa-4106-b81f-e9bce740f110 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:31.524245 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4762ed5-c3fa-4106-b81f-e9bce740f110 None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:31.524979 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4762ed5-c3fa-4106-b81f-e9bce740f110 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:31.526391 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4762ed5-c3fa-4106-b81f-e9bce740f110 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:31.557410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 501/989] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:20:31 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:20:33.276505 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76716f6-5e48-435a-8fc6-3b4cffbf5c0d None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:33.277067 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76716f6-5e48-435a-8fc6-3b4cffbf5c0d None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:33.277067 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76716f6-5e48-435a-8fc6-3b4cffbf5c0d None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:33.278794 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 489/990] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:33.285076 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e39165-dd69-420d-a1b5-19db96780707 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:33.285617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e39165-dd69-420d-a1b5-19db96780707 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:33.285724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e39165-dd69-420d-a1b5-19db96780707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:33.305215 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-02e39165-dd69-420d-a1b5-19db96780707 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:33.306594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-02e39165-dd69-420d-a1b5-19db96780707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:33.323997 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256b1bf-bd14-4a98-ad48-8605aed36acf None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:33.324270 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256b1bf-bd14-4a98-ad48-8605aed36acf None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:33.324475 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256b1bf-bd14-4a98-ad48-8605aed36acf None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:33.326430 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 490/991] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:20:33.332979 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78223f2d-6adc-46fa-bf8d-e6f74aeaa529 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:33.333277 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78223f2d-6adc-46fa-bf8d-e6f74aeaa529 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:33.333786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78223f2d-6adc-46fa-bf8d-e6f74aeaa529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:33.352844 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-78223f2d-6adc-46fa-bf8d-e6f74aeaa529 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:33.353641 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-78223f2d-6adc-46fa-bf8d-e6f74aeaa529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:33.395224 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 502/992] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:33.418033 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e39165-dd69-420d-a1b5-19db96780707 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:33.429263 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 491/993] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:20:33.457615 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78223f2d-6adc-46fa-bf8d-e6f74aeaa529 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:33.533817 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e39165-dd69-420d-a1b5-19db96780707 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:33.571053 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856129e-d7fe-4428-b41c-37da55d3fee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:33.571868 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856129e-d7fe-4428-b41c-37da55d3fee9 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:33.572154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856129e-d7fe-4428-b41c-37da55d3fee9 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:33.572433 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856129e-d7fe-4428-b41c-37da55d3fee9 None admin] PATH_INFO: `/v3/services/image` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:33.573105 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856129e-d7fe-4428-b41c-37da55d3fee9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:33.574539 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856129e-d7fe-4428-b41c-37da55d3fee9 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:33.576435 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78223f2d-6adc-46fa-bf8d-e6f74aeaa529 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:33.587642 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-9856129e-d7fe-4428-b41c-37da55d3fee9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:20:33.587642 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:33.587642 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:20:33.587642 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:20:33.587642 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:20:33.587642 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:20:33.587642 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:20:33.587642 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:33.587642 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:20:33.587642 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:33.587642 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:20:33.587642 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:33.587642 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:33.587642 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:33.587642 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:33.587642 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:33.587642 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:33.588622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:33.588622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:33.588622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:33.588622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:33.588622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:33.588622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:33.588622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:20:33.588622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:20:33.588622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:20:33.588622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:20:33.588622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:33.588622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:33.588622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:33.588622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:33.588622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:33.588622 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:33.589572 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:33.589572 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:33.589572 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:33.589572 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:33.589572 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:33.589572 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:33.589572 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:33.589572 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:33.589572 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:33.589572 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:33.589572 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:20:33.589572 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:33.589572 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:20:33.589572 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:33.589572 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 503/994] 10.222.0.48 () {56 vars in 1105 bytes} [Mon May 9 15:20:33 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:33.594890 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856129e-d7fe-4428-b41c-37da55d3fee9 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:33.619552 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292a960-0be2-4f80-bae0-980e46201d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:33.620453 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292a960-0be2-4f80-bae0-980e46201d2e None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:33.620743 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292a960-0be2-4f80-bae0-980e46201d2e None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:33.621021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292a960-0be2-4f80-bae0-980e46201d2e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:33.621732 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292a960-0be2-4f80-bae0-980e46201d2e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:33.623120 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292a960-0be2-4f80-bae0-980e46201d2e None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:33.636969 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-2292a960-0be2-4f80-bae0-980e46201d2e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:20:33.636969 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:33.636969 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:20:33.636969 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:20:33.636969 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:20:33.636969 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:20:33.636969 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:20:33.636969 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:33.636969 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:20:33.636969 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:33.636969 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:20:33.636969 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:33.636969 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:33.636969 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:33.636969 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:33.636969 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:33.636969 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:33.638157 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:33.638157 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:33.638157 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:33.638157 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:33.638157 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:33.638157 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:33.638157 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:20:33.638157 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:20:33.638157 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:20:33.638157 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:20:33.638157 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:33.638157 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:33.638157 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:33.638157 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:33.638157 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:33.638157 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:33.639427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:33.639427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:33.639427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:33.639427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:33.639427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:33.639427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:33.639427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:33.639427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:33.639427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:33.639427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:33.639427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:20:33.639427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:33.639427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:20:33.639427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:33.639427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 492/995] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:20:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:33.644708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292a960-0be2-4f80-bae0-980e46201d2e None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:33.715953 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856129e-d7fe-4428-b41c-37da55d3fee9 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:33.751774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292a960-0be2-4f80-bae0-980e46201d2e None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:33.752806 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7eaa6-528f-4da1-a4a9-cee47f693d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:33.754287 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7eaa6-528f-4da1-a4a9-cee47f693d4e None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:33.754578 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7eaa6-528f-4da1-a4a9-cee47f693d4e None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:33.754862 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7eaa6-528f-4da1-a4a9-cee47f693d4e None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:33.755676 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7eaa6-528f-4da1-a4a9-cee47f693d4e None admin] RBAC: Adding query filter params (name=image) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:33.755980 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7eaa6-528f-4da1-a4a9-cee47f693d4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:33.761221 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7eaa6-528f-4da1-a4a9-cee47f693d4e None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:33.773808 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 504/996] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:33.774900 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7eaa6-528f-4da1-a4a9-cee47f693d4e None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:33.795833 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfc487-7ff3-4e77-bb30-c3d08008d456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:33.796383 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfc487-7ff3-4e77-bb30-c3d08008d456 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:33.796671 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfc487-7ff3-4e77-bb30-c3d08008d456 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:33.796956 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecfc487-7ff3-4e77-bb30-c3d08008d456 None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:33.797723 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfc487-7ff3-4e77-bb30-c3d08008d456 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:33.798035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfc487-7ff3-4e77-bb30-c3d08008d456 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:33.799429 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecfc487-7ff3-4e77-bb30-c3d08008d456 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:33.810634 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 493/997] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:20:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:33.811790 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfc487-7ff3-4e77-bb30-c3d08008d456 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:33.884047 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7eaa6-528f-4da1-a4a9-cee47f693d4e None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:33.917473 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae398853-00e0-499a-8f6a-2d48c35e9f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:33.917873 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecfc487-7ff3-4e77-bb30-c3d08008d456 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:33.918143 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae398853-00e0-499a-8f6a-2d48c35e9f06 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:33.918588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae398853-00e0-499a-8f6a-2d48c35e9f06 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:33.918690 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae398853-00e0-499a-8f6a-2d48c35e9f06 None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:33.919409 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae398853-00e0-499a-8f6a-2d48c35e9f06 None admin] RBAC: Adding query filter params (type=image) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:33.919720 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae398853-00e0-499a-8f6a-2d48c35e9f06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:33.921105 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae398853-00e0-499a-8f6a-2d48c35e9f06 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:33.926453 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 505/998] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:33.927744 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272c6e3-5048-496c-aec6-8f5b0c41b03d None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:33.928041 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272c6e3-5048-496c-aec6-8f5b0c41b03d None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:33.928315 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272c6e3-5048-496c-aec6-8f5b0c41b03d None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:33.929637 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 506/999] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:33.935501 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e8074-4ecf-48e3-b07f-9c53b1ef1672 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:33.935815 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e8074-4ecf-48e3-b07f-9c53b1ef1672 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:33.936085 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e8074-4ecf-48e3-b07f-9c53b1ef1672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:33.954394 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-c57e8074-4ecf-48e3-b07f-9c53b1ef1672 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:33.955907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-c57e8074-4ecf-48e3-b07f-9c53b1ef1672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:33.956622 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b7724-b516-4338-827c-6906f1a65616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:33.957753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b7724-b516-4338-827c-6906f1a65616 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:33.958040 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b7724-b516-4338-827c-6906f1a65616 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:33.958326 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b7724-b516-4338-827c-6906f1a65616 None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:33.959068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b7724-b516-4338-827c-6906f1a65616 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:33.959484 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b7724-b516-4338-827c-6906f1a65616 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:33.961054 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b7724-b516-4338-827c-6906f1a65616 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:33.971328 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 494/1000] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:20:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:33.973504 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b7724-b516-4338-827c-6906f1a65616 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:34.040343 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 507/1001] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:20:34.064186 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e8074-4ecf-48e3-b07f-9c53b1ef1672 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:34.085023 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b7724-b516-4338-827c-6906f1a65616 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:34.130396 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655b88a-3cc8-4f87-a572-2db12daa5a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:34.131073 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655b88a-3cc8-4f87-a572-2db12daa5a86 None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:34.131366 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655b88a-3cc8-4f87-a572-2db12daa5a86 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:34.131661 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655b88a-3cc8-4f87-a572-2db12daa5a86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:34.132411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655b88a-3cc8-4f87-a572-2db12daa5a86 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:34.133877 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655b88a-3cc8-4f87-a572-2db12daa5a86 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:34.149932 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 495/1002] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:20:33 2022] POST /identity/v3/endpoints => generated 325 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:20:34.179162 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e8074-4ecf-48e3-b07f-9c53b1ef1672 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:34.225217 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245e6b0-3f33-4c07-86f0-8420adbaa069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:34.225925 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245e6b0-3f33-4c07-86f0-8420adbaa069 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:34.226214 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245e6b0-3f33-4c07-86f0-8420adbaa069 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:34.226490 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245e6b0-3f33-4c07-86f0-8420adbaa069 None admin] PATH_INFO: `/v3/services/compute` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:34.227162 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245e6b0-3f33-4c07-86f0-8420adbaa069 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:34.228556 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245e6b0-3f33-4c07-86f0-8420adbaa069 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:34.242067 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-b245e6b0-3f33-4c07-86f0-8420adbaa069 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:20:34.242067 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:34.242067 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:20:34.242067 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:20:34.242067 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:20:34.242067 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:20:34.242067 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:20:34.242067 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:34.242067 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:20:34.242067 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:34.242067 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:20:34.242067 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:34.242067 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:34.242067 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:34.242067 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:34.242067 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:34.242067 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:34.243055 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:34.243055 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:34.243055 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:34.243055 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:34.243055 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:34.243055 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:34.243055 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:20:34.243055 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:20:34.243055 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:20:34.243055 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:20:34.243055 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:34.243055 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:34.243055 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:34.243055 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:34.243055 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:34.243055 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:34.249201 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:34.249201 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:34.249201 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:34.249201 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:34.249201 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:34.249201 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:34.249201 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:34.249201 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:34.249201 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:34.249201 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:34.249201 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:20:34.249201 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:34.249201 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:20:34.249201 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:34.249201 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 508/1003] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:20:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:34.250029 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655b88a-3cc8-4f87-a572-2db12daa5a86 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:34.358750 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655b88a-3cc8-4f87-a572-2db12daa5a86 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:34.395762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45906295-1c86-4f4b-9614-dfd6309fe3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:34.396450 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45906295-1c86-4f4b-9614-dfd6309fe3fd None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:34.396741 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45906295-1c86-4f4b-9614-dfd6309fe3fd None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:34.397111 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45906295-1c86-4f4b-9614-dfd6309fe3fd None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:34.397847 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45906295-1c86-4f4b-9614-dfd6309fe3fd None admin] RBAC: Adding query filter params (name=compute) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:34.398155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45906295-1c86-4f4b-9614-dfd6309fe3fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:34.399566 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45906295-1c86-4f4b-9614-dfd6309fe3fd None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:34.409460 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 496/1004] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:20:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:34.410834 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245e6b0-3f33-4c07-86f0-8420adbaa069 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:34.522228 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245e6b0-3f33-4c07-86f0-8420adbaa069 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:34.558406 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fc7c7-acea-4db8-9363-e3311df00d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:34.559088 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fc7c7-acea-4db8-9363-e3311df00d15 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:34.559377 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fc7c7-acea-4db8-9363-e3311df00d15 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:34.559656 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fc7c7-acea-4db8-9363-e3311df00d15 None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:34.560392 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fc7c7-acea-4db8-9363-e3311df00d15 None admin] RBAC: Adding query filter params (type=compute) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:34.560706 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fc7c7-acea-4db8-9363-e3311df00d15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:34.562127 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fc7c7-acea-4db8-9363-e3311df00d15 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:34.568396 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 509/1005] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:20:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:34.574305 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45906295-1c86-4f4b-9614-dfd6309fe3fd None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:34.687364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45906295-1c86-4f4b-9614-dfd6309fe3fd None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:34.724266 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54501816-71e2-4e20-b1ac-60ec3d8a892b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:34.724975 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54501816-71e2-4e20-b1ac-60ec3d8a892b None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:34.725289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54501816-71e2-4e20-b1ac-60ec3d8a892b None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:34.725651 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54501816-71e2-4e20-b1ac-60ec3d8a892b None admin] PATH_INFO: `/v3/endpoints` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:34.726494 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54501816-71e2-4e20-b1ac-60ec3d8a892b None admin] RBAC: Adding query filter params (interface=public, service_id=e09de9825f4440b1860df97b8805aedc, region_id=RegionOne) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:34.726898 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54501816-71e2-4e20-b1ac-60ec3d8a892b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:34.728319 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54501816-71e2-4e20-b1ac-60ec3d8a892b None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:34.737820 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 497/1006] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:20:34 2022] GET /identity/v3/endpoints?service_id=e09de9825f4440b1860df97b8805aedc&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:34.740192 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fc7c7-acea-4db8-9363-e3311df00d15 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:34.859982 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fc7c7-acea-4db8-9363-e3311df00d15 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:34.901927 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563d08d-b58a-422d-a768-c29c5abb2828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:34.902645 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563d08d-b58a-422d-a768-c29c5abb2828 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:34.902935 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563d08d-b58a-422d-a768-c29c5abb2828 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:34.903219 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563d08d-b58a-422d-a768-c29c5abb2828 None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:34.903950 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563d08d-b58a-422d-a768-c29c5abb2828 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:34.905517 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563d08d-b58a-422d-a768-c29c5abb2828 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:34.916542 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 510/1007] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:20:34 2022] GET /identity/v3/services => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 15:20:36.236355 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1856b0-3eb8-437f-99b9-1d00ac8ed9b1 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:36.236898 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1856b0-3eb8-437f-99b9-1d00ac8ed9b1 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:36.236898 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1856b0-3eb8-437f-99b9-1d00ac8ed9b1 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:36.239264 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 498/1008] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:36.245600 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfd7a6-3bce-4993-b454-5949ea9bdaf6 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:36.246119 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfd7a6-3bce-4993-b454-5949ea9bdaf6 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:36.246191 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfd7a6-3bce-4993-b454-5949ea9bdaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:36.269921 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-5ecfd7a6-3bce-4993-b454-5949ea9bdaf6 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:36.271758 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-5ecfd7a6-3bce-4993-b454-5949ea9bdaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:36.385437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 511/1009] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:36 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:36.408035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1856b0-3eb8-437f-99b9-1d00ac8ed9b1 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:36.522966 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1856b0-3eb8-437f-99b9-1d00ac8ed9b1 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:36.523786 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3c21b-3246-4603-acfb-4dc0ce4c9c70 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:36.524085 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3c21b-3246-4603-acfb-4dc0ce4c9c70 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:36.524372 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3c21b-3246-4603-acfb-4dc0ce4c9c70 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:36.526364 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 512/1010] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:36.535004 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e4e4d-8ba2-46b7-9769-b176d485d05f None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:36.535348 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e4e4d-8ba2-46b7-9769-b176d485d05f None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:36.535659 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e4e4d-8ba2-46b7-9769-b176d485d05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:36.555912 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-8c7e4e4d-8ba2-46b7-9769-b176d485d05f None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:36.557134 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-8c7e4e4d-8ba2-46b7-9769-b176d485d05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:36.565126 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a748e-0f6e-4006-b07c-ba5dcb611c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:36.566504 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a748e-0f6e-4006-b07c-ba5dcb611c03 None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:36.566822 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a748e-0f6e-4006-b07c-ba5dcb611c03 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:36.567110 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a748e-0f6e-4006-b07c-ba5dcb611c03 None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:36.567859 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a748e-0f6e-4006-b07c-ba5dcb611c03 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:36.569302 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a748e-0f6e-4006-b07c-ba5dcb611c03 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:36.585670 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 499/1011] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:20:36 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:20:36.665425 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 513/1012] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:36 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:36.685693 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a748e-0f6e-4006-b07c-ba5dcb611c03 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:36.817762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a748e-0f6e-4006-b07c-ba5dcb611c03 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:36.856260 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26f557-f3c3-4286-89d4-3b551a2d2f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:36.857508 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26f557-f3c3-4286-89d4-3b551a2d2f50 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:36.858019 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26f557-f3c3-4286-89d4-3b551a2d2f50 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:36.858487 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26f557-f3c3-4286-89d4-3b551a2d2f50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:36.859910 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26f557-f3c3-4286-89d4-3b551a2d2f50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:36.861643 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26f557-f3c3-4286-89d4-3b551a2d2f50 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:36.864910 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 500/1013] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:36.871513 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e4e4d-8ba2-46b7-9769-b176d485d05f None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:36.984791 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e4e4d-8ba2-46b7-9769-b176d485d05f None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:37.026322 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe08c0-d0ff-4cf1-8a94-a171f5ef43fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:37.027118 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe08c0-d0ff-4cf1-8a94-a171f5ef43fd None admin] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:37.027412 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe08c0-d0ff-4cf1-8a94-a171f5ef43fd None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:37.027698 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe08c0-d0ff-4cf1-8a94-a171f5ef43fd None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:37.028449 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe08c0-d0ff-4cf1-8a94-a171f5ef43fd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:37.030103 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe08c0-d0ff-4cf1-8a94-a171f5ef43fd None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:37.061237 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 514/1014] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:20:36 2022] POST /identity/v3/projects => generated 311 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:20:37.266892 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bb6f1-87e7-44c0-bbb3-d745fe84e167 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:37.266892 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bb6f1-87e7-44c0-bbb3-d745fe84e167 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:37.266892 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bb6f1-87e7-44c0-bbb3-d745fe84e167 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:37.268249 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 501/1015] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:37.274629 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0e3a5-01b4-4748-b1ef-aa630045286e None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:37.275125 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0e3a5-01b4-4748-b1ef-aa630045286e None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:37.275213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0e3a5-01b4-4748-b1ef-aa630045286e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:37.296812 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-17f0e3a5-01b4-4748-b1ef-aa630045286e None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:37.298078 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-17f0e3a5-01b4-4748-b1ef-aa630045286e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:37.383412 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 515/1016] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:37 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:37.408441 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bb6f1-87e7-44c0-bbb3-d745fe84e167 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:37.537057 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bb6f1-87e7-44c0-bbb3-d745fe84e167 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:37.573622 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896637d2-af6e-4a3f-9e5d-fe6d4e58b94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:37.574416 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896637d2-af6e-4a3f-9e5d-fe6d4e58b94b None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:37.574696 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896637d2-af6e-4a3f-9e5d-fe6d4e58b94b None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:37.574967 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896637d2-af6e-4a3f-9e5d-fe6d4e58b94b None admin] PATH_INFO: `/v3/services/compute` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:37.575620 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896637d2-af6e-4a3f-9e5d-fe6d4e58b94b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:37.576978 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896637d2-af6e-4a3f-9e5d-fe6d4e58b94b None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:37.589838 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-896637d2-af6e-4a3f-9e5d-fe6d4e58b94b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:20:37.589838 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:37.589838 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:20:37.589838 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:20:37.589838 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:20:37.589838 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:20:37.589838 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:20:37.589838 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:37.589838 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:20:37.589838 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:37.589838 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:20:37.589838 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:37.589838 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:37.589838 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:37.589838 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:37.589838 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:37.589838 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:37.590753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:37.590753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:37.590753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:37.590753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:37.590753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:37.590753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:37.590753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:20:37.590753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:20:37.590753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:20:37.590753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:20:37.590753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:37.590753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:37.590753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:37.590753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:37.590753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:37.590753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:37.596555 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:37.596555 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:37.596555 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:37.596555 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:37.596555 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:37.596555 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:37.596555 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:37.596555 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:37.596555 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:37.596555 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:37.596555 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:20:37.596555 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:37.596555 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:20:37.596555 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:37.596555 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 502/1017] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:20:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:37.600158 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0e3a5-01b4-4748-b1ef-aa630045286e None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:37.702105 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0e3a5-01b4-4748-b1ef-aa630045286e None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:37.736987 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4c6a7-ccca-4d36-8f86-90bc90a1a421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:37.737785 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4c6a7-ccca-4d36-8f86-90bc90a1a421 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:37.738081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4c6a7-ccca-4d36-8f86-90bc90a1a421 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:37.738367 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4c6a7-ccca-4d36-8f86-90bc90a1a421 None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:37.739094 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4c6a7-ccca-4d36-8f86-90bc90a1a421 None admin] RBAC: Adding query filter params (name=compute) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:37.739410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4c6a7-ccca-4d36-8f86-90bc90a1a421 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:37.741046 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4c6a7-ccca-4d36-8f86-90bc90a1a421 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:37.751015 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 516/1018] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:20:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:37.752274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896637d2-af6e-4a3f-9e5d-fe6d4e58b94b None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:37.869503 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896637d2-af6e-4a3f-9e5d-fe6d4e58b94b None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:37.912888 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c65309-9e75-4537-8672-a5fdd975bc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:37.913628 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c65309-9e75-4537-8672-a5fdd975bc60 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:37.913918 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c65309-9e75-4537-8672-a5fdd975bc60 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:37.914203 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c65309-9e75-4537-8672-a5fdd975bc60 None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:37.914965 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c65309-9e75-4537-8672-a5fdd975bc60 None admin] RBAC: Adding query filter params (type=compute) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:37.915281 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c65309-9e75-4537-8672-a5fdd975bc60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:37.916706 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c65309-9e75-4537-8672-a5fdd975bc60 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:37.922536 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 503/1019] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:20:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:37.928998 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4c6a7-ccca-4d36-8f86-90bc90a1a421 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:38.034313 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4c6a7-ccca-4d36-8f86-90bc90a1a421 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:38.069131 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9ddf5-61e1-47f0-aa51-3e5bc8f5337d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:38.070033 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9ddf5-61e1-47f0-aa51-3e5bc8f5337d None admin] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:38.070452 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9ddf5-61e1-47f0-aa51-3e5bc8f5337d None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:38.070871 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9ddf5-61e1-47f0-aa51-3e5bc8f5337d None admin] PATH_INFO: `/v3/endpoints` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:38.071769 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9ddf5-61e1-47f0-aa51-3e5bc8f5337d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:38.073276 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9ddf5-61e1-47f0-aa51-3e5bc8f5337d None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:38.095454 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 517/1020] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:20:37 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:20:38.970534 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fda8aa-aab8-4b47-8a7f-f3c56de6fbc5 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:38.971080 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fda8aa-aab8-4b47-8a7f-f3c56de6fbc5 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:38.971080 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fda8aa-aab8-4b47-8a7f-f3c56de6fbc5 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:38.973070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 504/1021] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:38.978692 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043cb8b-e64f-40a9-939f-1acea8b4e060 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:38.979108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043cb8b-e64f-40a9-939f-1acea8b4e060 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:38.979299 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043cb8b-e64f-40a9-939f-1acea8b4e060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:38.996329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-5043cb8b-e64f-40a9-939f-1acea8b4e060 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:38.997556 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-5043cb8b-e64f-40a9-939f-1acea8b4e060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:39.072202 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 518/1022] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:39.094853 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fda8aa-aab8-4b47-8a7f-f3c56de6fbc5 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:39.207634 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fda8aa-aab8-4b47-8a7f-f3c56de6fbc5 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:39.240064 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e6daf-15f0-4129-b526-a59bb5a2c22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:39.240799 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e6daf-15f0-4129-b526-a59bb5a2c22a None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:39.241079 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e6daf-15f0-4129-b526-a59bb5a2c22a None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:39.241353 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e6daf-15f0-4129-b526-a59bb5a2c22a None admin] PATH_INFO: `/v3/services/image` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:39.242033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e6daf-15f0-4129-b526-a59bb5a2c22a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:39.243397 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e6daf-15f0-4129-b526-a59bb5a2c22a None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:39.255780 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-562e6daf-15f0-4129-b526-a59bb5a2c22a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:20:39.255780 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:39.255780 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:20:39.255780 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:20:39.255780 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:20:39.255780 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:20:39.255780 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:20:39.255780 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:39.255780 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:20:39.255780 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:39.255780 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:20:39.255780 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:39.255780 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:39.255780 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:39.255780 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:39.255780 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:39.255780 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:39.256762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:39.256762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:39.256762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:39.256762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:39.256762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:39.256762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:39.256762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:20:39.256762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:20:39.256762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:20:39.256762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:20:39.256762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:39.256762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:39.256762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:39.256762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:39.256762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:39.256762 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:39.257999 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:39.257999 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:39.257999 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:39.257999 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:39.257999 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:39.257999 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:39.257999 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:39.257999 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:39.257999 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:39.257999 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:39.257999 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:20:39.257999 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:39.257999 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:20:39.257999 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:39.259118 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 505/1023] 10.222.0.48 () {56 vars in 1105 bytes} [Mon May 9 15:20:39 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:39.267110 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043cb8b-e64f-40a9-939f-1acea8b4e060 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:39.377322 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043cb8b-e64f-40a9-939f-1acea8b4e060 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:39.411059 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d39c5-47da-48a2-a699-869dca08355b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:39.411773 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d39c5-47da-48a2-a699-869dca08355b None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:39.412057 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d39c5-47da-48a2-a699-869dca08355b None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:39.412332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d39c5-47da-48a2-a699-869dca08355b None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:39.413052 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d39c5-47da-48a2-a699-869dca08355b None admin] RBAC: Adding query filter params (name=image) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:39.413357 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d39c5-47da-48a2-a699-869dca08355b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:39.414794 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d39c5-47da-48a2-a699-869dca08355b None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:39.424699 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 519/1024] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:39.426182 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e6daf-15f0-4129-b526-a59bb5a2c22a None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:39.462599 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bda8b5-4bdf-415d-96fa-44ebb631e688 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:39.462913 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bda8b5-4bdf-415d-96fa-44ebb631e688 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:39.463166 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bda8b5-4bdf-415d-96fa-44ebb631e688 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:39.464540 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 520/1025] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:39.469877 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35a160-b836-4423-bf3b-a18675de072b None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:39.470165 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35a160-b836-4423-bf3b-a18675de072b None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:39.470447 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35a160-b836-4423-bf3b-a18675de072b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:39.488324 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-da35a160-b836-4423-bf3b-a18675de072b None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:39.489887 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-da35a160-b836-4423-bf3b-a18675de072b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:39.538005 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e6daf-15f0-4129-b526-a59bb5a2c22a None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:39.557995 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 521/1026] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:20:39.572034 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7746e5-752b-40c4-9942-7ede6343726a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:39.572696 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7746e5-752b-40c4-9942-7ede6343726a None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:39.572977 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7746e5-752b-40c4-9942-7ede6343726a None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:39.573252 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7746e5-752b-40c4-9942-7ede6343726a None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:39.573992 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7746e5-752b-40c4-9942-7ede6343726a None admin] RBAC: Adding query filter params (type=image) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:39.574301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7746e5-752b-40c4-9942-7ede6343726a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:39.575695 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7746e5-752b-40c4-9942-7ede6343726a None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:39.585581 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 506/1027] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:39.586395 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7746e5-752b-40c4-9942-7ede6343726a None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:39.587734 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35a160-b836-4423-bf3b-a18675de072b None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:39.691251 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35a160-b836-4423-bf3b-a18675de072b None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:39.702396 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7746e5-752b-40c4-9942-7ede6343726a None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:39.724894 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ebd91-2a7b-41eb-81c6-478c2c32a8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:39.725736 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ebd91-2a7b-41eb-81c6-478c2c32a8dd None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:39.726006 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ebd91-2a7b-41eb-81c6-478c2c32a8dd None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:39.726280 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ebd91-2a7b-41eb-81c6-478c2c32a8dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:39.727523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ebd91-2a7b-41eb-81c6-478c2c32a8dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:39.728918 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ebd91-2a7b-41eb-81c6-478c2c32a8dd None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:39.735306 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 522/1028] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:39.736253 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ebd91-2a7b-41eb-81c6-478c2c32a8dd None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:39.736356 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55cb15-3723-4249-b02c-3988d393a414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:39.736983 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55cb15-3723-4249-b02c-3988d393a414 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:39.737233 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55cb15-3723-4249-b02c-3988d393a414 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:39.738050 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55cb15-3723-4249-b02c-3988d393a414 None admin] PATH_INFO: `/v3/endpoints` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:39.738855 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55cb15-3723-4249-b02c-3988d393a414 None admin] RBAC: Adding query filter params (interface=public, service_id=57e76b4d76304fe2afc00fcc663c15e2, region_id=RegionOne) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:39.739171 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55cb15-3723-4249-b02c-3988d393a414 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:39.740805 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55cb15-3723-4249-b02c-3988d393a414 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:39.746305 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 507/1029] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:20:39 2022] GET /identity/v3/endpoints?service_id=57e76b4d76304fe2afc00fcc663c15e2&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:39.751729 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55cb15-3723-4249-b02c-3988d393a414 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:39.836617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ebd91-2a7b-41eb-81c6-478c2c32a8dd None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:39.853922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55cb15-3723-4249-b02c-3988d393a414 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:39.873317 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400b303-1035-472b-9ef3-294e20035199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:39.874334 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400b303-1035-472b-9ef3-294e20035199 None admin] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:39.874334 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400b303-1035-472b-9ef3-294e20035199 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:39.874633 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400b303-1035-472b-9ef3-294e20035199 None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:39.875425 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400b303-1035-472b-9ef3-294e20035199 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:39.876806 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400b303-1035-472b-9ef3-294e20035199 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:39.890856 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11279f1-cd61-46ec-a768-82f15a9cadab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:39.891811 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11279f1-cd61-46ec-a768-82f15a9cadab None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:39.892099 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11279f1-cd61-46ec-a768-82f15a9cadab None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:39.892380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11279f1-cd61-46ec-a768-82f15a9cadab None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:39.893334 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11279f1-cd61-46ec-a768-82f15a9cadab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:39.895477 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11279f1-cd61-46ec-a768-82f15a9cadab None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:39.900266 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 523/1030] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:20:39 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:20:39.903426 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 508/1031] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:20:39 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 15:20:40.490732 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54c9b2-3af3-45e8-88be-cc07589ab8aa None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:40.491238 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54c9b2-3af3-45e8-88be-cc07589ab8aa None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:40.491310 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54c9b2-3af3-45e8-88be-cc07589ab8aa None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:40.492683 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 524/1032] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:40.500661 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d755e-805e-4221-9fe2-b231a894492c None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:40.501133 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d755e-805e-4221-9fe2-b231a894492c None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:40.501203 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d755e-805e-4221-9fe2-b231a894492c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:40.520339 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-e88d755e-805e-4221-9fe2-b231a894492c None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:40.521586 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-e88d755e-805e-4221-9fe2-b231a894492c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:40.590678 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 509/1033] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:40.615249 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54c9b2-3af3-45e8-88be-cc07589ab8aa None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:40.720273 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54c9b2-3af3-45e8-88be-cc07589ab8aa None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:40.757083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d32c9-1098-4359-9626-ec7993599fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:40.757870 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d32c9-1098-4359-9626-ec7993599fcf None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:40.758161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d32c9-1098-4359-9626-ec7993599fcf None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:40.758443 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d32c9-1098-4359-9626-ec7993599fcf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:40.770347 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d32c9-1098-4359-9626-ec7993599fcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:20:40.778593 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-f25d32c9-1098-4359-9626-ec7993599fcf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:20:40.778593 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:40.778593 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:40.778593 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:40.778593 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:40.778593 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:40.778593 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:40.778593 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:40.778593 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:40.778593 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:40.778593 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:40.778593 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:40.778593 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:20:40.778593 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:20:40.778593 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:20:40.778593 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:20:40.779507 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:20:40.779507 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:20:40.779507 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:20:40.779507 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:20:40.779507 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:40.779507 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:40.779507 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:40.779507 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:40.779507 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:40.779507 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:40.779507 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:40.779507 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:40.779507 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:40.779507 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:40.779507 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:40.779507 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:40.785872 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:40.785872 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:40.785872 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:40.785872 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:40.785872 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:20:40.785872 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:20:40.785872 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:20:40.785872 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:20:40.785872 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:20:40.785872 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:20:40.785872 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:20:40.785872 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:40.785872 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 525/1034] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 9 15:20:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:40.788181 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d755e-805e-4221-9fe2-b231a894492c None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:40.887829 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d755e-805e-4221-9fe2-b231a894492c None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:40.921428 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b0cb9-9948-4bcb-8048-9ac06ef11a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:40.922103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b0cb9-9948-4bcb-8048-9ac06ef11a3d None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:40.922390 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b0cb9-9948-4bcb-8048-9ac06ef11a3d None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:40.922669 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b0cb9-9948-4bcb-8048-9ac06ef11a3d None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:40.923414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b0cb9-9948-4bcb-8048-9ac06ef11a3d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:40.923768 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b0cb9-9948-4bcb-8048-9ac06ef11a3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:40.925819 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b0cb9-9948-4bcb-8048-9ac06ef11a3d None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:40.937824 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 510/1035] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:20:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:40.939974 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d32c9-1098-4359-9626-ec7993599fcf None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:41.043803 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d32c9-1098-4359-9626-ec7993599fcf None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:41.080316 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7528202-55a8-4ed7-ae52-c2a9626006d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:41.081679 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7528202-55a8-4ed7-ae52-c2a9626006d6 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:41.082640 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7528202-55a8-4ed7-ae52-c2a9626006d6 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:41.082939 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7528202-55a8-4ed7-ae52-c2a9626006d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:41.094042 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7528202-55a8-4ed7-ae52-c2a9626006d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:41.095474 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7528202-55a8-4ed7-ae52-c2a9626006d6 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:41.116253 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-d7528202-55a8-4ed7-ae52-c2a9626006d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:41.116253 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:41.116253 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:41.116253 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:41.116253 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:41.116253 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:41.116253 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:41.116253 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:41.116253 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:41.116253 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:41.116253 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:41.116253 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:41.116253 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:41.116253 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:41.116253 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:41.117207 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:41.117207 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:41.117207 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:41.117207 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:41.117207 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:41.117207 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:41.117207 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:41.117207 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:41.117207 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:41.117207 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:41.117207 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:41.117207 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:41.117207 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:41.117207 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:41.117207 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:41.117207 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:41.117207 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:41.118063 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:41.118063 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:41.118063 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:41.118063 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:41.121759 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 526/1036] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:41.123216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b0cb9-9948-4bcb-8048-9ac06ef11a3d None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:41.231588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b0cb9-9948-4bcb-8048-9ac06ef11a3d None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:41.267172 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a6664-baae-4d26-ae32-b3aa1c945592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:41.268194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a6664-baae-4d26-ae32-b3aa1c945592 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:41.269194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a6664-baae-4d26-ae32-b3aa1c945592 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:41.270012 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a6664-baae-4d26-ae32-b3aa1c945592 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:41.270973 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a6664-baae-4d26-ae32-b3aa1c945592 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:41.271491 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a6664-baae-4d26-ae32-b3aa1c945592 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:41.273068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a6664-baae-4d26-ae32-b3aa1c945592 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:41.291453 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 511/1037] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:41.293236 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7528202-55a8-4ed7-ae52-c2a9626006d6 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:41.396473 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7528202-55a8-4ed7-ae52-c2a9626006d6 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:41.435535 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee763a80-2c38-4ae7-921a-8036921f69f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:41.436662 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee763a80-2c38-4ae7-921a-8036921f69f7 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:41.437090 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee763a80-2c38-4ae7-921a-8036921f69f7 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:41.437575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee763a80-2c38-4ae7-921a-8036921f69f7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:41.446933 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee763a80-2c38-4ae7-921a-8036921f69f7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:41.448672 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee763a80-2c38-4ae7-921a-8036921f69f7 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:41.465265 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-ee763a80-2c38-4ae7-921a-8036921f69f7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:20:41.465265 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:41.465265 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:41.465265 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:41.465265 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:41.465265 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:41.465265 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:41.465265 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:41.465265 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:41.465265 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:41.465265 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:41.465265 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:41.465265 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:20:41.465265 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:20:41.465265 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:20:41.465265 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:20:41.466299 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:41.466299 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:41.466299 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:20:41.466299 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:41.466299 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:20:41.466299 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:41.466299 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:41.466299 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:41.466299 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:41.466299 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:41.466299 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:41.466299 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:41.466299 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:41.466299 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:41.466299 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:41.466299 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:41.466299 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:41.466299 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:41.467154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:41.467154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:41.467154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:20:41.467154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:20:41.467154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:20:41.467154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:20:41.467154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:20:41.467154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:20:41.467154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:20:41.467154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:41.467154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 527/1038] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:20:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:41.474252 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a6664-baae-4d26-ae32-b3aa1c945592 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:41.582248 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a6664-baae-4d26-ae32-b3aa1c945592 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:41.622954 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2f83b-81a1-4d06-97f1-ef5b39721abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:41.623648 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2f83b-81a1-4d06-97f1-ef5b39721abe None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:41.623934 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2f83b-81a1-4d06-97f1-ef5b39721abe None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:41.624210 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2f83b-81a1-4d06-97f1-ef5b39721abe None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:41.625055 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2f83b-81a1-4d06-97f1-ef5b39721abe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:41.625396 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2f83b-81a1-4d06-97f1-ef5b39721abe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:41.626822 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2f83b-81a1-4d06-97f1-ef5b39721abe None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:41.649274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 512/1039] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:20:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:41.650416 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee763a80-2c38-4ae7-921a-8036921f69f7 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:41.749506 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee763a80-2c38-4ae7-921a-8036921f69f7 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:41.783326 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856dccb-9b88-4c72-8189-8e57989fc770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:41.783990 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856dccb-9b88-4c72-8189-8e57989fc770 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:41.784385 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856dccb-9b88-4c72-8189-8e57989fc770 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:41.784770 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856dccb-9b88-4c72-8189-8e57989fc770 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:41.858687 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856dccb-9b88-4c72-8189-8e57989fc770 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:41.860519 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856dccb-9b88-4c72-8189-8e57989fc770 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:41.961042 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 528/1040] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:20:41 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:20:41.967129 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2f83b-81a1-4d06-97f1-ef5b39721abe None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:42.069577 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2f83b-81a1-4d06-97f1-ef5b39721abe None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:42.107200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad871e-3c5d-418f-b926-0591f43aa39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:42.108424 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad871e-3c5d-418f-b926-0591f43aa39b None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:42.109021 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad871e-3c5d-418f-b926-0591f43aa39b None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:42.109590 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad871e-3c5d-418f-b926-0591f43aa39b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:42.123370 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad871e-3c5d-418f-b926-0591f43aa39b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:42.125219 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad871e-3c5d-418f-b926-0591f43aa39b None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:42.146978 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-6dad871e-3c5d-418f-b926-0591f43aa39b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:42.146978 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:42.146978 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:42.146978 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:42.146978 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:42.146978 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:42.146978 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:42.146978 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:42.146978 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:42.146978 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:42.146978 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:42.146978 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:42.146978 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:42.146978 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:42.146978 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:42.147909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:42.147909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:42.147909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:42.147909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:42.147909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:42.147909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:42.147909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:42.147909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:42.147909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:42.147909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:42.147909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:42.147909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:42.147909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:42.147909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:42.147909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:42.147909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:42.147909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:42.149841 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:42.149841 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:42.149841 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:42.149841 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:42.149841 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 513/1041] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:42.154451 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856dccb-9b88-4c72-8189-8e57989fc770 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:42.257886 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856dccb-9b88-4c72-8189-8e57989fc770 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:42.263696 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4ce89-5f52-4be7-b473-7f4e6e5bd217 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:42.263979 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4ce89-5f52-4be7-b473-7f4e6e5bd217 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:42.264231 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4ce89-5f52-4be7-b473-7f4e6e5bd217 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:42.265824 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 514/1042] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:20:42.272129 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858e94c-b3ad-4507-8290-18a1134e6af8 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:42.272435 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858e94c-b3ad-4507-8290-18a1134e6af8 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:42.272701 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858e94c-b3ad-4507-8290-18a1134e6af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:42.289828 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-9858e94c-b3ad-4507-8290-18a1134e6af8 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:42.291040 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-9858e94c-b3ad-4507-8290-18a1134e6af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:42.292839 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5148565-7eee-4b1b-a7bb-b5f9929c0901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:42.293541 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5148565-7eee-4b1b-a7bb-b5f9929c0901 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:42.293825 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5148565-7eee-4b1b-a7bb-b5f9929c0901 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:42.294124 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5148565-7eee-4b1b-a7bb-b5f9929c0901 None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:42.294830 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5148565-7eee-4b1b-a7bb-b5f9929c0901 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:42.295140 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5148565-7eee-4b1b-a7bb-b5f9929c0901 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:42.296539 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5148565-7eee-4b1b-a7bb-b5f9929c0901 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:42.312981 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 529/1043] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:42.314416 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5148565-7eee-4b1b-a7bb-b5f9929c0901 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:42.367439 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 515/1044] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:20:42.368623 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be982752-a6cf-43d8-a5a2-b64d320b3ee5 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:42.368918 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be982752-a6cf-43d8-a5a2-b64d320b3ee5 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:42.369201 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be982752-a6cf-43d8-a5a2-b64d320b3ee5 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:42.370720 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 516/1045] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:42.376469 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88509e-9075-402d-a58c-94c06aea5918 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:42.376806 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88509e-9075-402d-a58c-94c06aea5918 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:42.377044 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88509e-9075-402d-a58c-94c06aea5918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:42.396550 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-7a88509e-9075-402d-a58c-94c06aea5918 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:42.397834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-7a88509e-9075-402d-a58c-94c06aea5918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:42.420639 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5148565-7eee-4b1b-a7bb-b5f9929c0901 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:42.458299 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f846f4-83b8-4e9d-a840-27220702d225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:42.459133 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f846f4-83b8-4e9d-a840-27220702d225 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:42.459422 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f846f4-83b8-4e9d-a840-27220702d225 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:42.459713 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f846f4-83b8-4e9d-a840-27220702d225 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:42.467238 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f846f4-83b8-4e9d-a840-27220702d225 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:42.468740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f846f4-83b8-4e9d-a840-27220702d225 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:42.469520 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 517/1046] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:20:42.470402 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88509e-9075-402d-a58c-94c06aea5918 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:42.485451 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-45f846f4-83b8-4e9d-a840-27220702d225 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:42.485451 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:42.485451 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:42.485451 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:42.485451 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:42.485451 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:42.485451 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:42.485451 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:42.485451 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:42.485451 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:42.485451 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:42.485451 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:42.485451 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:20:42.485451 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:20:42.485451 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:20:42.486383 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:20:42.486383 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:42.486383 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:42.486383 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:42.486383 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:42.486383 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:42.486383 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:42.486383 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:42.486383 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:42.486383 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:42.486383 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:42.486383 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:42.486383 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:42.486383 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:42.486383 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:42.486383 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:42.486383 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:42.488008 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:20:42.488008 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:20:42.488008 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:20:42.488008 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:20:42.488008 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:20:42.488008 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:20:42.488008 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:42.488008 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:42.488008 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 530/1047] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:20:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:42.494136 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f846f4-83b8-4e9d-a840-27220702d225 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:42.575098 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88509e-9075-402d-a58c-94c06aea5918 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:42.595030 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f846f4-83b8-4e9d-a840-27220702d225 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:42.608996 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d4389-3fd4-4ce6-a815-29a31ea18a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:42.609823 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d4389-3fd4-4ce6-a815-29a31ea18a10 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:42.610105 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d4389-3fd4-4ce6-a815-29a31ea18a10 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:42.610380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d4389-3fd4-4ce6-a815-29a31ea18a10 None admin] PATH_INFO: `/v3/services/image` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:42.611031 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d4389-3fd4-4ce6-a815-29a31ea18a10 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:42.612954 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d4389-3fd4-4ce6-a815-29a31ea18a10 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:42.624897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-a41d4389-3fd4-4ce6-a815-29a31ea18a10 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:20:42.624897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:42.624897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:20:42.624897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:20:42.624897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:20:42.624897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:20:42.624897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:20:42.624897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:42.624897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:20:42.624897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:42.624897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:20:42.624897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:42.624897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:42.624897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:42.624897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:42.624897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:42.624897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:42.626047 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:42.626047 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:42.626047 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:42.626047 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:42.626047 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:42.626047 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:42.626047 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:20:42.626047 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:20:42.626047 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:20:42.626047 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:20:42.626047 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:42.626047 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:42.626047 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:42.626047 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:42.626047 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:42.626047 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:42.626852 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:42.626852 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:42.626852 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:42.626852 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:42.626852 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:42.626852 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:42.626852 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:42.626852 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:42.626852 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:42.626852 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:42.626852 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:20:42.626852 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:20:42.626852 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:20:42.626852 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:42.626852 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 518/1048] 10.222.0.48 () {56 vars in 1105 bytes} [Mon May 9 15:20:42 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:42.627623 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d4389-3fd4-4ce6-a815-29a31ea18a10 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:42.632263 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6a83d-9c8f-4eb6-87f1-51e0aca3adc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:42.632940 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6a83d-9c8f-4eb6-87f1-51e0aca3adc1 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:42.633229 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6a83d-9c8f-4eb6-87f1-51e0aca3adc1 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:42.633543 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6a83d-9c8f-4eb6-87f1-51e0aca3adc1 None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:42.634358 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6a83d-9c8f-4eb6-87f1-51e0aca3adc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:42.634667 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6a83d-9c8f-4eb6-87f1-51e0aca3adc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:42.636119 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6a83d-9c8f-4eb6-87f1-51e0aca3adc1 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:42.653713 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 531/1049] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:20:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:42.653713 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6a83d-9c8f-4eb6-87f1-51e0aca3adc1 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:42.728155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d4389-3fd4-4ce6-a815-29a31ea18a10 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:42.746503 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6a83d-9c8f-4eb6-87f1-51e0aca3adc1 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:42.762704 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3408e-adfb-484d-92dc-11d5b0664f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:42.763500 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3408e-adfb-484d-92dc-11d5b0664f29 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:42.763789 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3408e-adfb-484d-92dc-11d5b0664f29 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:42.764069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3408e-adfb-484d-92dc-11d5b0664f29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:42.774743 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3408e-adfb-484d-92dc-11d5b0664f29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:20:42.782238 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-f2a3408e-adfb-484d-92dc-11d5b0664f29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:20:42.782238 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:42.782238 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:42.782238 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:42.782238 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:42.782238 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:42.782238 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:42.782238 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:42.782238 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:42.782238 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:42.782238 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:42.782238 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:42.782238 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:20:42.782238 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:20:42.782238 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:20:42.782238 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:20:42.783257 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:20:42.783257 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:20:42.783257 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:20:42.783257 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:20:42.783257 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:42.783257 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:42.783257 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:42.783257 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:42.783257 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:42.783257 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:42.783257 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:42.783257 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:42.783257 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:42.783257 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:42.783257 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:42.783257 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:42.784186 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:42.784186 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:42.784186 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:42.784186 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:42.784186 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:20:42.784186 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:20:42.784186 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:20:42.784186 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:20:42.784186 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:20:42.784186 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:20:42.784186 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:20:42.784186 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:42.785400 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f9a21-d91f-43ae-9413-1dee72092e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:42.785400 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f9a21-d91f-43ae-9413-1dee72092e9f None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:42.785552 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 519/1050] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:20:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:42.785619 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f9a21-d91f-43ae-9413-1dee72092e9f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:42.785619 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f9a21-d91f-43ae-9413-1dee72092e9f None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:42.785764 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3408e-adfb-484d-92dc-11d5b0664f29 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:42.785834 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f9a21-d91f-43ae-9413-1dee72092e9f None admin] RBAC: Adding query filter params (name=image) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:42.785834 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f9a21-d91f-43ae-9413-1dee72092e9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:42.786633 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f9a21-d91f-43ae-9413-1dee72092e9f None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:42.797462 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 532/1051] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:42.797462 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f9a21-d91f-43ae-9413-1dee72092e9f None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:42.885025 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3408e-adfb-484d-92dc-11d5b0664f29 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:42.894150 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f9a21-d91f-43ae-9413-1dee72092e9f None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:42.923902 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23919819-d383-46a8-ba2d-289abf629cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:42.924891 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23919819-d383-46a8-ba2d-289abf629cc0 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:42.925769 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23919819-d383-46a8-ba2d-289abf629cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:42.926058 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23919819-d383-46a8-ba2d-289abf629cc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:42.926918 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23919819-d383-46a8-ba2d-289abf629cc0 None admin] RBAC: Adding query filter params (role.id=fbc2125af36f44b0913c866ea5f56ca5, scope.project.id=eb2de9bea1cf451db5f8c697f480c480, user.id=42dc38d6c3634b7496b1b7e99ca3f647) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:42.927242 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23919819-d383-46a8-ba2d-289abf629cc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:42.928715 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23919819-d383-46a8-ba2d-289abf629cc0 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:42.932688 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86f9dd-a885-4155-9d35-29b043e346de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:42.933389 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86f9dd-a885-4155-9d35-29b043e346de None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:42.933695 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86f9dd-a885-4155-9d35-29b043e346de None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:42.933981 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86f9dd-a885-4155-9d35-29b043e346de None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:42.934547 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 520/1052] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:20:42 2022] GET /identity/v3/role_assignments?user.id=42dc38d6c3634b7496b1b7e99ca3f647&scope.project.id=eb2de9bea1cf451db5f8c697f480c480&role.id=fbc2125af36f44b0913c866ea5f56ca5 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:42.934748 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86f9dd-a885-4155-9d35-29b043e346de None admin] RBAC: Adding query filter params (name=admin) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:42.935064 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86f9dd-a885-4155-9d35-29b043e346de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:42.935341 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23919819-d383-46a8-ba2d-289abf629cc0 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:42.936504 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86f9dd-a885-4155-9d35-29b043e346de None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:42.946200 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 533/1053] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:20:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:42.952019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86f9dd-a885-4155-9d35-29b043e346de None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:43.046227 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23919819-d383-46a8-ba2d-289abf629cc0 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:43.063178 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86f9dd-a885-4155-9d35-29b043e346de None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:43.085338 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d459f8-ba38-4b14-bff9-e20012baf2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:43.086056 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d459f8-ba38-4b14-bff9-e20012baf2c0 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:43.086342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d459f8-ba38-4b14-bff9-e20012baf2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:43.086621 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d459f8-ba38-4b14-bff9-e20012baf2c0 None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:43.087566 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d459f8-ba38-4b14-bff9-e20012baf2c0 None admin] RBAC: Adding query filter params (type=image) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:43.087935 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d459f8-ba38-4b14-bff9-e20012baf2c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:43.089361 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d459f8-ba38-4b14-bff9-e20012baf2c0 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:43.095238 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 521/1054] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:43.102188 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d459f8-ba38-4b14-bff9-e20012baf2c0 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:43.102406 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6428f-73ef-4ac0-9c7b-2fa4c0e1db50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:43.103302 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6428f-73ef-4ac0-9c7b-2fa4c0e1db50 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:43.103584 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6428f-73ef-4ac0-9c7b-2fa4c0e1db50 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:43.103860 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6428f-73ef-4ac0-9c7b-2fa4c0e1db50 None admin] PATH_INFO: `/v3/users/9b17be08847f4650a818ba3c1251994d` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:43.119912 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6428f-73ef-4ac0-9c7b-2fa4c0e1db50 None admin] RBAC: Authorizing `identity:get_user(user_id=9b17be08847f4650a818ba3c1251994d)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:43.121476 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6428f-73ef-4ac0-9c7b-2fa4c0e1db50 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:43.129416 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 534/1055] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:20:42 2022] GET /identity/v3/users/9b17be08847f4650a818ba3c1251994d => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:43.130884 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6428f-73ef-4ac0-9c7b-2fa4c0e1db50 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:43.212049 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d459f8-ba38-4b14-bff9-e20012baf2c0 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:43.246809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2e254-f8f0-42c6-bec2-4f2c6ec5173b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:43.247475 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2e254-f8f0-42c6-bec2-4f2c6ec5173b None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:43.247760 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2e254-f8f0-42c6-bec2-4f2c6ec5173b None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:43.248031 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2e254-f8f0-42c6-bec2-4f2c6ec5173b None admin] PATH_INFO: `/v3/endpoints` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:43.248757 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2e254-f8f0-42c6-bec2-4f2c6ec5173b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:43.249108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6428f-73ef-4ac0-9c7b-2fa4c0e1db50 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:43.250167 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2e254-f8f0-42c6-bec2-4f2c6ec5173b None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:43.285419 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 522/1056] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:20:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:20:43.311866 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e834d5-2a0c-4a19-ab6b-3f7c8b02b3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:43.312853 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e834d5-2a0c-4a19-ab6b-3f7c8b02b3d1 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:43.313343 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e834d5-2a0c-4a19-ab6b-3f7c8b02b3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:43.313770 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e834d5-2a0c-4a19-ab6b-3f7c8b02b3d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:43.434288 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e834d5-2a0c-4a19-ab6b-3f7c8b02b3d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:43.435777 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e834d5-2a0c-4a19-ab6b-3f7c8b02b3d1 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:43.569174 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 535/1057] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:20:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:20:43.576516 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2e254-f8f0-42c6-bec2-4f2c6ec5173b None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:43.687925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2e254-f8f0-42c6-bec2-4f2c6ec5173b None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:43.725243 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a6ad2-aa54-4323-bce4-733d0b8ea91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:43.726477 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a6ad2-aa54-4323-bce4-733d0b8ea91c None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:43.726915 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a6ad2-aa54-4323-bce4-733d0b8ea91c None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:43.727373 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a6ad2-aa54-4323-bce4-733d0b8ea91c None admin] PATH_INFO: `/v3/projects/600c10be1c6341c1bf80b644b34423a9` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:43.728763 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a6ad2-aa54-4323-bce4-733d0b8ea91c None admin] RBAC: Authorizing `identity:get_project(project_id=600c10be1c6341c1bf80b644b34423a9)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:43.730403 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a6ad2-aa54-4323-bce4-733d0b8ea91c None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:43.732309 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 523/1058] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:20:43 2022] GET /identity/v3/projects/600c10be1c6341c1bf80b644b34423a9 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:43.740105 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e834d5-2a0c-4a19-ab6b-3f7c8b02b3d1 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:43.853483 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e834d5-2a0c-4a19-ab6b-3f7c8b02b3d1 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:43.890940 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bfb2f-5858-4ed6-abc4-a5837e9a0f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:43.891612 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bfb2f-5858-4ed6-abc4-a5837e9a0f25 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:43.891900 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bfb2f-5858-4ed6-abc4-a5837e9a0f25 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:43.892177 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bfb2f-5858-4ed6-abc4-a5837e9a0f25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:43.893028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957bfb2f-5858-4ed6-abc4-a5837e9a0f25 None admin] RBAC: Adding query filter params (role.id=9aaa841361294b9c9b275ca1be0ed89c, scope.project.id=600c10be1c6341c1bf80b644b34423a9, user.id=9b17be08847f4650a818ba3c1251994d) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:43.893348 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957bfb2f-5858-4ed6-abc4-a5837e9a0f25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:43.894882 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957bfb2f-5858-4ed6-abc4-a5837e9a0f25 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:43.910041 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 536/1059] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:20:43 2022] GET /identity/v3/role_assignments?user.id=9b17be08847f4650a818ba3c1251994d&scope.project.id=600c10be1c6341c1bf80b644b34423a9&role.id=9aaa841361294b9c9b275ca1be0ed89c => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:45.318202 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fccc44-6983-42db-aee8-d08dcae2cf7c None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:45.318919 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fccc44-6983-42db-aee8-d08dcae2cf7c None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:45.318919 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fccc44-6983-42db-aee8-d08dcae2cf7c None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:45.320635 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 524/1060] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:20:45.326442 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a28f7-dc25-4cc6-9cd6-df5529d82ce8 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:45.326944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a28f7-dc25-4cc6-9cd6-df5529d82ce8 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:45.327213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a28f7-dc25-4cc6-9cd6-df5529d82ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:45.345721 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-9f2a28f7-dc25-4cc6-9cd6-df5529d82ce8 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:45.347483 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-9f2a28f7-dc25-4cc6-9cd6-df5529d82ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:45.429601 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 537/1061] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:45.452278 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fccc44-6983-42db-aee8-d08dcae2cf7c None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:45.607165 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fccc44-6983-42db-aee8-d08dcae2cf7c None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:45.653715 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb081605-df37-47ca-a601-48b3fd7c7b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:45.654542 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb081605-df37-47ca-a601-48b3fd7c7b17 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:45.654883 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb081605-df37-47ca-a601-48b3fd7c7b17 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:45.655163 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb081605-df37-47ca-a601-48b3fd7c7b17 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:45.666427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb081605-df37-47ca-a601-48b3fd7c7b17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:20:45.675993 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-bb081605-df37-47ca-a601-48b3fd7c7b17 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:20:45.675993 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:45.675993 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:45.675993 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:45.675993 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:45.675993 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:45.675993 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:45.675993 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:45.675993 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:45.675993 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:45.675993 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:45.675993 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:45.675993 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:20:45.675993 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:20:45.675993 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:20:45.675993 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:20:45.677317 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:20:45.677317 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:20:45.677317 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:20:45.677317 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:20:45.677317 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:45.677317 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:45.677317 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:45.677317 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:45.677317 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:45.677317 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:45.677317 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:45.677317 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:45.677317 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:45.677317 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:45.677317 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:45.677317 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:45.678342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:45.678342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:45.678342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:45.678342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:45.678342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:20:45.678342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:20:45.678342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:20:45.678342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:20:45.678342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:20:45.678342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:20:45.678342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:20:45.678342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:45.681781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 525/1062] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 9 15:20:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:45.684067 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a28f7-dc25-4cc6-9cd6-df5529d82ce8 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:45.792364 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a28f7-dc25-4cc6-9cd6-df5529d82ce8 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:45.827819 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea206a7-c98c-48c7-94c6-5529c235df13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:45.828500 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea206a7-c98c-48c7-94c6-5529c235df13 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:45.828785 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea206a7-c98c-48c7-94c6-5529c235df13 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:45.829061 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea206a7-c98c-48c7-94c6-5529c235df13 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:45.829941 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea206a7-c98c-48c7-94c6-5529c235df13 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:45.830154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea206a7-c98c-48c7-94c6-5529c235df13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:45.832582 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea206a7-c98c-48c7-94c6-5529c235df13 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:45.845401 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 538/1063] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:20:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:45.847219 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb081605-df37-47ca-a601-48b3fd7c7b17 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:45.927941 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb194db5-b4c8-4ade-9518-71c238d6703d None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:45.928226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb194db5-b4c8-4ade-9518-71c238d6703d None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:45.928431 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb194db5-b4c8-4ade-9518-71c238d6703d None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:45.929994 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 539/1064] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:45.937283 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af6005-92ee-41bd-a02f-cc3b80b8918b None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:45.937826 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af6005-92ee-41bd-a02f-cc3b80b8918b None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:45.938300 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af6005-92ee-41bd-a02f-cc3b80b8918b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:45.962340 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-13af6005-92ee-41bd-a02f-cc3b80b8918b None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:45.964607 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-13af6005-92ee-41bd-a02f-cc3b80b8918b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:45.966968 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb081605-df37-47ca-a601-48b3fd7c7b17 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:46.013328 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af592cb-1ea0-4044-9bcb-055904ffc0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:46.014417 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af592cb-1ea0-4044-9bcb-055904ffc0e2 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:46.014905 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af592cb-1ea0-4044-9bcb-055904ffc0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:46.015200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af592cb-1ea0-4044-9bcb-055904ffc0e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:46.027523 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af592cb-1ea0-4044-9bcb-055904ffc0e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:46.029028 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af592cb-1ea0-4044-9bcb-055904ffc0e2 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:46.048169 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-4af592cb-1ea0-4044-9bcb-055904ffc0e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:46.048169 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:46.048169 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:46.048169 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:46.048169 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:46.048169 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:46.048169 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:46.048169 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:46.048169 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:46.048169 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:46.048169 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:46.048169 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:46.048169 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:46.048169 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:46.048169 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:46.049103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:46.049103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:46.049103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:46.049103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:46.049103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:46.049103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:46.049103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:46.049103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:46.049103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:46.049103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:46.049103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:46.049103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:46.049103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:46.049103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:46.049103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:46.049103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:46.049103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:46.051043 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:46.051043 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:46.051043 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:46.051043 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:46.054740 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 526/1065] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:46.055659 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af592cb-1ea0-4044-9bcb-055904ffc0e2 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:46.065328 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 540/1066] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:20:46.088260 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af6005-92ee-41bd-a02f-cc3b80b8918b None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:46.160689 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af592cb-1ea0-4044-9bcb-055904ffc0e2 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:46.194395 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af6005-92ee-41bd-a02f-cc3b80b8918b None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:46.197603 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e91d0f-b430-4a41-91e0-e67b10739b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:46.197783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e91d0f-b430-4a41-91e0-e67b10739b50 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:46.198009 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e91d0f-b430-4a41-91e0-e67b10739b50 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:46.198210 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e91d0f-b430-4a41-91e0-e67b10739b50 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:46.198962 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e91d0f-b430-4a41-91e0-e67b10739b50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:46.199276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e91d0f-b430-4a41-91e0-e67b10739b50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:46.200738 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e91d0f-b430-4a41-91e0-e67b10739b50 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:46.216667 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 527/1067] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:46.223080 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e91d0f-b430-4a41-91e0-e67b10739b50 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:46.232384 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb177eca-3be2-4c40-a278-35df4ef3ee26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:46.233067 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb177eca-3be2-4c40-a278-35df4ef3ee26 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:46.233345 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb177eca-3be2-4c40-a278-35df4ef3ee26 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:46.233647 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb177eca-3be2-4c40-a278-35df4ef3ee26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:46.312161 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb177eca-3be2-4c40-a278-35df4ef3ee26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:46.313694 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb177eca-3be2-4c40-a278-35df4ef3ee26 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:46.326402 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e91d0f-b430-4a41-91e0-e67b10739b50 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:46.360577 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ffeff-d352-45a1-9c2f-c7e8f27887a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:46.361686 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ffeff-d352-45a1-9c2f-c7e8f27887a9 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:46.362659 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ffeff-d352-45a1-9c2f-c7e8f27887a9 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:46.362972 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ffeff-d352-45a1-9c2f-c7e8f27887a9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:46.372970 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ffeff-d352-45a1-9c2f-c7e8f27887a9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:46.374475 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ffeff-d352-45a1-9c2f-c7e8f27887a9 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:46.390800 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-2a9ffeff-d352-45a1-9c2f-c7e8f27887a9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:20:46.390800 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:46.390800 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:46.390800 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:46.390800 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:46.390800 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:46.390800 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:46.390800 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:46.390800 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:46.390800 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:46.390800 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:46.390800 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:46.390800 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:20:46.390800 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:20:46.390800 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:20:46.390800 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:20:46.391832 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:46.391832 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:46.391832 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:20:46.391832 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:46.391832 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:20:46.391832 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:46.391832 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:46.391832 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:46.391832 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:46.391832 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:46.391832 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:46.391832 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:46.391832 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:46.391832 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:46.391832 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:46.391832 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:46.391832 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:46.391832 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:46.392739 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:46.392739 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:46.392739 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:20:46.392739 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:20:46.392739 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:20:46.392739 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:20:46.392739 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:20:46.392739 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:20:46.392739 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:20:46.392739 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:46.392739 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 528/1068] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:20:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:46.393702 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e41e3-f2bb-412b-b782-a5157e050393 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:46.394088 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e41e3-f2bb-412b-b782-a5157e050393 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:46.394346 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e41e3-f2bb-412b-b782-a5157e050393 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:46.395853 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 529/1069] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:46.398161 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e41e3-f2bb-412b-b782-a5157e050393 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:46.436017 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 541/1070] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:20:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:20:46.437344 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e407519-91b5-4e34-9dbd-d127b86aa59a None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:46.437663 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e407519-91b5-4e34-9dbd-d127b86aa59a None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:46.437940 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e407519-91b5-4e34-9dbd-d127b86aa59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:46.454992 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-0e407519-91b5-4e34-9dbd-d127b86aa59a None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:46.456140 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-0e407519-91b5-4e34-9dbd-d127b86aa59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:46.512741 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e41e3-f2bb-412b-b782-a5157e050393 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:46.546433 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 542/1071] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:46.547307 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e407519-91b5-4e34-9dbd-d127b86aa59a None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:46.552475 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2052f9-3446-4d46-ae76-3ce327ea9837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:46.553331 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2052f9-3446-4d46-ae76-3ce327ea9837 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:46.553810 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2052f9-3446-4d46-ae76-3ce327ea9837 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:46.554230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2052f9-3446-4d46-ae76-3ce327ea9837 None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:46.555268 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2052f9-3446-4d46-ae76-3ce327ea9837 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:46.555730 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2052f9-3446-4d46-ae76-3ce327ea9837 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:46.557347 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2052f9-3446-4d46-ae76-3ce327ea9837 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:46.584739 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 530/1072] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:20:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:46.585742 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2052f9-3446-4d46-ae76-3ce327ea9837 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:46.655180 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e407519-91b5-4e34-9dbd-d127b86aa59a None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:46.684786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2052f9-3446-4d46-ae76-3ce327ea9837 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:46.688361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896562b-441d-48ae-92b3-61a76ff97fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:46.689165 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896562b-441d-48ae-92b3-61a76ff97fcc None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:46.689486 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896562b-441d-48ae-92b3-61a76ff97fcc None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:46.689765 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896562b-441d-48ae-92b3-61a76ff97fcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:46.701976 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896562b-441d-48ae-92b3-61a76ff97fcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:46.703589 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896562b-441d-48ae-92b3-61a76ff97fcc None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:46.719519 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad49e0-f783-49d3-89f6-f60e01aeda03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:46.720262 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad49e0-f783-49d3-89f6-f60e01aeda03 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:46.720537 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad49e0-f783-49d3-89f6-f60e01aeda03 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:46.720816 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad49e0-f783-49d3-89f6-f60e01aeda03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:46.721282 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-a896562b-441d-48ae-92b3-61a76ff97fcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:46.721282 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:46.721282 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:46.721282 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:46.721282 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:46.721282 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:46.721282 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:46.721282 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:46.721282 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:46.721282 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:46.721282 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:46.721282 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:46.721282 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:46.721282 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:46.721282 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:46.722364 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:46.722364 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:46.722364 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:46.722364 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:46.722364 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:46.722364 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:46.722364 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:46.722364 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:46.722364 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:46.722364 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:46.722364 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:46.722364 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:46.722364 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:46.722364 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:46.722364 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:46.722364 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:46.722364 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:46.723326 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:46.723326 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:46.723326 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:46.723326 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:46.723326 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 543/1073] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:46.723602 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896562b-441d-48ae-92b3-61a76ff97fcc None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:46.733553 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad49e0-f783-49d3-89f6-f60e01aeda03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:20:46.741951 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-6fad49e0-f783-49d3-89f6-f60e01aeda03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:20:46.741951 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:46.741951 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:46.741951 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:46.741951 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:46.741951 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:46.741951 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:46.741951 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:46.741951 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:46.741951 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:46.741951 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:46.741951 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:46.741951 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:20:46.741951 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:20:46.741951 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:20:46.741951 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:20:46.742964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:20:46.742964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:20:46.742964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:20:46.742964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:20:46.742964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:46.742964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:46.742964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:46.742964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:46.742964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:46.742964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:46.742964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:46.742964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:46.742964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:46.742964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:46.742964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:46.742964 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:46.743796 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:46.743796 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:46.743796 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:46.743796 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:46.743796 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:20:46.743796 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:20:46.743796 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:20:46.743796 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:20:46.743796 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:20:46.743796 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:20:46.743796 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:20:46.743796 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:46.743796 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 531/1074] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:20:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:46.744477 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad49e0-f783-49d3-89f6-f60e01aeda03 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:46.827139 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896562b-441d-48ae-92b3-61a76ff97fcc None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:46.848625 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad49e0-f783-49d3-89f6-f60e01aeda03 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:46.861581 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fdbb6-3224-47ed-ae45-6b831e688ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:46.862798 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fdbb6-3224-47ed-ae45-6b831e688ba6 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:46.863148 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fdbb6-3224-47ed-ae45-6b831e688ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:46.863434 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fdbb6-3224-47ed-ae45-6b831e688ba6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:46.874307 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fdbb6-3224-47ed-ae45-6b831e688ba6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:46.875762 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fdbb6-3224-47ed-ae45-6b831e688ba6 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:46.883236 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadd5aa-984a-49cf-ab88-14b185cd6fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:46.883915 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadd5aa-984a-49cf-ab88-14b185cd6fb9 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:46.884206 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadd5aa-984a-49cf-ab88-14b185cd6fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:46.884489 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadd5aa-984a-49cf-ab88-14b185cd6fb9 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:46.885230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadd5aa-984a-49cf-ab88-14b185cd6fb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:46.885578 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadd5aa-984a-49cf-ab88-14b185cd6fb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:46.886966 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadd5aa-984a-49cf-ab88-14b185cd6fb9 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:46.894816 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-958fdbb6-3224-47ed-ae45-6b831e688ba6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:46.894816 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:46.894816 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:46.894816 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:46.894816 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:46.894816 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:46.894816 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:46.894816 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:46.894816 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:46.894816 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:46.894816 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:46.894816 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:46.894816 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:46.894816 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:46.894816 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:46.895706 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:46.895706 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:46.895706 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:46.895706 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:46.895706 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:46.895706 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:46.895706 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:46.895706 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:46.895706 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:46.895706 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:46.895706 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:46.895706 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:46.895706 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:46.895706 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:46.895706 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:46.895706 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:46.895706 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:46.896549 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:46.896549 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:46.896549 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:46.896549 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:46.896549 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 544/1075] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:46.897360 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fdbb6-3224-47ed-ae45-6b831e688ba6 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:46.921402 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 532/1076] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:46.921402 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadd5aa-984a-49cf-ab88-14b185cd6fb9 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:47.017239 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadd5aa-984a-49cf-ab88-14b185cd6fb9 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:47.017893 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fdbb6-3224-47ed-ae45-6b831e688ba6 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:47.055049 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa0144-d639-4a26-b1db-5dceaad99dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:47.055827 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa0144-d639-4a26-b1db-5dceaad99dc1 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:47.056122 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa0144-d639-4a26-b1db-5dceaad99dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:47.056223 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb5ae3-697c-4459-95d7-31251dddc856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:47.056400 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa0144-d639-4a26-b1db-5dceaad99dc1 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:47.056803 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb5ae3-697c-4459-95d7-31251dddc856 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:47.057092 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb5ae3-697c-4459-95d7-31251dddc856 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:47.057269 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa0144-d639-4a26-b1db-5dceaad99dc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:47.057362 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb5ae3-697c-4459-95d7-31251dddc856 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:47.057643 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa0144-d639-4a26-b1db-5dceaad99dc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:47.058150 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb5ae3-697c-4459-95d7-31251dddc856 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:47.058464 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb5ae3-697c-4459-95d7-31251dddc856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:47.059163 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa0144-d639-4a26-b1db-5dceaad99dc1 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:47.059847 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb5ae3-697c-4459-95d7-31251dddc856 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:47.075331 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 545/1077] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:20:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:47.075542 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 533/1078] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:47.077457 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa0144-d639-4a26-b1db-5dceaad99dc1 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:47.077572 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb5ae3-697c-4459-95d7-31251dddc856 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:47.183027 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb5ae3-697c-4459-95d7-31251dddc856 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:47.189790 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa0144-d639-4a26-b1db-5dceaad99dc1 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:47.220839 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9289d-10a6-48b6-b302-429d45b9cfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:47.221932 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9289d-10a6-48b6-b302-429d45b9cfd1 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:47.222440 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9289d-10a6-48b6-b302-429d45b9cfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:47.222916 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9289d-10a6-48b6-b302-429d45b9cfd1 None admin] PATH_INFO: `/v3/users/9b17be08847f4650a818ba3c1251994d` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:47.224231 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9289d-10a6-48b6-b302-429d45b9cfd1 None admin] RBAC: Authorizing `identity:get_user(user_id=9b17be08847f4650a818ba3c1251994d)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:47.225737 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9289d-10a6-48b6-b302-429d45b9cfd1 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:47.227163 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05a743-4f44-4a8e-abbc-ab8eff7f256f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:47.227817 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 546/1079] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:20:47 2022] GET /identity/v3/users/9b17be08847f4650a818ba3c1251994d => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:47.228050 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05a743-4f44-4a8e-abbc-ab8eff7f256f None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:47.228340 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05a743-4f44-4a8e-abbc-ab8eff7f256f None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:47.228616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05a743-4f44-4a8e-abbc-ab8eff7f256f None admin] PATH_INFO: `/v3/projects/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:47.234080 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9289d-10a6-48b6-b302-429d45b9cfd1 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:47.236472 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05a743-4f44-4a8e-abbc-ab8eff7f256f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:47.238481 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05a743-4f44-4a8e-abbc-ab8eff7f256f None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:47.253530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-2a05a743-4f44-4a8e-abbc-ab8eff7f256f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:47.253530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:47.253530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:47.253530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:47.253530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:47.253530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:47.253530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:47.253530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:47.253530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:47.253530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:47.253530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:47.253530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:47.253530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:20:47.253530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:20:47.253530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:20:47.254522 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:20:47.254522 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:47.254522 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:47.254522 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:47.254522 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:47.254522 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:47.254522 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:47.254522 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:47.254522 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:47.254522 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:47.254522 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:47.254522 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:47.254522 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:47.254522 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:47.254522 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:47.254522 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:47.254522 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:47.255385 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:20:47.255385 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:20:47.255385 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:20:47.255385 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:20:47.255385 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:20:47.255385 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:20:47.255385 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:47.255385 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:47.255385 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 534/1080] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:20:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:47.260761 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05a743-4f44-4a8e-abbc-ab8eff7f256f None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:47.337875 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9289d-10a6-48b6-b302-429d45b9cfd1 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:47.359167 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05a743-4f44-4a8e-abbc-ab8eff7f256f None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:47.372008 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83b353-b650-4d15-9066-55112b60b6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:47.372916 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83b353-b650-4d15-9066-55112b60b6e4 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:47.373200 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83b353-b650-4d15-9066-55112b60b6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:47.373514 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83b353-b650-4d15-9066-55112b60b6e4 None admin] PATH_INFO: `/v3/projects/600c10be1c6341c1bf80b644b34423a9` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:47.374901 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83b353-b650-4d15-9066-55112b60b6e4 None admin] RBAC: Authorizing `identity:get_project(project_id=600c10be1c6341c1bf80b644b34423a9)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:47.376436 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83b353-b650-4d15-9066-55112b60b6e4 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:47.378858 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 547/1081] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:20:47 2022] GET /identity/v3/projects/600c10be1c6341c1bf80b644b34423a9 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:47.385402 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83b353-b650-4d15-9066-55112b60b6e4 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:47.398493 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5788b0f-60ff-47b5-a04b-18f25c104e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:47.399160 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5788b0f-60ff-47b5-a04b-18f25c104e3d None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:47.399442 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5788b0f-60ff-47b5-a04b-18f25c104e3d None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:47.399718 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5788b0f-60ff-47b5-a04b-18f25c104e3d None admin] PATH_INFO: `/v3/projects` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:47.400509 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5788b0f-60ff-47b5-a04b-18f25c104e3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:47.400809 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5788b0f-60ff-47b5-a04b-18f25c104e3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:47.402268 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5788b0f-60ff-47b5-a04b-18f25c104e3d None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:47.414122 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 535/1082] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:20:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:47.420070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5788b0f-60ff-47b5-a04b-18f25c104e3d None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:47.498222 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83b353-b650-4d15-9066-55112b60b6e4 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:47.546541 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5788b0f-60ff-47b5-a04b-18f25c104e3d None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:47.548002 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29abe6-e177-47d4-bc1a-b140d9052175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:47.548906 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29abe6-e177-47d4-bc1a-b140d9052175 None admin] REQUEST_METHOD: `PUT` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:47.549191 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29abe6-e177-47d4-bc1a-b140d9052175 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:47.549501 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29abe6-e177-47d4-bc1a-b140d9052175 None admin] PATH_INFO: `/v3/projects/600c10be1c6341c1bf80b644b34423a9/users/9b17be08847f4650a818ba3c1251994d/roles/9aaa841361294b9c9b275ca1be0ed89c` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:47.551767 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29abe6-e177-47d4-bc1a-b140d9052175 None admin] RBAC: Authorizing `identity:create_grant(project_id=600c10be1c6341c1bf80b644b34423a9, user_id=9b17be08847f4650a818ba3c1251994d, role_id=9aaa841361294b9c9b275ca1be0ed89c)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:47.553213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29abe6-e177-47d4-bc1a-b140d9052175 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:47.568054 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 548/1083] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:20:47 2022] PUT /identity/v3/projects/600c10be1c6341c1bf80b644b34423a9/users/9b17be08847f4650a818ba3c1251994d/roles/9aaa841361294b9c9b275ca1be0ed89c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:20:47.583895 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e3f75-acd1-4ab8-aa52-b77f1b8499b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:47.584815 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e3f75-acd1-4ab8-aa52-b77f1b8499b1 None admin] REQUEST_METHOD: `PUT` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:47.585102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e3f75-acd1-4ab8-aa52-b77f1b8499b1 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:47.585396 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e3f75-acd1-4ab8-aa52-b77f1b8499b1 None admin] PATH_INFO: `/v3/projects/eb2de9bea1cf451db5f8c697f480c480/users/42dc38d6c3634b7496b1b7e99ca3f647/roles/fbc2125af36f44b0913c866ea5f56ca5` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:47.588000 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e3f75-acd1-4ab8-aa52-b77f1b8499b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb2de9bea1cf451db5f8c697f480c480, user_id=42dc38d6c3634b7496b1b7e99ca3f647, role_id=fbc2125af36f44b0913c866ea5f56ca5)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:47.589481 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e3f75-acd1-4ab8-aa52-b77f1b8499b1 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:47.604436 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 536/1084] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:20:47 2022] PUT /identity/v3/projects/eb2de9bea1cf451db5f8c697f480c480/users/42dc38d6c3634b7496b1b7e99ca3f647/roles/fbc2125af36f44b0913c866ea5f56ca5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:20:49.872523 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ded61-bd01-4c8c-b85f-bbebe37e0e15 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:49.873253 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ded61-bd01-4c8c-b85f-bbebe37e0e15 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:49.873253 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ded61-bd01-4c8c-b85f-bbebe37e0e15 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:49.874551 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 549/1085] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:49.881165 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895e197-dcd0-41ea-9155-47906a1fec33 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:49.881660 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895e197-dcd0-41ea-9155-47906a1fec33 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:49.882132 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895e197-dcd0-41ea-9155-47906a1fec33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:49.887255 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd0590-b0b8-4778-b0a5-ebacf11f14f8 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:49.887551 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd0590-b0b8-4778-b0a5-ebacf11f14f8 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:49.887838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd0590-b0b8-4778-b0a5-ebacf11f14f8 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:49.889202 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 550/1086] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:20:49.894612 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a901452-6909-456a-aaf8-891ab29fd2e4 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:49.894926 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a901452-6909-456a-aaf8-891ab29fd2e4 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:49.895284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a901452-6909-456a-aaf8-891ab29fd2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:49.899783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-2895e197-dcd0-41ea-9155-47906a1fec33 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:49.901002 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-2895e197-dcd0-41ea-9155-47906a1fec33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:49.915142 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-9a901452-6909-456a-aaf8-891ab29fd2e4 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:49.916342 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-9a901452-6909-456a-aaf8-891ab29fd2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:49.981329 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 537/1087] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:50.001248 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 551/1088] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:20:50.005504 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895e197-dcd0-41ea-9155-47906a1fec33 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:50.025286 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a901452-6909-456a-aaf8-891ab29fd2e4 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:50.101395 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895e197-dcd0-41ea-9155-47906a1fec33 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:50.122902 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a901452-6909-456a-aaf8-891ab29fd2e4 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:50.135423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea50803-e1d9-449b-b9f2-36e8fe9b9c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:50.136229 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea50803-e1d9-449b-b9f2-36e8fe9b9c6e None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:50.136515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea50803-e1d9-449b-b9f2-36e8fe9b9c6e None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:50.136794 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea50803-e1d9-449b-b9f2-36e8fe9b9c6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:50.147307 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea50803-e1d9-449b-b9f2-36e8fe9b9c6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:20:50.157462 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dcead-3a6e-4be7-bb9b-5308e149a2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:50.157708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-5ea50803-e1d9-449b-b9f2-36e8fe9b9c6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:20:50.157708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:50.157708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:50.157708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:50.157708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:50.157708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:50.157708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:50.157708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:50.157708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:50.157708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:50.157708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:50.157708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:50.157708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:20:50.157708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:20:50.157708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:20:50.157708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:20:50.158869 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:20:50.158869 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:20:50.158869 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:20:50.158869 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:20:50.158869 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:50.158869 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:50.158869 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:50.158869 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:50.158869 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:50.158869 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:50.158869 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:50.158869 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:50.158869 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:50.158869 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:50.158869 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:50.158869 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:50.160963 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:50.160963 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:50.160963 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:50.160963 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:50.160963 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:20:50.160963 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:20:50.160963 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:20:50.160963 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:20:50.160963 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:20:50.160963 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:20:50.160963 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:20:50.160963 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:50.161646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dcead-3a6e-4be7-bb9b-5308e149a2c5 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:50.161646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dcead-3a6e-4be7-bb9b-5308e149a2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:50.161646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dcead-3a6e-4be7-bb9b-5308e149a2c5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:50.161844 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 538/1089] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:20:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:50.166227 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea50803-e1d9-449b-b9f2-36e8fe9b9c6e None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:50.171077 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702dcead-3a6e-4be7-bb9b-5308e149a2c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:20:50.179944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-702dcead-3a6e-4be7-bb9b-5308e149a2c5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:20:50.179944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:50.179944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:50.179944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:50.179944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:50.179944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:50.179944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:50.179944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:50.179944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:50.179944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:50.179944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:50.179944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:50.179944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:20:50.179944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:20:50.179944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:20:50.179944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:20:50.180841 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:20:50.180841 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:20:50.180841 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:20:50.180841 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:20:50.180841 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:50.180841 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:50.180841 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:50.180841 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:50.180841 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:50.180841 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:50.180841 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:50.180841 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:50.180841 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:50.180841 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:50.180841 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:50.180841 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:50.181664 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:50.181664 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:50.181664 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:50.181664 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:50.181664 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:20:50.181664 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:20:50.181664 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:20:50.181664 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:20:50.181664 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:20:50.181664 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:20:50.181664 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:20:50.181664 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:50.181664 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 552/1090] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 9 15:20:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:50.187134 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dcead-3a6e-4be7-bb9b-5308e149a2c5 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:50.271088 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea50803-e1d9-449b-b9f2-36e8fe9b9c6e None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:50.297492 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dcead-3a6e-4be7-bb9b-5308e149a2c5 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:50.305326 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de512f4d-574b-437f-89de-ed2f399fcdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:50.306029 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de512f4d-574b-437f-89de-ed2f399fcdaa None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:50.306318 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de512f4d-574b-437f-89de-ed2f399fcdaa None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:50.306601 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de512f4d-574b-437f-89de-ed2f399fcdaa None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:50.307364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de512f4d-574b-437f-89de-ed2f399fcdaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:50.307677 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de512f4d-574b-437f-89de-ed2f399fcdaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:50.309056 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de512f4d-574b-437f-89de-ed2f399fcdaa None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:50.321744 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 539/1091] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:20:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:50.327566 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de512f4d-574b-437f-89de-ed2f399fcdaa None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:50.338471 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e550b-0587-4628-acb0-9e65d6f496ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:50.339151 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e550b-0587-4628-acb0-9e65d6f496ae None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:50.339443 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e550b-0587-4628-acb0-9e65d6f496ae None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:50.339727 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e550b-0587-4628-acb0-9e65d6f496ae None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:50.340480 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e550b-0587-4628-acb0-9e65d6f496ae None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:50.340792 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e550b-0587-4628-acb0-9e65d6f496ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:50.342200 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e550b-0587-4628-acb0-9e65d6f496ae None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:50.350406 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 553/1092] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:20:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:50.356059 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e550b-0587-4628-acb0-9e65d6f496ae None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:50.444066 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de512f4d-574b-437f-89de-ed2f399fcdaa None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:50.477244 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad198e9d-ed02-4a81-8c20-7af67329b313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:50.478146 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad198e9d-ed02-4a81-8c20-7af67329b313 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:50.478430 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad198e9d-ed02-4a81-8c20-7af67329b313 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:50.478706 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad198e9d-ed02-4a81-8c20-7af67329b313 None admin] PATH_INFO: `/v3/users/9b17be08847f4650a818ba3c1251994d` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:50.479943 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad198e9d-ed02-4a81-8c20-7af67329b313 None admin] RBAC: Authorizing `identity:get_user(user_id=9b17be08847f4650a818ba3c1251994d)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:50.480450 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e550b-0587-4628-acb0-9e65d6f496ae None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:50.481402 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad198e9d-ed02-4a81-8c20-7af67329b313 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:50.483077 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 540/1093] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:20:50 2022] GET /identity/v3/users/9b17be08847f4650a818ba3c1251994d => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:50.489948 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad198e9d-ed02-4a81-8c20-7af67329b313 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:50.514016 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56af1b3-84d6-4b4f-95a4-0e8ab1474160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:50.514816 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56af1b3-84d6-4b4f-95a4-0e8ab1474160 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:50.515110 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56af1b3-84d6-4b4f-95a4-0e8ab1474160 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:50.515383 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56af1b3-84d6-4b4f-95a4-0e8ab1474160 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:50.525757 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56af1b3-84d6-4b4f-95a4-0e8ab1474160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:50.527201 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56af1b3-84d6-4b4f-95a4-0e8ab1474160 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:50.544962 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-a56af1b3-84d6-4b4f-95a4-0e8ab1474160 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:50.544962 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:50.544962 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:50.544962 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:50.544962 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:50.544962 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:50.544962 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:50.544962 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:50.544962 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:50.544962 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:50.544962 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:50.544962 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:50.544962 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:50.544962 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:50.544962 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:50.545907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:50.545907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:50.545907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:50.545907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:50.545907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:50.545907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:50.545907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:50.545907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:50.545907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:50.545907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:50.545907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:50.545907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:50.545907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:50.545907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:50.545907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:50.545907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:50.545907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:50.547038 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:50.547038 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:50.547038 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:50.547038 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:50.547038 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 554/1094] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:20:50.552443 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56af1b3-84d6-4b4f-95a4-0e8ab1474160 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:50.586552 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad198e9d-ed02-4a81-8c20-7af67329b313 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:50.620684 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd33b61-7d73-4c6e-9ab4-73f6f0b68af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:50.621349 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd33b61-7d73-4c6e-9ab4-73f6f0b68af8 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:50.621663 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd33b61-7d73-4c6e-9ab4-73f6f0b68af8 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:50.621945 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd33b61-7d73-4c6e-9ab4-73f6f0b68af8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:50.654494 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56af1b3-84d6-4b4f-95a4-0e8ab1474160 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:50.687275 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd33b61-7d73-4c6e-9ab4-73f6f0b68af8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:50.688001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699445d-2048-4624-8e71-dced93dcc0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:50.688669 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699445d-2048-4624-8e71-dced93dcc0d7 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:50.688774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd33b61-7d73-4c6e-9ab4-73f6f0b68af8 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:50.688963 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699445d-2048-4624-8e71-dced93dcc0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:50.689226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699445d-2048-4624-8e71-dced93dcc0d7 None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:50.690005 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699445d-2048-4624-8e71-dced93dcc0d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:50.690372 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699445d-2048-4624-8e71-dced93dcc0d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:50.691708 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699445d-2048-4624-8e71-dced93dcc0d7 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:50.703442 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 555/1095] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:50.717269 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699445d-2048-4624-8e71-dced93dcc0d7 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:50.807384 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 541/1096] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:20:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:20:50.813458 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd33b61-7d73-4c6e-9ab4-73f6f0b68af8 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:50.831477 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699445d-2048-4624-8e71-dced93dcc0d7 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:50.870914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c198ec-ebe3-4917-97f9-4704601d8fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:50.871714 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c198ec-ebe3-4917-97f9-4704601d8fb0 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:50.872001 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c198ec-ebe3-4917-97f9-4704601d8fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:50.872281 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c198ec-ebe3-4917-97f9-4704601d8fb0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:50.880402 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c198ec-ebe3-4917-97f9-4704601d8fb0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:50.881916 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c198ec-ebe3-4917-97f9-4704601d8fb0 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:50.897473 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-21c198ec-ebe3-4917-97f9-4704601d8fb0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:20:50.897473 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:50.897473 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:50.897473 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:50.897473 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:50.897473 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:50.897473 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:50.897473 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:50.897473 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:50.897473 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:50.897473 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:50.897473 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:50.897473 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:20:50.897473 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:20:50.897473 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:20:50.897473 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:20:50.898657 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:50.898657 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:50.898657 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:20:50.898657 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:50.898657 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:20:50.898657 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:20:50.898657 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:50.898657 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:50.898657 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:50.898657 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:50.898657 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:50.898657 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:20:50.898657 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:50.898657 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:50.898657 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:50.898657 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:50.898657 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:50.898657 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:50.904617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:50.904617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:50.904617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:20:50.904617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:20:50.904617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:20:50.904617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:20:50.904617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:20:50.904617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:20:50.904617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:20:50.904617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:20:50.904617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 556/1097] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:20:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:50.904617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c198ec-ebe3-4917-97f9-4704601d8fb0 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:50.915348 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd33b61-7d73-4c6e-9ab4-73f6f0b68af8 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:50.950291 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54819564-5a29-4298-b754-8eab6c518ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:50.951165 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54819564-5a29-4298-b754-8eab6c518ac6 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:50.951464 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54819564-5a29-4298-b754-8eab6c518ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:50.951744 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54819564-5a29-4298-b754-8eab6c518ac6 None admin] PATH_INFO: `/v3/projects/600c10be1c6341c1bf80b644b34423a9` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:50.952992 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54819564-5a29-4298-b754-8eab6c518ac6 None admin] RBAC: Authorizing `identity:get_project(project_id=600c10be1c6341c1bf80b644b34423a9)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:50.954560 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54819564-5a29-4298-b754-8eab6c518ac6 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:50.956825 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 542/1098] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:20:50 2022] GET /identity/v3/projects/600c10be1c6341c1bf80b644b34423a9 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:50.964338 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54819564-5a29-4298-b754-8eab6c518ac6 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:51.030950 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c198ec-ebe3-4917-97f9-4704601d8fb0 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:51.091432 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec494708-2284-4359-b338-1ae67e37f46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:51.092216 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec494708-2284-4359-b338-1ae67e37f46f None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:51.092538 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec494708-2284-4359-b338-1ae67e37f46f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:51.092857 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec494708-2284-4359-b338-1ae67e37f46f None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:51.093984 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec494708-2284-4359-b338-1ae67e37f46f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:51.094339 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec494708-2284-4359-b338-1ae67e37f46f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:51.096250 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec494708-2284-4359-b338-1ae67e37f46f None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:51.119948 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 557/1099] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:20:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:51.127008 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec494708-2284-4359-b338-1ae67e37f46f None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:51.127222 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54819564-5a29-4298-b754-8eab6c518ac6 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:51.164792 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e31529-a241-491a-807e-c19c8ec11035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:51.165661 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e31529-a241-491a-807e-c19c8ec11035 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:51.166069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e31529-a241-491a-807e-c19c8ec11035 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:51.166455 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e31529-a241-491a-807e-c19c8ec11035 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:51.167409 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e31529-a241-491a-807e-c19c8ec11035 None admin] RBAC: Adding query filter params (role.id=9aaa841361294b9c9b275ca1be0ed89c, scope.project.id=600c10be1c6341c1bf80b644b34423a9, user.id=9b17be08847f4650a818ba3c1251994d) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:51.167827 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e31529-a241-491a-807e-c19c8ec11035 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:51.169429 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e31529-a241-491a-807e-c19c8ec11035 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:51.185453 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 543/1100] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:20:50 2022] GET /identity/v3/role_assignments?user.id=9b17be08847f4650a818ba3c1251994d&scope.project.id=600c10be1c6341c1bf80b644b34423a9&role.id=9aaa841361294b9c9b275ca1be0ed89c => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:51.247999 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec494708-2284-4359-b338-1ae67e37f46f None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:51.289261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459117e-2e18-43e1-9745-90f15532ac90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:51.289967 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459117e-2e18-43e1-9745-90f15532ac90 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:51.290254 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459117e-2e18-43e1-9745-90f15532ac90 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:51.290533 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459117e-2e18-43e1-9745-90f15532ac90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:51.371735 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459117e-2e18-43e1-9745-90f15532ac90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:51.373222 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459117e-2e18-43e1-9745-90f15532ac90 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:51.485838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 558/1101] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:20:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:20:51.493262 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e31529-a241-491a-807e-c19c8ec11035 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:51.624965 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e31529-a241-491a-807e-c19c8ec11035 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:51.659617 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e966074-d00f-42d9-a238-51c71acec2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:51.660419 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e966074-d00f-42d9-a238-51c71acec2aa None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:51.660711 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e966074-d00f-42d9-a238-51c71acec2aa None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:51.661091 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e966074-d00f-42d9-a238-51c71acec2aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:51.671674 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e966074-d00f-42d9-a238-51c71acec2aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:51.673130 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e966074-d00f-42d9-a238-51c71acec2aa None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:51.691301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-2e966074-d00f-42d9-a238-51c71acec2aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:51.691301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:51.691301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:51.691301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:51.691301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:51.691301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:51.691301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:51.691301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:51.691301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:51.691301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:51.691301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:51.691301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:51.691301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:20:51.691301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:20:51.691301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:20:51.692333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:20:51.692333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:51.692333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:51.692333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:51.692333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:51.692333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:51.692333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:51.692333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:51.692333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:51.692333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:51.692333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:51.692333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:51.692333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:51.692333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:51.692333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:51.692333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:51.692333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:51.693223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:20:51.693223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:20:51.693223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:20:51.693223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:51.693223 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 544/1102] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:51.700235 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459117e-2e18-43e1-9745-90f15532ac90 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:51.829576 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459117e-2e18-43e1-9745-90f15532ac90 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:51.886171 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db014d0c-2a24-40be-b4e3-529218b2e60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:51.887309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db014d0c-2a24-40be-b4e3-529218b2e60c None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:51.887818 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db014d0c-2a24-40be-b4e3-529218b2e60c None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:51.888277 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db014d0c-2a24-40be-b4e3-529218b2e60c None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:51.889427 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db014d0c-2a24-40be-b4e3-529218b2e60c None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:51.889887 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db014d0c-2a24-40be-b4e3-529218b2e60c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:51.891995 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db014d0c-2a24-40be-b4e3-529218b2e60c None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:51.905644 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 559/1103] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:51.912151 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e966074-d00f-42d9-a238-51c71acec2aa None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:52.076955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e966074-d00f-42d9-a238-51c71acec2aa None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:52.133410 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5320f6-1f85-4e62-8f83-149b33a5b62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:52.134665 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5320f6-1f85-4e62-8f83-149b33a5b62f None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:52.135156 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5320f6-1f85-4e62-8f83-149b33a5b62f None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:52.135645 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5320f6-1f85-4e62-8f83-149b33a5b62f None admin] PATH_INFO: `/v3/projects/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:52.147346 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5320f6-1f85-4e62-8f83-149b33a5b62f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:52.150050 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5320f6-1f85-4e62-8f83-149b33a5b62f None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:52.177790 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-8c5320f6-1f85-4e62-8f83-149b33a5b62f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:52.177790 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:20:52.177790 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:20:52.177790 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:20:52.177790 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:20:52.177790 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:20:52.177790 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:20:52.177790 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:20:52.177790 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:20:52.177790 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:20:52.177790 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:20:52.177790 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:20:52.177790 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:20:52.177790 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:20:52.177790 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:20:52.178722 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:20:52.178722 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:20:52.178722 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:20:52.178722 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:20:52.178722 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:20:52.178722 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:20:52.178722 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:20:52.178722 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:20:52.178722 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:20:52.178722 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:20:52.178722 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:20:52.178722 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:20:52.178722 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:20:52.178722 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:20:52.178722 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:20:52.178722 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:20:52.178722 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:20:52.179558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:20:52.179558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:20:52.179558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:20:52.179558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:20:52.179558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:20:52.179558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:20:52.179558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:20:52.179558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:20:52.184783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 545/1104] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:20:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:20:52.186462 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db014d0c-2a24-40be-b4e3-529218b2e60c None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:52.292055 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db014d0c-2a24-40be-b4e3-529218b2e60c None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:52.328133 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27042119-0760-48c1-a7d8-444e259d941a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:52.328800 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27042119-0760-48c1-a7d8-444e259d941a None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:52.329081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27042119-0760-48c1-a7d8-444e259d941a None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:52.329356 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27042119-0760-48c1-a7d8-444e259d941a None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:52.330186 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27042119-0760-48c1-a7d8-444e259d941a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:52.330497 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27042119-0760-48c1-a7d8-444e259d941a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:52.332432 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27042119-0760-48c1-a7d8-444e259d941a None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:52.345507 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 560/1105] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:20:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:52.352432 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5320f6-1f85-4e62-8f83-149b33a5b62f None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:52.467433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5320f6-1f85-4e62-8f83-149b33a5b62f None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:52.506695 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea580b31-92b6-412c-969d-32ac5218fbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:52.507362 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea580b31-92b6-412c-969d-32ac5218fbc1 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:52.507650 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea580b31-92b6-412c-969d-32ac5218fbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:52.507935 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea580b31-92b6-412c-969d-32ac5218fbc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:52.508783 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea580b31-92b6-412c-969d-32ac5218fbc1 None admin] RBAC: Adding query filter params (role.id=fbc2125af36f44b0913c866ea5f56ca5, scope.project.id=eb2de9bea1cf451db5f8c697f480c480, user.id=42dc38d6c3634b7496b1b7e99ca3f647) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:52.509109 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea580b31-92b6-412c-969d-32ac5218fbc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:52.510616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea580b31-92b6-412c-969d-32ac5218fbc1 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:52.517142 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 546/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:20:52 2022] GET /identity/v3/role_assignments?user.id=42dc38d6c3634b7496b1b7e99ca3f647&scope.project.id=eb2de9bea1cf451db5f8c697f480c480&role.id=fbc2125af36f44b0913c866ea5f56ca5 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:53.743505 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007882d-ae10-44a4-8a1a-8dc1d40a966a None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:53.744077 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007882d-ae10-44a4-8a1a-8dc1d40a966a None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:53.744077 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007882d-ae10-44a4-8a1a-8dc1d40a966a None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:53.745520 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 561/1107] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:20:53.751211 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba4c48-9d20-4643-af08-e790bbdbec1f None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:53.751725 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba4c48-9d20-4643-af08-e790bbdbec1f None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:53.751856 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba4c48-9d20-4643-af08-e790bbdbec1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:53.771548 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-03ba4c48-9d20-4643-af08-e790bbdbec1f None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:53.772792 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-03ba4c48-9d20-4643-af08-e790bbdbec1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:53.846023 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 547/1108] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:53.872751 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007882d-ae10-44a4-8a1a-8dc1d40a966a None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:53.974502 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007882d-ae10-44a4-8a1a-8dc1d40a966a None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:54.008893 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd7958-9671-405e-a9a2-98eaaa27b79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:54.009715 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd7958-9671-405e-a9a2-98eaaa27b79d None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:54.009998 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd7958-9671-405e-a9a2-98eaaa27b79d None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:54.010274 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd7958-9671-405e-a9a2-98eaaa27b79d None admin] PATH_INFO: `/v3/domains/default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:54.011456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd7958-9671-405e-a9a2-98eaaa27b79d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:54.012893 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd7958-9671-405e-a9a2-98eaaa27b79d None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:54.014566 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 562/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:20:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:54.021012 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba4c48-9d20-4643-af08-e790bbdbec1f None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:54.135170 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba4c48-9d20-4643-af08-e790bbdbec1f None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:54.174006 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ea4c2-0208-481b-9bf1-43a719352819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:54.174792 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ea4c2-0208-481b-9bf1-43a719352819 None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:54.175412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ea4c2-0208-481b-9bf1-43a719352819 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:54.175412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ea4c2-0208-481b-9bf1-43a719352819 None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:54.176362 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ea4c2-0208-481b-9bf1-43a719352819 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:54.177911 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ea4c2-0208-481b-9bf1-43a719352819 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:54.201314 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 548/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:20:54 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:20:56.590996 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b40ba1-e22d-4156-ae15-566589c6ff4d None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:56.591564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b40ba1-e22d-4156-ae15-566589c6ff4d None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:56.591564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b40ba1-e22d-4156-ae15-566589c6ff4d None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:56.592944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 563/1111] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:20:56.599465 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab905fa-1093-490b-bfa3-e80ae9d06ff0 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:56.600190 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab905fa-1093-490b-bfa3-e80ae9d06ff0 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:56.600190 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab905fa-1093-490b-bfa3-e80ae9d06ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:56.617776 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-fab905fa-1093-490b-bfa3-e80ae9d06ff0 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:20:56.619000 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-fab905fa-1093-490b-bfa3-e80ae9d06ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:20:56.710040 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 549/1112] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:20:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:20:56.734237 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b40ba1-e22d-4156-ae15-566589c6ff4d None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:56.848759 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b40ba1-e22d-4156-ae15-566589c6ff4d None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:56.885830 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9f96a-a8e5-4b16-ac8f-9d6bea8ae1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:56.886766 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9f96a-a8e5-4b16-ac8f-9d6bea8ae1b4 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:56.887097 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9f96a-a8e5-4b16-ac8f-9d6bea8ae1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:56.887421 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9f96a-a8e5-4b16-ac8f-9d6bea8ae1b4 None admin] PATH_INFO: `/v3/roles/b624791ed6aa460fa31372c80cf5991d` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:56.889006 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9f96a-a8e5-4b16-ac8f-9d6bea8ae1b4 None admin] RBAC: Authorizing `identity:get_role(role_id=b624791ed6aa460fa31372c80cf5991d)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:56.890460 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9f96a-a8e5-4b16-ac8f-9d6bea8ae1b4 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:56.891941 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 564/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:20:56 2022] GET /identity/v3/roles/b624791ed6aa460fa31372c80cf5991d => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:56.898441 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab905fa-1093-490b-bfa3-e80ae9d06ff0 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:56.997848 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab905fa-1093-490b-bfa3-e80ae9d06ff0 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:57.032187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691fb94-e8a2-434a-a5ba-fbab6f0e74b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:57.033180 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691fb94-e8a2-434a-a5ba-fbab6f0e74b2 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:57.033553 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691fb94-e8a2-434a-a5ba-fbab6f0e74b2 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:57.034600 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691fb94-e8a2-434a-a5ba-fbab6f0e74b2 None admin] PATH_INFO: `/v3/users/e1afac15fe6c403cb13c729e7e23a082` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:57.048480 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691fb94-e8a2-434a-a5ba-fbab6f0e74b2 None admin] RBAC: Authorizing `identity:get_user(user_id=e1afac15fe6c403cb13c729e7e23a082)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:57.050432 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691fb94-e8a2-434a-a5ba-fbab6f0e74b2 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:57.052341 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 550/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:20:56 2022] GET /identity/v3/users/e1afac15fe6c403cb13c729e7e23a082 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:20:57.058560 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9f96a-a8e5-4b16-ac8f-9d6bea8ae1b4 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:57.176746 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9f96a-a8e5-4b16-ac8f-9d6bea8ae1b4 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:57.213131 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252fa70-748b-42e3-98a7-2e4b799dbcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:57.213891 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252fa70-748b-42e3-98a7-2e4b799dbcfc None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:57.214224 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252fa70-748b-42e3-98a7-2e4b799dbcfc None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:57.214546 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252fa70-748b-42e3-98a7-2e4b799dbcfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:57.282931 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252fa70-748b-42e3-98a7-2e4b799dbcfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:57.284980 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252fa70-748b-42e3-98a7-2e4b799dbcfc None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:57.386115 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 565/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:20:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:20:57.392282 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691fb94-e8a2-434a-a5ba-fbab6f0e74b2 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:57.521338 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691fb94-e8a2-434a-a5ba-fbab6f0e74b2 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:57.557301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca100e-48b8-40dc-b790-e736841cfb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:57.558284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca100e-48b8-40dc-b790-e736841cfb9d None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:57.558613 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca100e-48b8-40dc-b790-e736841cfb9d None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:57.558935 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca100e-48b8-40dc-b790-e736841cfb9d None admin] PATH_INFO: `/v3/projects/600c10be1c6341c1bf80b644b34423a9` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:57.560199 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca100e-48b8-40dc-b790-e736841cfb9d None admin] RBAC: Authorizing `identity:get_project(project_id=600c10be1c6341c1bf80b644b34423a9)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:57.561728 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca100e-48b8-40dc-b790-e736841cfb9d None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:57.563524 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 551/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:20:57 2022] GET /identity/v3/projects/600c10be1c6341c1bf80b644b34423a9 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:20:57.570723 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252fa70-748b-42e3-98a7-2e4b799dbcfc None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:20:57.677816 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252fa70-748b-42e3-98a7-2e4b799dbcfc None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:20:57.715784 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57574b9f-8948-4a94-bf40-cb9558ae2a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:20:57.716519 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57574b9f-8948-4a94-bf40-cb9558ae2a42 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:20:57.716853 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57574b9f-8948-4a94-bf40-cb9558ae2a42 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:20:57.717175 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57574b9f-8948-4a94-bf40-cb9558ae2a42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:20:57.718119 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57574b9f-8948-4a94-bf40-cb9558ae2a42 None admin] RBAC: Adding query filter params (role.id=b624791ed6aa460fa31372c80cf5991d, scope.project.id=600c10be1c6341c1bf80b644b34423a9, user.id=e1afac15fe6c403cb13c729e7e23a082) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:20:57.718478 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57574b9f-8948-4a94-bf40-cb9558ae2a42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:20:57.720017 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57574b9f-8948-4a94-bf40-cb9558ae2a42 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:20:57.728138 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 566/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:20:57 2022] GET /identity/v3/role_assignments?user.id=e1afac15fe6c403cb13c729e7e23a082&scope.project.id=600c10be1c6341c1bf80b644b34423a9&role.id=b624791ed6aa460fa31372c80cf5991d => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:00.102773 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adbda7-c756-48ef-ab2c-7d10d2a4ef2b None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:00.103340 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adbda7-c756-48ef-ab2c-7d10d2a4ef2b None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:00.103497 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adbda7-c756-48ef-ab2c-7d10d2a4ef2b None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:00.104990 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 552/1118] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:00.111437 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8597a6-c30c-43b2-8a22-bd13d2475b52 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:00.112040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8597a6-c30c-43b2-8a22-bd13d2475b52 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:00.112130 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8597a6-c30c-43b2-8a22-bd13d2475b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:00.132551 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-2c8597a6-c30c-43b2-8a22-bd13d2475b52 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:00.133851 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-2c8597a6-c30c-43b2-8a22-bd13d2475b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:00.210483 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 567/1119] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:21:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:21:00.234636 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adbda7-c756-48ef-ab2c-7d10d2a4ef2b None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:00.348512 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adbda7-c756-48ef-ab2c-7d10d2a4ef2b None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:00.392138 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6870696-c5f6-42ac-b9da-a921c099db37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:00.392924 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6870696-c5f6-42ac-b9da-a921c099db37 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:00.393256 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6870696-c5f6-42ac-b9da-a921c099db37 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:00.393682 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6870696-c5f6-42ac-b9da-a921c099db37 None admin] PATH_INFO: `/v3/roles/b624791ed6aa460fa31372c80cf5991d` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:00.395643 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6870696-c5f6-42ac-b9da-a921c099db37 None admin] RBAC: Authorizing `identity:get_role(role_id=b624791ed6aa460fa31372c80cf5991d)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:00.397083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6870696-c5f6-42ac-b9da-a921c099db37 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:00.398625 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 553/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:21:00 2022] GET /identity/v3/roles/b624791ed6aa460fa31372c80cf5991d => generated 223 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:00.405008 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8597a6-c30c-43b2-8a22-bd13d2475b52 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:00.526322 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8597a6-c30c-43b2-8a22-bd13d2475b52 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:00.571935 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88c0ec-adf8-4e0b-ad1a-76262b0c01d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:00.572886 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88c0ec-adf8-4e0b-ad1a-76262b0c01d4 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:00.573214 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88c0ec-adf8-4e0b-ad1a-76262b0c01d4 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:00.573576 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88c0ec-adf8-4e0b-ad1a-76262b0c01d4 None admin] PATH_INFO: `/v3/users/e1afac15fe6c403cb13c729e7e23a082` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:00.574910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88c0ec-adf8-4e0b-ad1a-76262b0c01d4 None admin] RBAC: Authorizing `identity:get_user(user_id=e1afac15fe6c403cb13c729e7e23a082)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:00.576430 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88c0ec-adf8-4e0b-ad1a-76262b0c01d4 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:00.578337 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 568/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:21:00 2022] GET /identity/v3/users/e1afac15fe6c403cb13c729e7e23a082 => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:21:00.584884 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6870696-c5f6-42ac-b9da-a921c099db37 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:00.688262 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6870696-c5f6-42ac-b9da-a921c099db37 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:00.722827 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c01c6-2b62-46bc-a325-95e7c8328d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:00.723767 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c01c6-2b62-46bc-a325-95e7c8328d9f None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:00.724096 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c01c6-2b62-46bc-a325-95e7c8328d9f None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:00.724430 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c01c6-2b62-46bc-a325-95e7c8328d9f None admin] PATH_INFO: `/v3/projects/600c10be1c6341c1bf80b644b34423a9` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:00.725773 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c01c6-2b62-46bc-a325-95e7c8328d9f None admin] RBAC: Authorizing `identity:get_project(project_id=600c10be1c6341c1bf80b644b34423a9)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:00.727280 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c01c6-2b62-46bc-a325-95e7c8328d9f None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:00.729098 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 554/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:21:00 2022] GET /identity/v3/projects/600c10be1c6341c1bf80b644b34423a9 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:00.735448 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88c0ec-adf8-4e0b-ad1a-76262b0c01d4 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:00.857336 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88c0ec-adf8-4e0b-ad1a-76262b0c01d4 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:00.897955 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf29eb-1ce9-43f3-a312-9c9a311852d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:00.898985 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf29eb-1ce9-43f3-a312-9c9a311852d3 None admin] REQUEST_METHOD: `PUT` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:00.899352 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf29eb-1ce9-43f3-a312-9c9a311852d3 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:00.899725 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf29eb-1ce9-43f3-a312-9c9a311852d3 None admin] PATH_INFO: `/v3/projects/600c10be1c6341c1bf80b644b34423a9/users/e1afac15fe6c403cb13c729e7e23a082/roles/b624791ed6aa460fa31372c80cf5991d` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:00.902249 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf29eb-1ce9-43f3-a312-9c9a311852d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=600c10be1c6341c1bf80b644b34423a9, user_id=e1afac15fe6c403cb13c729e7e23a082, role_id=b624791ed6aa460fa31372c80cf5991d)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:00.903781 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf29eb-1ce9-43f3-a312-9c9a311852d3 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:00.918634 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 569/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:21:00 2022] PUT /identity/v3/projects/600c10be1c6341c1bf80b644b34423a9/users/e1afac15fe6c403cb13c729e7e23a082/roles/b624791ed6aa460fa31372c80cf5991d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:21:03.249191 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb680398-57e4-4e1e-9d72-6eef3b896b07 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:03.249806 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb680398-57e4-4e1e-9d72-6eef3b896b07 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:03.249806 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb680398-57e4-4e1e-9d72-6eef3b896b07 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:03.251176 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 555/1124] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:03.257438 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841b690-b774-4eeb-bfeb-c451d1afd732 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:03.258051 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841b690-b774-4eeb-bfeb-c451d1afd732 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:03.258051 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841b690-b774-4eeb-bfeb-c451d1afd732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:03.276017 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-9841b690-b774-4eeb-bfeb-c451d1afd732 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:03.277280 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-9841b690-b774-4eeb-bfeb-c451d1afd732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:03.343992 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 570/1125] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:21:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:21:03.368861 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb680398-57e4-4e1e-9d72-6eef3b896b07 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:03.472107 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb680398-57e4-4e1e-9d72-6eef3b896b07 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:03.507514 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfdbd6-38bc-43ca-af56-eff127622b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:03.508304 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfdbd6-38bc-43ca-af56-eff127622b17 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:03.508905 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfdbd6-38bc-43ca-af56-eff127622b17 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:03.511224 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfdbd6-38bc-43ca-af56-eff127622b17 None admin] PATH_INFO: `/v3/roles/b624791ed6aa460fa31372c80cf5991d` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:03.511224 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfdbd6-38bc-43ca-af56-eff127622b17 None admin] RBAC: Authorizing `identity:get_role(role_id=b624791ed6aa460fa31372c80cf5991d)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:03.512195 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfdbd6-38bc-43ca-af56-eff127622b17 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:03.513689 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 556/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:21:03 2022] GET /identity/v3/roles/b624791ed6aa460fa31372c80cf5991d => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:03.520485 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841b690-b774-4eeb-bfeb-c451d1afd732 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:03.631576 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841b690-b774-4eeb-bfeb-c451d1afd732 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:03.666550 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984fe18-4ffc-425f-aab1-62695d345221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:03.667441 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984fe18-4ffc-425f-aab1-62695d345221 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:03.667732 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984fe18-4ffc-425f-aab1-62695d345221 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:03.668014 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984fe18-4ffc-425f-aab1-62695d345221 None admin] PATH_INFO: `/v3/users/e1afac15fe6c403cb13c729e7e23a082` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:03.669274 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984fe18-4ffc-425f-aab1-62695d345221 None admin] RBAC: Authorizing `identity:get_user(user_id=e1afac15fe6c403cb13c729e7e23a082)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:03.670773 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984fe18-4ffc-425f-aab1-62695d345221 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:03.672510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 571/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:21:03 2022] GET /identity/v3/users/e1afac15fe6c403cb13c729e7e23a082 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:21:03.681994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfdbd6-38bc-43ca-af56-eff127622b17 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:03.784563 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfdbd6-38bc-43ca-af56-eff127622b17 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:03.839254 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b75fb-d886-46fd-817e-e865b5d765de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:03.840572 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b75fb-d886-46fd-817e-e865b5d765de None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:03.841068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b75fb-d886-46fd-817e-e865b5d765de None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:03.841591 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b75fb-d886-46fd-817e-e865b5d765de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:03.923746 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b75fb-d886-46fd-817e-e865b5d765de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:03.925923 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b75fb-d886-46fd-817e-e865b5d765de None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:04.028594 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 557/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:21:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:21:04.038556 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984fe18-4ffc-425f-aab1-62695d345221 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:04.139004 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984fe18-4ffc-425f-aab1-62695d345221 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:04.174018 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cff7a-aca5-4858-bcac-1820fab6441d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:04.175493 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cff7a-aca5-4858-bcac-1820fab6441d None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:04.175905 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cff7a-aca5-4858-bcac-1820fab6441d None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:04.176232 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cff7a-aca5-4858-bcac-1820fab6441d None admin] PATH_INFO: `/v3/projects/600c10be1c6341c1bf80b644b34423a9` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:04.177644 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cff7a-aca5-4858-bcac-1820fab6441d None admin] RBAC: Authorizing `identity:get_project(project_id=600c10be1c6341c1bf80b644b34423a9)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:04.179134 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cff7a-aca5-4858-bcac-1820fab6441d None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:04.180950 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 572/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:21:04 2022] GET /identity/v3/projects/600c10be1c6341c1bf80b644b34423a9 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:21:04.187552 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b75fb-d886-46fd-817e-e865b5d765de None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:04.302970 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b75fb-d886-46fd-817e-e865b5d765de None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:04.341608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419394d9-8fe3-49ba-987d-f8950e7a45c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:04.342295 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419394d9-8fe3-49ba-987d-f8950e7a45c5 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:04.342585 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419394d9-8fe3-49ba-987d-f8950e7a45c5 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:04.342866 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419394d9-8fe3-49ba-987d-f8950e7a45c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:04.343725 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419394d9-8fe3-49ba-987d-f8950e7a45c5 None admin] RBAC: Adding query filter params (role.id=b624791ed6aa460fa31372c80cf5991d, scope.project.id=600c10be1c6341c1bf80b644b34423a9, user.id=e1afac15fe6c403cb13c729e7e23a082) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:21:04.344045 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419394d9-8fe3-49ba-987d-f8950e7a45c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:04.345568 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419394d9-8fe3-49ba-987d-f8950e7a45c5 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:04.352963 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 558/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:21:04 2022] GET /identity/v3/role_assignments?user.id=e1afac15fe6c403cb13c729e7e23a082&scope.project.id=600c10be1c6341c1bf80b644b34423a9&role.id=b624791ed6aa460fa31372c80cf5991d => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:06.739149 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e870a-3157-49a3-a72a-10c412ac7b3a None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:06.739940 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e870a-3157-49a3-a72a-10c412ac7b3a None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:06.739940 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e870a-3157-49a3-a72a-10c412ac7b3a None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:06.741361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 573/1131] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:06.746764 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7cd25-9135-4cf5-94ce-ac8010f8c0ba None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:06.747199 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7cd25-9135-4cf5-94ce-ac8010f8c0ba None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:06.747331 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7cd25-9135-4cf5-94ce-ac8010f8c0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:06.765298 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-27b7cd25-9135-4cf5-94ce-ac8010f8c0ba None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:06.766526 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-27b7cd25-9135-4cf5-94ce-ac8010f8c0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:06.831158 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 559/1132] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:21:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:21:06.855358 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e870a-3157-49a3-a72a-10c412ac7b3a None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:06.958470 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e870a-3157-49a3-a72a-10c412ac7b3a None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:06.994079 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcab5c-6fdf-4028-8c18-b888d5144b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:06.994872 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcab5c-6fdf-4028-8c18-b888d5144b17 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:06.995159 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcab5c-6fdf-4028-8c18-b888d5144b17 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:06.995441 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcab5c-6fdf-4028-8c18-b888d5144b17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:06.996649 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdcab5c-6fdf-4028-8c18-b888d5144b17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:06.998114 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdcab5c-6fdf-4028-8c18-b888d5144b17 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:06.999767 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 574/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:21:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:07.005888 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7cd25-9135-4cf5-94ce-ac8010f8c0ba None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:07.100136 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7cd25-9135-4cf5-94ce-ac8010f8c0ba None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:07.133212 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1cb57-adab-4ff8-8324-f437eb36bbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:07.133910 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1cb57-adab-4ff8-8324-f437eb36bbf2 None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:07.134198 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1cb57-adab-4ff8-8324-f437eb36bbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:07.134479 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1cb57-adab-4ff8-8324-f437eb36bbf2 None admin] PATH_INFO: `/v3/projects` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:07.135188 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1cb57-adab-4ff8-8324-f437eb36bbf2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:07.136640 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1cb57-adab-4ff8-8324-f437eb36bbf2 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:07.165445 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 560/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:21:07 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:21:09.505986 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34b98a-3511-45a5-8b90-2d5c2b5d5ab5 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:09.506542 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34b98a-3511-45a5-8b90-2d5c2b5d5ab5 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:09.506542 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34b98a-3511-45a5-8b90-2d5c2b5d5ab5 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:09.507945 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 575/1135] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:09.513318 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d94308-7b0a-43da-80e2-6a927e09fd8d None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:09.513803 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d94308-7b0a-43da-80e2-6a927e09fd8d None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:09.513893 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d94308-7b0a-43da-80e2-6a927e09fd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:09.530994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-c2d94308-7b0a-43da-80e2-6a927e09fd8d None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:09.532264 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-c2d94308-7b0a-43da-80e2-6a927e09fd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:09.598607 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 561/1136] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:21:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:21:09.624752 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34b98a-3511-45a5-8b90-2d5c2b5d5ab5 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:09.724927 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34b98a-3511-45a5-8b90-2d5c2b5d5ab5 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:09.759077 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6e1db-3acd-40eb-8ab6-89e7118d6271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:09.759797 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6e1db-3acd-40eb-8ab6-89e7118d6271 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:09.760078 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6e1db-3acd-40eb-8ab6-89e7118d6271 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:09.760353 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6e1db-3acd-40eb-8ab6-89e7118d6271 None admin] PATH_INFO: `/v3/domains/default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:09.761581 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6e1db-3acd-40eb-8ab6-89e7118d6271 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:09.763017 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6e1db-3acd-40eb-8ab6-89e7118d6271 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:09.764663 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 576/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:21:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:09.770703 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d94308-7b0a-43da-80e2-6a927e09fd8d None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:09.867461 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d94308-7b0a-43da-80e2-6a927e09fd8d None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:09.900961 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946af27b-9551-4750-90db-762c509a0351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:09.901672 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946af27b-9551-4750-90db-762c509a0351 None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:09.901965 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946af27b-9551-4750-90db-762c509a0351 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:09.902250 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946af27b-9551-4750-90db-762c509a0351 None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:09.902981 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946af27b-9551-4750-90db-762c509a0351 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:09.904427 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946af27b-9551-4750-90db-762c509a0351 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:09.924802 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 562/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:21:09 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:21:12.239030 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a582a-4279-4d92-ba7a-5edf744d2c87 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:12.239833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a582a-4279-4d92-ba7a-5edf744d2c87 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:12.239833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a582a-4279-4d92-ba7a-5edf744d2c87 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:12.241219 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 577/1139] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:12.247048 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8714c0c-e37e-4092-8139-2d0b8193d1e5 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:12.247511 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8714c0c-e37e-4092-8139-2d0b8193d1e5 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:12.247600 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8714c0c-e37e-4092-8139-2d0b8193d1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:12.264861 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-a8714c0c-e37e-4092-8139-2d0b8193d1e5 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:12.266132 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-a8714c0c-e37e-4092-8139-2d0b8193d1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:12.331919 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 563/1140] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:21:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:21:12.356318 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a582a-4279-4d92-ba7a-5edf744d2c87 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:12.459725 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a582a-4279-4d92-ba7a-5edf744d2c87 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:12.495833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115d957-2698-4a40-8199-2d5a3ba6b304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:12.496548 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115d957-2698-4a40-8199-2d5a3ba6b304 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:12.496838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115d957-2698-4a40-8199-2d5a3ba6b304 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:12.497119 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115d957-2698-4a40-8199-2d5a3ba6b304 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:12.508733 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115d957-2698-4a40-8199-2d5a3ba6b304 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:21:12.516681 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-7115d957-2698-4a40-8199-2d5a3ba6b304 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:21:12.516681 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:21:12.516681 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:21:12.516681 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:21:12.516681 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:21:12.516681 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:21:12.516681 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:21:12.516681 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:21:12.516681 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:21:12.516681 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:21:12.516681 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:21:12.516681 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:21:12.516681 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:21:12.516681 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:21:12.516681 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:21:12.516681 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:21:12.518456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:21:12.518456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:21:12.518456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:21:12.518456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:21:12.518456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:21:12.518456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:21:12.518456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:21:12.518456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:21:12.518456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:21:12.518456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:21:12.518456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:21:12.518456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:21:12.518456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:21:12.518456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:21:12.518456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:21:12.518456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:21:12.519512 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:21:12.519512 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:21:12.519512 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:21:12.519512 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:21:12.519512 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:21:12.519512 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:21:12.519512 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:21:12.519512 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:21:12.519512 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:21:12.519512 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:21:12.519512 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:21:12.519512 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:21:12.521548 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 578/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:21:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:21:12.525297 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8714c0c-e37e-4092-8139-2d0b8193d1e5 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:12.636846 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8714c0c-e37e-4092-8139-2d0b8193d1e5 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:12.674272 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d465d-5108-4c73-82b9-dda6d8a45923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:12.675212 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d465d-5108-4c73-82b9-dda6d8a45923 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:12.675471 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d465d-5108-4c73-82b9-dda6d8a45923 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:12.675748 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d465d-5108-4c73-82b9-dda6d8a45923 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:12.676527 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d465d-5108-4c73-82b9-dda6d8a45923 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:21:12.676837 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d465d-5108-4c73-82b9-dda6d8a45923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:12.678292 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d465d-5108-4c73-82b9-dda6d8a45923 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:12.687492 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 564/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:21:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:12.693708 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115d957-2698-4a40-8199-2d5a3ba6b304 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:12.806388 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115d957-2698-4a40-8199-2d5a3ba6b304 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:12.844043 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88ddc6-bb07-4042-908e-707cf154d1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:12.844925 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88ddc6-bb07-4042-908e-707cf154d1a2 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:12.845214 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88ddc6-bb07-4042-908e-707cf154d1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:12.845524 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88ddc6-bb07-4042-908e-707cf154d1a2 None admin] PATH_INFO: `/v3/users/15c6bdc64e454679a5901b5c557af2c1` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:12.860101 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88ddc6-bb07-4042-908e-707cf154d1a2 None admin] RBAC: Authorizing `identity:get_user(user_id=15c6bdc64e454679a5901b5c557af2c1)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:12.861620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88ddc6-bb07-4042-908e-707cf154d1a2 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:12.863833 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 579/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:21:12 2022] GET /identity/v3/users/15c6bdc64e454679a5901b5c557af2c1 => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:12.869900 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d465d-5108-4c73-82b9-dda6d8a45923 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:12.976905 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d465d-5108-4c73-82b9-dda6d8a45923 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:13.012625 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e5a27-684c-41d2-8f8f-58ecd5c09b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:13.013282 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e5a27-684c-41d2-8f8f-58ecd5c09b9d None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:13.013600 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e5a27-684c-41d2-8f8f-58ecd5c09b9d None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:13.013882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e5a27-684c-41d2-8f8f-58ecd5c09b9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:13.082124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e5a27-684c-41d2-8f8f-58ecd5c09b9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:13.083531 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e5a27-684c-41d2-8f8f-58ecd5c09b9d None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:13.184365 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 565/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:21:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:21:13.191475 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88ddc6-bb07-4042-908e-707cf154d1a2 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:13.296274 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88ddc6-bb07-4042-908e-707cf154d1a2 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:13.332458 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef2964-51ce-4732-b296-769818d1c5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:13.333247 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef2964-51ce-4732-b296-769818d1c5be None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:13.333561 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef2964-51ce-4732-b296-769818d1c5be None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:13.333844 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef2964-51ce-4732-b296-769818d1c5be None admin] PATH_INFO: `/v3/projects/e19cd98780534af49914be59d6e64f4b` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:13.335081 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef2964-51ce-4732-b296-769818d1c5be None admin] RBAC: Authorizing `identity:get_project(project_id=e19cd98780534af49914be59d6e64f4b)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:13.336539 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef2964-51ce-4732-b296-769818d1c5be None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:13.338336 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 580/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:21:13 2022] GET /identity/v3/projects/e19cd98780534af49914be59d6e64f4b => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:13.344570 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e5a27-684c-41d2-8f8f-58ecd5c09b9d None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:13.448298 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e5a27-684c-41d2-8f8f-58ecd5c09b9d None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:13.482551 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612248d-8de9-412a-8469-783e2dcb7b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:13.483224 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612248d-8de9-412a-8469-783e2dcb7b51 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:13.483513 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612248d-8de9-412a-8469-783e2dcb7b51 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:13.483796 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612248d-8de9-412a-8469-783e2dcb7b51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:13.484641 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612248d-8de9-412a-8469-783e2dcb7b51 None admin] RBAC: Adding query filter params (role.id=9aaa841361294b9c9b275ca1be0ed89c, scope.project.id=e19cd98780534af49914be59d6e64f4b, user.id=15c6bdc64e454679a5901b5c557af2c1) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:21:13.484963 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612248d-8de9-412a-8469-783e2dcb7b51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:13.487329 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612248d-8de9-412a-8469-783e2dcb7b51 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:13.493782 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 566/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:21:13 2022] GET /identity/v3/role_assignments?user.id=15c6bdc64e454679a5901b5c557af2c1&scope.project.id=e19cd98780534af49914be59d6e64f4b&role.id=9aaa841361294b9c9b275ca1be0ed89c => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:15.812498 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98bc87-59a7-4cf9-ab7f-902ca6902486 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:15.813033 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98bc87-59a7-4cf9-ab7f-902ca6902486 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:15.813033 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98bc87-59a7-4cf9-ab7f-902ca6902486 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:15.815082 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 581/1147] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:15.821194 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07261161-c563-47c5-acb9-bcae9a9a1d0f None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:15.821779 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07261161-c563-47c5-acb9-bcae9a9a1d0f None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:15.821779 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07261161-c563-47c5-acb9-bcae9a9a1d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:15.839934 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-07261161-c563-47c5-acb9-bcae9a9a1d0f None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:15.841176 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-07261161-c563-47c5-acb9-bcae9a9a1d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:15.913172 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 567/1148] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:21:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:21:15.936851 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98bc87-59a7-4cf9-ab7f-902ca6902486 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:16.051837 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98bc87-59a7-4cf9-ab7f-902ca6902486 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:16.086640 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be133a5d-382b-40e4-920b-d50516d304b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:16.087360 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be133a5d-382b-40e4-920b-d50516d304b8 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:16.087648 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be133a5d-382b-40e4-920b-d50516d304b8 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:16.087924 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be133a5d-382b-40e4-920b-d50516d304b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:16.099251 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be133a5d-382b-40e4-920b-d50516d304b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:21:16.107006 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-be133a5d-382b-40e4-920b-d50516d304b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:21:16.107006 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:21:16.107006 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:21:16.107006 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:21:16.107006 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:21:16.107006 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:21:16.107006 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:21:16.107006 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:21:16.107006 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:21:16.107006 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:21:16.107006 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:21:16.107006 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:21:16.107006 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:21:16.107006 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:21:16.107006 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:21:16.107006 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:21:16.107902 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:21:16.107902 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:21:16.107902 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:21:16.107902 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:21:16.107902 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:21:16.107902 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:21:16.107902 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:21:16.107902 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:21:16.107902 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:21:16.107902 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:21:16.107902 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:21:16.107902 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:21:16.107902 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:21:16.107902 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:21:16.107902 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:21:16.107902 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:21:16.108809 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:21:16.108809 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:21:16.108809 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:21:16.108809 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:21:16.108809 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:21:16.108809 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:21:16.108809 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:21:16.108809 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:21:16.108809 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:21:16.108809 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:21:16.108809 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:21:16.108809 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:21:16.108809 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 582/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:21:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:21:16.116166 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07261161-c563-47c5-acb9-bcae9a9a1d0f None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:16.212386 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07261161-c563-47c5-acb9-bcae9a9a1d0f None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:16.248028 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66553c-5dac-4fb8-ae90-0b259fc40a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:16.248700 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66553c-5dac-4fb8-ae90-0b259fc40a8f None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:16.248982 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66553c-5dac-4fb8-ae90-0b259fc40a8f None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:16.249256 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66553c-5dac-4fb8-ae90-0b259fc40a8f None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:16.250041 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66553c-5dac-4fb8-ae90-0b259fc40a8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:21:16.250349 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66553c-5dac-4fb8-ae90-0b259fc40a8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:16.251708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66553c-5dac-4fb8-ae90-0b259fc40a8f None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:16.260025 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 568/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:21:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:16.266080 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be133a5d-382b-40e4-920b-d50516d304b8 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:16.372520 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be133a5d-382b-40e4-920b-d50516d304b8 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:16.407258 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089599b-28db-4c1f-bfe0-97e0bbcf7648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:16.408231 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089599b-28db-4c1f-bfe0-97e0bbcf7648 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:16.409123 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089599b-28db-4c1f-bfe0-97e0bbcf7648 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:16.409421 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089599b-28db-4c1f-bfe0-97e0bbcf7648 None admin] PATH_INFO: `/v3/users/15c6bdc64e454679a5901b5c557af2c1` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:16.410649 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089599b-28db-4c1f-bfe0-97e0bbcf7648 None admin] RBAC: Authorizing `identity:get_user(user_id=15c6bdc64e454679a5901b5c557af2c1)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:16.412079 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089599b-28db-4c1f-bfe0-97e0bbcf7648 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:16.413768 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 583/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:21:16 2022] GET /identity/v3/users/15c6bdc64e454679a5901b5c557af2c1 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:16.419574 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66553c-5dac-4fb8-ae90-0b259fc40a8f None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:16.522790 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66553c-5dac-4fb8-ae90-0b259fc40a8f None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:16.556741 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861df61-5702-4406-a70d-8ad3cca6b8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:16.557644 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861df61-5702-4406-a70d-8ad3cca6b8e7 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:16.557934 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861df61-5702-4406-a70d-8ad3cca6b8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:16.558212 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861df61-5702-4406-a70d-8ad3cca6b8e7 None admin] PATH_INFO: `/v3/projects/e19cd98780534af49914be59d6e64f4b` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:16.559407 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861df61-5702-4406-a70d-8ad3cca6b8e7 None admin] RBAC: Authorizing `identity:get_project(project_id=e19cd98780534af49914be59d6e64f4b)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:16.560845 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861df61-5702-4406-a70d-8ad3cca6b8e7 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:16.562671 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 569/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:21:16 2022] GET /identity/v3/projects/e19cd98780534af49914be59d6e64f4b => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:16.569309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089599b-28db-4c1f-bfe0-97e0bbcf7648 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:16.674053 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089599b-28db-4c1f-bfe0-97e0bbcf7648 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:16.718444 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde3ebe-3b38-41ee-aca9-e4c56605a4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:16.719405 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde3ebe-3b38-41ee-aca9-e4c56605a4bc None admin] REQUEST_METHOD: `PUT` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:16.719689 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde3ebe-3b38-41ee-aca9-e4c56605a4bc None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:16.719963 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde3ebe-3b38-41ee-aca9-e4c56605a4bc None admin] PATH_INFO: `/v3/projects/e19cd98780534af49914be59d6e64f4b/users/15c6bdc64e454679a5901b5c557af2c1/roles/9aaa841361294b9c9b275ca1be0ed89c` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:16.722475 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde3ebe-3b38-41ee-aca9-e4c56605a4bc None admin] RBAC: Authorizing `identity:create_grant(project_id=e19cd98780534af49914be59d6e64f4b, user_id=15c6bdc64e454679a5901b5c557af2c1, role_id=9aaa841361294b9c9b275ca1be0ed89c)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:16.723913 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde3ebe-3b38-41ee-aca9-e4c56605a4bc None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:16.738430 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 584/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:21:16 2022] PUT /identity/v3/projects/e19cd98780534af49914be59d6e64f4b/users/15c6bdc64e454679a5901b5c557af2c1/roles/9aaa841361294b9c9b275ca1be0ed89c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:21:19.026116 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27149936-790d-4634-b08a-eead3867f8b7 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:19.026984 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27149936-790d-4634-b08a-eead3867f8b7 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:19.026984 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27149936-790d-4634-b08a-eead3867f8b7 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:19.028055 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 570/1154] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:19.034923 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f56d0-5a2e-4b91-a5fb-3aeeba2ca43b None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:19.035499 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f56d0-5a2e-4b91-a5fb-3aeeba2ca43b None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:19.035499 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f56d0-5a2e-4b91-a5fb-3aeeba2ca43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:19.060616 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-0e7f56d0-5a2e-4b91-a5fb-3aeeba2ca43b None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:19.061895 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-0e7f56d0-5a2e-4b91-a5fb-3aeeba2ca43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:19.133993 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 585/1155] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:21:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:21:19.159271 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27149936-790d-4634-b08a-eead3867f8b7 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:19.263039 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27149936-790d-4634-b08a-eead3867f8b7 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:19.296316 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df732e6c-1d7d-4021-9afe-5a2c29b4c39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:19.297036 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df732e6c-1d7d-4021-9afe-5a2c29b4c39a None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:19.297325 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df732e6c-1d7d-4021-9afe-5a2c29b4c39a None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:19.297639 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df732e6c-1d7d-4021-9afe-5a2c29b4c39a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:19.308483 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df732e6c-1d7d-4021-9afe-5a2c29b4c39a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:21:19.317191 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-df732e6c-1d7d-4021-9afe-5a2c29b4c39a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:21:19.317191 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:21:19.317191 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:21:19.317191 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:21:19.317191 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:21:19.317191 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:21:19.317191 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:21:19.317191 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:21:19.317191 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:21:19.317191 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:21:19.317191 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:21:19.317191 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:21:19.317191 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:21:19.317191 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:21:19.317191 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:21:19.317191 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:21:19.318206 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:21:19.318206 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:21:19.318206 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:21:19.318206 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:21:19.318206 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:21:19.318206 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:21:19.318206 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:21:19.318206 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:21:19.318206 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:21:19.318206 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:21:19.318206 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:21:19.318206 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:21:19.318206 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:21:19.318206 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:21:19.318206 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:21:19.318206 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:21:19.319070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:21:19.319070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:21:19.319070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:21:19.319070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:21:19.319070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:21:19.319070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:21:19.319070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:21:19.319070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:21:19.319070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:21:19.319070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:21:19.319070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:21:19.319070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:21:19.319070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 571/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:21:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:21:19.324669 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f56d0-5a2e-4b91-a5fb-3aeeba2ca43b None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:19.422365 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f56d0-5a2e-4b91-a5fb-3aeeba2ca43b None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:19.456014 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474baf7-1731-43b2-9a76-45dd012dfad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:19.456687 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474baf7-1731-43b2-9a76-45dd012dfad5 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:19.456976 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474baf7-1731-43b2-9a76-45dd012dfad5 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:19.457260 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474baf7-1731-43b2-9a76-45dd012dfad5 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:19.458052 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474baf7-1731-43b2-9a76-45dd012dfad5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:21:19.458363 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474baf7-1731-43b2-9a76-45dd012dfad5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:19.459750 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474baf7-1731-43b2-9a76-45dd012dfad5 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:19.467736 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 586/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:21:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:19.473628 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df732e6c-1d7d-4021-9afe-5a2c29b4c39a None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:19.572484 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df732e6c-1d7d-4021-9afe-5a2c29b4c39a None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:19.604006 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d05bf-9864-4243-853f-6dc566dac22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:19.604885 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d05bf-9864-4243-853f-6dc566dac22e None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:19.605164 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d05bf-9864-4243-853f-6dc566dac22e None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:19.605468 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d05bf-9864-4243-853f-6dc566dac22e None admin] PATH_INFO: `/v3/users/15c6bdc64e454679a5901b5c557af2c1` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:19.606678 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d05bf-9864-4243-853f-6dc566dac22e None admin] RBAC: Authorizing `identity:get_user(user_id=15c6bdc64e454679a5901b5c557af2c1)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:19.608108 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d05bf-9864-4243-853f-6dc566dac22e None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:19.609789 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 572/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:21:19 2022] GET /identity/v3/users/15c6bdc64e454679a5901b5c557af2c1 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:19.616959 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474baf7-1731-43b2-9a76-45dd012dfad5 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:19.725691 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474baf7-1731-43b2-9a76-45dd012dfad5 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:19.759416 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6589ac-0dc5-4539-b289-1252b4741ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:19.760074 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6589ac-0dc5-4539-b289-1252b4741ecd None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:19.760363 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6589ac-0dc5-4539-b289-1252b4741ecd None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:19.760644 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6589ac-0dc5-4539-b289-1252b4741ecd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:19.827785 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6589ac-0dc5-4539-b289-1252b4741ecd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:19.829157 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6589ac-0dc5-4539-b289-1252b4741ecd None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:19.928606 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 587/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:21:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:21:19.934540 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d05bf-9864-4243-853f-6dc566dac22e None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:20.030460 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d05bf-9864-4243-853f-6dc566dac22e None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:20.062582 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20c04f-5c08-42f5-8039-ade2b4dbb8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:20.063428 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20c04f-5c08-42f5-8039-ade2b4dbb8e5 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:20.063708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20c04f-5c08-42f5-8039-ade2b4dbb8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:20.063979 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20c04f-5c08-42f5-8039-ade2b4dbb8e5 None admin] PATH_INFO: `/v3/projects/e19cd98780534af49914be59d6e64f4b` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:20.065364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20c04f-5c08-42f5-8039-ade2b4dbb8e5 None admin] RBAC: Authorizing `identity:get_project(project_id=e19cd98780534af49914be59d6e64f4b)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:20.066823 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20c04f-5c08-42f5-8039-ade2b4dbb8e5 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:20.068547 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 573/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:21:19 2022] GET /identity/v3/projects/e19cd98780534af49914be59d6e64f4b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:20.074636 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6589ac-0dc5-4539-b289-1252b4741ecd None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:20.171186 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6589ac-0dc5-4539-b289-1252b4741ecd None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:20.204631 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3534c3d-ac41-46ea-bff5-a1acf017b3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:20.205556 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3534c3d-ac41-46ea-bff5-a1acf017b3ee None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:20.205844 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3534c3d-ac41-46ea-bff5-a1acf017b3ee None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:20.206122 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3534c3d-ac41-46ea-bff5-a1acf017b3ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:20.206967 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3534c3d-ac41-46ea-bff5-a1acf017b3ee None admin] RBAC: Adding query filter params (role.id=9aaa841361294b9c9b275ca1be0ed89c, scope.project.id=e19cd98780534af49914be59d6e64f4b, user.id=15c6bdc64e454679a5901b5c557af2c1) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:21:20.207285 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3534c3d-ac41-46ea-bff5-a1acf017b3ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:20.208733 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3534c3d-ac41-46ea-bff5-a1acf017b3ee None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:20.214645 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 588/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:21:20 2022] GET /identity/v3/role_assignments?user.id=15c6bdc64e454679a5901b5c557af2c1&scope.project.id=e19cd98780534af49914be59d6e64f4b&role.id=9aaa841361294b9c9b275ca1be0ed89c => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:22.593394 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2f0e8-2c6d-4844-a449-878ce5f7f4f4 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:22.593924 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2f0e8-2c6d-4844-a449-878ce5f7f4f4 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:22.594025 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2f0e8-2c6d-4844-a449-878ce5f7f4f4 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:22.595338 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 574/1162] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:22.601144 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95117c-e4c3-4fbd-8c2a-3ac08d15b8d5 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:22.601748 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95117c-e4c3-4fbd-8c2a-3ac08d15b8d5 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:22.601748 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95117c-e4c3-4fbd-8c2a-3ac08d15b8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:22.619486 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-4e95117c-e4c3-4fbd-8c2a-3ac08d15b8d5 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:22.620705 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-4e95117c-e4c3-4fbd-8c2a-3ac08d15b8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:22.686842 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 589/1163] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:21:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:21:22.709441 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2f0e8-2c6d-4844-a449-878ce5f7f4f4 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:22.805089 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2f0e8-2c6d-4844-a449-878ce5f7f4f4 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:22.837091 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d27dea-ca1f-4457-b531-11ea141a859f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:22.837759 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d27dea-ca1f-4457-b531-11ea141a859f None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:22.838045 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d27dea-ca1f-4457-b531-11ea141a859f None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:22.838323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d27dea-ca1f-4457-b531-11ea141a859f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:22.902243 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d27dea-ca1f-4457-b531-11ea141a859f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:22.903712 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d27dea-ca1f-4457-b531-11ea141a859f None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:22.997772 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 575/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:21:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:21:23.004010 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95117c-e4c3-4fbd-8c2a-3ac08d15b8d5 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:23.098913 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95117c-e4c3-4fbd-8c2a-3ac08d15b8d5 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:23.132123 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ec40f-e40c-4528-a09a-24521eac25c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:23.132912 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ec40f-e40c-4528-a09a-24521eac25c8 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:23.133194 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ec40f-e40c-4528-a09a-24521eac25c8 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:23.133495 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ec40f-e40c-4528-a09a-24521eac25c8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:23.140058 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ec40f-e40c-4528-a09a-24521eac25c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:23.141520 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ec40f-e40c-4528-a09a-24521eac25c8 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:23.156040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-290ec40f-e40c-4528-a09a-24521eac25c8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 09 15:21:23.156040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:21:23.156040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 09 15:21:23.156040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 09 15:21:23.156040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:21:23.156040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:21:23.156040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:21:23.156040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:21:23.156040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 09 15:21:23.156040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:21:23.156040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:21:23.156040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:21:23.156040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:21:23.156040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:21:23.156040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:21:23.156040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:21:23.156040 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:21:23.157245 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:21:23.157245 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:21:23.157245 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:21:23.157245 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:21:23.157245 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:21:23.157245 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:21:23.157245 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:21:23.157245 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:21:23.157245 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:21:23.157245 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:21:23.157245 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:21:23.157245 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:21:23.157245 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:21:23.157245 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:21:23.157245 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:21:23.157245 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:21:23.158853 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:21:23.158853 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:21:23.158853 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:21:23.158853 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:21:23.158853 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:21:23.158853 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:21:23.158853 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:21:23.158853 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:21:23.158853 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:21:23.158853 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:21:23.158853 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 09 15:21:23.158853 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:21:23.158853 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 09 15:21:23.158853 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:21:23.158853 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 590/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:21:23 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:21:23.166076 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d27dea-ca1f-4457-b531-11ea141a859f None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:23.259851 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d27dea-ca1f-4457-b531-11ea141a859f None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:23.292649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef6223-b47e-4853-9a47-783a502ef0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:23.293304 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef6223-b47e-4853-9a47-783a502ef0ce None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:23.293613 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef6223-b47e-4853-9a47-783a502ef0ce None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:23.293890 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef6223-b47e-4853-9a47-783a502ef0ce None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:23.294611 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef6223-b47e-4853-9a47-783a502ef0ce None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:21:23.295008 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef6223-b47e-4853-9a47-783a502ef0ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:23.296371 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef6223-b47e-4853-9a47-783a502ef0ce None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:23.303475 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 576/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:21:23 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:25.550777 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17930797-69d9-4443-b698-82112034ed5c None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:25.551251 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17930797-69d9-4443-b698-82112034ed5c None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:25.551347 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17930797-69d9-4443-b698-82112034ed5c None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:25.552720 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 591/1167] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:25.558189 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc99a8-fb0c-4165-9805-68cba2776b5d None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:25.558606 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc99a8-fb0c-4165-9805-68cba2776b5d None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:25.558761 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc99a8-fb0c-4165-9805-68cba2776b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:25.575217 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-54bc99a8-fb0c-4165-9805-68cba2776b5d None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:25.576424 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-54bc99a8-fb0c-4165-9805-68cba2776b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:25.646843 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 577/1168] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:21:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:21:25.669982 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17930797-69d9-4443-b698-82112034ed5c None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:25.768482 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17930797-69d9-4443-b698-82112034ed5c None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:25.802491 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b4bc1-8447-4778-ba77-e4ea17c66f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:25.803077 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b4bc1-8447-4778-ba77-e4ea17c66f65 None admin] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:25.803362 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b4bc1-8447-4778-ba77-e4ea17c66f65 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:25.803641 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b4bc1-8447-4778-ba77-e4ea17c66f65 None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:25.804389 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b4bc1-8447-4778-ba77-e4ea17c66f65 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:25.805799 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b4bc1-8447-4778-ba77-e4ea17c66f65 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:25.820048 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 592/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Mon May 9 15:21:25 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:21:28.114010 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67623a9b-41ab-4140-8db8-3e714d7eac87 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:28.114571 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67623a9b-41ab-4140-8db8-3e714d7eac87 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:28.114571 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67623a9b-41ab-4140-8db8-3e714d7eac87 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:28.116214 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 578/1170] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:28.121712 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568ea5e-4d44-4e94-82c0-e1fca43144a7 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:28.122127 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568ea5e-4d44-4e94-82c0-e1fca43144a7 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:28.122275 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568ea5e-4d44-4e94-82c0-e1fca43144a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:28.139349 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-d568ea5e-4d44-4e94-82c0-e1fca43144a7 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:28.140534 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-d568ea5e-4d44-4e94-82c0-e1fca43144a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:28.207405 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 593/1171] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:21:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:21:28.231376 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67623a9b-41ab-4140-8db8-3e714d7eac87 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:28.329689 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67623a9b-41ab-4140-8db8-3e714d7eac87 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:28.362657 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651e79f-a1fc-4a37-9557-d68511caf7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:28.363512 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651e79f-a1fc-4a37-9557-d68511caf7ad None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:28.363796 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651e79f-a1fc-4a37-9557-d68511caf7ad None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:28.364126 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651e79f-a1fc-4a37-9557-d68511caf7ad None admin] PATH_INFO: `/v3/domains/2fd96d9c61704cf68e1abead779950b4` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:28.374404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651e79f-a1fc-4a37-9557-d68511caf7ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=2fd96d9c61704cf68e1abead779950b4)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:28.375845 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651e79f-a1fc-4a37-9557-d68511caf7ad None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:28.378221 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 579/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Mon May 9 15:21:28 2022] GET /identity/v3/domains/2fd96d9c61704cf68e1abead779950b4 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:28.384176 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568ea5e-4d44-4e94-82c0-e1fca43144a7 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:28.485454 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568ea5e-4d44-4e94-82c0-e1fca43144a7 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:28.522006 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40537e58-ab42-4530-9be1-d27fbc873e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:28.522679 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40537e58-ab42-4530-9be1-d27fbc873e2f None admin] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:28.523192 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40537e58-ab42-4530-9be1-d27fbc873e2f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:28.523309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40537e58-ab42-4530-9be1-d27fbc873e2f None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:28.523936 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40537e58-ab42-4530-9be1-d27fbc873e2f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:28.525541 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40537e58-ab42-4530-9be1-d27fbc873e2f None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:28.552741 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 594/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:21:28 2022] POST /identity/v3/projects => generated 361 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:21:30.901275 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b37d3-d6b5-4464-a369-709a240e062e None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:30.901834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b37d3-d6b5-4464-a369-709a240e062e None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:30.901834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b37d3-d6b5-4464-a369-709a240e062e None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:30.903169 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 580/1174] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:30.908888 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1a525-62da-4215-b050-e6190b317f31 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:30.909363 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1a525-62da-4215-b050-e6190b317f31 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:30.909504 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1a525-62da-4215-b050-e6190b317f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:30.926224 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-def1a525-62da-4215-b050-e6190b317f31 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:30.927431 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-def1a525-62da-4215-b050-e6190b317f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:30.992978 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 595/1175] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:21:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:21:31.018669 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b37d3-d6b5-4464-a369-709a240e062e None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:31.131128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b37d3-d6b5-4464-a369-709a240e062e None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:31.168007 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5203328-3d8d-42ef-9911-a6d0742af899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:31.168801 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5203328-3d8d-42ef-9911-a6d0742af899 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:31.169083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5203328-3d8d-42ef-9911-a6d0742af899 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:31.169360 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5203328-3d8d-42ef-9911-a6d0742af899 None admin] PATH_INFO: `/v3/domains/2fd96d9c61704cf68e1abead779950b4` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:31.170603 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5203328-3d8d-42ef-9911-a6d0742af899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2fd96d9c61704cf68e1abead779950b4)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:31.172049 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5203328-3d8d-42ef-9911-a6d0742af899 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:31.174207 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 581/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Mon May 9 15:21:31 2022] GET /identity/v3/domains/2fd96d9c61704cf68e1abead779950b4 => generated 267 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:31.179771 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1a525-62da-4215-b050-e6190b317f31 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:31.280868 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1a525-62da-4215-b050-e6190b317f31 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:31.315449 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c24f90-e707-4a8b-9fe0-3606703eeca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:31.316125 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c24f90-e707-4a8b-9fe0-3606703eeca1 None admin] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:31.316411 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c24f90-e707-4a8b-9fe0-3606703eeca1 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:31.316783 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c24f90-e707-4a8b-9fe0-3606703eeca1 None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:31.317415 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c24f90-e707-4a8b-9fe0-3606703eeca1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:31.318847 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c24f90-e707-4a8b-9fe0-3606703eeca1 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:31.339047 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 596/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:21:31 2022] POST /identity/v3/users => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:21:33.727878 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c786f-46d7-45bb-b857-ad92d339ec1f None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:33.728421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c786f-46d7-45bb-b857-ad92d339ec1f None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:33.728421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c786f-46d7-45bb-b857-ad92d339ec1f None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:33.729874 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 582/1178] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:33.735434 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f063ec-dda3-4eb8-8f12-32f10f891d16 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:33.736386 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f063ec-dda3-4eb8-8f12-32f10f891d16 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:33.736697 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f063ec-dda3-4eb8-8f12-32f10f891d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:33.755205 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-f6f063ec-dda3-4eb8-8f12-32f10f891d16 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:33.756439 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-f6f063ec-dda3-4eb8-8f12-32f10f891d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:33.827776 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 597/1179] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:21:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:21:33.852159 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c786f-46d7-45bb-b857-ad92d339ec1f None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:33.960367 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c786f-46d7-45bb-b857-ad92d339ec1f None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:33.997312 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9669ebf-0d7b-448b-b518-842f9d894a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:33.998157 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9669ebf-0d7b-448b-b518-842f9d894a02 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:33.998446 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9669ebf-0d7b-448b-b518-842f9d894a02 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:33.998733 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9669ebf-0d7b-448b-b518-842f9d894a02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:34.010404 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9669ebf-0d7b-448b-b518-842f9d894a02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:21:34.018974 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-f9669ebf-0d7b-448b-b518-842f9d894a02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:21:34.018974 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:21:34.018974 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:21:34.018974 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:21:34.018974 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:21:34.018974 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:21:34.018974 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:21:34.018974 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:21:34.018974 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:21:34.018974 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:21:34.018974 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:21:34.018974 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:21:34.018974 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:21:34.018974 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:21:34.018974 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:21:34.018974 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:21:34.020090 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:21:34.020090 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:21:34.020090 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:21:34.020090 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:21:34.020090 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:21:34.020090 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:21:34.020090 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:21:34.020090 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:21:34.020090 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:21:34.020090 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:21:34.020090 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:21:34.020090 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:21:34.020090 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:21:34.020090 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:21:34.020090 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:21:34.020090 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:21:34.021096 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:21:34.021096 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:21:34.021096 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:21:34.021096 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:21:34.021096 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:21:34.021096 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:21:34.021096 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:21:34.021096 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:21:34.021096 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:21:34.021096 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:21:34.021096 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:21:34.021096 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:21:34.021096 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 583/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:21:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:21:34.026668 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f063ec-dda3-4eb8-8f12-32f10f891d16 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:34.134824 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f063ec-dda3-4eb8-8f12-32f10f891d16 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:34.174669 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3dd98-3669-4264-a017-fc7246bb9f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:34.175366 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3dd98-3669-4264-a017-fc7246bb9f85 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:34.175665 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3dd98-3669-4264-a017-fc7246bb9f85 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:34.175977 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3dd98-3669-4264-a017-fc7246bb9f85 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:34.176731 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3dd98-3669-4264-a017-fc7246bb9f85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:21:34.177052 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3dd98-3669-4264-a017-fc7246bb9f85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:34.178603 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3dd98-3669-4264-a017-fc7246bb9f85 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:34.187984 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 598/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:21:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:21:34.194629 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9669ebf-0d7b-448b-b518-842f9d894a02 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:34.297598 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9669ebf-0d7b-448b-b518-842f9d894a02 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:34.331569 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b2cd2-e87c-40c7-a52f-0f382d61b158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:34.332440 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b2cd2-e87c-40c7-a52f-0f382d61b158 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:34.332729 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b2cd2-e87c-40c7-a52f-0f382d61b158 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:34.333007 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b2cd2-e87c-40c7-a52f-0f382d61b158 None admin] PATH_INFO: `/v3/users/0fa3bc25da434a6187c95cee1dbea6fe` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:34.346590 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b2cd2-e87c-40c7-a52f-0f382d61b158 None admin] RBAC: Authorizing `identity:get_user(user_id=0fa3bc25da434a6187c95cee1dbea6fe)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:34.348070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b2cd2-e87c-40c7-a52f-0f382d61b158 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:34.349895 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 584/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:21:34 2022] GET /identity/v3/users/0fa3bc25da434a6187c95cee1dbea6fe => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:34.355825 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3dd98-3669-4264-a017-fc7246bb9f85 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:34.464484 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3dd98-3669-4264-a017-fc7246bb9f85 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:34.500843 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6fb9c-f171-42d1-ad25-e270573b0fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:34.502089 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6fb9c-f171-42d1-ad25-e270573b0fe1 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:34.502387 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6fb9c-f171-42d1-ad25-e270573b0fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:34.502665 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6fb9c-f171-42d1-ad25-e270573b0fe1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:34.589156 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c6fb9c-f171-42d1-ad25-e270573b0fe1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:34.590640 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c6fb9c-f171-42d1-ad25-e270573b0fe1 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:34.690876 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 599/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:21:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:21:34.696827 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b2cd2-e87c-40c7-a52f-0f382d61b158 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:34.794240 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b2cd2-e87c-40c7-a52f-0f382d61b158 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:34.827704 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65e1fe-52d3-472b-8a6f-acdc91a48023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:34.828561 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65e1fe-52d3-472b-8a6f-acdc91a48023 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:34.828841 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65e1fe-52d3-472b-8a6f-acdc91a48023 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:34.829116 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65e1fe-52d3-472b-8a6f-acdc91a48023 None admin] PATH_INFO: `/v3/projects/42c662ae294a4cf5ab36047de3bcbc75` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:34.830533 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65e1fe-52d3-472b-8a6f-acdc91a48023 None admin] RBAC: Authorizing `identity:get_project(project_id=42c662ae294a4cf5ab36047de3bcbc75)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:34.831981 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65e1fe-52d3-472b-8a6f-acdc91a48023 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:34.833732 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 585/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:21:34 2022] GET /identity/v3/projects/42c662ae294a4cf5ab36047de3bcbc75 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:34.839898 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6fb9c-f171-42d1-ad25-e270573b0fe1 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:34.937812 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6fb9c-f171-42d1-ad25-e270573b0fe1 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:34.971429 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a578ed0-cf16-4f3a-999f-0fbbb0868011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:34.972085 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a578ed0-cf16-4f3a-999f-0fbbb0868011 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:34.972372 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a578ed0-cf16-4f3a-999f-0fbbb0868011 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:34.972646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a578ed0-cf16-4f3a-999f-0fbbb0868011 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:34.973521 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a578ed0-cf16-4f3a-999f-0fbbb0868011 None admin] RBAC: Adding query filter params (role.id=9aaa841361294b9c9b275ca1be0ed89c, scope.project.id=42c662ae294a4cf5ab36047de3bcbc75, user.id=0fa3bc25da434a6187c95cee1dbea6fe) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:21:34.973835 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a578ed0-cf16-4f3a-999f-0fbbb0868011 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:34.975275 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a578ed0-cf16-4f3a-999f-0fbbb0868011 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:34.981085 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 600/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:21:34 2022] GET /identity/v3/role_assignments?user.id=0fa3bc25da434a6187c95cee1dbea6fe&scope.project.id=42c662ae294a4cf5ab36047de3bcbc75&role.id=9aaa841361294b9c9b275ca1be0ed89c => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:37.293646 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096dfde-7b57-472f-9b04-2c48ad1b4758 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:37.294206 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096dfde-7b57-472f-9b04-2c48ad1b4758 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:37.294206 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096dfde-7b57-472f-9b04-2c48ad1b4758 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:37.295634 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 586/1186] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:37.301199 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac8c77-7171-4637-9c31-54599389b5c1 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:37.301709 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac8c77-7171-4637-9c31-54599389b5c1 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:37.301832 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac8c77-7171-4637-9c31-54599389b5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:37.318446 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-b4ac8c77-7171-4637-9c31-54599389b5c1 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:37.319694 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-b4ac8c77-7171-4637-9c31-54599389b5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:37.387082 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 601/1187] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:21:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:21:37.410980 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096dfde-7b57-472f-9b04-2c48ad1b4758 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:37.515266 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096dfde-7b57-472f-9b04-2c48ad1b4758 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:37.550358 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b71a5-43c2-47e7-bccc-a44f5e1f43b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:37.551089 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b71a5-43c2-47e7-bccc-a44f5e1f43b7 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:37.551369 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b71a5-43c2-47e7-bccc-a44f5e1f43b7 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:37.551643 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b71a5-43c2-47e7-bccc-a44f5e1f43b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:37.561725 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b71a5-43c2-47e7-bccc-a44f5e1f43b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:21:37.569897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-194b71a5-43c2-47e7-bccc-a44f5e1f43b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:21:37.569897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:21:37.569897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:21:37.569897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:21:37.569897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:21:37.569897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:21:37.569897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:21:37.569897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:21:37.569897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:21:37.569897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:21:37.569897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:21:37.569897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:21:37.569897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:21:37.569897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:21:37.569897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:21:37.569897 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:21:37.571115 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:21:37.571115 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:21:37.571115 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:21:37.571115 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:21:37.571115 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:21:37.571115 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:21:37.571115 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:21:37.571115 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:21:37.571115 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:21:37.571115 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:21:37.571115 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:21:37.571115 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:21:37.571115 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:21:37.571115 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:21:37.571115 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:21:37.571115 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:21:37.572337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:21:37.572337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:21:37.572337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:21:37.572337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:21:37.572337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:21:37.572337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:21:37.572337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:21:37.572337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:21:37.572337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:21:37.572337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:21:37.572337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:21:37.572337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:21:37.572337 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 587/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:21:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:21:37.577180 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac8c77-7171-4637-9c31-54599389b5c1 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:37.679238 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac8c77-7171-4637-9c31-54599389b5c1 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:37.723390 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99f195-0fb1-435d-8777-24369a6ead17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:37.724074 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99f195-0fb1-435d-8777-24369a6ead17 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:37.724359 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99f195-0fb1-435d-8777-24369a6ead17 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:37.724640 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99f195-0fb1-435d-8777-24369a6ead17 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:37.725439 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99f195-0fb1-435d-8777-24369a6ead17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:21:37.725749 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99f195-0fb1-435d-8777-24369a6ead17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:37.727159 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99f195-0fb1-435d-8777-24369a6ead17 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:37.738070 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 602/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:21:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:37.744352 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b71a5-43c2-47e7-bccc-a44f5e1f43b7 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:37.847267 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b71a5-43c2-47e7-bccc-a44f5e1f43b7 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:37.881905 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2cd96-8ad7-4b50-a1ce-6a65f7713857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:37.882804 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2cd96-8ad7-4b50-a1ce-6a65f7713857 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:37.883094 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2cd96-8ad7-4b50-a1ce-6a65f7713857 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:37.883379 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2cd96-8ad7-4b50-a1ce-6a65f7713857 None admin] PATH_INFO: `/v3/users/0fa3bc25da434a6187c95cee1dbea6fe` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:37.884684 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2cd96-8ad7-4b50-a1ce-6a65f7713857 None admin] RBAC: Authorizing `identity:get_user(user_id=0fa3bc25da434a6187c95cee1dbea6fe)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:37.886188 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2cd96-8ad7-4b50-a1ce-6a65f7713857 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:37.887945 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 588/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:21:37 2022] GET /identity/v3/users/0fa3bc25da434a6187c95cee1dbea6fe => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:37.894058 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99f195-0fb1-435d-8777-24369a6ead17 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:37.994235 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99f195-0fb1-435d-8777-24369a6ead17 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:38.028011 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01771e-4922-4174-9686-b55e4934889f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:38.029066 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01771e-4922-4174-9686-b55e4934889f None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:38.029490 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01771e-4922-4174-9686-b55e4934889f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:38.029863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01771e-4922-4174-9686-b55e4934889f None admin] PATH_INFO: `/v3/projects/42c662ae294a4cf5ab36047de3bcbc75` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:38.031222 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01771e-4922-4174-9686-b55e4934889f None admin] RBAC: Authorizing `identity:get_project(project_id=42c662ae294a4cf5ab36047de3bcbc75)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:38.033393 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01771e-4922-4174-9686-b55e4934889f None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:38.035352 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 603/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:21:37 2022] GET /identity/v3/projects/42c662ae294a4cf5ab36047de3bcbc75 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:38.041389 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2cd96-8ad7-4b50-a1ce-6a65f7713857 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:38.141187 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2cd96-8ad7-4b50-a1ce-6a65f7713857 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:38.187348 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d128e-dcb0-4f7e-931d-4e389cbd4e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:38.188470 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d128e-dcb0-4f7e-931d-4e389cbd4e25 None admin] REQUEST_METHOD: `PUT` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:38.188831 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d128e-dcb0-4f7e-931d-4e389cbd4e25 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:38.189213 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d128e-dcb0-4f7e-931d-4e389cbd4e25 None admin] PATH_INFO: `/v3/projects/42c662ae294a4cf5ab36047de3bcbc75/users/0fa3bc25da434a6187c95cee1dbea6fe/roles/9aaa841361294b9c9b275ca1be0ed89c` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:38.191777 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d128e-dcb0-4f7e-931d-4e389cbd4e25 None admin] RBAC: Authorizing `identity:create_grant(project_id=42c662ae294a4cf5ab36047de3bcbc75, user_id=0fa3bc25da434a6187c95cee1dbea6fe, role_id=9aaa841361294b9c9b275ca1be0ed89c)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:38.193556 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d128e-dcb0-4f7e-931d-4e389cbd4e25 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:38.209476 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 589/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:21:38 2022] PUT /identity/v3/projects/42c662ae294a4cf5ab36047de3bcbc75/users/0fa3bc25da434a6187c95cee1dbea6fe/roles/9aaa841361294b9c9b275ca1be0ed89c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:21:40.501401 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48de716-889c-4c1d-a5e1-5147074193b8 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:40.502018 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48de716-889c-4c1d-a5e1-5147074193b8 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:40.502018 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48de716-889c-4c1d-a5e1-5147074193b8 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:40.503360 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 604/1193] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:21:40.509038 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05106f-01f6-4608-8ef3-8a57695618a4 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:40.509518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05106f-01f6-4608-8ef3-8a57695618a4 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:40.509633 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05106f-01f6-4608-8ef3-8a57695618a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:40.528068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-9b05106f-01f6-4608-8ef3-8a57695618a4 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:21:40.529332 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-9b05106f-01f6-4608-8ef3-8a57695618a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:21:40.600257 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 590/1194] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:21:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:21:40.625038 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48de716-889c-4c1d-a5e1-5147074193b8 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:40.732422 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48de716-889c-4c1d-a5e1-5147074193b8 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:40.768689 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e75d1-4603-4583-83ae-03112a942517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:40.769434 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e75d1-4603-4583-83ae-03112a942517 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:40.769727 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e75d1-4603-4583-83ae-03112a942517 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:40.770007 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e75d1-4603-4583-83ae-03112a942517 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:40.781940 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e75d1-4603-4583-83ae-03112a942517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:21:40.790261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-4c2e75d1-4603-4583-83ae-03112a942517 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:21:40.790261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:21:40.790261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:21:40.790261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:21:40.790261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:21:40.790261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:21:40.790261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:21:40.790261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:21:40.790261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:21:40.790261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:21:40.790261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:21:40.790261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:21:40.790261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:21:40.790261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:21:40.790261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:21:40.790261 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:21:40.791509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:21:40.791509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:21:40.791509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:21:40.791509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:21:40.791509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:21:40.791509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:21:40.791509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:21:40.791509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:21:40.791509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:21:40.791509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:21:40.791509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:21:40.791509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:21:40.791509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:21:40.791509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:21:40.791509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:21:40.791509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:21:40.792510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:21:40.792510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:21:40.792510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:21:40.792510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:21:40.792510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:21:40.792510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:21:40.792510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:21:40.792510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:21:40.792510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:21:40.792510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:21:40.792510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:21:40.792510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:21:40.792510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 605/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:21:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:21:40.797629 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05106f-01f6-4608-8ef3-8a57695618a4 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:40.896660 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05106f-01f6-4608-8ef3-8a57695618a4 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:40.931027 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaad132-a45d-4541-8709-312c6be5ce78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:40.931705 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaad132-a45d-4541-8709-312c6be5ce78 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:40.931991 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaad132-a45d-4541-8709-312c6be5ce78 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:40.932270 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaad132-a45d-4541-8709-312c6be5ce78 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:40.933034 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaad132-a45d-4541-8709-312c6be5ce78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:21:40.933349 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaad132-a45d-4541-8709-312c6be5ce78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:40.934786 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaad132-a45d-4541-8709-312c6be5ce78 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:40.943639 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 591/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:21:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:40.949522 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e75d1-4603-4583-83ae-03112a942517 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:41.049289 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e75d1-4603-4583-83ae-03112a942517 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:41.082624 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1e92a-7f69-417f-bcd1-4a40e6d4cdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:41.083502 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1e92a-7f69-417f-bcd1-4a40e6d4cdb3 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:41.083787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1e92a-7f69-417f-bcd1-4a40e6d4cdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:41.084063 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1e92a-7f69-417f-bcd1-4a40e6d4cdb3 None admin] PATH_INFO: `/v3/users/0fa3bc25da434a6187c95cee1dbea6fe` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:41.085281 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1e92a-7f69-417f-bcd1-4a40e6d4cdb3 None admin] RBAC: Authorizing `identity:get_user(user_id=0fa3bc25da434a6187c95cee1dbea6fe)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:41.086765 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1e92a-7f69-417f-bcd1-4a40e6d4cdb3 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:41.088444 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 606/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:21:40 2022] GET /identity/v3/users/0fa3bc25da434a6187c95cee1dbea6fe => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:21:41.094266 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaad132-a45d-4541-8709-312c6be5ce78 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:41.195397 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaad132-a45d-4541-8709-312c6be5ce78 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:41.228891 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9f154-9486-42f9-9b18-5ae4601d78e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:41.229569 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9f154-9486-42f9-9b18-5ae4601d78e9 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:41.229853 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9f154-9486-42f9-9b18-5ae4601d78e9 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:41.230130 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9f154-9486-42f9-9b18-5ae4601d78e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:41.296083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9f154-9486-42f9-9b18-5ae4601d78e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:41.297569 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9f154-9486-42f9-9b18-5ae4601d78e9 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:41.401274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 592/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:21:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:21:41.407434 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1e92a-7f69-417f-bcd1-4a40e6d4cdb3 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:41.509769 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1e92a-7f69-417f-bcd1-4a40e6d4cdb3 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:41.545457 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9648d1-848e-4d8b-9760-49bca3d4b1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:41.546337 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9648d1-848e-4d8b-9760-49bca3d4b1a3 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:41.546614 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9648d1-848e-4d8b-9760-49bca3d4b1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:41.546889 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9648d1-848e-4d8b-9760-49bca3d4b1a3 None admin] PATH_INFO: `/v3/projects/42c662ae294a4cf5ab36047de3bcbc75` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:41.548723 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9648d1-848e-4d8b-9760-49bca3d4b1a3 None admin] RBAC: Authorizing `identity:get_project(project_id=42c662ae294a4cf5ab36047de3bcbc75)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:41.550213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9648d1-848e-4d8b-9760-49bca3d4b1a3 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:41.552002 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 607/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:21:41 2022] GET /identity/v3/projects/42c662ae294a4cf5ab36047de3bcbc75 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:21:41.558283 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9f154-9486-42f9-9b18-5ae4601d78e9 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:21:41.666057 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9f154-9486-42f9-9b18-5ae4601d78e9 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:21:41.703607 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580c841-0ff1-426d-85f5-9dda27cc3aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:21:41.704273 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580c841-0ff1-426d-85f5-9dda27cc3aba None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:21:41.704737 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580c841-0ff1-426d-85f5-9dda27cc3aba None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:21:41.705054 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580c841-0ff1-426d-85f5-9dda27cc3aba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:21:41.706128 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580c841-0ff1-426d-85f5-9dda27cc3aba None admin] RBAC: Adding query filter params (role.id=9aaa841361294b9c9b275ca1be0ed89c, scope.project.id=42c662ae294a4cf5ab36047de3bcbc75, user.id=0fa3bc25da434a6187c95cee1dbea6fe) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:21:41.706450 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580c841-0ff1-426d-85f5-9dda27cc3aba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:21:41.707902 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580c841-0ff1-426d-85f5-9dda27cc3aba None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:21:41.715907 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 593/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:21:41 2022] GET /identity/v3/role_assignments?user.id=0fa3bc25da434a6187c95cee1dbea6fe&scope.project.id=42c662ae294a4cf5ab36047de3bcbc75&role.id=9aaa841361294b9c9b275ca1be0ed89c => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:22:43.587604 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975856e2-01f0-4a11-8166-5a93092cafc4 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:43.588164 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975856e2-01f0-4a11-8166-5a93092cafc4 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:43.588164 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975856e2-01f0-4a11-8166-5a93092cafc4 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:43.589756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 608/1201] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:22:43.599044 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75664e71-ebe7-47e0-99aa-d78b51dfd1b6 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:43.599543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75664e71-ebe7-47e0-99aa-d78b51dfd1b6 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:43.599637 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75664e71-ebe7-47e0-99aa-d78b51dfd1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:43.618356 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-75664e71-ebe7-47e0-99aa-d78b51dfd1b6 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:22:43.619581 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-75664e71-ebe7-47e0-99aa-d78b51dfd1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:22:43.689643 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 594/1202] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:22:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:22:43.714698 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975856e2-01f0-4a11-8166-5a93092cafc4 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:43.818850 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975856e2-01f0-4a11-8166-5a93092cafc4 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:43.853805 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a77e2-5977-44a3-ac3e-e0d0bce4c686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:43.854610 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a77e2-5977-44a3-ac3e-e0d0bce4c686 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:43.854899 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a77e2-5977-44a3-ac3e-e0d0bce4c686 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:43.855199 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a77e2-5977-44a3-ac3e-e0d0bce4c686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:43.868729 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a77e2-5977-44a3-ac3e-e0d0bce4c686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:43.870474 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a77e2-5977-44a3-ac3e-e0d0bce4c686 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:43.890556 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-8f3a77e2-5977-44a3-ac3e-e0d0bce4c686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:22:43.890556 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:22:43.890556 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:22:43.890556 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:22:43.890556 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:22:43.890556 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:22:43.890556 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:22:43.890556 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:22:43.890556 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:22:43.890556 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:22:43.890556 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:22:43.890556 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:22:43.890556 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:22:43.890556 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:22:43.890556 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:22:43.900477 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:22:43.900477 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:22:43.900477 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:22:43.900477 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:22:43.900477 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:22:43.900477 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:22:43.900477 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:22:43.900477 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:22:43.900477 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:22:43.900477 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:22:43.900477 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:22:43.900477 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:22:43.900477 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:22:43.900477 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:22:43.900477 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:22:43.900477 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:22:43.900477 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:22:43.902628 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:22:43.902628 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:22:43.902628 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:22:43.902628 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:22:43.902628 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 609/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:22:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:22:43.905423 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75664e71-ebe7-47e0-99aa-d78b51dfd1b6 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:44.012979 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75664e71-ebe7-47e0-99aa-d78b51dfd1b6 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:44.047072 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9b294-2517-422d-ad27-2b68457aa279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:44.048154 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9b294-2517-422d-ad27-2b68457aa279 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:44.048592 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9b294-2517-422d-ad27-2b68457aa279 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:44.049047 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9b294-2517-422d-ad27-2b68457aa279 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:44.049971 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9b294-2517-422d-ad27-2b68457aa279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:22:44.050424 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9b294-2517-422d-ad27-2b68457aa279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:44.051967 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9b294-2517-422d-ad27-2b68457aa279 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:44.079959 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 595/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:22:44.081019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a77e2-5977-44a3-ac3e-e0d0bce4c686 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:44.209120 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a77e2-5977-44a3-ac3e-e0d0bce4c686 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:44.254649 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad0e68-f3c5-4944-9bfe-e4ad6cea76ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:44.256131 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad0e68-f3c5-4944-9bfe-e4ad6cea76ef None admin] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:44.256497 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad0e68-f3c5-4944-9bfe-e4ad6cea76ef None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:44.256851 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad0e68-f3c5-4944-9bfe-e4ad6cea76ef None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:44.257841 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad0e68-f3c5-4944-9bfe-e4ad6cea76ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:44.260037 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad0e68-f3c5-4944-9bfe-e4ad6cea76ef None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:44.289943 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 610/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:22:44 2022] POST /identity/v3/users => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:22:46.814302 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cc59d-341c-4c7f-a1ea-1a56c6d07028 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:46.815032 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cc59d-341c-4c7f-a1ea-1a56c6d07028 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:46.815032 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cc59d-341c-4c7f-a1ea-1a56c6d07028 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:46.816346 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 596/1206] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:22:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:22:46.823327 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c35c7-9431-4ecc-9673-fb0bdd2aa9d6 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:46.823931 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c35c7-9431-4ecc-9673-fb0bdd2aa9d6 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:46.824264 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c35c7-9431-4ecc-9673-fb0bdd2aa9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:46.847783 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-d34c35c7-9431-4ecc-9673-fb0bdd2aa9d6 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:22:46.849215 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-d34c35c7-9431-4ecc-9673-fb0bdd2aa9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:22:46.937809 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 611/1207] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:22:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:22:46.961988 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cc59d-341c-4c7f-a1ea-1a56c6d07028 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:47.073135 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cc59d-341c-4c7f-a1ea-1a56c6d07028 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:47.113613 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9cbe4-8495-4f71-ab3d-54357834aca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:47.114543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9cbe4-8495-4f71-ab3d-54357834aca2 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:47.115079 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9cbe4-8495-4f71-ab3d-54357834aca2 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:47.115400 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9cbe4-8495-4f71-ab3d-54357834aca2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:47.128205 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9cbe4-8495-4f71-ab3d-54357834aca2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:22:47.137230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-7ee9cbe4-8495-4f71-ab3d-54357834aca2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:22:47.137230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:22:47.137230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:22:47.137230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:22:47.137230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:22:47.137230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:22:47.137230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:22:47.137230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:22:47.137230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:22:47.137230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:22:47.137230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:22:47.137230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:22:47.137230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:22:47.137230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:22:47.137230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:22:47.137230 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:22:47.138198 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:22:47.138198 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:22:47.138198 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:22:47.138198 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:22:47.138198 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:22:47.138198 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:22:47.138198 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:22:47.138198 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:22:47.138198 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:22:47.138198 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:22:47.138198 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:22:47.138198 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:22:47.138198 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:22:47.138198 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:22:47.138198 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:22:47.138198 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:22:47.139035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:22:47.139035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:22:47.139035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:22:47.139035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:22:47.139035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:22:47.139035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:22:47.139035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:22:47.139035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:22:47.139035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:22:47.139035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:22:47.139035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:22:47.139035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:22:47.139035 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 597/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:22:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:22:47.145699 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c35c7-9431-4ecc-9673-fb0bdd2aa9d6 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:47.282413 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c35c7-9431-4ecc-9673-fb0bdd2aa9d6 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:47.327018 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7eb3b3-e0ca-4bab-bdfb-964c9f5c1289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:47.328380 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eb3b3-e0ca-4bab-bdfb-964c9f5c1289 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:47.328666 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eb3b3-e0ca-4bab-bdfb-964c9f5c1289 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:47.328943 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eb3b3-e0ca-4bab-bdfb-964c9f5c1289 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:47.329905 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7eb3b3-e0ca-4bab-bdfb-964c9f5c1289 None admin] RBAC: Adding query filter params (name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:22:47.330273 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7eb3b3-e0ca-4bab-bdfb-964c9f5c1289 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:47.331843 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7eb3b3-e0ca-4bab-bdfb-964c9f5c1289 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:47.341411 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 612/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:22:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:22:47.347918 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9cbe4-8495-4f71-ab3d-54357834aca2 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:47.468001 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9cbe4-8495-4f71-ab3d-54357834aca2 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:47.518604 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4e20e-e8ec-4f2e-81a6-3cc601e04577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:47.520080 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4e20e-e8ec-4f2e-81a6-3cc601e04577 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:47.520756 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4e20e-e8ec-4f2e-81a6-3cc601e04577 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:47.521336 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4e20e-e8ec-4f2e-81a6-3cc601e04577 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:47.536329 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4e20e-e8ec-4f2e-81a6-3cc601e04577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:47.540488 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4e20e-e8ec-4f2e-81a6-3cc601e04577 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:47.562754 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-adf4e20e-e8ec-4f2e-81a6-3cc601e04577 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:22:47.562754 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:22:47.562754 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:22:47.562754 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:22:47.562754 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:22:47.562754 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:22:47.562754 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:22:47.562754 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:22:47.562754 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:22:47.562754 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:22:47.562754 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:22:47.562754 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:22:47.562754 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:22:47.562754 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:22:47.562754 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:22:47.564232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:22:47.564232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:22:47.564232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:22:47.564232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:22:47.564232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:22:47.564232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:22:47.564232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:22:47.564232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:22:47.564232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:22:47.564232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:22:47.564232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:22:47.564232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:22:47.564232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:22:47.564232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:22:47.564232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:22:47.564232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:22:47.564232 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:22:47.565418 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:22:47.565418 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:22:47.565418 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:22:47.565418 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:22:47.565418 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 598/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:22:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:22:47.570315 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7eb3b3-e0ca-4bab-bdfb-964c9f5c1289 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:47.687456 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7eb3b3-e0ca-4bab-bdfb-964c9f5c1289 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:47.726908 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce83c20-5a95-41bf-ae67-2ea20a84cbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:47.727736 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce83c20-5a95-41bf-ae67-2ea20a84cbb5 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:47.728024 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce83c20-5a95-41bf-ae67-2ea20a84cbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:47.728307 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce83c20-5a95-41bf-ae67-2ea20a84cbb5 None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:47.729086 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce83c20-5a95-41bf-ae67-2ea20a84cbb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:22:47.729515 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce83c20-5a95-41bf-ae67-2ea20a84cbb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:47.732249 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce83c20-5a95-41bf-ae67-2ea20a84cbb5 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:47.752856 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 613/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:22:47.759300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4e20e-e8ec-4f2e-81a6-3cc601e04577 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:47.906834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4e20e-e8ec-4f2e-81a6-3cc601e04577 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:47.950228 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3fdb6-7c07-4423-a9cf-e54dc5f419fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:47.950901 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3fdb6-7c07-4423-a9cf-e54dc5f419fb None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:47.951188 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3fdb6-7c07-4423-a9cf-e54dc5f419fb None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:47.951522 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3fdb6-7c07-4423-a9cf-e54dc5f419fb None admin] PATH_INFO: `/v3/users/placement` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:47.961190 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3fdb6-7c07-4423-a9cf-e54dc5f419fb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:47.962753 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3fdb6-7c07-4423-a9cf-e54dc5f419fb None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:47.983114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-a8c3fdb6-7c07-4423-a9cf-e54dc5f419fb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:22:47.983114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:22:47.983114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:22:47.983114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:22:47.983114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:22:47.983114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:22:47.983114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:22:47.983114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:22:47.983114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:22:47.983114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:22:47.983114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:22:47.983114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:22:47.983114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:22:47.983114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:22:47.983114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:22:47.983114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:22:47.984518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:22:47.984518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:22:47.984518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:22:47.984518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:22:47.984518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:22:47.984518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:22:47.984518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:22:47.984518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:22:47.984518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:22:47.984518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:22:47.984518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:22:47.984518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:22:47.984518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:22:47.984518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:22:47.984518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:22:47.984518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:22:47.984518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:22:47.984518 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:22:47.985904 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:22:47.985904 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:22:47.985904 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:22:47.985904 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:22:47.985904 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:22:47.985904 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:22:47.985904 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:22:47.985904 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:22:47.985904 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:22:47.985904 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:22:47.994781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 599/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:22:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:22:47.996697 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce83c20-5a95-41bf-ae67-2ea20a84cbb5 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:48.157144 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce83c20-5a95-41bf-ae67-2ea20a84cbb5 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:48.214585 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaff530-7d2d-47fe-aea4-19c131cb18c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:48.215450 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaff530-7d2d-47fe-aea4-19c131cb18c9 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:48.215758 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaff530-7d2d-47fe-aea4-19c131cb18c9 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:48.216035 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaff530-7d2d-47fe-aea4-19c131cb18c9 None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:48.217289 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaff530-7d2d-47fe-aea4-19c131cb18c9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:22:48.217801 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaff530-7d2d-47fe-aea4-19c131cb18c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:48.220086 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaff530-7d2d-47fe-aea4-19c131cb18c9 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:48.245362 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 614/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 9 15:22:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:22:48.253224 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3fdb6-7c07-4423-a9cf-e54dc5f419fb None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:48.399052 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3fdb6-7c07-4423-a9cf-e54dc5f419fb None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:48.448348 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d751a3-c7d1-4e59-ad5a-c03ab65fc50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:48.449017 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d751a3-c7d1-4e59-ad5a-c03ab65fc50e None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:48.449305 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d751a3-c7d1-4e59-ad5a-c03ab65fc50e None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:48.449619 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d751a3-c7d1-4e59-ad5a-c03ab65fc50e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:48.545581 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d751a3-c7d1-4e59-ad5a-c03ab65fc50e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:48.547807 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d751a3-c7d1-4e59-ad5a-c03ab65fc50e None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:48.675584 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 600/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:22:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:22:48.685346 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaff530-7d2d-47fe-aea4-19c131cb18c9 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:48.810686 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaff530-7d2d-47fe-aea4-19c131cb18c9 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:48.855727 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83a198-c6b3-4cec-a9ce-a6c5cd02a611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:48.856815 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83a198-c6b3-4cec-a9ce-a6c5cd02a611 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:48.857108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83a198-c6b3-4cec-a9ce-a6c5cd02a611 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:48.857429 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83a198-c6b3-4cec-a9ce-a6c5cd02a611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:48.877954 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83a198-c6b3-4cec-a9ce-a6c5cd02a611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:48.879644 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83a198-c6b3-4cec-a9ce-a6c5cd02a611 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:48.900575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-de83a198-c6b3-4cec-a9ce-a6c5cd02a611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:22:48.900575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:22:48.900575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:22:48.900575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:22:48.900575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:22:48.900575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:22:48.900575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:22:48.900575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:22:48.900575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:22:48.900575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:22:48.900575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:22:48.900575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:22:48.900575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:22:48.900575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:22:48.900575 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:22:48.901541 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:22:48.901541 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:22:48.901541 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:22:48.901541 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:22:48.901541 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:22:48.901541 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:22:48.901541 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:22:48.901541 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:22:48.901541 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:22:48.901541 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:22:48.901541 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:22:48.901541 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:22:48.901541 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:22:48.901541 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:22:48.901541 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:22:48.901541 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:22:48.901541 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:22:48.908155 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:22:48.908155 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:22:48.908155 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:22:48.908155 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:22:48.908155 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 615/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:22:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:22:48.908425 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d751a3-c7d1-4e59-ad5a-c03ab65fc50e None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:49.024065 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d751a3-c7d1-4e59-ad5a-c03ab65fc50e None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:49.068305 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a02e1d-91a3-4dad-be19-857e880be59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:49.069006 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a02e1d-91a3-4dad-be19-857e880be59f None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:49.069333 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a02e1d-91a3-4dad-be19-857e880be59f None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:49.069692 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a02e1d-91a3-4dad-be19-857e880be59f None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:49.070562 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a02e1d-91a3-4dad-be19-857e880be59f None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:22:49.070879 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a02e1d-91a3-4dad-be19-857e880be59f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:49.072418 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a02e1d-91a3-4dad-be19-857e880be59f None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:49.092737 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83a198-c6b3-4cec-a9ce-a6c5cd02a611 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:49.095662 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 601/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:22:49.212866 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83a198-c6b3-4cec-a9ce-a6c5cd02a611 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:49.252944 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c779d-a659-4af7-b70e-202c4769133a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:49.253875 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c779d-a659-4af7-b70e-202c4769133a None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:49.254229 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c779d-a659-4af7-b70e-202c4769133a None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:49.254416 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c779d-a659-4af7-b70e-202c4769133a None admin] PATH_INFO: `/v3/projects/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:49.262884 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c779d-a659-4af7-b70e-202c4769133a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:49.264493 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c779d-a659-4af7-b70e-202c4769133a None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:49.280045 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-cb5c779d-a659-4af7-b70e-202c4769133a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:22:49.280045 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:22:49.280045 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:22:49.280045 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:22:49.280045 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:22:49.280045 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:22:49.280045 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:22:49.280045 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:22:49.280045 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:22:49.280045 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:22:49.280045 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:22:49.280045 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:22:49.280045 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:22:49.280045 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:22:49.280045 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:22:49.281026 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:22:49.281026 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:22:49.281026 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:22:49.281026 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:22:49.281026 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:22:49.281026 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:22:49.281026 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:22:49.281026 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:22:49.281026 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:22:49.281026 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:22:49.281026 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:22:49.281026 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:22:49.281026 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:22:49.281026 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:22:49.281026 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:22:49.281026 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:22:49.281026 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:22:49.281907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:22:49.281907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:22:49.281907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:22:49.281907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:22:49.281907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:22:49.281907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:22:49.281907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:22:49.281907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:22:49.281907 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 616/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:22:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:22:49.288025 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a02e1d-91a3-4dad-be19-857e880be59f None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:49.402433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a02e1d-91a3-4dad-be19-857e880be59f None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:49.440522 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad8724-e708-4d1c-b9b7-56b3c0cf8e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:49.441207 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad8724-e708-4d1c-b9b7-56b3c0cf8e15 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:49.441532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad8724-e708-4d1c-b9b7-56b3c0cf8e15 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:49.441817 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad8724-e708-4d1c-b9b7-56b3c0cf8e15 None admin] PATH_INFO: `/v3/projects` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:49.442629 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad8724-e708-4d1c-b9b7-56b3c0cf8e15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:22:49.442994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad8724-e708-4d1c-b9b7-56b3c0cf8e15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:49.444916 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad8724-e708-4d1c-b9b7-56b3c0cf8e15 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:49.459979 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 602/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:22:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:22:49.466284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c779d-a659-4af7-b70e-202c4769133a None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:49.594492 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c779d-a659-4af7-b70e-202c4769133a None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:49.633000 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1dbbe-5139-4b54-8f0c-787b2692d734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:49.633809 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1dbbe-5139-4b54-8f0c-787b2692d734 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:49.634103 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1dbbe-5139-4b54-8f0c-787b2692d734 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:49.634401 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1dbbe-5139-4b54-8f0c-787b2692d734 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:49.635262 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1dbbe-5139-4b54-8f0c-787b2692d734 None admin] RBAC: Adding query filter params (role.id=7d8a1698372145a59d70d67ed7867f56, scope.project.id=eb2de9bea1cf451db5f8c697f480c480, user.id=acd06b5fad24414abc8c2e5c209ce867) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:22:49.635585 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1dbbe-5139-4b54-8f0c-787b2692d734 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:49.637013 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1dbbe-5139-4b54-8f0c-787b2692d734 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:49.643803 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 617/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:22:49 2022] GET /identity/v3/role_assignments?user.id=acd06b5fad24414abc8c2e5c209ce867&scope.project.id=eb2de9bea1cf451db5f8c697f480c480&role.id=7d8a1698372145a59d70d67ed7867f56 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:22:52.057179 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518fbc2-caac-4047-9b4e-198f625bc4c8 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:52.057811 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518fbc2-caac-4047-9b4e-198f625bc4c8 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:52.057811 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518fbc2-caac-4047-9b4e-198f625bc4c8 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:52.059323 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 603/1220] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:22:52.065514 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf64f4-c91e-4a67-be6f-294bf9823047 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:52.066028 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf64f4-c91e-4a67-be6f-294bf9823047 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:52.066112 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf64f4-c91e-4a67-be6f-294bf9823047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:52.084322 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-a0bf64f4-c91e-4a67-be6f-294bf9823047 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:22:52.085580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-a0bf64f4-c91e-4a67-be6f-294bf9823047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:22:52.163758 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 618/1221] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:22:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:22:52.193039 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518fbc2-caac-4047-9b4e-198f625bc4c8 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:52.313580 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518fbc2-caac-4047-9b4e-198f625bc4c8 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:52.353478 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a688eee-d984-4527-aa6e-af4285a0959e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:52.355319 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a688eee-d984-4527-aa6e-af4285a0959e None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:52.355319 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a688eee-d984-4527-aa6e-af4285a0959e None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:52.355319 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a688eee-d984-4527-aa6e-af4285a0959e None admin] PATH_INFO: `/v3/roles/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:52.367342 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a688eee-d984-4527-aa6e-af4285a0959e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:22:52.376882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-3a688eee-d984-4527-aa6e-af4285a0959e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:22:52.376882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:22:52.376882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:22:52.376882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:22:52.376882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:22:52.376882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:22:52.376882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:22:52.376882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:22:52.376882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:22:52.376882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:22:52.376882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:22:52.376882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:22:52.376882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:22:52.376882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:22:52.376882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:22:52.376882 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:22:52.378284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:22:52.378284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:22:52.378284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:22:52.378284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:22:52.378284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:22:52.378284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:22:52.378284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:22:52.378284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:22:52.378284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:22:52.378284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:22:52.378284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:22:52.378284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:22:52.378284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:22:52.378284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:22:52.378284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:22:52.378284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:22:52.381589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:22:52.381589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:22:52.381589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:22:52.381589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:22:52.381589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:22:52.381589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:22:52.381589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:22:52.381589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:22:52.381589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:22:52.381589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:22:52.381589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:22:52.381589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:22:52.381589 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 604/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:22:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:22:52.385973 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf64f4-c91e-4a67-be6f-294bf9823047 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:52.512981 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf64f4-c91e-4a67-be6f-294bf9823047 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:52.555922 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8ab05-008b-4072-93c3-52fae5237eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:52.556800 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8ab05-008b-4072-93c3-52fae5237eee None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:52.557165 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8ab05-008b-4072-93c3-52fae5237eee None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:52.557520 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8ab05-008b-4072-93c3-52fae5237eee None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:52.558470 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8ab05-008b-4072-93c3-52fae5237eee None admin] RBAC: Adding query filter params (name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:22:52.558835 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8ab05-008b-4072-93c3-52fae5237eee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:52.560277 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8ab05-008b-4072-93c3-52fae5237eee None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:52.569489 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 619/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:22:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:22:52.575493 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a688eee-d984-4527-aa6e-af4285a0959e None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:52.686000 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a688eee-d984-4527-aa6e-af4285a0959e None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:52.724535 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d015d-cf00-4d81-9030-ef84fa5bffe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:52.725395 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d015d-cf00-4d81-9030-ef84fa5bffe7 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:52.725726 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d015d-cf00-4d81-9030-ef84fa5bffe7 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:52.726000 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d015d-cf00-4d81-9030-ef84fa5bffe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:52.737748 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d015d-cf00-4d81-9030-ef84fa5bffe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:52.739226 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d015d-cf00-4d81-9030-ef84fa5bffe7 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:52.757473 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-046d015d-cf00-4d81-9030-ef84fa5bffe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:22:52.757473 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:22:52.757473 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:22:52.757473 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:22:52.757473 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:22:52.757473 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:22:52.757473 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:22:52.757473 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:22:52.757473 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:22:52.757473 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:22:52.757473 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:22:52.757473 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:22:52.757473 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:22:52.757473 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:22:52.757473 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:22:52.758727 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:22:52.758727 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:22:52.758727 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:22:52.758727 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:22:52.758727 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:22:52.758727 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:22:52.758727 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:22:52.758727 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:22:52.758727 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:22:52.758727 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:22:52.758727 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:22:52.758727 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:22:52.758727 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:22:52.758727 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:22:52.758727 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:22:52.758727 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:22:52.758727 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:22:52.765952 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:22:52.765952 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:22:52.765952 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:22:52.765952 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:22:52.765952 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 605/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:22:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:22:52.766556 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8ab05-008b-4072-93c3-52fae5237eee None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:52.877461 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8ab05-008b-4072-93c3-52fae5237eee None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:52.913717 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489aad9-d7ae-4f38-ab29-167297f80a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:52.914496 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489aad9-d7ae-4f38-ab29-167297f80a4f None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:52.914853 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489aad9-d7ae-4f38-ab29-167297f80a4f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:52.915177 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489aad9-d7ae-4f38-ab29-167297f80a4f None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:52.916037 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489aad9-d7ae-4f38-ab29-167297f80a4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:22:52.916353 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489aad9-d7ae-4f38-ab29-167297f80a4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:52.918056 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489aad9-d7ae-4f38-ab29-167297f80a4f None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:52.930766 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 620/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:22:52.936391 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d015d-cf00-4d81-9030-ef84fa5bffe7 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:53.039376 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d015d-cf00-4d81-9030-ef84fa5bffe7 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:53.075751 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c30e5-3d19-43c3-a39a-167257b111e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:53.076563 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c30e5-3d19-43c3-a39a-167257b111e7 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:53.076852 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c30e5-3d19-43c3-a39a-167257b111e7 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:53.077137 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c30e5-3d19-43c3-a39a-167257b111e7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:53.085942 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c30e5-3d19-43c3-a39a-167257b111e7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:53.087413 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c30e5-3d19-43c3-a39a-167257b111e7 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:53.104114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-ec9c30e5-3d19-43c3-a39a-167257b111e7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:22:53.104114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:22:53.104114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:22:53.104114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:22:53.104114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:22:53.104114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:22:53.104114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:22:53.104114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:22:53.104114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:22:53.104114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:22:53.104114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:22:53.104114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:22:53.104114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:22:53.104114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:22:53.104114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:22:53.104114 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:22:53.105433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:22:53.105433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:22:53.105433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:22:53.105433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:22:53.105433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:22:53.105433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:22:53.105433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:22:53.105433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:22:53.105433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:22:53.105433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:22:53.105433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:22:53.105433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:22:53.105433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:22:53.105433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:22:53.105433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:22:53.105433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:22:53.105433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:22:53.105433 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:22:53.106497 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:22:53.106497 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:22:53.106497 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:22:53.106497 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:22:53.106497 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:22:53.106497 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:22:53.106497 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:22:53.106497 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:22:53.106497 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:22:53.106497 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:22:53.106497 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 606/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:22:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:22:53.111923 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489aad9-d7ae-4f38-ab29-167297f80a4f None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:53.225124 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489aad9-d7ae-4f38-ab29-167297f80a4f None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:53.262035 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0cef3-16ab-42c1-8d81-c662932cadf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:53.262714 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0cef3-16ab-42c1-8d81-c662932cadf1 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:53.263004 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0cef3-16ab-42c1-8d81-c662932cadf1 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:53.263284 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0cef3-16ab-42c1-8d81-c662932cadf1 None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:53.264140 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0cef3-16ab-42c1-8d81-c662932cadf1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:22:53.264453 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0cef3-16ab-42c1-8d81-c662932cadf1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:53.266480 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0cef3-16ab-42c1-8d81-c662932cadf1 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:53.284579 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 621/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 9 15:22:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:22:53.290402 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c30e5-3d19-43c3-a39a-167257b111e7 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:53.402273 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c30e5-3d19-43c3-a39a-167257b111e7 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:53.441866 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08f1a6-76c5-4720-a629-4736459212de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:53.442728 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08f1a6-76c5-4720-a629-4736459212de None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:53.443046 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08f1a6-76c5-4720-a629-4736459212de None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:53.443346 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08f1a6-76c5-4720-a629-4736459212de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:53.456039 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08f1a6-76c5-4720-a629-4736459212de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:53.457548 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08f1a6-76c5-4720-a629-4736459212de None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:53.477332 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-fb08f1a6-76c5-4720-a629-4736459212de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:22:53.477332 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:22:53.477332 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:22:53.477332 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:22:53.477332 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:22:53.477332 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:22:53.477332 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:22:53.477332 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:22:53.477332 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:22:53.477332 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:22:53.477332 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:22:53.477332 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:22:53.477332 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:22:53.477332 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:22:53.477332 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:22:53.478532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:22:53.478532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:22:53.478532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:22:53.478532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:22:53.478532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:22:53.478532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:22:53.478532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:22:53.478532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:22:53.478532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:22:53.478532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:22:53.478532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:22:53.478532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:22:53.478532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:22:53.478532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:22:53.478532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:22:53.478532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:22:53.478532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:22:53.479558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:22:53.479558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:22:53.479558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:22:53.479558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:22:53.479558 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 607/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:22:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:22:53.484357 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0cef3-16ab-42c1-8d81-c662932cadf1 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:53.591327 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0cef3-16ab-42c1-8d81-c662932cadf1 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:53.633714 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc18916-250e-4532-b4b1-02f3c7b3084e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:53.634524 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc18916-250e-4532-b4b1-02f3c7b3084e None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:53.634838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc18916-250e-4532-b4b1-02f3c7b3084e None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:53.635126 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc18916-250e-4532-b4b1-02f3c7b3084e None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:53.635923 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc18916-250e-4532-b4b1-02f3c7b3084e None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:22:53.636260 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc18916-250e-4532-b4b1-02f3c7b3084e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:53.637819 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc18916-250e-4532-b4b1-02f3c7b3084e None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:53.649768 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 622/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:22:53.655895 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08f1a6-76c5-4720-a629-4736459212de None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:53.774741 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08f1a6-76c5-4720-a629-4736459212de None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:53.813461 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79878489-03f5-4e2c-9bbd-abe837a19e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:53.814295 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79878489-03f5-4e2c-9bbd-abe837a19e81 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:53.814580 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79878489-03f5-4e2c-9bbd-abe837a19e81 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:53.814845 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79878489-03f5-4e2c-9bbd-abe837a19e81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:53.821827 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79878489-03f5-4e2c-9bbd-abe837a19e81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:53.823329 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79878489-03f5-4e2c-9bbd-abe837a19e81 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:53.838760 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-79878489-03f5-4e2c-9bbd-abe837a19e81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:22:53.838760 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:22:53.838760 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:22:53.838760 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:22:53.838760 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:22:53.838760 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:22:53.838760 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:22:53.838760 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:22:53.838760 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:22:53.838760 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:22:53.838760 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:22:53.838760 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:22:53.838760 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:22:53.838760 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:22:53.838760 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:22:53.840708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:22:53.840708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:22:53.840708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:22:53.840708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:22:53.840708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:22:53.840708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:22:53.840708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:22:53.840708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:22:53.840708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:22:53.840708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:22:53.840708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:22:53.840708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:22:53.840708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:22:53.840708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:22:53.840708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:22:53.840708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:22:53.840708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:22:53.841872 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:22:53.841872 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:22:53.841872 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:22:53.841872 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:22:53.841872 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:22:53.841872 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:22:53.841872 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:22:53.841872 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:22:53.841872 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 608/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:22:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:22:53.846752 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc18916-250e-4532-b4b1-02f3c7b3084e None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:53.956627 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc18916-250e-4532-b4b1-02f3c7b3084e None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:53.991338 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7304bf-2911-40d4-9081-14db0937f499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:53.992172 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7304bf-2911-40d4-9081-14db0937f499 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:53.992460 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7304bf-2911-40d4-9081-14db0937f499 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:53.992821 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7304bf-2911-40d4-9081-14db0937f499 None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:53.993761 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7304bf-2911-40d4-9081-14db0937f499 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:22:53.994079 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7304bf-2911-40d4-9081-14db0937f499 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:53.996072 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7304bf-2911-40d4-9081-14db0937f499 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:54.010363 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 623/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:22:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:22:54.017018 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79878489-03f5-4e2c-9bbd-abe837a19e81 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:54.131860 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79878489-03f5-4e2c-9bbd-abe837a19e81 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:54.167070 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207e081-9966-4546-90ad-c7567f4b1d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:54.168084 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207e081-9966-4546-90ad-c7567f4b1d1b None admin] REQUEST_METHOD: `PUT` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:54.168472 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207e081-9966-4546-90ad-c7567f4b1d1b None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:54.168693 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207e081-9966-4546-90ad-c7567f4b1d1b None admin] PATH_INFO: `/v3/projects/eb2de9bea1cf451db5f8c697f480c480/users/acd06b5fad24414abc8c2e5c209ce867/roles/7d8a1698372145a59d70d67ed7867f56` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:54.186412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b207e081-9966-4546-90ad-c7567f4b1d1b None admin] RBAC: Authorizing `identity:create_grant(project_id=eb2de9bea1cf451db5f8c697f480c480, user_id=acd06b5fad24414abc8c2e5c209ce867, role_id=7d8a1698372145a59d70d67ed7867f56)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:54.188126 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b207e081-9966-4546-90ad-c7567f4b1d1b None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:54.209757 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 609/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:22:54 2022] PUT /identity/v3/projects/eb2de9bea1cf451db5f8c697f480c480/users/acd06b5fad24414abc8c2e5c209ce867/roles/7d8a1698372145a59d70d67ed7867f56 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:22:56.678613 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46644312-a738-4e9e-ba6c-927496a77d41 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:56.679145 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46644312-a738-4e9e-ba6c-927496a77d41 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:56.679264 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46644312-a738-4e9e-ba6c-927496a77d41 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:56.680965 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 624/1233] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:22:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:22:56.687224 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72306c72-2473-40f5-8662-ea6e60d58606 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:56.687712 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72306c72-2473-40f5-8662-ea6e60d58606 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:56.687810 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72306c72-2473-40f5-8662-ea6e60d58606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:56.707694 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-72306c72-2473-40f5-8662-ea6e60d58606 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:22:56.709249 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-72306c72-2473-40f5-8662-ea6e60d58606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:22:56.784208 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 610/1234] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:22:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:22:56.809233 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46644312-a738-4e9e-ba6c-927496a77d41 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:56.936304 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46644312-a738-4e9e-ba6c-927496a77d41 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:56.976439 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f70105-ca03-4c3e-8612-a654e9adfe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:56.977401 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f70105-ca03-4c3e-8612-a654e9adfe55 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:56.977692 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f70105-ca03-4c3e-8612-a654e9adfe55 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:56.977976 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f70105-ca03-4c3e-8612-a654e9adfe55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:56.989731 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f70105-ca03-4c3e-8612-a654e9adfe55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:22:56.997874 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-e1f70105-ca03-4c3e-8612-a654e9adfe55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:22:56.997874 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:22:56.997874 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:22:56.997874 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:22:56.997874 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:22:56.997874 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:22:56.997874 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:22:56.997874 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:22:56.997874 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:22:56.997874 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:22:56.997874 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:22:56.997874 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:22:56.997874 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:22:56.997874 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:22:56.997874 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:22:56.997874 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:22:56.998969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:22:56.998969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:22:56.998969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:22:56.998969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:22:56.998969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:22:56.998969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:22:56.998969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:22:56.998969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:22:56.998969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:22:56.998969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:22:56.998969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:22:56.998969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:22:56.998969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:22:56.998969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:22:56.998969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:22:56.998969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:22:57.005937 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:22:57.005937 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:22:57.005937 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:22:57.005937 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:22:57.005937 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:22:57.005937 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:22:57.005937 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:22:57.005937 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:22:57.005937 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:22:57.005937 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:22:57.005937 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:22:57.005937 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:22:57.005937 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 625/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:22:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:22:57.006995 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72306c72-2473-40f5-8662-ea6e60d58606 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:57.116694 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72306c72-2473-40f5-8662-ea6e60d58606 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:57.156175 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73621e78-4133-40ce-a787-521f9aaaecef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:57.157108 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73621e78-4133-40ce-a787-521f9aaaecef None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:57.157495 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73621e78-4133-40ce-a787-521f9aaaecef None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:57.157850 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73621e78-4133-40ce-a787-521f9aaaecef None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:57.158683 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73621e78-4133-40ce-a787-521f9aaaecef None admin] RBAC: Adding query filter params (name=service) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:22:57.159069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73621e78-4133-40ce-a787-521f9aaaecef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:57.160543 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73621e78-4133-40ce-a787-521f9aaaecef None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:57.173412 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 611/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:22:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:22:57.176484 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f70105-ca03-4c3e-8612-a654e9adfe55 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:57.293462 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f70105-ca03-4c3e-8612-a654e9adfe55 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:57.332863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af275f-5381-4681-a3a4-3381c93fedce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:57.333854 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af275f-5381-4681-a3a4-3381c93fedce None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:57.334180 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af275f-5381-4681-a3a4-3381c93fedce None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:57.334460 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af275f-5381-4681-a3a4-3381c93fedce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:57.348739 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af275f-5381-4681-a3a4-3381c93fedce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:57.351025 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af275f-5381-4681-a3a4-3381c93fedce None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:57.376787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-c9af275f-5381-4681-a3a4-3381c93fedce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:22:57.376787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:22:57.376787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:22:57.376787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:22:57.376787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:22:57.376787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:22:57.376787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:22:57.376787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:22:57.376787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:22:57.376787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:22:57.376787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:22:57.376787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:22:57.376787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:22:57.376787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:22:57.376787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:22:57.377724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:22:57.377724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:22:57.377724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:22:57.377724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:22:57.377724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:22:57.377724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:22:57.377724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:22:57.377724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:22:57.377724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:22:57.377724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:22:57.377724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:22:57.377724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:22:57.377724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:22:57.377724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:22:57.377724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:22:57.377724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:22:57.377724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:22:57.378914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:22:57.378914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:22:57.378914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:22:57.378914 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:22:57.383862 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 626/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:22:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:22:57.385215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73621e78-4133-40ce-a787-521f9aaaecef None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:57.502216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73621e78-4133-40ce-a787-521f9aaaecef None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:57.544174 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d908a1-c86a-4dbe-9a93-9f2d93471b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:57.544867 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d908a1-c86a-4dbe-9a93-9f2d93471b86 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:57.545155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d908a1-c86a-4dbe-9a93-9f2d93471b86 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:57.545465 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d908a1-c86a-4dbe-9a93-9f2d93471b86 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:57.546776 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d908a1-c86a-4dbe-9a93-9f2d93471b86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:22:57.547088 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d908a1-c86a-4dbe-9a93-9f2d93471b86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:57.548525 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d908a1-c86a-4dbe-9a93-9f2d93471b86 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:57.562908 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 612/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:22:57.568834 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af275f-5381-4681-a3a4-3381c93fedce None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:57.698732 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af275f-5381-4681-a3a4-3381c93fedce None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:57.743259 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5ad9f-8209-44dc-b023-63eae39e6c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:57.744468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5ad9f-8209-44dc-b023-63eae39e6c9d None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:57.744863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5ad9f-8209-44dc-b023-63eae39e6c9d None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:57.745207 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5ad9f-8209-44dc-b023-63eae39e6c9d None admin] PATH_INFO: `/v3/users/placement` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:57.756624 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5ad9f-8209-44dc-b023-63eae39e6c9d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:57.758358 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5ad9f-8209-44dc-b023-63eae39e6c9d None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:57.779308 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-9cd5ad9f-8209-44dc-b023-63eae39e6c9d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:22:57.779308 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:22:57.779308 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:22:57.779308 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:22:57.779308 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:22:57.779308 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:22:57.779308 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:22:57.779308 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:22:57.779308 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:22:57.779308 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:22:57.779308 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:22:57.779308 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:22:57.779308 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:22:57.779308 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:22:57.779308 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:22:57.779308 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:22:57.780850 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:22:57.780850 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:22:57.780850 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:22:57.780850 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:22:57.780850 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:22:57.780850 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:22:57.780850 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:22:57.780850 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:22:57.780850 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:22:57.780850 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:22:57.780850 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:22:57.780850 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:22:57.780850 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:22:57.780850 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:22:57.780850 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:22:57.780850 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:22:57.780850 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:22:57.780850 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:22:57.782031 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:22:57.782031 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:22:57.782031 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:22:57.782031 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:22:57.782031 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:22:57.782031 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:22:57.782031 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:22:57.782031 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:22:57.782031 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:22:57.782031 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:22:57.782031 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 627/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:22:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:22:57.789086 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d908a1-c86a-4dbe-9a93-9f2d93471b86 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:57.907944 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d908a1-c86a-4dbe-9a93-9f2d93471b86 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:57.948638 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd25e82-d437-4d40-822e-161038bb9318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:57.949284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd25e82-d437-4d40-822e-161038bb9318 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:57.949587 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd25e82-d437-4d40-822e-161038bb9318 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:57.949934 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd25e82-d437-4d40-822e-161038bb9318 None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:57.950945 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd25e82-d437-4d40-822e-161038bb9318 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:22:57.951287 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd25e82-d437-4d40-822e-161038bb9318 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:57.953568 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd25e82-d437-4d40-822e-161038bb9318 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:57.973123 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 613/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 9 15:22:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:22:57.979587 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5ad9f-8209-44dc-b023-63eae39e6c9d None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:58.093543 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5ad9f-8209-44dc-b023-63eae39e6c9d None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:58.131680 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba027571-6ba5-4196-868e-3d55c27fb255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:58.134230 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba027571-6ba5-4196-868e-3d55c27fb255 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:58.134230 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba027571-6ba5-4196-868e-3d55c27fb255 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:58.134230 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba027571-6ba5-4196-868e-3d55c27fb255 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:58.214236 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba027571-6ba5-4196-868e-3d55c27fb255 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:58.214236 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba027571-6ba5-4196-868e-3d55c27fb255 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:58.340386 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 628/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:22:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:22:58.346868 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd25e82-d437-4d40-822e-161038bb9318 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:58.456507 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd25e82-d437-4d40-822e-161038bb9318 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:58.492343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f277fc6-a850-4e97-8909-ab8cebe5434b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:58.494994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f277fc6-a850-4e97-8909-ab8cebe5434b None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:58.494994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f277fc6-a850-4e97-8909-ab8cebe5434b None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:58.494994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f277fc6-a850-4e97-8909-ab8cebe5434b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:58.504856 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f277fc6-a850-4e97-8909-ab8cebe5434b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:58.506347 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f277fc6-a850-4e97-8909-ab8cebe5434b None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:58.525672 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-9f277fc6-a850-4e97-8909-ab8cebe5434b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:22:58.525672 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:22:58.525672 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:22:58.525672 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:22:58.525672 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:22:58.525672 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:22:58.525672 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:22:58.525672 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:22:58.525672 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:22:58.525672 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:22:58.525672 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:22:58.525672 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:22:58.525672 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:22:58.525672 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:22:58.525672 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:22:58.526933 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:22:58.526933 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:22:58.526933 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:22:58.526933 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:22:58.526933 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:22:58.526933 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:22:58.526933 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:22:58.526933 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:22:58.526933 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:22:58.526933 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:22:58.526933 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:22:58.526933 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:22:58.526933 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:22:58.526933 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:22:58.526933 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:22:58.526933 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:22:58.526933 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:22:58.527828 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:22:58.527828 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:22:58.527828 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:22:58.527828 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:22:58.527828 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 614/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:22:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:22:58.534132 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba027571-6ba5-4196-868e-3d55c27fb255 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:58.646832 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba027571-6ba5-4196-868e-3d55c27fb255 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:58.684159 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42061394-ae26-4510-b35d-0a45fcb3aeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:58.684842 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42061394-ae26-4510-b35d-0a45fcb3aeb9 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:58.685160 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42061394-ae26-4510-b35d-0a45fcb3aeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:58.685533 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42061394-ae26-4510-b35d-0a45fcb3aeb9 None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:58.686220 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42061394-ae26-4510-b35d-0a45fcb3aeb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:22:58.686718 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42061394-ae26-4510-b35d-0a45fcb3aeb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:58.688562 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42061394-ae26-4510-b35d-0a45fcb3aeb9 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:58.701521 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 629/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:22:58.709025 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f277fc6-a850-4e97-8909-ab8cebe5434b None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:58.824300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f277fc6-a850-4e97-8909-ab8cebe5434b None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:58.863202 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e6fc8-ce00-461f-b32f-cbf145dd45ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:58.864026 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e6fc8-ce00-461f-b32f-cbf145dd45ad None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:58.864286 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e6fc8-ce00-461f-b32f-cbf145dd45ad None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:58.864618 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e6fc8-ce00-461f-b32f-cbf145dd45ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:58.872921 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e6fc8-ce00-461f-b32f-cbf145dd45ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:58.875602 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e6fc8-ce00-461f-b32f-cbf145dd45ad None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:58.892058 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-8c4e6fc8-ce00-461f-b32f-cbf145dd45ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:22:58.892058 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:22:58.892058 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:22:58.892058 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:22:58.892058 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:22:58.892058 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:22:58.892058 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:22:58.892058 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:22:58.892058 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:22:58.892058 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:22:58.892058 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:22:58.892058 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:22:58.892058 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:22:58.892058 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:22:58.892058 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:22:58.893158 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:22:58.893158 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:22:58.893158 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:22:58.893158 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:22:58.893158 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:22:58.893158 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:22:58.893158 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:22:58.893158 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:22:58.893158 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:22:58.893158 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:22:58.893158 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:22:58.893158 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:22:58.893158 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:22:58.893158 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:22:58.893158 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:22:58.893158 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:22:58.893158 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:22:58.894222 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:22:58.894222 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:22:58.894222 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:22:58.894222 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:22:58.894222 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:22:58.894222 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:22:58.894222 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:22:58.894222 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:22:58.894222 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 615/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:22:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:22:58.900436 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42061394-ae26-4510-b35d-0a45fcb3aeb9 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:59.021860 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42061394-ae26-4510-b35d-0a45fcb3aeb9 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:59.062471 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52946c0d-be34-4fa7-891c-49ade4199470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:59.063229 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52946c0d-be34-4fa7-891c-49ade4199470 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:59.063521 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52946c0d-be34-4fa7-891c-49ade4199470 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:59.063822 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52946c0d-be34-4fa7-891c-49ade4199470 None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:59.064624 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52946c0d-be34-4fa7-891c-49ade4199470 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:22:59.064899 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52946c0d-be34-4fa7-891c-49ade4199470 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:59.066520 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52946c0d-be34-4fa7-891c-49ade4199470 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:59.080059 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 630/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:22:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:22:59.086062 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e6fc8-ce00-461f-b32f-cbf145dd45ad None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:22:59.210094 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e6fc8-ce00-461f-b32f-cbf145dd45ad None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:22:59.253629 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c5328-98b0-413c-9739-4533cad1b3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:22:59.254301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c5328-98b0-413c-9739-4533cad1b3f2 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:22:59.254604 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c5328-98b0-413c-9739-4533cad1b3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:22:59.254869 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c5328-98b0-413c-9739-4533cad1b3f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:22:59.255716 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c5328-98b0-413c-9739-4533cad1b3f2 None admin] RBAC: Adding query filter params (role.id=7d8a1698372145a59d70d67ed7867f56, scope.project.id=eb2de9bea1cf451db5f8c697f480c480, user.id=acd06b5fad24414abc8c2e5c209ce867) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:22:59.256034 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c5328-98b0-413c-9739-4533cad1b3f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:22:59.257501 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c5328-98b0-413c-9739-4533cad1b3f2 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:22:59.266921 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 616/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:22:59 2022] GET /identity/v3/role_assignments?user.id=acd06b5fad24414abc8c2e5c209ce867&scope.project.id=eb2de9bea1cf451db5f8c697f480c480&role.id=7d8a1698372145a59d70d67ed7867f56 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:23:01.670636 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a47331-4624-4710-b462-8ac9112ea928 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:01.672080 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a47331-4624-4710-b462-8ac9112ea928 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:01.672468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a47331-4624-4710-b462-8ac9112ea928 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:01.674455 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 631/1247] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:23:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:23:01.681586 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443843b-c92c-48eb-95a1-c2e8095e1928 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:01.682173 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443843b-c92c-48eb-95a1-c2e8095e1928 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:01.682456 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443843b-c92c-48eb-95a1-c2e8095e1928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:01.703315 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-9443843b-c92c-48eb-95a1-c2e8095e1928 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:23:01.704657 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-9443843b-c92c-48eb-95a1-c2e8095e1928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:23:01.788169 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 617/1248] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:23:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:23:01.816441 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a47331-4624-4710-b462-8ac9112ea928 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:01.937587 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a47331-4624-4710-b462-8ac9112ea928 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:01.975315 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125445d2-0c78-42cf-8a7a-4d3c5fba3859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:01.976158 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125445d2-0c78-42cf-8a7a-4d3c5fba3859 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:01.976478 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125445d2-0c78-42cf-8a7a-4d3c5fba3859 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:01.976884 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125445d2-0c78-42cf-8a7a-4d3c5fba3859 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:01.989581 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125445d2-0c78-42cf-8a7a-4d3c5fba3859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:23:01.998505 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-125445d2-0c78-42cf-8a7a-4d3c5fba3859 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:23:01.998505 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:23:01.998505 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:23:01.998505 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:23:01.998505 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:23:01.998505 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:23:01.998505 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:23:01.998505 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:23:01.998505 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:23:01.998505 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:23:01.998505 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:23:01.998505 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:23:01.998505 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:23:01.998505 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:23:01.998505 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:23:01.998505 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:23:02.000410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:23:02.000410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:23:02.000410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:23:02.000410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:23:02.000410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:23:02.000410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:23:02.000410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:23:02.000410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:23:02.000410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:23:02.000410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:23:02.000410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:23:02.000410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:23:02.000410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:23:02.000410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:23:02.000410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:23:02.000410 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:23:02.001341 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:23:02.001341 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:23:02.001341 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:23:02.001341 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:23:02.001341 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:23:02.001341 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:23:02.001341 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:23:02.001341 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:23:02.001341 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:23:02.001341 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:23:02.001341 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:23:02.001341 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:23:02.001341 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 632/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:23:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:23:02.007791 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443843b-c92c-48eb-95a1-c2e8095e1928 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:02.117804 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443843b-c92c-48eb-95a1-c2e8095e1928 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:02.155686 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386f2be-9720-46bd-aa05-1babc9c7103b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:02.156575 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386f2be-9720-46bd-aa05-1babc9c7103b None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:02.156884 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386f2be-9720-46bd-aa05-1babc9c7103b None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:02.157241 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386f2be-9720-46bd-aa05-1babc9c7103b None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:02.158174 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386f2be-9720-46bd-aa05-1babc9c7103b None admin] RBAC: Adding query filter params (name=admin) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:23:02.158527 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386f2be-9720-46bd-aa05-1babc9c7103b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:02.160033 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386f2be-9720-46bd-aa05-1babc9c7103b None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:02.170588 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 618/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:23:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:23:02.179009 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125445d2-0c78-42cf-8a7a-4d3c5fba3859 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:02.309302 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125445d2-0c78-42cf-8a7a-4d3c5fba3859 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:02.349041 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f8092-3044-4fe3-a06e-af09d16a750d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:02.349872 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f8092-3044-4fe3-a06e-af09d16a750d None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:02.350166 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f8092-3044-4fe3-a06e-af09d16a750d None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:02.350468 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f8092-3044-4fe3-a06e-af09d16a750d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:02.363883 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f8092-3044-4fe3-a06e-af09d16a750d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:02.365887 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f8092-3044-4fe3-a06e-af09d16a750d None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:02.386472 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-7f5f8092-3044-4fe3-a06e-af09d16a750d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:23:02.386472 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:23:02.386472 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:23:02.386472 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:23:02.386472 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:23:02.386472 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:23:02.386472 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:23:02.386472 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:23:02.386472 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:23:02.386472 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:23:02.386472 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:23:02.386472 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:23:02.386472 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:23:02.386472 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:23:02.386472 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:23:02.387564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:23:02.387564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:23:02.387564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:23:02.387564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:23:02.387564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:23:02.387564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:23:02.387564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:23:02.387564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:23:02.387564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:23:02.387564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:23:02.387564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:23:02.387564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:23:02.387564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:23:02.387564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:23:02.387564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:23:02.387564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:23:02.387564 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:23:02.388620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:23:02.388620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:23:02.388620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:23:02.388620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:23:02.388620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 633/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:23:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:23:02.394644 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386f2be-9720-46bd-aa05-1babc9c7103b None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:02.513467 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386f2be-9720-46bd-aa05-1babc9c7103b None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:02.554571 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bd041-a9b7-419a-b04d-cafb987452da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:02.555304 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bd041-a9b7-419a-b04d-cafb987452da None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:02.555586 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bd041-a9b7-419a-b04d-cafb987452da None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:02.555857 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bd041-a9b7-419a-b04d-cafb987452da None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:02.556595 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bd041-a9b7-419a-b04d-cafb987452da None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:23:02.556895 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bd041-a9b7-419a-b04d-cafb987452da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:02.558313 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bd041-a9b7-419a-b04d-cafb987452da None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:02.572906 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 619/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:23:02.580309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f8092-3044-4fe3-a06e-af09d16a750d None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:02.696039 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f8092-3044-4fe3-a06e-af09d16a750d None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:02.739134 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fc9c8-d845-4e05-b892-d717268b4e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:02.740389 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fc9c8-d845-4e05-b892-d717268b4e81 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:02.740719 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fc9c8-d845-4e05-b892-d717268b4e81 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:02.741070 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fc9c8-d845-4e05-b892-d717268b4e81 None admin] PATH_INFO: `/v3/users/placement` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:02.751666 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fc9c8-d845-4e05-b892-d717268b4e81 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:02.752648 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fc9c8-d845-4e05-b892-d717268b4e81 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:02.769772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-352fc9c8-d845-4e05-b892-d717268b4e81 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:23:02.769772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:23:02.769772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:23:02.769772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:23:02.769772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:23:02.769772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:23:02.769772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:23:02.769772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:23:02.769772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:23:02.769772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:23:02.769772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:23:02.769772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:23:02.769772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:23:02.769772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:23:02.769772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:23:02.769772 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:23:02.773291 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:23:02.773291 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:23:02.773291 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:23:02.773291 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:23:02.773291 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:23:02.773291 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:23:02.773291 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:23:02.773291 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:23:02.773291 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:23:02.773291 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:23:02.773291 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:23:02.773291 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:23:02.773291 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:23:02.773291 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:23:02.773291 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:23:02.773291 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:23:02.773291 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:23:02.773291 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:23:02.774225 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:23:02.774225 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:23:02.774225 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:23:02.774225 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:23:02.774225 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:23:02.774225 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:23:02.774225 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:23:02.774225 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:23:02.774225 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:23:02.774225 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:23:02.774225 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 634/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:23:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:23:02.777451 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bd041-a9b7-419a-b04d-cafb987452da None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:02.903930 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bd041-a9b7-419a-b04d-cafb987452da None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:02.942704 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc005c7-95a2-46bb-bf95-b8f7383dddd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:02.943390 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc005c7-95a2-46bb-bf95-b8f7383dddd1 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:02.943772 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc005c7-95a2-46bb-bf95-b8f7383dddd1 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:02.943959 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc005c7-95a2-46bb-bf95-b8f7383dddd1 None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:02.944950 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc005c7-95a2-46bb-bf95-b8f7383dddd1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:23:02.945286 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc005c7-95a2-46bb-bf95-b8f7383dddd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:02.946910 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc005c7-95a2-46bb-bf95-b8f7383dddd1 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:02.972048 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 620/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 9 15:23:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:23:02.973479 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fc9c8-d845-4e05-b892-d717268b4e81 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:03.101096 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fc9c8-d845-4e05-b892-d717268b4e81 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:03.144870 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c0cd5-4b3c-465b-bef9-380829df385d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:03.145643 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c0cd5-4b3c-465b-bef9-380829df385d None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:03.145949 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c0cd5-4b3c-465b-bef9-380829df385d None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:03.146258 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c0cd5-4b3c-465b-bef9-380829df385d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:03.229893 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c0cd5-4b3c-465b-bef9-380829df385d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:03.231275 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c0cd5-4b3c-465b-bef9-380829df385d None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:03.351542 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 635/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:23:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:23:03.357776 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc005c7-95a2-46bb-bf95-b8f7383dddd1 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:03.471651 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc005c7-95a2-46bb-bf95-b8f7383dddd1 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:03.513648 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546edb51-bc61-4dc5-8a29-b494f98ff202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:03.514364 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546edb51-bc61-4dc5-8a29-b494f98ff202 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:03.514851 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546edb51-bc61-4dc5-8a29-b494f98ff202 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:03.515142 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546edb51-bc61-4dc5-8a29-b494f98ff202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:03.526550 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546edb51-bc61-4dc5-8a29-b494f98ff202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:03.528133 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546edb51-bc61-4dc5-8a29-b494f98ff202 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:03.551422 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-546edb51-bc61-4dc5-8a29-b494f98ff202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:23:03.551422 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:23:03.551422 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:23:03.551422 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:23:03.551422 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:23:03.551422 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:23:03.551422 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:23:03.551422 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:23:03.551422 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:23:03.551422 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:23:03.551422 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:23:03.551422 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:23:03.551422 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:23:03.551422 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:23:03.551422 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:23:03.552688 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:23:03.552688 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:23:03.552688 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:23:03.552688 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:23:03.552688 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:23:03.552688 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:23:03.552688 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:23:03.552688 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:23:03.552688 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:23:03.552688 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:23:03.552688 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:23:03.552688 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:23:03.552688 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:23:03.552688 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:23:03.552688 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:23:03.552688 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:23:03.552688 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:23:03.553873 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:23:03.553873 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:23:03.553873 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:23:03.553873 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:23:03.553873 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 621/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:23:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:23:03.557160 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c0cd5-4b3c-465b-bef9-380829df385d None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:03.675195 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c0cd5-4b3c-465b-bef9-380829df385d None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:03.724502 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cde043-d1b5-494c-b064-53ba7f50bdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:03.725192 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cde043-d1b5-494c-b064-53ba7f50bdef None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:03.725495 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cde043-d1b5-494c-b064-53ba7f50bdef None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:03.725777 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cde043-d1b5-494c-b064-53ba7f50bdef None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:03.726516 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cde043-d1b5-494c-b064-53ba7f50bdef None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:23:03.726827 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cde043-d1b5-494c-b064-53ba7f50bdef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:03.728472 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cde043-d1b5-494c-b064-53ba7f50bdef None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:03.741449 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 636/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:23:03.747495 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546edb51-bc61-4dc5-8a29-b494f98ff202 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:03.864515 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546edb51-bc61-4dc5-8a29-b494f98ff202 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:03.905326 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683c68f-ccbb-47a3-8d0f-68d139461442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:03.906155 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683c68f-ccbb-47a3-8d0f-68d139461442 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:03.906432 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683c68f-ccbb-47a3-8d0f-68d139461442 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:03.906714 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683c68f-ccbb-47a3-8d0f-68d139461442 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:03.914411 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683c68f-ccbb-47a3-8d0f-68d139461442 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:03.916095 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683c68f-ccbb-47a3-8d0f-68d139461442 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:03.931929 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-3683c68f-ccbb-47a3-8d0f-68d139461442 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:23:03.931929 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:23:03.931929 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:23:03.931929 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:23:03.931929 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:23:03.931929 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:23:03.931929 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:23:03.931929 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:23:03.931929 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:23:03.931929 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:23:03.931929 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:23:03.931929 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:23:03.931929 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:23:03.931929 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:23:03.931929 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:23:03.933069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:23:03.933069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:23:03.933069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:23:03.933069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:23:03.933069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:23:03.933069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:23:03.933069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:23:03.933069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:23:03.933069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:23:03.933069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:23:03.933069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:23:03.933069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:23:03.933069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:23:03.933069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:23:03.933069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:23:03.933069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:23:03.933069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:23:03.934012 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:23:03.934012 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:23:03.934012 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:23:03.934012 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:23:03.934012 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:23:03.934012 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:23:03.934012 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:23:03.934012 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:23:03.934012 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 622/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:23:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:23:03.940436 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cde043-d1b5-494c-b064-53ba7f50bdef None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:04.082894 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cde043-d1b5-494c-b064-53ba7f50bdef None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:04.121768 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf08003-f61c-4a27-8d78-c958b3546e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:04.122455 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf08003-f61c-4a27-8d78-c958b3546e7d None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:04.122756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf08003-f61c-4a27-8d78-c958b3546e7d None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:04.123042 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf08003-f61c-4a27-8d78-c958b3546e7d None admin] PATH_INFO: `/v3/projects` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:04.123982 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf08003-f61c-4a27-8d78-c958b3546e7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:23:04.124903 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf08003-f61c-4a27-8d78-c958b3546e7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:04.126802 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf08003-f61c-4a27-8d78-c958b3546e7d None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:04.141233 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 637/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:23:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:23:04.147375 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683c68f-ccbb-47a3-8d0f-68d139461442 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:04.259492 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683c68f-ccbb-47a3-8d0f-68d139461442 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:04.297961 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78367026-6583-4dc0-b68e-2cf4c4b002c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:04.299255 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78367026-6583-4dc0-b68e-2cf4c4b002c0 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:04.299605 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78367026-6583-4dc0-b68e-2cf4c4b002c0 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:04.299883 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78367026-6583-4dc0-b68e-2cf4c4b002c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:04.300815 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78367026-6583-4dc0-b68e-2cf4c4b002c0 None admin] RBAC: Adding query filter params (role.id=9aaa841361294b9c9b275ca1be0ed89c, scope.project.id=eb2de9bea1cf451db5f8c697f480c480, user.id=acd06b5fad24414abc8c2e5c209ce867) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:23:04.301136 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78367026-6583-4dc0-b68e-2cf4c4b002c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:04.302746 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78367026-6583-4dc0-b68e-2cf4c4b002c0 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:04.309156 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 623/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:23:04 2022] GET /identity/v3/role_assignments?user.id=acd06b5fad24414abc8c2e5c209ce867&scope.project.id=eb2de9bea1cf451db5f8c697f480c480&role.id=9aaa841361294b9c9b275ca1be0ed89c => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:23:06.636771 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1f028-73ae-48bd-b5c3-af0d60c7f3b5 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:06.637319 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1f028-73ae-48bd-b5c3-af0d60c7f3b5 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:06.637319 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1f028-73ae-48bd-b5c3-af0d60c7f3b5 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:06.638757 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 638/1261] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:23:06.644925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283aa101-8ff8-47d7-8cb6-653ab6accc78 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:06.645488 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283aa101-8ff8-47d7-8cb6-653ab6accc78 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:06.645586 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283aa101-8ff8-47d7-8cb6-653ab6accc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:06.663513 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-283aa101-8ff8-47d7-8cb6-653ab6accc78 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:23:06.664746 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-283aa101-8ff8-47d7-8cb6-653ab6accc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:23:06.732338 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 624/1262] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:23:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:23:06.755744 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1f028-73ae-48bd-b5c3-af0d60c7f3b5 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:06.857728 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1f028-73ae-48bd-b5c3-af0d60c7f3b5 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:06.893398 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236a16f-b701-4ab8-a80e-228888286edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:06.894230 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236a16f-b701-4ab8-a80e-228888286edd None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:06.894511 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236a16f-b701-4ab8-a80e-228888286edd None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:06.894783 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236a16f-b701-4ab8-a80e-228888286edd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:06.906194 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236a16f-b701-4ab8-a80e-228888286edd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:23:06.913839 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-0236a16f-b701-4ab8-a80e-228888286edd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:23:06.913839 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:23:06.913839 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:23:06.913839 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:23:06.913839 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:23:06.913839 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:23:06.913839 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:23:06.913839 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:23:06.913839 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:23:06.913839 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:23:06.913839 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:23:06.913839 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:23:06.913839 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:23:06.913839 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:23:06.913839 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:23:06.913839 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:23:06.914942 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:23:06.914942 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:23:06.914942 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:23:06.914942 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:23:06.914942 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:23:06.914942 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:23:06.914942 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:23:06.914942 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:23:06.914942 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:23:06.914942 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:23:06.914942 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:23:06.914942 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:23:06.914942 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:23:06.914942 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:23:06.914942 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:23:06.914942 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:23:06.921504 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:23:06.921504 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:23:06.921504 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:23:06.921504 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:23:06.921504 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:23:06.921504 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:23:06.921504 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:23:06.921504 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:23:06.921504 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:23:06.921504 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:23:06.921504 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:23:06.921504 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:23:06.921504 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 639/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:23:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:23:06.922467 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283aa101-8ff8-47d7-8cb6-653ab6accc78 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:07.020476 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283aa101-8ff8-47d7-8cb6-653ab6accc78 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:07.056639 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ead8e-b292-42f3-9092-d690e88f2671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:07.057317 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ead8e-b292-42f3-9092-d690e88f2671 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:07.057638 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ead8e-b292-42f3-9092-d690e88f2671 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:07.057922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ead8e-b292-42f3-9092-d690e88f2671 None admin] PATH_INFO: `/v3/roles` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:07.058680 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ead8e-b292-42f3-9092-d690e88f2671 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:23:07.058994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ead8e-b292-42f3-9092-d690e88f2671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:07.060369 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ead8e-b292-42f3-9092-d690e88f2671 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:07.068781 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 625/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:23:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:23:07.074808 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236a16f-b701-4ab8-a80e-228888286edd None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:07.179169 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236a16f-b701-4ab8-a80e-228888286edd None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:07.225679 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cd30c-e9ef-4db1-8bff-db5e9696de13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:07.226616 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cd30c-e9ef-4db1-8bff-db5e9696de13 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:07.226991 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cd30c-e9ef-4db1-8bff-db5e9696de13 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:07.227349 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cd30c-e9ef-4db1-8bff-db5e9696de13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:07.239008 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796cd30c-e9ef-4db1-8bff-db5e9696de13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:07.240710 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796cd30c-e9ef-4db1-8bff-db5e9696de13 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:07.257588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-796cd30c-e9ef-4db1-8bff-db5e9696de13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:23:07.257588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:23:07.257588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:23:07.257588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:23:07.257588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:23:07.257588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:23:07.257588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:23:07.257588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:23:07.257588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:23:07.257588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:23:07.257588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:23:07.257588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:23:07.257588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:23:07.257588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:23:07.257588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:23:07.259309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:23:07.259309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:23:07.259309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:23:07.259309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:23:07.259309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:23:07.259309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:23:07.259309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:23:07.259309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:23:07.259309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:23:07.259309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:23:07.259309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:23:07.259309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:23:07.259309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:23:07.259309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:23:07.259309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:23:07.259309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:23:07.259309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:23:07.261610 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:23:07.261610 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:23:07.261610 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:23:07.261610 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:23:07.261610 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 640/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:23:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:23:07.266652 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ead8e-b292-42f3-9092-d690e88f2671 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:07.365198 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ead8e-b292-42f3-9092-d690e88f2671 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:07.399012 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd024f92-abc5-442f-a3d5-aa6caa323197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:07.399689 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd024f92-abc5-442f-a3d5-aa6caa323197 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:07.399976 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd024f92-abc5-442f-a3d5-aa6caa323197 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:07.400258 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd024f92-abc5-442f-a3d5-aa6caa323197 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:07.400994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd024f92-abc5-442f-a3d5-aa6caa323197 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:23:07.401308 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd024f92-abc5-442f-a3d5-aa6caa323197 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:07.402712 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd024f92-abc5-442f-a3d5-aa6caa323197 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:07.415677 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 626/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:23:07.422659 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cd30c-e9ef-4db1-8bff-db5e9696de13 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:07.525357 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cd30c-e9ef-4db1-8bff-db5e9696de13 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:07.560323 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15470a7d-fd53-4c4a-ad6f-727dd8fa0dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:07.561185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15470a7d-fd53-4c4a-ad6f-727dd8fa0dbf None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:07.562019 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15470a7d-fd53-4c4a-ad6f-727dd8fa0dbf None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:07.562323 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15470a7d-fd53-4c4a-ad6f-727dd8fa0dbf None admin] PATH_INFO: `/v3/users/placement` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:07.570241 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15470a7d-fd53-4c4a-ad6f-727dd8fa0dbf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:07.571706 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15470a7d-fd53-4c4a-ad6f-727dd8fa0dbf None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:07.586852 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-15470a7d-fd53-4c4a-ad6f-727dd8fa0dbf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:23:07.586852 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:23:07.586852 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:23:07.586852 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:23:07.586852 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:23:07.586852 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:23:07.586852 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:23:07.586852 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:23:07.586852 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:23:07.586852 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:23:07.586852 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:23:07.586852 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:23:07.586852 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:23:07.586852 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:23:07.586852 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:23:07.586852 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:23:07.587968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:23:07.587968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:23:07.587968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:23:07.587968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:23:07.587968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:23:07.587968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:23:07.587968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:23:07.587968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:23:07.587968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:23:07.587968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:23:07.587968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:23:07.587968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:23:07.587968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:23:07.587968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:23:07.587968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:23:07.587968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:23:07.587968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:23:07.587968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:23:07.589083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:23:07.589083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:23:07.589083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:23:07.589083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:23:07.589083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:23:07.589083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:23:07.589083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:23:07.589083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:23:07.589083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:23:07.589083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:23:07.589083 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 641/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:23:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:23:07.594182 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd024f92-abc5-442f-a3d5-aa6caa323197 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:07.695807 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd024f92-abc5-442f-a3d5-aa6caa323197 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:07.728642 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9902fb-33ed-4f58-98f4-750cdee9331b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:07.729398 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9902fb-33ed-4f58-98f4-750cdee9331b None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:07.729737 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9902fb-33ed-4f58-98f4-750cdee9331b None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:07.730084 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9902fb-33ed-4f58-98f4-750cdee9331b None admin] PATH_INFO: `/v3/users` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:07.730994 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9902fb-33ed-4f58-98f4-750cdee9331b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:23:07.731354 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9902fb-33ed-4f58-98f4-750cdee9331b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:07.732895 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9902fb-33ed-4f58-98f4-750cdee9331b None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:07.753013 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 627/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 9 15:23:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:23:07.758819 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15470a7d-fd53-4c4a-ad6f-727dd8fa0dbf None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:07.863382 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15470a7d-fd53-4c4a-ad6f-727dd8fa0dbf None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:07.898375 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fb3b2-6e81-4d5b-941d-dcc36f5e608a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:07.899171 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fb3b2-6e81-4d5b-941d-dcc36f5e608a None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:07.899461 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fb3b2-6e81-4d5b-941d-dcc36f5e608a None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:07.899742 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fb3b2-6e81-4d5b-941d-dcc36f5e608a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:07.910793 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fb3b2-6e81-4d5b-941d-dcc36f5e608a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:07.912247 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fb3b2-6e81-4d5b-941d-dcc36f5e608a None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:07.930154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-668fb3b2-6e81-4d5b-941d-dcc36f5e608a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:23:07.930154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:23:07.930154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:23:07.930154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:23:07.930154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:23:07.930154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:23:07.930154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:23:07.930154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:23:07.930154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:23:07.930154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:23:07.930154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:23:07.930154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:23:07.930154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:23:07.930154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:23:07.930154 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:23:07.931213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:23:07.931213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:23:07.931213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:23:07.931213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:23:07.931213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:23:07.931213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:23:07.931213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:23:07.931213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:23:07.931213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:23:07.931213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:23:07.931213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:23:07.931213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:23:07.931213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:23:07.931213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:23:07.931213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:23:07.931213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:23:07.931213 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:23:07.932453 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:23:07.932453 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:23:07.932453 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:23:07.932453 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:23:07.932453 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 642/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:23:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:23:07.938376 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9902fb-33ed-4f58-98f4-750cdee9331b None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:08.039602 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9902fb-33ed-4f58-98f4-750cdee9331b None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:08.074407 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8db9d2-9c01-45ea-88d6-d1d13c7d7398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:08.075080 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8db9d2-9c01-45ea-88d6-d1d13c7d7398 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:08.075365 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8db9d2-9c01-45ea-88d6-d1d13c7d7398 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:08.075646 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8db9d2-9c01-45ea-88d6-d1d13c7d7398 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:08.076376 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8db9d2-9c01-45ea-88d6-d1d13c7d7398 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:23:08.076682 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8db9d2-9c01-45ea-88d6-d1d13c7d7398 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:08.078659 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8db9d2-9c01-45ea-88d6-d1d13c7d7398 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:08.090072 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 628/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:23:08.096863 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fb3b2-6e81-4d5b-941d-dcc36f5e608a None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:08.209148 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fb3b2-6e81-4d5b-941d-dcc36f5e608a None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:08.246865 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a38f66-2a75-4a97-8107-bc97358181cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:08.247674 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a38f66-2a75-4a97-8107-bc97358181cc None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:08.247969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a38f66-2a75-4a97-8107-bc97358181cc None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:08.248249 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a38f66-2a75-4a97-8107-bc97358181cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:08.255897 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a38f66-2a75-4a97-8107-bc97358181cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:08.257343 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a38f66-2a75-4a97-8107-bc97358181cc None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:08.272246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-e5a38f66-2a75-4a97-8107-bc97358181cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:23:08.272246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:23:08.272246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:23:08.272246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:23:08.272246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:23:08.272246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:23:08.272246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:23:08.272246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:23:08.272246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:23:08.272246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:23:08.272246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:23:08.272246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:23:08.272246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:23:08.272246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:23:08.272246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:23:08.273316 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:23:08.273316 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:23:08.273316 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:23:08.273316 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:23:08.273316 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:23:08.273316 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:23:08.273316 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:23:08.273316 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:23:08.273316 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:23:08.273316 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:23:08.273316 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:23:08.273316 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:23:08.273316 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:23:08.273316 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:23:08.273316 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:23:08.273316 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:23:08.273316 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:23:08.274268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:23:08.274268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:23:08.274268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:23:08.274268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:23:08.274268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:23:08.274268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:23:08.274268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:23:08.274268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:23:08.274268 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 643/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:23:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:23:08.279429 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8db9d2-9c01-45ea-88d6-d1d13c7d7398 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:08.384583 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8db9d2-9c01-45ea-88d6-d1d13c7d7398 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:08.417971 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284201b7-8cf9-4d38-911b-c471313e528a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:08.418636 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284201b7-8cf9-4d38-911b-c471313e528a None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:08.418925 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284201b7-8cf9-4d38-911b-c471313e528a None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:08.419205 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284201b7-8cf9-4d38-911b-c471313e528a None admin] PATH_INFO: `/v3/projects` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:08.420011 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284201b7-8cf9-4d38-911b-c471313e528a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:23:08.420322 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284201b7-8cf9-4d38-911b-c471313e528a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:08.422662 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284201b7-8cf9-4d38-911b-c471313e528a None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:08.434384 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 629/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:23:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:23:08.440752 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a38f66-2a75-4a97-8107-bc97358181cc None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:08.541030 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a38f66-2a75-4a97-8107-bc97358181cc None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:08.574483 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8599936-66c1-4f7f-960e-203210ee1988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:08.575375 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8599936-66c1-4f7f-960e-203210ee1988 None admin] REQUEST_METHOD: `PUT` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:08.575661 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8599936-66c1-4f7f-960e-203210ee1988 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:08.575942 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8599936-66c1-4f7f-960e-203210ee1988 None admin] PATH_INFO: `/v3/projects/eb2de9bea1cf451db5f8c697f480c480/users/acd06b5fad24414abc8c2e5c209ce867/roles/9aaa841361294b9c9b275ca1be0ed89c` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:08.578507 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8599936-66c1-4f7f-960e-203210ee1988 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb2de9bea1cf451db5f8c697f480c480, user_id=acd06b5fad24414abc8c2e5c209ce867, role_id=9aaa841361294b9c9b275ca1be0ed89c)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:08.579941 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8599936-66c1-4f7f-960e-203210ee1988 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:08.593786 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 644/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:23:08 2022] PUT /identity/v3/projects/eb2de9bea1cf451db5f8c697f480c480/users/acd06b5fad24414abc8c2e5c209ce867/roles/9aaa841361294b9c9b275ca1be0ed89c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:23:10.906406 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8414043-fd74-4378-b2a5-6ce41d99bebe None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:10.906938 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8414043-fd74-4378-b2a5-6ce41d99bebe None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:10.906938 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8414043-fd74-4378-b2a5-6ce41d99bebe None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:10.908247 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 630/1274] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:23:10.914127 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4c083-c984-4a86-9266-a6a9580b002f None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:10.914516 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4c083-c984-4a86-9266-a6a9580b002f None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:10.914699 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4c083-c984-4a86-9266-a6a9580b002f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:10.931174 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-64f4c083-c984-4a86-9266-a6a9580b002f None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:23:10.932380 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-64f4c083-c984-4a86-9266-a6a9580b002f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:23:10.998670 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 645/1275] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:23:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:23:11.022954 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8414043-fd74-4378-b2a5-6ce41d99bebe None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:11.120079 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8414043-fd74-4378-b2a5-6ce41d99bebe None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:11.154135 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69280c07-79af-4ed6-8a65-478cfe280a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:11.154918 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69280c07-79af-4ed6-8a65-478cfe280a4c None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:11.155198 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69280c07-79af-4ed6-8a65-478cfe280a4c None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:11.155471 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69280c07-79af-4ed6-8a65-478cfe280a4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:11.165322 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69280c07-79af-4ed6-8a65-478cfe280a4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:23:11.174127 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-69280c07-79af-4ed6-8a65-478cfe280a4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:23:11.174127 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:23:11.174127 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:23:11.174127 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:23:11.174127 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:23:11.174127 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:23:11.174127 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:23:11.174127 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:23:11.174127 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:23:11.174127 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:23:11.174127 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:23:11.174127 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:23:11.174127 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:23:11.174127 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:23:11.174127 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:23:11.174127 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:23:11.175631 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:23:11.175631 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:23:11.175631 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:23:11.175631 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:23:11.175631 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:23:11.175631 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:23:11.175631 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:23:11.175631 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:23:11.175631 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:23:11.175631 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:23:11.175631 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:23:11.175631 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:23:11.175631 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:23:11.175631 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:23:11.175631 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:23:11.175631 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:23:11.176649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:23:11.176649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:23:11.176649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:23:11.176649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:23:11.176649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:23:11.176649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:23:11.176649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:23:11.176649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:23:11.176649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:23:11.176649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:23:11.176649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:23:11.176649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:23:11.176649 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 631/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:23:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:23:11.184594 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4c083-c984-4a86-9266-a6a9580b002f None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:11.287454 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4c083-c984-4a86-9266-a6a9580b002f None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:11.320375 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def21d4-e81e-4b65-8554-62a3b45355b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:11.321037 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def21d4-e81e-4b65-8554-62a3b45355b2 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:11.321321 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def21d4-e81e-4b65-8554-62a3b45355b2 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:11.321630 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def21d4-e81e-4b65-8554-62a3b45355b2 None admin] PATH_INFO: `/v3/roles` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:11.322378 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def21d4-e81e-4b65-8554-62a3b45355b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:23:11.322685 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def21d4-e81e-4b65-8554-62a3b45355b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:11.324066 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def21d4-e81e-4b65-8554-62a3b45355b2 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:11.332557 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 646/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:23:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:23:11.338322 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69280c07-79af-4ed6-8a65-478cfe280a4c None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:11.434933 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69280c07-79af-4ed6-8a65-478cfe280a4c None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:11.477765 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030ede6-ffbc-420a-81d4-e0d6590362d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:11.478562 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030ede6-ffbc-420a-81d4-e0d6590362d8 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:11.478853 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030ede6-ffbc-420a-81d4-e0d6590362d8 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:11.479134 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030ede6-ffbc-420a-81d4-e0d6590362d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:11.490162 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030ede6-ffbc-420a-81d4-e0d6590362d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:11.491608 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030ede6-ffbc-420a-81d4-e0d6590362d8 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:11.508380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-8030ede6-ffbc-420a-81d4-e0d6590362d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:23:11.508380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:23:11.508380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:23:11.508380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:23:11.508380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:23:11.508380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:23:11.508380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:23:11.508380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:23:11.508380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:23:11.508380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:23:11.508380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:23:11.508380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:23:11.508380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:23:11.508380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:23:11.508380 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:23:11.509236 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:23:11.509236 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:23:11.509236 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:23:11.509236 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:23:11.509236 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:23:11.509236 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:23:11.509236 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:23:11.509236 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:23:11.509236 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:23:11.509236 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:23:11.509236 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:23:11.509236 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:23:11.509236 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:23:11.509236 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:23:11.509236 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:23:11.509236 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:23:11.509236 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:23:11.510149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:23:11.510149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:23:11.510149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:23:11.510149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:23:11.510149 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 632/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:23:11.516045 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def21d4-e81e-4b65-8554-62a3b45355b2 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:11.612531 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def21d4-e81e-4b65-8554-62a3b45355b2 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:11.644646 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b49de-2d2f-45f2-bd23-c6615d3690c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:11.645308 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b49de-2d2f-45f2-bd23-c6615d3690c1 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:11.645740 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b49de-2d2f-45f2-bd23-c6615d3690c1 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:11.646022 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b49de-2d2f-45f2-bd23-c6615d3690c1 None admin] PATH_INFO: `/v3/domains` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:11.646749 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b49de-2d2f-45f2-bd23-c6615d3690c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:23:11.647060 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b49de-2d2f-45f2-bd23-c6615d3690c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:11.648420 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b49de-2d2f-45f2-bd23-c6615d3690c1 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:11.659707 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 647/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:23:11.665343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030ede6-ffbc-420a-81d4-e0d6590362d8 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:11.765580 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030ede6-ffbc-420a-81d4-e0d6590362d8 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:11.797719 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdf43d-09ef-4d20-b16c-8a84d9b6dea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:11.798522 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdf43d-09ef-4d20-b16c-8a84d9b6dea5 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:11.798807 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdf43d-09ef-4d20-b16c-8a84d9b6dea5 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:11.799084 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdf43d-09ef-4d20-b16c-8a84d9b6dea5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:11.807103 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cdf43d-09ef-4d20-b16c-8a84d9b6dea5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:11.808556 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cdf43d-09ef-4d20-b16c-8a84d9b6dea5 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:11.823465 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-63cdf43d-09ef-4d20-b16c-8a84d9b6dea5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:23:11.823465 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:23:11.823465 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:23:11.823465 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:23:11.823465 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:23:11.823465 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:23:11.823465 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:23:11.823465 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:23:11.823465 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:23:11.823465 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:23:11.823465 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:23:11.823465 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:23:11.823465 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:23:11.823465 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:23:11.823465 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:23:11.823465 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:23:11.824542 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:23:11.824542 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:23:11.824542 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:23:11.824542 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:23:11.824542 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:23:11.824542 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:23:11.824542 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:23:11.824542 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:23:11.824542 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:23:11.824542 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:23:11.824542 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:23:11.824542 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:23:11.824542 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:23:11.824542 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:23:11.824542 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:23:11.824542 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:23:11.824542 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:23:11.824542 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:23:11.825532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:23:11.825532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:23:11.825532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:23:11.825532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:23:11.825532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:23:11.825532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:23:11.825532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:23:11.825532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:23:11.825532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:23:11.825532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:23:11.825532 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 633/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:23:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:23:11.830516 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b49de-2d2f-45f2-bd23-c6615d3690c1 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:11.926681 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b49de-2d2f-45f2-bd23-c6615d3690c1 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:11.959389 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927cf44-97c4-471f-855b-d12462f15820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:11.960061 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927cf44-97c4-471f-855b-d12462f15820 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:11.960346 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927cf44-97c4-471f-855b-d12462f15820 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:11.960623 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927cf44-97c4-471f-855b-d12462f15820 None admin] PATH_INFO: `/v3/users` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:11.961504 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927cf44-97c4-471f-855b-d12462f15820 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:23:11.961818 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927cf44-97c4-471f-855b-d12462f15820 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:11.963238 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927cf44-97c4-471f-855b-d12462f15820 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:11.980185 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 648/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 9 15:23:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:23:11.986527 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdf43d-09ef-4d20-b16c-8a84d9b6dea5 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:12.079300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdf43d-09ef-4d20-b16c-8a84d9b6dea5 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:12.111346 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733c667-0210-4898-8f1e-c2d22272d37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:12.111987 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733c667-0210-4898-8f1e-c2d22272d37d None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:12.112271 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733c667-0210-4898-8f1e-c2d22272d37d None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:12.112552 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733c667-0210-4898-8f1e-c2d22272d37d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:12.177177 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d733c667-0210-4898-8f1e-c2d22272d37d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:12.178718 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d733c667-0210-4898-8f1e-c2d22272d37d None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:12.274598 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 634/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:23:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:23:12.281262 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927cf44-97c4-471f-855b-d12462f15820 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:12.376510 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927cf44-97c4-471f-855b-d12462f15820 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:12.410095 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac693d-2e69-451c-8fb1-a53ec9b34b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:12.410886 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac693d-2e69-451c-8fb1-a53ec9b34b60 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:12.411172 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac693d-2e69-451c-8fb1-a53ec9b34b60 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:12.411448 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac693d-2e69-451c-8fb1-a53ec9b34b60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:12.421314 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac693d-2e69-451c-8fb1-a53ec9b34b60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:12.422787 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac693d-2e69-451c-8fb1-a53ec9b34b60 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:12.439974 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-52ac693d-2e69-451c-8fb1-a53ec9b34b60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:23:12.439974 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:23:12.439974 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:23:12.439974 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:23:12.439974 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:23:12.439974 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:23:12.439974 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:23:12.439974 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:23:12.439974 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:23:12.439974 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:23:12.439974 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:23:12.439974 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:23:12.439974 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:23:12.439974 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:23:12.439974 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:23:12.440969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:23:12.440969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:23:12.440969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:23:12.440969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:23:12.440969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:23:12.440969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:23:12.440969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:23:12.440969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:23:12.440969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:23:12.440969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:23:12.440969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:23:12.440969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:23:12.440969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:23:12.440969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:23:12.440969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:23:12.440969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:23:12.440969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:23:12.441910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:23:12.441910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:23:12.441910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:23:12.441910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:23:12.441910 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 649/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:23:12.447016 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733c667-0210-4898-8f1e-c2d22272d37d None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:12.549689 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733c667-0210-4898-8f1e-c2d22272d37d None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:12.583390 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6350808-3162-40e1-9a81-4aaf7054d974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:12.584054 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6350808-3162-40e1-9a81-4aaf7054d974 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:12.584343 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6350808-3162-40e1-9a81-4aaf7054d974 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:12.584626 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6350808-3162-40e1-9a81-4aaf7054d974 None admin] PATH_INFO: `/v3/domains` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:12.585354 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6350808-3162-40e1-9a81-4aaf7054d974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:23:12.585695 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6350808-3162-40e1-9a81-4aaf7054d974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:12.587069 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6350808-3162-40e1-9a81-4aaf7054d974 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:12.597863 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 635/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:23:12.603581 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac693d-2e69-451c-8fb1-a53ec9b34b60 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:12.698857 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac693d-2e69-451c-8fb1-a53ec9b34b60 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:12.732324 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d231464-9841-4090-b929-f784fe514754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:12.733198 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d231464-9841-4090-b929-f784fe514754 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:12.733793 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d231464-9841-4090-b929-f784fe514754 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:12.734082 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d231464-9841-4090-b929-f784fe514754 None admin] PATH_INFO: `/v3/projects/service` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:12.740876 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d231464-9841-4090-b929-f784fe514754 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:12.742367 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d231464-9841-4090-b929-f784fe514754 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:12.756553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application [None req-9d231464-9841-4090-b929-f784fe514754 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:23:12.756553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:23:12.756553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:23:12.756553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:23:12.756553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:23:12.756553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:23:12.756553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:23:12.756553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:23:12.756553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:23:12.756553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:23:12.756553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:23:12.756553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:23:12.756553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:23:12.756553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:23:12.756553 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:23:12.757620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:23:12.757620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:23:12.757620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:23:12.757620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:23:12.757620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:23:12.757620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:23:12.757620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:23:12.757620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:23:12.757620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application with Lock( May 09 15:23:12.757620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:23:12.757620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._enter() May 09 15:23:12.757620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:23:12.757620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:23:12.757620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:23:12.757620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.creator() May 09 15:23:12.757620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:23:12.757620 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application created_value = creator( May 09 15:23:12.758563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:23:12.758563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:23:12.758563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:23:12.758563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:23:12.758563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:23:12.758563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:23:12.758563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:23:12.758563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: ERROR keystone.server.flask.application May 09 15:23:12.758563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 650/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:23:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:23:12.763517 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6350808-3162-40e1-9a81-4aaf7054d974 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:12.860031 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6350808-3162-40e1-9a81-4aaf7054d974 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:12.891505 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a4903-e5e7-4fb9-86ca-5dc6fc01536e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:12.892159 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a4903-e5e7-4fb9-86ca-5dc6fc01536e None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:12.892447 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a4903-e5e7-4fb9-86ca-5dc6fc01536e None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:12.892728 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a4903-e5e7-4fb9-86ca-5dc6fc01536e None admin] PATH_INFO: `/v3/projects` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:12.893546 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a4903-e5e7-4fb9-86ca-5dc6fc01536e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:23:12.893861 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a4903-e5e7-4fb9-86ca-5dc6fc01536e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:12.895289 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a4903-e5e7-4fb9-86ca-5dc6fc01536e None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:12.907184 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 636/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:23:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:23:12.913108 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d231464-9841-4090-b929-f784fe514754 None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:13.009658 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d231464-9841-4090-b929-f784fe514754 None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:13.042339 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f5579-dae0-46b2-bf84-530eafe1682f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:13.042980 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f5579-dae0-46b2-bf84-530eafe1682f None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:13.043266 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f5579-dae0-46b2-bf84-530eafe1682f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:13.043544 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f5579-dae0-46b2-bf84-530eafe1682f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:13.044373 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f5579-dae0-46b2-bf84-530eafe1682f None admin] RBAC: Adding query filter params (role.id=9aaa841361294b9c9b275ca1be0ed89c, scope.project.id=eb2de9bea1cf451db5f8c697f480c480, user.id=acd06b5fad24414abc8c2e5c209ce867) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:23:13.044688 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f5579-dae0-46b2-bf84-530eafe1682f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:13.046156 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f5579-dae0-46b2-bf84-530eafe1682f None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:13.051812 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 651/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:23:12 2022] GET /identity/v3/role_assignments?user.id=acd06b5fad24414abc8c2e5c209ce867&scope.project.id=eb2de9bea1cf451db5f8c697f480c480&role.id=9aaa841361294b9c9b275ca1be0ed89c => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:23:15.298812 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfee3a-1bca-4eea-8a9a-1d88bb4b7c99 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:15.299385 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfee3a-1bca-4eea-8a9a-1d88bb4b7c99 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:15.299385 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfee3a-1bca-4eea-8a9a-1d88bb4b7c99 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:15.300771 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 637/1288] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:23:15.306642 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a082cb7-e7cd-458e-b56b-f0888193d43c None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:15.307138 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a082cb7-e7cd-458e-b56b-f0888193d43c None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:15.307231 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a082cb7-e7cd-458e-b56b-f0888193d43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:15.323455 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-3a082cb7-e7cd-458e-b56b-f0888193d43c None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:23:15.324639 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-3a082cb7-e7cd-458e-b56b-f0888193d43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:23:15.387175 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 652/1289] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:23:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:23:15.410026 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfee3a-1bca-4eea-8a9a-1d88bb4b7c99 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:15.505941 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfee3a-1bca-4eea-8a9a-1d88bb4b7c99 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:15.539688 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd40c4-00bb-4d93-83b0-5357aa4da63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:15.540487 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd40c4-00bb-4d93-83b0-5357aa4da63b None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:15.540773 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd40c4-00bb-4d93-83b0-5357aa4da63b None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:15.541049 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd40c4-00bb-4d93-83b0-5357aa4da63b None admin] PATH_INFO: `/v3/services/placement` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:15.541745 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd40c4-00bb-4d93-83b0-5357aa4da63b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:15.543113 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd40c4-00bb-4d93-83b0-5357aa4da63b None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:15.555102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-2dbd40c4-00bb-4d93-83b0-5357aa4da63b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:23:15.555102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:23:15.555102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:23:15.555102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:23:15.555102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:23:15.555102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:23:15.555102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:23:15.555102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:23:15.555102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:23:15.555102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:23:15.555102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:23:15.555102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:23:15.555102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:23:15.555102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:23:15.555102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:23:15.555102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:23:15.555102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:23:15.556300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:23:15.556300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:23:15.556300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:23:15.556300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:23:15.556300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:23:15.556300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:23:15.556300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:23:15.556300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:23:15.556300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:23:15.556300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:23:15.556300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:23:15.556300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:23:15.556300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:23:15.556300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:23:15.556300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:23:15.556300 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:23:15.557434 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:23:15.557434 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:23:15.557434 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:23:15.557434 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:23:15.557434 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:23:15.557434 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:23:15.557434 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:23:15.557434 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:23:15.557434 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:23:15.557434 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:23:15.557434 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:23:15.557434 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:23:15.557434 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:23:15.557434 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:23:15.557434 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 638/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:23:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:23:15.562800 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a082cb7-e7cd-458e-b56b-f0888193d43c None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:15.659070 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a082cb7-e7cd-458e-b56b-f0888193d43c None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:15.691098 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e38623-0eee-455b-b418-8a1bd192f523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:15.691756 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e38623-0eee-455b-b418-8a1bd192f523 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:15.692037 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e38623-0eee-455b-b418-8a1bd192f523 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:15.692309 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e38623-0eee-455b-b418-8a1bd192f523 None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:15.693010 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e38623-0eee-455b-b418-8a1bd192f523 None admin] RBAC: Adding query filter params (name=placement) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:23:15.693313 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e38623-0eee-455b-b418-8a1bd192f523 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:15.694692 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e38623-0eee-455b-b418-8a1bd192f523 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:15.699342 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 653/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Mon May 9 15:23:15 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:23:15.705972 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd40c4-00bb-4d93-83b0-5357aa4da63b None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:15.804503 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd40c4-00bb-4d93-83b0-5357aa4da63b None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:15.836355 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af1d9b-1392-4f80-a570-6237daaec604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:15.836953 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af1d9b-1392-4f80-a570-6237daaec604 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:15.837239 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af1d9b-1392-4f80-a570-6237daaec604 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:15.837550 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af1d9b-1392-4f80-a570-6237daaec604 None admin] PATH_INFO: `/v3/services` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:15.838265 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af1d9b-1392-4f80-a570-6237daaec604 None admin] RBAC: Adding query filter params (type=placement) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:23:15.838576 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af1d9b-1392-4f80-a570-6237daaec604 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:15.839946 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af1d9b-1392-4f80-a570-6237daaec604 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:15.844955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 639/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Mon May 9 15:23:15 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:23:18.088085 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b34fa-1354-4370-adc1-f56059bbc3d5 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:18.088649 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b34fa-1354-4370-adc1-f56059bbc3d5 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:18.088649 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b34fa-1354-4370-adc1-f56059bbc3d5 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:18.090074 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 654/1293] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:23:18.095785 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06007c4-1dfa-4928-a2e1-7e731c6a8b05 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:18.096269 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06007c4-1dfa-4928-a2e1-7e731c6a8b05 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:18.096372 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06007c4-1dfa-4928-a2e1-7e731c6a8b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:18.112965 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-d06007c4-1dfa-4928-a2e1-7e731c6a8b05 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:23:18.114191 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-d06007c4-1dfa-4928-a2e1-7e731c6a8b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:23:18.179796 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 640/1294] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:23:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:23:18.203155 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b34fa-1354-4370-adc1-f56059bbc3d5 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:18.315865 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b34fa-1354-4370-adc1-f56059bbc3d5 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:18.350285 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25f251-fb80-4632-853f-91dab839a257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:18.350877 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25f251-fb80-4632-853f-91dab839a257 None admin] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:18.351165 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25f251-fb80-4632-853f-91dab839a257 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:18.351445 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25f251-fb80-4632-853f-91dab839a257 None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:18.352169 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25f251-fb80-4632-853f-91dab839a257 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:18.353648 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25f251-fb80-4632-853f-91dab839a257 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:18.367516 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 655/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:23:18 2022] POST /identity/v3/services => generated 246 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:23:20.607202 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251621d8-74e0-4abf-9b65-542b9c7cf3f4 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:20.608250 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251621d8-74e0-4abf-9b65-542b9c7cf3f4 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:20.608357 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251621d8-74e0-4abf-9b65-542b9c7cf3f4 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:20.609704 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 641/1296] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:23:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:23:20.615246 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c283fc7-92ea-4664-97df-1010235d0d47 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:20.615682 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c283fc7-92ea-4664-97df-1010235d0d47 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:20.615819 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c283fc7-92ea-4664-97df-1010235d0d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:20.633342 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-2c283fc7-92ea-4664-97df-1010235d0d47 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:23:20.634569 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-2c283fc7-92ea-4664-97df-1010235d0d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:23:20.705775 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 656/1297] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:23:20 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:23:20.727708 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251621d8-74e0-4abf-9b65-542b9c7cf3f4 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:20.823264 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251621d8-74e0-4abf-9b65-542b9c7cf3f4 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:20.855074 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff3955-35d6-405d-ad69-82a36a9f9b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:20.855878 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff3955-35d6-405d-ad69-82a36a9f9b03 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:20.856163 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff3955-35d6-405d-ad69-82a36a9f9b03 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:20.856441 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff3955-35d6-405d-ad69-82a36a9f9b03 None admin] PATH_INFO: `/v3/services/placement` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:20.857108 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff3955-35d6-405d-ad69-82a36a9f9b03 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:20.859167 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff3955-35d6-405d-ad69-82a36a9f9b03 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:20.871954 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-74ff3955-35d6-405d-ad69-82a36a9f9b03 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:23:20.871954 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:23:20.871954 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:23:20.871954 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:23:20.871954 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:23:20.871954 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:23:20.871954 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:23:20.871954 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:23:20.871954 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:23:20.871954 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:23:20.871954 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:23:20.871954 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:23:20.871954 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:23:20.871954 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:23:20.871954 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:23:20.871954 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:23:20.871954 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:23:20.873216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:23:20.873216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:23:20.873216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:23:20.873216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:23:20.873216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:23:20.873216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:23:20.873216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:23:20.873216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:23:20.873216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:23:20.873216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:23:20.873216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:23:20.873216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:23:20.873216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:23:20.873216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:23:20.873216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:23:20.873216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:23:20.874759 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:23:20.874759 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:23:20.874759 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:23:20.874759 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:23:20.874759 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:23:20.874759 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:23:20.874759 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:23:20.874759 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:23:20.874759 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:23:20.874759 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:23:20.874759 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:23:20.874759 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:23:20.874759 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:23:20.874759 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:23:20.874759 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 642/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:23:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:23:20.879570 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c283fc7-92ea-4664-97df-1010235d0d47 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:20.978262 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c283fc7-92ea-4664-97df-1010235d0d47 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:21.013298 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed7ad4-0edd-42d6-9f56-ea85d2087e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:21.014260 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed7ad4-0edd-42d6-9f56-ea85d2087e6f None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:21.014577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed7ad4-0edd-42d6-9f56-ea85d2087e6f None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:21.014887 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed7ad4-0edd-42d6-9f56-ea85d2087e6f None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:21.015603 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed7ad4-0edd-42d6-9f56-ea85d2087e6f None admin] RBAC: Adding query filter params (name=placement) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:23:21.015913 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed7ad4-0edd-42d6-9f56-ea85d2087e6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:21.017281 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed7ad4-0edd-42d6-9f56-ea85d2087e6f None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:21.022361 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 657/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Mon May 9 15:23:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:23:21.028276 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff3955-35d6-405d-ad69-82a36a9f9b03 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:21.128298 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff3955-35d6-405d-ad69-82a36a9f9b03 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:21.161143 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731f3f0-0639-45f5-b5e5-f74c2ad7f96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:21.161844 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731f3f0-0639-45f5-b5e5-f74c2ad7f96e None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:21.162134 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731f3f0-0639-45f5-b5e5-f74c2ad7f96e None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:21.162414 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731f3f0-0639-45f5-b5e5-f74c2ad7f96e None admin] PATH_INFO: `/v3/endpoints` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:21.163238 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731f3f0-0639-45f5-b5e5-f74c2ad7f96e None admin] RBAC: Adding query filter params (interface=public, service_id=9e611ea39ed346b185168c5b347f3870, region_id=RegionOne) {{(pid=143282) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:23:21.163552 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731f3f0-0639-45f5-b5e5-f74c2ad7f96e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:21.164922 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731f3f0-0639-45f5-b5e5-f74c2ad7f96e None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:21.170044 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 643/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:23:21 2022] GET /identity/v3/endpoints?service_id=9e611ea39ed346b185168c5b347f3870&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:23:21.177688 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed7ad4-0edd-42d6-9f56-ea85d2087e6f None admin] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:21.286721 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed7ad4-0edd-42d6-9f56-ea85d2087e6f None admin] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:21.327096 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4e4e6-1d09-4b74-aa60-e1e4abd86911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:21.327840 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4e4e6-1d09-4b74-aa60-e1e4abd86911 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:21.328131 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4e4e6-1d09-4b74-aa60-e1e4abd86911 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:21.328407 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4e4e6-1d09-4b74-aa60-e1e4abd86911 None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:21.329098 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4e4e6-1d09-4b74-aa60-e1e4abd86911 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:21.330495 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4e4e6-1d09-4b74-aa60-e1e4abd86911 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:21.337169 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 658/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:23:21 2022] GET /identity/v3/services => generated 2191 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:23:23.582830 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a726fa7-17b2-48e6-a1b0-50f688ace84c None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:23.583349 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a726fa7-17b2-48e6-a1b0-50f688ace84c None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:23.583459 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a726fa7-17b2-48e6-a1b0-50f688ace84c None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:23.584774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 644/1302] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:23:23.590149 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cafd6e-de29-4706-9cf4-f9ba2f769cda None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:23.590580 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cafd6e-de29-4706-9cf4-f9ba2f769cda None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:23.590724 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cafd6e-de29-4706-9cf4-f9ba2f769cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:23.608513 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-a7cafd6e-de29-4706-9cf4-f9ba2f769cda None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:23:23.609785 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-a7cafd6e-de29-4706-9cf4-f9ba2f769cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:23:23.676764 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 659/1303] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:23:23 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:23:23.699429 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a726fa7-17b2-48e6-a1b0-50f688ace84c None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:23.799440 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a726fa7-17b2-48e6-a1b0-50f688ace84c None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:23.833041 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aee9cd-ee58-4d0a-acf2-7ce2fa6373c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:23.833875 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aee9cd-ee58-4d0a-acf2-7ce2fa6373c0 None admin] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:23.834164 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aee9cd-ee58-4d0a-acf2-7ce2fa6373c0 None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:23.834442 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aee9cd-ee58-4d0a-acf2-7ce2fa6373c0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:23.835107 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aee9cd-ee58-4d0a-acf2-7ce2fa6373c0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:23.836484 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aee9cd-ee58-4d0a-acf2-7ce2fa6373c0 None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:23.848668 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application [None req-17aee9cd-ee58-4d0a-acf2-7ce2fa6373c0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:23:23.848668 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:23:23.848668 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:23:23.848668 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:23:23.848668 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:23:23.848668 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:23:23.848668 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:23:23.848668 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:23:23.848668 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:23:23.848668 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:23:23.848668 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:23:23.848668 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:23:23.848668 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:23:23.848668 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:23:23.848668 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:23:23.848668 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:23:23.848668 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:23:23.855200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:23:23.855200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:23:23.855200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:23:23.855200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:23:23.855200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:23:23.855200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:23:23.855200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:23:23.855200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:23:23.855200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:23:23.855200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:23:23.855200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:23:23.855200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:23:23.855200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:23:23.855200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:23:23.855200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:23:23.855200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:23:23.856327 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:23:23.856327 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application with Lock( May 09 15:23:23.856327 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:23:23.856327 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self._enter() May 09 15:23:23.856327 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:23:23.856327 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:23:23.856327 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:23:23.856327 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application return self.creator() May 09 15:23:23.856327 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:23:23.856327 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application created_value = creator( May 09 15:23:23.856327 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:23:23.856327 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:23:23.856327 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:23:23.856327 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: ERROR keystone.server.flask.application May 09 15:23:23.856327 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 645/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:23:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:23:23.857329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cafd6e-de29-4706-9cf4-f9ba2f769cda None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:23.956013 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cafd6e-de29-4706-9cf4-f9ba2f769cda None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:23.989681 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21250b7b-caf6-4fb8-8900-d49f82555a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:23.990617 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21250b7b-caf6-4fb8-8900-d49f82555a64 None admin] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:23.990894 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21250b7b-caf6-4fb8-8900-d49f82555a64 None admin] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:23.991174 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21250b7b-caf6-4fb8-8900-d49f82555a64 None admin] PATH_INFO: `/v3/services` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:23.991886 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21250b7b-caf6-4fb8-8900-d49f82555a64 None admin] RBAC: Adding query filter params (name=placement) {{(pid=143281) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:23:23.992199 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21250b7b-caf6-4fb8-8900-d49f82555a64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:23.993599 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21250b7b-caf6-4fb8-8900-d49f82555a64 None admin] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:23.999595 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 660/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Mon May 9 15:23:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:23:24.005504 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aee9cd-ee58-4d0a-acf2-7ce2fa6373c0 None admin] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:23:24.101080 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aee9cd-ee58-4d0a-acf2-7ce2fa6373c0 None admin] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:23:24.133361 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5d16a-8ab2-4e66-afd9-1f349d86c00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cdae28a6c6045309f4aaea02e9f2c9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:23:24.134047 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5d16a-8ab2-4e66-afd9-1f349d86c00b None admin] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:23:24.134334 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5d16a-8ab2-4e66-afd9-1f349d86c00b None admin] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:23:24.134613 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5d16a-8ab2-4e66-afd9-1f349d86c00b None admin] PATH_INFO: `/v3/endpoints` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:23:24.135368 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5d16a-8ab2-4e66-afd9-1f349d86c00b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:23:24.136731 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5d16a-8ab2-4e66-afd9-1f349d86c00b None admin] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:23:24.155454 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 646/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:23:24 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:24:31.153336 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbd5d8-0d46-498c-b831-c0acfa6ef1b8 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:31.154035 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbd5d8-0d46-498c-b831-c0acfa6ef1b8 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:31.154423 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbd5d8-0d46-498c-b831-c0acfa6ef1b8 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:31.156050 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 661/1307] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:24:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:24:31.162079 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd1d1-13ae-477d-98c0-37251a25bc8d None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:31.162657 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd1d1-13ae-477d-98c0-37251a25bc8d None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:31.162657 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd1d1-13ae-477d-98c0-37251a25bc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:31.328703 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-9c2bd1d1-13ae-477d-98c0-37251a25bc8d None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:24:31.330350 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-9c2bd1d1-13ae-477d-98c0-37251a25bc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:31.505455 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 647/1308] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:24:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:24:31.564139 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c955536-592f-4a1d-99a3-f065804dc20a None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:31.565005 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c955536-592f-4a1d-99a3-f065804dc20a None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:31.565426 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c955536-592f-4a1d-99a3-f065804dc20a None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:31.567271 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 662/1309] 10.222.0.48 () {54 vars in 964 bytes} [Mon May 9 15:24:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:24:31.576308 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43196f-fe1d-4745-9e5d-821f03a7fda0 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:31.576602 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43196f-fe1d-4745-9e5d-821f03a7fda0 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:31.576888 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43196f-fe1d-4745-9e5d-821f03a7fda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:31.716741 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-8d43196f-fe1d-4745-9e5d-821f03a7fda0 None None] MFA Rules not processed for user `e9433a0b92c34247b4e539b96dc4d581`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:24:31.718083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-8d43196f-fe1d-4745-9e5d-821f03a7fda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:31.909041 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 648/1310] 10.222.0.48 () {58 vars in 1061 bytes} [Mon May 9 15:24:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:24:31.910727 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c955536-592f-4a1d-99a3-f065804dc20a None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:24:31.913117 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-3c955536-592f-4a1d-99a3-f065804dc20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:32.190085 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c955536-592f-4a1d-99a3-f065804dc20a None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:24:32.314641 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dbd25-431c-4d11-9a5e-a94fc1a7059a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9433a0b92c34247b4e539b96dc4d581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb2de9bea1cf451db5f8c697f480c480', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:24:32.315505 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dbd25-431c-4d11-9a5e-a94fc1a7059a service neutron] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:32.315940 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dbd25-431c-4d11-9a5e-a94fc1a7059a service neutron] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:32.316384 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dbd25-431c-4d11-9a5e-a94fc1a7059a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:32.318266 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-d43dbd25-431c-4d11-9a5e-a94fc1a7059a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:32.438960 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43dbd25-431c-4d11-9a5e-a94fc1a7059a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:24:32.440636 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43dbd25-431c-4d11-9a5e-a94fc1a7059a service neutron] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:24:32.460210 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 663/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:24:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:24:35.164231 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173af24-7b40-4146-a425-55c4c59d1f60 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:35.165132 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173af24-7b40-4146-a425-55c4c59d1f60 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:35.165605 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173af24-7b40-4146-a425-55c4c59d1f60 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:35.174132 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81cb87-dc16-4c12-87ee-a05f142de963 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:35.175006 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81cb87-dc16-4c12-87ee-a05f142de963 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:35.175440 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81cb87-dc16-4c12-87ee-a05f142de963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:35.178974 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 649/1312] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:24:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:24:35.259579 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-5f81cb87-dc16-4c12-87ee-a05f142de963 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:24:35.261080 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-5f81cb87-dc16-4c12-87ee-a05f142de963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:35.389947 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 664/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:24:35.417867 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173af24-7b40-4146-a425-55c4c59d1f60 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:24:35.420274 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-7173af24-7b40-4146-a425-55c4c59d1f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:35.553570 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173af24-7b40-4146-a425-55c4c59d1f60 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:24:35.636241 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ebb3c3-f1e6-4d72-8103-d1626c45296a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9433a0b92c34247b4e539b96dc4d581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb2de9bea1cf451db5f8c697f480c480', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:24:35.637452 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebb3c3-f1e6-4d72-8103-d1626c45296a service neutron] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:35.638584 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebb3c3-f1e6-4d72-8103-d1626c45296a service neutron] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:35.638878 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ebb3c3-f1e6-4d72-8103-d1626c45296a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:35.640876 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-f9ebb3c3-f1e6-4d72-8103-d1626c45296a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:35.768981 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ebb3c3-f1e6-4d72-8103-d1626c45296a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:24:35.770707 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ebb3c3-f1e6-4d72-8103-d1626c45296a service neutron] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:24:35.792214 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 650/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:24:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:24:38.545890 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0f78a-c191-4137-b3da-adfdc7453ce0 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:38.546336 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0f78a-c191-4137-b3da-adfdc7453ce0 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:38.546557 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0f78a-c191-4137-b3da-adfdc7453ce0 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:38.548106 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 665/1315] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:24:38.553759 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02079efd-5541-415a-9155-410c172b8eed None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:38.554143 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02079efd-5541-415a-9155-410c172b8eed None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:38.554332 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02079efd-5541-415a-9155-410c172b8eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:38.617642 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-02079efd-5541-415a-9155-410c172b8eed None None] MFA Rules not processed for user `0c56e75b50944a4781c82d5e2c9cfbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:24:38.618877 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-02079efd-5541-415a-9155-410c172b8eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:38.712734 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 651/1316] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:24:38 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:24:38.766908 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186318b-6351-4c67-9753-889f7f6a30b9 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:38.767200 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186318b-6351-4c67-9753-889f7f6a30b9 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:38.767491 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186318b-6351-4c67-9753-889f7f6a30b9 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:38.768876 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 666/1317] 10.222.0.48 () {54 vars in 964 bytes} [Mon May 9 15:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:24:38.774937 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca30f8-b512-4630-84e4-01d37a5b6371 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:38.775235 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca30f8-b512-4630-84e4-01d37a5b6371 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:38.775521 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca30f8-b512-4630-84e4-01d37a5b6371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:38.858591 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-cdca30f8-b512-4630-84e4-01d37a5b6371 None None] MFA Rules not processed for user `e9433a0b92c34247b4e539b96dc4d581`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:24:38.859717 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-cdca30f8-b512-4630-84e4-01d37a5b6371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:38.940529 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 652/1318] 10.222.0.48 () {58 vars in 1061 bytes} [Mon May 9 15:24:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:24:38.950416 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186318b-6351-4c67-9753-889f7f6a30b9 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:24:38.951955 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-5186318b-6351-4c67-9753-889f7f6a30b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:39.055329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186318b-6351-4c67-9753-889f7f6a30b9 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:24:39.129821 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c02f56-69b2-4c84-8330-fc96930a8cbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9433a0b92c34247b4e539b96dc4d581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb2de9bea1cf451db5f8c697f480c480', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:24:39.130395 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c02f56-69b2-4c84-8330-fc96930a8cbd service neutron] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:39.130686 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c02f56-69b2-4c84-8330-fc96930a8cbd service neutron] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:39.130969 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c02f56-69b2-4c84-8330-fc96930a8cbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:39.132640 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-a9c02f56-69b2-4c84-8330-fc96930a8cbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:39.242359 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c02f56-69b2-4c84-8330-fc96930a8cbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:24:39.243816 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c02f56-69b2-4c84-8330-fc96930a8cbd service neutron] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:24:39.264798 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 667/1319] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:24:38 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:24:42.501097 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bb22b-069d-44f5-8335-2e1059e39678 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:42.501667 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bb22b-069d-44f5-8335-2e1059e39678 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:42.501757 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bb22b-069d-44f5-8335-2e1059e39678 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:42.503090 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 653/1320] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:24:42.508434 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b7fe6-2407-421b-98e4-d1304385aead None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:42.508890 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b7fe6-2407-421b-98e4-d1304385aead None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:42.509018 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b7fe6-2407-421b-98e4-d1304385aead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:42.580572 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-db9b7fe6-2407-421b-98e4-d1304385aead None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:24:42.581866 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-db9b7fe6-2407-421b-98e4-d1304385aead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:42.680126 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 668/1321] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:24:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:24:42.720712 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182bb22b-069d-44f5-8335-2e1059e39678 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:24:42.722336 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-182bb22b-069d-44f5-8335-2e1059e39678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:42.826628 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182bb22b-069d-44f5-8335-2e1059e39678 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:24:42.899051 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d9bc9-b2c8-49da-82b2-02f73c7890eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9433a0b92c34247b4e539b96dc4d581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb2de9bea1cf451db5f8c697f480c480', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:24:42.899704 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d9bc9-b2c8-49da-82b2-02f73c7890eb service neutron] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:42.899988 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d9bc9-b2c8-49da-82b2-02f73c7890eb service neutron] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:42.900324 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d9bc9-b2c8-49da-82b2-02f73c7890eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:42.901955 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-ad3d9bc9-b2c8-49da-82b2-02f73c7890eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:43.009396 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d9bc9-b2c8-49da-82b2-02f73c7890eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:24:43.010879 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d9bc9-b2c8-49da-82b2-02f73c7890eb service neutron] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:24:43.032754 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 654/1322] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:24:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:24:46.085930 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b492c-2651-4470-a951-3ac16d2e67f3 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:46.086450 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b492c-2651-4470-a951-3ac16d2e67f3 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:46.086528 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b492c-2651-4470-a951-3ac16d2e67f3 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:46.087913 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 669/1323] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:24:46.094215 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d75cb-d941-4cfb-9cdb-2de1c4b0cf0e None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:46.094675 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d75cb-d941-4cfb-9cdb-2de1c4b0cf0e None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:46.094906 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d75cb-d941-4cfb-9cdb-2de1c4b0cf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:46.161036 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-c09d75cb-d941-4cfb-9cdb-2de1c4b0cf0e None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:24:46.162298 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-c09d75cb-d941-4cfb-9cdb-2de1c4b0cf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:46.258631 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 655/1324] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:24:46.293781 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b492c-2651-4470-a951-3ac16d2e67f3 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:24:46.295330 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-5a3b492c-2651-4470-a951-3ac16d2e67f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:46.395017 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b492c-2651-4470-a951-3ac16d2e67f3 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:24:46.466565 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dad677-2e6c-4e91-bfc0-6892d991badc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9433a0b92c34247b4e539b96dc4d581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb2de9bea1cf451db5f8c697f480c480', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:24:46.467215 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dad677-2e6c-4e91-bfc0-6892d991badc service neutron] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:46.467498 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dad677-2e6c-4e91-bfc0-6892d991badc service neutron] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:46.467773 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dad677-2e6c-4e91-bfc0-6892d991badc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:46.469461 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-c9dad677-2e6c-4e91-bfc0-6892d991badc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:46.578568 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dad677-2e6c-4e91-bfc0-6892d991badc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:24:46.580006 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dad677-2e6c-4e91-bfc0-6892d991badc service neutron] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:24:46.598535 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 670/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:24:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:24:48.948819 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afde4ad-0fc8-4dea-9e8a-8ada39ee2fae None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:48.950048 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afde4ad-0fc8-4dea-9e8a-8ada39ee2fae None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:48.950048 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afde4ad-0fc8-4dea-9e8a-8ada39ee2fae None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:48.951533 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 656/1326] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:24:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:24:48.957238 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60af8a9-7624-4b35-8f98-b8e3ab889cbc None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:48.957690 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60af8a9-7624-4b35-8f98-b8e3ab889cbc None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:48.957839 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60af8a9-7624-4b35-8f98-b8e3ab889cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:49.029329 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-b60af8a9-7624-4b35-8f98-b8e3ab889cbc None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:24:49.031133 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-b60af8a9-7624-4b35-8f98-b8e3ab889cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:49.126753 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 671/1327] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:24:49.162774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afde4ad-0fc8-4dea-9e8a-8ada39ee2fae None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:24:49.164408 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-6afde4ad-0fc8-4dea-9e8a-8ada39ee2fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:49.272793 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afde4ad-0fc8-4dea-9e8a-8ada39ee2fae None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:24:49.350026 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6d07e-532a-412f-ae0d-4b91ca04e8ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9433a0b92c34247b4e539b96dc4d581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb2de9bea1cf451db5f8c697f480c480', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:24:49.350690 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6d07e-532a-412f-ae0d-4b91ca04e8ad service neutron] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:49.350974 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6d07e-532a-412f-ae0d-4b91ca04e8ad service neutron] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:49.351253 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6d07e-532a-412f-ae0d-4b91ca04e8ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:49.352928 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-8ee6d07e-532a-412f-ae0d-4b91ca04e8ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:49.458310 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6d07e-532a-412f-ae0d-4b91ca04e8ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:24:49.459776 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6d07e-532a-412f-ae0d-4b91ca04e8ad service neutron] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:24:49.478264 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 657/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:24:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:24:51.918459 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f50933-2d2d-4b7e-9573-473e807b6d7d None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:51.918983 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f50933-2d2d-4b7e-9573-473e807b6d7d None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:51.919072 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f50933-2d2d-4b7e-9573-473e807b6d7d None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:51.920413 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 672/1329] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:24:51.925940 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3222b2-29bb-4c6b-92a6-927d179f0993 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:51.926383 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3222b2-29bb-4c6b-92a6-927d179f0993 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:51.926512 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3222b2-29bb-4c6b-92a6-927d179f0993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:51.991438 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-4a3222b2-29bb-4c6b-92a6-927d179f0993 None None] MFA Rules not processed for user `0c56e75b50944a4781c82d5e2c9cfbcd`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:24:51.992661 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-4a3222b2-29bb-4c6b-92a6-927d179f0993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:52.090759 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 658/1330] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:24:51 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:24:52.127317 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f50933-2d2d-4b7e-9573-473e807b6d7d None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:24:52.128842 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-73f50933-2d2d-4b7e-9573-473e807b6d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:52.229805 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f50933-2d2d-4b7e-9573-473e807b6d7d None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:24:52.301921 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37c736-c137-42ba-b461-b94e76113353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9433a0b92c34247b4e539b96dc4d581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb2de9bea1cf451db5f8c697f480c480', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:24:52.302811 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37c736-c137-42ba-b461-b94e76113353 service neutron] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:52.303193 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37c736-c137-42ba-b461-b94e76113353 service neutron] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:52.303591 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37c736-c137-42ba-b461-b94e76113353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:52.305889 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-7a37c736-c137-42ba-b461-b94e76113353 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:52.411842 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37c736-c137-42ba-b461-b94e76113353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:24:52.413204 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37c736-c137-42ba-b461-b94e76113353 service neutron] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:24:52.432159 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 673/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:24:52 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:24:55.017124 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db52efc-1627-49cf-aeec-bb33f1b1580a None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:55.017686 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db52efc-1627-49cf-aeec-bb33f1b1580a None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:55.017774 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db52efc-1627-49cf-aeec-bb33f1b1580a None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:55.019118 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 659/1332] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:24:55.024565 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8166205-1b51-46a7-a42a-4297f5003ee8 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:55.024968 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8166205-1b51-46a7-a42a-4297f5003ee8 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:55.025168 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8166205-1b51-46a7-a42a-4297f5003ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:55.089609 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-f8166205-1b51-46a7-a42a-4297f5003ee8 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:24:55.090834 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-f8166205-1b51-46a7-a42a-4297f5003ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:55.186424 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 674/1333] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:24:55.223329 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db52efc-1627-49cf-aeec-bb33f1b1580a None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:24:55.224896 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-5db52efc-1627-49cf-aeec-bb33f1b1580a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:55.328512 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db52efc-1627-49cf-aeec-bb33f1b1580a None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:24:55.398421 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9792539-6077-46e9-948e-d6245ba0b3c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9433a0b92c34247b4e539b96dc4d581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb2de9bea1cf451db5f8c697f480c480', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:24:55.399072 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9792539-6077-46e9-948e-d6245ba0b3c0 service neutron] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:55.399358 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9792539-6077-46e9-948e-d6245ba0b3c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:55.399657 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9792539-6077-46e9-948e-d6245ba0b3c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:55.401328 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-a9792539-6077-46e9-948e-d6245ba0b3c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:55.506501 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9792539-6077-46e9-948e-d6245ba0b3c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:24:55.507954 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9792539-6077-46e9-948e-d6245ba0b3c0 service neutron] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:24:55.525693 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 660/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:24:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:24:57.864105 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42220bd-f218-43e8-984f-8b8dd61e5d67 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:57.864605 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42220bd-f218-43e8-984f-8b8dd61e5d67 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:57.864605 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42220bd-f218-43e8-984f-8b8dd61e5d67 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:57.866263 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 675/1335] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:24:57.872116 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac043cd5-1550-4170-8d65-b1fd3b29a3f3 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:57.872560 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac043cd5-1550-4170-8d65-b1fd3b29a3f3 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:57.872654 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac043cd5-1550-4170-8d65-b1fd3b29a3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:57.937873 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-ac043cd5-1550-4170-8d65-b1fd3b29a3f3 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:24:57.939090 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-ac043cd5-1550-4170-8d65-b1fd3b29a3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:58.037777 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 661/1336] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:24:58.077619 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42220bd-f218-43e8-984f-8b8dd61e5d67 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:24:58.079227 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-b42220bd-f218-43e8-984f-8b8dd61e5d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:58.200544 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42220bd-f218-43e8-984f-8b8dd61e5d67 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:24:58.307138 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227db3e-18f5-413a-855f-bcb145c77e77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9433a0b92c34247b4e539b96dc4d581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb2de9bea1cf451db5f8c697f480c480', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:24:58.307798 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227db3e-18f5-413a-855f-bcb145c77e77 service neutron] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:24:58.308628 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227db3e-18f5-413a-855f-bcb145c77e77 service neutron] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:24:58.309160 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227db3e-18f5-413a-855f-bcb145c77e77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:24:58.310873 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-c227db3e-18f5-413a-855f-bcb145c77e77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:24:58.421042 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227db3e-18f5-413a-855f-bcb145c77e77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:24:58.422522 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227db3e-18f5-413a-855f-bcb145c77e77 service neutron] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:24:58.440598 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 676/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:24:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:25:01.075696 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c44fc-bbea-4ede-bf8c-1e4409eaa853 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:01.076266 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c44fc-bbea-4ede-bf8c-1e4409eaa853 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:01.076266 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c44fc-bbea-4ede-bf8c-1e4409eaa853 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:01.077737 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 662/1338] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:25:01.082933 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba758d1-6346-412d-b708-7e9de485595e None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:01.083406 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba758d1-6346-412d-b708-7e9de485595e None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:01.083509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba758d1-6346-412d-b708-7e9de485595e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:01.147504 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-cba758d1-6346-412d-b708-7e9de485595e None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:25:01.148714 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-cba758d1-6346-412d-b708-7e9de485595e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:25:01.250133 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 677/1339] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:25:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:25:01.285010 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c44fc-bbea-4ede-bf8c-1e4409eaa853 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:25:01.288091 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-c39c44fc-bbea-4ede-bf8c-1e4409eaa853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:25:01.394815 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c44fc-bbea-4ede-bf8c-1e4409eaa853 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:25:01.407065 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f7ee0-8f60-4ff8-98ff-00fd227a6a3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9433a0b92c34247b4e539b96dc4d581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb2de9bea1cf451db5f8c697f480c480', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:25:01.407721 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f7ee0-8f60-4ff8-98ff-00fd227a6a3e service neutron] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:01.408006 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f7ee0-8f60-4ff8-98ff-00fd227a6a3e service neutron] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:01.408284 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f7ee0-8f60-4ff8-98ff-00fd227a6a3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:01.409936 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-ad3f7ee0-8f60-4ff8-98ff-00fd227a6a3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:25:01.510931 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f7ee0-8f60-4ff8-98ff-00fd227a6a3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:25:01.512407 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f7ee0-8f60-4ff8-98ff-00fd227a6a3e service neutron] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:25:01.533236 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 663/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:25:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:25:05.886793 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3d7a7-4af7-46c4-bbac-ac41902ab693 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:05.887321 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3d7a7-4af7-46c4-bbac-ac41902ab693 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:05.887321 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3d7a7-4af7-46c4-bbac-ac41902ab693 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:05.888641 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 678/1341] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:25:05.896387 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2df3df-3469-4c56-93ef-e81866d71fb2 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:05.896948 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2df3df-3469-4c56-93ef-e81866d71fb2 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:05.896948 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2df3df-3469-4c56-93ef-e81866d71fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:05.951446 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-dd2df3df-3469-4c56-93ef-e81866d71fb2 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:25:05.953202 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-dd2df3df-3469-4c56-93ef-e81866d71fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:25:06.039200 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 664/1342] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:25:06.078926 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3d7a7-4af7-46c4-bbac-ac41902ab693 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:25:06.081179 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-3fd3d7a7-4af7-46c4-bbac-ac41902ab693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:25:06.105800 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3d7a7-4af7-46c4-bbac-ac41902ab693 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:25:06.109624 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb5ecc-bdd5-422c-beb4-1fd77e3cfeff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9433a0b92c34247b4e539b96dc4d581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb2de9bea1cf451db5f8c697f480c480', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:25:06.110344 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb5ecc-bdd5-422c-beb4-1fd77e3cfeff service neutron] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:06.110702 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb5ecc-bdd5-422c-beb4-1fd77e3cfeff service neutron] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:06.111047 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb5ecc-bdd5-422c-beb4-1fd77e3cfeff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:06.120781 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb5ecc-bdd5-422c-beb4-1fd77e3cfeff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:25:06.122369 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb5ecc-bdd5-422c-beb4-1fd77e3cfeff service neutron] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:25:06.132477 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 679/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:25:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:25:09.283963 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ab4ee-59eb-4b2f-b52e-608a51624e86 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:09.284487 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ab4ee-59eb-4b2f-b52e-608a51624e86 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:09.284487 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ab4ee-59eb-4b2f-b52e-608a51624e86 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:09.285932 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 665/1344] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:25:09.295308 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030cbc1-ba03-42fb-b950-246e32128605 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:09.296308 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030cbc1-ba03-42fb-b950-246e32128605 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:09.296838 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030cbc1-ba03-42fb-b950-246e32128605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:09.326226 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-8030cbc1-ba03-42fb-b950-246e32128605 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:25:09.327424 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-8030cbc1-ba03-42fb-b950-246e32128605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:25:09.335435 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 680/1345] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:25:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:25:09.371831 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ab4ee-59eb-4b2f-b52e-608a51624e86 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:25:09.382326 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ab4ee-59eb-4b2f-b52e-608a51624e86 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:25:09.386286 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99f631-b408-40c4-b230-007376361037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9433a0b92c34247b4e539b96dc4d581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb2de9bea1cf451db5f8c697f480c480', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:25:09.386992 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99f631-b408-40c4-b230-007376361037 service neutron] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:09.387204 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99f631-b408-40c4-b230-007376361037 service neutron] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:09.387479 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99f631-b408-40c4-b230-007376361037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:09.396302 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99f631-b408-40c4-b230-007376361037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:25:09.397803 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99f631-b408-40c4-b230-007376361037 service neutron] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:25:09.408616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 666/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:25:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 15:25:14.055314 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15ab3c-9f78-41ba-84aa-d66c8a30791c None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:14.055831 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15ab3c-9f78-41ba-84aa-d66c8a30791c None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:14.055831 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15ab3c-9f78-41ba-84aa-d66c8a30791c None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:14.057175 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 681/1347] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:25:14.063104 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559915d-9092-4499-884b-25be2ace3dac None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:14.063533 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559915d-9092-4499-884b-25be2ace3dac None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:14.063675 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559915d-9092-4499-884b-25be2ace3dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:14.081834 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-0559915d-9092-4499-884b-25be2ace3dac None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:25:14.083084 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-0559915d-9092-4499-884b-25be2ace3dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:25:14.092161 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 667/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:25:14.132095 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15ab3c-9f78-41ba-84aa-d66c8a30791c None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:25:14.143029 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15ab3c-9f78-41ba-84aa-d66c8a30791c None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:25:14.146588 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cca057-c122-49ab-b58a-b5cc17ef0ed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9433a0b92c34247b4e539b96dc4d581', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb2de9bea1cf451db5f8c697f480c480', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:25:14.147232 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cca057-c122-49ab-b58a-b5cc17ef0ed1 service neutron] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:14.147520 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cca057-c122-49ab-b58a-b5cc17ef0ed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:14.147802 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cca057-c122-49ab-b58a-b5cc17ef0ed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:14.157355 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cca057-c122-49ab-b58a-b5cc17ef0ed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:25:14.158853 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cca057-c122-49ab-b58a-b5cc17ef0ed1 service neutron] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:25:14.168735 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 682/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:25:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:25:19.694376 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f459c-a1d6-439e-98f8-8f37260b37f5 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:19.694909 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f459c-a1d6-439e-98f8-8f37260b37f5 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:19.695178 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f459c-a1d6-439e-98f8-8f37260b37f5 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:19.697015 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 668/1350] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 9 15:25:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:25:19.704996 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d3d05-8035-48a2-babb-cd84b7d9c1ca None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:19.705520 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d3d05-8035-48a2-babb-cd84b7d9c1ca None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:19.705825 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d3d05-8035-48a2-babb-cd84b7d9c1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:19.871421 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-b06d3d05-8035-48a2-babb-cd84b7d9c1ca None None] MFA Rules not processed for user `acd06b5fad24414abc8c2e5c209ce867`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:25:19.872819 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-b06d3d05-8035-48a2-babb-cd84b7d9c1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:25:20.103630 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 683/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 9 15:25:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:25:24.314395 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d1abf-9a52-4205-b1e0-46b525872359 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:24.315278 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d1abf-9a52-4205-b1e0-46b525872359 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:24.315718 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d1abf-9a52-4205-b1e0-46b525872359 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:24.317604 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 669/1352] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 9 15:25:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:25:24.322692 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e8e94-704f-4ae0-902e-d3506a66a9c7 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:24.323522 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e8e94-704f-4ae0-902e-d3506a66a9c7 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:24.323989 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e8e94-704f-4ae0-902e-d3506a66a9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:24.342337 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-101e8e94-704f-4ae0-902e-d3506a66a9c7 None None] MFA Rules not processed for user `acd06b5fad24414abc8c2e5c209ce867`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:25:24.343864 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-101e8e94-704f-4ae0-902e-d3506a66a9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:25:24.353202 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 684/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 9 15:25:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:25:25.920277 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fd190-5801-4edc-8576-a0a8a7a3f519 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:25.920766 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fd190-5801-4edc-8576-a0a8a7a3f519 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:25.920766 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fd190-5801-4edc-8576-a0a8a7a3f519 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:25.922312 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 670/1354] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 9 15:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:25:25.926988 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48713b2f-4d99-401e-ba07-d12dfeaf4e64 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:25.927389 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48713b2f-4d99-401e-ba07-d12dfeaf4e64 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:25.927545 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48713b2f-4d99-401e-ba07-d12dfeaf4e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:25.945563 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-48713b2f-4d99-401e-ba07-d12dfeaf4e64 None None] MFA Rules not processed for user `acd06b5fad24414abc8c2e5c209ce867`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:25:25.946972 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-48713b2f-4d99-401e-ba07-d12dfeaf4e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:25:25.956110 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 685/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 9 15:25:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:25:29.917298 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7da1af-90fa-4f0e-b2cc-ea6af0a46166 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:29.918219 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7da1af-90fa-4f0e-b2cc-ea6af0a46166 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:29.918631 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7da1af-90fa-4f0e-b2cc-ea6af0a46166 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:29.920050 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 671/1356] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:25:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:25:29.926007 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746711aa-9fe5-4f0e-86d7-d728df30b2df None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:29.929429 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746711aa-9fe5-4f0e-86d7-d728df30b2df None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:29.929725 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746711aa-9fe5-4f0e-86d7-d728df30b2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:29.959674 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-746711aa-9fe5-4f0e-86d7-d728df30b2df None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:25:29.961207 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-746711aa-9fe5-4f0e-86d7-d728df30b2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:25:29.973419 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 686/1357] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:25:30.022914 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e61dd-15ae-4912-8574-c58d5e99da5d None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:30.023291 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e61dd-15ae-4912-8574-c58d5e99da5d None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:30.023645 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e61dd-15ae-4912-8574-c58d5e99da5d None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:30.025083 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 672/1358] 10.222.0.48 () {54 vars in 961 bytes} [Mon May 9 15:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:25:30.031281 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7095788-19c8-444b-844f-5f97a1c67f0d None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:30.031581 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7095788-19c8-444b-844f-5f97a1c67f0d None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:30.031870 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7095788-19c8-444b-844f-5f97a1c67f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:30.081716 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-d7095788-19c8-444b-844f-5f97a1c67f0d None None] MFA Rules not processed for user `42dc38d6c3634b7496b1b7e99ca3f647`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:25:30.083014 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-d7095788-19c8-444b-844f-5f97a1c67f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:25:30.163611 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 687/1359] 10.222.0.48 () {58 vars in 1058 bytes} [Mon May 9 15:25:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:25:30.171953 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e61dd-15ae-4912-8574-c58d5e99da5d None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:25:30.186392 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e61dd-15ae-4912-8574-c58d5e99da5d None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:25:30.191819 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c8137-6e85-494b-a314-58bcf1cba775 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42dc38d6c3634b7496b1b7e99ca3f647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb2de9bea1cf451db5f8c697f480c480', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:25:30.192938 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c8137-6e85-494b-a314-58bcf1cba775 service nova] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:30.193351 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c8137-6e85-494b-a314-58bcf1cba775 service nova] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:30.194181 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c8137-6e85-494b-a314-58bcf1cba775 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:30.203082 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c8137-6e85-494b-a314-58bcf1cba775 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:25:30.204675 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c8137-6e85-494b-a314-58bcf1cba775 service nova] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:25:30.213950 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 673/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:25:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:25:32.710601 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca8026-d467-4a1e-ae7f-f2ddb2324c36 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:32.711144 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca8026-d467-4a1e-ae7f-f2ddb2324c36 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:32.711259 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca8026-d467-4a1e-ae7f-f2ddb2324c36 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:32.712662 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 688/1361] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:25:32.719616 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc979f-08ae-42a4-bad4-8b5eefff8b86 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:32.720068 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc979f-08ae-42a4-bad4-8b5eefff8b86 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:32.720429 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc979f-08ae-42a4-bad4-8b5eefff8b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:32.739245 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-0cdc979f-08ae-42a4-bad4-8b5eefff8b86 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:25:32.740720 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-0cdc979f-08ae-42a4-bad4-8b5eefff8b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:25:32.749844 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 674/1362] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:25:32.795495 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca8026-d467-4a1e-ae7f-f2ddb2324c36 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:25:32.810534 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca8026-d467-4a1e-ae7f-f2ddb2324c36 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:25:32.816242 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1337b1b-2fea-457e-9af1-f1c97e87acf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42dc38d6c3634b7496b1b7e99ca3f647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb2de9bea1cf451db5f8c697f480c480', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:25:32.816905 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1337b1b-2fea-457e-9af1-f1c97e87acf3 service nova] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:32.817194 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1337b1b-2fea-457e-9af1-f1c97e87acf3 service nova] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:32.817577 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1337b1b-2fea-457e-9af1-f1c97e87acf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:32.827280 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1337b1b-2fea-457e-9af1-f1c97e87acf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:25:32.828921 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1337b1b-2fea-457e-9af1-f1c97e87acf3 service nova] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:25:32.839988 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 689/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:25:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 15:25:35.457637 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b367a45-4a47-434d-abfc-fee3c80c0e94 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:35.458252 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b367a45-4a47-434d-abfc-fee3c80c0e94 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:35.458252 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b367a45-4a47-434d-abfc-fee3c80c0e94 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:35.459591 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 675/1364] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:25:35.465985 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffece2f-3d53-4f2a-b24e-97c311039e8e None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:35.466520 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffece2f-3d53-4f2a-b24e-97c311039e8e None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:35.466656 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffece2f-3d53-4f2a-b24e-97c311039e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:35.486117 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-6ffece2f-3d53-4f2a-b24e-97c311039e8e None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:25:35.487342 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-6ffece2f-3d53-4f2a-b24e-97c311039e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:25:35.498094 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 690/1365] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:25:35.549636 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b94c5-e25b-4ec2-90d3-54001d3eae77 None None] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:35.549929 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b94c5-e25b-4ec2-90d3-54001d3eae77 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:35.550216 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b94c5-e25b-4ec2-90d3-54001d3eae77 None None] PATH_INFO: `/` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:35.551625 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 676/1366] 10.222.0.48 () {54 vars in 961 bytes} [Mon May 9 15:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:25:35.558999 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fa444-3f24-4ef2-a488-70590cdaca12 None None] REQUEST_METHOD: `POST` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:35.559301 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fa444-3f24-4ef2-a488-70590cdaca12 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:35.560245 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fa444-3f24-4ef2-a488-70590cdaca12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:35.584591 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.auth.core [None req-541fa444-3f24-4ef2-a488-70590cdaca12 None None] MFA Rules not processed for user `42dc38d6c3634b7496b1b7e99ca3f647`. Rule list: `[]` (Enabled: `True`). {{(pid=143281) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:25:35.585867 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.fernet_utils [None req-541fa444-3f24-4ef2-a488-70590cdaca12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143281) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:25:35.598541 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 691/1367] 10.222.0.48 () {58 vars in 1058 bytes} [Mon May 9 15:25:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:25:35.607331 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b94c5-e25b-4ec2-90d3-54001d3eae77 None None] Authenticating user token {{(pid=143282) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:25:35.625996 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b94c5-e25b-4ec2-90d3-54001d3eae77 None None] Validating token access rules against request {{(pid=143282) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:25:35.633009 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef745ed4-9080-4ed0-a5df-83a12ee145ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42dc38d6c3634b7496b1b7e99ca3f647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb2de9bea1cf451db5f8c697f480c480', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143282) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:25:35.633876 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef745ed4-9080-4ed0-a5df-83a12ee145ef service nova] REQUEST_METHOD: `GET` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:35.634157 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef745ed4-9080-4ed0-a5df-83a12ee145ef service nova] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:35.634629 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef745ed4-9080-4ed0-a5df-83a12ee145ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:35.645570 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef745ed4-9080-4ed0-a5df-83a12ee145ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:25:35.647422 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef745ed4-9080-4ed0-a5df-83a12ee145ef service nova] RBAC: Authorization granted {{(pid=143282) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:25:35.659635 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 677/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:25:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:25:36.579332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c4733-26c5-4c8f-88ed-953cade5b3fb None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:36.579332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c4733-26c5-4c8f-88ed-953cade5b3fb None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:36.579332 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c4733-26c5-4c8f-88ed-953cade5b3fb None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:36.582514 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 692/1369] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:25:36.590397 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bca09-417f-4af1-be46-23ff8f05b0c7 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:36.590397 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bca09-417f-4af1-be46-23ff8f05b0c7 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:36.590397 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bca09-417f-4af1-be46-23ff8f05b0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:36.607711 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-273bca09-417f-4af1-be46-23ff8f05b0c7 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:25:36.608981 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-273bca09-417f-4af1-be46-23ff8f05b0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:25:36.618301 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 678/1370] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:25:38.069157 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fcac0-5a87-4951-937e-41f9645ed341 None None] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:38.069754 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fcac0-5a87-4951-937e-41f9645ed341 None None] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:38.069754 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7fcac0-5a87-4951-937e-41f9645ed341 None None] PATH_INFO: `/` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:38.071151 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 693/1371] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:25:38.076530 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e7ca4-ff01-4fbe-b3cf-a9587d5c0879 None None] REQUEST_METHOD: `POST` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:38.076966 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e7ca4-ff01-4fbe-b3cf-a9587d5c0879 None None] SCRIPT_NAME: `/identity` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:38.077102 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e7ca4-ff01-4fbe-b3cf-a9587d5c0879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=143282) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:38.095674 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.auth.core [None req-eb1e7ca4-ff01-4fbe-b3cf-a9587d5c0879 None None] MFA Rules not processed for user `1cdae28a6c6045309f4aaea02e9f2c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=143282) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:25:38.096870 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: DEBUG keystone.common.fernet_utils [None req-eb1e7ca4-ff01-4fbe-b3cf-a9587d5c0879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=143282) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:25:38.105328 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: [pid: 143282|app: 0|req: 679/1372] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:25:38.149883 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7fcac0-5a87-4951-937e-41f9645ed341 None None] Authenticating user token {{(pid=143281) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:25:38.165504 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7fcac0-5a87-4951-937e-41f9645ed341 None None] Validating token access rules against request {{(pid=143281) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:25:38.171572 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87481b-b8ba-47f0-abb3-899ad872b44e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42dc38d6c3634b7496b1b7e99ca3f647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb2de9bea1cf451db5f8c697f480c480', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143281) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:25:38.172222 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87481b-b8ba-47f0-abb3-899ad872b44e service nova] REQUEST_METHOD: `GET` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:25:38.172509 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87481b-b8ba-47f0-abb3-899ad872b44e service nova] SCRIPT_NAME: `/identity` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:25:38.172789 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87481b-b8ba-47f0-abb3-899ad872b44e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=143281) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:25:38.181334 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87481b-b8ba-47f0-abb3-899ad872b44e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:25:38.182990 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87481b-b8ba-47f0-abb3-899ad872b44e service nova] RBAC: Authorization granted {{(pid=143281) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:25:38.192786 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: [pid: 143281|app: 0|req: 694/1373] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:26:00.001761 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: Mon May 9 15:26:00 2022 - graceful shutdown triggered... May 09 15:26:00.002278 dv-cinder-835881-7-iscsi devstack@keystone.service[143282]: Gracefully killing worker 2 (pid: 143282)... May 09 15:26:00.002656 dv-cinder-835881-7-iscsi devstack@keystone.service[143281]: Gracefully killing worker 1 (pid: 143281)... May 09 15:26:00.005813 dv-cinder-835881-7-iscsi systemd[1]: Stopping Devstack devstack@keystone.service... May 09 15:26:01.002888 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: worker 1 buried after 1 seconds May 09 15:26:01.002888 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: worker 2 buried after 1 seconds May 09 15:26:01.003509 dv-cinder-835881-7-iscsi devstack@keystone.service[143280]: goodbye to uWSGI. May 09 15:26:01.004420 dv-cinder-835881-7-iscsi systemd[1]: devstack@keystone.service: Succeeded. May 09 15:26:01.004998 dv-cinder-835881-7-iscsi systemd[1]: Stopped Devstack devstack@keystone.service. May 09 15:31:36.698546 dv-cinder-835881-7-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 09 15:31:36.706108 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 09 15:31:36.708202 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 9 15:31:36 2022] *** May 09 15:31:36.708202 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 09 15:31:36.708202 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 09 15:31:36.708202 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: nodename: dv-cinder-835881-7-iscsi May 09 15:31:36.708202 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: machine: x86_64 May 09 15:31:36.708202 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: clock source: unix May 09 15:31:36.708202 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: pcre jit disabled May 09 15:31:36.708771 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: detected number of CPU cores: 4 May 09 15:31:36.708771 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: current working directory: / May 09 15:31:36.708771 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: detected binary path: /usr/bin/uwsgi-core May 09 15:31:36.708771 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: your processes number limit is 47680 May 09 15:31:36.708771 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: your memory page size is 4096 bytes May 09 15:31:36.708771 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: detected max file descriptor number: 2048 May 09 15:31:36.708771 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: lock engine: pthread robust mutexes May 09 15:31:36.708771 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: thunder lock: enabled May 09 15:31:36.708771 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 09 15:31:36.708771 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 09 15:31:36.760590 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: Python main interpreter initialized at 0x55f533d219c0 May 09 15:31:36.760590 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: python threads support enabled May 09 15:31:36.760590 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: your server socket listen backlog is limited to 100 connections May 09 15:31:36.760590 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: your mercy for graceful operations on workers is 90 seconds May 09 15:31:36.761030 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: mapped 403077 bytes (393 KB) for 2 cores May 09 15:31:36.761030 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: *** Operational MODE: preforking *** May 09 15:31:36.761318 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: *** uWSGI is running in multiple interpreter mode *** May 09 15:31:36.761318 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: spawned uWSGI master process (pid: 212990) May 09 15:31:36.761540 dv-cinder-835881-7-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 09 15:31:36.763360 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: spawned uWSGI worker 1 (pid: 212998, cores: 1) May 09 15:31:36.763360 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: spawned uWSGI worker 2 (pid: 212999, cores: 1) May 09 15:31:36.763360 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 09 15:31:42.600044 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:31:42.600044 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: from cryptography.utils import int_from_bytes May 09 15:31:42.601425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:31:42.601425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: from cryptography.utils import int_from_bytes May 09 15:31:42.603579 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:31:42.603579 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: from cryptography.utils import int_from_bytes May 09 15:31:42.604937 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:31:42.604937 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: from cryptography.utils import int_from_bytes May 09 15:31:42.651944 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 15:31:42.652155 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 15:31:42.652321 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] command line args: [] {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 15:31:42.652594 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 15:31:42.652773 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ================================================================================ {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 15:31:42.653033 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] admin_token = **** {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.653284 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] config_dir = [] {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.653496 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.653683 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] config_source = [] {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.653863 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] debug = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.654064 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.654417 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.654601 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] insecure_debug = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.654861 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.655117 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.655354 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] list_limit = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.655539 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] log_config_append = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.655715 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.655891 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] log_dir = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.656074 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] log_file = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.656309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.656539 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 15:31:42.656664 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.656745 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 15:31:42.656822 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.656905 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] command line args: [] {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 15:31:42.657057 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.657208 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 15:31:42.657316 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.657438 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ================================================================================ {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 15:31:42.657530 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.657648 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] admin_token = **** {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.657748 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.657896 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.657986 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] config_dir = [] {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.658135 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.658274 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.658357 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] config_source = [] {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.658432 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.658600 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] debug = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.658769 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.659495 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.659612 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.659692 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.659766 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.659943 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] insecure_debug = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.660087 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] notification_format = cadf {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.660239 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.660385 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.660653 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.660805 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.660952 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] list_limit = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.661114 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] publish_errors = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.661261 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] log_config_append = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.661456 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.661611 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.661768 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.661907 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] log_dir = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.662053 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.662198 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] log_file = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.662343 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.662504 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.662649 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.662794 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.662944 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] standard_threads = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.663089 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.663233 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] strict_password_check = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.663377 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.663524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.663681 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.663833 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] use_eventlog = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.663978 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.664124 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] use_journal = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.664283 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.664428 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] use_json = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.664428 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] use_stderr = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.664710 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.664857 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] use_syslog = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.665001 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.665138 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] watch_log_file = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.665283 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.665459 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.665627 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.665774 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.665918 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.666062 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.666206 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.666355 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.666512 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] notification_format = cadf {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.666657 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.666807 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.666958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.666958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.667234 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.667531 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.667695 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] publish_errors = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.667842 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.667996 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.668139 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.668289 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.668289 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.668563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.668708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.668857 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.669009 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.669153 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.669298 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] standard_threads = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.669457 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.669623 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] strict_password_check = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.669769 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.669919 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.670064 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.670209 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] use_eventlog = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.670347 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.670491 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] use_journal = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.670491 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] use_json = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.670771 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.670917 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] use_stderr = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.671062 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.671206 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] use_syslog = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.671344 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.671486 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] watch_log_file = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:31:42.671646 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.671790 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.671928 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.672073 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.672216 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.672367 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.672522 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.672667 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.672810 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.672956 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.673102 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.673246 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.673444 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.673608 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.673754 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.673898 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.674036 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.674181 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.674328 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.674525 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.674687 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.674826 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.674970 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.675115 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.675263 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.675414 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.675553 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.675708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.675861 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.676007 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.676156 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.676297 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.676447 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.676593 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.676738 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.676882 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.677033 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.677171 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.677315 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.677489 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.677647 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.677792 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.677946 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.677946 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.678223 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.678368 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.678518 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.678667 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.678830 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.678974 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.678974 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.679249 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.679395 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.679556 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.679695 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.679839 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.679986 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.680130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.680274 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.680429 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.680574 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.680718 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.680862 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.681007 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.681151 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.681302 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.681479 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.681646 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.681799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.681944 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.682088 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.682088 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.682389 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.682536 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.682687 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.682826 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.682970 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.683120 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.683266 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.683410 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.683566 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.683710 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.683856 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.684006 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.684152 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.684290 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.684436 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.684581 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.684735 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.684873 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.685020 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.685164 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.685312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.685488 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.685638 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.685783 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.685927 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.685927 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.686205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.686350 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.686495 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.686641 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.686790 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.686928 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.687077 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.687222 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.687365 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.687516 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.687661 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.enabled = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.687806 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.687956 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.688106 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.688251 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.688395 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.688539 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.688689 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.688844 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.688989 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.689134 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.689273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.689488 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.689634 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.689781 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.689922 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.690071 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.690210 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.690347 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.690498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.690823 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.690979 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.691120 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.691279 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.691427 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.691565 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.691720 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.691866 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.692012 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.692167 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.692313 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.692457 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.692602 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.692747 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.692897 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.693074 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.693226 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.693388 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.693544 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.693713 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.693862 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.694006 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.694160 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.694338 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.694486 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.694631 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.enabled = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.694868 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.695010 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.695155 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.695294 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.695438 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.695577 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.695727 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.695883 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.696030 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.696170 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.696314 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.696459 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.696610 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] auth.external = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.696749 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.696886 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] auth.mapped = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.697023 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.697166 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.697308 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.697526 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.697669 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.697818 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] auth.password = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.697972 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.698110 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] auth.token = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.698249 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.698404 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.698404 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] catalog.caching = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.698690 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.698835 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.698835 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.699102 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.699248 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.699388 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.699526 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.699664 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.699812 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.699951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.700100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] credential.caching = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.700250 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.700396 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] credential.driver = sql {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.700548 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.700699 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.700854 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.701017 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.701186 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.701334 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.701508 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.701654 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.701809 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.701954 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.702110 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.702266 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.702407 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.702551 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.702697 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.702841 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.703001 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.703148 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.703293 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.703431 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.703571 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] auth.external = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.703714 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.703875 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] auth.mapped = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.704021 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.704166 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.704312 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.704457 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.704603 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.704754 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] auth.password = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.704899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] federation.caching = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.705044 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] auth.token = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.705189 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.705333 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.705532 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] federation.driver = sql {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.706203 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] catalog.caching = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.706358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.706504 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.706650 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.706795 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.706934 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.707085 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.707225 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.707372 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.707510 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.707655 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.707805 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.707956 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] credential.caching = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.708101 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.708257 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] credential.driver = sql {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.708395 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.708551 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.708691 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.708839 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.708978 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] identity.caching = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.709135 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.709274 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.709443 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.709610 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.709761 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.709907 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.710053 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.710191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.710347 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.710497 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] identity.driver = sql {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.710637 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.710776 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.710921 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.711059 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.711204 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.711350 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.711495 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.711640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.711779 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.711923 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.712075 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.712232 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.712232 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.712501 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.712650 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.712795 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] federation.caching = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.712980 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.713130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.713276 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.713462 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] federation.driver = sql {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.713607 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.713747 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.713747 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.714025 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.714172 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.714329 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.714475 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.714619 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.714757 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.714908 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.715048 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.715185 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.715185 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.715473 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.715619 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.715770 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.715916 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.716063 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.716212 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.716357 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] identity.caching = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.716503 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.716654 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.716795 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.716939 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.717078 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.717224 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.717387 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.717546 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.717693 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.717838 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] identity.driver = sql {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.717984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.718129 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.718289 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.718439 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.718578 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.718578 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.718853 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.718999 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.719144 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.719293 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.password = **** {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.719438 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.719588 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.719734 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.719879 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.720024 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.720188 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.720330 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.720469 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.720607 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.720745 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.720889 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.721110 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.721110 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.722043 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.722219 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.722375 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.722538 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.722711 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.722944 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.723112 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.723266 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.723415 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.723569 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.723716 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.723868 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.724014 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.724165 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.724317 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.724472 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.user = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.724625 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.724772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.724917 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.725080 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.725234 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.725412 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.725578 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.725731 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.725876 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.726028 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.726174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.726328 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.726479 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.726639 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.726791 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.726937 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.727089 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.727258 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.727405 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.727557 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.727704 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.727855 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.728000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.728168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.728316 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.password = **** {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.728467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.728613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.728765 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.728918 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.729076 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.729259 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.729531 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.729694 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.729848 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.730001 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.730166 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.730314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.730460 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.730611 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.730764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.730916 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.731079 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.731226 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.731377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.731535 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.731680 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.731826 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.731992 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.732146 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.732301 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.732460 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.732610 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.732756 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.732920 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] policy.driver = sql {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.733073 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.user = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.733225 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.733396 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.733568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.733726 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.733884 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.734044 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.734195 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] receipt.caching = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.734341 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.734491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.734642 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.734801 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.734948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.735099 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.735099 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.735381 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.735532 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.735711 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.735858 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] resource.caching = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.736011 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.736011 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.736293 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.736438 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.736594 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] resource.driver = sql {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.736594 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.736943 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.737164 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.737361 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.737561 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.737898 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.738050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] revoke.caching = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.738223 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.738369 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.738522 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.738677 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.738824 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.738969 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] role.cache_time = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.739114 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.739261 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] role.caching = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.739261 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] role.driver = sql {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.739556 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.739709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] role.list_limit = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.739709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.740000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.740169 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.740324 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.740479 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.740633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.740779 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.740931 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.741077 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.741233 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.741469 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.741633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.741786 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.741939 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.742085 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.742231 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] policy.driver = sql {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.742396 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.742550 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.742707 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.742860 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.743012 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.743168 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.743326 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.743481 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] receipt.caching = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.743627 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.744030 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.744030 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.744307 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.744462 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.744626 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.744777 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.744931 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.745084 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.745237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.745451 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] resource.caching = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.745615 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.745762 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.745907 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.746059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] resource.driver = sql {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.746204 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.746363 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.746517 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.746690 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.746837 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.746989 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.747141 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.747300 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] revoke.caching = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.747469 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.747618 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.747770 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.747917 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.748061 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.748219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] role.cache_time = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.748366 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.748511 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] role.caching = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.748677 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.748840 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] role.driver = sql {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.748992 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.749151 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] role.list_limit = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.749297 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.749470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.749619 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.749775 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.749935 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] token.cache_time = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.750083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.750229 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] token.caching = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.750381 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.750527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.750674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.750838 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] token.provider = fernet {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.750838 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.751129 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.751129 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.751413 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.751565 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.751804 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.751961 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.752113 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.752113 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.752411 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.753083 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.753258 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.753436 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] trust.driver = sql {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.753601 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.753759 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.753913 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.754067 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.754067 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.754355 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.754509 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.754661 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.754813 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.754966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.755125 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.755279 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.755431 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.755594 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.755748 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.755901 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.755901 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.756200 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] database.connection = **** {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.756200 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.756496 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.756665 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.756813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.756960 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.757105 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.757251 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.757438 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.757604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.757750 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.757897 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.758043 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.758191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.758345 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.758503 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.758662 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.758808 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.758954 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.759107 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.759107 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.759393 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.759545 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.759702 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.759849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.759995 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] token.cache_time = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.760150 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.760304 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] token.caching = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.760451 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.760451 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.760744 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.760896 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.761055 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] token.provider = fernet {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.761209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.761397 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.761552 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=212999) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 15:31:42.761712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.761712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.761712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.761712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.761712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.761712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] trust.driver = sql {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.761712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.761712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.761712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.762977 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.762977 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.762977 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.762977 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.762977 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.762977 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] database.connection = **** {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.762977 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.762977 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.762977 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.764233 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.764233 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.764233 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.764233 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.764233 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.764233 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.764233 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.764233 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.764233 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.765575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.765575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.765575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.765575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.765575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.765575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:31:42.765575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=212998) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 15:31:42.771906 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.772146 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.772379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.776230 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.776472 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.776709 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.781394 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.786499 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.811299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.811532 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.814573 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.814813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.865316 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.866767 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.921498 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.921803 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.923349 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.923589 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.988942 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.989169 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.989422 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.989651 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.989873 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.990045 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.990153 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.990288 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.990520 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.990746 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.990969 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:42.991190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.013484 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.013715 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.013822 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.013927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.014018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.014147 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.014246 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.014365 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.014471 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.014585 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.014683 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.014801 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.014899 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.015024 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.026216 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.027003 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.041221 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.041574 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.041730 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.041833 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.041926 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.042014 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.042102 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.042189 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.042323 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.042422 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.042541 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=212999) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.042639 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.042811 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.043032 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=212998) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:31:43.059828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.060039 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:31:43.060381 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.060584 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:31:43.060672 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.060835 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:31:43.060931 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.061103 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.061197 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.061364 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.061614 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:31:43.061713 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.061802 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.061915 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.062179 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.062540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.073248 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.073558 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.073830 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.074112 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.074565 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.074854 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.075129 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.075417 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.082347 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=212999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.083981 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=212998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.085662 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=212999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.085947 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.086233 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.086629 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.086913 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.087180 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.087339 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=212998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.087437 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.087628 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.087724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.087918 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.088020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.088259 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.088354 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.088530 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.088626 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.088853 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.089132 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.089459 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.089720 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.090006 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.090283 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.116855 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.118494 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=212999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.118995 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.119103 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.120690 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=212998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.120980 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.124414 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=212999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.124695 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.124978 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.126485 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=212998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.126774 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.127061 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.132541 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=212999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.132827 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.134844 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=212998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.135134 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.137509 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=212999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.137801 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.138087 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.138368 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.138642 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.138919 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.139190 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.139460 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.139879 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=212998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.140171 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.140458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.140747 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.141030 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.141314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.141630 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.141907 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.158971 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.159285 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.161925 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.162214 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.163847 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=212999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.166909 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=212998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.167499 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.167797 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.170602 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.170903 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.172786 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=212999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.176795 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=212998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.177128 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=212999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.180429 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=212998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.180886 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.181185 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.181504 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.181793 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.182074 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.182354 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.184214 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.184521 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.184813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.185104 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.185447 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.185708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.201697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=212999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.202086 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.202358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.202625 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.205467 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=212998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.206458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.206929 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.207211 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.211148 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.212891 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.213172 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.215208 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.216287 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=212999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.216573 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.216865 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.216962 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.217151 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.217251 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.217460 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.220402 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=212998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.220688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.220981 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.221314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.221774 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.231087 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=212999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.231372 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.231655 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.231963 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.232249 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.232536 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.232831 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.235472 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=212998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.235760 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.236047 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.236344 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.236631 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.237465 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.237954 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.251772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=212999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.255345 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=212999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.257261 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=212998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.258689 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.260307 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.260583 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=212998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.262000 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=212999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.262285 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.262580 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.263960 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.265765 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.267434 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=212998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.267720 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.268018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.270578 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.272182 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=212999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.275472 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.275768 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.276048 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.276320 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.276426 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.277980 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=212998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.281250 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.281572 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.281861 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.282139 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.285722 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=212999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.286020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.286306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.291848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=212998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.292159 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.292445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.294210 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=212999) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.294492 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.294776 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.295056 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.295334 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.295620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.295904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.296186 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.296465 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.296736 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.297008 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.297270 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.297581 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.297845 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=212999) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.301546 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=212998) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:31:43.301840 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.302127 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.302407 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.302684 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.302976 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.303268 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.303551 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.303826 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.304099 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.304385 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.304662 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.304942 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.305206 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=212998) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:31:43.337804 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55f533d219c0 pid: 212999 (default app) May 09 15:31:43.341252 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b6960-e494-43e1-af80-ddfe5c26f737 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:43.341587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b6960-e494-43e1-af80-ddfe5c26f737 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:43.341874 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b6960-e494-43e1-af80-ddfe5c26f737 None None] PATH_INFO: `/v3` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:43.347068 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55f533d219c0 pid: 212998 (default app) May 09 15:31:43.347210 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Mon May 9 15:31:43 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:31:51.509615 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbe8f0-1bc0-463d-9666-d622cfdf8664 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:51.510317 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbe8f0-1bc0-463d-9666-d622cfdf8664 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:51.510317 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbe8f0-1bc0-463d-9666-d622cfdf8664 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:51.511545 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:31:51.519888 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e74e82-f2da-48af-9147-0edee61a93e4 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:51.520379 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e74e82-f2da-48af-9147-0edee61a93e4 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:51.520477 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e74e82-f2da-48af-9147-0edee61a93e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:51.551952 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG oslo_db.sqlalchemy.engines [None req-22e74e82-f2da-48af-9147-0edee61a93e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=212998) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 15:31:51.747852 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG passlib.handlers.bcrypt [None req-22e74e82-f2da-48af-9147-0edee61a93e4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=212998) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 09 15:31:51.748292 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG passlib.handlers.bcrypt [None req-22e74e82-f2da-48af-9147-0edee61a93e4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=212998) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 09 15:31:51.807684 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-22e74e82-f2da-48af-9147-0edee61a93e4 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:31:51.809365 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-22e74e82-f2da-48af-9147-0edee61a93e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:31:51.954363 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 1/3] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:31:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 09 15:31:51.981504 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbe8f0-1bc0-463d-9666-d622cfdf8664 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:52.018849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG oslo_db.sqlalchemy.engines [None req-cccbe8f0-1bc0-463d-9666-d622cfdf8664 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=212999) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 15:31:52.159500 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbe8f0-1bc0-463d-9666-d622cfdf8664 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:52.164034 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ec143-020c-4c1e-a05d-7c83637ad2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a83b0c5040146dc9a4ba09b4fd4dfe7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:52.164717 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ec143-020c-4c1e-a05d-7c83637ad2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:52.165107 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ec143-020c-4c1e-a05d-7c83637ad2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:52.165497 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ec143-020c-4c1e-a05d-7c83637ad2a3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:52.176738 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ec143-020c-4c1e-a05d-7c83637ad2a3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:52.233444 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2d8ec143-020c-4c1e-a05d-7c83637ad2a3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 09 15:31:52.233817 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ec143-020c-4c1e-a05d-7c83637ad2a3 admin admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:52.246805 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 3/4] 10.222.0.48 () {58 vars in 1324 bytes} [Mon May 9 15:31:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 09 15:31:52.253617 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e74e82-f2da-48af-9147-0edee61a93e4 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:52.271706 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e74e82-f2da-48af-9147-0edee61a93e4 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:52.276832 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81136d20-eb06-4757-8a5d-827d97003eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a83b0c5040146dc9a4ba09b4fd4dfe7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:52.278084 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81136d20-eb06-4757-8a5d-827d97003eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:52.278376 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81136d20-eb06-4757-8a5d-827d97003eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:52.278658 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81136d20-eb06-4757-8a5d-827d97003eb4 admin admin] PATH_INFO: `/v3/projects/0a83b0c5040146dc9a4ba09b4fd4dfe7` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:52.280426 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81136d20-eb06-4757-8a5d-827d97003eb4 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a83b0c5040146dc9a4ba09b4fd4dfe7)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:52.331606 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: WARNING keystone.common.rbac_enforcer.enforcer [None req-81136d20-eb06-4757-8a5d-827d97003eb4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 09 15:31:52.331951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81136d20-eb06-4757-8a5d-827d97003eb4 admin admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:52.337153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 2/5] 10.222.0.48 () {56 vars in 1207 bytes} [Mon May 9 15:31:52 2022] GET /identity/v3/projects/0a83b0c5040146dc9a4ba09b4fd4dfe7 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:31:54.781543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab8dff-fd7d-49d7-9bab-eb50e272d288 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:54.782128 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab8dff-fd7d-49d7-9bab-eb50e272d288 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:54.782128 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab8dff-fd7d-49d7-9bab-eb50e272d288 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:54.788674 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 4/6] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:31:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:31:54.795298 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77432814-de08-46f3-9659-c7c406799791 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:54.795829 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77432814-de08-46f3-9659-c7c406799791 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:54.795829 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77432814-de08-46f3-9659-c7c406799791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:54.818724 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-77432814-de08-46f3-9659-c7c406799791 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:31:54.820318 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-77432814-de08-46f3-9659-c7c406799791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:31:54.829833 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 3/7] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:31:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 09 15:31:54.855036 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab8dff-fd7d-49d7-9bab-eb50e272d288 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:54.868025 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab8dff-fd7d-49d7-9bab-eb50e272d288 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:54.873081 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92307e3-42fc-47e1-9a19-f13878c40ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a83b0c5040146dc9a4ba09b4fd4dfe7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:54.874883 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92307e3-42fc-47e1-9a19-f13878c40ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:54.875198 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92307e3-42fc-47e1-9a19-f13878c40ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:54.875483 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92307e3-42fc-47e1-9a19-f13878c40ba6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:54.885190 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92307e3-42fc-47e1-9a19-f13878c40ba6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:54.886995 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92307e3-42fc-47e1-9a19-f13878c40ba6 admin admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:54.903871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 5/8] 10.222.0.48 () {58 vars in 1324 bytes} [Mon May 9 15:31:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 09 15:31:54.910808 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77432814-de08-46f3-9659-c7c406799791 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:54.920355 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77432814-de08-46f3-9659-c7c406799791 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:54.926174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d691935-963b-40cc-95db-0402306ecb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a83b0c5040146dc9a4ba09b4fd4dfe7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:54.927065 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d691935-963b-40cc-95db-0402306ecb72 admin admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:54.927355 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d691935-963b-40cc-95db-0402306ecb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:54.927638 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d691935-963b-40cc-95db-0402306ecb72 admin admin] PATH_INFO: `/v3/users/7982ad69f6614806bd35b21cb21af8d0` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:54.929091 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d691935-963b-40cc-95db-0402306ecb72 admin admin] RBAC: Authorizing `identity:get_user(user_id=7982ad69f6614806bd35b21cb21af8d0)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:54.931008 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d691935-963b-40cc-95db-0402306ecb72 admin admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:54.933764 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 4/9] 10.222.0.48 () {56 vars in 1198 bytes} [Mon May 9 15:31:54 2022] GET /identity/v3/users/7982ad69f6614806bd35b21cb21af8d0 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:31:57.342355 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50c180-5f8d-41bd-98b6-f6b9d23a9f1f None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:57.343111 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50c180-5f8d-41bd-98b6-f6b9d23a9f1f None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:57.343111 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50c180-5f8d-41bd-98b6-f6b9d23a9f1f None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:57.344283 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:31:57.352907 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edccc5-7c2b-424c-ae76-f7cfb6b1a8c7 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:57.353507 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edccc5-7c2b-424c-ae76-f7cfb6b1a8c7 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:57.353781 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edccc5-7c2b-424c-ae76-f7cfb6b1a8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:57.395168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572520ff-ec0a-4d6f-ac9d-8791618b3aeb None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:57.395555 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572520ff-ec0a-4d6f-ac9d-8791618b3aeb None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:57.395862 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572520ff-ec0a-4d6f-ac9d-8791618b3aeb None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:57.397344 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 7/11] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:31:57.403874 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f1447-a3a1-4018-9fad-86dc66dffafc None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:57.404167 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f1447-a3a1-4018-9fad-86dc66dffafc None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:57.404462 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f1447-a3a1-4018-9fad-86dc66dffafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:57.451563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG passlib.handlers.bcrypt [None req-ec0f1447-a3a1-4018-9fad-86dc66dffafc None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=212999) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 09 15:31:57.451999 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG passlib.handlers.bcrypt [None req-ec0f1447-a3a1-4018-9fad-86dc66dffafc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=212999) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 09 15:31:57.503680 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-ec0f1447-a3a1-4018-9fad-86dc66dffafc None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:31:57.505525 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-ec0f1447-a3a1-4018-9fad-86dc66dffafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:31:57.518357 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-08edccc5-7c2b-424c-ae76-f7cfb6b1a8c7 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:31:57.520508 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-08edccc5-7c2b-424c-ae76-f7cfb6b1a8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:31:57.620797 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 5/12] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:31:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:31:57.629013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 8/13] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:31:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:31:57.644083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edccc5-7c2b-424c-ae76-f7cfb6b1a8c7 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:57.654312 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f1447-a3a1-4018-9fad-86dc66dffafc None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:57.764843 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edccc5-7c2b-424c-ae76-f7cfb6b1a8c7 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:57.771445 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f1447-a3a1-4018-9fad-86dc66dffafc None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:57.815353 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfd9e9-104c-4ff3-82d1-be23c789e8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:57.816169 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfd9e9-104c-4ff3-82d1-be23c789e8c3 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:57.816539 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfd9e9-104c-4ff3-82d1-be23c789e8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:57.816829 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfd9e9-104c-4ff3-82d1-be23c789e8c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:57.817777 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1318b-c44f-4fba-b91d-84168e6f1c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:57.819096 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1318b-c44f-4fba-b91d-84168e6f1c89 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:57.819652 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1318b-c44f-4fba-b91d-84168e6f1c89 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:57.820001 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1318b-c44f-4fba-b91d-84168e6f1c89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:57.829989 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfd9e9-104c-4ff3-82d1-be23c789e8c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:31:57.842221 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-a1dfd9e9-104c-4ff3-82d1-be23c789e8c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:31:57.842221 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:31:57.842221 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:31:57.842221 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:31:57.842221 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:31:57.842221 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:31:57.842221 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:31:57.842221 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:31:57.842221 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:31:57.842221 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:31:57.842221 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:31:57.842221 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:31:57.842221 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:31:57.842221 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:31:57.842221 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:31:57.842221 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:31:57.843470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:31:57.843470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:31:57.843470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:31:57.843470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:31:57.843470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:31:57.843470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:31:57.843470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:31:57.843470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:31:57.843470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:31:57.843470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:31:57.843470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:31:57.843470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:31:57.843470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:31:57.843470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:31:57.843470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:31:57.843470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:31:57.844896 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:31:57.844896 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:31:57.844896 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:31:57.844896 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:31:57.844896 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:31:57.844896 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:31:57.844896 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:31:57.844896 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:31:57.844896 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:31:57.844896 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:31:57.844896 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:31:57.844896 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:31:57.844896 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 6/14] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:31:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:31:57.850153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfd9e9-104c-4ff3-82d1-be23c789e8c3 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:57.910813 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1318b-c44f-4fba-b91d-84168e6f1c89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:57.912435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1318b-c44f-4fba-b91d-84168e6f1c89 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:57.966253 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfd9e9-104c-4ff3-82d1-be23c789e8c3 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:58.003426 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f05395-4510-42ee-b0d9-96820340cf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:58.004099 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f05395-4510-42ee-b0d9-96820340cf1c None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:58.004385 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f05395-4510-42ee-b0d9-96820340cf1c None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:58.004656 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f05395-4510-42ee-b0d9-96820340cf1c None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:58.005444 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f05395-4510-42ee-b0d9-96820340cf1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:31:58.005752 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f05395-4510-42ee-b0d9-96820340cf1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:58.007641 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f05395-4510-42ee-b0d9-96820340cf1c None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:58.020070 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 7/15] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:31:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:31:58.026554 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f05395-4510-42ee-b0d9-96820340cf1c None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:58.031896 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 9/16] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:31:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:31:58.038165 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1318b-c44f-4fba-b91d-84168e6f1c89 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:58.133784 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f05395-4510-42ee-b0d9-96820340cf1c None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:58.155720 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1318b-c44f-4fba-b91d-84168e6f1c89 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:58.181136 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcbc20-f8e9-48b0-a016-8eda73bc0bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:58.182645 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcbc20-f8e9-48b0-a016-8eda73bc0bdb None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:58.183135 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcbc20-f8e9-48b0-a016-8eda73bc0bdb None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:58.183420 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcbc20-f8e9-48b0-a016-8eda73bc0bdb None admin] PATH_INFO: `/v3/users/7982ad69f6614806bd35b21cb21af8d0` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:58.185631 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcbc20-f8e9-48b0-a016-8eda73bc0bdb None admin] RBAC: Authorizing `identity:get_user(user_id=7982ad69f6614806bd35b21cb21af8d0)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:58.187960 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcbc20-f8e9-48b0-a016-8eda73bc0bdb None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:58.190797 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 8/17] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:31:58 2022] GET /identity/v3/users/7982ad69f6614806bd35b21cb21af8d0 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:31:58.191285 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3890db-e0de-418b-847f-f5ba7cd15a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:58.192157 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3890db-e0de-418b-847f-f5ba7cd15a07 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:58.192443 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3890db-e0de-418b-847f-f5ba7cd15a07 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:58.192725 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3890db-e0de-418b-847f-f5ba7cd15a07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:58.199573 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcbc20-f8e9-48b0-a016-8eda73bc0bdb None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:58.324394 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3890db-e0de-418b-847f-f5ba7cd15a07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:58.325943 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3890db-e0de-418b-847f-f5ba7cd15a07 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:58.345957 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcbc20-f8e9-48b0-a016-8eda73bc0bdb None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:58.350942 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-de3890db-e0de-418b-847f-f5ba7cd15a07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:31:58.350942 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:31:58.350942 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:31:58.350942 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:31:58.350942 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:31:58.350942 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:31:58.350942 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:31:58.350942 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:31:58.350942 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:31:58.350942 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:31:58.350942 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:31:58.350942 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:31:58.350942 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:31:58.350942 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:31:58.350942 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:31:58.352216 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:31:58.352216 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:31:58.352216 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:31:58.352216 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:31:58.352216 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:31:58.352216 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:31:58.352216 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:31:58.352216 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:31:58.352216 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:31:58.352216 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:31:58.352216 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:31:58.352216 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:31:58.352216 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:31:58.352216 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:31:58.352216 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:31:58.352216 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:31:58.352216 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:31:58.353287 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:31:58.353287 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:31:58.353287 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:31:58.353287 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:31:58.353287 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 10/18] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:31:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:31:58.358533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3890db-e0de-418b-847f-f5ba7cd15a07 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:58.385883 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c4010-e5b0-48f0-a87e-36c1e8b41955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:58.386696 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c4010-e5b0-48f0-a87e-36c1e8b41955 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:58.386986 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c4010-e5b0-48f0-a87e-36c1e8b41955 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:58.387267 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c4010-e5b0-48f0-a87e-36c1e8b41955 None admin] PATH_INFO: `/v3/domains/default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:58.388502 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c4010-e5b0-48f0-a87e-36c1e8b41955 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:58.390238 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c4010-e5b0-48f0-a87e-36c1e8b41955 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:58.392343 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 9/19] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:31:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:31:58.399152 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c4010-e5b0-48f0-a87e-36c1e8b41955 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:31:58.504601 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3890db-e0de-418b-847f-f5ba7cd15a07 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:58.509636 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c4010-e5b0-48f0-a87e-36c1e8b41955 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:31:58.544742 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0708742-e03a-446d-a620-fa0d8253553d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:58.545553 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0708742-e03a-446d-a620-fa0d8253553d None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:58.545898 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0708742-e03a-446d-a620-fa0d8253553d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:58.546132 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0708742-e03a-446d-a620-fa0d8253553d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:58.547066 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0708742-e03a-446d-a620-fa0d8253553d None admin] RBAC: Adding query filter params (role.id=a5cb8d37261d486cbc1b06d167a9c05c, scope.domain.id=default, user.id=7982ad69f6614806bd35b21cb21af8d0) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:31:58.547413 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0708742-e03a-446d-a620-fa0d8253553d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:58.548974 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0708742-e03a-446d-a620-fa0d8253553d None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:58.554955 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94784b48-b07a-4da5-b625-c8a143f0d656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:31:58.555744 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94784b48-b07a-4da5-b625-c8a143f0d656 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:31:58.556030 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94784b48-b07a-4da5-b625-c8a143f0d656 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:31:58.556353 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94784b48-b07a-4da5-b625-c8a143f0d656 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:31:58.557147 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94784b48-b07a-4da5-b625-c8a143f0d656 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:31:58.557595 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94784b48-b07a-4da5-b625-c8a143f0d656 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:31:58.573407 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 10/20] 10.222.0.48 () {56 vars in 1322 bytes} [Mon May 9 15:31:58 2022] GET /identity/v3/role_assignments?user.id=7982ad69f6614806bd35b21cb21af8d0&scope.domain.id=default&role.id=a5cb8d37261d486cbc1b06d167a9c05c => generated 233 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:31:58.573678 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94784b48-b07a-4da5-b625-c8a143f0d656 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:31:58.581531 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 11/21] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:01.414738 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e53079-0e9f-4cb8-8a41-a66148039ccb None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:01.415834 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e53079-0e9f-4cb8-8a41-a66148039ccb None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:01.416359 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e53079-0e9f-4cb8-8a41-a66148039ccb None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:01.418449 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 11/22] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:01.424713 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0598957-4f76-4db4-aa5b-d8a2bc30e47e None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:01.425965 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0598957-4f76-4db4-aa5b-d8a2bc30e47e None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:01.426496 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0598957-4f76-4db4-aa5b-d8a2bc30e47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:01.449520 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-f0598957-4f76-4db4-aa5b-d8a2bc30e47e None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:01.450759 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-f0598957-4f76-4db4-aa5b-d8a2bc30e47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:01.549849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 12/23] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:01.586837 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e53079-0e9f-4cb8-8a41-a66148039ccb None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:01.723303 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e53079-0e9f-4cb8-8a41-a66148039ccb None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:01.769643 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c499bcc-44de-4179-a060-3aba0e843a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:01.770462 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c499bcc-44de-4179-a060-3aba0e843a16 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:01.770756 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c499bcc-44de-4179-a060-3aba0e843a16 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:01.771045 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c499bcc-44de-4179-a060-3aba0e843a16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:01.788076 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c499bcc-44de-4179-a060-3aba0e843a16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:01.795039 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e48c5-ead2-432b-a10a-4859c9131b1d None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:01.795666 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e48c5-ead2-432b-a10a-4859c9131b1d None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:01.796181 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e48c5-ead2-432b-a10a-4859c9131b1d None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:01.796767 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-0c499bcc-44de-4179-a060-3aba0e843a16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:32:01.796767 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:01.796767 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:01.796767 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:01.796767 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:01.796767 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:01.796767 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:01.796767 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:01.796767 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:01.796767 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:01.796767 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:01.796767 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:01.796767 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:01.796767 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:01.796767 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:01.796767 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:01.797742 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:01.797742 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:01.797742 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:01.797742 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:01.797742 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:01.797742 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:01.797742 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:01.797742 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:01.797742 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:01.797742 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:01.797742 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:01.797742 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:32:01.797742 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:01.797742 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:01.797742 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:01.797742 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:01.798689 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:01.798689 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:01.798689 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:01.798689 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:01.798689 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:01.798689 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:01.798689 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:01.798689 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:01.798689 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:01.798689 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:01.798689 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:32:01.798689 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:32:01.798689 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 12/24] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:32:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:01.802508 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 13/25] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:01.808795 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c499bcc-44de-4179-a060-3aba0e843a16 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:01.810618 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5b4b7-f830-4b81-bedb-b479b34e254f None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:01.813443 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5b4b7-f830-4b81-bedb-b479b34e254f None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:01.813889 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5b4b7-f830-4b81-bedb-b479b34e254f None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:01.816948 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 14/26] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:01.818427 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72422fe-8fa6-4cda-b34f-6f03181a1e97 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:01.820875 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72422fe-8fa6-4cda-b34f-6f03181a1e97 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:01.821182 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72422fe-8fa6-4cda-b34f-6f03181a1e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:01.851732 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-c72422fe-8fa6-4cda-b34f-6f03181a1e97 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:01.854235 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-c72422fe-8fa6-4cda-b34f-6f03181a1e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:01.960522 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c499bcc-44de-4179-a060-3aba0e843a16 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:01.970805 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 15/27] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:01.972311 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127849a-2764-42dc-8b1c-eb14420f8d03 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:01.972603 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127849a-2764-42dc-8b1c-eb14420f8d03 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:01.972881 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127849a-2764-42dc-8b1c-eb14420f8d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:01.998517 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-2127849a-2764-42dc-8b1c-eb14420f8d03 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:01.999666 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-2127849a-2764-42dc-8b1c-eb14420f8d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:02.002107 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d8fb4-d8c5-4bfe-9318-e1266eb75fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:02.003027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d8fb4-d8c5-4bfe-9318-e1266eb75fda None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:02.003534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d8fb4-d8c5-4bfe-9318-e1266eb75fda None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:02.003832 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d8fb4-d8c5-4bfe-9318-e1266eb75fda None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:02.004596 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d8fb4-d8c5-4bfe-9318-e1266eb75fda None admin] RBAC: Adding query filter params (name=admin) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:02.004914 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d8fb4-d8c5-4bfe-9318-e1266eb75fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:02.006359 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d8fb4-d8c5-4bfe-9318-e1266eb75fda None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:02.023676 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 13/28] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:02.024316 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d8fb4-d8c5-4bfe-9318-e1266eb75fda None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:02.156689 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d8fb4-d8c5-4bfe-9318-e1266eb75fda None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:02.170887 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 16/29] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:02.171556 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127849a-2764-42dc-8b1c-eb14420f8d03 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:02.200760 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb597109-48d7-4444-a526-edcb87b4858e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:02.201810 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb597109-48d7-4444-a526-edcb87b4858e None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:02.202174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb597109-48d7-4444-a526-edcb87b4858e None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:02.202559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb597109-48d7-4444-a526-edcb87b4858e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:02.218156 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb597109-48d7-4444-a526-edcb87b4858e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:02.220132 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb597109-48d7-4444-a526-edcb87b4858e None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:02.243427 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-eb597109-48d7-4444-a526-edcb87b4858e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:02.243427 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:02.243427 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:02.243427 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:02.243427 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:02.243427 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:02.243427 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:02.243427 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:02.243427 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:02.243427 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:02.243427 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:02.243427 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:02.243427 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:32:02.243427 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:32:02.243427 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:32:02.244848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:32:02.244848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:02.244848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:02.244848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:02.244848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:02.244848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:02.244848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:02.244848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:02.244848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:32:02.244848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:02.244848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:02.244848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:02.244848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:02.244848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:02.244848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:02.244848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:02.244848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:02.245833 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:32:02.245833 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:32:02.245833 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:32:02.245833 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:32:02.245833 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 14/30] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:32:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:02.250527 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb597109-48d7-4444-a526-edcb87b4858e None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:02.341982 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127849a-2764-42dc-8b1c-eb14420f8d03 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:02.385505 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa1c06-fc84-4348-b0a1-82595a9268cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:02.386407 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa1c06-fc84-4348-b0a1-82595a9268cd None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:02.386697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa1c06-fc84-4348-b0a1-82595a9268cd None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:02.386977 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa1c06-fc84-4348-b0a1-82595a9268cd None admin] PATH_INFO: `/v3/users/7982ad69f6614806bd35b21cb21af8d0` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:02.389767 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa1c06-fc84-4348-b0a1-82595a9268cd None admin] RBAC: Authorizing `identity:get_user(user_id=7982ad69f6614806bd35b21cb21af8d0)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:02.391274 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa1c06-fc84-4348-b0a1-82595a9268cd None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:02.393781 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 17/31] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:02 2022] GET /identity/v3/users/7982ad69f6614806bd35b21cb21af8d0 => generated 247 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:02.395684 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa1c06-fc84-4348-b0a1-82595a9268cd None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:02.505930 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb597109-48d7-4444-a526-edcb87b4858e None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:02.525673 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa1c06-fc84-4348-b0a1-82595a9268cd None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:02.556616 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1628b0f-56f4-4544-976c-1a83461e5f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:02.557879 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1628b0f-56f4-4544-976c-1a83461e5f5e None admin] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:02.558690 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1628b0f-56f4-4544-976c-1a83461e5f5e None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:02.559453 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1628b0f-56f4-4544-976c-1a83461e5f5e None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:02.560447 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1628b0f-56f4-4544-976c-1a83461e5f5e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:02.562103 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1628b0f-56f4-4544-976c-1a83461e5f5e None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:02.563190 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011b246-7aad-405e-a6e2-5f1e85ad6912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:02.563873 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011b246-7aad-405e-a6e2-5f1e85ad6912 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:02.564164 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011b246-7aad-405e-a6e2-5f1e85ad6912 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:02.564446 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011b246-7aad-405e-a6e2-5f1e85ad6912 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:02.565788 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011b246-7aad-405e-a6e2-5f1e85ad6912 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:02.566104 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011b246-7aad-405e-a6e2-5f1e85ad6912 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:02.567503 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011b246-7aad-405e-a6e2-5f1e85ad6912 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:02.582259 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 18/32] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:02.583345 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011b246-7aad-405e-a6e2-5f1e85ad6912 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:02.717264 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 15/33] 10.222.0.48 () {60 vars in 1131 bytes} [Mon May 9 15:32:02 2022] POST /identity/v3/roles => generated 219 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:32:02.719097 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93025b-36bb-48d3-94da-08ad1205519a None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:02.719216 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93025b-36bb-48d3-94da-08ad1205519a None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:02.719466 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93025b-36bb-48d3-94da-08ad1205519a None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:02.720826 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 16/34] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:02.722304 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93025b-36bb-48d3-94da-08ad1205519a None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:02.723135 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011b246-7aad-405e-a6e2-5f1e85ad6912 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:02.764631 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29124005-1f0c-419e-b004-ba0eb916c357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:02.765803 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29124005-1f0c-419e-b004-ba0eb916c357 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:02.766311 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29124005-1f0c-419e-b004-ba0eb916c357 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:02.766843 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29124005-1f0c-419e-b004-ba0eb916c357 None admin] PATH_INFO: `/v3/domains/default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:02.768544 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29124005-1f0c-419e-b004-ba0eb916c357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:02.770330 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29124005-1f0c-419e-b004-ba0eb916c357 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:02.772272 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 19/35] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:32:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:02.781753 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cd92f-bbac-467d-b0df-d1b4ad1711bc None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:02.782382 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cd92f-bbac-467d-b0df-d1b4ad1711bc None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:02.782868 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cd92f-bbac-467d-b0df-d1b4ad1711bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:02.818614 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-1c6cd92f-bbac-467d-b0df-d1b4ad1711bc None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:02.820304 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-1c6cd92f-bbac-467d-b0df-d1b4ad1711bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:02.850328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93025b-36bb-48d3-94da-08ad1205519a None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:02.903682 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00874594-e0f2-44a2-9122-b932584ecbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:02.904666 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00874594-e0f2-44a2-9122-b932584ecbd1 None admin] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:02.905038 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00874594-e0f2-44a2-9122-b932584ecbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:02.905514 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00874594-e0f2-44a2-9122-b932584ecbd1 None admin] PATH_INFO: `/v3/projects` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:02.906817 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00874594-e0f2-44a2-9122-b932584ecbd1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:02.909654 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00874594-e0f2-44a2-9122-b932584ecbd1 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:02.911854 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 20/36] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:02.913031 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cd92f-bbac-467d-b0df-d1b4ad1711bc None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:02.950235 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 17/37] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:32:02 2022] POST /identity/v3/projects => generated 301 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:32:02.951571 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620ade9-1592-4b85-8ca5-8e07ada28be4 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:02.951874 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620ade9-1592-4b85-8ca5-8e07ada28be4 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:02.952164 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620ade9-1592-4b85-8ca5-8e07ada28be4 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:02.960337 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 18/38] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:02.961726 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620ade9-1592-4b85-8ca5-8e07ada28be4 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:03.074735 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cd92f-bbac-467d-b0df-d1b4ad1711bc None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:03.138756 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe311819-2a0b-45a9-bba7-d88deb4d4e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:03.140124 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe311819-2a0b-45a9-bba7-d88deb4d4e4e None admin] REQUEST_METHOD: `PUT` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:03.140586 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe311819-2a0b-45a9-bba7-d88deb4d4e4e None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:03.141040 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe311819-2a0b-45a9-bba7-d88deb4d4e4e None admin] PATH_INFO: `/v3/domains/default/users/7982ad69f6614806bd35b21cb21af8d0/roles/a5cb8d37261d486cbc1b06d167a9c05c` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:03.142384 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620ade9-1592-4b85-8ca5-8e07ada28be4 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:03.144062 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe311819-2a0b-45a9-bba7-d88deb4d4e4e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7982ad69f6614806bd35b21cb21af8d0, role_id=a5cb8d37261d486cbc1b06d167a9c05c)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:03.147553 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe311819-2a0b-45a9-bba7-d88deb4d4e4e None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:03.191168 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c0892-01a7-40dc-9ff5-c01e1f70a874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:03.191903 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c0892-01a7-40dc-9ff5-c01e1f70a874 None admin] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:03.192214 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c0892-01a7-40dc-9ff5-c01e1f70a874 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:03.192478 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c0892-01a7-40dc-9ff5-c01e1f70a874 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:03.193307 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c0892-01a7-40dc-9ff5-c01e1f70a874 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:03.194794 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c0892-01a7-40dc-9ff5-c01e1f70a874 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:03.209600 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1131 bytes} [Mon May 9 15:32:02 2022] POST /identity/v3/roles => generated 225 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:32:03.213430 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9779377-75b2-4675-9f3b-571980f1c1b5 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:03.213430 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9779377-75b2-4675-9f3b-571980f1c1b5 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:03.213430 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9779377-75b2-4675-9f3b-571980f1c1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:03.231072 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-d9779377-75b2-4675-9f3b-571980f1c1b5 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:03.232764 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-d9779377-75b2-4675-9f3b-571980f1c1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:03.284942 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 21/40] 10.222.0.48 () {58 vars in 1361 bytes} [Mon May 9 15:32:02 2022] PUT /identity/v3/domains/default/users/7982ad69f6614806bd35b21cb21af8d0/roles/a5cb8d37261d486cbc1b06d167a9c05c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:32:03.291271 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2c253-3335-4b4a-8672-008e40132c94 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:03.291616 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2c253-3335-4b4a-8672-008e40132c94 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:03.291860 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2c253-3335-4b4a-8672-008e40132c94 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:03.296650 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 22/41] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:03 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:03.305159 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5453a-ba91-4824-8096-cf9cbd1b7d4a None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:03.305493 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5453a-ba91-4824-8096-cf9cbd1b7d4a None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:03.305782 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5453a-ba91-4824-8096-cf9cbd1b7d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:03.322163 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 20/42] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:03.346751 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-07a5453a-ba91-4824-8096-cf9cbd1b7d4a None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:03.349057 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-07a5453a-ba91-4824-8096-cf9cbd1b7d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:03.351802 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9779377-75b2-4675-9f3b-571980f1c1b5 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:03.451372 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 23/43] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:03.476883 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5453a-ba91-4824-8096-cf9cbd1b7d4a None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:03.495701 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9779377-75b2-4675-9f3b-571980f1c1b5 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:03.533514 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efff6ec-147e-4e2a-aab5-eca6515d91dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:03.534530 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efff6ec-147e-4e2a-aab5-eca6515d91dc None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:03.534818 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efff6ec-147e-4e2a-aab5-eca6515d91dc None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:03.535098 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efff6ec-147e-4e2a-aab5-eca6515d91dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:03.536328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efff6ec-147e-4e2a-aab5-eca6515d91dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:03.538016 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efff6ec-147e-4e2a-aab5-eca6515d91dc None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:03.539670 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 21/44] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:32:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:03.545181 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efff6ec-147e-4e2a-aab5-eca6515d91dc None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:03.620335 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5453a-ba91-4824-8096-cf9cbd1b7d4a None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:03.654760 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efff6ec-147e-4e2a-aab5-eca6515d91dc None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:03.659970 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769aa56-eb42-4499-aaa6-1c6a8540d0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:03.660666 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769aa56-eb42-4499-aaa6-1c6a8540d0f3 None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:03.660957 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769aa56-eb42-4499-aaa6-1c6a8540d0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:03.661244 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769aa56-eb42-4499-aaa6-1c6a8540d0f3 None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:03.662060 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769aa56-eb42-4499-aaa6-1c6a8540d0f3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:03.663618 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769aa56-eb42-4499-aaa6-1c6a8540d0f3 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:03.681282 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 24/45] 10.222.0.48 () {60 vars in 1131 bytes} [Mon May 9 15:32:03 2022] POST /identity/v3/roles => generated 223 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:32:03.705362 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059eed2d-9bce-429f-bf36-1aac2aad141a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:03.706390 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eed2d-9bce-429f-bf36-1aac2aad141a None admin] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:03.706800 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eed2d-9bce-429f-bf36-1aac2aad141a None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:03.707201 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eed2d-9bce-429f-bf36-1aac2aad141a None admin] PATH_INFO: `/v3/projects` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:03.708367 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059eed2d-9bce-429f-bf36-1aac2aad141a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:03.710794 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059eed2d-9bce-429f-bf36-1aac2aad141a None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:03.745339 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 22/46] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:32:03 2022] POST /identity/v3/projects => generated 312 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:32:05.697782 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa8bc7-dc06-47f0-9c95-cc85f437108d None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:05.698356 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa8bc7-dc06-47f0-9c95-cc85f437108d None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:05.698459 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa8bc7-dc06-47f0-9c95-cc85f437108d None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:05.700682 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 25/47] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:05.706689 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a7aad-1270-4b7e-aad6-f9225800900c None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:05.707248 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a7aad-1270-4b7e-aad6-f9225800900c None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:05.707350 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a7aad-1270-4b7e-aad6-f9225800900c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:05.724143 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-820a7aad-1270-4b7e-aad6-f9225800900c None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:05.725354 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-820a7aad-1270-4b7e-aad6-f9225800900c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:05.792741 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 23/48] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:05.816901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa8bc7-dc06-47f0-9c95-cc85f437108d None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:05.923122 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa8bc7-dc06-47f0-9c95-cc85f437108d None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:05.956303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78230edb-01b9-4924-8544-71f2f5c138ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:05.957290 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78230edb-01b9-4924-8544-71f2f5c138ab None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:05.957609 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78230edb-01b9-4924-8544-71f2f5c138ab None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:05.957890 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78230edb-01b9-4924-8544-71f2f5c138ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:05.969633 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78230edb-01b9-4924-8544-71f2f5c138ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:05.979292 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-78230edb-01b9-4924-8544-71f2f5c138ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:32:05.979292 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:05.979292 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:05.979292 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:05.979292 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:05.979292 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:05.979292 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:05.979292 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:05.979292 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:05.979292 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:05.979292 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:05.979292 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:05.979292 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:05.979292 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:05.979292 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:05.979292 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:05.980425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:05.980425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:05.980425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:05.980425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:05.980425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:05.980425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:05.980425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:05.980425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:05.980425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:05.980425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:05.980425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:05.980425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:32:05.980425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:05.980425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:05.980425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:05.980425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:05.982734 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:05.982734 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:05.982734 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:05.982734 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:05.982734 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:05.982734 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:05.982734 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:05.982734 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:05.982734 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:05.982734 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:05.982734 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:32:05.982734 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:32:05.982734 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 26/49] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:32:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:32:05.986413 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a7aad-1270-4b7e-aad6-f9225800900c None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:06.070658 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4704a-ed09-45e5-a464-31fe54927d5f None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:06.070952 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4704a-ed09-45e5-a464-31fe54927d5f None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:06.071252 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4704a-ed09-45e5-a464-31fe54927d5f None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:06.072673 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 27/50] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:32:06.078132 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8658afa-5ff5-4b37-95dd-b65ccca61e28 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:06.078436 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8658afa-5ff5-4b37-95dd-b65ccca61e28 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:06.078725 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8658afa-5ff5-4b37-95dd-b65ccca61e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:06.087837 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a7aad-1270-4b7e-aad6-f9225800900c None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:06.098917 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-b8658afa-5ff5-4b37-95dd-b65ccca61e28 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:06.100275 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-b8658afa-5ff5-4b37-95dd-b65ccca61e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:06.122882 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43c6ba-d58d-4a19-9db1-98fc388cf799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:06.123565 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43c6ba-d58d-4a19-9db1-98fc388cf799 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:06.123855 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43c6ba-d58d-4a19-9db1-98fc388cf799 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:06.124135 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43c6ba-d58d-4a19-9db1-98fc388cf799 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:06.124903 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43c6ba-d58d-4a19-9db1-98fc388cf799 None admin] RBAC: Adding query filter params (name=admin) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:06.125218 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43c6ba-d58d-4a19-9db1-98fc388cf799 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:06.126714 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43c6ba-d58d-4a19-9db1-98fc388cf799 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:06.135877 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 24/51] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:06.141482 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43c6ba-d58d-4a19-9db1-98fc388cf799 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:06.170540 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 28/52] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:32:06.195076 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8658afa-5ff5-4b37-95dd-b65ccca61e28 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:06.240340 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43c6ba-d58d-4a19-9db1-98fc388cf799 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:06.278200 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36b422-ba3f-4319-9180-a042f70cae93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:06.279080 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36b422-ba3f-4319-9180-a042f70cae93 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:06.279371 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36b422-ba3f-4319-9180-a042f70cae93 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:06.279658 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36b422-ba3f-4319-9180-a042f70cae93 None admin] PATH_INFO: `/v3/users/7982ad69f6614806bd35b21cb21af8d0` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:06.280939 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36b422-ba3f-4319-9180-a042f70cae93 None admin] RBAC: Authorizing `identity:get_user(user_id=7982ad69f6614806bd35b21cb21af8d0)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:06.282487 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36b422-ba3f-4319-9180-a042f70cae93 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:06.284907 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 25/53] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:06 2022] GET /identity/v3/users/7982ad69f6614806bd35b21cb21af8d0 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:06.290546 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36b422-ba3f-4319-9180-a042f70cae93 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:06.307764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8658afa-5ff5-4b37-95dd-b65ccca61e28 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:06.351355 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05246bfc-9604-44db-b7b1-281dcb7480c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:06.352174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05246bfc-9604-44db-b7b1-281dcb7480c3 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:06.352472 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05246bfc-9604-44db-b7b1-281dcb7480c3 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:06.352760 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05246bfc-9604-44db-b7b1-281dcb7480c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:06.354035 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05246bfc-9604-44db-b7b1-281dcb7480c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:06.355525 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05246bfc-9604-44db-b7b1-281dcb7480c3 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:06.357178 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 29/54] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:32:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:06.363920 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05246bfc-9604-44db-b7b1-281dcb7480c3 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:06.394092 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36b422-ba3f-4319-9180-a042f70cae93 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:06.427528 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf5e14-1ac3-4ebe-a666-f4119dab3cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:06.428334 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf5e14-1ac3-4ebe-a666-f4119dab3cc5 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:06.428624 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf5e14-1ac3-4ebe-a666-f4119dab3cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:06.428902 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf5e14-1ac3-4ebe-a666-f4119dab3cc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:06.430253 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf5e14-1ac3-4ebe-a666-f4119dab3cc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:06.431729 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf5e14-1ac3-4ebe-a666-f4119dab3cc5 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:06.433409 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 26/55] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:32:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:06.439429 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf5e14-1ac3-4ebe-a666-f4119dab3cc5 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:06.466491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05246bfc-9604-44db-b7b1-281dcb7480c3 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:06.501455 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c7157-087a-461c-ac87-d805a7e07e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:06.502123 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c7157-087a-461c-ac87-d805a7e07e4c None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:06.502857 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c7157-087a-461c-ac87-d805a7e07e4c None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:06.503151 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c7157-087a-461c-ac87-d805a7e07e4c None admin] PATH_INFO: `/v3/projects` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:06.503886 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c7157-087a-461c-ac87-d805a7e07e4c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:06.505400 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c7157-087a-461c-ac87-d805a7e07e4c None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:06.533121 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 30/56] 10.222.0.48 () {60 vars in 1140 bytes} [Mon May 9 15:32:06 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:32:06.539412 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf5e14-1ac3-4ebe-a666-f4119dab3cc5 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:06.576377 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211909e-29e1-4e50-912c-d8f9f29641f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:06.577059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211909e-29e1-4e50-912c-d8f9f29641f7 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:06.577354 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211909e-29e1-4e50-912c-d8f9f29641f7 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:06.577698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211909e-29e1-4e50-912c-d8f9f29641f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:06.578569 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211909e-29e1-4e50-912c-d8f9f29641f7 None admin] RBAC: Adding query filter params (role.id=a5cb8d37261d486cbc1b06d167a9c05c, scope.domain.id=default, user.id=7982ad69f6614806bd35b21cb21af8d0) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:06.578886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211909e-29e1-4e50-912c-d8f9f29641f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:06.580942 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211909e-29e1-4e50-912c-d8f9f29641f7 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:06.587527 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 27/57] 10.222.0.48 () {56 vars in 1322 bytes} [Mon May 9 15:32:06 2022] GET /identity/v3/role_assignments?user.id=7982ad69f6614806bd35b21cb21af8d0&scope.domain.id=default&role.id=a5cb8d37261d486cbc1b06d167a9c05c => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:08.849963 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2ee64-b755-4a96-b3bd-86b8268057ac None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:08.850513 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2ee64-b755-4a96-b3bd-86b8268057ac None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:08.850617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2ee64-b755-4a96-b3bd-86b8268057ac None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:08.851927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 31/58] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:08.857102 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea32422-120a-413a-8777-b73252db88f4 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:08.857555 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea32422-120a-413a-8777-b73252db88f4 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:08.857688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea32422-120a-413a-8777-b73252db88f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:08.874718 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-9ea32422-120a-413a-8777-b73252db88f4 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:08.875961 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-9ea32422-120a-413a-8777-b73252db88f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:08.940604 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 28/59] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:08.964993 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2ee64-b755-4a96-b3bd-86b8268057ac None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:09.064622 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2ee64-b755-4a96-b3bd-86b8268057ac None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:09.097963 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cba936-82a1-4d9f-bbab-7d2f29a4ed1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:09.099094 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cba936-82a1-4d9f-bbab-7d2f29a4ed1c None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:09.099470 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cba936-82a1-4d9f-bbab-7d2f29a4ed1c None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:09.099908 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cba936-82a1-4d9f-bbab-7d2f29a4ed1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:09.101111 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cba936-82a1-4d9f-bbab-7d2f29a4ed1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:09.102626 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cba936-82a1-4d9f-bbab-7d2f29a4ed1c None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:09.104256 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 32/60] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:32:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:09.109829 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea32422-120a-413a-8777-b73252db88f4 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:09.207486 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea32422-120a-413a-8777-b73252db88f4 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:09.245356 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee6df0-adb4-4e3e-b340-6e58ee2bb6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:09.246073 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee6df0-adb4-4e3e-b340-6e58ee2bb6dc None admin] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:09.246367 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee6df0-adb4-4e3e-b340-6e58ee2bb6dc None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:09.246654 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee6df0-adb4-4e3e-b340-6e58ee2bb6dc None admin] PATH_INFO: `/v3/users` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:09.247387 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee6df0-adb4-4e3e-b340-6e58ee2bb6dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:09.248863 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee6df0-adb4-4e3e-b340-6e58ee2bb6dc None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:09.274423 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 29/61] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:32:09 2022] POST /identity/v3/users => generated 275 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:32:12.871577 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89f894-59ce-4d2d-91b8-da80ab268c6d None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:12.872955 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89f894-59ce-4d2d-91b8-da80ab268c6d None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:12.873996 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89f894-59ce-4d2d-91b8-da80ab268c6d None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:12.876074 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 33/62] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:12.882050 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793624c-549f-429c-9737-2493f17564a4 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:12.882581 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793624c-549f-429c-9737-2493f17564a4 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:12.882674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793624c-549f-429c-9737-2493f17564a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:12.909739 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-6793624c-549f-429c-9737-2493f17564a4 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:12.911014 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-6793624c-549f-429c-9737-2493f17564a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:12.999035 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b66215-e2f7-4efe-bdff-4bb49f44c474 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:12.999612 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b66215-e2f7-4efe-bdff-4bb49f44c474 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:13.000047 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b66215-e2f7-4efe-bdff-4bb49f44c474 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:13.002289 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 34/63] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:13.014980 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0257d-9453-4277-91d5-f75548d4d482 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:13.015546 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0257d-9453-4277-91d5-f75548d4d482 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:13.016230 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0257d-9453-4277-91d5-f75548d4d482 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:13.016895 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 30/64] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:13.019750 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 35/65] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:13.023725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63224472-7cc1-42e5-b8e9-5b227d9d0ef8 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:13.023725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63224472-7cc1-42e5-b8e9-5b227d9d0ef8 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:13.023725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63224472-7cc1-42e5-b8e9-5b227d9d0ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:13.037604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8612a0-1a63-43b6-910e-5fe86f12a2db None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:13.038231 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8612a0-1a63-43b6-910e-5fe86f12a2db None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:13.038512 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8612a0-1a63-43b6-910e-5fe86f12a2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:13.050322 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-63224472-7cc1-42e5-b8e9-5b227d9d0ef8 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:13.052981 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-63224472-7cc1-42e5-b8e9-5b227d9d0ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:13.070303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-6b8612a0-1a63-43b6-910e-5fe86f12a2db None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:13.072483 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-6b8612a0-1a63-43b6-910e-5fe86f12a2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:13.132292 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 31/66] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:32:13.133526 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63224472-7cc1-42e5-b8e9-5b227d9d0ef8 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:13.183194 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 36/67] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:13.184613 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8612a0-1a63-43b6-910e-5fe86f12a2db None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:13.248294 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63224472-7cc1-42e5-b8e9-5b227d9d0ef8 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:13.290675 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfacac6-2622-41be-a205-2fe2919ec690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:13.291839 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfacac6-2622-41be-a205-2fe2919ec690 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:13.292300 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfacac6-2622-41be-a205-2fe2919ec690 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:13.292741 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfacac6-2622-41be-a205-2fe2919ec690 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:13.308314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfacac6-2622-41be-a205-2fe2919ec690 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:13.309802 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8612a0-1a63-43b6-910e-5fe86f12a2db None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:13.317678 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-3bfacac6-2622-41be-a205-2fe2919ec690 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:32:13.317678 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:13.317678 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:13.317678 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:13.317678 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:13.317678 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:13.317678 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:13.317678 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:13.317678 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:13.317678 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:13.317678 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:13.317678 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:13.317678 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:13.317678 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:13.317678 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:13.317678 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:13.318874 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:13.318874 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:13.318874 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:13.318874 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:13.318874 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:13.318874 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:13.318874 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:13.318874 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:13.318874 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:13.318874 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:13.318874 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:13.318874 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:32:13.318874 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:13.318874 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:13.318874 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:13.318874 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:13.319763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:13.319763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:13.319763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:13.319763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:13.319763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:13.319763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:13.319763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:13.319763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:13.319763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:13.319763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:13.319763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:32:13.319763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:32:13.321814 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 32/68] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:32:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:13.327360 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfacac6-2622-41be-a205-2fe2919ec690 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:13.351986 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a913f6a-86a5-4810-a12e-58c7f6f38c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:13.352807 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a913f6a-86a5-4810-a12e-58c7f6f38c33 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:13.353597 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a913f6a-86a5-4810-a12e-58c7f6f38c33 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:13.353896 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a913f6a-86a5-4810-a12e-58c7f6f38c33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:13.367696 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a913f6a-86a5-4810-a12e-58c7f6f38c33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:13.378020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-1a913f6a-86a5-4810-a12e-58c7f6f38c33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:13.378020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:13.378020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:13.378020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:13.378020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:13.378020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:13.378020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:13.378020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:13.378020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:13.378020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:13.378020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:13.378020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:13.378020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:13.378020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:13.378020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:13.378020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:13.379046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:13.379046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:13.379046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:13.379046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:13.379046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:13.379046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:13.379046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:13.379046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:13.379046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:13.379046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:13.379046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:13.379046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:32:13.379046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:13.379046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:13.379046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:13.379046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:13.379914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:13.379914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:13.379914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:13.379914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:13.379914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:13.379914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:13.379914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:13.379914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:13.379914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:13.379914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:13.379914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:13.379914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:32:13.379914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 37/69] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:13.380640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a913f6a-86a5-4810-a12e-58c7f6f38c33 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:13.461529 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfacac6-2622-41be-a205-2fe2919ec690 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:13.495980 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29a074-9af0-4119-bbe3-de13b5bd5e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:13.496944 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29a074-9af0-4119-bbe3-de13b5bd5e8e None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:13.497233 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29a074-9af0-4119-bbe3-de13b5bd5e8e None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:13.497541 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29a074-9af0-4119-bbe3-de13b5bd5e8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:13.502788 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a913f6a-86a5-4810-a12e-58c7f6f38c33 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:13.508707 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29a074-9af0-4119-bbe3-de13b5bd5e8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:13.516382 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-bc29a074-9af0-4119-bbe3-de13b5bd5e8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:32:13.516382 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:13.516382 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:13.516382 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:13.516382 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:13.516382 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:13.516382 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:13.516382 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:13.516382 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:13.516382 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:13.516382 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:13.516382 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:13.516382 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:13.516382 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:13.516382 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:13.516382 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:13.517328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:13.517328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:13.517328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:13.517328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:13.517328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:13.517328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:13.517328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:13.517328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:13.517328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:13.517328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:13.517328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:13.517328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:32:13.517328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:13.517328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:13.517328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:13.517328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:13.518849 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:13.518849 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:13.518849 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:13.518849 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:13.518849 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:13.518849 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:13.518849 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:13.518849 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:13.518849 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:13.518849 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:13.518849 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:32:13.518849 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:32:13.518849 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 33/70] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:32:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:13.519570 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29a074-9af0-4119-bbe3-de13b5bd5e8e None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:13.546335 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4c2fe-a840-44ec-9964-24564e08c8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:13.547024 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4c2fe-a840-44ec-9964-24564e08c8ba None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:13.547316 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4c2fe-a840-44ec-9964-24564e08c8ba None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:13.547601 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4c2fe-a840-44ec-9964-24564e08c8ba None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:13.548370 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4c2fe-a840-44ec-9964-24564e08c8ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:13.548692 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4c2fe-a840-44ec-9964-24564e08c8ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:13.550225 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4c2fe-a840-44ec-9964-24564e08c8ba None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:13.562465 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 38/71] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:32:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:13.563789 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc07a7-bdc8-407f-9ad7-f56058366a50 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:13.564087 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc07a7-bdc8-407f-9ad7-f56058366a50 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:13.564370 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc07a7-bdc8-407f-9ad7-f56058366a50 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:13.566444 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 39/72] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:13.567463 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d3088-3c2b-424b-9ef8-dafa07a43902 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:13.568040 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d3088-3c2b-424b-9ef8-dafa07a43902 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:13.568225 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d3088-3c2b-424b-9ef8-dafa07a43902 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:13.569598 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 40/73] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:13.571463 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d3088-3c2b-424b-9ef8-dafa07a43902 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:13.639517 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29a074-9af0-4119-bbe3-de13b5bd5e8e None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:13.672281 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24374bb8-264c-4896-bf09-38a9f6900c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:13.672954 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24374bb8-264c-4896-bf09-38a9f6900c7d None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:13.673242 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24374bb8-264c-4896-bf09-38a9f6900c7d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:13.673553 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24374bb8-264c-4896-bf09-38a9f6900c7d None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:13.674486 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24374bb8-264c-4896-bf09-38a9f6900c7d None admin] RBAC: Adding query filter params (name=member) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:13.674807 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24374bb8-264c-4896-bf09-38a9f6900c7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:13.676211 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24374bb8-264c-4896-bf09-38a9f6900c7d None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:13.678550 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d3088-3c2b-424b-9ef8-dafa07a43902 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:13.684499 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 34/74] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:32:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:13.685347 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24374bb8-264c-4896-bf09-38a9f6900c7d None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:13.713419 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31acebd-ab89-4286-93d1-8fcaadc2ae6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:13.714031 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31acebd-ab89-4286-93d1-8fcaadc2ae6b None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:13.714321 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31acebd-ab89-4286-93d1-8fcaadc2ae6b None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:13.714606 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31acebd-ab89-4286-93d1-8fcaadc2ae6b None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:13.715375 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31acebd-ab89-4286-93d1-8fcaadc2ae6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:13.715688 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31acebd-ab89-4286-93d1-8fcaadc2ae6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:13.717649 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31acebd-ab89-4286-93d1-8fcaadc2ae6b None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:13.727034 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 41/75] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:13.729167 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5038a-dff3-436e-a5f9-ddd9bc7ceb32 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:13.729501 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5038a-dff3-436e-a5f9-ddd9bc7ceb32 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:13.729789 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5038a-dff3-436e-a5f9-ddd9bc7ceb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:13.747062 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-c6d5038a-dff3-436e-a5f9-ddd9bc7ceb32 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:13.748299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-c6d5038a-dff3-436e-a5f9-ddd9bc7ceb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:13.792661 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24374bb8-264c-4896-bf09-38a9f6900c7d None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:13.815838 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 42/76] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:13.817184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942abde0-2211-4fa7-a2d7-f7d3073eb909 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:13.817571 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942abde0-2211-4fa7-a2d7-f7d3073eb909 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:13.818064 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942abde0-2211-4fa7-a2d7-f7d3073eb909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:13.835440 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-942abde0-2211-4fa7-a2d7-f7d3073eb909 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:13.836582 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac00d01-b981-470d-9fc8-c47c7c9021e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:13.837457 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-942abde0-2211-4fa7-a2d7-f7d3073eb909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:13.837970 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac00d01-b981-470d-9fc8-c47c7c9021e2 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:13.838314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac00d01-b981-470d-9fc8-c47c7c9021e2 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:13.838606 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac00d01-b981-470d-9fc8-c47c7c9021e2 None admin] PATH_INFO: `/v3/users/cc3d6549df2943439a77a3939535737e` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:13.856107 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac00d01-b981-470d-9fc8-c47c7c9021e2 None admin] RBAC: Authorizing `identity:get_user(user_id=cc3d6549df2943439a77a3939535737e)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:13.857641 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac00d01-b981-470d-9fc8-c47c7c9021e2 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:13.859403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 35/77] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:13 2022] GET /identity/v3/users/cc3d6549df2943439a77a3939535737e => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:13.860192 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac00d01-b981-470d-9fc8-c47c7c9021e2 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:13.918528 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 43/78] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:13.920145 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942abde0-2211-4fa7-a2d7-f7d3073eb909 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:13.991584 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac00d01-b981-470d-9fc8-c47c7c9021e2 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:14.026280 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab68f3-8948-4891-8ef4-f3700ac32b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:14.027257 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab68f3-8948-4891-8ef4-f3700ac32b5c None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:14.027610 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab68f3-8948-4891-8ef4-f3700ac32b5c None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:14.027958 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab68f3-8948-4891-8ef4-f3700ac32b5c None admin] PATH_INFO: `/v3/users/cc3d6549df2943439a77a3939535737e` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:14.029294 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab68f3-8948-4891-8ef4-f3700ac32b5c None admin] RBAC: Authorizing `identity:get_user(user_id=cc3d6549df2943439a77a3939535737e)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:14.030177 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942abde0-2211-4fa7-a2d7-f7d3073eb909 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:14.030783 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab68f3-8948-4891-8ef4-f3700ac32b5c None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:14.032450 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 36/79] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:13 2022] GET /identity/v3/users/cc3d6549df2943439a77a3939535737e => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:14.034006 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab68f3-8948-4891-8ef4-f3700ac32b5c None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:14.064379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8205f-a02b-4087-859b-d5ec7975779b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:14.065581 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8205f-a02b-4087-859b-d5ec7975779b None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:14.065871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8205f-a02b-4087-859b-d5ec7975779b None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:14.066149 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8205f-a02b-4087-859b-d5ec7975779b None admin] PATH_INFO: `/v3/users/7982ad69f6614806bd35b21cb21af8d0` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:14.067361 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8205f-a02b-4087-859b-d5ec7975779b None admin] RBAC: Authorizing `identity:get_user(user_id=7982ad69f6614806bd35b21cb21af8d0)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:14.068831 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8205f-a02b-4087-859b-d5ec7975779b None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:14.070509 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 44/80] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:13 2022] GET /identity/v3/users/7982ad69f6614806bd35b21cb21af8d0 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:14.071291 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8205f-a02b-4087-859b-d5ec7975779b None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:14.130580 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab68f3-8948-4891-8ef4-f3700ac32b5c None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:14.164075 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650545f5-0783-4827-b60f-40411ecc7a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:14.164871 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650545f5-0783-4827-b60f-40411ecc7a28 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:14.165155 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650545f5-0783-4827-b60f-40411ecc7a28 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:14.165466 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650545f5-0783-4827-b60f-40411ecc7a28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:14.168331 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8205f-a02b-4087-859b-d5ec7975779b None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:14.175698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650545f5-0783-4827-b60f-40411ecc7a28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:14.183403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-650545f5-0783-4827-b60f-40411ecc7a28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:14.183403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:14.183403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:14.183403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:14.183403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:14.183403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:14.183403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:14.183403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:14.183403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:14.183403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:14.183403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:14.183403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:14.183403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:14.183403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:14.183403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:14.183403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:14.184563 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:14.184563 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:14.184563 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:14.184563 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:14.184563 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:14.184563 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:14.184563 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:14.184563 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:14.184563 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:14.184563 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:14.184563 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:14.184563 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:32:14.184563 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:14.184563 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:14.184563 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:14.184563 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:14.185524 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:14.185524 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:14.185524 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:14.185524 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:14.185524 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:14.185524 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:14.185524 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:14.185524 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:14.185524 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:14.185524 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:14.185524 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:14.185524 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:32:14.185524 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 37/81] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:14.186700 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650545f5-0783-4827-b60f-40411ecc7a28 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:14.207791 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502477c-b112-40d3-a71c-e22b0681011c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:14.208456 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502477c-b112-40d3-a71c-e22b0681011c None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:14.208749 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502477c-b112-40d3-a71c-e22b0681011c None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:14.209033 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502477c-b112-40d3-a71c-e22b0681011c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:14.280633 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502477c-b112-40d3-a71c-e22b0681011c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:14.282104 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502477c-b112-40d3-a71c-e22b0681011c None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:14.291165 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650545f5-0783-4827-b60f-40411ecc7a28 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:14.324857 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178c277-a0bc-4df2-9ec4-e13529801109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:14.325689 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178c277-a0bc-4df2-9ec4-e13529801109 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:14.325976 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178c277-a0bc-4df2-9ec4-e13529801109 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:14.326259 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178c277-a0bc-4df2-9ec4-e13529801109 None admin] PATH_INFO: `/v3/domains/default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:14.327439 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178c277-a0bc-4df2-9ec4-e13529801109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:14.328893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178c277-a0bc-4df2-9ec4-e13529801109 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:14.331161 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 38/82] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:32:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:14.333484 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178c277-a0bc-4df2-9ec4-e13529801109 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:14.383059 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 45/83] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:32:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:32:14.385061 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502477c-b112-40d3-a71c-e22b0681011c None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:14.431703 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178c277-a0bc-4df2-9ec4-e13529801109 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:14.466151 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b083425-34b9-4d88-9640-4a14ae4f4642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:14.466835 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b083425-34b9-4d88-9640-4a14ae4f4642 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:14.467125 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b083425-34b9-4d88-9640-4a14ae4f4642 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:14.467410 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b083425-34b9-4d88-9640-4a14ae4f4642 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:14.485258 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502477c-b112-40d3-a71c-e22b0681011c None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:14.521849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fc667-dbdf-4581-862d-83a03d3b49d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:14.522518 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fc667-dbdf-4581-862d-83a03d3b49d7 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:14.522805 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fc667-dbdf-4581-862d-83a03d3b49d7 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:14.523085 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fc667-dbdf-4581-862d-83a03d3b49d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:14.540673 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b083425-34b9-4d88-9640-4a14ae4f4642 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:14.542165 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b083425-34b9-4d88-9640-4a14ae4f4642 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:14.594235 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43fc667-dbdf-4581-862d-83a03d3b49d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:14.596258 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43fc667-dbdf-4581-862d-83a03d3b49d7 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:14.653990 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 39/84] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:32:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:32:14.655157 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b083425-34b9-4d88-9640-4a14ae4f4642 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:14.706999 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 46/85] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:32:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:32:14.708286 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fc667-dbdf-4581-862d-83a03d3b49d7 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:14.758050 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b083425-34b9-4d88-9640-4a14ae4f4642 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:14.797689 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8581cc1-ed8e-4b86-b626-b7d84c8e51d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:14.798328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8581cc1-ed8e-4b86-b626-b7d84c8e51d1 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:14.798617 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8581cc1-ed8e-4b86-b626-b7d84c8e51d1 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:14.799458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8581cc1-ed8e-4b86-b626-b7d84c8e51d1 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:14.800223 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8581cc1-ed8e-4b86-b626-b7d84c8e51d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:14.800535 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8581cc1-ed8e-4b86-b626-b7d84c8e51d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:14.802070 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8581cc1-ed8e-4b86-b626-b7d84c8e51d1 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:14.810319 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 40/86] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:32:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:14.811236 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8581cc1-ed8e-4b86-b626-b7d84c8e51d1 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:14.813980 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fc667-dbdf-4581-862d-83a03d3b49d7 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:14.852348 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721680aa-0159-4695-9f18-364e03f9d2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:14.853039 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721680aa-0159-4695-9f18-364e03f9d2fa None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:14.853331 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721680aa-0159-4695-9f18-364e03f9d2fa None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:14.853650 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721680aa-0159-4695-9f18-364e03f9d2fa None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:14.854379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721680aa-0159-4695-9f18-364e03f9d2fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:14.855869 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721680aa-0159-4695-9f18-364e03f9d2fa None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:14.882330 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 47/87] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:32:14 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:32:14.883184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721680aa-0159-4695-9f18-364e03f9d2fa None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:14.915070 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8581cc1-ed8e-4b86-b626-b7d84c8e51d1 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:14.952643 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147585aa-d99e-4ec3-9295-f0814b739674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:14.954020 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147585aa-d99e-4ec3-9295-f0814b739674 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:14.954549 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147585aa-d99e-4ec3-9295-f0814b739674 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:14.954897 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147585aa-d99e-4ec3-9295-f0814b739674 None admin] PATH_INFO: `/v3/projects/50c0c9efd04543c4baaf687248d2cb4e` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:14.957101 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147585aa-d99e-4ec3-9295-f0814b739674 None admin] RBAC: Authorizing `identity:get_project(project_id=50c0c9efd04543c4baaf687248d2cb4e)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:14.958735 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147585aa-d99e-4ec3-9295-f0814b739674 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:14.960721 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 41/88] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:14 2022] GET /identity/v3/projects/50c0c9efd04543c4baaf687248d2cb4e => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:14.961415 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147585aa-d99e-4ec3-9295-f0814b739674 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:15.000625 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721680aa-0159-4695-9f18-364e03f9d2fa None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:15.054020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ffd53-a894-45de-bce1-a6d623484546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:15.054820 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ffd53-a894-45de-bce1-a6d623484546 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:15.055115 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ffd53-a894-45de-bce1-a6d623484546 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:15.055538 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ffd53-a894-45de-bce1-a6d623484546 None admin] PATH_INFO: `/v3/projects/50c0c9efd04543c4baaf687248d2cb4e` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:15.056713 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ffd53-a894-45de-bce1-a6d623484546 None admin] RBAC: Authorizing `identity:get_project(project_id=50c0c9efd04543c4baaf687248d2cb4e)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:15.058349 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ffd53-a894-45de-bce1-a6d623484546 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:15.060338 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 48/89] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:14 2022] GET /identity/v3/projects/50c0c9efd04543c4baaf687248d2cb4e => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:15.060990 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ffd53-a894-45de-bce1-a6d623484546 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:15.081780 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147585aa-d99e-4ec3-9295-f0814b739674 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:15.128583 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebc91d-30aa-4b3a-9cad-85a4ce16054b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:15.129595 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebc91d-30aa-4b3a-9cad-85a4ce16054b None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:15.129803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebc91d-30aa-4b3a-9cad-85a4ce16054b None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:15.130953 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebc91d-30aa-4b3a-9cad-85a4ce16054b None admin] PATH_INFO: `/v3/projects/50c0c9efd04543c4baaf687248d2cb4e` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:15.132008 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebc91d-30aa-4b3a-9cad-85a4ce16054b None admin] RBAC: Authorizing `identity:get_project(project_id=50c0c9efd04543c4baaf687248d2cb4e)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:15.133638 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebc91d-30aa-4b3a-9cad-85a4ce16054b None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:15.135633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 42/90] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:14 2022] GET /identity/v3/projects/50c0c9efd04543c4baaf687248d2cb4e => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:15.136239 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebc91d-30aa-4b3a-9cad-85a4ce16054b None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:15.180662 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ffd53-a894-45de-bce1-a6d623484546 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:15.224522 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129548c-ef6e-4f12-9346-bca055760607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:15.225621 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129548c-ef6e-4f12-9346-bca055760607 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:15.225938 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129548c-ef6e-4f12-9346-bca055760607 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:15.226192 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129548c-ef6e-4f12-9346-bca055760607 None admin] PATH_INFO: `/v3/users/cc3d6549df2943439a77a3939535737e` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:15.227534 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129548c-ef6e-4f12-9346-bca055760607 None admin] RBAC: Authorizing `identity:get_user(user_id=cc3d6549df2943439a77a3939535737e)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:15.229053 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a129548c-ef6e-4f12-9346-bca055760607 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:15.230985 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 49/91] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:15 2022] GET /identity/v3/users/cc3d6549df2943439a77a3939535737e => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:15.231799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129548c-ef6e-4f12-9346-bca055760607 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:15.268183 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebc91d-30aa-4b3a-9cad-85a4ce16054b None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:15.316478 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81657302-d801-4823-9081-2d7a5050eb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:15.317565 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81657302-d801-4823-9081-2d7a5050eb12 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:15.318093 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81657302-d801-4823-9081-2d7a5050eb12 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:15.318596 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81657302-d801-4823-9081-2d7a5050eb12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:15.320221 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81657302-d801-4823-9081-2d7a5050eb12 None admin] RBAC: Adding query filter params (role.id=607698024b4d44f0a109bb69deafc0c5, scope.project.id=50c0c9efd04543c4baaf687248d2cb4e, user.id=cc3d6549df2943439a77a3939535737e) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:15.320781 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81657302-d801-4823-9081-2d7a5050eb12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:15.323284 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81657302-d801-4823-9081-2d7a5050eb12 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:15.332520 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 43/92] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:32:15 2022] GET /identity/v3/role_assignments?user.id=cc3d6549df2943439a77a3939535737e&scope.project.id=50c0c9efd04543c4baaf687248d2cb4e&role.id=607698024b4d44f0a109bb69deafc0c5 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:15.338479 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81657302-d801-4823-9081-2d7a5050eb12 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:15.367233 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129548c-ef6e-4f12-9346-bca055760607 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:15.443780 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528943c9-ff39-4c0a-9fb3-40264e8c66a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:15.444758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528943c9-ff39-4c0a-9fb3-40264e8c66a9 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:15.445212 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528943c9-ff39-4c0a-9fb3-40264e8c66a9 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:15.445682 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528943c9-ff39-4c0a-9fb3-40264e8c66a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:15.447854 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528943c9-ff39-4c0a-9fb3-40264e8c66a9 None admin] RBAC: Adding query filter params (role.id=198eba72a9774c1b87f0403d4f400243, scope.project.id=50c0c9efd04543c4baaf687248d2cb4e, user.id=cc3d6549df2943439a77a3939535737e) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:15.449170 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528943c9-ff39-4c0a-9fb3-40264e8c66a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:15.450885 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528943c9-ff39-4c0a-9fb3-40264e8c66a9 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:15.467797 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 50/93] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:32:15 2022] GET /identity/v3/role_assignments?user.id=cc3d6549df2943439a77a3939535737e&scope.project.id=50c0c9efd04543c4baaf687248d2cb4e&role.id=198eba72a9774c1b87f0403d4f400243 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:15.471906 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528943c9-ff39-4c0a-9fb3-40264e8c66a9 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:15.593105 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81657302-d801-4823-9081-2d7a5050eb12 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:15.693315 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528943c9-ff39-4c0a-9fb3-40264e8c66a9 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:15.707227 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275aa16-e4cc-46e8-96c7-170c2b0b1c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:15.707903 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275aa16-e4cc-46e8-96c7-170c2b0b1c66 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:15.708188 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275aa16-e4cc-46e8-96c7-170c2b0b1c66 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:15.708462 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275aa16-e4cc-46e8-96c7-170c2b0b1c66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:15.709324 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275aa16-e4cc-46e8-96c7-170c2b0b1c66 None admin] RBAC: Adding query filter params (role.id=a5cb8d37261d486cbc1b06d167a9c05c, scope.project.id=50c0c9efd04543c4baaf687248d2cb4e, user.id=7982ad69f6614806bd35b21cb21af8d0) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:15.709662 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275aa16-e4cc-46e8-96c7-170c2b0b1c66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:15.711137 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275aa16-e4cc-46e8-96c7-170c2b0b1c66 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:15.718652 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 44/94] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:32:15 2022] GET /identity/v3/role_assignments?user.id=7982ad69f6614806bd35b21cb21af8d0&scope.project.id=50c0c9efd04543c4baaf687248d2cb4e&role.id=a5cb8d37261d486cbc1b06d167a9c05c => generated 259 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:15.762101 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d53de-f326-4bb6-b610-46013a10bff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:15.763098 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d53de-f326-4bb6-b610-46013a10bff3 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:15.763568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d53de-f326-4bb6-b610-46013a10bff3 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:15.764024 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d53de-f326-4bb6-b610-46013a10bff3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:15.854581 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d53de-f326-4bb6-b610-46013a10bff3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:15.856375 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d53de-f326-4bb6-b610-46013a10bff3 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:15.968244 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 51/95] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:32:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:32:15.975125 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275aa16-e4cc-46e8-96c7-170c2b0b1c66 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:16.102772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275aa16-e4cc-46e8-96c7-170c2b0b1c66 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:16.140675 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da49e1c-0540-4fb8-a659-697b0e49d0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:16.141504 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da49e1c-0540-4fb8-a659-697b0e49d0b0 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:16.141801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da49e1c-0540-4fb8-a659-697b0e49d0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:16.142090 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da49e1c-0540-4fb8-a659-697b0e49d0b0 None admin] PATH_INFO: `/v3/projects/a88db5f812344fa4a64e5355bb1962ee` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:16.143721 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da49e1c-0540-4fb8-a659-697b0e49d0b0 None admin] RBAC: Authorizing `identity:get_project(project_id=a88db5f812344fa4a64e5355bb1962ee)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:16.145253 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da49e1c-0540-4fb8-a659-697b0e49d0b0 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:16.147056 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 45/96] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:15 2022] GET /identity/v3/projects/a88db5f812344fa4a64e5355bb1962ee => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:16.152933 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d53de-f326-4bb6-b610-46013a10bff3 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:16.300087 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d53de-f326-4bb6-b610-46013a10bff3 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:16.346958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b72749-21a9-473e-83ed-de2c9d3e9d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:16.347859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b72749-21a9-473e-83ed-de2c9d3e9d61 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:16.348151 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b72749-21a9-473e-83ed-de2c9d3e9d61 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:16.348430 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b72749-21a9-473e-83ed-de2c9d3e9d61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:16.349286 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b72749-21a9-473e-83ed-de2c9d3e9d61 None admin] RBAC: Adding query filter params (role.id=198eba72a9774c1b87f0403d4f400243, scope.project.id=a88db5f812344fa4a64e5355bb1962ee, user.id=cc3d6549df2943439a77a3939535737e) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:16.349630 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b72749-21a9-473e-83ed-de2c9d3e9d61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:16.351107 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b72749-21a9-473e-83ed-de2c9d3e9d61 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:16.361620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 52/97] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:32:16 2022] GET /identity/v3/role_assignments?user.id=cc3d6549df2943439a77a3939535737e&scope.project.id=a88db5f812344fa4a64e5355bb1962ee&role.id=198eba72a9774c1b87f0403d4f400243 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:18.266310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39f198-93e6-471a-83e6-539d44d1fcd2 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:18.266870 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39f198-93e6-471a-83e6-539d44d1fcd2 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:18.266870 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39f198-93e6-471a-83e6-539d44d1fcd2 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:18.269044 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 46/98] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:18.274808 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015f1ca-0d51-4c72-8ee9-ff08d5e68a22 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:18.275320 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015f1ca-0d51-4c72-8ee9-ff08d5e68a22 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:18.275407 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015f1ca-0d51-4c72-8ee9-ff08d5e68a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:18.295259 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-2015f1ca-0d51-4c72-8ee9-ff08d5e68a22 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:18.296553 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-2015f1ca-0d51-4c72-8ee9-ff08d5e68a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:18.375178 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 53/99] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:18.399607 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39f198-93e6-471a-83e6-539d44d1fcd2 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:18.528524 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39f198-93e6-471a-83e6-539d44d1fcd2 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:18.571492 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265803d-483d-414d-9216-9abaca1c3c49 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:18.572146 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265803d-483d-414d-9216-9abaca1c3c49 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:18.572638 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265803d-483d-414d-9216-9abaca1c3c49 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:18.574306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 54/100] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:18.580208 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b9eab-c10b-4ccc-965d-004d7f9f3feb None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:18.580615 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b9eab-c10b-4ccc-965d-004d7f9f3feb None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:18.581072 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b9eab-c10b-4ccc-965d-004d7f9f3feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:18.584658 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8482b6-015b-446a-8f51-28c0d840d0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:18.585860 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8482b6-015b-446a-8f51-28c0d840d0c6 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:18.586376 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8482b6-015b-446a-8f51-28c0d840d0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:18.586872 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8482b6-015b-446a-8f51-28c0d840d0c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:18.588349 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8482b6-015b-446a-8f51-28c0d840d0c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:18.590105 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8482b6-015b-446a-8f51-28c0d840d0c6 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:18.592386 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 47/101] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:32:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:18.598772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8482b6-015b-446a-8f51-28c0d840d0c6 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:18.615035 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-479b9eab-c10b-4ccc-965d-004d7f9f3feb None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:18.616288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-479b9eab-c10b-4ccc-965d-004d7f9f3feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:18.728277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 55/102] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:32:18.745501 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033f2b5-27db-446b-979a-e07a5104a418 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:18.745859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033f2b5-27db-446b-979a-e07a5104a418 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:18.746091 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033f2b5-27db-446b-979a-e07a5104a418 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:18.747881 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 56/103] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:18.754725 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5f75b-9678-4446-9a21-4db873bda212 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:18.755087 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5f75b-9678-4446-9a21-4db873bda212 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:18.755312 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5f75b-9678-4446-9a21-4db873bda212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:18.790018 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-11a5f75b-9678-4446-9a21-4db873bda212 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:18.791211 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-11a5f75b-9678-4446-9a21-4db873bda212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:18.811370 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8482b6-015b-446a-8f51-28c0d840d0c6 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:18.876670 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446cafa-ce38-45e1-a4e9-855a15194b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:18.877907 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446cafa-ce38-45e1-a4e9-855a15194b66 None admin] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:18.878197 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446cafa-ce38-45e1-a4e9-855a15194b66 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:18.878479 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446cafa-ce38-45e1-a4e9-855a15194b66 None admin] PATH_INFO: `/v3/projects` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:18.879210 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446cafa-ce38-45e1-a4e9-855a15194b66 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:18.880713 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446cafa-ce38-45e1-a4e9-855a15194b66 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:18.927932 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 48/104] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:32:18 2022] POST /identity/v3/projects => generated 302 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:32:18.930096 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 57/105] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:32:18.937625 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446cafa-ce38-45e1-a4e9-855a15194b66 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:18.957651 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c20646-97c6-4dcb-96a6-de27fe455450 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:18.957989 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c20646-97c6-4dcb-96a6-de27fe455450 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:18.958234 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c20646-97c6-4dcb-96a6-de27fe455450 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:18.959677 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 58/106] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:32:18.971871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cdbb8-fdfd-4d72-895d-a02c7171b843 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:18.972245 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cdbb8-fdfd-4d72-895d-a02c7171b843 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:18.972435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cdbb8-fdfd-4d72-895d-a02c7171b843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:19.017994 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-209cdbb8-fdfd-4d72-895d-a02c7171b843 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:19.019245 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-209cdbb8-fdfd-4d72-895d-a02c7171b843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:19.083529 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446cafa-ce38-45e1-a4e9-855a15194b66 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:19.096121 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 59/107] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:32:19.096864 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209cdbb8-fdfd-4d72-895d-a02c7171b843 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:19.124652 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d7362-fdef-422a-b542-a3744df8f74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:19.125848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d7362-fdef-422a-b542-a3744df8f74c None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:19.126327 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d7362-fdef-422a-b542-a3744df8f74c None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:19.126758 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d7362-fdef-422a-b542-a3744df8f74c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:19.139788 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d7362-fdef-422a-b542-a3744df8f74c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:19.148458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-032d7362-fdef-422a-b542-a3744df8f74c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:32:19.148458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:19.148458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:19.148458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:19.148458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:19.148458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:19.148458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:19.148458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:19.148458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:19.148458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:19.148458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:19.148458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:19.148458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:19.148458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:19.148458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:19.148458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:19.149567 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:19.149567 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:19.149567 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:19.149567 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:19.149567 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:19.149567 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:19.149567 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:19.149567 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:19.149567 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:19.149567 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:19.149567 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:19.149567 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:32:19.149567 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:19.149567 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:19.149567 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:19.149567 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:19.150461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:19.150461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:19.150461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:19.150461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:19.150461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:19.150461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:19.150461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:19.150461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:19.150461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:19.150461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:19.150461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:32:19.150461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:32:19.150461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 49/108] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:19.155752 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8e8c1-9d4f-4a9c-bd29-6069c527cb0e None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:19.156051 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8e8c1-9d4f-4a9c-bd29-6069c527cb0e None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:19.156341 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8e8c1-9d4f-4a9c-bd29-6069c527cb0e None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:19.158519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 50/109] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:19.159359 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8e8c1-9d4f-4a9c-bd29-6069c527cb0e None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:19.253520 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209cdbb8-fdfd-4d72-895d-a02c7171b843 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:19.277898 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8e8c1-9d4f-4a9c-bd29-6069c527cb0e None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:19.291746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52a1b4-4207-45fe-ad1f-eb98122c78e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:19.292559 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52a1b4-4207-45fe-ad1f-eb98122c78e1 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:19.292850 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52a1b4-4207-45fe-ad1f-eb98122c78e1 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:19.293138 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52a1b4-4207-45fe-ad1f-eb98122c78e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:19.304717 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52a1b4-4207-45fe-ad1f-eb98122c78e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:19.312640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-1c52a1b4-4207-45fe-ad1f-eb98122c78e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:19.312640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:19.312640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:19.312640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:19.312640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:19.312640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:19.312640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:19.312640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:19.312640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:19.312640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:19.312640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:19.312640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:19.312640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:19.312640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:19.312640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:19.312640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:19.313641 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:19.313641 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:19.313641 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:19.313641 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:19.313641 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:19.313641 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:19.313641 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:19.313641 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:19.313641 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:19.313641 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:19.313641 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:19.313641 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:32:19.313641 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:19.313641 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:19.313641 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:19.313641 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:19.315319 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:19.315319 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:19.315319 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:19.315319 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:19.315319 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:19.315319 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:19.315319 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:19.315319 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:19.315319 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:19.315319 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:19.315319 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:19.315319 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:32:19.315319 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 60/110] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:19.319644 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52a1b4-4207-45fe-ad1f-eb98122c78e1 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:19.322873 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4ddf1-c42c-4e49-a934-a54f5d680f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:19.324038 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4ddf1-c42c-4e49-a934-a54f5d680f88 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:19.324573 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4ddf1-c42c-4e49-a934-a54f5d680f88 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:19.325215 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4ddf1-c42c-4e49-a934-a54f5d680f88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:19.340923 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4ddf1-c42c-4e49-a934-a54f5d680f88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:19.352766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-f6d4ddf1-c42c-4e49-a934-a54f5d680f88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:32:19.352766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:19.352766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:19.352766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:19.352766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:19.352766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:19.352766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:19.352766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:19.352766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:19.352766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:19.352766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:19.352766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:19.352766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:19.352766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:19.352766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:19.352766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:19.354346 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:19.354346 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:19.354346 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:19.354346 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:19.354346 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:19.354346 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:19.354346 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:19.354346 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:19.354346 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:19.354346 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:19.354346 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:19.354346 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:32:19.354346 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:19.354346 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:19.354346 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:19.354346 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:19.355209 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:19.355209 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:19.355209 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:19.355209 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:19.355209 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:19.355209 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:19.355209 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:19.355209 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:19.355209 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:19.355209 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:19.355209 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:32:19.355209 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:32:19.355209 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 51/111] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:32:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:19.355947 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57a7bd-9425-4289-add2-40ae9e29d87e None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:19.361941 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57a7bd-9425-4289-add2-40ae9e29d87e None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:19.361941 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57a7bd-9425-4289-add2-40ae9e29d87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:19.386986 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-ee57a7bd-9425-4289-add2-40ae9e29d87e None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:19.389167 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-ee57a7bd-9425-4289-add2-40ae9e29d87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:19.442598 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52a1b4-4207-45fe-ad1f-eb98122c78e1 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:19.479251 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 52/112] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:19.479776 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795fea6-324b-4a33-a90b-6b9b4f039af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:19.480554 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795fea6-324b-4a33-a90b-6b9b4f039af0 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:19.480845 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795fea6-324b-4a33-a90b-6b9b4f039af0 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:19.481125 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795fea6-324b-4a33-a90b-6b9b4f039af0 None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:19.481534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57a7bd-9425-4289-add2-40ae9e29d87e None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:19.481922 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795fea6-324b-4a33-a90b-6b9b4f039af0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:19.482236 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795fea6-324b-4a33-a90b-6b9b4f039af0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:19.483859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795fea6-324b-4a33-a90b-6b9b4f039af0 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:19.495010 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 61/113] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:32:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:19.500361 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795fea6-324b-4a33-a90b-6b9b4f039af0 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:19.598001 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57a7bd-9425-4289-add2-40ae9e29d87e None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:19.618858 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795fea6-324b-4a33-a90b-6b9b4f039af0 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:19.651613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2e607-d334-4888-a1ed-4916e0dda424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:19.652685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2e607-d334-4888-a1ed-4916e0dda424 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:19.653236 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2e607-d334-4888-a1ed-4916e0dda424 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:19.653769 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2e607-d334-4888-a1ed-4916e0dda424 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:19.654756 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2e607-d334-4888-a1ed-4916e0dda424 None admin] RBAC: Adding query filter params (name=member) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:19.655275 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2e607-d334-4888-a1ed-4916e0dda424 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:19.655457 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c82e5-563a-4f1a-95bc-7a1a9b186900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:19.656099 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c82e5-563a-4f1a-95bc-7a1a9b186900 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:19.656391 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c82e5-563a-4f1a-95bc-7a1a9b186900 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:19.656672 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c82e5-563a-4f1a-95bc-7a1a9b186900 None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:19.657458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c82e5-563a-4f1a-95bc-7a1a9b186900 None admin] RBAC: Adding query filter params (name=admin) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:19.657774 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c82e5-563a-4f1a-95bc-7a1a9b186900 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:19.659063 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2e607-d334-4888-a1ed-4916e0dda424 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:19.659711 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c82e5-563a-4f1a-95bc-7a1a9b186900 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:19.673404 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 62/114] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:19.673404 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c82e5-563a-4f1a-95bc-7a1a9b186900 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:19.674817 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 53/115] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:32:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:19.676007 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2e607-d334-4888-a1ed-4916e0dda424 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:19.776093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c82e5-563a-4f1a-95bc-7a1a9b186900 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:19.782923 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2e607-d334-4888-a1ed-4916e0dda424 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:19.812428 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb2cfd-6828-465a-b498-900b907b1b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:19.813390 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb2cfd-6828-465a-b498-900b907b1b9a None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:19.813692 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb2cfd-6828-465a-b498-900b907b1b9a None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:19.813977 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb2cfd-6828-465a-b498-900b907b1b9a None admin] PATH_INFO: `/v3/users/90395916ed9b4045bc53441ba3969dd1` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:19.824845 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4a5ff-cd68-41d2-ab1c-ec0fcf48ef1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:19.825734 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4a5ff-cd68-41d2-ab1c-ec0fcf48ef1c None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:19.826026 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4a5ff-cd68-41d2-ab1c-ec0fcf48ef1c None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:19.826311 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4a5ff-cd68-41d2-ab1c-ec0fcf48ef1c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:19.833526 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb2cfd-6828-465a-b498-900b907b1b9a None admin] RBAC: Authorizing `identity:get_user(user_id=90395916ed9b4045bc53441ba3969dd1)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:19.835588 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb2cfd-6828-465a-b498-900b907b1b9a None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:19.838813 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 63/116] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:19 2022] GET /identity/v3/users/90395916ed9b4045bc53441ba3969dd1 => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:19.840180 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb2cfd-6828-465a-b498-900b907b1b9a None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:19.845514 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4a5ff-cd68-41d2-ab1c-ec0fcf48ef1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:19.857362 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-5cc4a5ff-cd68-41d2-ab1c-ec0fcf48ef1c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:32:19.857362 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:19.857362 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:19.857362 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:19.857362 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:19.857362 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:19.857362 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:19.857362 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:19.857362 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:19.857362 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:19.857362 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:19.857362 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:19.857362 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:19.857362 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:19.857362 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:19.857362 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:19.858403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:19.858403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:19.858403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:19.858403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:19.858403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:19.858403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:19.858403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:19.858403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:19.858403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:19.858403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:19.858403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:19.858403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:32:19.858403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:19.858403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:19.858403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:19.858403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:19.859248 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:19.859248 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:19.859248 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:19.859248 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:19.859248 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:19.859248 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:19.859248 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:19.859248 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:19.859248 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:19.859248 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:19.859248 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:32:19.859248 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:32:19.859248 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 54/117] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:32:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:19.859958 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4a5ff-cd68-41d2-ab1c-ec0fcf48ef1c None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:19.970201 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4a5ff-cd68-41d2-ab1c-ec0fcf48ef1c None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:19.971927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb2cfd-6828-465a-b498-900b907b1b9a None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:20.010045 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd31e7e-130b-4e8a-9104-8d594222c5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:20.011351 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd31e7e-130b-4e8a-9104-8d594222c5db None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:20.011864 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd31e7e-130b-4e8a-9104-8d594222c5db None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:20.012044 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295b5c8-a702-43da-94fd-cb2c3ac4a295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:20.012563 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd31e7e-130b-4e8a-9104-8d594222c5db None admin] PATH_INFO: `/v3/users/cc3d6549df2943439a77a3939535737e` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:20.012908 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295b5c8-a702-43da-94fd-cb2c3ac4a295 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:20.013209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295b5c8-a702-43da-94fd-cb2c3ac4a295 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:20.013530 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295b5c8-a702-43da-94fd-cb2c3ac4a295 None admin] PATH_INFO: `/v3/users/7982ad69f6614806bd35b21cb21af8d0` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:20.014803 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295b5c8-a702-43da-94fd-cb2c3ac4a295 None admin] RBAC: Authorizing `identity:get_user(user_id=7982ad69f6614806bd35b21cb21af8d0)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:20.015050 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd31e7e-130b-4e8a-9104-8d594222c5db None admin] RBAC: Authorizing `identity:get_user(user_id=cc3d6549df2943439a77a3939535737e)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:20.016320 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295b5c8-a702-43da-94fd-cb2c3ac4a295 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:20.016989 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd31e7e-130b-4e8a-9104-8d594222c5db None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:20.018473 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 64/118] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:19 2022] GET /identity/v3/users/7982ad69f6614806bd35b21cb21af8d0 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:20.023046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295b5c8-a702-43da-94fd-cb2c3ac4a295 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:20.024586 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 55/119] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:19 2022] GET /identity/v3/users/cc3d6549df2943439a77a3939535737e => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:20.025751 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd31e7e-130b-4e8a-9104-8d594222c5db None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:20.130893 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295b5c8-a702-43da-94fd-cb2c3ac4a295 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:20.146515 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd31e7e-130b-4e8a-9104-8d594222c5db None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:20.166257 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f8864-0bf3-480d-94f0-e2d524234e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:20.166927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f8864-0bf3-480d-94f0-e2d524234e3f None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:20.167214 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f8864-0bf3-480d-94f0-e2d524234e3f None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:20.167485 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f8864-0bf3-480d-94f0-e2d524234e3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:20.181719 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58036c80-9c30-446d-8642-7f73385a873d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:20.182400 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58036c80-9c30-446d-8642-7f73385a873d None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:20.182694 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58036c80-9c30-446d-8642-7f73385a873d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:20.182979 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58036c80-9c30-446d-8642-7f73385a873d None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:20.183747 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58036c80-9c30-446d-8642-7f73385a873d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:20.184065 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58036c80-9c30-446d-8642-7f73385a873d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:20.185515 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58036c80-9c30-446d-8642-7f73385a873d None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:20.194518 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 56/120] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:32:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:20.195370 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58036c80-9c30-446d-8642-7f73385a873d None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:20.248783 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f8864-0bf3-480d-94f0-e2d524234e3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:20.250327 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f8864-0bf3-480d-94f0-e2d524234e3f None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:20.302267 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58036c80-9c30-446d-8642-7f73385a873d None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:20.338120 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7153a7-c1e6-42c3-83a5-3dde48607b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:20.338997 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7153a7-c1e6-42c3-83a5-3dde48607b5d None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:20.339366 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7153a7-c1e6-42c3-83a5-3dde48607b5d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:20.339598 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7153a7-c1e6-42c3-83a5-3dde48607b5d None admin] PATH_INFO: `/v3/projects/50c0c9efd04543c4baaf687248d2cb4e` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:20.340761 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7153a7-c1e6-42c3-83a5-3dde48607b5d None admin] RBAC: Authorizing `identity:get_project(project_id=50c0c9efd04543c4baaf687248d2cb4e)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:20.342269 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7153a7-c1e6-42c3-83a5-3dde48607b5d None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:20.344235 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 57/121] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:20 2022] GET /identity/v3/projects/50c0c9efd04543c4baaf687248d2cb4e => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:20.344787 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7153a7-c1e6-42c3-83a5-3dde48607b5d None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:20.388876 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 65/122] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:32:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:32:20.388876 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d1c2e-8aa9-46fc-9acf-2580a31136d3 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:20.388876 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d1c2e-8aa9-46fc-9acf-2580a31136d3 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:20.388876 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d1c2e-8aa9-46fc-9acf-2580a31136d3 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:20.389807 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 66/123] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:20.390071 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d1c2e-8aa9-46fc-9acf-2580a31136d3 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:20.459224 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7153a7-c1e6-42c3-83a5-3dde48607b5d None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:20.495820 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90dfca-f38b-4978-a0cd-a23f8e84f485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:20.496697 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90dfca-f38b-4978-a0cd-a23f8e84f485 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:20.496986 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90dfca-f38b-4978-a0cd-a23f8e84f485 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:20.497272 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90dfca-f38b-4978-a0cd-a23f8e84f485 None admin] PATH_INFO: `/v3/projects/50c0c9efd04543c4baaf687248d2cb4e` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:20.498617 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90dfca-f38b-4978-a0cd-a23f8e84f485 None admin] RBAC: Authorizing `identity:get_project(project_id=50c0c9efd04543c4baaf687248d2cb4e)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:20.498735 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d1c2e-8aa9-46fc-9acf-2580a31136d3 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:20.500089 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90dfca-f38b-4978-a0cd-a23f8e84f485 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:20.502053 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 58/124] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:20 2022] GET /identity/v3/projects/50c0c9efd04543c4baaf687248d2cb4e => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:20.503012 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90dfca-f38b-4978-a0cd-a23f8e84f485 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:20.536091 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5d395-6cba-498a-9e6b-89b63da1b094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:20.537138 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5d395-6cba-498a-9e6b-89b63da1b094 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:20.537465 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5d395-6cba-498a-9e6b-89b63da1b094 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:20.537744 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5d395-6cba-498a-9e6b-89b63da1b094 None admin] PATH_INFO: `/v3/users/cc3d6549df2943439a77a3939535737e` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:20.538966 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5d395-6cba-498a-9e6b-89b63da1b094 None admin] RBAC: Authorizing `identity:get_user(user_id=cc3d6549df2943439a77a3939535737e)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:20.540437 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5d395-6cba-498a-9e6b-89b63da1b094 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:20.542416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 67/125] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:20 2022] GET /identity/v3/users/cc3d6549df2943439a77a3939535737e => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:20.543206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5d395-6cba-498a-9e6b-89b63da1b094 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:20.612899 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90dfca-f38b-4978-a0cd-a23f8e84f485 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:20.652587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5d395-6cba-498a-9e6b-89b63da1b094 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:20.654327 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6ad3c-8cec-430e-9fb0-6359d6b80e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:20.655236 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6ad3c-8cec-430e-9fb0-6359d6b80e4d None admin] REQUEST_METHOD: `PUT` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:20.655523 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6ad3c-8cec-430e-9fb0-6359d6b80e4d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:20.655801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6ad3c-8cec-430e-9fb0-6359d6b80e4d None admin] PATH_INFO: `/v3/projects/50c0c9efd04543c4baaf687248d2cb4e/users/7982ad69f6614806bd35b21cb21af8d0/roles/a5cb8d37261d486cbc1b06d167a9c05c` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:20.657836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6ad3c-8cec-430e-9fb0-6359d6b80e4d None admin] RBAC: Authorizing `identity:create_grant(project_id=50c0c9efd04543c4baaf687248d2cb4e, user_id=7982ad69f6614806bd35b21cb21af8d0, role_id=a5cb8d37261d486cbc1b06d167a9c05c)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:20.659414 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6ad3c-8cec-430e-9fb0-6359d6b80e4d None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:20.681651 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 59/126] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:32:20 2022] PUT /identity/v3/projects/50c0c9efd04543c4baaf687248d2cb4e/users/7982ad69f6614806bd35b21cb21af8d0/roles/a5cb8d37261d486cbc1b06d167a9c05c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:32:20.681651 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cc9db-e60a-49f0-a69c-f46dd53047a3 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:20.681651 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cc9db-e60a-49f0-a69c-f46dd53047a3 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:20.681651 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cc9db-e60a-49f0-a69c-f46dd53047a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:20.702483 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-479cc9db-e60a-49f0-a69c-f46dd53047a3 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:20.703826 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-479cc9db-e60a-49f0-a69c-f46dd53047a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:20.715332 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92798f7b-4042-4465-bc96-24edc093f486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:20.716394 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92798f7b-4042-4465-bc96-24edc093f486 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:20.716693 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92798f7b-4042-4465-bc96-24edc093f486 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:20.716981 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92798f7b-4042-4465-bc96-24edc093f486 None admin] PATH_INFO: `/v3/projects/50c0c9efd04543c4baaf687248d2cb4e` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:20.718539 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92798f7b-4042-4465-bc96-24edc093f486 None admin] RBAC: Authorizing `identity:get_project(project_id=50c0c9efd04543c4baaf687248d2cb4e)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:20.720170 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92798f7b-4042-4465-bc96-24edc093f486 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:20.726750 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 68/127] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:20 2022] GET /identity/v3/projects/50c0c9efd04543c4baaf687248d2cb4e => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:20.727381 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92798f7b-4042-4465-bc96-24edc093f486 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:20.798002 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 60/128] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:20.799575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479cc9db-e60a-49f0-a69c-f46dd53047a3 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:20.878168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92798f7b-4042-4465-bc96-24edc093f486 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:20.921090 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479cc9db-e60a-49f0-a69c-f46dd53047a3 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:20.927594 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbec71-3e83-4626-ac1e-27a4fe5c5243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:20.928532 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbec71-3e83-4626-ac1e-27a4fe5c5243 None admin] REQUEST_METHOD: `PUT` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:20.929619 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbec71-3e83-4626-ac1e-27a4fe5c5243 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:20.929947 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbec71-3e83-4626-ac1e-27a4fe5c5243 None admin] PATH_INFO: `/v3/projects/50c0c9efd04543c4baaf687248d2cb4e/users/cc3d6549df2943439a77a3939535737e/roles/198eba72a9774c1b87f0403d4f400243` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:20.932179 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbec71-3e83-4626-ac1e-27a4fe5c5243 None admin] RBAC: Authorizing `identity:create_grant(project_id=50c0c9efd04543c4baaf687248d2cb4e, user_id=cc3d6549df2943439a77a3939535737e, role_id=198eba72a9774c1b87f0403d4f400243)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:20.933704 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbec71-3e83-4626-ac1e-27a4fe5c5243 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:20.956699 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 69/129] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:32:20 2022] PUT /identity/v3/projects/50c0c9efd04543c4baaf687248d2cb4e/users/cc3d6549df2943439a77a3939535737e/roles/198eba72a9774c1b87f0403d4f400243 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:32:20.957325 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbec71-3e83-4626-ac1e-27a4fe5c5243 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:20.997220 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566899f-3b31-4da0-b408-837a9267de14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:20.998434 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566899f-3b31-4da0-b408-837a9267de14 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:20.998716 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566899f-3b31-4da0-b408-837a9267de14 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:20.998997 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566899f-3b31-4da0-b408-837a9267de14 None admin] PATH_INFO: `/v3/projects/50c0c9efd04543c4baaf687248d2cb4e` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:21.000427 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566899f-3b31-4da0-b408-837a9267de14 None admin] RBAC: Authorizing `identity:get_project(project_id=50c0c9efd04543c4baaf687248d2cb4e)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:21.004460 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566899f-3b31-4da0-b408-837a9267de14 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:21.012129 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 61/130] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:20 2022] GET /identity/v3/projects/50c0c9efd04543c4baaf687248d2cb4e => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:21.013077 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566899f-3b31-4da0-b408-837a9267de14 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:21.167304 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566899f-3b31-4da0-b408-837a9267de14 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:21.208481 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbec71-3e83-4626-ac1e-27a4fe5c5243 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:21.209564 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd21022-00fc-48df-8919-158f4dfb777a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:21.210672 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd21022-00fc-48df-8919-158f4dfb777a None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:21.210968 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd21022-00fc-48df-8919-158f4dfb777a None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:21.211249 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd21022-00fc-48df-8919-158f4dfb777a None admin] PATH_INFO: `/v3/roles/member` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:21.245956 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd21022-00fc-48df-8919-158f4dfb777a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:21.261813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-2fd21022-00fc-48df-8919-158f4dfb777a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:21.261813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:21.261813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:21.261813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:21.261813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:21.261813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:21.261813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:21.261813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:21.261813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:21.261813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:21.261813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:21.261813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:21.261813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:21.261813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:21.261813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:21.261813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:21.263539 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:21.263539 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:21.263539 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:21.263539 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:21.263539 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:21.263539 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:21.263539 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:21.263539 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:21.263539 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:21.263539 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:21.263539 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:21.263539 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:32:21.263539 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:21.263539 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:21.263539 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:21.263539 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:21.264494 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:21.264494 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:21.264494 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:21.264494 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:21.264494 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:21.264494 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:21.264494 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:21.264494 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:21.264494 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:21.264494 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:21.264494 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:21.264494 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:32:21.264494 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 62/131] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:21.264494 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd21022-00fc-48df-8919-158f4dfb777a None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:21.296964 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d2704-759b-4c16-9c26-9cf715ebbe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:21.297774 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d2704-759b-4c16-9c26-9cf715ebbe4a None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:21.298059 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d2704-759b-4c16-9c26-9cf715ebbe4a None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:21.298340 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d2704-759b-4c16-9c26-9cf715ebbe4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:21.299325 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d2704-759b-4c16-9c26-9cf715ebbe4a None admin] RBAC: Adding query filter params (role.id=0f6ee7650e6c49e3b33ccb7090a19c23, scope.project.id=50c0c9efd04543c4baaf687248d2cb4e, user.id=90395916ed9b4045bc53441ba3969dd1) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:21.299640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d2704-759b-4c16-9c26-9cf715ebbe4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:21.301180 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d2704-759b-4c16-9c26-9cf715ebbe4a None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:21.307393 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 70/132] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:32:20 2022] GET /identity/v3/role_assignments?user.id=90395916ed9b4045bc53441ba3969dd1&scope.project.id=50c0c9efd04543c4baaf687248d2cb4e&role.id=0f6ee7650e6c49e3b33ccb7090a19c23 => generated 259 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:21.308544 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d2704-759b-4c16-9c26-9cf715ebbe4a None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:21.420082 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd21022-00fc-48df-8919-158f4dfb777a None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:21.435554 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d2704-759b-4c16-9c26-9cf715ebbe4a None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:21.464208 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749597b-fea5-4eaa-8a6b-0178f5c5d944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:21.465022 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749597b-fea5-4eaa-8a6b-0178f5c5d944 None admin] REQUEST_METHOD: `PUT` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:21.465313 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749597b-fea5-4eaa-8a6b-0178f5c5d944 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:21.465631 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749597b-fea5-4eaa-8a6b-0178f5c5d944 None admin] PATH_INFO: `/v3/projects/50c0c9efd04543c4baaf687248d2cb4e/users/cc3d6549df2943439a77a3939535737e/roles/607698024b4d44f0a109bb69deafc0c5` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:21.468061 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749597b-fea5-4eaa-8a6b-0178f5c5d944 None admin] RBAC: Authorizing `identity:create_grant(project_id=50c0c9efd04543c4baaf687248d2cb4e, user_id=cc3d6549df2943439a77a3939535737e, role_id=607698024b4d44f0a109bb69deafc0c5)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:21.469642 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749597b-fea5-4eaa-8a6b-0178f5c5d944 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:21.492272 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 63/133] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:32:21 2022] PUT /identity/v3/projects/50c0c9efd04543c4baaf687248d2cb4e/users/cc3d6549df2943439a77a3939535737e/roles/607698024b4d44f0a109bb69deafc0c5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:32:21.492272 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0e6f1-eb82-499d-a95c-bc9d434ff784 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:21.492272 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0e6f1-eb82-499d-a95c-bc9d434ff784 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:21.492272 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0e6f1-eb82-499d-a95c-bc9d434ff784 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:21.493531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 64/134] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:21.499369 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980e0a4-a004-40e1-ba61-5c9630facb61 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:21.499646 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980e0a4-a004-40e1-ba61-5c9630facb61 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:21.500013 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980e0a4-a004-40e1-ba61-5c9630facb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:21.504501 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7c794-73ce-497c-95cf-4f909283f2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:21.505518 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7c794-73ce-497c-95cf-4f909283f2cf None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:21.506044 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7c794-73ce-497c-95cf-4f909283f2cf None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:21.506592 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7c794-73ce-497c-95cf-4f909283f2cf None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:21.507607 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7c794-73ce-497c-95cf-4f909283f2cf None admin] RBAC: Adding query filter params (name=member) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:21.508166 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7c794-73ce-497c-95cf-4f909283f2cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:21.518319 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7c794-73ce-497c-95cf-4f909283f2cf None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:21.520010 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-6980e0a4-a004-40e1-ba61-5c9630facb61 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:21.522060 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-6980e0a4-a004-40e1-ba61-5c9630facb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:21.529598 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 71/135] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:32:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:21.535776 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7c794-73ce-497c-95cf-4f909283f2cf None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:21.614492 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 65/136] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:32:21.645682 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980e0a4-a004-40e1-ba61-5c9630facb61 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:21.769521 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980e0a4-a004-40e1-ba61-5c9630facb61 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:21.782629 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7c794-73ce-497c-95cf-4f909283f2cf None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:21.810938 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d151d4-6429-4f88-b2d3-8a6d99f8ae33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:21.811830 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d151d4-6429-4f88-b2d3-8a6d99f8ae33 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:21.812192 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d151d4-6429-4f88-b2d3-8a6d99f8ae33 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:21.812543 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d151d4-6429-4f88-b2d3-8a6d99f8ae33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:21.813936 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d151d4-6429-4f88-b2d3-8a6d99f8ae33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:21.816074 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d151d4-6429-4f88-b2d3-8a6d99f8ae33 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:21.818048 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 66/137] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:32:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:21.823522 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d151d4-6429-4f88-b2d3-8a6d99f8ae33 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:21.849965 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9af4c4-2a08-4bfa-8de0-60d07dc37b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:21.851272 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9af4c4-2a08-4bfa-8de0-60d07dc37b21 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:21.851799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9af4c4-2a08-4bfa-8de0-60d07dc37b21 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:21.852265 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9af4c4-2a08-4bfa-8de0-60d07dc37b21 None admin] PATH_INFO: `/v3/users/cc3d6549df2943439a77a3939535737e` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:21.854474 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9af4c4-2a08-4bfa-8de0-60d07dc37b21 None admin] RBAC: Authorizing `identity:get_user(user_id=cc3d6549df2943439a77a3939535737e)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:21.856229 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9af4c4-2a08-4bfa-8de0-60d07dc37b21 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:21.858206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 72/138] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:21 2022] GET /identity/v3/users/cc3d6549df2943439a77a3939535737e => generated 275 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:21.864541 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9af4c4-2a08-4bfa-8de0-60d07dc37b21 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:21.930956 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d151d4-6429-4f88-b2d3-8a6d99f8ae33 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:21.968574 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f98dcf-ed39-4d19-acf4-5094ba4847a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:21.969326 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f98dcf-ed39-4d19-acf4-5094ba4847a9 None admin] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:21.969661 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f98dcf-ed39-4d19-acf4-5094ba4847a9 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:21.969944 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f98dcf-ed39-4d19-acf4-5094ba4847a9 None admin] PATH_INFO: `/v3/users` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:21.970885 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f98dcf-ed39-4d19-acf4-5094ba4847a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:21.972564 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f98dcf-ed39-4d19-acf4-5094ba4847a9 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:22.003435 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 67/139] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:32:21 2022] POST /identity/v3/users => generated 283 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:32:22.013967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9af4c4-2a08-4bfa-8de0-60d07dc37b21 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:22.054525 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae0ce6-2acd-471d-913d-6323bd740083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:22.055386 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae0ce6-2acd-471d-913d-6323bd740083 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:22.055728 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae0ce6-2acd-471d-913d-6323bd740083 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:22.056051 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae0ce6-2acd-471d-913d-6323bd740083 None admin] PATH_INFO: `/v3/projects/a88db5f812344fa4a64e5355bb1962ee` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:22.057342 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae0ce6-2acd-471d-913d-6323bd740083 None admin] RBAC: Authorizing `identity:get_project(project_id=a88db5f812344fa4a64e5355bb1962ee)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:22.058999 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae0ce6-2acd-471d-913d-6323bd740083 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:22.061344 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 73/140] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:21 2022] GET /identity/v3/projects/a88db5f812344fa4a64e5355bb1962ee => generated 312 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:22.068221 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f98dcf-ed39-4d19-acf4-5094ba4847a9 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:22.182145 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f98dcf-ed39-4d19-acf4-5094ba4847a9 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:22.218691 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b4cf2-da7f-4268-85e6-761b524757e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:22.219624 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b4cf2-da7f-4268-85e6-761b524757e4 None admin] REQUEST_METHOD: `PUT` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:22.219914 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b4cf2-da7f-4268-85e6-761b524757e4 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:22.220200 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b4cf2-da7f-4268-85e6-761b524757e4 None admin] PATH_INFO: `/v3/projects/a88db5f812344fa4a64e5355bb1962ee/users/cc3d6549df2943439a77a3939535737e/roles/198eba72a9774c1b87f0403d4f400243` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:22.222791 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b4cf2-da7f-4268-85e6-761b524757e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a88db5f812344fa4a64e5355bb1962ee, user_id=cc3d6549df2943439a77a3939535737e, role_id=198eba72a9774c1b87f0403d4f400243)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:22.224329 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b4cf2-da7f-4268-85e6-761b524757e4 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:22.242519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 68/141] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:32:22 2022] PUT /identity/v3/projects/a88db5f812344fa4a64e5355bb1962ee/users/cc3d6549df2943439a77a3939535737e/roles/198eba72a9774c1b87f0403d4f400243 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:32:23.613743 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b8aab-13e0-4c5e-8956-275e6f4ed68b None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:23.614308 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b8aab-13e0-4c5e-8956-275e6f4ed68b None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:23.614308 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b8aab-13e0-4c5e-8956-275e6f4ed68b None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:23.616022 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 74/142] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:23.623881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208488e8-badb-4e43-9c63-71f97303ff0d None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:23.623881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208488e8-badb-4e43-9c63-71f97303ff0d None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:23.623881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208488e8-badb-4e43-9c63-71f97303ff0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:23.645260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-208488e8-badb-4e43-9c63-71f97303ff0d None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:23.646575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-208488e8-badb-4e43-9c63-71f97303ff0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:23.725735 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 69/143] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:32:23.747617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b8aab-13e0-4c5e-8956-275e6f4ed68b None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:23.862779 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b8aab-13e0-4c5e-8956-275e6f4ed68b None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:23.903916 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ef952-f491-4444-adbe-0a1624c7cf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:23.904652 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ef952-f491-4444-adbe-0a1624c7cf61 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:23.904942 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ef952-f491-4444-adbe-0a1624c7cf61 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:23.905224 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ef952-f491-4444-adbe-0a1624c7cf61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:23.921915 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ef952-f491-4444-adbe-0a1624c7cf61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:23.930454 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-b29ef952-f491-4444-adbe-0a1624c7cf61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:32:23.930454 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:23.930454 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:23.930454 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:23.930454 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:23.930454 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:23.930454 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:23.930454 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:23.930454 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:23.930454 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:23.930454 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:23.930454 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:23.930454 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:23.930454 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:23.930454 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:23.930454 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:23.931491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:23.931491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:23.931491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:23.931491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:23.931491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:23.931491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:23.931491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:23.931491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:23.931491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:23.931491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:23.931491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:23.931491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:32:23.931491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:23.931491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:23.931491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:23.931491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:23.932399 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:23.932399 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:23.932399 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:23.932399 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:23.932399 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:23.932399 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:23.932399 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:23.932399 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:23.932399 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:23.932399 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:23.932399 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:32:23.932399 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:32:23.932399 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 75/144] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:32:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:23.937906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208488e8-badb-4e43-9c63-71f97303ff0d None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:24.046203 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208488e8-badb-4e43-9c63-71f97303ff0d None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:24.089171 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6172e1-2384-4fa4-87c3-9efc8dfeff07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:24.089898 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6172e1-2384-4fa4-87c3-9efc8dfeff07 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:24.090188 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6172e1-2384-4fa4-87c3-9efc8dfeff07 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:24.090467 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6172e1-2384-4fa4-87c3-9efc8dfeff07 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:24.091242 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6172e1-2384-4fa4-87c3-9efc8dfeff07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:24.091554 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6172e1-2384-4fa4-87c3-9efc8dfeff07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:24.092954 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6172e1-2384-4fa4-87c3-9efc8dfeff07 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:24.103200 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 70/145] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:24.108922 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ef952-f491-4444-adbe-0a1624c7cf61 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:24.228635 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ef952-f491-4444-adbe-0a1624c7cf61 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:24.269635 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fae0dc-9f81-4b1c-b998-fe3d408b0cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:24.270589 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fae0dc-9f81-4b1c-b998-fe3d408b0cd8 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:24.270881 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fae0dc-9f81-4b1c-b998-fe3d408b0cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:24.271166 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fae0dc-9f81-4b1c-b998-fe3d408b0cd8 None admin] PATH_INFO: `/v3/users/7982ad69f6614806bd35b21cb21af8d0` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:24.272426 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fae0dc-9f81-4b1c-b998-fe3d408b0cd8 None admin] RBAC: Authorizing `identity:get_user(user_id=7982ad69f6614806bd35b21cb21af8d0)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:24.273970 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fae0dc-9f81-4b1c-b998-fe3d408b0cd8 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:24.275704 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 76/146] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:24 2022] GET /identity/v3/users/7982ad69f6614806bd35b21cb21af8d0 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:24.281739 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6172e1-2384-4fa4-87c3-9efc8dfeff07 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:24.392069 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6172e1-2384-4fa4-87c3-9efc8dfeff07 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:24.433015 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0ed89-d8b5-49f0-97ef-957bae7b213d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:24.433738 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0ed89-d8b5-49f0-97ef-957bae7b213d None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:24.434030 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0ed89-d8b5-49f0-97ef-957bae7b213d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:24.434311 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0ed89-d8b5-49f0-97ef-957bae7b213d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:24.514001 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0ed89-d8b5-49f0-97ef-957bae7b213d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:24.515411 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0ed89-d8b5-49f0-97ef-957bae7b213d None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:24.626095 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 71/147] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:32:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:32:24.628000 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fae0dc-9f81-4b1c-b998-fe3d408b0cd8 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:24.756437 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fae0dc-9f81-4b1c-b998-fe3d408b0cd8 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:24.797263 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07ce21-ca19-4e46-a6f0-57792d167ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:24.798116 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07ce21-ca19-4e46-a6f0-57792d167ce0 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:24.798410 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07ce21-ca19-4e46-a6f0-57792d167ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:24.798791 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07ce21-ca19-4e46-a6f0-57792d167ce0 None admin] PATH_INFO: `/v3/projects/50c0c9efd04543c4baaf687248d2cb4e` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:24.800533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07ce21-ca19-4e46-a6f0-57792d167ce0 None admin] RBAC: Authorizing `identity:get_project(project_id=50c0c9efd04543c4baaf687248d2cb4e)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:24.802054 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07ce21-ca19-4e46-a6f0-57792d167ce0 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:24.803792 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 77/148] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:24 2022] GET /identity/v3/projects/50c0c9efd04543c4baaf687248d2cb4e => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:24.809805 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0ed89-d8b5-49f0-97ef-957bae7b213d None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:24.928701 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0ed89-d8b5-49f0-97ef-957bae7b213d None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:24.972076 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a4db9-e252-4838-aec3-2184b5dcc6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:24.972767 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a4db9-e252-4838-aec3-2184b5dcc6b5 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:24.973059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a4db9-e252-4838-aec3-2184b5dcc6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:24.973353 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a4db9-e252-4838-aec3-2184b5dcc6b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:24.974239 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a4db9-e252-4838-aec3-2184b5dcc6b5 None admin] RBAC: Adding query filter params (role.id=a5cb8d37261d486cbc1b06d167a9c05c, scope.project.id=50c0c9efd04543c4baaf687248d2cb4e, user.id=7982ad69f6614806bd35b21cb21af8d0) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:24.974556 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a4db9-e252-4838-aec3-2184b5dcc6b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:24.976038 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a4db9-e252-4838-aec3-2184b5dcc6b5 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:24.983096 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 72/149] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:32:24 2022] GET /identity/v3/role_assignments?user.id=7982ad69f6614806bd35b21cb21af8d0&scope.project.id=50c0c9efd04543c4baaf687248d2cb4e&role.id=a5cb8d37261d486cbc1b06d167a9c05c => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:25.305961 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc227b2-a724-4051-8c26-50bb73dc60d1 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:25.306358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc227b2-a724-4051-8c26-50bb73dc60d1 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:25.306552 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc227b2-a724-4051-8c26-50bb73dc60d1 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:25.308221 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 78/150] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:25.313928 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc4d43-6b4f-4fef-934a-95d13793bab0 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:25.314248 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc4d43-6b4f-4fef-934a-95d13793bab0 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:25.314568 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc4d43-6b4f-4fef-934a-95d13793bab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:25.338485 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-9ebc4d43-6b4f-4fef-934a-95d13793bab0 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:25.339714 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-9ebc4d43-6b4f-4fef-934a-95d13793bab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:25.398416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7f9a4-5266-40e5-bc3e-2976746c4ff4 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:25.398761 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7f9a4-5266-40e5-bc3e-2976746c4ff4 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:25.398984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7f9a4-5266-40e5-bc3e-2976746c4ff4 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:25.400581 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 79/151] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:32:25.415074 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069210a7-24b5-4ed6-b7f5-47593e14bf82 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:25.415425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069210a7-24b5-4ed6-b7f5-47593e14bf82 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:25.415646 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069210a7-24b5-4ed6-b7f5-47593e14bf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:25.451268 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-069210a7-24b5-4ed6-b7f5-47593e14bf82 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:25.452514 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-069210a7-24b5-4ed6-b7f5-47593e14bf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:25.488010 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 73/152] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:32:25.561482 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 80/153] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:25.575661 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc4d43-6b4f-4fef-934a-95d13793bab0 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:25.601229 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069210a7-24b5-4ed6-b7f5-47593e14bf82 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:25.730508 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069210a7-24b5-4ed6-b7f5-47593e14bf82 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:25.746217 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc4d43-6b4f-4fef-934a-95d13793bab0 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:25.778797 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039dccf-32ba-4a8a-a8fe-50a94a1e966f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:25.779623 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039dccf-32ba-4a8a-a8fe-50a94a1e966f None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:25.779912 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039dccf-32ba-4a8a-a8fe-50a94a1e966f None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:25.780193 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039dccf-32ba-4a8a-a8fe-50a94a1e966f None admin] PATH_INFO: `/v3/roles/member` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:25.793587 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4ce7e-76bf-4ed8-93e4-7f1d48048977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:25.794735 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4ce7e-76bf-4ed8-93e4-7f1d48048977 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:25.795183 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4ce7e-76bf-4ed8-93e4-7f1d48048977 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:25.795641 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4ce7e-76bf-4ed8-93e4-7f1d48048977 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:25.804025 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039dccf-32ba-4a8a-a8fe-50a94a1e966f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:25.810376 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4ce7e-76bf-4ed8-93e4-7f1d48048977 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:25.812335 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-5039dccf-32ba-4a8a-a8fe-50a94a1e966f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:25.812335 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:25.812335 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:25.812335 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:25.812335 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:25.812335 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:25.812335 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:25.812335 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:25.812335 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:25.812335 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:25.812335 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:25.812335 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:25.812335 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:25.812335 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:25.812335 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:25.812335 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:25.813543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:25.813543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:25.813543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:25.813543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:25.813543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:25.813543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:25.813543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:25.813543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:25.813543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:25.813543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:25.813543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:25.813543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:32:25.813543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:25.813543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:25.813543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:25.813543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:25.814582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:25.814582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:25.814582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:25.814582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:25.814582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:25.814582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:25.814582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:25.814582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:25.814582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:25.814582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:25.814582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:25.814582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:32:25.817674 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 81/154] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:25.822569 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-4da4ce7e-76bf-4ed8-93e4-7f1d48048977 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:32:25.822569 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:25.822569 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:25.822569 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:25.822569 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:25.822569 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:25.822569 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:25.822569 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:25.822569 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:25.822569 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:25.822569 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:25.822569 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:25.822569 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:25.822569 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:25.822569 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:25.822569 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:25.823951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:25.823951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:25.823951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:25.823951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:25.823951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:25.823951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:25.823951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:25.823951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:25.823951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:25.823951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:25.823951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:25.823951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:32:25.823951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:25.823951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:25.823951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:25.823951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:25.824998 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:25.824998 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:25.824998 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:25.824998 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:25.824998 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:25.824998 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:25.824998 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:25.824998 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:25.824998 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:25.824998 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:25.824998 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:32:25.824998 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:32:25.825783 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039dccf-32ba-4a8a-a8fe-50a94a1e966f None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:25.827769 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 74/155] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:32:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:25.835280 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4ce7e-76bf-4ed8-93e4-7f1d48048977 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:25.956738 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4ce7e-76bf-4ed8-93e4-7f1d48048977 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:25.987040 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039dccf-32ba-4a8a-a8fe-50a94a1e966f None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:25.996447 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed90688-6f73-4793-91c0-9d7ed9857df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:25.997444 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed90688-6f73-4793-91c0-9d7ed9857df9 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:25.997890 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed90688-6f73-4793-91c0-9d7ed9857df9 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:25.998356 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed90688-6f73-4793-91c0-9d7ed9857df9 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:25.999394 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed90688-6f73-4793-91c0-9d7ed9857df9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:25.999883 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed90688-6f73-4793-91c0-9d7ed9857df9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:26.001545 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed90688-6f73-4793-91c0-9d7ed9857df9 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:26.011038 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 75/156] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:32:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:26.018459 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed90688-6f73-4793-91c0-9d7ed9857df9 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:26.058231 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d428d93-0f11-4297-b179-5eedd7af216a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:26.058954 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d428d93-0f11-4297-b179-5eedd7af216a None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:26.059253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d428d93-0f11-4297-b179-5eedd7af216a None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:26.059540 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d428d93-0f11-4297-b179-5eedd7af216a None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:26.060343 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d428d93-0f11-4297-b179-5eedd7af216a None admin] RBAC: Adding query filter params (name=member) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:26.060658 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d428d93-0f11-4297-b179-5eedd7af216a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:26.062160 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d428d93-0f11-4297-b179-5eedd7af216a None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:26.095092 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 82/157] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:32:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:26.100044 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d428d93-0f11-4297-b179-5eedd7af216a None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:26.273246 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed90688-6f73-4793-91c0-9d7ed9857df9 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:26.329732 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d428d93-0f11-4297-b179-5eedd7af216a None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:26.359697 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77174be8-d1ef-4d39-b090-0315c1c88f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:26.360517 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77174be8-d1ef-4d39-b090-0315c1c88f29 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:26.360799 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77174be8-d1ef-4d39-b090-0315c1c88f29 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:26.361075 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77174be8-d1ef-4d39-b090-0315c1c88f29 None admin] PATH_INFO: `/v3/users/cc3d6549df2943439a77a3939535737e` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:26.366221 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77174be8-d1ef-4d39-b090-0315c1c88f29 None admin] RBAC: Authorizing `identity:get_user(user_id=cc3d6549df2943439a77a3939535737e)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:26.367711 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77174be8-d1ef-4d39-b090-0315c1c88f29 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:26.369733 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 76/158] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:26 2022] GET /identity/v3/users/cc3d6549df2943439a77a3939535737e => generated 275 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:26.371014 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237c335-836d-4295-bddd-f21f5091f4da None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:26.371301 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237c335-836d-4295-bddd-f21f5091f4da None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:26.371583 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237c335-836d-4295-bddd-f21f5091f4da None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:26.372840 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 77/159] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:26.378717 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237c335-836d-4295-bddd-f21f5091f4da None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:26.400676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968e698-73a5-4c63-ae48-71bc9632bf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:26.402107 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968e698-73a5-4c63-ae48-71bc9632bf7e None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:26.402664 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968e698-73a5-4c63-ae48-71bc9632bf7e None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:26.403158 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968e698-73a5-4c63-ae48-71bc9632bf7e None admin] PATH_INFO: `/v3/users/cc3d6549df2943439a77a3939535737e` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:26.405079 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968e698-73a5-4c63-ae48-71bc9632bf7e None admin] RBAC: Authorizing `identity:get_user(user_id=cc3d6549df2943439a77a3939535737e)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:26.408678 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968e698-73a5-4c63-ae48-71bc9632bf7e None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:26.415299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 83/160] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:26 2022] GET /identity/v3/users/cc3d6549df2943439a77a3939535737e => generated 275 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:26.417063 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce098f5e-40f7-4db6-8aec-584e101adbc3 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:26.417654 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce098f5e-40f7-4db6-8aec-584e101adbc3 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:26.418207 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce098f5e-40f7-4db6-8aec-584e101adbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:26.443872 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-ce098f5e-40f7-4db6-8aec-584e101adbc3 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:26.448390 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-ce098f5e-40f7-4db6-8aec-584e101adbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:26.556870 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 84/161] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:26.558386 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce098f5e-40f7-4db6-8aec-584e101adbc3 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:26.641006 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237c335-836d-4295-bddd-f21f5091f4da None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:26.677787 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77625e30-6694-46e1-95b3-7de8a2c18f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:26.678559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77625e30-6694-46e1-95b3-7de8a2c18f78 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:26.678918 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77625e30-6694-46e1-95b3-7de8a2c18f78 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:26.679267 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77625e30-6694-46e1-95b3-7de8a2c18f78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:26.691866 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce098f5e-40f7-4db6-8aec-584e101adbc3 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:26.732698 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08362ab0-f667-4813-ad44-169ab3c3dcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:26.733516 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08362ab0-f667-4813-ad44-169ab3c3dcd4 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:26.733878 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08362ab0-f667-4813-ad44-169ab3c3dcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:26.734233 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08362ab0-f667-4813-ad44-169ab3c3dcd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:26.757822 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77625e30-6694-46e1-95b3-7de8a2c18f78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:26.759410 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77625e30-6694-46e1-95b3-7de8a2c18f78 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:26.808512 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08362ab0-f667-4813-ad44-169ab3c3dcd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:26.810235 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08362ab0-f667-4813-ad44-169ab3c3dcd4 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:26.879777 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 78/162] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:32:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:32:26.881282 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77625e30-6694-46e1-95b3-7de8a2c18f78 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:26.928887 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 85/163] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:32:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:32:26.930377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c385e0-2dc6-4dee-80e9-347986568123 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:26.930748 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c385e0-2dc6-4dee-80e9-347986568123 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:26.931133 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c385e0-2dc6-4dee-80e9-347986568123 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:26.932845 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 86/164] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:26.937592 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c385e0-2dc6-4dee-80e9-347986568123 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:26.993742 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77625e30-6694-46e1-95b3-7de8a2c18f78 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:27.032288 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4353008-e31d-44ca-a9d0-36e2ecde0ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:27.033141 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4353008-e31d-44ca-a9d0-36e2ecde0ef7 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:27.033449 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4353008-e31d-44ca-a9d0-36e2ecde0ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:27.033734 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4353008-e31d-44ca-a9d0-36e2ecde0ef7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:27.045068 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4353008-e31d-44ca-a9d0-36e2ecde0ef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:27.052248 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c385e0-2dc6-4dee-80e9-347986568123 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:27.053503 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-d4353008-e31d-44ca-a9d0-36e2ecde0ef7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:32:27.053503 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:27.053503 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:27.053503 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:27.053503 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:27.053503 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:27.053503 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:27.053503 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:27.053503 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:27.053503 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:27.053503 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:27.053503 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:27.053503 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:27.053503 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:27.053503 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:27.053503 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:27.055967 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:27.055967 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:27.055967 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:27.055967 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:27.055967 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:27.055967 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:27.055967 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:27.055967 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:27.055967 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:27.055967 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:27.055967 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:27.055967 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:32:27.055967 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:27.055967 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:27.055967 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:27.055967 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:27.058153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:27.058153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:27.058153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:27.058153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:27.058153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:27.058153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:27.058153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:27.058153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:27.058153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:27.058153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:27.058153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:32:27.058153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:32:27.058153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 79/165] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:27.058153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4353008-e31d-44ca-a9d0-36e2ecde0ef7 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:27.091480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d28917-5f4e-47e4-8f68-2b0d93d9fb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:27.092408 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d28917-5f4e-47e4-8f68-2b0d93d9fb70 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:27.092748 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d28917-5f4e-47e4-8f68-2b0d93d9fb70 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:27.093031 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d28917-5f4e-47e4-8f68-2b0d93d9fb70 None admin] PATH_INFO: `/v3/projects/50c0c9efd04543c4baaf687248d2cb4e` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:27.094358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d28917-5f4e-47e4-8f68-2b0d93d9fb70 None admin] RBAC: Authorizing `identity:get_project(project_id=50c0c9efd04543c4baaf687248d2cb4e)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:27.096112 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d28917-5f4e-47e4-8f68-2b0d93d9fb70 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:27.098228 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 87/166] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:26 2022] GET /identity/v3/projects/50c0c9efd04543c4baaf687248d2cb4e => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:27.099337 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4978d2-daac-4838-a105-f9c3dc8a5278 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:27.104331 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4978d2-daac-4838-a105-f9c3dc8a5278 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:27.104673 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4978d2-daac-4838-a105-f9c3dc8a5278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:27.142697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-3b4978d2-daac-4838-a105-f9c3dc8a5278 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:27.143867 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-3b4978d2-daac-4838-a105-f9c3dc8a5278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:27.165561 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4353008-e31d-44ca-a9d0-36e2ecde0ef7 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:27.208238 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974d635-fea6-4ef0-9182-9ef51e65fe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:27.209159 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974d635-fea6-4ef0-9182-9ef51e65fe96 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:27.209468 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974d635-fea6-4ef0-9182-9ef51e65fe96 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:27.209750 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974d635-fea6-4ef0-9182-9ef51e65fe96 None admin] PATH_INFO: `/v3/projects/50c0c9efd04543c4baaf687248d2cb4e` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:27.210988 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974d635-fea6-4ef0-9182-9ef51e65fe96 None admin] RBAC: Authorizing `identity:get_project(project_id=50c0c9efd04543c4baaf687248d2cb4e)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:27.212546 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974d635-fea6-4ef0-9182-9ef51e65fe96 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:27.214389 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 80/167] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:27 2022] GET /identity/v3/projects/50c0c9efd04543c4baaf687248d2cb4e => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:27.215334 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974d635-fea6-4ef0-9182-9ef51e65fe96 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:27.247703 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 88/168] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:27.248661 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4978d2-daac-4838-a105-f9c3dc8a5278 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:27.349130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974d635-fea6-4ef0-9182-9ef51e65fe96 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:27.386933 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba23f3-0b15-44a3-af5c-669dfc427a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:27.387620 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba23f3-0b15-44a3-af5c-669dfc427a3f None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:27.387910 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba23f3-0b15-44a3-af5c-669dfc427a3f None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:27.388193 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba23f3-0b15-44a3-af5c-669dfc427a3f None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:27.388962 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba23f3-0b15-44a3-af5c-669dfc427a3f None admin] RBAC: Adding query filter params (name=reader) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:27.389276 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba23f3-0b15-44a3-af5c-669dfc427a3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:27.389661 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4978d2-daac-4838-a105-f9c3dc8a5278 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:27.390730 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba23f3-0b15-44a3-af5c-669dfc427a3f None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:27.400938 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 81/169] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:32:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:27.402397 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612372c-2c28-429d-add2-3b6525aa574e None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:27.402603 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612372c-2c28-429d-add2-3b6525aa574e None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:27.402841 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612372c-2c28-429d-add2-3b6525aa574e None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:27.404375 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 82/170] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:27.409955 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612372c-2c28-429d-add2-3b6525aa574e None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:27.435296 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350b29b-960a-412a-8b36-408297dcdba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:27.436545 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350b29b-960a-412a-8b36-408297dcdba2 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:27.437360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350b29b-960a-412a-8b36-408297dcdba2 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:27.438165 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350b29b-960a-412a-8b36-408297dcdba2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:27.439425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350b29b-960a-412a-8b36-408297dcdba2 None admin] RBAC: Adding query filter params (role.id=607698024b4d44f0a109bb69deafc0c5, scope.project.id=50c0c9efd04543c4baaf687248d2cb4e, user.id=cc3d6549df2943439a77a3939535737e) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:27.439983 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350b29b-960a-412a-8b36-408297dcdba2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:27.442493 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350b29b-960a-412a-8b36-408297dcdba2 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:27.450713 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 89/171] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:32:27 2022] GET /identity/v3/role_assignments?user.id=cc3d6549df2943439a77a3939535737e&scope.project.id=50c0c9efd04543c4baaf687248d2cb4e&role.id=607698024b4d44f0a109bb69deafc0c5 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:27.451823 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350b29b-960a-412a-8b36-408297dcdba2 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:27.583214 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350b29b-960a-412a-8b36-408297dcdba2 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:27.629400 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df377db-9258-4242-978e-3179fc4918da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:27.630613 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df377db-9258-4242-978e-3179fc4918da None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:27.631147 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df377db-9258-4242-978e-3179fc4918da None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:27.631643 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df377db-9258-4242-978e-3179fc4918da None admin] PATH_INFO: `/v3/roles/member` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:27.646182 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df377db-9258-4242-978e-3179fc4918da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:27.648410 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612372c-2c28-429d-add2-3b6525aa574e None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:27.656609 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-2df377db-9258-4242-978e-3179fc4918da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:27.656609 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:27.656609 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:27.656609 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:27.656609 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:27.656609 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:27.656609 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:27.656609 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:27.656609 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:27.656609 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:27.656609 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:27.656609 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:27.656609 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:27.656609 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:27.656609 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:27.656609 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:27.657830 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:27.657830 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:27.657830 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:27.657830 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:27.657830 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:27.657830 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:27.657830 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:27.657830 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:27.657830 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:27.657830 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:27.657830 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:27.657830 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:32:27.657830 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:27.657830 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:27.657830 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:27.657830 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:27.659402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:27.659402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:27.659402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:27.659402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:27.659402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:27.659402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:27.659402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:27.659402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:27.659402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:27.659402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:27.659402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:27.659402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:32:27.663252 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 90/172] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:27.664511 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df377db-9258-4242-978e-3179fc4918da None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:27.731215 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f6605-195f-4f9f-a70e-f0a2aecd94da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:27.731215 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f6605-195f-4f9f-a70e-f0a2aecd94da None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:27.731526 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f6605-195f-4f9f-a70e-f0a2aecd94da None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:27.731604 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f6605-195f-4f9f-a70e-f0a2aecd94da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:27.732452 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f6605-195f-4f9f-a70e-f0a2aecd94da None admin] RBAC: Adding query filter params (role.id=198eba72a9774c1b87f0403d4f400243, scope.project.id=50c0c9efd04543c4baaf687248d2cb4e, user.id=cc3d6549df2943439a77a3939535737e) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:27.732770 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f6605-195f-4f9f-a70e-f0a2aecd94da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:27.734301 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f6605-195f-4f9f-a70e-f0a2aecd94da None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:27.745398 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 83/173] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:32:27 2022] GET /identity/v3/role_assignments?user.id=cc3d6549df2943439a77a3939535737e&scope.project.id=50c0c9efd04543c4baaf687248d2cb4e&role.id=198eba72a9774c1b87f0403d4f400243 => generated 608 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:27.745398 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26304425-d0cd-4cb1-8b35-497af70ce70d None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:27.745398 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26304425-d0cd-4cb1-8b35-497af70ce70d None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:27.745398 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26304425-d0cd-4cb1-8b35-497af70ce70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:27.773475 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-26304425-d0cd-4cb1-8b35-497af70ce70d None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:27.774862 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-26304425-d0cd-4cb1-8b35-497af70ce70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:27.803125 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df377db-9258-4242-978e-3179fc4918da None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:27.849630 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a197689-2c11-4ef7-b30a-b2b56c1bd57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:27.850558 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a197689-2c11-4ef7-b30a-b2b56c1bd57c None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:27.850850 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a197689-2c11-4ef7-b30a-b2b56c1bd57c None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:27.851129 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a197689-2c11-4ef7-b30a-b2b56c1bd57c None admin] PATH_INFO: `/v3/users/90395916ed9b4045bc53441ba3969dd1` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:27.853202 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a197689-2c11-4ef7-b30a-b2b56c1bd57c None admin] RBAC: Authorizing `identity:get_user(user_id=90395916ed9b4045bc53441ba3969dd1)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:27.854759 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a197689-2c11-4ef7-b30a-b2b56c1bd57c None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:27.856692 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 91/174] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:27 2022] GET /identity/v3/users/90395916ed9b4045bc53441ba3969dd1 => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:27.857355 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a197689-2c11-4ef7-b30a-b2b56c1bd57c None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:27.865391 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 84/175] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:27.866851 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892bfc3-f585-4661-b40b-a48ddabcd948 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:27.867191 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892bfc3-f585-4661-b40b-a48ddabcd948 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:27.867469 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892bfc3-f585-4661-b40b-a48ddabcd948 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:27.869112 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 85/176] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:27.869955 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892bfc3-f585-4661-b40b-a48ddabcd948 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:27.976547 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a197689-2c11-4ef7-b30a-b2b56c1bd57c None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:27.989932 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892bfc3-f585-4661-b40b-a48ddabcd948 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:28.016922 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4e137-dae0-489b-a3f8-04bc33d9a576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:28.021113 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4e137-dae0-489b-a3f8-04bc33d9a576 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:28.021113 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4e137-dae0-489b-a3f8-04bc33d9a576 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:28.021113 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4e137-dae0-489b-a3f8-04bc33d9a576 None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:28.021113 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4e137-dae0-489b-a3f8-04bc33d9a576 None admin] RBAC: Adding query filter params (name=member) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:28.021113 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4e137-dae0-489b-a3f8-04bc33d9a576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:28.021688 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4e137-dae0-489b-a3f8-04bc33d9a576 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:28.030399 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 92/177] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:32:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:28.032526 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a298ac-23e6-4826-a235-516b3ccddfff None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:28.032826 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a298ac-23e6-4826-a235-516b3ccddfff None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:28.033282 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a298ac-23e6-4826-a235-516b3ccddfff None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:28.034887 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 93/178] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:28.036136 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212a38f-9c22-49ad-b2c7-118847d6e48d None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:28.036494 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212a38f-9c22-49ad-b2c7-118847d6e48d None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:28.036785 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212a38f-9c22-49ad-b2c7-118847d6e48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:28.041486 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5652e5-1e5c-4cb0-9d6e-ea2f55971d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:28.042350 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5652e5-1e5c-4cb0-9d6e-ea2f55971d6f None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:28.042662 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5652e5-1e5c-4cb0-9d6e-ea2f55971d6f None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:28.042927 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5652e5-1e5c-4cb0-9d6e-ea2f55971d6f None admin] PATH_INFO: `/v3/projects/50c0c9efd04543c4baaf687248d2cb4e` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:28.044164 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5652e5-1e5c-4cb0-9d6e-ea2f55971d6f None admin] RBAC: Authorizing `identity:get_project(project_id=50c0c9efd04543c4baaf687248d2cb4e)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:28.045687 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5652e5-1e5c-4cb0-9d6e-ea2f55971d6f None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:28.047431 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 86/179] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:27 2022] GET /identity/v3/projects/50c0c9efd04543c4baaf687248d2cb4e => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:28.048220 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5652e5-1e5c-4cb0-9d6e-ea2f55971d6f None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:28.057278 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-4212a38f-9c22-49ad-b2c7-118847d6e48d None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:28.058559 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-4212a38f-9c22-49ad-b2c7-118847d6e48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:28.127592 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 94/180] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:28.128557 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212a38f-9c22-49ad-b2c7-118847d6e48d None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:28.151111 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5652e5-1e5c-4cb0-9d6e-ea2f55971d6f None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:28.184038 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee212c-02e8-4700-8a44-c8cac5519569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:28.184846 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee212c-02e8-4700-8a44-c8cac5519569 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:28.185126 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee212c-02e8-4700-8a44-c8cac5519569 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:28.185420 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee212c-02e8-4700-8a44-c8cac5519569 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:28.195951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee212c-02e8-4700-8a44-c8cac5519569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:28.203572 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-a2ee212c-02e8-4700-8a44-c8cac5519569 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:32:28.203572 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:28.203572 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:28.203572 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:28.203572 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:28.203572 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:28.203572 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:28.203572 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:28.203572 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:28.203572 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:28.203572 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:28.203572 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:28.203572 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:28.203572 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:28.203572 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:28.203572 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:28.205338 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:28.205338 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:28.205338 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:28.205338 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:28.205338 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:28.205338 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:28.205338 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:28.205338 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:28.205338 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:28.205338 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:28.205338 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:28.205338 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:32:28.205338 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:28.205338 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:28.205338 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:28.205338 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:28.207078 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:28.207078 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:28.207078 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:28.207078 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:28.207078 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:28.207078 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:28.207078 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:28.207078 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:28.207078 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:28.207078 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:28.207078 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:32:28.207078 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:32:28.207078 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 87/181] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:32:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:28.208220 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c3343-3c0e-4a84-9013-d2e6510f107f None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:28.208220 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c3343-3c0e-4a84-9013-d2e6510f107f None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:28.208411 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c3343-3c0e-4a84-9013-d2e6510f107f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:28.226533 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-6c5c3343-3c0e-4a84-9013-d2e6510f107f None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:28.227778 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-6c5c3343-3c0e-4a84-9013-d2e6510f107f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:28.235852 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212a38f-9c22-49ad-b2c7-118847d6e48d None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:28.270667 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e86472-8293-4e8e-ba15-3a0a6b8cf8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:28.271560 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e86472-8293-4e8e-ba15-3a0a6b8cf8d9 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:28.271848 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e86472-8293-4e8e-ba15-3a0a6b8cf8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:28.272130 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e86472-8293-4e8e-ba15-3a0a6b8cf8d9 None admin] PATH_INFO: `/v3/users/cc3d6549df2943439a77a3939535737e` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:28.273356 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e86472-8293-4e8e-ba15-3a0a6b8cf8d9 None admin] RBAC: Authorizing `identity:get_user(user_id=cc3d6549df2943439a77a3939535737e)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:28.274851 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e86472-8293-4e8e-ba15-3a0a6b8cf8d9 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:28.276519 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 95/182] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:28 2022] GET /identity/v3/users/cc3d6549df2943439a77a3939535737e => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:28.277272 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e86472-8293-4e8e-ba15-3a0a6b8cf8d9 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:28.292688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 88/183] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:28.293578 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c3343-3c0e-4a84-9013-d2e6510f107f None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:28.383168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e86472-8293-4e8e-ba15-3a0a6b8cf8d9 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:28.402282 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c3343-3c0e-4a84-9013-d2e6510f107f None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:28.420665 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81207f-f00c-4425-99bc-8491cfc1b611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:28.421597 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81207f-f00c-4425-99bc-8491cfc1b611 None admin] REQUEST_METHOD: `PUT` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:28.421887 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81207f-f00c-4425-99bc-8491cfc1b611 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:28.422172 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81207f-f00c-4425-99bc-8491cfc1b611 None admin] PATH_INFO: `/v3/projects/50c0c9efd04543c4baaf687248d2cb4e/users/90395916ed9b4045bc53441ba3969dd1/roles/0f6ee7650e6c49e3b33ccb7090a19c23` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:28.424669 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f81207f-f00c-4425-99bc-8491cfc1b611 None admin] RBAC: Authorizing `identity:create_grant(project_id=50c0c9efd04543c4baaf687248d2cb4e, user_id=90395916ed9b4045bc53441ba3969dd1, role_id=0f6ee7650e6c49e3b33ccb7090a19c23)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:28.426167 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f81207f-f00c-4425-99bc-8491cfc1b611 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:28.437033 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195af8fe-a1f8-400c-9414-cb706dbb2c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:28.437895 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195af8fe-a1f8-400c-9414-cb706dbb2c01 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:28.438174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195af8fe-a1f8-400c-9414-cb706dbb2c01 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:28.438451 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195af8fe-a1f8-400c-9414-cb706dbb2c01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:28.441465 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 96/184] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:32:28 2022] PUT /identity/v3/projects/50c0c9efd04543c4baaf687248d2cb4e/users/90395916ed9b4045bc53441ba3969dd1/roles/0f6ee7650e6c49e3b33ccb7090a19c23 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:32:28.442321 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81207f-f00c-4425-99bc-8491cfc1b611 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:28.452019 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195af8fe-a1f8-400c-9414-cb706dbb2c01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:28.460909 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-195af8fe-a1f8-400c-9414-cb706dbb2c01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:32:28.460909 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:28.460909 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:28.460909 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:28.460909 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:28.460909 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:28.460909 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:28.460909 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:28.460909 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:28.460909 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:28.460909 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:28.460909 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:28.460909 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:28.460909 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:28.460909 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:28.460909 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:28.462348 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:28.462348 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:28.462348 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:28.462348 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:28.462348 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:28.462348 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:28.462348 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:28.462348 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:28.462348 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:28.462348 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:28.462348 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:28.462348 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:32:28.462348 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:28.462348 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:28.462348 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:28.462348 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:28.463339 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:28.463339 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:28.463339 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:28.463339 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:28.463339 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:28.463339 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:28.463339 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:28.463339 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:28.463339 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:28.463339 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:28.463339 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:32:28.463339 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:32:28.463339 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 89/185] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:32:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:28.463339 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195af8fe-a1f8-400c-9414-cb706dbb2c01 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:28.585704 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195af8fe-a1f8-400c-9414-cb706dbb2c01 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:28.591564 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81207f-f00c-4425-99bc-8491cfc1b611 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:28.628481 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c99e8-bd42-4b06-99cc-6e6a473f61fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:28.629727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c99e8-bd42-4b06-99cc-6e6a473f61fe None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:28.630294 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c99e8-bd42-4b06-99cc-6e6a473f61fe None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:28.630573 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c99e8-bd42-4b06-99cc-6e6a473f61fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:28.663797 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d6196-cf3c-4cc1-a7b9-e04d046648f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:28.665010 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d6196-cf3c-4cc1-a7b9-e04d046648f3 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:28.665575 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d6196-cf3c-4cc1-a7b9-e04d046648f3 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:28.666089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d6196-cf3c-4cc1-a7b9-e04d046648f3 None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:28.667571 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d6196-cf3c-4cc1-a7b9-e04d046648f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:28.668151 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d6196-cf3c-4cc1-a7b9-e04d046648f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:28.670503 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d6196-cf3c-4cc1-a7b9-e04d046648f3 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:28.685977 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 97/186] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:28.687383 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d6196-cf3c-4cc1-a7b9-e04d046648f3 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:28.715244 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c99e8-bd42-4b06-99cc-6e6a473f61fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:28.718015 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c99e8-bd42-4b06-99cc-6e6a473f61fe None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:28.802366 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d6196-cf3c-4cc1-a7b9-e04d046648f3 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:28.846280 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535d9cf-6ce0-406f-974d-25d1654e9092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:28.847011 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535d9cf-6ce0-406f-974d-25d1654e9092 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:28.847317 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535d9cf-6ce0-406f-974d-25d1654e9092 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:28.847573 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535d9cf-6ce0-406f-974d-25d1654e9092 None admin] PATH_INFO: `/v3/domains/default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:28.848773 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535d9cf-6ce0-406f-974d-25d1654e9092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:28.850301 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535d9cf-6ce0-406f-974d-25d1654e9092 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:28.851977 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 98/187] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:32:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:28.861140 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535d9cf-6ce0-406f-974d-25d1654e9092 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:28.861765 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 90/188] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:32:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:32:28.861765 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c99e8-bd42-4b06-99cc-6e6a473f61fe None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:28.956299 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c99e8-bd42-4b06-99cc-6e6a473f61fe None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:28.962333 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535d9cf-6ce0-406f-974d-25d1654e9092 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:28.992606 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8305fec-5722-478c-a2a4-98d1448adb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:28.993518 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8305fec-5722-478c-a2a4-98d1448adb67 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:28.993801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8305fec-5722-478c-a2a4-98d1448adb67 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:28.994076 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8305fec-5722-478c-a2a4-98d1448adb67 None admin] PATH_INFO: `/v3/users/c1d6058310e84365b6eee084762be50d` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:29.002002 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c020aa-bb5c-4e9b-9b70-f96763c96f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:29.002689 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c020aa-bb5c-4e9b-9b70-f96763c96f37 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:29.002993 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c020aa-bb5c-4e9b-9b70-f96763c96f37 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:29.003242 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c020aa-bb5c-4e9b-9b70-f96763c96f37 None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:29.004006 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c020aa-bb5c-4e9b-9b70-f96763c96f37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:29.004317 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c020aa-bb5c-4e9b-9b70-f96763c96f37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:29.005943 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c020aa-bb5c-4e9b-9b70-f96763c96f37 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:29.007996 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8305fec-5722-478c-a2a4-98d1448adb67 None admin] RBAC: Authorizing `identity:get_user(user_id=c1d6058310e84365b6eee084762be50d)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:29.009507 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8305fec-5722-478c-a2a4-98d1448adb67 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:29.011386 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 91/189] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:28 2022] GET /identity/v3/users/c1d6058310e84365b6eee084762be50d => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:29.012004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8305fec-5722-478c-a2a4-98d1448adb67 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:29.024233 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 99/190] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:32:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:29.024233 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c020aa-bb5c-4e9b-9b70-f96763c96f37 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:29.115647 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8305fec-5722-478c-a2a4-98d1448adb67 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:29.131266 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c020aa-bb5c-4e9b-9b70-f96763c96f37 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:29.149667 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570f7ac-d72c-4cd7-8101-292ec561f252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:29.150347 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570f7ac-d72c-4cd7-8101-292ec561f252 None admin] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:29.150627 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570f7ac-d72c-4cd7-8101-292ec561f252 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:29.150899 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570f7ac-d72c-4cd7-8101-292ec561f252 None admin] PATH_INFO: `/v3/users` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:29.151617 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570f7ac-d72c-4cd7-8101-292ec561f252 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:29.153063 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570f7ac-d72c-4cd7-8101-292ec561f252 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:29.166511 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2b387-e41c-474b-9acc-d276396bb61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:29.167702 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2b387-e41c-474b-9acc-d276396bb61a None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:29.168164 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2b387-e41c-474b-9acc-d276396bb61a None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:29.168624 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2b387-e41c-474b-9acc-d276396bb61a None admin] PATH_INFO: `/v3/projects/a88db5f812344fa4a64e5355bb1962ee` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:29.170129 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2b387-e41c-474b-9acc-d276396bb61a None admin] RBAC: Authorizing `identity:get_project(project_id=a88db5f812344fa4a64e5355bb1962ee)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:29.171782 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2b387-e41c-474b-9acc-d276396bb61a None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:29.185401 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 92/191] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:32:29 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:32:29.185401 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570f7ac-d72c-4cd7-8101-292ec561f252 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:29.185692 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 100/192] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:29 2022] GET /identity/v3/projects/a88db5f812344fa4a64e5355bb1962ee => generated 312 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:29.185692 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2b387-e41c-474b-9acc-d276396bb61a None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:29.295470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570f7ac-d72c-4cd7-8101-292ec561f252 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:29.332164 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2b387-e41c-474b-9acc-d276396bb61a None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:29.348741 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ec6df-82e1-46dd-980b-2da2b0926fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:29.349724 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ec6df-82e1-46dd-980b-2da2b0926fd3 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:29.350009 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ec6df-82e1-46dd-980b-2da2b0926fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:29.350284 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ec6df-82e1-46dd-980b-2da2b0926fd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:29.372910 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5f810-6883-4aad-ad46-bd936db22f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:29.373740 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5f810-6883-4aad-ad46-bd936db22f63 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:29.374187 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5f810-6883-4aad-ad46-bd936db22f63 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:29.374471 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5f810-6883-4aad-ad46-bd936db22f63 None admin] PATH_INFO: `/v3/users/c1d6058310e84365b6eee084762be50d` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:29.376112 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5f810-6883-4aad-ad46-bd936db22f63 None admin] RBAC: Authorizing `identity:get_user(user_id=c1d6058310e84365b6eee084762be50d)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:29.378253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5f810-6883-4aad-ad46-bd936db22f63 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:29.380973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 101/193] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:29 2022] GET /identity/v3/users/c1d6058310e84365b6eee084762be50d => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:29.382161 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5f810-6883-4aad-ad46-bd936db22f63 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:29.441561 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ec6df-82e1-46dd-980b-2da2b0926fd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:29.443531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ec6df-82e1-46dd-980b-2da2b0926fd3 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:29.519352 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5f810-6883-4aad-ad46-bd936db22f63 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:29.570727 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4469b-0cdd-490b-bd85-a6164a3328a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:29.571443 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4469b-0cdd-490b-bd85-a6164a3328a5 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:29.571733 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4469b-0cdd-490b-bd85-a6164a3328a5 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:29.572345 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4469b-0cdd-490b-bd85-a6164a3328a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:29.573248 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4469b-0cdd-490b-bd85-a6164a3328a5 None admin] RBAC: Adding query filter params (role.id=198eba72a9774c1b87f0403d4f400243, scope.project.id=a88db5f812344fa4a64e5355bb1962ee, user.id=cc3d6549df2943439a77a3939535737e) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:29.573811 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4469b-0cdd-490b-bd85-a6164a3328a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:29.575771 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4469b-0cdd-490b-bd85-a6164a3328a5 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:29.585334 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 102/194] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:32:29 2022] GET /identity/v3/role_assignments?user.id=cc3d6549df2943439a77a3939535737e&scope.project.id=a88db5f812344fa4a64e5355bb1962ee&role.id=198eba72a9774c1b87f0403d4f400243 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:29.586695 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4469b-0cdd-490b-bd85-a6164a3328a5 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:29.599325 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 93/195] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:32:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:32:29.605610 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ec6df-82e1-46dd-980b-2da2b0926fd3 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:29.720031 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4469b-0cdd-490b-bd85-a6164a3328a5 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:29.760305 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313aed7-a084-4fbe-a2e6-2d5c6273c752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:29.760958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313aed7-a084-4fbe-a2e6-2d5c6273c752 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:29.761244 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313aed7-a084-4fbe-a2e6-2d5c6273c752 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:29.761550 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313aed7-a084-4fbe-a2e6-2d5c6273c752 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:29.784313 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ec6df-82e1-46dd-980b-2da2b0926fd3 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:29.840021 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa82a5-b3a9-4e31-aaf8-ff8152820bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:29.841331 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa82a5-b3a9-4e31-aaf8-ff8152820bf1 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:29.841853 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa82a5-b3a9-4e31-aaf8-ff8152820bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:29.842365 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa82a5-b3a9-4e31-aaf8-ff8152820bf1 None admin] PATH_INFO: `/v3/projects/f097dc1a2c714aada1ee8228564936d7` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:29.844179 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313aed7-a084-4fbe-a2e6-2d5c6273c752 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:29.845207 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa82a5-b3a9-4e31-aaf8-ff8152820bf1 None admin] RBAC: Authorizing `identity:get_project(project_id=f097dc1a2c714aada1ee8228564936d7)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:29.845855 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313aed7-a084-4fbe-a2e6-2d5c6273c752 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:29.847830 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa82a5-b3a9-4e31-aaf8-ff8152820bf1 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:29.850305 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 94/196] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:29 2022] GET /identity/v3/projects/f097dc1a2c714aada1ee8228564936d7 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:29.862522 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa82a5-b3a9-4e31-aaf8-ff8152820bf1 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:29.978397 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 103/197] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:32:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:32:29.997873 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313aed7-a084-4fbe-a2e6-2d5c6273c752 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:30.031914 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa82a5-b3a9-4e31-aaf8-ff8152820bf1 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:30.082861 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559404e3-c23c-417c-a15d-c67a5f6d25a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:30.083542 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559404e3-c23c-417c-a15d-c67a5f6d25a0 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:30.083826 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559404e3-c23c-417c-a15d-c67a5f6d25a0 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:30.084102 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559404e3-c23c-417c-a15d-c67a5f6d25a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:30.084962 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559404e3-c23c-417c-a15d-c67a5f6d25a0 None admin] RBAC: Adding query filter params (role.id=a5cb8d37261d486cbc1b06d167a9c05c, scope.project.id=f097dc1a2c714aada1ee8228564936d7, user.id=c1d6058310e84365b6eee084762be50d) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:30.085279 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559404e3-c23c-417c-a15d-c67a5f6d25a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:30.086781 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559404e3-c23c-417c-a15d-c67a5f6d25a0 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:30.102433 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 95/198] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:32:29 2022] GET /identity/v3/role_assignments?user.id=c1d6058310e84365b6eee084762be50d&scope.project.id=f097dc1a2c714aada1ee8228564936d7&role.id=a5cb8d37261d486cbc1b06d167a9c05c => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:30.157531 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313aed7-a084-4fbe-a2e6-2d5c6273c752 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:30.199637 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81471af9-530c-4eea-b654-c9d84cc14cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:30.200524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81471af9-530c-4eea-b654-c9d84cc14cba None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:30.200812 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81471af9-530c-4eea-b654-c9d84cc14cba None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:30.201093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81471af9-530c-4eea-b654-c9d84cc14cba None admin] PATH_INFO: `/v3/projects/f097dc1a2c714aada1ee8228564936d7` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:30.202414 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81471af9-530c-4eea-b654-c9d84cc14cba None admin] RBAC: Authorizing `identity:get_project(project_id=f097dc1a2c714aada1ee8228564936d7)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:30.203934 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81471af9-530c-4eea-b654-c9d84cc14cba None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:30.206712 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 104/199] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:29 2022] GET /identity/v3/projects/f097dc1a2c714aada1ee8228564936d7 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:30.212661 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559404e3-c23c-417c-a15d-c67a5f6d25a0 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:30.350608 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559404e3-c23c-417c-a15d-c67a5f6d25a0 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:30.407779 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa84da-fd59-49c6-b803-2c1d2eea4801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:30.409032 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa84da-fd59-49c6-b803-2c1d2eea4801 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:30.409321 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa84da-fd59-49c6-b803-2c1d2eea4801 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:30.409676 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa84da-fd59-49c6-b803-2c1d2eea4801 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:30.410508 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa84da-fd59-49c6-b803-2c1d2eea4801 None admin] RBAC: Adding query filter params (role.id=607698024b4d44f0a109bb69deafc0c5, scope.project.id=f097dc1a2c714aada1ee8228564936d7, user.id=c1d6058310e84365b6eee084762be50d) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:30.410826 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa84da-fd59-49c6-b803-2c1d2eea4801 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:30.412329 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa84da-fd59-49c6-b803-2c1d2eea4801 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:30.422058 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 96/200] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:32:30 2022] GET /identity/v3/role_assignments?user.id=c1d6058310e84365b6eee084762be50d&scope.project.id=f097dc1a2c714aada1ee8228564936d7&role.id=607698024b4d44f0a109bb69deafc0c5 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:30.932989 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46c9ed-15b2-44d1-adc9-04d5375800aa None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:30.933279 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46c9ed-15b2-44d1-adc9-04d5375800aa None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:30.933593 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46c9ed-15b2-44d1-adc9-04d5375800aa None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:30.934980 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 105/201] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:32:30.945304 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485cebc-bda4-47fd-8a04-97058a93e8d2 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:30.945907 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485cebc-bda4-47fd-8a04-97058a93e8d2 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:30.945907 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485cebc-bda4-47fd-8a04-97058a93e8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:30.966220 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-6485cebc-bda4-47fd-8a04-97058a93e8d2 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:30.967428 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-6485cebc-bda4-47fd-8a04-97058a93e8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:31.064789 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 97/202] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:31.104926 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46c9ed-15b2-44d1-adc9-04d5375800aa None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:31.254926 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46c9ed-15b2-44d1-adc9-04d5375800aa None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:31.302565 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6ba3b-588d-4f03-af6a-e703d5c0dc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:31.303380 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6ba3b-588d-4f03-af6a-e703d5c0dc9a None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:31.303663 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6ba3b-588d-4f03-af6a-e703d5c0dc9a None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:31.303941 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6ba3b-588d-4f03-af6a-e703d5c0dc9a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:31.324858 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6ba3b-588d-4f03-af6a-e703d5c0dc9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:31.334746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-56e6ba3b-588d-4f03-af6a-e703d5c0dc9a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:32:31.334746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:31.334746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:31.334746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:31.334746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:31.334746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:31.334746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:31.334746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:31.334746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:31.334746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:31.334746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:31.334746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:31.334746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:31.334746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:31.334746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:31.334746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:31.335822 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:31.335822 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:31.335822 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:31.335822 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:31.335822 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:31.335822 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:31.335822 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:31.335822 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:31.335822 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:31.335822 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:31.335822 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:31.335822 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:32:31.335822 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:31.335822 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:31.335822 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:31.335822 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:31.336723 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:31.336723 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:31.336723 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:31.336723 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:31.336723 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:31.336723 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:31.336723 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:31.336723 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:31.336723 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:31.336723 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:31.336723 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:32:31.336723 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:32:31.336723 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 106/203] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:31.343890 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485cebc-bda4-47fd-8a04-97058a93e8d2 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:31.475541 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485cebc-bda4-47fd-8a04-97058a93e8d2 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:31.528399 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99bd64-0d3c-48dc-b671-0ba050ab4970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:31.529008 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99bd64-0d3c-48dc-b671-0ba050ab4970 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:31.529497 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99bd64-0d3c-48dc-b671-0ba050ab4970 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:31.529783 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99bd64-0d3c-48dc-b671-0ba050ab4970 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:31.530821 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99bd64-0d3c-48dc-b671-0ba050ab4970 None admin] RBAC: Adding query filter params (name=reader) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:31.531186 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99bd64-0d3c-48dc-b671-0ba050ab4970 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:31.533504 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99bd64-0d3c-48dc-b671-0ba050ab4970 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:31.544843 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 98/204] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:32:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:31.551003 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6ba3b-588d-4f03-af6a-e703d5c0dc9a None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:31.689911 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6ba3b-588d-4f03-af6a-e703d5c0dc9a None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:31.748896 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3026d-648f-4799-8a38-3e90b5ab107b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:31.749816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3026d-648f-4799-8a38-3e90b5ab107b None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:31.750099 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3026d-648f-4799-8a38-3e90b5ab107b None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:31.750378 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3026d-648f-4799-8a38-3e90b5ab107b None admin] PATH_INFO: `/v3/users/90395916ed9b4045bc53441ba3969dd1` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:31.751671 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3026d-648f-4799-8a38-3e90b5ab107b None admin] RBAC: Authorizing `identity:get_user(user_id=90395916ed9b4045bc53441ba3969dd1)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:31.753143 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3026d-648f-4799-8a38-3e90b5ab107b None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:31.755365 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 107/205] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:31 2022] GET /identity/v3/users/90395916ed9b4045bc53441ba3969dd1 => generated 289 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:31.760857 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99bd64-0d3c-48dc-b671-0ba050ab4970 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:31.938181 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99bd64-0d3c-48dc-b671-0ba050ab4970 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:31.991399 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcabea-eab2-4a65-8c16-32bd9a9c6987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:31.992056 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcabea-eab2-4a65-8c16-32bd9a9c6987 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:31.992337 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcabea-eab2-4a65-8c16-32bd9a9c6987 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:31.992596 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcabea-eab2-4a65-8c16-32bd9a9c6987 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:32.086357 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcabea-eab2-4a65-8c16-32bd9a9c6987 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:32.087849 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcabea-eab2-4a65-8c16-32bd9a9c6987 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:32.222560 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 99/206] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:32:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:32:32.228236 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3026d-648f-4799-8a38-3e90b5ab107b None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:32.434022 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3026d-648f-4799-8a38-3e90b5ab107b None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:32.517629 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1be3a3-3188-438d-a20f-22422d594a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:32.519350 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1be3a3-3188-438d-a20f-22422d594a4e None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:32.519844 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1be3a3-3188-438d-a20f-22422d594a4e None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:32.520353 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1be3a3-3188-438d-a20f-22422d594a4e None admin] PATH_INFO: `/v3/projects/50c0c9efd04543c4baaf687248d2cb4e` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:32.526749 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1be3a3-3188-438d-a20f-22422d594a4e None admin] RBAC: Authorizing `identity:get_project(project_id=50c0c9efd04543c4baaf687248d2cb4e)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:32.529879 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1be3a3-3188-438d-a20f-22422d594a4e None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:32.534710 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 108/207] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:32 2022] GET /identity/v3/projects/50c0c9efd04543c4baaf687248d2cb4e => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:32.541273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcabea-eab2-4a65-8c16-32bd9a9c6987 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:32.770445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcabea-eab2-4a65-8c16-32bd9a9c6987 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:32.848533 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0330088-56af-42a9-afa9-4e0dc38a5ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:32.849671 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0330088-56af-42a9-afa9-4e0dc38a5ea3 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:32.850161 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0330088-56af-42a9-afa9-4e0dc38a5ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:32.850646 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0330088-56af-42a9-afa9-4e0dc38a5ea3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:32.852193 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0330088-56af-42a9-afa9-4e0dc38a5ea3 None admin] RBAC: Adding query filter params (role.id=0f6ee7650e6c49e3b33ccb7090a19c23, scope.project.id=50c0c9efd04543c4baaf687248d2cb4e, user.id=90395916ed9b4045bc53441ba3969dd1) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:32.852752 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0330088-56af-42a9-afa9-4e0dc38a5ea3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:32.855534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0330088-56af-42a9-afa9-4e0dc38a5ea3 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:32.870104 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 100/208] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:32:32 2022] GET /identity/v3/role_assignments?user.id=90395916ed9b4045bc53441ba3969dd1&scope.project.id=50c0c9efd04543c4baaf687248d2cb4e&role.id=0f6ee7650e6c49e3b33ccb7090a19c23 => generated 608 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:32.873089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2122250-2065-47a6-a13e-a78802f3392d None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:32.873649 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2122250-2065-47a6-a13e-a78802f3392d None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:32.874139 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2122250-2065-47a6-a13e-a78802f3392d None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:32.881611 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 109/209] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:32 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:32.896415 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf31af3-d3b3-40af-820c-f4afe87b50de None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:32.897119 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf31af3-d3b3-40af-820c-f4afe87b50de None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:32.897680 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf31af3-d3b3-40af-820c-f4afe87b50de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:32.921030 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-4bf31af3-d3b3-40af-820c-f4afe87b50de None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:32.922736 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-4bf31af3-d3b3-40af-820c-f4afe87b50de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:32.993526 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd5f9b-c705-4c7d-888b-db241abf4e48 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:32.993818 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd5f9b-c705-4c7d-888b-db241abf4e48 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:32.994604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd5f9b-c705-4c7d-888b-db241abf4e48 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:32.996509 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 110/210] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:33.013160 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db547c-0710-4722-a471-0d9ec3f42820 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:33.014244 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db547c-0710-4722-a471-0d9ec3f42820 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:33.014539 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db547c-0710-4722-a471-0d9ec3f42820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:33.039316 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 101/211] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:33.045116 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-a6db547c-0710-4722-a471-0d9ec3f42820 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:33.046419 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-a6db547c-0710-4722-a471-0d9ec3f42820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:33.081548 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf31af3-d3b3-40af-820c-f4afe87b50de None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:33.151846 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 111/212] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:33.159594 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688cc8e-1e6f-4d81-a96b-952f97a1a856 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:33.160113 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688cc8e-1e6f-4d81-a96b-952f97a1a856 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:33.160561 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688cc8e-1e6f-4d81-a96b-952f97a1a856 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:33.162205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 112/213] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:33.168149 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3e5e9-b9c6-437e-99b3-276d482cf352 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:33.168677 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3e5e9-b9c6-437e-99b3-276d482cf352 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:33.169156 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3e5e9-b9c6-437e-99b3-276d482cf352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:33.186531 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-abf3e5e9-b9c6-437e-99b3-276d482cf352 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:33.188028 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-abf3e5e9-b9c6-437e-99b3-276d482cf352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:33.208856 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf31af3-d3b3-40af-820c-f4afe87b50de None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:33.246416 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc626c0-c102-4d06-a605-dc1bd3551ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:33.247284 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc626c0-c102-4d06-a605-dc1bd3551ea0 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:33.247567 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc626c0-c102-4d06-a605-dc1bd3551ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:33.250621 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc626c0-c102-4d06-a605-dc1bd3551ea0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:33.250621 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc626c0-c102-4d06-a605-dc1bd3551ea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:33.250843 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc626c0-c102-4d06-a605-dc1bd3551ea0 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:33.258003 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 102/214] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:32:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:33.258862 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc626c0-c102-4d06-a605-dc1bd3551ea0 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:33.263033 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 113/215] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:32:33.264201 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce8bc4-5f6e-445d-8525-d1c8908afbdc None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:33.264490 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce8bc4-5f6e-445d-8525-d1c8908afbdc None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:33.264766 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce8bc4-5f6e-445d-8525-d1c8908afbdc None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:33.266238 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 114/216] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:33.266763 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce8bc4-5f6e-445d-8525-d1c8908afbdc None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:33.366645 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc626c0-c102-4d06-a605-dc1bd3551ea0 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:33.370663 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce8bc4-5f6e-445d-8525-d1c8908afbdc None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:33.401692 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4acff4-3e6a-4dd3-ac68-1cb91fae4e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:33.402506 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4acff4-3e6a-4dd3-ac68-1cb91fae4e18 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:33.402793 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4acff4-3e6a-4dd3-ac68-1cb91fae4e18 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:33.403076 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4acff4-3e6a-4dd3-ac68-1cb91fae4e18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:33.405312 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2598fd-8e1c-40fd-ba82-3ffc49a622a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:33.406009 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2598fd-8e1c-40fd-ba82-3ffc49a622a7 None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:33.406295 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2598fd-8e1c-40fd-ba82-3ffc49a622a7 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:33.406572 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2598fd-8e1c-40fd-ba82-3ffc49a622a7 None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:33.407289 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2598fd-8e1c-40fd-ba82-3ffc49a622a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:33.409307 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2598fd-8e1c-40fd-ba82-3ffc49a622a7 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:33.414141 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4acff4-3e6a-4dd3-ac68-1cb91fae4e18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:33.423083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-fb4acff4-3e6a-4dd3-ac68-1cb91fae4e18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:33.423083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:33.423083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:33.423083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:33.423083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:33.423083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:33.423083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:33.423083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:33.423083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:33.423083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:33.423083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:33.423083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:33.423083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:33.423083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:33.423083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:33.423083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:33.424466 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:33.424466 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:33.424466 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:33.424466 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:33.424466 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:33.424466 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:33.424466 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:33.424466 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:33.424466 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:33.424466 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:33.424466 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:33.424466 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:32:33.424466 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:33.424466 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:33.424466 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:33.424466 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:33.425725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:33.425725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:33.425725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:33.425725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:33.425725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:33.425725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:33.425725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:33.425725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:33.425725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:33.425725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:33.425725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:33.425725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:32:33.425725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 103/217] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:33.425725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491c277-fe5f-4a9e-a0c9-cc58c2d07751 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:33.426578 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491c277-fe5f-4a9e-a0c9-cc58c2d07751 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:33.426578 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491c277-fe5f-4a9e-a0c9-cc58c2d07751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:33.434750 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 115/218] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:32:33 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:32:33.436055 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2598fd-8e1c-40fd-ba82-3ffc49a622a7 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:33.443890 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-c491c277-fe5f-4a9e-a0c9-cc58c2d07751 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:33.445155 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-c491c277-fe5f-4a9e-a0c9-cc58c2d07751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:33.529231 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 104/219] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:33.529231 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491c277-fe5f-4a9e-a0c9-cc58c2d07751 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:33.569664 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2598fd-8e1c-40fd-ba82-3ffc49a622a7 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:33.607131 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576ec8d-337c-4aba-aec9-d7728b45ff90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:33.607975 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576ec8d-337c-4aba-aec9-d7728b45ff90 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:33.608264 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576ec8d-337c-4aba-aec9-d7728b45ff90 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:33.608546 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576ec8d-337c-4aba-aec9-d7728b45ff90 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:33.621301 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576ec8d-337c-4aba-aec9-d7728b45ff90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:33.630401 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-e576ec8d-337c-4aba-aec9-d7728b45ff90 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:32:33.630401 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:33.630401 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:33.630401 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:33.630401 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:33.630401 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:33.630401 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:33.630401 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:33.630401 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:33.630401 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:33.630401 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:33.630401 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:33.630401 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:33.630401 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:33.630401 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:33.630401 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:33.631615 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:33.631615 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:33.631615 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:33.631615 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:33.631615 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:33.631615 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:33.631615 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:33.631615 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:33.631615 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:33.631615 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:33.631615 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:33.631615 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:32:33.631615 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:33.631615 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:33.631615 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:33.631615 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:33.632555 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:33.632555 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:33.632555 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:33.632555 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:33.632555 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:33.632555 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:33.632555 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:33.632555 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:33.632555 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:33.632555 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:33.632555 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:32:33.632555 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:32:33.632555 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 116/220] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:32:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:33.632555 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576ec8d-337c-4aba-aec9-d7728b45ff90 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:33.648456 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491c277-fe5f-4a9e-a0c9-cc58c2d07751 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:33.694727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907ee5e-5a88-4734-8e78-42b43accc1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:33.695416 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907ee5e-5a88-4734-8e78-42b43accc1cd None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:33.695708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907ee5e-5a88-4734-8e78-42b43accc1cd None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:33.695991 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907ee5e-5a88-4734-8e78-42b43accc1cd None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:33.696762 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0907ee5e-5a88-4734-8e78-42b43accc1cd None admin] RBAC: Adding query filter params (name=member) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:33.697083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0907ee5e-5a88-4734-8e78-42b43accc1cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:33.700813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0907ee5e-5a88-4734-8e78-42b43accc1cd None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:33.709080 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 105/221] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:32:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:33.711416 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907ee5e-5a88-4734-8e78-42b43accc1cd None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:33.762639 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576ec8d-337c-4aba-aec9-d7728b45ff90 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:33.805275 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f61aa-e402-468c-9e45-4490f09581a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:33.806085 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f61aa-e402-468c-9e45-4490f09581a4 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:33.806374 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f61aa-e402-468c-9e45-4490f09581a4 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:33.806656 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f61aa-e402-468c-9e45-4490f09581a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:33.820608 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f61aa-e402-468c-9e45-4490f09581a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:33.828494 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-6b7f61aa-e402-468c-9e45-4490f09581a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:32:33.828494 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:33.828494 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:33.828494 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:33.828494 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:33.828494 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:33.828494 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:33.828494 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:33.828494 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:33.828494 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:33.828494 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:33.828494 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:33.828494 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:33.828494 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:33.828494 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:33.828494 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:33.829975 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:33.829975 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:33.829975 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:33.829975 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:33.829975 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:33.829975 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:33.829975 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:33.829975 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:33.829975 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:33.829975 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:33.829975 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:33.829975 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:32:33.829975 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:33.829975 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:33.829975 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:33.829975 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:33.830910 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:33.830910 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:33.830910 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:33.830910 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:33.830910 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:33.830910 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:33.830910 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:33.830910 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:33.830910 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:33.830910 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:33.830910 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:32:33.830910 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:32:33.831597 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907ee5e-5a88-4734-8e78-42b43accc1cd None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:33.831679 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 117/222] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:32:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:33.832139 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f61aa-e402-468c-9e45-4490f09581a4 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:33.881215 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89849119-fb80-47a4-8fc1-25dddd666dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:33.881847 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89849119-fb80-47a4-8fc1-25dddd666dd1 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:33.882126 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89849119-fb80-47a4-8fc1-25dddd666dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:33.882400 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89849119-fb80-47a4-8fc1-25dddd666dd1 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:33.883159 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89849119-fb80-47a4-8fc1-25dddd666dd1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:33.883467 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89849119-fb80-47a4-8fc1-25dddd666dd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:33.884863 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89849119-fb80-47a4-8fc1-25dddd666dd1 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:33.894349 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 106/223] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:32:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:33.895020 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89849119-fb80-47a4-8fc1-25dddd666dd1 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:33.950637 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f61aa-e402-468c-9e45-4490f09581a4 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:33.986354 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9290c-91de-45fd-964b-dfaca05b325b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:33.987447 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9290c-91de-45fd-964b-dfaca05b325b None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:33.987806 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9290c-91de-45fd-964b-dfaca05b325b None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:33.988157 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9290c-91de-45fd-964b-dfaca05b325b None admin] PATH_INFO: `/v3/users/52bd845d860246699e3d9eacb3e530ac` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:33.995707 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89849119-fb80-47a4-8fc1-25dddd666dd1 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:34.004184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9290c-91de-45fd-964b-dfaca05b325b None admin] RBAC: Authorizing `identity:get_user(user_id=52bd845d860246699e3d9eacb3e530ac)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:34.005760 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9290c-91de-45fd-964b-dfaca05b325b None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:34.007655 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 118/224] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:33 2022] GET /identity/v3/users/52bd845d860246699e3d9eacb3e530ac => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:34.008577 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9290c-91de-45fd-964b-dfaca05b325b None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:34.031356 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e331a-1bdb-4d1f-8459-4a437b1ce278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:34.031926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e331a-1bdb-4d1f-8459-4a437b1ce278 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:34.032208 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e331a-1bdb-4d1f-8459-4a437b1ce278 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:34.032484 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e331a-1bdb-4d1f-8459-4a437b1ce278 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:34.033299 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e331a-1bdb-4d1f-8459-4a437b1ce278 None admin] RBAC: Adding query filter params (name=admin) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:34.033640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e331a-1bdb-4d1f-8459-4a437b1ce278 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:34.035233 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e331a-1bdb-4d1f-8459-4a437b1ce278 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:34.048510 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 107/225] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:34.049603 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e331a-1bdb-4d1f-8459-4a437b1ce278 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:34.116757 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9290c-91de-45fd-964b-dfaca05b325b None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:34.152572 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b7991-2cb1-45a8-a60e-c818fa1c660f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:34.153340 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e331a-1bdb-4d1f-8459-4a437b1ce278 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:34.153497 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b7991-2cb1-45a8-a60e-c818fa1c660f None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:34.153707 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b7991-2cb1-45a8-a60e-c818fa1c660f None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:34.153949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b7991-2cb1-45a8-a60e-c818fa1c660f None admin] PATH_INFO: `/v3/users/c1d6058310e84365b6eee084762be50d` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:34.155197 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b7991-2cb1-45a8-a60e-c818fa1c660f None admin] RBAC: Authorizing `identity:get_user(user_id=c1d6058310e84365b6eee084762be50d)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:34.156673 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b7991-2cb1-45a8-a60e-c818fa1c660f None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:34.159136 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 119/226] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:34 2022] GET /identity/v3/users/c1d6058310e84365b6eee084762be50d => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:34.160065 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b7991-2cb1-45a8-a60e-c818fa1c660f None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:34.188754 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa44abf-75cc-4550-85aa-12ab614baf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:34.189545 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa44abf-75cc-4550-85aa-12ab614baf95 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:34.189823 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa44abf-75cc-4550-85aa-12ab614baf95 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:34.190102 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa44abf-75cc-4550-85aa-12ab614baf95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:34.266360 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa44abf-75cc-4550-85aa-12ab614baf95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:34.268511 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa44abf-75cc-4550-85aa-12ab614baf95 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:34.280174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b7991-2cb1-45a8-a60e-c818fa1c660f None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:34.316375 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7ce66-4af9-422b-9fa2-b9ff3646c579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:34.317254 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7ce66-4af9-422b-9fa2-b9ff3646c579 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:34.317575 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7ce66-4af9-422b-9fa2-b9ff3646c579 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:34.317854 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7ce66-4af9-422b-9fa2-b9ff3646c579 None admin] PATH_INFO: `/v3/users/c1d6058310e84365b6eee084762be50d` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:34.319185 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7ce66-4af9-422b-9fa2-b9ff3646c579 None admin] RBAC: Authorizing `identity:get_user(user_id=c1d6058310e84365b6eee084762be50d)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:34.320648 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7ce66-4af9-422b-9fa2-b9ff3646c579 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:34.326921 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 120/227] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:34 2022] GET /identity/v3/users/c1d6058310e84365b6eee084762be50d => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:34.327856 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7ce66-4af9-422b-9fa2-b9ff3646c579 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:34.379147 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 108/228] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:32:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:32:34.380142 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa44abf-75cc-4550-85aa-12ab614baf95 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:34.433984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7ce66-4af9-422b-9fa2-b9ff3646c579 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:34.469798 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea708d1-06b7-4474-8d9a-1550deadb6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:34.470777 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea708d1-06b7-4474-8d9a-1550deadb6b7 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:34.471062 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea708d1-06b7-4474-8d9a-1550deadb6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:34.471342 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea708d1-06b7-4474-8d9a-1550deadb6b7 None admin] PATH_INFO: `/v3/projects/f097dc1a2c714aada1ee8228564936d7` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:34.472590 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea708d1-06b7-4474-8d9a-1550deadb6b7 None admin] RBAC: Authorizing `identity:get_project(project_id=f097dc1a2c714aada1ee8228564936d7)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:34.474111 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea708d1-06b7-4474-8d9a-1550deadb6b7 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:34.476194 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 121/229] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:34 2022] GET /identity/v3/projects/f097dc1a2c714aada1ee8228564936d7 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:34.477099 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea708d1-06b7-4474-8d9a-1550deadb6b7 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:34.487712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa44abf-75cc-4550-85aa-12ab614baf95 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:34.524698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba7a73-2be9-4265-9a58-56f6bd82790d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:34.525615 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba7a73-2be9-4265-9a58-56f6bd82790d None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:34.525906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba7a73-2be9-4265-9a58-56f6bd82790d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:34.526186 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba7a73-2be9-4265-9a58-56f6bd82790d None admin] PATH_INFO: `/v3/projects/f097dc1a2c714aada1ee8228564936d7` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:34.527452 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba7a73-2be9-4265-9a58-56f6bd82790d None admin] RBAC: Authorizing `identity:get_project(project_id=f097dc1a2c714aada1ee8228564936d7)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:34.528975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba7a73-2be9-4265-9a58-56f6bd82790d None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:34.530820 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 109/230] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:34 2022] GET /identity/v3/projects/f097dc1a2c714aada1ee8228564936d7 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:34.531660 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba7a73-2be9-4265-9a58-56f6bd82790d None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:34.585620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea708d1-06b7-4474-8d9a-1550deadb6b7 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:34.621241 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b16c9-c529-4618-a520-0cff53f0e833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:34.622152 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b16c9-c529-4618-a520-0cff53f0e833 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:34.622435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b16c9-c529-4618-a520-0cff53f0e833 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:34.622711 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b16c9-c529-4618-a520-0cff53f0e833 None admin] PATH_INFO: `/v3/projects/f097dc1a2c714aada1ee8228564936d7` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:34.624019 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b16c9-c529-4618-a520-0cff53f0e833 None admin] RBAC: Authorizing `identity:get_project(project_id=f097dc1a2c714aada1ee8228564936d7)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:34.625508 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b16c9-c529-4618-a520-0cff53f0e833 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:34.627278 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 122/231] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:34 2022] GET /identity/v3/projects/f097dc1a2c714aada1ee8228564936d7 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:34.628250 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b16c9-c529-4618-a520-0cff53f0e833 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:34.646306 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba7a73-2be9-4265-9a58-56f6bd82790d None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:34.682084 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3566f4-9ecc-4611-b758-30c97a968d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:34.683311 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3566f4-9ecc-4611-b758-30c97a968d4d None admin] REQUEST_METHOD: `PUT` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:34.683777 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3566f4-9ecc-4611-b758-30c97a968d4d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:34.684295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3566f4-9ecc-4611-b758-30c97a968d4d None admin] PATH_INFO: `/v3/projects/f097dc1a2c714aada1ee8228564936d7/users/c1d6058310e84365b6eee084762be50d/roles/607698024b4d44f0a109bb69deafc0c5` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:34.686968 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3566f4-9ecc-4611-b758-30c97a968d4d None admin] RBAC: Authorizing `identity:create_grant(project_id=f097dc1a2c714aada1ee8228564936d7, user_id=c1d6058310e84365b6eee084762be50d, role_id=607698024b4d44f0a109bb69deafc0c5)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:34.688651 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3566f4-9ecc-4611-b758-30c97a968d4d None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:34.706879 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 110/232] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:32:34 2022] PUT /identity/v3/projects/f097dc1a2c714aada1ee8228564936d7/users/c1d6058310e84365b6eee084762be50d/roles/607698024b4d44f0a109bb69deafc0c5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:32:34.708507 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3566f4-9ecc-4611-b758-30c97a968d4d None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:34.734102 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b16c9-c529-4618-a520-0cff53f0e833 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:34.772596 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1bd1c-f7dd-4b9e-94d5-66b12ac7973c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:34.773524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1bd1c-f7dd-4b9e-94d5-66b12ac7973c None admin] REQUEST_METHOD: `PUT` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:34.773813 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1bd1c-f7dd-4b9e-94d5-66b12ac7973c None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:34.774091 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1bd1c-f7dd-4b9e-94d5-66b12ac7973c None admin] PATH_INFO: `/v3/projects/f097dc1a2c714aada1ee8228564936d7/users/c1d6058310e84365b6eee084762be50d/roles/a5cb8d37261d486cbc1b06d167a9c05c` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:34.776533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1bd1c-f7dd-4b9e-94d5-66b12ac7973c None admin] RBAC: Authorizing `identity:create_grant(project_id=f097dc1a2c714aada1ee8228564936d7, user_id=c1d6058310e84365b6eee084762be50d, role_id=a5cb8d37261d486cbc1b06d167a9c05c)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:34.778438 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1bd1c-f7dd-4b9e-94d5-66b12ac7973c None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:34.798482 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 123/233] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:32:34 2022] PUT /identity/v3/projects/f097dc1a2c714aada1ee8228564936d7/users/c1d6058310e84365b6eee084762be50d/roles/a5cb8d37261d486cbc1b06d167a9c05c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:32:34.832107 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3566f4-9ecc-4611-b758-30c97a968d4d None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:34.873868 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bf936-96a8-494d-908e-7fc00cf42fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:34.874934 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bf936-96a8-494d-908e-7fc00cf42fe4 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:34.875397 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bf936-96a8-494d-908e-7fc00cf42fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:34.875836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bf936-96a8-494d-908e-7fc00cf42fe4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:34.876950 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bf936-96a8-494d-908e-7fc00cf42fe4 None admin] RBAC: Adding query filter params (role.id=198eba72a9774c1b87f0403d4f400243, scope.project.id=f097dc1a2c714aada1ee8228564936d7, user.id=52bd845d860246699e3d9eacb3e530ac) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:34.877471 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bf936-96a8-494d-908e-7fc00cf42fe4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:34.879248 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bf936-96a8-494d-908e-7fc00cf42fe4 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:34.886799 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 111/234] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:32:34 2022] GET /identity/v3/role_assignments?user.id=52bd845d860246699e3d9eacb3e530ac&scope.project.id=f097dc1a2c714aada1ee8228564936d7&role.id=198eba72a9774c1b87f0403d4f400243 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:36.132789 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd3c03-d3cf-4aad-a6a1-f332919943da None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:36.133333 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd3c03-d3cf-4aad-a6a1-f332919943da None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:36.133333 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd3c03-d3cf-4aad-a6a1-f332919943da None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:36.135104 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 124/235] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:36.141193 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f0d5e-c512-483d-9e3c-421c79c9155d None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:36.142117 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f0d5e-c512-483d-9e3c-421c79c9155d None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:36.143411 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f0d5e-c512-483d-9e3c-421c79c9155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:36.166718 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-ca9f0d5e-c512-483d-9e3c-421c79c9155d None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:36.168268 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-ca9f0d5e-c512-483d-9e3c-421c79c9155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:36.245288 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 112/236] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:36.288856 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd3c03-d3cf-4aad-a6a1-f332919943da None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:36.451208 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd3c03-d3cf-4aad-a6a1-f332919943da None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:36.465592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a8580-1e4f-4745-9bb7-efb5269c126b None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:36.466246 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a8580-1e4f-4745-9bb7-efb5269c126b None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:36.466756 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a8580-1e4f-4745-9bb7-efb5269c126b None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:36.472217 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 113/237] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:36.473953 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779230f-10e9-41c8-90cd-95ad49cc61a2 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:36.474490 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779230f-10e9-41c8-90cd-95ad49cc61a2 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:36.474978 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779230f-10e9-41c8-90cd-95ad49cc61a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:36.495968 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24529f9b-c8e8-4ba4-ab9d-c969573ae043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:36.496783 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24529f9b-c8e8-4ba4-ab9d-c969573ae043 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:36.497063 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24529f9b-c8e8-4ba4-ab9d-c969573ae043 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:36.497333 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24529f9b-c8e8-4ba4-ab9d-c969573ae043 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:36.509168 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-6779230f-10e9-41c8-90cd-95ad49cc61a2 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:36.510640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-6779230f-10e9-41c8-90cd-95ad49cc61a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:36.525507 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24529f9b-c8e8-4ba4-ab9d-c969573ae043 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:36.533802 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-24529f9b-c8e8-4ba4-ab9d-c969573ae043 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:32:36.533802 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:36.533802 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:36.533802 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:36.533802 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:36.533802 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:36.533802 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:36.533802 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:36.533802 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:36.533802 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:36.533802 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:36.533802 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:36.533802 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:36.533802 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:36.533802 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:36.533802 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:36.534935 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:36.534935 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:36.534935 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:36.534935 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:36.534935 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:36.534935 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:36.534935 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:36.534935 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:36.534935 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:36.534935 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:36.534935 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:36.534935 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:32:36.534935 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:36.534935 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:36.534935 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:36.534935 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:36.535907 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:36.535907 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:36.535907 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:36.535907 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:36.535907 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:36.535907 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:36.535907 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:36.535907 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:36.535907 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:36.535907 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:36.535907 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:32:36.535907 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:32:36.538112 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 125/238] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:36.543437 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24529f9b-c8e8-4ba4-ab9d-c969573ae043 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:36.613219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 114/239] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:36.653548 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779230f-10e9-41c8-90cd-95ad49cc61a2 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:36.699498 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24529f9b-c8e8-4ba4-ab9d-c969573ae043 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:36.783331 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b37cdd-d54e-4bde-9105-162562788086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:36.784687 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b37cdd-d54e-4bde-9105-162562788086 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:36.784824 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b37cdd-d54e-4bde-9105-162562788086 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:36.785072 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b37cdd-d54e-4bde-9105-162562788086 None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:36.785973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b37cdd-d54e-4bde-9105-162562788086 None admin] RBAC: Adding query filter params (name=reader) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:36.786316 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b37cdd-d54e-4bde-9105-162562788086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:36.787717 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b37cdd-d54e-4bde-9105-162562788086 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:36.791806 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779230f-10e9-41c8-90cd-95ad49cc61a2 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:36.809016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 126/240] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:32:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:36.815231 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b37cdd-d54e-4bde-9105-162562788086 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:36.836371 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a19d9-c82d-438a-8e62-83dc48b001cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:36.837639 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a19d9-c82d-438a-8e62-83dc48b001cb None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:36.838139 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a19d9-c82d-438a-8e62-83dc48b001cb None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:36.838624 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a19d9-c82d-438a-8e62-83dc48b001cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:36.840722 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a19d9-c82d-438a-8e62-83dc48b001cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:36.844548 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a19d9-c82d-438a-8e62-83dc48b001cb None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:36.847142 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 115/241] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:32:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:36.854407 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a19d9-c82d-438a-8e62-83dc48b001cb None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:37.006261 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b37cdd-d54e-4bde-9105-162562788086 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:37.064452 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a19d9-c82d-438a-8e62-83dc48b001cb None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:37.085003 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528c64b-fc98-4ff3-8cb4-a96e140e1952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:37.085964 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528c64b-fc98-4ff3-8cb4-a96e140e1952 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:37.086249 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528c64b-fc98-4ff3-8cb4-a96e140e1952 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:37.086526 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528c64b-fc98-4ff3-8cb4-a96e140e1952 None admin] PATH_INFO: `/v3/users/8ea9f682c84243259e9780008255a5b4` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:37.103598 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528c64b-fc98-4ff3-8cb4-a96e140e1952 None admin] RBAC: Authorizing `identity:get_user(user_id=8ea9f682c84243259e9780008255a5b4)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:37.105360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528c64b-fc98-4ff3-8cb4-a96e140e1952 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:37.108396 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 127/242] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:36 2022] GET /identity/v3/users/8ea9f682c84243259e9780008255a5b4 => generated 297 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:37.116268 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528c64b-fc98-4ff3-8cb4-a96e140e1952 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:37.147057 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35252d2b-de74-4063-8b4c-6a0adbe664c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:37.147744 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35252d2b-de74-4063-8b4c-6a0adbe664c4 None admin] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:37.148036 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35252d2b-de74-4063-8b4c-6a0adbe664c4 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:37.148317 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35252d2b-de74-4063-8b4c-6a0adbe664c4 None admin] PATH_INFO: `/v3/users` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:37.149050 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35252d2b-de74-4063-8b4c-6a0adbe664c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:37.152361 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35252d2b-de74-4063-8b4c-6a0adbe664c4 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:37.191136 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 116/243] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:32:36 2022] POST /identity/v3/users => generated 293 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:32:37.269897 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528c64b-fc98-4ff3-8cb4-a96e140e1952 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:37.308422 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7566a12-88a5-4294-bc00-cc72524bf6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:37.309101 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7566a12-88a5-4294-bc00-cc72524bf6ae None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:37.309402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7566a12-88a5-4294-bc00-cc72524bf6ae None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:37.309709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7566a12-88a5-4294-bc00-cc72524bf6ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:37.406103 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7566a12-88a5-4294-bc00-cc72524bf6ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:37.407587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7566a12-88a5-4294-bc00-cc72524bf6ae None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:37.522992 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 128/244] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:32:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:32:37.528880 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35252d2b-de74-4063-8b4c-6a0adbe664c4 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:37.663728 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35252d2b-de74-4063-8b4c-6a0adbe664c4 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:37.702759 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e280115-6ada-4aef-908f-9c4a10197454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:37.703657 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e280115-6ada-4aef-908f-9c4a10197454 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:37.703947 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e280115-6ada-4aef-908f-9c4a10197454 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:37.704230 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e280115-6ada-4aef-908f-9c4a10197454 None admin] PATH_INFO: `/v3/projects/f097dc1a2c714aada1ee8228564936d7` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:37.706040 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e280115-6ada-4aef-908f-9c4a10197454 None admin] RBAC: Authorizing `identity:get_project(project_id=f097dc1a2c714aada1ee8228564936d7)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:37.707557 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e280115-6ada-4aef-908f-9c4a10197454 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:37.709793 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 117/245] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:37 2022] GET /identity/v3/projects/f097dc1a2c714aada1ee8228564936d7 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:37.710765 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219755a5-10c4-45fe-87d3-230a8c5ffeae None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:37.711068 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219755a5-10c4-45fe-87d3-230a8c5ffeae None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:37.711353 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219755a5-10c4-45fe-87d3-230a8c5ffeae None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:37.712810 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 129/246] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:37.719458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e280115-6ada-4aef-908f-9c4a10197454 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:37.724772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f5583-828d-4375-8ccd-ecaab4bbcea5 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:37.725055 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f5583-828d-4375-8ccd-ecaab4bbcea5 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:37.725343 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f5583-828d-4375-8ccd-ecaab4bbcea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:37.757046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-4c4f5583-828d-4375-8ccd-ecaab4bbcea5 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:37.758603 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-4c4f5583-828d-4375-8ccd-ecaab4bbcea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:37.835531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e280115-6ada-4aef-908f-9c4a10197454 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:37.856552 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 130/247] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:37.857961 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb2bbb-8cfb-488e-957a-39a2fe3b6eb3 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:37.858255 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb2bbb-8cfb-488e-957a-39a2fe3b6eb3 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:37.858536 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb2bbb-8cfb-488e-957a-39a2fe3b6eb3 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:37.859833 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 131/248] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:37.866221 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46501f1-b36f-4e4e-b921-26b3332c61e7 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:37.866510 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46501f1-b36f-4e4e-b921-26b3332c61e7 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:37.866787 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46501f1-b36f-4e4e-b921-26b3332c61e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:37.876258 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7016c44-8d6c-45b8-a5e5-1be6e6e11e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:37.877595 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7016c44-8d6c-45b8-a5e5-1be6e6e11e44 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:37.877903 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7016c44-8d6c-45b8-a5e5-1be6e6e11e44 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:37.878193 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7016c44-8d6c-45b8-a5e5-1be6e6e11e44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:37.879055 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7016c44-8d6c-45b8-a5e5-1be6e6e11e44 None admin] RBAC: Adding query filter params (role.id=0f6ee7650e6c49e3b33ccb7090a19c23, scope.project.id=f097dc1a2c714aada1ee8228564936d7, user.id=8ea9f682c84243259e9780008255a5b4) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:37.879379 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7016c44-8d6c-45b8-a5e5-1be6e6e11e44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:37.880867 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7016c44-8d6c-45b8-a5e5-1be6e6e11e44 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:37.884313 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-f46501f1-b36f-4e4e-b921-26b3332c61e7 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:37.885581 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-f46501f1-b36f-4e4e-b921-26b3332c61e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:37.887152 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 118/249] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:32:37 2022] GET /identity/v3/role_assignments?user.id=8ea9f682c84243259e9780008255a5b4&scope.project.id=f097dc1a2c714aada1ee8228564936d7&role.id=0f6ee7650e6c49e3b33ccb7090a19c23 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:37.894053 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7016c44-8d6c-45b8-a5e5-1be6e6e11e44 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:37.980328 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 132/250] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:32:37.981764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f7658-e8b3-46b1-92f1-a30311eb01df None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:37.982062 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f7658-e8b3-46b1-92f1-a30311eb01df None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:37.982346 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f7658-e8b3-46b1-92f1-a30311eb01df None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:37.983950 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 133/251] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:37.990256 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ba08e-7b0e-49be-8ead-67acdd3ea590 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:37.990560 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ba08e-7b0e-49be-8ead-67acdd3ea590 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:37.990986 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ba08e-7b0e-49be-8ead-67acdd3ea590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:38.014709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-3d2ba08e-7b0e-49be-8ead-67acdd3ea590 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:38.016290 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-3d2ba08e-7b0e-49be-8ead-67acdd3ea590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:38.031031 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7016c44-8d6c-45b8-a5e5-1be6e6e11e44 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:38.078798 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c65484-65cc-4b00-bef9-d1d93805cf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:38.080538 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c65484-65cc-4b00-bef9-d1d93805cf82 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:38.080538 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c65484-65cc-4b00-bef9-d1d93805cf82 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:38.080838 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c65484-65cc-4b00-bef9-d1d93805cf82 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:38.098812 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c65484-65cc-4b00-bef9-d1d93805cf82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:38.112097 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-85c65484-65cc-4b00-bef9-d1d93805cf82 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:32:38.112097 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:38.112097 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:38.112097 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:38.112097 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:38.112097 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:38.112097 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:38.112097 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:38.112097 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:38.112097 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:38.112097 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:38.112097 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:38.112097 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:38.112097 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:38.112097 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:38.112097 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:38.113464 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:38.113464 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:38.113464 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:38.113464 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:38.113464 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:38.113464 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:38.113464 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:38.113464 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:38.113464 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:38.113464 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:38.113464 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:38.113464 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:32:38.113464 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:38.113464 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:38.113464 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:38.113464 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:38.114534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:38.114534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:38.114534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:38.114534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:38.114534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:38.114534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:38.114534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:38.114534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:38.114534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:38.114534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:38.114534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:32:38.114534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:32:38.114534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 119/252] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:32:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:38.115354 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c65484-65cc-4b00-bef9-d1d93805cf82 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:38.128404 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 134/253] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:32:38.129861 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ba08e-7b0e-49be-8ead-67acdd3ea590 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:38.240010 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c65484-65cc-4b00-bef9-d1d93805cf82 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:38.265549 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ba08e-7b0e-49be-8ead-67acdd3ea590 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:38.284865 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101d69c-6238-4977-a051-7a44c3ecd33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:38.285723 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101d69c-6238-4977-a051-7a44c3ecd33e None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:38.286262 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101d69c-6238-4977-a051-7a44c3ecd33e None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:38.286556 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101d69c-6238-4977-a051-7a44c3ecd33e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:38.300417 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101d69c-6238-4977-a051-7a44c3ecd33e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:38.306921 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a701060-0140-4c91-9600-c937109b39aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:38.308212 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a701060-0140-4c91-9600-c937109b39aa None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:38.308714 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a701060-0140-4c91-9600-c937109b39aa None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:38.309200 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a701060-0140-4c91-9600-c937109b39aa None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:38.309312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-5101d69c-6238-4977-a051-7a44c3ecd33e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:32:38.309312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:38.309312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:38.309312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:38.309312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:38.309312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:38.309312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:38.309312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:38.309312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:38.309312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:38.309312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:38.309312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:38.309312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:38.309312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:38.309312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:38.309312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:38.310295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:38.310295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:38.310295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:38.310295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:38.310295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:38.310295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:38.310295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:38.310295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:38.310295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:38.310295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:38.310295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:38.310295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:32:38.310295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:38.310295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:38.310295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:38.310295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:38.311203 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:38.311203 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:38.311203 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:38.311203 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:38.311203 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:38.311203 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:38.311203 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:38.311203 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:38.311203 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:38.311203 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:38.311203 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:32:38.311203 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:32:38.311203 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 120/254] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:32:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:38.311953 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101d69c-6238-4977-a051-7a44c3ecd33e None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:38.313476 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a701060-0140-4c91-9600-c937109b39aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:38.314538 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a701060-0140-4c91-9600-c937109b39aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:38.316244 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a701060-0140-4c91-9600-c937109b39aa None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:38.325830 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 135/255] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:32:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:38.326987 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a701060-0140-4c91-9600-c937109b39aa None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:38.436267 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101d69c-6238-4977-a051-7a44c3ecd33e None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:38.478861 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6886d14-86c5-41fc-8dcf-ce2d22d0795c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:38.479691 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6886d14-86c5-41fc-8dcf-ce2d22d0795c None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:38.479980 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6886d14-86c5-41fc-8dcf-ce2d22d0795c None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:38.480263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6886d14-86c5-41fc-8dcf-ce2d22d0795c None admin] PATH_INFO: `/v3/roles/member` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:38.493302 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6886d14-86c5-41fc-8dcf-ce2d22d0795c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:38.503845 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-d6886d14-86c5-41fc-8dcf-ce2d22d0795c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:38.503845 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:38.503845 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:38.503845 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:38.503845 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:38.503845 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:38.503845 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:38.503845 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:38.503845 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:38.503845 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:38.503845 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:38.503845 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:38.503845 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:38.503845 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:38.503845 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:38.503845 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:38.504876 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:38.504876 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:38.504876 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:38.504876 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:38.504876 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:38.504876 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:38.504876 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:38.504876 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:38.504876 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:38.504876 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:38.504876 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:38.504876 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:32:38.504876 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:38.504876 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:38.504876 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:38.504876 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:38.505848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:38.505848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:38.505848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:38.505848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:38.505848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:38.505848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:38.505848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:38.505848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:38.505848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:38.505848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:38.505848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:38.505848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:32:38.505848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 121/256] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:38.507097 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6886d14-86c5-41fc-8dcf-ce2d22d0795c None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:38.526313 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a701060-0140-4c91-9600-c937109b39aa None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:38.609294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16111587-cc23-4166-9ee4-44588639b90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:38.610020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16111587-cc23-4166-9ee4-44588639b90e None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:38.610360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16111587-cc23-4166-9ee4-44588639b90e None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:38.610643 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16111587-cc23-4166-9ee4-44588639b90e None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:38.612012 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16111587-cc23-4166-9ee4-44588639b90e None admin] RBAC: Adding query filter params (name=admin) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:38.612323 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16111587-cc23-4166-9ee4-44588639b90e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:38.613983 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16111587-cc23-4166-9ee4-44588639b90e None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:38.624206 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6886d14-86c5-41fc-8dcf-ce2d22d0795c None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:38.644731 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 136/257] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:38.649702 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16111587-cc23-4166-9ee4-44588639b90e None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:38.684263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029faef4-6af8-44e9-b35e-94022de32956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:38.685165 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029faef4-6af8-44e9-b35e-94022de32956 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:38.685491 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029faef4-6af8-44e9-b35e-94022de32956 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:38.685772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029faef4-6af8-44e9-b35e-94022de32956 None admin] PATH_INFO: `/v3/users/c1d6058310e84365b6eee084762be50d` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:38.688465 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029faef4-6af8-44e9-b35e-94022de32956 None admin] RBAC: Authorizing `identity:get_user(user_id=c1d6058310e84365b6eee084762be50d)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:38.690807 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029faef4-6af8-44e9-b35e-94022de32956 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:38.692556 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 122/258] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:38 2022] GET /identity/v3/users/c1d6058310e84365b6eee084762be50d => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:38.693378 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029faef4-6af8-44e9-b35e-94022de32956 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:38.812712 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16111587-cc23-4166-9ee4-44588639b90e None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:38.851643 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029faef4-6af8-44e9-b35e-94022de32956 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:38.871060 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428d12f-8eaf-4410-95a9-b21ca34c46c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:38.871825 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428d12f-8eaf-4410-95a9-b21ca34c46c2 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:38.872122 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428d12f-8eaf-4410-95a9-b21ca34c46c2 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:38.872411 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428d12f-8eaf-4410-95a9-b21ca34c46c2 None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:38.873707 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428d12f-8eaf-4410-95a9-b21ca34c46c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:38.874190 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428d12f-8eaf-4410-95a9-b21ca34c46c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:38.875939 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428d12f-8eaf-4410-95a9-b21ca34c46c2 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:38.886539 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 137/259] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:32:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:38.887238 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428d12f-8eaf-4410-95a9-b21ca34c46c2 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:38.907056 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3473ad-d710-449d-8932-afee69c99338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:38.908560 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3473ad-d710-449d-8932-afee69c99338 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:38.908848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3473ad-d710-449d-8932-afee69c99338 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:38.909125 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3473ad-d710-449d-8932-afee69c99338 None admin] PATH_INFO: `/v3/users/c1d6058310e84365b6eee084762be50d` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:38.910531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3473ad-d710-449d-8932-afee69c99338 None admin] RBAC: Authorizing `identity:get_user(user_id=c1d6058310e84365b6eee084762be50d)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:38.912002 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3473ad-d710-449d-8932-afee69c99338 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:38.914042 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 123/260] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:38 2022] GET /identity/v3/users/c1d6058310e84365b6eee084762be50d => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:38.914887 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3473ad-d710-449d-8932-afee69c99338 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:39.052063 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3473ad-d710-449d-8932-afee69c99338 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:39.091948 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428d12f-8eaf-4410-95a9-b21ca34c46c2 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:39.114118 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086a681-ae44-4e44-b3e2-4e6eba272ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:39.115379 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086a681-ae44-4e44-b3e2-4e6eba272ff8 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:39.115922 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086a681-ae44-4e44-b3e2-4e6eba272ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:39.116205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086a681-ae44-4e44-b3e2-4e6eba272ff8 None admin] PATH_INFO: `/v3/users/52bd845d860246699e3d9eacb3e530ac` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:39.122204 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086a681-ae44-4e44-b3e2-4e6eba272ff8 None admin] RBAC: Authorizing `identity:get_user(user_id=52bd845d860246699e3d9eacb3e530ac)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:39.123737 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086a681-ae44-4e44-b3e2-4e6eba272ff8 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:39.125465 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 124/261] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:38 2022] GET /identity/v3/users/52bd845d860246699e3d9eacb3e530ac => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:39.126259 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086a681-ae44-4e44-b3e2-4e6eba272ff8 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:39.144221 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b2806-a545-485d-9949-29989d9c805d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:39.145272 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b2806-a545-485d-9949-29989d9c805d None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:39.145805 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b2806-a545-485d-9949-29989d9c805d None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:39.146292 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b2806-a545-485d-9949-29989d9c805d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:39.276059 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b2806-a545-485d-9949-29989d9c805d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:39.277998 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b2806-a545-485d-9949-29989d9c805d None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:39.317735 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086a681-ae44-4e44-b3e2-4e6eba272ff8 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:39.383130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef935f-7ca9-4bab-8f54-9c8190085cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:39.384184 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef935f-7ca9-4bab-8f54-9c8190085cf8 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:39.384681 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef935f-7ca9-4bab-8f54-9c8190085cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:39.385167 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef935f-7ca9-4bab-8f54-9c8190085cf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:39.464814 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 138/262] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:32:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:32:39.465820 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b2806-a545-485d-9949-29989d9c805d None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:39.554441 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef935f-7ca9-4bab-8f54-9c8190085cf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:39.556302 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef935f-7ca9-4bab-8f54-9c8190085cf8 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:39.569980 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b2806-a545-485d-9949-29989d9c805d None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:39.611599 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63427cd9-f328-49a9-adc5-995930e8ed89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:39.612872 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63427cd9-f328-49a9-adc5-995930e8ed89 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:39.613161 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63427cd9-f328-49a9-adc5-995930e8ed89 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:39.614180 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63427cd9-f328-49a9-adc5-995930e8ed89 None admin] PATH_INFO: `/v3/projects/f097dc1a2c714aada1ee8228564936d7` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:39.615517 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63427cd9-f328-49a9-adc5-995930e8ed89 None admin] RBAC: Authorizing `identity:get_project(project_id=f097dc1a2c714aada1ee8228564936d7)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:39.618149 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63427cd9-f328-49a9-adc5-995930e8ed89 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:39.621076 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 139/263] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:39 2022] GET /identity/v3/projects/f097dc1a2c714aada1ee8228564936d7 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:39.624382 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63427cd9-f328-49a9-adc5-995930e8ed89 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:39.756092 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 125/264] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:32:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:32:39.756959 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef935f-7ca9-4bab-8f54-9c8190085cf8 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:39.809769 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63427cd9-f328-49a9-adc5-995930e8ed89 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:39.850557 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560c9ad-60c6-4f80-abed-1c91f70ea228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:39.851445 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560c9ad-60c6-4f80-abed-1c91f70ea228 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:39.851733 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560c9ad-60c6-4f80-abed-1c91f70ea228 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:39.852007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560c9ad-60c6-4f80-abed-1c91f70ea228 None admin] PATH_INFO: `/v3/projects/f097dc1a2c714aada1ee8228564936d7` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:39.853403 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560c9ad-60c6-4f80-abed-1c91f70ea228 None admin] RBAC: Authorizing `identity:get_project(project_id=f097dc1a2c714aada1ee8228564936d7)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:39.854885 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560c9ad-60c6-4f80-abed-1c91f70ea228 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:39.856637 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 140/265] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:39 2022] GET /identity/v3/projects/f097dc1a2c714aada1ee8228564936d7 => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:39.857449 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560c9ad-60c6-4f80-abed-1c91f70ea228 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:39.974935 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef935f-7ca9-4bab-8f54-9c8190085cf8 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:39.992515 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560c9ad-60c6-4f80-abed-1c91f70ea228 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:40.029204 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03760d-833c-4c8a-a077-6dddc481bcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:40.030207 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03760d-833c-4c8a-a077-6dddc481bcf1 None admin] REQUEST_METHOD: `PUT` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:40.030440 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983343bf-2470-4ba7-98aa-0f92c823fe45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:40.030580 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03760d-833c-4c8a-a077-6dddc481bcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:40.030811 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03760d-833c-4c8a-a077-6dddc481bcf1 None admin] PATH_INFO: `/v3/projects/f097dc1a2c714aada1ee8228564936d7/users/52bd845d860246699e3d9eacb3e530ac/roles/198eba72a9774c1b87f0403d4f400243` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:40.031315 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983343bf-2470-4ba7-98aa-0f92c823fe45 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:40.031602 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983343bf-2470-4ba7-98aa-0f92c823fe45 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:40.031882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983343bf-2470-4ba7-98aa-0f92c823fe45 None admin] PATH_INFO: `/v3/projects/f097dc1a2c714aada1ee8228564936d7` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:40.032964 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03760d-833c-4c8a-a077-6dddc481bcf1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f097dc1a2c714aada1ee8228564936d7, user_id=52bd845d860246699e3d9eacb3e530ac, role_id=198eba72a9774c1b87f0403d4f400243)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:40.033598 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983343bf-2470-4ba7-98aa-0f92c823fe45 None admin] RBAC: Authorizing `identity:get_project(project_id=f097dc1a2c714aada1ee8228564936d7)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:40.034586 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03760d-833c-4c8a-a077-6dddc481bcf1 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:40.035131 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983343bf-2470-4ba7-98aa-0f92c823fe45 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:40.036905 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 141/266] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:39 2022] GET /identity/v3/projects/f097dc1a2c714aada1ee8228564936d7 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:40.037730 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983343bf-2470-4ba7-98aa-0f92c823fe45 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:40.072178 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 126/267] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:32:39 2022] PUT /identity/v3/projects/f097dc1a2c714aada1ee8228564936d7/users/52bd845d860246699e3d9eacb3e530ac/roles/198eba72a9774c1b87f0403d4f400243 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:32:40.073037 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03760d-833c-4c8a-a077-6dddc481bcf1 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:40.232638 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983343bf-2470-4ba7-98aa-0f92c823fe45 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:40.290356 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8a86a-042e-4cc6-b3d3-593635b44e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:40.290961 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8a86a-042e-4cc6-b3d3-593635b44e18 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:40.291250 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8a86a-042e-4cc6-b3d3-593635b44e18 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:40.291530 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8a86a-042e-4cc6-b3d3-593635b44e18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:40.292425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8a86a-042e-4cc6-b3d3-593635b44e18 None admin] RBAC: Adding query filter params (role.id=607698024b4d44f0a109bb69deafc0c5, scope.project.id=f097dc1a2c714aada1ee8228564936d7, user.id=c1d6058310e84365b6eee084762be50d) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:40.292745 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8a86a-042e-4cc6-b3d3-593635b44e18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:40.294311 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8a86a-042e-4cc6-b3d3-593635b44e18 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:40.295019 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03760d-833c-4c8a-a077-6dddc481bcf1 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:40.302062 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 142/268] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:32:40 2022] GET /identity/v3/role_assignments?user.id=c1d6058310e84365b6eee084762be50d&scope.project.id=f097dc1a2c714aada1ee8228564936d7&role.id=607698024b4d44f0a109bb69deafc0c5 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:40.375916 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfb3a5-c6bc-4b2f-85c6-b0fde1841e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:40.377297 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfb3a5-c6bc-4b2f-85c6-b0fde1841e40 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:40.377820 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfb3a5-c6bc-4b2f-85c6-b0fde1841e40 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:40.378258 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfb3a5-c6bc-4b2f-85c6-b0fde1841e40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:40.379326 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dfb3a5-c6bc-4b2f-85c6-b0fde1841e40 None admin] RBAC: Adding query filter params (role.id=a5cb8d37261d486cbc1b06d167a9c05c, scope.project.id=f097dc1a2c714aada1ee8228564936d7, user.id=c1d6058310e84365b6eee084762be50d) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:40.379838 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dfb3a5-c6bc-4b2f-85c6-b0fde1841e40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:40.381527 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dfb3a5-c6bc-4b2f-85c6-b0fde1841e40 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:40.390227 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 127/269] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:32:40 2022] GET /identity/v3/role_assignments?user.id=c1d6058310e84365b6eee084762be50d&scope.project.id=f097dc1a2c714aada1ee8228564936d7&role.id=a5cb8d37261d486cbc1b06d167a9c05c => generated 608 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:40.665880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d53516-e126-4c38-b919-deec644c3532 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:40.666441 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d53516-e126-4c38-b919-deec644c3532 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:40.666441 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d53516-e126-4c38-b919-deec644c3532 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:40.668252 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 143/270] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:40.674519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cad61e-5d60-4975-8da6-193d5fd20d84 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:40.674812 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cad61e-5d60-4975-8da6-193d5fd20d84 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:40.675095 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cad61e-5d60-4975-8da6-193d5fd20d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:40.697771 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-32cad61e-5d60-4975-8da6-193d5fd20d84 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:40.699067 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-32cad61e-5d60-4975-8da6-193d5fd20d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:40.771134 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85478dbf-1920-4881-a371-e946f2eb80d8 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:40.771416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85478dbf-1920-4881-a371-e946f2eb80d8 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:40.771943 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85478dbf-1920-4881-a371-e946f2eb80d8 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:40.773832 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 144/271] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:40.779420 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176274a-b657-4624-9a83-1f64db27bfb8 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:40.781279 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176274a-b657-4624-9a83-1f64db27bfb8 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:40.781629 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176274a-b657-4624-9a83-1f64db27bfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:40.799799 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 128/272] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:40.810032 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-c176274a-b657-4624-9a83-1f64db27bfb8 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:40.811665 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-c176274a-b657-4624-9a83-1f64db27bfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:40.830466 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cad61e-5d60-4975-8da6-193d5fd20d84 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:40.921419 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 145/273] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:40.941098 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672fc00-8850-414f-a9c7-fbd149347679 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:40.941824 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672fc00-8850-414f-a9c7-fbd149347679 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:40.942319 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672fc00-8850-414f-a9c7-fbd149347679 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:40.945101 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 146/274] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:32:40.948772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672fc00-8850-414f-a9c7-fbd149347679 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:40.966502 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cad61e-5d60-4975-8da6-193d5fd20d84 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:41.005924 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29c038-01ea-4f0a-98f4-6e688848dbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:41.006737 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29c038-01ea-4f0a-98f4-6e688848dbb5 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:41.007021 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29c038-01ea-4f0a-98f4-6e688848dbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:41.007300 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29c038-01ea-4f0a-98f4-6e688848dbb5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:41.008645 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29c038-01ea-4f0a-98f4-6e688848dbb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:41.010219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29c038-01ea-4f0a-98f4-6e688848dbb5 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:41.013559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 129/275] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:32:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:41.013559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879830f-43d9-4a24-9f31-1d5e5247a34d None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:41.013559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879830f-43d9-4a24-9f31-1d5e5247a34d None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:41.013848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879830f-43d9-4a24-9f31-1d5e5247a34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:41.030837 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-c879830f-43d9-4a24-9f31-1d5e5247a34d None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:41.032031 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-c879830f-43d9-4a24-9f31-1d5e5247a34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:41.076753 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672fc00-8850-414f-a9c7-fbd149347679 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:41.114499 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 130/276] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:41.122139 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879830f-43d9-4a24-9f31-1d5e5247a34d None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:41.128210 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd691bd-3992-448f-a7f8-55101b0095aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:41.130010 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd691bd-3992-448f-a7f8-55101b0095aa None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:41.130828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd691bd-3992-448f-a7f8-55101b0095aa None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:41.131557 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd691bd-3992-448f-a7f8-55101b0095aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:41.147711 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd691bd-3992-448f-a7f8-55101b0095aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:41.155912 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-fbd691bd-3992-448f-a7f8-55101b0095aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:41.155912 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:41.155912 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:41.155912 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:41.155912 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:41.155912 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:41.155912 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:41.155912 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:41.155912 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:41.155912 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:41.155912 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:41.155912 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:41.155912 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:41.155912 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:41.155912 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:41.155912 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:41.156959 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:41.156959 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:41.156959 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:41.156959 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:41.156959 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:41.156959 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:41.156959 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:41.156959 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:41.156959 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:41.156959 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:41.156959 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:41.156959 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:32:41.156959 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:41.156959 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:41.156959 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:41.156959 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:41.158009 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:41.158009 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:41.158009 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:41.158009 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:41.158009 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:41.158009 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:41.158009 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:41.158009 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:41.158009 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:41.158009 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:41.158009 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:41.158009 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:32:41.161735 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 147/277] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:32:41.163159 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd691bd-3992-448f-a7f8-55101b0095aa None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:41.231985 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879830f-43d9-4a24-9f31-1d5e5247a34d None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:41.265974 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f24ac-eb0a-4bc9-8fc1-e0e99d6c7b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:41.266653 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f24ac-eb0a-4bc9-8fc1-e0e99d6c7b78 None admin] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:41.266936 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f24ac-eb0a-4bc9-8fc1-e0e99d6c7b78 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:41.267919 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f24ac-eb0a-4bc9-8fc1-e0e99d6c7b78 None admin] PATH_INFO: `/v3/users` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:41.268728 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f24ac-eb0a-4bc9-8fc1-e0e99d6c7b78 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:41.270194 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f24ac-eb0a-4bc9-8fc1-e0e99d6c7b78 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:41.278518 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd691bd-3992-448f-a7f8-55101b0095aa None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:41.292021 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 131/278] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:32:41 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:32:41.293211 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f24ac-eb0a-4bc9-8fc1-e0e99d6c7b78 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:41.328133 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39803a3c-d96f-4933-8256-2806cf288437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:41.329757 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39803a3c-d96f-4933-8256-2806cf288437 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:41.330812 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39803a3c-d96f-4933-8256-2806cf288437 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:41.331300 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39803a3c-d96f-4933-8256-2806cf288437 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:41.343296 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39803a3c-d96f-4933-8256-2806cf288437 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:41.352125 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-39803a3c-d96f-4933-8256-2806cf288437 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:32:41.352125 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:41.352125 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:41.352125 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:41.352125 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:41.352125 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:41.352125 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:41.352125 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:41.352125 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:41.352125 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:41.352125 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:41.352125 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:41.352125 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:41.352125 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:41.352125 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:41.352125 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:41.353209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:41.353209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:41.353209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:41.353209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:41.353209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:41.353209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:41.353209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:41.353209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:41.353209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:41.353209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:41.353209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:41.353209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:32:41.353209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:41.353209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:41.353209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:41.353209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:41.354173 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:41.354173 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:41.354173 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:41.354173 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:41.354173 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:41.354173 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:41.354173 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:41.354173 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:41.354173 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:41.354173 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:41.354173 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:32:41.354173 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:32:41.356877 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 148/279] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:41.364333 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39803a3c-d96f-4933-8256-2806cf288437 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:41.426946 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f24ac-eb0a-4bc9-8fc1-e0e99d6c7b78 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:41.467761 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bab17-893c-45c2-90fd-d32c93f8abbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:41.468152 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bab17-893c-45c2-90fd-d32c93f8abbd None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:41.468375 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bab17-893c-45c2-90fd-d32c93f8abbd None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:41.468655 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bab17-893c-45c2-90fd-d32c93f8abbd None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:41.469444 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bab17-893c-45c2-90fd-d32c93f8abbd None admin] RBAC: Adding query filter params (name=member) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:41.469928 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bab17-893c-45c2-90fd-d32c93f8abbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:41.471965 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bab17-893c-45c2-90fd-d32c93f8abbd None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:41.481899 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 132/280] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:32:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:41.489210 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bab17-893c-45c2-90fd-d32c93f8abbd None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:41.491980 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39803a3c-d96f-4933-8256-2806cf288437 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:41.535570 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f4c23-a971-48bb-992e-220a0df3b8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:41.536159 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f4c23-a971-48bb-992e-220a0df3b8b4 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:41.536984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f4c23-a971-48bb-992e-220a0df3b8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:41.536984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f4c23-a971-48bb-992e-220a0df3b8b4 None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:41.537512 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f4c23-a971-48bb-992e-220a0df3b8b4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:41.537812 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f4c23-a971-48bb-992e-220a0df3b8b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:41.539925 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f4c23-a971-48bb-992e-220a0df3b8b4 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:41.550980 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 149/281] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:32:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:41.557148 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f4c23-a971-48bb-992e-220a0df3b8b4 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:41.612610 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bab17-893c-45c2-90fd-d32c93f8abbd None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:41.661559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf1e07-e4a0-46ae-9049-95b1f760abaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:41.661801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf1e07-e4a0-46ae-9049-95b1f760abaf None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:41.662072 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf1e07-e4a0-46ae-9049-95b1f760abaf None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:41.662351 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf1e07-e4a0-46ae-9049-95b1f760abaf None admin] PATH_INFO: `/v3/users/d5acca77635449d4802ed1ea47137e0d` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:41.683868 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf1e07-e4a0-46ae-9049-95b1f760abaf None admin] RBAC: Authorizing `identity:get_user(user_id=d5acca77635449d4802ed1ea47137e0d)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:41.686235 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf1e07-e4a0-46ae-9049-95b1f760abaf None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:41.689886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 133/282] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:41 2022] GET /identity/v3/users/d5acca77635449d4802ed1ea47137e0d => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:41.695276 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf1e07-e4a0-46ae-9049-95b1f760abaf None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:41.708893 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f4c23-a971-48bb-992e-220a0df3b8b4 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:41.753421 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23007b3e-2125-4626-9de6-ce1b4010db9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:41.754367 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23007b3e-2125-4626-9de6-ce1b4010db9e None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:41.754651 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23007b3e-2125-4626-9de6-ce1b4010db9e None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:41.754925 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23007b3e-2125-4626-9de6-ce1b4010db9e None admin] PATH_INFO: `/v3/users/8ea9f682c84243259e9780008255a5b4` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:41.756338 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23007b3e-2125-4626-9de6-ce1b4010db9e None admin] RBAC: Authorizing `identity:get_user(user_id=8ea9f682c84243259e9780008255a5b4)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:41.759231 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23007b3e-2125-4626-9de6-ce1b4010db9e None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:41.761713 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 150/283] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:41 2022] GET /identity/v3/users/8ea9f682c84243259e9780008255a5b4 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:41.769827 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23007b3e-2125-4626-9de6-ce1b4010db9e None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:41.831039 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf1e07-e4a0-46ae-9049-95b1f760abaf None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:41.877947 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abdf90-09d4-4ac2-95ec-f9aa4d0497d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:41.878622 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abdf90-09d4-4ac2-95ec-f9aa4d0497d8 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:41.878910 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abdf90-09d4-4ac2-95ec-f9aa4d0497d8 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:41.881393 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abdf90-09d4-4ac2-95ec-f9aa4d0497d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:41.881393 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abdf90-09d4-4ac2-95ec-f9aa4d0497d8 None admin] RBAC: Adding query filter params (role.id=198eba72a9774c1b87f0403d4f400243, user.id=d5acca77635449d4802ed1ea47137e0d, scope.system=all) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:41.881393 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abdf90-09d4-4ac2-95ec-f9aa4d0497d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:41.881911 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abdf90-09d4-4ac2-95ec-f9aa4d0497d8 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:41.894324 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 134/284] 10.222.0.48 () {56 vars in 1308 bytes} [Mon May 9 15:32:41 2022] GET /identity/v3/role_assignments?user.id=d5acca77635449d4802ed1ea47137e0d&scope.system=all&role.id=198eba72a9774c1b87f0403d4f400243 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:41.896208 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23007b3e-2125-4626-9de6-ce1b4010db9e None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:41.932562 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371846d8-df36-41e2-ac35-27bcd4e08c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:41.933488 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371846d8-df36-41e2-ac35-27bcd4e08c09 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:41.933782 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371846d8-df36-41e2-ac35-27bcd4e08c09 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:41.934066 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371846d8-df36-41e2-ac35-27bcd4e08c09 None admin] PATH_INFO: `/v3/projects/f097dc1a2c714aada1ee8228564936d7` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:41.935316 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371846d8-df36-41e2-ac35-27bcd4e08c09 None admin] RBAC: Authorizing `identity:get_project(project_id=f097dc1a2c714aada1ee8228564936d7)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:41.936801 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371846d8-df36-41e2-ac35-27bcd4e08c09 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:41.939011 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 151/285] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:41 2022] GET /identity/v3/projects/f097dc1a2c714aada1ee8228564936d7 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:41.946560 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abdf90-09d4-4ac2-95ec-f9aa4d0497d8 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:42.085665 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abdf90-09d4-4ac2-95ec-f9aa4d0497d8 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:42.135696 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738004d-17b5-4832-9d4f-0fd74d958c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:42.137018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738004d-17b5-4832-9d4f-0fd74d958c01 None admin] REQUEST_METHOD: `PUT` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:42.137564 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738004d-17b5-4832-9d4f-0fd74d958c01 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:42.138087 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738004d-17b5-4832-9d4f-0fd74d958c01 None admin] PATH_INFO: `/v3/projects/f097dc1a2c714aada1ee8228564936d7/users/8ea9f682c84243259e9780008255a5b4/roles/0f6ee7650e6c49e3b33ccb7090a19c23` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:42.140516 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738004d-17b5-4832-9d4f-0fd74d958c01 None admin] RBAC: Authorizing `identity:create_grant(project_id=f097dc1a2c714aada1ee8228564936d7, user_id=8ea9f682c84243259e9780008255a5b4, role_id=0f6ee7650e6c49e3b33ccb7090a19c23)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:42.142859 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738004d-17b5-4832-9d4f-0fd74d958c01 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:42.168234 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 135/286] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:32:41 2022] PUT /identity/v3/projects/f097dc1a2c714aada1ee8228564936d7/users/8ea9f682c84243259e9780008255a5b4/roles/0f6ee7650e6c49e3b33ccb7090a19c23 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:32:43.071888 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958124d-a329-4942-acf3-92bfd202d846 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:43.072417 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958124d-a329-4942-acf3-92bfd202d846 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:43.072417 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958124d-a329-4942-acf3-92bfd202d846 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:43.073844 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 152/287] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:43.079288 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144edffe-f09d-48ad-a4a0-4b8547f793eb None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:43.079767 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144edffe-f09d-48ad-a4a0-4b8547f793eb None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:43.080574 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144edffe-f09d-48ad-a4a0-4b8547f793eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:43.101522 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-144edffe-f09d-48ad-a4a0-4b8547f793eb None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:43.103135 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-144edffe-f09d-48ad-a4a0-4b8547f793eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:43.192267 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 136/288] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:43.229223 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958124d-a329-4942-acf3-92bfd202d846 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:43.374358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958124d-a329-4942-acf3-92bfd202d846 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:43.417067 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0e08c-80cd-4288-97c2-dd9b9dcd151c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:43.417913 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0e08c-80cd-4288-97c2-dd9b9dcd151c None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:43.418196 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0e08c-80cd-4288-97c2-dd9b9dcd151c None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:43.418473 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0e08c-80cd-4288-97c2-dd9b9dcd151c None admin] PATH_INFO: `/v3/roles/member` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:43.436849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0e08c-80cd-4288-97c2-dd9b9dcd151c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:43.445461 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-e1a0e08c-80cd-4288-97c2-dd9b9dcd151c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:43.445461 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:43.445461 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:43.445461 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:43.445461 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:43.445461 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:43.445461 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:43.445461 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:43.445461 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:43.445461 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:43.445461 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:43.445461 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:43.445461 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:43.445461 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:43.445461 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:43.445461 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:43.446604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:43.446604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:43.446604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:43.446604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:43.446604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:43.446604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:43.446604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:43.446604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:43.446604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:43.446604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:43.446604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:43.446604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:32:43.446604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:43.446604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:43.446604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:43.446604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:43.447527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:43.447527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:43.447527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:43.447527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:43.447527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:43.447527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:43.447527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:43.447527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:43.447527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:43.447527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:43.447527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:43.447527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:32:43.447527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 153/289] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:43.457170 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144edffe-f09d-48ad-a4a0-4b8547f793eb None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:43.565975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144edffe-f09d-48ad-a4a0-4b8547f793eb None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:43.606487 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce91596-4f6f-4383-8b7e-18efb473e101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:43.607179 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce91596-4f6f-4383-8b7e-18efb473e101 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:43.607461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce91596-4f6f-4383-8b7e-18efb473e101 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:43.607736 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce91596-4f6f-4383-8b7e-18efb473e101 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:43.608504 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce91596-4f6f-4383-8b7e-18efb473e101 None admin] RBAC: Adding query filter params (name=member) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:43.608811 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce91596-4f6f-4383-8b7e-18efb473e101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:43.610237 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce91596-4f6f-4383-8b7e-18efb473e101 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:43.620008 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 137/290] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:32:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:43.628176 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0e08c-80cd-4288-97c2-dd9b9dcd151c None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:43.812419 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0e08c-80cd-4288-97c2-dd9b9dcd151c None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:43.903528 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb8cef-e90a-46ad-8928-1c6337be5faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:43.905008 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb8cef-e90a-46ad-8928-1c6337be5faa None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:43.905577 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb8cef-e90a-46ad-8928-1c6337be5faa None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:43.906113 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb8cef-e90a-46ad-8928-1c6337be5faa None admin] PATH_INFO: `/v3/users/52bd845d860246699e3d9eacb3e530ac` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:43.910145 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb8cef-e90a-46ad-8928-1c6337be5faa None admin] RBAC: Authorizing `identity:get_user(user_id=52bd845d860246699e3d9eacb3e530ac)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:43.912997 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb8cef-e90a-46ad-8928-1c6337be5faa None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:43.916753 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 154/291] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:43 2022] GET /identity/v3/users/52bd845d860246699e3d9eacb3e530ac => generated 297 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:43.923184 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce91596-4f6f-4383-8b7e-18efb473e101 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:44.079150 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce91596-4f6f-4383-8b7e-18efb473e101 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:44.123640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331515ce-3a99-4174-8c0d-33003971e163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:44.124431 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331515ce-3a99-4174-8c0d-33003971e163 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:44.124638 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331515ce-3a99-4174-8c0d-33003971e163 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:44.124817 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331515ce-3a99-4174-8c0d-33003971e163 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:44.228587 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331515ce-3a99-4174-8c0d-33003971e163 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:44.230133 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331515ce-3a99-4174-8c0d-33003971e163 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:44.263661 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b1a66-0304-44a3-8ab8-fc3703ef4e90 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:44.264702 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b1a66-0304-44a3-8ab8-fc3703ef4e90 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:44.265294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b1a66-0304-44a3-8ab8-fc3703ef4e90 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:44.267159 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 155/292] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:44.273361 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43edf5-51ff-4337-917d-d4f47e791fd6 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:44.274047 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43edf5-51ff-4337-917d-d4f47e791fd6 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:44.274573 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43edf5-51ff-4337-917d-d4f47e791fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:44.304972 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-8b43edf5-51ff-4337-917d-d4f47e791fd6 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:44.313415 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-8b43edf5-51ff-4337-917d-d4f47e791fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:44.349669 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 138/293] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:32:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:32:44.359558 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331515ce-3a99-4174-8c0d-33003971e163 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:44.452346 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 156/294] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:44.478435 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331515ce-3a99-4174-8c0d-33003971e163 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:44.494954 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43edf5-51ff-4337-917d-d4f47e791fd6 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:44.531560 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeb850-08ef-4b8f-a9a9-6d8bf9604091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:44.532537 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeb850-08ef-4b8f-a9a9-6d8bf9604091 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:44.533506 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeb850-08ef-4b8f-a9a9-6d8bf9604091 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:44.533802 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeb850-08ef-4b8f-a9a9-6d8bf9604091 None admin] PATH_INFO: `/v3/projects/f097dc1a2c714aada1ee8228564936d7` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:44.538451 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbeb850-08ef-4b8f-a9a9-6d8bf9604091 None admin] RBAC: Authorizing `identity:get_project(project_id=f097dc1a2c714aada1ee8228564936d7)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:44.540045 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbeb850-08ef-4b8f-a9a9-6d8bf9604091 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:44.542443 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 139/295] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:44 2022] GET /identity/v3/projects/f097dc1a2c714aada1ee8228564936d7 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:44.548208 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeb850-08ef-4b8f-a9a9-6d8bf9604091 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:44.625709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43edf5-51ff-4337-917d-d4f47e791fd6 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:44.687514 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9849d-068b-48bc-8ab3-4ce7cf62b1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:44.688830 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9849d-068b-48bc-8ab3-4ce7cf62b1d4 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:44.689948 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9849d-068b-48bc-8ab3-4ce7cf62b1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:44.690320 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9849d-068b-48bc-8ab3-4ce7cf62b1d4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:44.710207 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeb850-08ef-4b8f-a9a9-6d8bf9604091 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:44.723186 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9849d-068b-48bc-8ab3-4ce7cf62b1d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:44.740568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-55f9849d-068b-48bc-8ab3-4ce7cf62b1d4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:32:44.740568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:44.740568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:44.740568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:44.740568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:44.740568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:44.740568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:44.740568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:44.740568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:44.740568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:44.740568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:44.740568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:44.740568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:44.740568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:44.740568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:44.740568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:44.742050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:44.742050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:44.742050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:44.742050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:44.742050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:44.742050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:44.742050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:44.742050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:44.742050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:44.742050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:44.742050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:44.742050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:32:44.742050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:44.742050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:44.742050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:44.742050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:44.743046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:44.743046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:44.743046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:44.743046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:44.743046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:44.743046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:44.743046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:44.743046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:44.743046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:44.743046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:44.743046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:32:44.743046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:32:44.743046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 157/296] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:32:44.743862 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa03160-9828-4b48-a055-d97e7369aa3e None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:44.743862 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa03160-9828-4b48-a055-d97e7369aa3e None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:44.744649 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa03160-9828-4b48-a055-d97e7369aa3e None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:44.745952 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 158/297] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:44.751409 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa03160-9828-4b48-a055-d97e7369aa3e None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:44.762672 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b04274-f615-438e-b3da-c884c67a9f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:44.764357 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b04274-f615-438e-b3da-c884c67a9f6e None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:44.765224 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b04274-f615-438e-b3da-c884c67a9f6e None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:44.766134 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b04274-f615-438e-b3da-c884c67a9f6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:44.768025 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b04274-f615-438e-b3da-c884c67a9f6e None admin] RBAC: Adding query filter params (role.id=198eba72a9774c1b87f0403d4f400243, scope.project.id=f097dc1a2c714aada1ee8228564936d7, user.id=52bd845d860246699e3d9eacb3e530ac) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:44.768817 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b04274-f615-438e-b3da-c884c67a9f6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:44.770751 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b04274-f615-438e-b3da-c884c67a9f6e None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:44.777823 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 140/298] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:32:44 2022] GET /identity/v3/role_assignments?user.id=52bd845d860246699e3d9eacb3e530ac&scope.project.id=f097dc1a2c714aada1ee8228564936d7&role.id=198eba72a9774c1b87f0403d4f400243 => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:44.779559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94be4e4-77b4-4d92-83c9-ed73c0143bbc None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:44.780105 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94be4e4-77b4-4d92-83c9-ed73c0143bbc None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:44.780612 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94be4e4-77b4-4d92-83c9-ed73c0143bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:44.800793 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-c94be4e4-77b4-4d92-83c9-ed73c0143bbc None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:44.802884 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-c94be4e4-77b4-4d92-83c9-ed73c0143bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:44.899001 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 141/299] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:44.924174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94be4e4-77b4-4d92-83c9-ed73c0143bbc None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:44.991611 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa03160-9828-4b48-a055-d97e7369aa3e None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:45.082121 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8d819-2261-4b42-8856-4dfb4503ad0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:45.083811 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8d819-2261-4b42-8856-4dfb4503ad0f None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:45.084579 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8d819-2261-4b42-8856-4dfb4503ad0f None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:45.085120 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8d819-2261-4b42-8856-4dfb4503ad0f None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:45.086850 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8d819-2261-4b42-8856-4dfb4503ad0f None admin] RBAC: Adding query filter params (name=reader) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:45.087602 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8d819-2261-4b42-8856-4dfb4503ad0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:45.089665 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8d819-2261-4b42-8856-4dfb4503ad0f None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:45.093017 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94be4e4-77b4-4d92-83c9-ed73c0143bbc None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:45.106548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 159/300] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:32:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:45.108665 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818abd1-fbd4-45f2-9be9-7d4a05d0e222 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:45.109210 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818abd1-fbd4-45f2-9be9-7d4a05d0e222 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:45.109754 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818abd1-fbd4-45f2-9be9-7d4a05d0e222 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:45.114999 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 160/301] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:45.115824 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818abd1-fbd4-45f2-9be9-7d4a05d0e222 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:45.162697 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95508e24-18f9-4f18-b6c1-16c662bc59ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:45.164801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95508e24-18f9-4f18-b6c1-16c662bc59ff None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:45.165252 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95508e24-18f9-4f18-b6c1-16c662bc59ff None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:45.165995 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95508e24-18f9-4f18-b6c1-16c662bc59ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:45.167479 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95508e24-18f9-4f18-b6c1-16c662bc59ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:45.169150 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95508e24-18f9-4f18-b6c1-16c662bc59ff None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:45.172571 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 142/302] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:32:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:45.174618 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b29e6-7ab0-4088-9f58-f67d22237e85 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:45.175169 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b29e6-7ab0-4088-9f58-f67d22237e85 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:45.175651 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b29e6-7ab0-4088-9f58-f67d22237e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:45.199302 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-0e1b29e6-7ab0-4088-9f58-f67d22237e85 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:45.200064 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-0e1b29e6-7ab0-4088-9f58-f67d22237e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:45.270544 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818abd1-fbd4-45f2-9be9-7d4a05d0e222 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:45.282841 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 143/303] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:45.283898 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b29e6-7ab0-4088-9f58-f67d22237e85 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:45.315446 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931da9fd-85e3-494a-95ee-25ea326bf390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:45.318846 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931da9fd-85e3-494a-95ee-25ea326bf390 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:45.319175 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931da9fd-85e3-494a-95ee-25ea326bf390 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:45.319411 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931da9fd-85e3-494a-95ee-25ea326bf390 None admin] PATH_INFO: `/v3/users/00910a359d24402fa3c5b9c91f84b863` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:45.336456 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931da9fd-85e3-494a-95ee-25ea326bf390 None admin] RBAC: Authorizing `identity:get_user(user_id=00910a359d24402fa3c5b9c91f84b863)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:45.337962 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931da9fd-85e3-494a-95ee-25ea326bf390 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:45.339931 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 161/304] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:45 2022] GET /identity/v3/users/00910a359d24402fa3c5b9c91f84b863 => generated 293 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:45.344911 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931da9fd-85e3-494a-95ee-25ea326bf390 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:45.391534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b29e6-7ab0-4088-9f58-f67d22237e85 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:45.430410 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09040041-e487-42e9-9774-bae8f78b4aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:45.431104 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09040041-e487-42e9-9774-bae8f78b4aff None admin] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:45.431465 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09040041-e487-42e9-9774-bae8f78b4aff None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:45.431699 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09040041-e487-42e9-9774-bae8f78b4aff None admin] PATH_INFO: `/v3/groups` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:45.432410 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09040041-e487-42e9-9774-bae8f78b4aff None admin] RBAC: Authorizing `identity:create_group()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:45.433958 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09040041-e487-42e9-9774-bae8f78b4aff None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:45.450416 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 144/305] 10.222.0.48 () {60 vars in 1134 bytes} [Mon May 9 15:32:45 2022] POST /identity/v3/groups => generated 229 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:32:45.455267 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09040041-e487-42e9-9774-bae8f78b4aff None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:45.459863 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931da9fd-85e3-494a-95ee-25ea326bf390 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:45.506797 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b02302-d2bb-4795-9de7-fe6fc1b71440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:45.506797 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b02302-d2bb-4795-9de7-fe6fc1b71440 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:45.507162 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b02302-d2bb-4795-9de7-fe6fc1b71440 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:45.507445 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b02302-d2bb-4795-9de7-fe6fc1b71440 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:45.521616 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b02302-d2bb-4795-9de7-fe6fc1b71440 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:45.530324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-53b02302-d2bb-4795-9de7-fe6fc1b71440 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:32:45.530324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:45.530324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:45.530324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:45.530324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:45.530324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:45.530324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:45.530324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:45.530324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:45.530324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:45.530324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:45.530324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:45.530324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:45.530324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:45.530324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:45.530324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:45.531534 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:45.531534 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:45.531534 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:45.531534 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:45.531534 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:45.531534 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:45.531534 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:45.531534 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:45.531534 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:45.531534 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:45.531534 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:45.531534 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:32:45.531534 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:45.531534 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:45.531534 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:45.531534 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:45.532700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:45.532700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:45.532700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:45.532700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:45.532700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:45.532700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:45.532700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:45.532700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:45.532700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:45.532700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:45.532700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:32:45.532700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:32:45.532700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 162/306] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:45.533890 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18009d50-3c5a-4aa9-8d77-4de8180ee755 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:45.533968 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18009d50-3c5a-4aa9-8d77-4de8180ee755 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:45.534456 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18009d50-3c5a-4aa9-8d77-4de8180ee755 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:45.535723 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 163/307] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:45.538341 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18009d50-3c5a-4aa9-8d77-4de8180ee755 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:45.594063 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09040041-e487-42e9-9774-bae8f78b4aff None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:45.634381 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab505e2-73a8-4013-a616-97943aab792b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:45.635421 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab505e2-73a8-4013-a616-97943aab792b None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:45.635743 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab505e2-73a8-4013-a616-97943aab792b None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:45.636021 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab505e2-73a8-4013-a616-97943aab792b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:45.636921 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab505e2-73a8-4013-a616-97943aab792b None admin] RBAC: Adding query filter params (role.id=0f6ee7650e6c49e3b33ccb7090a19c23, user.id=00910a359d24402fa3c5b9c91f84b863, scope.system=all) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:45.637268 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab505e2-73a8-4013-a616-97943aab792b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:45.638935 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab505e2-73a8-4013-a616-97943aab792b None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:45.645763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 145/308] 10.222.0.48 () {56 vars in 1308 bytes} [Mon May 9 15:32:45 2022] GET /identity/v3/role_assignments?user.id=00910a359d24402fa3c5b9c91f84b863&scope.system=all&role.id=0f6ee7650e6c49e3b33ccb7090a19c23 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:45.647192 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adba9d-770a-4bc1-bcfa-b4eb287babed None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:45.647486 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adba9d-770a-4bc1-bcfa-b4eb287babed None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:45.647795 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05adba9d-770a-4bc1-bcfa-b4eb287babed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:45.669058 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18009d50-3c5a-4aa9-8d77-4de8180ee755 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:45.680503 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-05adba9d-770a-4bc1-bcfa-b4eb287babed None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:45.681947 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-05adba9d-770a-4bc1-bcfa-b4eb287babed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:45.720522 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c804a3-ecd2-4224-a7ad-997798521ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:45.722024 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c804a3-ecd2-4224-a7ad-997798521ea1 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:45.722544 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c804a3-ecd2-4224-a7ad-997798521ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:45.723212 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c804a3-ecd2-4224-a7ad-997798521ea1 None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:45.724692 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c804a3-ecd2-4224-a7ad-997798521ea1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:45.725462 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c804a3-ecd2-4224-a7ad-997798521ea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:45.727575 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c804a3-ecd2-4224-a7ad-997798521ea1 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:45.739464 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 164/309] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:32:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:45.747400 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c804a3-ecd2-4224-a7ad-997798521ea1 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:45.799445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 146/310] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:45.826190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05adba9d-770a-4bc1-bcfa-b4eb287babed None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:45.933476 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c804a3-ecd2-4224-a7ad-997798521ea1 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:45.985754 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69623121-a37b-4960-be0c-4132532e209e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:45.987451 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69623121-a37b-4960-be0c-4132532e209e None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:45.987951 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69623121-a37b-4960-be0c-4132532e209e None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:45.988436 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69623121-a37b-4960-be0c-4132532e209e None admin] PATH_INFO: `/v3/users/8ea9f682c84243259e9780008255a5b4` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:45.990042 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69623121-a37b-4960-be0c-4132532e209e None admin] RBAC: Authorizing `identity:get_user(user_id=8ea9f682c84243259e9780008255a5b4)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:45.991771 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69623121-a37b-4960-be0c-4132532e209e None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:45.994147 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 165/311] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:45 2022] GET /identity/v3/users/8ea9f682c84243259e9780008255a5b4 => generated 297 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:46.003660 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69623121-a37b-4960-be0c-4132532e209e None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:46.028234 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05adba9d-770a-4bc1-bcfa-b4eb287babed None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:46.073914 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e70bc8-cc77-4933-b2c9-495215f3daeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:46.075170 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e70bc8-cc77-4933-b2c9-495215f3daeb None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:46.075759 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e70bc8-cc77-4933-b2c9-495215f3daeb None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:46.076264 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e70bc8-cc77-4933-b2c9-495215f3daeb None admin] PATH_INFO: `/v3/roles/member` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:46.090164 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e70bc8-cc77-4933-b2c9-495215f3daeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:46.099859 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-d5e70bc8-cc77-4933-b2c9-495215f3daeb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:46.099859 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:46.099859 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:46.099859 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:46.099859 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:46.099859 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:46.099859 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:46.099859 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:46.099859 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:46.099859 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:46.099859 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:46.099859 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:46.099859 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:46.099859 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:46.099859 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:46.099859 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:46.101046 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:46.101046 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:46.101046 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:46.101046 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:46.101046 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:46.101046 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:46.101046 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:46.101046 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:46.101046 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:46.101046 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:46.101046 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:46.101046 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:32:46.101046 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:46.101046 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:46.101046 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:46.101046 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:46.102035 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:46.102035 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:46.102035 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:46.102035 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:46.102035 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:46.102035 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:46.102035 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:46.102035 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:46.102035 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:46.102035 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:46.102035 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:46.102035 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:32:46.105454 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 147/312] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:46.116979 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e70bc8-cc77-4933-b2c9-495215f3daeb None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:46.225794 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69623121-a37b-4960-be0c-4132532e209e None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:46.270987 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d19fb-4718-4ed0-bbac-afd4cc43e017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:46.272550 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d19fb-4718-4ed0-bbac-afd4cc43e017 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:46.273080 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d19fb-4718-4ed0-bbac-afd4cc43e017 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:46.273832 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d19fb-4718-4ed0-bbac-afd4cc43e017 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:46.292134 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e70bc8-cc77-4933-b2c9-495215f3daeb None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:46.333817 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d80679-8f50-4aa1-95b6-afd33b7b9078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:46.334951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d80679-8f50-4aa1-95b6-afd33b7b9078 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:46.335590 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d80679-8f50-4aa1-95b6-afd33b7b9078 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:46.336094 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d80679-8f50-4aa1-95b6-afd33b7b9078 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:46.337105 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d80679-8f50-4aa1-95b6-afd33b7b9078 None admin] RBAC: Adding query filter params (name=member) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:46.337671 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d80679-8f50-4aa1-95b6-afd33b7b9078 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:46.339367 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d80679-8f50-4aa1-95b6-afd33b7b9078 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:46.349968 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 148/313] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:32:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:46.361972 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d80679-8f50-4aa1-95b6-afd33b7b9078 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:46.398292 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d19fb-4718-4ed0-bbac-afd4cc43e017 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:46.399899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d19fb-4718-4ed0-bbac-afd4cc43e017 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:46.538416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 166/314] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:32:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:32:46.549428 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d19fb-4718-4ed0-bbac-afd4cc43e017 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:46.556587 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d80679-8f50-4aa1-95b6-afd33b7b9078 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:46.598777 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa0fe2-9b84-48ae-996f-cb64ee26c207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:46.599778 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa0fe2-9b84-48ae-996f-cb64ee26c207 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:46.600132 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa0fe2-9b84-48ae-996f-cb64ee26c207 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:46.600535 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa0fe2-9b84-48ae-996f-cb64ee26c207 None admin] PATH_INFO: `/v3/users/d5acca77635449d4802ed1ea47137e0d` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:46.601956 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa0fe2-9b84-48ae-996f-cb64ee26c207 None admin] RBAC: Authorizing `identity:get_user(user_id=d5acca77635449d4802ed1ea47137e0d)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:46.603882 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa0fe2-9b84-48ae-996f-cb64ee26c207 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:46.606283 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 149/315] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:46 2022] GET /identity/v3/users/d5acca77635449d4802ed1ea47137e0d => generated 293 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:46.620236 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa0fe2-9b84-48ae-996f-cb64ee26c207 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:46.671613 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d19fb-4718-4ed0-bbac-afd4cc43e017 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:46.741509 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b160f96-ee18-4d83-8f96-af74af1f0a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:46.743036 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b160f96-ee18-4d83-8f96-af74af1f0a69 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:46.743554 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b160f96-ee18-4d83-8f96-af74af1f0a69 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:46.744057 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b160f96-ee18-4d83-8f96-af74af1f0a69 None admin] PATH_INFO: `/v3/projects/f097dc1a2c714aada1ee8228564936d7` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:46.746730 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b160f96-ee18-4d83-8f96-af74af1f0a69 None admin] RBAC: Authorizing `identity:get_project(project_id=f097dc1a2c714aada1ee8228564936d7)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:46.749666 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b160f96-ee18-4d83-8f96-af74af1f0a69 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:46.754516 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 167/316] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:46 2022] GET /identity/v3/projects/f097dc1a2c714aada1ee8228564936d7 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:46.759990 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b160f96-ee18-4d83-8f96-af74af1f0a69 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:46.805071 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa0fe2-9b84-48ae-996f-cb64ee26c207 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:46.871883 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b160f96-ee18-4d83-8f96-af74af1f0a69 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:46.874792 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3673a-d091-47dc-9074-34556b98ab0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:46.876741 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3673a-d091-47dc-9074-34556b98ab0c None admin] REQUEST_METHOD: `PUT` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:46.877156 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3673a-d091-47dc-9074-34556b98ab0c None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:46.878254 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3673a-d091-47dc-9074-34556b98ab0c None admin] PATH_INFO: `/v3/system/users/d5acca77635449d4802ed1ea47137e0d/roles/198eba72a9774c1b87f0403d4f400243` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:46.881243 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3673a-d091-47dc-9074-34556b98ab0c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d5acca77635449d4802ed1ea47137e0d, role_id=198eba72a9774c1b87f0403d4f400243)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:46.883937 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3673a-d091-47dc-9074-34556b98ab0c None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:46.913538 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 150/317] 10.222.0.48 () {58 vars in 1334 bytes} [Mon May 9 15:32:46 2022] PUT /identity/v3/system/users/d5acca77635449d4802ed1ea47137e0d/roles/198eba72a9774c1b87f0403d4f400243 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:32:46.919697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6eb19-99d1-4818-a006-04139d846957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:46.920399 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6eb19-99d1-4818-a006-04139d846957 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:46.920691 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6eb19-99d1-4818-a006-04139d846957 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:46.920965 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6eb19-99d1-4818-a006-04139d846957 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:46.922013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6eb19-99d1-4818-a006-04139d846957 None admin] RBAC: Adding query filter params (role.id=0f6ee7650e6c49e3b33ccb7090a19c23, scope.project.id=f097dc1a2c714aada1ee8228564936d7, user.id=8ea9f682c84243259e9780008255a5b4) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:46.922338 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6eb19-99d1-4818-a006-04139d846957 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:46.924061 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6eb19-99d1-4818-a006-04139d846957 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:46.931954 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 168/318] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:32:46 2022] GET /identity/v3/role_assignments?user.id=8ea9f682c84243259e9780008255a5b4&scope.project.id=f097dc1a2c714aada1ee8228564936d7&role.id=0f6ee7650e6c49e3b33ccb7090a19c23 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:48.641571 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626d96b-c5ab-42f0-b5d4-e1981c84009b None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:48.642900 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626d96b-c5ab-42f0-b5d4-e1981c84009b None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:48.642900 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626d96b-c5ab-42f0-b5d4-e1981c84009b None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:48.644757 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 151/319] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:48.651804 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dbaf9-6d97-4e49-a3ef-016dad1584d4 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:48.652671 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dbaf9-6d97-4e49-a3ef-016dad1584d4 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:48.652671 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dbaf9-6d97-4e49-a3ef-016dad1584d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:48.674294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-351dbaf9-6d97-4e49-a3ef-016dad1584d4 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:48.675838 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-351dbaf9-6d97-4e49-a3ef-016dad1584d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:48.767375 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 169/320] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:32:48.802850 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626d96b-c5ab-42f0-b5d4-e1981c84009b None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:48.848016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d436d9-d0af-4967-9fa5-6b7baad37557 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:48.848478 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d436d9-d0af-4967-9fa5-6b7baad37557 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:48.848956 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d436d9-d0af-4967-9fa5-6b7baad37557 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:48.851720 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 170/321] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:32:48.860435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed42d6-6d76-429f-80ac-da616be2e8bc None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:48.860876 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed42d6-6d76-429f-80ac-da616be2e8bc None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:48.861755 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed42d6-6d76-429f-80ac-da616be2e8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:48.888916 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-93ed42d6-6d76-429f-80ac-da616be2e8bc None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:48.890722 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-93ed42d6-6d76-429f-80ac-da616be2e8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:48.972228 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626d96b-c5ab-42f0-b5d4-e1981c84009b None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:48.993076 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 171/322] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:32:49.018629 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed42d6-6d76-429f-80ac-da616be2e8bc None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:49.045652 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da8c57-0cf0-4880-81f2-679bc591c44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:49.047040 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da8c57-0cf0-4880-81f2-679bc591c44d None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:49.047531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da8c57-0cf0-4880-81f2-679bc591c44d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:49.048027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da8c57-0cf0-4880-81f2-679bc591c44d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:49.068839 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da8c57-0cf0-4880-81f2-679bc591c44d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:49.085688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-b7da8c57-0cf0-4880-81f2-679bc591c44d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:32:49.085688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:49.085688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:49.085688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:49.085688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:49.085688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:49.085688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:49.085688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:49.085688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:49.085688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:49.085688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:49.085688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:49.085688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:49.085688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:49.085688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:49.085688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:49.087633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:49.087633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:49.087633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:49.087633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:49.087633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:49.087633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:49.087633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:49.087633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:49.087633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:49.087633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:49.087633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:49.087633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:32:49.087633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:49.087633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:49.087633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:49.087633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:49.091154 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:49.091154 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:49.091154 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:49.091154 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:49.091154 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:49.091154 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:49.091154 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:49.091154 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:49.091154 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:49.091154 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:49.091154 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:32:49.091154 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:32:49.091154 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 152/323] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:49.099155 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da8c57-0cf0-4880-81f2-679bc591c44d None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:49.185868 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed42d6-6d76-429f-80ac-da616be2e8bc None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:49.240156 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207534f-62fa-4c51-81df-54ecca5dea73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:49.241789 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207534f-62fa-4c51-81df-54ecca5dea73 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:49.242528 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207534f-62fa-4c51-81df-54ecca5dea73 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:49.243215 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207534f-62fa-4c51-81df-54ecca5dea73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:49.245628 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207534f-62fa-4c51-81df-54ecca5dea73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:49.248201 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207534f-62fa-4c51-81df-54ecca5dea73 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:49.253434 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 172/324] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:32:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:49.261611 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207534f-62fa-4c51-81df-54ecca5dea73 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:49.268670 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da8c57-0cf0-4880-81f2-679bc591c44d None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:49.330663 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407764b-7985-4ba7-80ec-09801f37bb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:49.332016 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407764b-7985-4ba7-80ec-09801f37bb50 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:49.332487 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407764b-7985-4ba7-80ec-09801f37bb50 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:49.332943 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407764b-7985-4ba7-80ec-09801f37bb50 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:49.334305 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407764b-7985-4ba7-80ec-09801f37bb50 None admin] RBAC: Adding query filter params (name=reader) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:49.334798 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407764b-7985-4ba7-80ec-09801f37bb50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:49.337322 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407764b-7985-4ba7-80ec-09801f37bb50 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:49.357094 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 153/325] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:32:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:49.358767 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407764b-7985-4ba7-80ec-09801f37bb50 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:49.415172 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207534f-62fa-4c51-81df-54ecca5dea73 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:49.454985 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417de56-7140-43d3-b808-f395b15619b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:49.455573 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417de56-7140-43d3-b808-f395b15619b4 None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:49.455859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417de56-7140-43d3-b808-f395b15619b4 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:49.456141 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417de56-7140-43d3-b808-f395b15619b4 None admin] PATH_INFO: `/v3/groups` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:49.456867 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417de56-7140-43d3-b808-f395b15619b4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:49.458414 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417de56-7140-43d3-b808-f395b15619b4 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:49.477404 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 173/326] 10.222.0.48 () {60 vars in 1134 bytes} [Mon May 9 15:32:49 2022] POST /identity/v3/groups => generated 226 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:32:49.540038 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407764b-7985-4ba7-80ec-09801f37bb50 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:49.583001 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1b275-4db5-4e2f-a91a-64a4280b6e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:49.583914 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1b275-4db5-4e2f-a91a-64a4280b6e7d None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:49.584214 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1b275-4db5-4e2f-a91a-64a4280b6e7d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:49.584475 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1b275-4db5-4e2f-a91a-64a4280b6e7d None admin] PATH_INFO: `/v3/users/00910a359d24402fa3c5b9c91f84b863` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:49.585943 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1b275-4db5-4e2f-a91a-64a4280b6e7d None admin] RBAC: Authorizing `identity:get_user(user_id=00910a359d24402fa3c5b9c91f84b863)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:49.587589 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1b275-4db5-4e2f-a91a-64a4280b6e7d None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:49.597163 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 154/327] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:49 2022] GET /identity/v3/users/00910a359d24402fa3c5b9c91f84b863 => generated 293 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:49.598464 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417de56-7140-43d3-b808-f395b15619b4 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:49.693331 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181b507-79d0-47d7-b4fd-6dd684064939 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:49.694208 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181b507-79d0-47d7-b4fd-6dd684064939 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:49.694385 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181b507-79d0-47d7-b4fd-6dd684064939 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:49.696454 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 155/328] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:32:49.704462 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678f6bd-da63-49d5-9e73-542ee85e6403 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:49.705257 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678f6bd-da63-49d5-9e73-542ee85e6403 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:49.705568 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678f6bd-da63-49d5-9e73-542ee85e6403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:49.727713 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-4678f6bd-da63-49d5-9e73-542ee85e6403 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:49.728970 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-4678f6bd-da63-49d5-9e73-542ee85e6403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:49.753704 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417de56-7140-43d3-b808-f395b15619b4 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:49.797968 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb036c-eff4-4f08-b6f5-729c92fcf716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:49.799628 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb036c-eff4-4f08-b6f5-729c92fcf716 None admin] REQUEST_METHOD: `PUT` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:49.799914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb036c-eff4-4f08-b6f5-729c92fcf716 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:49.800218 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb036c-eff4-4f08-b6f5-729c92fcf716 None admin] PATH_INFO: `/v3/system/users/00910a359d24402fa3c5b9c91f84b863/roles/0f6ee7650e6c49e3b33ccb7090a19c23` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:49.802442 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb036c-eff4-4f08-b6f5-729c92fcf716 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=00910a359d24402fa3c5b9c91f84b863, role_id=0f6ee7650e6c49e3b33ccb7090a19c23)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:49.805267 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb036c-eff4-4f08-b6f5-729c92fcf716 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:49.819252 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 174/329] 10.222.0.48 () {58 vars in 1334 bytes} [Mon May 9 15:32:49 2022] PUT /identity/v3/system/users/00910a359d24402fa3c5b9c91f84b863/roles/0f6ee7650e6c49e3b33ccb7090a19c23 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:32:49.828948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 156/330] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:49.855685 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb036c-eff4-4f08-b6f5-729c92fcf716 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:49.979221 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb036c-eff4-4f08-b6f5-729c92fcf716 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:50.020896 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c72e7-7f93-4ba0-85d8-9b04bebd556c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:50.021788 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c72e7-7f93-4ba0-85d8-9b04bebd556c None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:50.022076 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c72e7-7f93-4ba0-85d8-9b04bebd556c None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:50.022353 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c72e7-7f93-4ba0-85d8-9b04bebd556c None admin] PATH_INFO: `/v3/roles/member` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:50.035232 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c72e7-7f93-4ba0-85d8-9b04bebd556c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:50.043458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-734c72e7-7f93-4ba0-85d8-9b04bebd556c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:50.043458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:50.043458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:50.043458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:50.043458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:50.043458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:50.043458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:50.043458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:50.043458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:50.043458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:50.043458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:50.043458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:50.043458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:50.043458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:50.043458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:50.043458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:50.045288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:50.045288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:50.045288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:50.045288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:50.045288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:50.045288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:50.045288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:50.045288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:50.045288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:50.045288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:50.045288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:50.045288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:32:50.045288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:50.045288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:50.045288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:50.045288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:50.047324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:50.047324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:50.047324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:50.047324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:50.047324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:50.047324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:50.047324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:50.047324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:50.047324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:50.047324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:50.047324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:50.047324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:32:50.047324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 175/331] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:50.055690 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678f6bd-da63-49d5-9e73-542ee85e6403 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:50.200304 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678f6bd-da63-49d5-9e73-542ee85e6403 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:50.270288 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2732bf-2fe2-4240-b838-ef2b048bec9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:50.271363 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2732bf-2fe2-4240-b838-ef2b048bec9a None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:50.271864 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2732bf-2fe2-4240-b838-ef2b048bec9a None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:50.272347 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2732bf-2fe2-4240-b838-ef2b048bec9a None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:50.273826 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2732bf-2fe2-4240-b838-ef2b048bec9a None admin] RBAC: Adding query filter params (name=member) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:50.274378 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2732bf-2fe2-4240-b838-ef2b048bec9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:50.277000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2732bf-2fe2-4240-b838-ef2b048bec9a None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:50.301539 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 157/332] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:32:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:50.305848 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c72e7-7f93-4ba0-85d8-9b04bebd556c None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:50.554061 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c72e7-7f93-4ba0-85d8-9b04bebd556c None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:50.618142 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec86aca-2d23-42a0-975e-9bf85d1fe571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:50.620001 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec86aca-2d23-42a0-975e-9bf85d1fe571 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:50.620520 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec86aca-2d23-42a0-975e-9bf85d1fe571 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:50.621598 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec86aca-2d23-42a0-975e-9bf85d1fe571 None admin] PATH_INFO: `/v3/users/d5acca77635449d4802ed1ea47137e0d` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:50.623901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec86aca-2d23-42a0-975e-9bf85d1fe571 None admin] RBAC: Authorizing `identity:get_user(user_id=d5acca77635449d4802ed1ea47137e0d)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:50.627303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec86aca-2d23-42a0-975e-9bf85d1fe571 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:50.630929 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 176/333] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:50 2022] GET /identity/v3/users/d5acca77635449d4802ed1ea47137e0d => generated 293 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:50.655645 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2732bf-2fe2-4240-b838-ef2b048bec9a None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:50.859799 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2732bf-2fe2-4240-b838-ef2b048bec9a None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:50.931485 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7e788-6371-40cf-b377-d74bce203cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:50.932649 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7e788-6371-40cf-b377-d74bce203cbf None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:50.933160 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7e788-6371-40cf-b377-d74bce203cbf None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:50.933679 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7e788-6371-40cf-b377-d74bce203cbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:50.935354 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7e788-6371-40cf-b377-d74bce203cbf None admin] RBAC: Adding query filter params (role.id=198eba72a9774c1b87f0403d4f400243, user.id=d5acca77635449d4802ed1ea47137e0d, scope.system=all) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:50.935934 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7e788-6371-40cf-b377-d74bce203cbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:50.938897 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7e788-6371-40cf-b377-d74bce203cbf None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:50.969178 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 158/334] 10.222.0.48 () {56 vars in 1308 bytes} [Mon May 9 15:32:50 2022] GET /identity/v3/role_assignments?user.id=d5acca77635449d4802ed1ea47137e0d&scope.system=all&role.id=198eba72a9774c1b87f0403d4f400243 => generated 510 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:52.860366 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076e917-9676-41c2-ba0e-bff447f9baa1 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:52.860366 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076e917-9676-41c2-ba0e-bff447f9baa1 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:52.860366 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076e917-9676-41c2-ba0e-bff447f9baa1 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:52.860366 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 177/335] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:52.877772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249e444-d455-4b4b-bc8c-a7974251bb53 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:52.878456 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249e444-d455-4b4b-bc8c-a7974251bb53 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:52.878456 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249e444-d455-4b4b-bc8c-a7974251bb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:52.902914 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-d249e444-d455-4b4b-bc8c-a7974251bb53 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:52.904138 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-d249e444-d455-4b4b-bc8c-a7974251bb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:53.009216 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 159/336] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:32:53.065479 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076e917-9676-41c2-ba0e-bff447f9baa1 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:53.344018 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076e917-9676-41c2-ba0e-bff447f9baa1 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:53.428914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659338d-aaa8-4955-a6d5-5dfd141f2e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:53.430880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659338d-aaa8-4955-a6d5-5dfd141f2e87 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:53.433334 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659338d-aaa8-4955-a6d5-5dfd141f2e87 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:53.434208 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659338d-aaa8-4955-a6d5-5dfd141f2e87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:53.466772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659338d-aaa8-4955-a6d5-5dfd141f2e87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:53.488758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-e659338d-aaa8-4955-a6d5-5dfd141f2e87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:53.488758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:53.488758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:53.488758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:53.488758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:53.488758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:53.488758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:53.488758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:53.488758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:53.488758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:53.488758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:53.488758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:53.488758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:53.488758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:53.488758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:53.488758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:53.490826 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:53.490826 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:53.490826 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:53.490826 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:53.490826 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:53.490826 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:53.490826 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:53.490826 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:53.490826 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:53.490826 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:53.490826 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:53.490826 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:32:53.490826 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:53.490826 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:53.490826 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:53.490826 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:53.493031 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:53.493031 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:53.493031 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:53.493031 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:53.493031 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:53.493031 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:53.493031 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:53.493031 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:53.493031 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:53.493031 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:53.493031 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:53.493031 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:32:53.499499 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 178/337] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 435 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:53.510605 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249e444-d455-4b4b-bc8c-a7974251bb53 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:53.670215 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249e444-d455-4b4b-bc8c-a7974251bb53 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:53.739036 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f66adf-2a5a-483f-b560-c2b181980211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:53.739802 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f66adf-2a5a-483f-b560-c2b181980211 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:53.740115 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f66adf-2a5a-483f-b560-c2b181980211 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:53.740396 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f66adf-2a5a-483f-b560-c2b181980211 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:53.741156 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f66adf-2a5a-483f-b560-c2b181980211 None admin] RBAC: Adding query filter params (name=member) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:53.741497 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f66adf-2a5a-483f-b560-c2b181980211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:53.742939 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f66adf-2a5a-483f-b560-c2b181980211 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:53.754297 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 160/338] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:32:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:53.764581 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659338d-aaa8-4955-a6d5-5dfd141f2e87 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:53.801404 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e739d-e542-491a-be96-2f7acae712b4 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:53.801713 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e739d-e542-491a-be96-2f7acae712b4 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:53.801868 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e739d-e542-491a-be96-2f7acae712b4 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:53.803277 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 161/339] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:32:53.811697 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91891f6e-ad3c-47ef-8cd4-108ccaa8b5b4 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:53.812247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91891f6e-ad3c-47ef-8cd4-108ccaa8b5b4 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:53.812427 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91891f6e-ad3c-47ef-8cd4-108ccaa8b5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:53.848916 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-91891f6e-ad3c-47ef-8cd4-108ccaa8b5b4 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:53.851632 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-91891f6e-ad3c-47ef-8cd4-108ccaa8b5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:53.959061 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659338d-aaa8-4955-a6d5-5dfd141f2e87 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:54.005873 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883e149-af39-4ec9-8b99-3ac586b31eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:54.006967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883e149-af39-4ec9-8b99-3ac586b31eb2 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:54.007485 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883e149-af39-4ec9-8b99-3ac586b31eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:54.007994 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883e149-af39-4ec9-8b99-3ac586b31eb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:54.014997 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 162/340] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:54.066792 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91891f6e-ad3c-47ef-8cd4-108ccaa8b5b4 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:54.106131 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883e149-af39-4ec9-8b99-3ac586b31eb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:54.107904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883e149-af39-4ec9-8b99-3ac586b31eb2 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:54.249795 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 179/341] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:32:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:32:54.256470 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883e149-af39-4ec9-8b99-3ac586b31eb2 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:54.293431 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91891f6e-ad3c-47ef-8cd4-108ccaa8b5b4 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:54.358994 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d9891-0205-4df7-8735-3691f8795ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:54.361731 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d9891-0205-4df7-8735-3691f8795ff7 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:54.362729 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d9891-0205-4df7-8735-3691f8795ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:54.364065 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d9891-0205-4df7-8735-3691f8795ff7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:54.366274 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883e149-af39-4ec9-8b99-3ac586b31eb2 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:54.393745 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d9891-0205-4df7-8735-3691f8795ff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:54.414038 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-406d9891-0205-4df7-8735-3691f8795ff7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:32:54.414038 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:54.414038 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:54.414038 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:54.414038 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:54.414038 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:54.414038 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:54.414038 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:54.414038 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:54.414038 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:54.414038 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:54.414038 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:54.414038 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:54.414038 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:54.414038 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:54.414038 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:54.416059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:54.416059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:54.416059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:54.416059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:54.416059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:54.416059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:54.416059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:54.416059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:54.416059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:54.416059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:54.416059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:54.416059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:32:54.416059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:54.416059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:54.416059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:54.416059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:54.417685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:54.417685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:54.417685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:54.417685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:54.417685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:54.417685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:54.417685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:54.417685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:54.417685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:54.417685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:54.417685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:32:54.417685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:32:54.417685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 163/342] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:32:54.428086 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d9891-0205-4df7-8735-3691f8795ff7 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:54.459012 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9cb1b-5ca4-4edd-8728-ba9bef7572d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:54.459979 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9cb1b-5ca4-4edd-8728-ba9bef7572d4 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:54.460259 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9cb1b-5ca4-4edd-8728-ba9bef7572d4 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:54.460528 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9cb1b-5ca4-4edd-8728-ba9bef7572d4 None admin] PATH_INFO: `/v3/projects/50c0c9efd04543c4baaf687248d2cb4e` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:54.462435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9cb1b-5ca4-4edd-8728-ba9bef7572d4 None admin] RBAC: Authorizing `identity:get_project(project_id=50c0c9efd04543c4baaf687248d2cb4e)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:54.464169 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9cb1b-5ca4-4edd-8728-ba9bef7572d4 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:54.475751 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 180/343] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:54 2022] GET /identity/v3/projects/50c0c9efd04543c4baaf687248d2cb4e => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:54.484155 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9cb1b-5ca4-4edd-8728-ba9bef7572d4 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:54.691709 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d9891-0205-4df7-8735-3691f8795ff7 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:54.738137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9cb1b-5ca4-4edd-8728-ba9bef7572d4 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:54.753706 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4ad17-4664-405b-9e8a-d6220f61a949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:54.754735 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4ad17-4664-405b-9e8a-d6220f61a949 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:54.755243 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4ad17-4664-405b-9e8a-d6220f61a949 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:54.755723 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4ad17-4664-405b-9e8a-d6220f61a949 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:54.756701 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4ad17-4664-405b-9e8a-d6220f61a949 None admin] RBAC: Adding query filter params (name=reader) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:54.757221 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4ad17-4664-405b-9e8a-d6220f61a949 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:54.761549 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4ad17-4664-405b-9e8a-d6220f61a949 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:54.780158 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 164/344] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:32:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:54.791092 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061aa524-07b3-4974-8f59-e7395395a781 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:54.793133 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061aa524-07b3-4974-8f59-e7395395a781 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:54.793686 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061aa524-07b3-4974-8f59-e7395395a781 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:54.795805 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 165/345] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:54.796849 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061aa524-07b3-4974-8f59-e7395395a781 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:54.847357 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192ef71-542e-4b74-b5b1-e30a3097e83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:54.848807 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192ef71-542e-4b74-b5b1-e30a3097e83e None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:54.849433 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192ef71-542e-4b74-b5b1-e30a3097e83e None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:54.849992 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192ef71-542e-4b74-b5b1-e30a3097e83e None admin] PATH_INFO: `/v3/groups/b354a8e530004d14b14d84cd6c43d12d` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:54.866466 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192ef71-542e-4b74-b5b1-e30a3097e83e None admin] RBAC: Authorizing `identity:get_group(group_id=b354a8e530004d14b14d84cd6c43d12d)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:54.871290 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192ef71-542e-4b74-b5b1-e30a3097e83e None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:54.881027 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 181/346] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:32:54 2022] GET /identity/v3/groups/b354a8e530004d14b14d84cd6c43d12d => generated 226 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:54.882873 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd55ce-cc7a-493d-8949-d91195fe0e30 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:54.883397 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd55ce-cc7a-493d-8949-d91195fe0e30 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:54.885807 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd55ce-cc7a-493d-8949-d91195fe0e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:54.912881 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-fcdd55ce-cc7a-493d-8949-d91195fe0e30 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:54.914498 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-fcdd55ce-cc7a-493d-8949-d91195fe0e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:54.991703 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061aa524-07b3-4974-8f59-e7395395a781 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:55.011664 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 182/347] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:55.012789 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd55ce-cc7a-493d-8949-d91195fe0e30 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:55.042227 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaaa6a6-b955-47f6-a63f-be30773b353d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:55.043159 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaa6a6-b955-47f6-a63f-be30773b353d None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:55.043513 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaa6a6-b955-47f6-a63f-be30773b353d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:55.043805 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaa6a6-b955-47f6-a63f-be30773b353d None admin] PATH_INFO: `/v3/users/00910a359d24402fa3c5b9c91f84b863` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:55.045279 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaaa6a6-b955-47f6-a63f-be30773b353d None admin] RBAC: Authorizing `identity:get_user(user_id=00910a359d24402fa3c5b9c91f84b863)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:55.047262 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaaa6a6-b955-47f6-a63f-be30773b353d None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:55.050005 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 166/348] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:32:54 2022] GET /identity/v3/users/00910a359d24402fa3c5b9c91f84b863 => generated 293 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:55.051489 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d64f6a-e568-4119-a33f-f8e5a86ee873 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:55.051778 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d64f6a-e568-4119-a33f-f8e5a86ee873 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:55.052065 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d64f6a-e568-4119-a33f-f8e5a86ee873 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:55.059818 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 167/349] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:55.060837 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d64f6a-e568-4119-a33f-f8e5a86ee873 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:55.167491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd55ce-cc7a-493d-8949-d91195fe0e30 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:55.192746 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d64f6a-e568-4119-a33f-f8e5a86ee873 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:55.209354 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaf1ac-3e23-45d8-b04e-61158f1491c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:55.210395 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaf1ac-3e23-45d8-b04e-61158f1491c8 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:55.210938 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaf1ac-3e23-45d8-b04e-61158f1491c8 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:55.211227 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaf1ac-3e23-45d8-b04e-61158f1491c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:55.213176 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaf1ac-3e23-45d8-b04e-61158f1491c8 None admin] RBAC: Adding query filter params (group.id=b354a8e530004d14b14d84cd6c43d12d, role.id=198eba72a9774c1b87f0403d4f400243, scope.project.id=50c0c9efd04543c4baaf687248d2cb4e) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:55.213964 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaf1ac-3e23-45d8-b04e-61158f1491c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:55.216713 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaf1ac-3e23-45d8-b04e-61158f1491c8 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:55.229289 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 183/350] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:32:55 2022] GET /identity/v3/role_assignments?group.id=b354a8e530004d14b14d84cd6c43d12d&scope.project.id=50c0c9efd04543c4baaf687248d2cb4e&role.id=198eba72a9774c1b87f0403d4f400243 => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:55.230684 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaf1ac-3e23-45d8-b04e-61158f1491c8 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:55.238537 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7cc5c-14a3-4708-a103-217f82d097bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:55.239342 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7cc5c-14a3-4708-a103-217f82d097bc None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:55.239640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7cc5c-14a3-4708-a103-217f82d097bc None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:55.239918 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7cc5c-14a3-4708-a103-217f82d097bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:55.240894 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7cc5c-14a3-4708-a103-217f82d097bc None admin] RBAC: Adding query filter params (role.id=0f6ee7650e6c49e3b33ccb7090a19c23, user.id=00910a359d24402fa3c5b9c91f84b863, scope.system=all) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:55.241213 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7cc5c-14a3-4708-a103-217f82d097bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:55.242872 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7cc5c-14a3-4708-a103-217f82d097bc None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:55.262304 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 168/351] 10.222.0.48 () {56 vars in 1308 bytes} [Mon May 9 15:32:55 2022] GET /identity/v3/role_assignments?user.id=00910a359d24402fa3c5b9c91f84b863&scope.system=all&role.id=0f6ee7650e6c49e3b33ccb7090a19c23 => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:55.264239 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6c16d-7bcb-4808-81f3-64b6dda5bc24 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:55.264534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6c16d-7bcb-4808-81f3-64b6dda5bc24 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:55.264820 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6c16d-7bcb-4808-81f3-64b6dda5bc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:55.306631 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-8dd6c16d-7bcb-4808-81f3-64b6dda5bc24 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:55.307911 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-8dd6c16d-7bcb-4808-81f3-64b6dda5bc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:55.410092 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaf1ac-3e23-45d8-b04e-61158f1491c8 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:55.432683 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 169/352] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:55.486478 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548d69f-848d-43e0-838c-7ca6a50e8d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:55.487394 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548d69f-848d-43e0-838c-7ca6a50e8d98 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:55.487747 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548d69f-848d-43e0-838c-7ca6a50e8d98 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:55.488017 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548d69f-848d-43e0-838c-7ca6a50e8d98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:55.505589 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548d69f-848d-43e0-838c-7ca6a50e8d98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:55.519439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-f548d69f-848d-43e0-838c-7ca6a50e8d98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:55.519439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:55.519439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:55.519439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:55.519439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:55.519439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:55.519439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:55.519439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:55.519439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:55.519439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:55.519439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:55.519439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:55.519439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:55.519439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:55.519439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:55.519439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:55.521849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:55.521849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:55.521849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:55.521849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:55.521849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:55.521849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:55.521849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:55.521849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:55.521849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:55.521849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:55.521849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:55.521849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:32:55.521849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:55.521849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:55.521849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:55.521849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:55.523987 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:55.523987 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:55.523987 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:55.523987 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:55.523987 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:55.523987 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:55.523987 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:55.523987 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:55.523987 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:55.523987 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:55.523987 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:55.523987 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:32:55.527663 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 184/353] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:55.532118 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6c16d-7bcb-4808-81f3-64b6dda5bc24 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:55.535083 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548d69f-848d-43e0-838c-7ca6a50e8d98 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:55.685035 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548d69f-848d-43e0-838c-7ca6a50e8d98 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:55.741190 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c788a3e-087c-433e-a594-ee47a4d567e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:55.742067 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c788a3e-087c-433e-a594-ee47a4d567e5 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:55.742357 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c788a3e-087c-433e-a594-ee47a4d567e5 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:55.742645 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c788a3e-087c-433e-a594-ee47a4d567e5 None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:55.743439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c788a3e-087c-433e-a594-ee47a4d567e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:55.743753 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c788a3e-087c-433e-a594-ee47a4d567e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:55.745492 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c788a3e-087c-433e-a594-ee47a4d567e5 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:55.760853 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 185/354] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:32:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:55.767713 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c788a3e-087c-433e-a594-ee47a4d567e5 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:55.805345 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6c16d-7bcb-4808-81f3-64b6dda5bc24 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:55.912232 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd5ab2-4fc9-4fd5-b3a3-8098cb64daba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:55.913639 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd5ab2-4fc9-4fd5-b3a3-8098cb64daba None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:55.914168 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd5ab2-4fc9-4fd5-b3a3-8098cb64daba None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:55.914724 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd5ab2-4fc9-4fd5-b3a3-8098cb64daba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:55.937253 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd5ab2-4fc9-4fd5-b3a3-8098cb64daba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:55.947836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-0bfd5ab2-4fc9-4fd5-b3a3-8098cb64daba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:32:55.947836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:55.947836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:55.947836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:55.947836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:55.947836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:55.947836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:55.947836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:55.947836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:55.947836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:55.947836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:55.947836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:55.947836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:55.947836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:55.947836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:55.947836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:55.949325 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:55.949325 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:55.949325 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:55.949325 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:55.949325 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:55.949325 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:55.949325 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:55.949325 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:55.949325 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:55.949325 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:55.949325 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:55.949325 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:32:55.949325 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:55.949325 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:55.949325 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:55.949325 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:55.951008 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:55.951008 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:55.951008 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:55.951008 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:55.951008 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:55.951008 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:55.951008 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:55.951008 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:55.951008 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:55.951008 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:55.951008 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:32:55.951008 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:32:55.958994 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 170/355] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:32:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:55.961941 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5a8c2-f1ce-4e8d-a5c1-6475f3acb7d7 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:55.962564 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5a8c2-f1ce-4e8d-a5c1-6475f3acb7d7 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:55.963166 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5a8c2-f1ce-4e8d-a5c1-6475f3acb7d7 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:55.966592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 171/356] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:55.967875 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5a8c2-f1ce-4e8d-a5c1-6475f3acb7d7 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:55.969016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c788a3e-087c-433e-a594-ee47a4d567e5 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:56.022518 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39505eaa-dbe3-44c4-96f2-a013fe005153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:56.023463 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39505eaa-dbe3-44c4-96f2-a013fe005153 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:56.023819 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39505eaa-dbe3-44c4-96f2-a013fe005153 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:56.024228 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39505eaa-dbe3-44c4-96f2-a013fe005153 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:56.122337 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5a8c2-f1ce-4e8d-a5c1-6475f3acb7d7 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:56.136113 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39505eaa-dbe3-44c4-96f2-a013fe005153 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:56.137832 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39505eaa-dbe3-44c4-96f2-a013fe005153 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:56.165955 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdc4ed-4452-4b62-918a-8f1ea2221bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:56.166967 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdc4ed-4452-4b62-918a-8f1ea2221bf4 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:56.167395 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdc4ed-4452-4b62-918a-8f1ea2221bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:56.167691 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdc4ed-4452-4b62-918a-8f1ea2221bf4 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:56.168800 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdc4ed-4452-4b62-918a-8f1ea2221bf4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:56.169345 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdc4ed-4452-4b62-918a-8f1ea2221bf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:56.171558 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdc4ed-4452-4b62-918a-8f1ea2221bf4 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:56.185248 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 172/357] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:32:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:56.187715 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7e81f-40ae-40c5-8473-0af80aabebcf None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:56.188151 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7e81f-40ae-40c5-8473-0af80aabebcf None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:56.188742 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7e81f-40ae-40c5-8473-0af80aabebcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:56.215667 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-58d7e81f-40ae-40c5-8473-0af80aabebcf None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:56.217686 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-58d7e81f-40ae-40c5-8473-0af80aabebcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:56.295926 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 186/358] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:32:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:32:56.297127 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39505eaa-dbe3-44c4-96f2-a013fe005153 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:56.346109 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 173/359] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:56.347751 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7e81f-40ae-40c5-8473-0af80aabebcf None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:56.494326 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39505eaa-dbe3-44c4-96f2-a013fe005153 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:56.537632 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7e81f-40ae-40c5-8473-0af80aabebcf None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:56.558839 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5d6fe-92e7-4fdb-8a22-78a15a70ac14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:56.559672 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5d6fe-92e7-4fdb-8a22-78a15a70ac14 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:56.560064 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5d6fe-92e7-4fdb-8a22-78a15a70ac14 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:56.560353 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5d6fe-92e7-4fdb-8a22-78a15a70ac14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:56.590047 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc64ed2-bea5-4f88-8e91-f4f2d289614e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:56.591019 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc64ed2-bea5-4f88-8e91-f4f2d289614e None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:56.591837 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc64ed2-bea5-4f88-8e91-f4f2d289614e None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:56.592371 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc64ed2-bea5-4f88-8e91-f4f2d289614e None admin] PATH_INFO: `/v3/projects/f097dc1a2c714aada1ee8228564936d7` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:56.598766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc64ed2-bea5-4f88-8e91-f4f2d289614e None admin] RBAC: Authorizing `identity:get_project(project_id=f097dc1a2c714aada1ee8228564936d7)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:56.600559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc64ed2-bea5-4f88-8e91-f4f2d289614e None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:56.603765 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 174/360] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:56 2022] GET /identity/v3/projects/f097dc1a2c714aada1ee8228564936d7 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:56.605008 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc64ed2-bea5-4f88-8e91-f4f2d289614e None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:56.699675 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5d6fe-92e7-4fdb-8a22-78a15a70ac14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:56.701212 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5d6fe-92e7-4fdb-8a22-78a15a70ac14 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:56.776448 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc64ed2-bea5-4f88-8e91-f4f2d289614e None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:56.820606 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059ba7c-7713-49ea-b953-7ca356510620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:56.821870 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059ba7c-7713-49ea-b953-7ca356510620 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:56.822407 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059ba7c-7713-49ea-b953-7ca356510620 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:56.822896 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059ba7c-7713-49ea-b953-7ca356510620 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:56.836226 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059ba7c-7713-49ea-b953-7ca356510620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:56.845559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-a059ba7c-7713-49ea-b953-7ca356510620 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:32:56.845559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:56.845559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:56.845559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:56.845559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:56.845559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:56.845559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:56.845559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:56.845559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:56.845559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:56.845559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:56.845559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:56.845559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:56.845559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:56.845559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:56.845559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:56.846978 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:56.846978 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:56.846978 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:56.846978 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:56.846978 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:56.846978 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:56.846978 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:56.846978 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:56.846978 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:56.846978 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:56.846978 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:56.846978 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:32:56.846978 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:56.846978 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:56.846978 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:56.846978 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:56.847887 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:56.847887 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:56.847887 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:56.847887 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:56.847887 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:56.847887 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:56.847887 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:56.847887 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:56.847887 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:56.847887 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:56.847887 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:32:56.847887 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:32:56.849363 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 187/361] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:32:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:32:56.850372 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bb0b9-e660-4bde-83b9-3136fad59ff2 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:56.850669 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bb0b9-e660-4bde-83b9-3136fad59ff2 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:56.850953 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bb0b9-e660-4bde-83b9-3136fad59ff2 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:56.852025 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 175/362] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:32:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:56.853112 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059ba7c-7713-49ea-b953-7ca356510620 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:56.854634 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 188/363] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:56.860827 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bb0b9-e660-4bde-83b9-3136fad59ff2 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:57.019019 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bb0b9-e660-4bde-83b9-3136fad59ff2 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:57.027623 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059ba7c-7713-49ea-b953-7ca356510620 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:57.089537 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dca969-36c8-4fa6-bcb3-7154588c2c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:57.090255 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dca969-36c8-4fa6-bcb3-7154588c2c27 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:57.090896 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dca969-36c8-4fa6-bcb3-7154588c2c27 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:57.091285 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dca969-36c8-4fa6-bcb3-7154588c2c27 None admin] PATH_INFO: `/v3/projects/50c0c9efd04543c4baaf687248d2cb4e` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:57.093195 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dca969-36c8-4fa6-bcb3-7154588c2c27 None admin] RBAC: Authorizing `identity:get_project(project_id=50c0c9efd04543c4baaf687248d2cb4e)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:57.096328 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dca969-36c8-4fa6-bcb3-7154588c2c27 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:57.105414 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 189/364] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:56 2022] GET /identity/v3/projects/50c0c9efd04543c4baaf687248d2cb4e => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:57.105414 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53becc3-8fe7-45ec-be7d-56b3715ff8fe None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:57.105414 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53becc3-8fe7-45ec-be7d-56b3715ff8fe None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:57.105414 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53becc3-8fe7-45ec-be7d-56b3715ff8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:57.113206 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439647a-efcd-466e-a62f-c7c21d8ac504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:57.114132 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439647a-efcd-466e-a62f-c7c21d8ac504 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:57.114409 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439647a-efcd-466e-a62f-c7c21d8ac504 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:57.114683 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439647a-efcd-466e-a62f-c7c21d8ac504 None admin] PATH_INFO: `/v3/groups/b354a8e530004d14b14d84cd6c43d12d` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:57.116348 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439647a-efcd-466e-a62f-c7c21d8ac504 None admin] RBAC: Authorizing `identity:get_group(group_id=b354a8e530004d14b14d84cd6c43d12d)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:57.118151 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439647a-efcd-466e-a62f-c7c21d8ac504 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:57.120290 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 176/365] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:32:56 2022] GET /identity/v3/groups/b354a8e530004d14b14d84cd6c43d12d => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:57.121229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439647a-efcd-466e-a62f-c7c21d8ac504 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:57.140623 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-a53becc3-8fe7-45ec-be7d-56b3715ff8fe None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:57.143968 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-a53becc3-8fe7-45ec-be7d-56b3715ff8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:57.260338 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439647a-efcd-466e-a62f-c7c21d8ac504 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:57.273527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 190/366] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:57.276226 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53becc3-8fe7-45ec-be7d-56b3715ff8fe None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:57.321270 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e86409-2903-4b76-9420-1f8b5d2d79ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:57.321998 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e86409-2903-4b76-9420-1f8b5d2d79ac None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:57.322279 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e86409-2903-4b76-9420-1f8b5d2d79ac None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:57.322563 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e86409-2903-4b76-9420-1f8b5d2d79ac None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:57.323334 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e86409-2903-4b76-9420-1f8b5d2d79ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:57.323643 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e86409-2903-4b76-9420-1f8b5d2d79ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:57.325234 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e86409-2903-4b76-9420-1f8b5d2d79ac None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:57.334730 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 177/367] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:32:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:57.335690 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e86409-2903-4b76-9420-1f8b5d2d79ac None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:57.452418 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53becc3-8fe7-45ec-be7d-56b3715ff8fe None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:57.494074 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e86409-2903-4b76-9420-1f8b5d2d79ac None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:57.526202 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a1eb1-d713-4e25-aced-47111da687d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:57.527639 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a1eb1-d713-4e25-aced-47111da687d1 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:57.528186 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a1eb1-d713-4e25-aced-47111da687d1 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:57.528523 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a1eb1-d713-4e25-aced-47111da687d1 None admin] PATH_INFO: `/v3/groups/b354a8e530004d14b14d84cd6c43d12d` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:57.530156 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a1eb1-d713-4e25-aced-47111da687d1 None admin] RBAC: Authorizing `identity:get_group(group_id=b354a8e530004d14b14d84cd6c43d12d)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:57.531865 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a1eb1-d713-4e25-aced-47111da687d1 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:57.538359 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 191/368] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:32:57 2022] GET /identity/v3/groups/b354a8e530004d14b14d84cd6c43d12d => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:57.538359 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a1eb1-d713-4e25-aced-47111da687d1 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:57.545396 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6f181-cacb-442a-acdb-5ba11824dd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:57.546461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6f181-cacb-442a-acdb-5ba11824dd0e None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:57.546872 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6f181-cacb-442a-acdb-5ba11824dd0e None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:57.547332 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6f181-cacb-442a-acdb-5ba11824dd0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:57.550017 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6f181-cacb-442a-acdb-5ba11824dd0e None admin] RBAC: Adding query filter params (group.id=b354a8e530004d14b14d84cd6c43d12d, role.id=198eba72a9774c1b87f0403d4f400243, scope.project.id=f097dc1a2c714aada1ee8228564936d7) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:57.550518 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6f181-cacb-442a-acdb-5ba11824dd0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:57.552635 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6f181-cacb-442a-acdb-5ba11824dd0e None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:57.561084 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 178/369] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:32:57 2022] GET /identity/v3/role_assignments?group.id=b354a8e530004d14b14d84cd6c43d12d&scope.project.id=f097dc1a2c714aada1ee8228564936d7&role.id=198eba72a9774c1b87f0403d4f400243 => generated 260 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:57.562281 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6f181-cacb-442a-acdb-5ba11824dd0e None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:57.726060 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a1eb1-d713-4e25-aced-47111da687d1 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:57.787064 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6f181-cacb-442a-acdb-5ba11824dd0e None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:57.793024 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226d29c-d24d-4641-8c28-f03383956725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:57.794242 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226d29c-d24d-4641-8c28-f03383956725 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:57.794604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226d29c-d24d-4641-8c28-f03383956725 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:57.795002 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226d29c-d24d-4641-8c28-f03383956725 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:57.816381 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226d29c-d24d-4641-8c28-f03383956725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:57.828946 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-d226d29c-d24d-4641-8c28-f03383956725 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:32:57.828946 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:57.828946 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:57.828946 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:57.828946 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:57.828946 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:57.828946 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:57.828946 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:57.828946 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:57.828946 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:57.828946 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:57.828946 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:57.828946 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:57.828946 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:57.828946 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:57.828946 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:57.830209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:57.830209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:57.830209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:57.830209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:57.830209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:57.830209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:57.830209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:57.830209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:57.830209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:57.830209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:57.830209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:57.830209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:32:57.830209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:57.830209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:57.830209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:57.830209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:57.831192 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:57.831192 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:57.831192 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:57.831192 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:57.831192 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:57.831192 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:57.831192 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:57.831192 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:57.831192 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:57.831192 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:57.831192 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:32:57.831192 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:32:57.833116 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 192/370] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:32:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:32:57.838343 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226d29c-d24d-4641-8c28-f03383956725 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:57.839031 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025d962-c40b-4143-bcbc-d99a38956b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:57.840047 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025d962-c40b-4143-bcbc-d99a38956b1e None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:57.840331 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025d962-c40b-4143-bcbc-d99a38956b1e None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:57.840605 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025d962-c40b-4143-bcbc-d99a38956b1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:57.957336 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025d962-c40b-4143-bcbc-d99a38956b1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:57.958965 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025d962-c40b-4143-bcbc-d99a38956b1e None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:58.077026 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226d29c-d24d-4641-8c28-f03383956725 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:58.109256 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 179/371] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:32:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:32:58.111390 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025d962-c40b-4143-bcbc-d99a38956b1e None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:58.129420 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00300d8a-23d8-4211-a5d4-b2e87cf201c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:58.130181 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00300d8a-23d8-4211-a5d4-b2e87cf201c2 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:58.130466 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00300d8a-23d8-4211-a5d4-b2e87cf201c2 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:58.130763 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00300d8a-23d8-4211-a5d4-b2e87cf201c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:58.131786 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00300d8a-23d8-4211-a5d4-b2e87cf201c2 None admin] RBAC: Adding query filter params (group.id=b354a8e530004d14b14d84cd6c43d12d, role.id=607698024b4d44f0a109bb69deafc0c5, scope.project.id=50c0c9efd04543c4baaf687248d2cb4e) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:58.132217 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00300d8a-23d8-4211-a5d4-b2e87cf201c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:58.134797 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00300d8a-23d8-4211-a5d4-b2e87cf201c2 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:58.143985 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 193/372] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:32:57 2022] GET /identity/v3/role_assignments?group.id=b354a8e530004d14b14d84cd6c43d12d&scope.project.id=50c0c9efd04543c4baaf687248d2cb4e&role.id=607698024b4d44f0a109bb69deafc0c5 => generated 260 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:58.145130 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00300d8a-23d8-4211-a5d4-b2e87cf201c2 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:58.333497 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025d962-c40b-4143-bcbc-d99a38956b1e None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:58.337585 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00300d8a-23d8-4211-a5d4-b2e87cf201c2 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:58.386879 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba56e2-299c-4e2f-a428-96c8b70aed44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:58.387473 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba56e2-299c-4e2f-a428-96c8b70aed44 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:58.387767 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba56e2-299c-4e2f-a428-96c8b70aed44 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:58.388038 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba56e2-299c-4e2f-a428-96c8b70aed44 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:58.393456 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba56e2-299c-4e2f-a428-96c8b70aed44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:58.393456 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba56e2-299c-4e2f-a428-96c8b70aed44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:58.393456 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba56e2-299c-4e2f-a428-96c8b70aed44 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:58.401199 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 180/373] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:58.406906 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385800e-2f2a-436d-a097-27590fa0a19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:58.408511 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385800e-2f2a-436d-a097-27590fa0a19d None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:58.409827 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba56e2-299c-4e2f-a428-96c8b70aed44 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:58.410575 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385800e-2f2a-436d-a097-27590fa0a19d None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:58.410863 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385800e-2f2a-436d-a097-27590fa0a19d None admin] PATH_INFO: `/v3/projects/f097dc1a2c714aada1ee8228564936d7` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:58.412564 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385800e-2f2a-436d-a097-27590fa0a19d None admin] RBAC: Authorizing `identity:get_project(project_id=f097dc1a2c714aada1ee8228564936d7)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:58.414141 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385800e-2f2a-436d-a097-27590fa0a19d None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:58.427035 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 194/374] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:58 2022] GET /identity/v3/projects/f097dc1a2c714aada1ee8228564936d7 => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:58.428060 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385800e-2f2a-436d-a097-27590fa0a19d None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:58.586917 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba56e2-299c-4e2f-a428-96c8b70aed44 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:58.630130 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385800e-2f2a-436d-a097-27590fa0a19d None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:58.631055 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9413b41-4503-4d1b-a101-ac993529a2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:58.631811 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9413b41-4503-4d1b-a101-ac993529a2ea None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:58.632149 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9413b41-4503-4d1b-a101-ac993529a2ea None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:58.632485 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9413b41-4503-4d1b-a101-ac993529a2ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:58.703193 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854f4f2-63ea-4845-97d3-29fc33524e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:58.705107 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854f4f2-63ea-4845-97d3-29fc33524e6a None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:58.706928 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854f4f2-63ea-4845-97d3-29fc33524e6a None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:58.707604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854f4f2-63ea-4845-97d3-29fc33524e6a None admin] PATH_INFO: `/v3/groups/b354a8e530004d14b14d84cd6c43d12d` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:58.711105 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854f4f2-63ea-4845-97d3-29fc33524e6a None admin] RBAC: Authorizing `identity:get_group(group_id=b354a8e530004d14b14d84cd6c43d12d)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:58.715533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854f4f2-63ea-4845-97d3-29fc33524e6a None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:58.719677 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 195/375] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:32:58 2022] GET /identity/v3/groups/b354a8e530004d14b14d84cd6c43d12d => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:58.723330 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906120fd-1ab2-4d9e-80f6-912f39e5fe64 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:58.723934 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906120fd-1ab2-4d9e-80f6-912f39e5fe64 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:58.724854 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906120fd-1ab2-4d9e-80f6-912f39e5fe64 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:58.728112 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 196/376] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:32:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:32:58.737334 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a7cd4-f61c-4242-ad66-7dca28b12e38 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:58.738269 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a7cd4-f61c-4242-ad66-7dca28b12e38 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:58.738719 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9413b41-4503-4d1b-a101-ac993529a2ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:58.739067 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a7cd4-f61c-4242-ad66-7dca28b12e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:58.740238 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9413b41-4503-4d1b-a101-ac993529a2ea None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:58.771079 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-574a7cd4-f61c-4242-ad66-7dca28b12e38 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:32:58.773266 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-574a7cd4-f61c-4242-ad66-7dca28b12e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:32:58.873652 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 197/377] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:32:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:32:58.875287 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a7cd4-f61c-4242-ad66-7dca28b12e38 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:58.957700 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 181/378] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:32:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:32:58.959742 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9413b41-4503-4d1b-a101-ac993529a2ea None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:58.999008 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a7cd4-f61c-4242-ad66-7dca28b12e38 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:59.040350 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42674b5e-b07d-413a-b5c6-43fdf4e2d3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:59.041420 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42674b5e-b07d-413a-b5c6-43fdf4e2d3f3 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:59.041942 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42674b5e-b07d-413a-b5c6-43fdf4e2d3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:59.042440 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42674b5e-b07d-413a-b5c6-43fdf4e2d3f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:59.043803 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42674b5e-b07d-413a-b5c6-43fdf4e2d3f3 None admin] RBAC: Adding query filter params (group.id=b354a8e530004d14b14d84cd6c43d12d, role.id=607698024b4d44f0a109bb69deafc0c5, scope.project.id=f097dc1a2c714aada1ee8228564936d7) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:59.044402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42674b5e-b07d-413a-b5c6-43fdf4e2d3f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:59.046434 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42674b5e-b07d-413a-b5c6-43fdf4e2d3f3 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:59.054412 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 198/379] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:32:58 2022] GET /identity/v3/role_assignments?group.id=b354a8e530004d14b14d84cd6c43d12d&scope.project.id=f097dc1a2c714aada1ee8228564936d7&role.id=607698024b4d44f0a109bb69deafc0c5 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:59.055698 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42674b5e-b07d-413a-b5c6-43fdf4e2d3f3 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:59.165931 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9413b41-4503-4d1b-a101-ac993529a2ea None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:59.188288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42674b5e-b07d-413a-b5c6-43fdf4e2d3f3 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:59.232724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58d623-c2e5-4599-8a22-f3ee681d9006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:59.234106 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58d623-c2e5-4599-8a22-f3ee681d9006 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:59.234692 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58d623-c2e5-4599-8a22-f3ee681d9006 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:59.235224 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58d623-c2e5-4599-8a22-f3ee681d9006 None admin] PATH_INFO: `/v3/projects/0a83b0c5040146dc9a4ba09b4fd4dfe7` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:59.237472 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58d623-c2e5-4599-8a22-f3ee681d9006 None admin] RBAC: Authorizing `identity:get_project(project_id=0a83b0c5040146dc9a4ba09b4fd4dfe7)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:59.239451 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58d623-c2e5-4599-8a22-f3ee681d9006 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:59.242125 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 199/380] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:59 2022] GET /identity/v3/projects/0a83b0c5040146dc9a4ba09b4fd4dfe7 => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:59.247905 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58d623-c2e5-4599-8a22-f3ee681d9006 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:59.251984 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96420d10-4eb6-4a8a-8018-75944725bacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:59.252836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96420d10-4eb6-4a8a-8018-75944725bacd None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:59.253217 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96420d10-4eb6-4a8a-8018-75944725bacd None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:59.253766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96420d10-4eb6-4a8a-8018-75944725bacd None admin] PATH_INFO: `/v3/roles/member` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:59.289266 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96420d10-4eb6-4a8a-8018-75944725bacd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:32:59.299087 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-96420d10-4eb6-4a8a-8018-75944725bacd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:59.299087 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:32:59.299087 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:32:59.299087 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:32:59.299087 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:32:59.299087 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:32:59.299087 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:32:59.299087 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:32:59.299087 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:32:59.299087 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:32:59.299087 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:32:59.299087 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:32:59.299087 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:32:59.299087 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:32:59.299087 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:32:59.299087 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:32:59.300244 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:32:59.300244 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:32:59.300244 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:32:59.300244 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:32:59.300244 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:32:59.300244 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:32:59.300244 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:32:59.300244 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:32:59.300244 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:32:59.300244 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:32:59.300244 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:32:59.300244 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:32:59.300244 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:32:59.300244 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:32:59.300244 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:32:59.300244 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:32:59.301273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:32:59.301273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:32:59.301273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:32:59.301273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:32:59.301273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:32:59.301273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:32:59.301273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:32:59.301273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:32:59.301273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:32:59.301273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:32:59.301273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:32:59.301273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:32:59.306470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 182/381] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:32:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:32:59.312533 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96420d10-4eb6-4a8a-8018-75944725bacd None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:59.380616 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58d623-c2e5-4599-8a22-f3ee681d9006 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:59.424083 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb3562-8f5f-446e-a33e-672ec5cc884a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:59.425493 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb3562-8f5f-446e-a33e-672ec5cc884a None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:59.426073 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb3562-8f5f-446e-a33e-672ec5cc884a None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:59.426588 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb3562-8f5f-446e-a33e-672ec5cc884a None admin] PATH_INFO: `/v3/groups/80d71fe4181d413392e4b1e64a8fe69f` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:59.432879 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb3562-8f5f-446e-a33e-672ec5cc884a None admin] RBAC: Authorizing `identity:get_group(group_id=80d71fe4181d413392e4b1e64a8fe69f)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:59.434820 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb3562-8f5f-446e-a33e-672ec5cc884a None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:59.437269 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 200/382] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:32:59 2022] GET /identity/v3/groups/80d71fe4181d413392e4b1e64a8fe69f => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:59.447088 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb3562-8f5f-446e-a33e-672ec5cc884a None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:59.569929 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96420d10-4eb6-4a8a-8018-75944725bacd None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:59.616218 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb3562-8f5f-446e-a33e-672ec5cc884a None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:59.620533 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1c789-167f-4b97-975f-e67ee0a1bbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:59.620895 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1c789-167f-4b97-975f-e67ee0a1bbbc None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:59.621110 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1c789-167f-4b97-975f-e67ee0a1bbbc None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:59.621485 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1c789-167f-4b97-975f-e67ee0a1bbbc None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:59.624656 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1c789-167f-4b97-975f-e67ee0a1bbbc None admin] RBAC: Adding query filter params (name=member) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:59.624656 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1c789-167f-4b97-975f-e67ee0a1bbbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:59.624656 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1c789-167f-4b97-975f-e67ee0a1bbbc None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:59.635837 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 183/383] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:32:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:32:59.642964 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1c789-167f-4b97-975f-e67ee0a1bbbc None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:32:59.682190 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b968e-8fb8-4413-b9c7-cb7b8995b0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:59.683527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b968e-8fb8-4413-b9c7-cb7b8995b0bf None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:59.684505 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b968e-8fb8-4413-b9c7-cb7b8995b0bf None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:59.685387 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b968e-8fb8-4413-b9c7-cb7b8995b0bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:59.686565 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b968e-8fb8-4413-b9c7-cb7b8995b0bf None admin] RBAC: Adding query filter params (group.id=80d71fe4181d413392e4b1e64a8fe69f, role.id=a5cb8d37261d486cbc1b06d167a9c05c, scope.project.id=0a83b0c5040146dc9a4ba09b4fd4dfe7) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:32:59.687403 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b968e-8fb8-4413-b9c7-cb7b8995b0bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:59.690497 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b968e-8fb8-4413-b9c7-cb7b8995b0bf None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:59.699273 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 201/384] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:32:59 2022] GET /identity/v3/role_assignments?group.id=80d71fe4181d413392e4b1e64a8fe69f&scope.project.id=0a83b0c5040146dc9a4ba09b4fd4dfe7&role.id=a5cb8d37261d486cbc1b06d167a9c05c => generated 260 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:59.791525 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1c789-167f-4b97-975f-e67ee0a1bbbc None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:32:59.842151 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863ea6c-9440-4762-a577-156bc00303e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:32:59.843336 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863ea6c-9440-4762-a577-156bc00303e6 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:32:59.843792 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863ea6c-9440-4762-a577-156bc00303e6 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:32:59.844151 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863ea6c-9440-4762-a577-156bc00303e6 None admin] PATH_INFO: `/v3/groups/b354a8e530004d14b14d84cd6c43d12d` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:32:59.846500 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863ea6c-9440-4762-a577-156bc00303e6 None admin] RBAC: Authorizing `identity:get_group(group_id=b354a8e530004d14b14d84cd6c43d12d)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:32:59.848695 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863ea6c-9440-4762-a577-156bc00303e6 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:32:59.851629 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 184/385] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:32:59 2022] GET /identity/v3/groups/b354a8e530004d14b14d84cd6c43d12d => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:32:59.858701 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b968e-8fb8-4413-b9c7-cb7b8995b0bf None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:00.033843 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b968e-8fb8-4413-b9c7-cb7b8995b0bf None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:00.078934 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95a037-efbc-4d7b-a328-3e567512a3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:00.081613 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95a037-efbc-4d7b-a328-3e567512a3d4 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:00.082119 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95a037-efbc-4d7b-a328-3e567512a3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:00.082585 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95a037-efbc-4d7b-a328-3e567512a3d4 None admin] PATH_INFO: `/v3/projects/50c0c9efd04543c4baaf687248d2cb4e` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:00.084470 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95a037-efbc-4d7b-a328-3e567512a3d4 None admin] RBAC: Authorizing `identity:get_project(project_id=50c0c9efd04543c4baaf687248d2cb4e)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:00.086404 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95a037-efbc-4d7b-a328-3e567512a3d4 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:00.089361 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 202/386] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:32:59 2022] GET /identity/v3/projects/50c0c9efd04543c4baaf687248d2cb4e => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:00.097419 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863ea6c-9440-4762-a577-156bc00303e6 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:00.218523 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863ea6c-9440-4762-a577-156bc00303e6 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:00.261053 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb776f-d83c-4056-878e-74e15f615452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:00.262280 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb776f-d83c-4056-878e-74e15f615452 None admin] REQUEST_METHOD: `PUT` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:00.262770 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb776f-d83c-4056-878e-74e15f615452 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:00.263209 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb776f-d83c-4056-878e-74e15f615452 None admin] PATH_INFO: `/v3/projects/50c0c9efd04543c4baaf687248d2cb4e/groups/b354a8e530004d14b14d84cd6c43d12d/roles/198eba72a9774c1b87f0403d4f400243` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:00.265583 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb776f-d83c-4056-878e-74e15f615452 None admin] RBAC: Authorizing `identity:create_grant(project_id=50c0c9efd04543c4baaf687248d2cb4e, group_id=b354a8e530004d14b14d84cd6c43d12d, role_id=198eba72a9774c1b87f0403d4f400243)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:00.268103 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb776f-d83c-4056-878e-74e15f615452 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:00.290962 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 185/387] 10.222.0.48 () {58 vars in 1442 bytes} [Mon May 9 15:33:00 2022] PUT /identity/v3/projects/50c0c9efd04543c4baaf687248d2cb4e/groups/b354a8e530004d14b14d84cd6c43d12d/roles/198eba72a9774c1b87f0403d4f400243 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:33:00.681293 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901fc2f-41c1-4ec2-b0db-ffcae9eec183 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:00.682320 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901fc2f-41c1-4ec2-b0db-ffcae9eec183 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:00.682817 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901fc2f-41c1-4ec2-b0db-ffcae9eec183 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:00.684703 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 203/388] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:00.691829 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde843d6-a0da-4eff-ba53-c7cdb366e767 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:00.692776 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde843d6-a0da-4eff-ba53-c7cdb366e767 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:00.693292 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde843d6-a0da-4eff-ba53-c7cdb366e767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:00.712270 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-dde843d6-a0da-4eff-ba53-c7cdb366e767 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:00.714123 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-dde843d6-a0da-4eff-ba53-c7cdb366e767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:00.799165 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 186/389] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:33:00.828081 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901fc2f-41c1-4ec2-b0db-ffcae9eec183 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:00.965483 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901fc2f-41c1-4ec2-b0db-ffcae9eec183 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:01.011223 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c20fb1-7868-45bd-bd01-a4c8eeafac23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:01.012522 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c20fb1-7868-45bd-bd01-a4c8eeafac23 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:01.013083 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c20fb1-7868-45bd-bd01-a4c8eeafac23 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:01.013612 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c20fb1-7868-45bd-bd01-a4c8eeafac23 None admin] PATH_INFO: `/v3/roles/member` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:01.027694 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c20fb1-7868-45bd-bd01-a4c8eeafac23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:01.037457 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-a3c20fb1-7868-45bd-bd01-a4c8eeafac23 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:33:01.037457 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:01.037457 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:01.037457 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:01.037457 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:01.037457 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:01.037457 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:01.037457 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:01.037457 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:01.037457 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:01.037457 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:01.037457 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:01.037457 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:01.037457 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:01.037457 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:01.037457 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:01.038533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:01.038533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:01.038533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:01.038533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:01.038533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:01.038533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:01.038533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:01.038533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:01.038533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:01.038533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:01.038533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:01.038533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:01.038533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:01.038533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:01.038533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:01.038533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:01.039434 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:01.039434 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:01.039434 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:01.039434 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:01.039434 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:01.039434 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:01.039434 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:01.039434 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:01.039434 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:01.039434 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:01.039434 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:33:01.039434 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:01.042490 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 204/390] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:33:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:01.050014 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde843d6-a0da-4eff-ba53-c7cdb366e767 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:01.234360 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde843d6-a0da-4eff-ba53-c7cdb366e767 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:01.296604 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac8543-efb1-4ad4-b675-8fe77ef22309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:01.297294 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac8543-efb1-4ad4-b675-8fe77ef22309 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:01.297685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac8543-efb1-4ad4-b675-8fe77ef22309 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:01.298682 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac8543-efb1-4ad4-b675-8fe77ef22309 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:01.299469 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac8543-efb1-4ad4-b675-8fe77ef22309 None admin] RBAC: Adding query filter params (name=member) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:01.299770 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac8543-efb1-4ad4-b675-8fe77ef22309 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:01.301183 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac8543-efb1-4ad4-b675-8fe77ef22309 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:01.315309 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 187/391] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:33:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:01.321335 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c20fb1-7868-45bd-bd01-a4c8eeafac23 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:01.428226 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab38a1-2afc-4745-b127-f24415eab8ed None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:01.428572 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab38a1-2afc-4745-b127-f24415eab8ed None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:01.429010 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab38a1-2afc-4745-b127-f24415eab8ed None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:01.430609 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 188/392] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:33:01.439149 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025088c-d490-404d-9ec3-232f65781f60 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:01.439406 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025088c-d490-404d-9ec3-232f65781f60 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:01.439689 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025088c-d490-404d-9ec3-232f65781f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:01.461925 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-1025088c-d490-404d-9ec3-232f65781f60 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:01.463135 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-1025088c-d490-404d-9ec3-232f65781f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:01.532176 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c20fb1-7868-45bd-bd01-a4c8eeafac23 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:01.616268 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854696c4-90f0-4ec1-9417-b9b2b804182a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:01.617243 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854696c4-90f0-4ec1-9417-b9b2b804182a None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:01.617584 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854696c4-90f0-4ec1-9417-b9b2b804182a None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:01.617864 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854696c4-90f0-4ec1-9417-b9b2b804182a None admin] PATH_INFO: `/v3/groups/b354a8e530004d14b14d84cd6c43d12d` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:01.619263 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854696c4-90f0-4ec1-9417-b9b2b804182a None admin] RBAC: Authorizing `identity:get_group(group_id=b354a8e530004d14b14d84cd6c43d12d)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:01.621766 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854696c4-90f0-4ec1-9417-b9b2b804182a None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:01.624650 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 205/393] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:33:01 2022] GET /identity/v3/groups/b354a8e530004d14b14d84cd6c43d12d => generated 226 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:01.635380 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854696c4-90f0-4ec1-9417-b9b2b804182a None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:01.671271 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 189/394] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:33:01.726928 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025088c-d490-404d-9ec3-232f65781f60 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:01.845798 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854696c4-90f0-4ec1-9417-b9b2b804182a None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:01.915751 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069df6c0-dfc0-454f-a100-85c106cded12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:01.916674 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069df6c0-dfc0-454f-a100-85c106cded12 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:01.916959 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069df6c0-dfc0-454f-a100-85c106cded12 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:01.917296 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069df6c0-dfc0-454f-a100-85c106cded12 None admin] PATH_INFO: `/v3/projects/f097dc1a2c714aada1ee8228564936d7` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:01.922156 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069df6c0-dfc0-454f-a100-85c106cded12 None admin] RBAC: Authorizing `identity:get_project(project_id=f097dc1a2c714aada1ee8228564936d7)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:01.924726 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069df6c0-dfc0-454f-a100-85c106cded12 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:01.927031 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 206/395] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:33:01 2022] GET /identity/v3/projects/f097dc1a2c714aada1ee8228564936d7 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:01.932684 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069df6c0-dfc0-454f-a100-85c106cded12 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:01.948090 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025088c-d490-404d-9ec3-232f65781f60 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:01.998160 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e87560-ec64-4fe1-95bb-56e355159d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:01.999003 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e87560-ec64-4fe1-95bb-56e355159d6b None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:01.999289 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e87560-ec64-4fe1-95bb-56e355159d6b None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:01.999572 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e87560-ec64-4fe1-95bb-56e355159d6b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:02.023152 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e87560-ec64-4fe1-95bb-56e355159d6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:02.036366 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-08e87560-ec64-4fe1-95bb-56e355159d6b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:33:02.036366 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:02.036366 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:02.036366 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:02.036366 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:02.036366 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:02.036366 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:02.036366 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:02.036366 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:02.036366 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:02.036366 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:02.036366 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:02.036366 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:02.036366 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:02.036366 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:02.036366 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:02.037484 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:02.037484 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:02.037484 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:02.037484 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:02.037484 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:02.037484 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:02.037484 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:02.037484 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:02.037484 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:02.037484 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:02.037484 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:02.037484 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:02.037484 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:02.037484 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:02.037484 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:02.037484 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:02.038410 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:02.038410 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:02.038410 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:02.038410 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:02.038410 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:02.038410 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:02.038410 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:02.038410 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:02.038410 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:02.038410 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:02.038410 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:33:02.038410 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:02.041007 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 190/396] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:33:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:33:02.047365 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e87560-ec64-4fe1-95bb-56e355159d6b None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:02.075637 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069df6c0-dfc0-454f-a100-85c106cded12 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:02.114193 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780a16c-e6a2-4652-81c1-1d94db0ca47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:02.115109 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780a16c-e6a2-4652-81c1-1d94db0ca47f None admin] REQUEST_METHOD: `PUT` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:02.115392 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780a16c-e6a2-4652-81c1-1d94db0ca47f None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:02.115668 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780a16c-e6a2-4652-81c1-1d94db0ca47f None admin] PATH_INFO: `/v3/projects/f097dc1a2c714aada1ee8228564936d7/groups/b354a8e530004d14b14d84cd6c43d12d/roles/198eba72a9774c1b87f0403d4f400243` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:02.123845 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780a16c-e6a2-4652-81c1-1d94db0ca47f None admin] RBAC: Authorizing `identity:create_grant(project_id=f097dc1a2c714aada1ee8228564936d7, group_id=b354a8e530004d14b14d84cd6c43d12d, role_id=198eba72a9774c1b87f0403d4f400243)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:02.125657 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780a16c-e6a2-4652-81c1-1d94db0ca47f None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:02.164193 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 207/397] 10.222.0.48 () {58 vars in 1442 bytes} [Mon May 9 15:33:01 2022] PUT /identity/v3/projects/f097dc1a2c714aada1ee8228564936d7/groups/b354a8e530004d14b14d84cd6c43d12d/roles/198eba72a9774c1b87f0403d4f400243 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:33:02.296312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e87560-ec64-4fe1-95bb-56e355159d6b None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:02.340391 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a2415-e221-4ffe-a2e5-26a199c55abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:02.341087 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a2415-e221-4ffe-a2e5-26a199c55abe None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:02.341390 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a2415-e221-4ffe-a2e5-26a199c55abe None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:02.341684 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a2415-e221-4ffe-a2e5-26a199c55abe None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:02.342460 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a2415-e221-4ffe-a2e5-26a199c55abe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:02.342774 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a2415-e221-4ffe-a2e5-26a199c55abe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:02.344223 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a2415-e221-4ffe-a2e5-26a199c55abe None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:02.355545 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 191/398] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:02.362607 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780a16c-e6a2-4652-81c1-1d94db0ca47f None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:02.524657 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780a16c-e6a2-4652-81c1-1d94db0ca47f None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:02.579304 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba25c0-9edf-41ac-b790-0e9f037d4661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:02.583398 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba25c0-9edf-41ac-b790-0e9f037d4661 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:02.583748 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba25c0-9edf-41ac-b790-0e9f037d4661 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:02.584249 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba25c0-9edf-41ac-b790-0e9f037d4661 None admin] PATH_INFO: `/v3/groups/b354a8e530004d14b14d84cd6c43d12d` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:02.586433 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba25c0-9edf-41ac-b790-0e9f037d4661 None admin] RBAC: Authorizing `identity:get_group(group_id=b354a8e530004d14b14d84cd6c43d12d)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:02.588251 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba25c0-9edf-41ac-b790-0e9f037d4661 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:02.597490 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 208/399] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:33:02 2022] GET /identity/v3/groups/b354a8e530004d14b14d84cd6c43d12d => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:02.602872 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a2415-e221-4ffe-a2e5-26a199c55abe None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:02.699727 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b051b-d980-4b67-a5dd-8a71e9931295 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:02.700091 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b051b-d980-4b67-a5dd-8a71e9931295 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:02.700291 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b051b-d980-4b67-a5dd-8a71e9931295 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:02.702089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 209/400] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:33:02.711026 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d2c6a-e7b6-49ca-90f1-3b55180fc4e3 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:02.711684 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d2c6a-e7b6-49ca-90f1-3b55180fc4e3 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:02.712193 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d2c6a-e7b6-49ca-90f1-3b55180fc4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:02.747277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-b56d2c6a-e7b6-49ca-90f1-3b55180fc4e3 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:02.748524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-b56d2c6a-e7b6-49ca-90f1-3b55180fc4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:02.786722 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a2415-e221-4ffe-a2e5-26a199c55abe None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:02.839068 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd66410-f8c9-45db-80b4-caab25a66116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:02.840093 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd66410-f8c9-45db-80b4-caab25a66116 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:02.840370 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd66410-f8c9-45db-80b4-caab25a66116 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:02.840925 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd66410-f8c9-45db-80b4-caab25a66116 None admin] PATH_INFO: `/v3/projects/50c0c9efd04543c4baaf687248d2cb4e` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:02.842517 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd66410-f8c9-45db-80b4-caab25a66116 None admin] RBAC: Authorizing `identity:get_project(project_id=50c0c9efd04543c4baaf687248d2cb4e)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:02.844012 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd66410-f8c9-45db-80b4-caab25a66116 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:02.847862 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 192/401] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:33:02 2022] GET /identity/v3/projects/50c0c9efd04543c4baaf687248d2cb4e => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:02.853280 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd66410-f8c9-45db-80b4-caab25a66116 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:02.915303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 210/402] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:33:02.946770 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d2c6a-e7b6-49ca-90f1-3b55180fc4e3 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:03.065074 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd66410-f8c9-45db-80b4-caab25a66116 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:03.065785 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d2c6a-e7b6-49ca-90f1-3b55180fc4e3 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:03.104773 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fd0fb-b658-45f1-802a-4bca31d8abf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:03.105045 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a91f7-74e8-487b-a8c9-ddf3bdec051d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:03.105684 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fd0fb-b658-45f1-802a-4bca31d8abf2 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:03.105912 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a91f7-74e8-487b-a8c9-ddf3bdec051d None admin] REQUEST_METHOD: `PUT` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:03.106022 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fd0fb-b658-45f1-802a-4bca31d8abf2 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:03.106218 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a91f7-74e8-487b-a8c9-ddf3bdec051d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:03.106335 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fd0fb-b658-45f1-802a-4bca31d8abf2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:03.106525 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a91f7-74e8-487b-a8c9-ddf3bdec051d None admin] PATH_INFO: `/v3/projects/50c0c9efd04543c4baaf687248d2cb4e/groups/b354a8e530004d14b14d84cd6c43d12d/roles/607698024b4d44f0a109bb69deafc0c5` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:03.109406 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a91f7-74e8-487b-a8c9-ddf3bdec051d None admin] RBAC: Authorizing `identity:create_grant(project_id=50c0c9efd04543c4baaf687248d2cb4e, group_id=b354a8e530004d14b14d84cd6c43d12d, role_id=607698024b4d44f0a109bb69deafc0c5)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:03.111597 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a91f7-74e8-487b-a8c9-ddf3bdec051d None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:03.118996 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fd0fb-b658-45f1-802a-4bca31d8abf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:03.128406 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-651fd0fb-b658-45f1-802a-4bca31d8abf2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:33:03.128406 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:03.128406 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:03.128406 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:03.128406 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:03.128406 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:03.128406 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:03.128406 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:03.128406 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:03.128406 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:03.128406 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:03.128406 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:03.128406 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:03.128406 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:03.128406 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:03.128406 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:03.129765 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:03.129765 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:03.129765 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:03.129765 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:03.129765 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:03.129765 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:03.129765 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:03.129765 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:03.129765 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:03.129765 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:03.129765 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:03.129765 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:03.129765 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:03.129765 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:03.129765 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:03.129765 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:03.130758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:03.130758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:03.130758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:03.130758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:03.130758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:03.130758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:03.130758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:03.130758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:03.130758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:03.130758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:03.130758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:33:03.130758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:03.130758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 211/403] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:33:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:03.131800 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4749f7a-ae76-4f69-83bc-58f423f906e1 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:03.132049 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4749f7a-ae76-4f69-83bc-58f423f906e1 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:03.132370 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4749f7a-ae76-4f69-83bc-58f423f906e1 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:03.138640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 212/404] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:03.138640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4749f7a-ae76-4f69-83bc-58f423f906e1 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:03.139770 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 193/405] 10.222.0.48 () {58 vars in 1442 bytes} [Mon May 9 15:33:02 2022] PUT /identity/v3/projects/50c0c9efd04543c4baaf687248d2cb4e/groups/b354a8e530004d14b14d84cd6c43d12d/roles/607698024b4d44f0a109bb69deafc0c5 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:33:03.141594 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303c270-c162-4f51-b0ef-3d0084f56373 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:03.142977 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303c270-c162-4f51-b0ef-3d0084f56373 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:03.144608 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303c270-c162-4f51-b0ef-3d0084f56373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:03.167733 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-b303c270-c162-4f51-b0ef-3d0084f56373 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:03.169408 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-b303c270-c162-4f51-b0ef-3d0084f56373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:03.303715 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4749f7a-ae76-4f69-83bc-58f423f906e1 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:03.323421 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 194/406] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:33:03.369156 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65affcf5-f6a4-4fde-a907-43a80d2437eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:03.369503 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303c270-c162-4f51-b0ef-3d0084f56373 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:03.370697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65affcf5-f6a4-4fde-a907-43a80d2437eb None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:03.371251 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65affcf5-f6a4-4fde-a907-43a80d2437eb None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:03.372086 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65affcf5-f6a4-4fde-a907-43a80d2437eb None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:03.373131 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65affcf5-f6a4-4fde-a907-43a80d2437eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:03.373819 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65affcf5-f6a4-4fde-a907-43a80d2437eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:03.378279 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65affcf5-f6a4-4fde-a907-43a80d2437eb None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:03.396490 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 213/407] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:03.405787 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65affcf5-f6a4-4fde-a907-43a80d2437eb None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:03.500816 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303c270-c162-4f51-b0ef-3d0084f56373 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:03.554217 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfb5d2-79c8-467b-9b9d-b203482d83ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:03.555064 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfb5d2-79c8-467b-9b9d-b203482d83ce None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:03.555487 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfb5d2-79c8-467b-9b9d-b203482d83ce None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:03.555654 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfb5d2-79c8-467b-9b9d-b203482d83ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:03.571068 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bfb5d2-79c8-467b-9b9d-b203482d83ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:03.587511 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-54bfb5d2-79c8-467b-9b9d-b203482d83ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:33:03.587511 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:03.587511 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:03.587511 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:03.587511 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:03.587511 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:03.587511 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:03.587511 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:03.587511 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:03.587511 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:03.587511 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:03.587511 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:03.587511 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:03.587511 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:03.587511 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:03.587511 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:03.588674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:03.588674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:03.588674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:03.588674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:03.588674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:03.588674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:03.588674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:03.588674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:03.588674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:03.588674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:03.588674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:03.588674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:03.588674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:03.588674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:03.588674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:03.588674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:03.589600 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:03.589600 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:03.589600 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:03.589600 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:03.589600 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:03.589600 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:03.589600 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:03.589600 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:03.589600 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:03.589600 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:03.589600 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:33:03.589600 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:03.589600 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 195/408] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:33:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:33:03.590466 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907ae1d-3e94-4f90-b52c-2d8a31b3286c None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:03.591073 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907ae1d-3e94-4f90-b52c-2d8a31b3286c None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:03.591073 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907ae1d-3e94-4f90-b52c-2d8a31b3286c None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:03.592747 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65affcf5-f6a4-4fde-a907-43a80d2437eb None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:03.597604 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 196/409] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:03.599339 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907ae1d-3e94-4f90-b52c-2d8a31b3286c None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:03.635803 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1b7f9-3436-49e6-92a0-9db91de348b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:03.637056 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1b7f9-3436-49e6-92a0-9db91de348b9 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:03.637628 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1b7f9-3436-49e6-92a0-9db91de348b9 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:03.638152 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1b7f9-3436-49e6-92a0-9db91de348b9 None admin] PATH_INFO: `/v3/groups/b354a8e530004d14b14d84cd6c43d12d` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:03.639688 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1b7f9-3436-49e6-92a0-9db91de348b9 None admin] RBAC: Authorizing `identity:get_group(group_id=b354a8e530004d14b14d84cd6c43d12d)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:03.641575 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1b7f9-3436-49e6-92a0-9db91de348b9 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:03.644189 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 214/410] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:33:03 2022] GET /identity/v3/groups/b354a8e530004d14b14d84cd6c43d12d => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:03.645820 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ccaef-770f-4932-b374-40715cc9e904 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:03.646358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ccaef-770f-4932-b374-40715cc9e904 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:03.646912 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ccaef-770f-4932-b374-40715cc9e904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:03.679588 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-5b4ccaef-770f-4932-b374-40715cc9e904 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:03.682184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-5b4ccaef-770f-4932-b374-40715cc9e904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:03.765300 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907ae1d-3e94-4f90-b52c-2d8a31b3286c None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:03.782863 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 215/411] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:33:03.784746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ccaef-770f-4932-b374-40715cc9e904 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:03.811441 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1097c-8233-4d21-b1f4-dd62feda40dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:03.812137 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1097c-8233-4d21-b1f4-dd62feda40dd None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:03.812459 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1097c-8233-4d21-b1f4-dd62feda40dd None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:03.812736 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1097c-8233-4d21-b1f4-dd62feda40dd None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:03.813583 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1097c-8233-4d21-b1f4-dd62feda40dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:03.813902 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1097c-8233-4d21-b1f4-dd62feda40dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:03.815945 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1097c-8233-4d21-b1f4-dd62feda40dd None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:03.829790 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 197/412] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:33:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:33:03.842643 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1097c-8233-4d21-b1f4-dd62feda40dd None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:03.919466 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ccaef-770f-4932-b374-40715cc9e904 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:03.958563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ff06b-0ae9-4f32-9193-323795514ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:03.959509 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ff06b-0ae9-4f32-9193-323795514ad4 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:03.959798 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ff06b-0ae9-4f32-9193-323795514ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:03.960078 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ff06b-0ae9-4f32-9193-323795514ad4 None admin] PATH_INFO: `/v3/projects/f097dc1a2c714aada1ee8228564936d7` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:03.961420 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ff06b-0ae9-4f32-9193-323795514ad4 None admin] RBAC: Authorizing `identity:get_project(project_id=f097dc1a2c714aada1ee8228564936d7)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:03.963147 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ff06b-0ae9-4f32-9193-323795514ad4 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:03.965359 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 216/413] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:33:03 2022] GET /identity/v3/projects/f097dc1a2c714aada1ee8228564936d7 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:03.966223 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ff06b-0ae9-4f32-9193-323795514ad4 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:04.000650 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1097c-8233-4d21-b1f4-dd62feda40dd None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:04.041846 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035e8f9-472d-4e25-9e56-432ec0f5bf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:04.042850 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035e8f9-472d-4e25-9e56-432ec0f5bf5d None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:04.043140 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035e8f9-472d-4e25-9e56-432ec0f5bf5d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:04.043421 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035e8f9-472d-4e25-9e56-432ec0f5bf5d None admin] PATH_INFO: `/v3/groups/80d71fe4181d413392e4b1e64a8fe69f` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:04.045005 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035e8f9-472d-4e25-9e56-432ec0f5bf5d None admin] RBAC: Authorizing `identity:get_group(group_id=80d71fe4181d413392e4b1e64a8fe69f)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:04.046577 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035e8f9-472d-4e25-9e56-432ec0f5bf5d None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:04.048738 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 198/414] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:33:03 2022] GET /identity/v3/groups/80d71fe4181d413392e4b1e64a8fe69f => generated 229 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:04.049840 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035e8f9-472d-4e25-9e56-432ec0f5bf5d None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:04.120417 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ff06b-0ae9-4f32-9193-323795514ad4 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:04.159872 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763ce30-7d6d-438a-aafe-e65d1c9a7b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:04.161076 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763ce30-7d6d-438a-aafe-e65d1c9a7b1e None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:04.161641 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763ce30-7d6d-438a-aafe-e65d1c9a7b1e None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:04.162157 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763ce30-7d6d-438a-aafe-e65d1c9a7b1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:04.162720 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035e8f9-472d-4e25-9e56-432ec0f5bf5d None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:04.175759 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763ce30-7d6d-438a-aafe-e65d1c9a7b1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:04.184189 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-3763ce30-7d6d-438a-aafe-e65d1c9a7b1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:33:04.184189 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:04.184189 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:04.184189 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:04.184189 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:04.184189 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:04.184189 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:04.184189 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:04.184189 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:04.184189 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:04.184189 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:04.184189 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:04.184189 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:04.184189 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:04.184189 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:04.184189 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:04.185303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:04.185303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:04.185303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:04.185303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:04.185303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:04.185303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:04.185303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:04.185303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:04.185303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:04.185303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:04.185303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:04.185303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:04.185303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:04.185303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:04.185303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:04.185303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:04.186253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:04.186253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:04.186253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:04.186253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:04.186253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:04.186253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:04.186253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:04.186253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:04.186253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:04.186253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:04.186253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:33:04.186253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:04.190452 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 217/415] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:33:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:04.191653 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763ce30-7d6d-438a-aafe-e65d1c9a7b1e None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:04.206940 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1efbc-4e54-4379-977e-c6928cb66865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:04.207871 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1efbc-4e54-4379-977e-c6928cb66865 None admin] REQUEST_METHOD: `PUT` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:04.208205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1efbc-4e54-4379-977e-c6928cb66865 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:04.208486 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1efbc-4e54-4379-977e-c6928cb66865 None admin] PATH_INFO: `/v3/projects/f097dc1a2c714aada1ee8228564936d7/groups/b354a8e530004d14b14d84cd6c43d12d/roles/607698024b4d44f0a109bb69deafc0c5` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:04.210978 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1efbc-4e54-4379-977e-c6928cb66865 None admin] RBAC: Authorizing `identity:create_grant(project_id=f097dc1a2c714aada1ee8228564936d7, group_id=b354a8e530004d14b14d84cd6c43d12d, role_id=607698024b4d44f0a109bb69deafc0c5)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:04.212519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1efbc-4e54-4379-977e-c6928cb66865 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:04.227695 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 199/416] 10.222.0.48 () {58 vars in 1442 bytes} [Mon May 9 15:33:04 2022] PUT /identity/v3/projects/f097dc1a2c714aada1ee8228564936d7/groups/b354a8e530004d14b14d84cd6c43d12d/roles/607698024b4d44f0a109bb69deafc0c5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:33:04.228777 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1efbc-4e54-4379-977e-c6928cb66865 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:04.315744 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763ce30-7d6d-438a-aafe-e65d1c9a7b1e None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:04.350058 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1efbc-4e54-4379-977e-c6928cb66865 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:04.369593 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e21d72-542d-440a-9621-188e3de33d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:04.371249 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e21d72-542d-440a-9621-188e3de33d48 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:04.371969 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e21d72-542d-440a-9621-188e3de33d48 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:04.374117 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e21d72-542d-440a-9621-188e3de33d48 None admin] PATH_INFO: `/v3/projects/0a83b0c5040146dc9a4ba09b4fd4dfe7` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:04.377560 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e21d72-542d-440a-9621-188e3de33d48 None admin] RBAC: Authorizing `identity:get_project(project_id=0a83b0c5040146dc9a4ba09b4fd4dfe7)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:04.380193 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e21d72-542d-440a-9621-188e3de33d48 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:04.382568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 218/417] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:33:04 2022] GET /identity/v3/projects/0a83b0c5040146dc9a4ba09b4fd4dfe7 => generated 344 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:04.391544 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e21d72-542d-440a-9621-188e3de33d48 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:04.432159 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c06287-a10c-495e-8feb-a5cda74253a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:04.432851 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c06287-a10c-495e-8feb-a5cda74253a1 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:04.433132 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c06287-a10c-495e-8feb-a5cda74253a1 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:04.433434 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c06287-a10c-495e-8feb-a5cda74253a1 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:04.434217 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c06287-a10c-495e-8feb-a5cda74253a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:04.434523 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c06287-a10c-495e-8feb-a5cda74253a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:04.435977 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c06287-a10c-495e-8feb-a5cda74253a1 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:04.457671 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 200/418] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:33:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:04.464474 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c06287-a10c-495e-8feb-a5cda74253a1 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:04.604335 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e21d72-542d-440a-9621-188e3de33d48 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:04.656364 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c06287-a10c-495e-8feb-a5cda74253a1 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:04.667180 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a1fbf-6cff-440c-be35-9760b864cf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:04.668233 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a1fbf-6cff-440c-be35-9760b864cf09 None admin] REQUEST_METHOD: `PUT` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:04.668522 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a1fbf-6cff-440c-be35-9760b864cf09 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:04.668804 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a1fbf-6cff-440c-be35-9760b864cf09 None admin] PATH_INFO: `/v3/projects/0a83b0c5040146dc9a4ba09b4fd4dfe7/groups/80d71fe4181d413392e4b1e64a8fe69f/roles/a5cb8d37261d486cbc1b06d167a9c05c` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:04.672596 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a1fbf-6cff-440c-be35-9760b864cf09 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a83b0c5040146dc9a4ba09b4fd4dfe7, group_id=80d71fe4181d413392e4b1e64a8fe69f, role_id=a5cb8d37261d486cbc1b06d167a9c05c)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:04.674964 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a1fbf-6cff-440c-be35-9760b864cf09 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:04.701794 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 219/419] 10.222.0.48 () {58 vars in 1442 bytes} [Mon May 9 15:33:04 2022] PUT /identity/v3/projects/0a83b0c5040146dc9a4ba09b4fd4dfe7/groups/80d71fe4181d413392e4b1e64a8fe69f/roles/a5cb8d37261d486cbc1b06d167a9c05c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:33:04.741444 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5dd88-438a-4283-a03f-245de5ebcd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:04.742587 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5dd88-438a-4283-a03f-245de5ebcd9c None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:04.742890 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5dd88-438a-4283-a03f-245de5ebcd9c None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:04.743175 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5dd88-438a-4283-a03f-245de5ebcd9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:04.899324 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5dd88-438a-4283-a03f-245de5ebcd9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:04.902099 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5dd88-438a-4283-a03f-245de5ebcd9c None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:05.088024 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 201/420] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:33:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:33:05.097233 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a1fbf-6cff-440c-be35-9760b864cf09 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:05.271869 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a1fbf-6cff-440c-be35-9760b864cf09 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:05.334198 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26b7c6-113b-46d3-807b-20f001f8e67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:05.335104 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26b7c6-113b-46d3-807b-20f001f8e67a None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:05.335395 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26b7c6-113b-46d3-807b-20f001f8e67a None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:05.335666 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26b7c6-113b-46d3-807b-20f001f8e67a None admin] PATH_INFO: `/v3/projects/50c0c9efd04543c4baaf687248d2cb4e` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:05.336983 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26b7c6-113b-46d3-807b-20f001f8e67a None admin] RBAC: Authorizing `identity:get_project(project_id=50c0c9efd04543c4baaf687248d2cb4e)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:05.338473 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26b7c6-113b-46d3-807b-20f001f8e67a None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:05.340578 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 220/421] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:33:05 2022] GET /identity/v3/projects/50c0c9efd04543c4baaf687248d2cb4e => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:05.346331 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5dd88-438a-4283-a03f-245de5ebcd9c None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:05.356416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f676a-4795-44ce-ab64-81164fd0ec4e None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:05.356763 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f676a-4795-44ce-ab64-81164fd0ec4e None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:05.356978 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f676a-4795-44ce-ab64-81164fd0ec4e None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:05.361709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 221/422] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:05.365322 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511def98-101a-4181-9046-6cfdc15569bf None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:05.365715 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511def98-101a-4181-9046-6cfdc15569bf None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:05.365935 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511def98-101a-4181-9046-6cfdc15569bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:05.398637 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-511def98-101a-4181-9046-6cfdc15569bf None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:05.400063 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-511def98-101a-4181-9046-6cfdc15569bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:05.475877 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5dd88-438a-4283-a03f-245de5ebcd9c None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:05.514466 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9d791-429e-4681-986b-62cde410818d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:05.515441 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9d791-429e-4681-986b-62cde410818d None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:05.515747 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9d791-429e-4681-986b-62cde410818d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:05.516023 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9d791-429e-4681-986b-62cde410818d None admin] PATH_INFO: `/v3/groups/b354a8e530004d14b14d84cd6c43d12d` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:05.517426 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9d791-429e-4681-986b-62cde410818d None admin] RBAC: Authorizing `identity:get_group(group_id=b354a8e530004d14b14d84cd6c43d12d)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:05.519143 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9d791-429e-4681-986b-62cde410818d None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:05.525476 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 202/423] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:33:05 2022] GET /identity/v3/groups/b354a8e530004d14b14d84cd6c43d12d => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:05.529839 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9d791-429e-4681-986b-62cde410818d None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:05.597555 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 222/424] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:33:05.641546 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511def98-101a-4181-9046-6cfdc15569bf None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:05.664273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9d791-429e-4681-986b-62cde410818d None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:05.710198 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044271a0-7827-4ac4-81ba-a1d1322b4a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:05.710939 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044271a0-7827-4ac4-81ba-a1d1322b4a42 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:05.711226 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044271a0-7827-4ac4-81ba-a1d1322b4a42 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:05.711505 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044271a0-7827-4ac4-81ba-a1d1322b4a42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:05.712377 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044271a0-7827-4ac4-81ba-a1d1322b4a42 None admin] RBAC: Adding query filter params (group.id=b354a8e530004d14b14d84cd6c43d12d, role.id=198eba72a9774c1b87f0403d4f400243, scope.project.id=50c0c9efd04543c4baaf687248d2cb4e) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:05.712725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044271a0-7827-4ac4-81ba-a1d1322b4a42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:05.714248 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044271a0-7827-4ac4-81ba-a1d1322b4a42 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:05.731798 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 203/425] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:33:05 2022] GET /identity/v3/role_assignments?group.id=b354a8e530004d14b14d84cd6c43d12d&scope.project.id=50c0c9efd04543c4baaf687248d2cb4e&role.id=198eba72a9774c1b87f0403d4f400243 => generated 611 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:05.835618 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511def98-101a-4181-9046-6cfdc15569bf None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:05.885416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81723c38-abd2-4b39-802d-55df08aa730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:05.886273 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81723c38-abd2-4b39-802d-55df08aa730e None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:05.886596 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81723c38-abd2-4b39-802d-55df08aa730e None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:05.886930 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81723c38-abd2-4b39-802d-55df08aa730e None admin] PATH_INFO: `/v3/roles/member` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:05.908849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81723c38-abd2-4b39-802d-55df08aa730e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:05.926027 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-81723c38-abd2-4b39-802d-55df08aa730e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:33:05.926027 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:05.926027 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:05.926027 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:05.926027 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:05.926027 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:05.926027 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:05.926027 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:05.926027 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:05.926027 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:05.926027 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:05.926027 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:05.926027 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:05.926027 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:05.926027 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:05.926027 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:05.927137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:05.927137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:05.927137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:05.927137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:05.927137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:05.927137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:05.927137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:05.927137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:05.927137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:05.927137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:05.927137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:05.927137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:05.927137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:05.927137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:05.927137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:05.927137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:05.928287 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:05.928287 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:05.928287 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:05.928287 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:05.928287 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:05.928287 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:05.928287 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:05.928287 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:05.928287 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:05.928287 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:05.928287 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:33:05.928287 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:05.928287 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 223/426] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:33:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:05.934210 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044271a0-7827-4ac4-81ba-a1d1322b4a42 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:06.131962 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3117dd2-4dc7-4f36-a1b2-b8ced75cdd86 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:06.132750 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3117dd2-4dc7-4f36-a1b2-b8ced75cdd86 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:06.132946 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3117dd2-4dc7-4f36-a1b2-b8ced75cdd86 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:06.136097 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 224/427] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:06.138144 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044271a0-7827-4ac4-81ba-a1d1322b4a42 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:06.144145 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14384d-6f50-401a-bc90-04d59869b859 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:06.144492 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14384d-6f50-401a-bc90-04d59869b859 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:06.144849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14384d-6f50-401a-bc90-04d59869b859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:06.180536 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-2f14384d-6f50-401a-bc90-04d59869b859 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:06.182279 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-2f14384d-6f50-401a-bc90-04d59869b859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:06.192449 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097d1b5-8deb-47bb-801d-75bcf2323023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:06.193212 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097d1b5-8deb-47bb-801d-75bcf2323023 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:06.193580 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097d1b5-8deb-47bb-801d-75bcf2323023 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:06.193867 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097d1b5-8deb-47bb-801d-75bcf2323023 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:06.195389 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097d1b5-8deb-47bb-801d-75bcf2323023 None admin] RBAC: Adding query filter params (name=member) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:06.195389 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097d1b5-8deb-47bb-801d-75bcf2323023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:06.196802 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097d1b5-8deb-47bb-801d-75bcf2323023 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:06.208335 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 204/428] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:33:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:06.214052 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097d1b5-8deb-47bb-801d-75bcf2323023 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:06.271113 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 225/429] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:33:06.302270 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14384d-6f50-401a-bc90-04d59869b859 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:06.350559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097d1b5-8deb-47bb-801d-75bcf2323023 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:06.403551 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cb22b-5b94-4573-a1c0-445be34457c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:06.404554 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cb22b-5b94-4573-a1c0-445be34457c6 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:06.404992 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cb22b-5b94-4573-a1c0-445be34457c6 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:06.405547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cb22b-5b94-4573-a1c0-445be34457c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:06.468760 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14384d-6f50-401a-bc90-04d59869b859 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:06.518087 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98958d-f982-40a2-ae1a-72828b2e3d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:06.519500 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98958d-f982-40a2-ae1a-72828b2e3d3b None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:06.520691 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98958d-f982-40a2-ae1a-72828b2e3d3b None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:06.521225 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98958d-f982-40a2-ae1a-72828b2e3d3b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:06.522896 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099cb22b-5b94-4573-a1c0-445be34457c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:06.524618 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099cb22b-5b94-4573-a1c0-445be34457c6 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:06.536137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98958d-f982-40a2-ae1a-72828b2e3d3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:06.548727 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-6c98958d-f982-40a2-ae1a-72828b2e3d3b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:33:06.548727 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:06.548727 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:06.548727 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:06.548727 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:06.548727 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:06.548727 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:06.548727 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:06.548727 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:06.548727 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:06.548727 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:06.548727 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:06.548727 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:06.548727 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:06.548727 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:06.548727 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:06.549871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:06.549871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:06.549871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:06.549871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:06.549871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:06.549871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:06.549871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:06.549871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:06.549871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:06.549871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:06.549871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:06.549871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:06.549871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:06.549871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:06.549871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:06.549871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:06.550859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:06.550859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:06.550859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:06.550859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:06.550859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:06.550859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:06.550859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:06.550859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:06.550859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:06.550859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:06.550859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:33:06.550859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:06.554019 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 226/430] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:33:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:33:06.563138 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98958d-f982-40a2-ae1a-72828b2e3d3b None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:06.687329 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 205/431] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:33:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:33:06.694344 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cb22b-5b94-4573-a1c0-445be34457c6 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:06.720774 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98958d-f982-40a2-ae1a-72828b2e3d3b None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:06.767894 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed406545-815a-468a-afbf-4cee2407528f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:06.769862 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed406545-815a-468a-afbf-4cee2407528f None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:06.770359 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed406545-815a-468a-afbf-4cee2407528f None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:06.773296 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed406545-815a-468a-afbf-4cee2407528f None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:06.775142 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed406545-815a-468a-afbf-4cee2407528f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:06.775732 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed406545-815a-468a-afbf-4cee2407528f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:06.778605 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed406545-815a-468a-afbf-4cee2407528f None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:06.789921 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 227/432] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:06.796331 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed406545-815a-468a-afbf-4cee2407528f None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:06.855032 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cb22b-5b94-4573-a1c0-445be34457c6 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:06.905209 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce5b09-2646-4ec6-a753-416053e6cb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:06.906447 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce5b09-2646-4ec6-a753-416053e6cb3f None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:06.906606 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce5b09-2646-4ec6-a753-416053e6cb3f None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:06.906915 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce5b09-2646-4ec6-a753-416053e6cb3f None admin] PATH_INFO: `/v3/projects/f097dc1a2c714aada1ee8228564936d7` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:06.909343 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce5b09-2646-4ec6-a753-416053e6cb3f None admin] RBAC: Authorizing `identity:get_project(project_id=f097dc1a2c714aada1ee8228564936d7)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:06.911375 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce5b09-2646-4ec6-a753-416053e6cb3f None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:06.914055 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 206/433] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:33:06 2022] GET /identity/v3/projects/f097dc1a2c714aada1ee8228564936d7 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:06.923277 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce5b09-2646-4ec6-a753-416053e6cb3f None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:06.952420 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed406545-815a-468a-afbf-4cee2407528f None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:07.015680 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7688402-9f2c-4594-bfc3-57fa9c5cacb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:07.017742 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7688402-9f2c-4594-bfc3-57fa9c5cacb9 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:07.018365 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7688402-9f2c-4594-bfc3-57fa9c5cacb9 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:07.018836 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7688402-9f2c-4594-bfc3-57fa9c5cacb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:07.041798 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce5b09-2646-4ec6-a753-416053e6cb3f None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:07.083369 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d2662-a1f2-4e6a-b93e-607c98ba3525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:07.084387 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d2662-a1f2-4e6a-b93e-607c98ba3525 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:07.084689 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d2662-a1f2-4e6a-b93e-607c98ba3525 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:07.085022 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d2662-a1f2-4e6a-b93e-607c98ba3525 None admin] PATH_INFO: `/v3/groups/b354a8e530004d14b14d84cd6c43d12d` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:07.086930 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d2662-a1f2-4e6a-b93e-607c98ba3525 None admin] RBAC: Authorizing `identity:get_group(group_id=b354a8e530004d14b14d84cd6c43d12d)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:07.088461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d2662-a1f2-4e6a-b93e-607c98ba3525 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:07.093568 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 207/434] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:33:06 2022] GET /identity/v3/groups/b354a8e530004d14b14d84cd6c43d12d => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:07.097296 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d2662-a1f2-4e6a-b93e-607c98ba3525 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:07.138695 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7688402-9f2c-4594-bfc3-57fa9c5cacb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:07.140677 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7688402-9f2c-4594-bfc3-57fa9c5cacb9 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:07.255607 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d2662-a1f2-4e6a-b93e-607c98ba3525 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:07.275503 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 228/435] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:33:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:33:07.281212 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7688402-9f2c-4594-bfc3-57fa9c5cacb9 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:07.320169 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479986a-8427-4476-a972-f50b680294db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:07.320950 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479986a-8427-4476-a972-f50b680294db None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:07.321339 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479986a-8427-4476-a972-f50b680294db None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:07.321719 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479986a-8427-4476-a972-f50b680294db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:07.323304 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479986a-8427-4476-a972-f50b680294db None admin] RBAC: Adding query filter params (group.id=b354a8e530004d14b14d84cd6c43d12d, role.id=198eba72a9774c1b87f0403d4f400243, scope.project.id=f097dc1a2c714aada1ee8228564936d7) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:07.323785 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479986a-8427-4476-a972-f50b680294db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:07.326139 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479986a-8427-4476-a972-f50b680294db None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:07.337956 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 208/436] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:33:07 2022] GET /identity/v3/role_assignments?group.id=b354a8e530004d14b14d84cd6c43d12d&scope.project.id=f097dc1a2c714aada1ee8228564936d7&role.id=198eba72a9774c1b87f0403d4f400243 => generated 611 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:33:07.414238 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20511a04-4f47-44e9-a440-d4692d537a51 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:07.414539 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20511a04-4f47-44e9-a440-d4692d537a51 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:07.414885 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20511a04-4f47-44e9-a440-d4692d537a51 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:07.416611 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 209/437] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:33:07.422729 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16b4ff-ffb7-4eec-a457-ba65b092aaa1 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:07.423285 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16b4ff-ffb7-4eec-a457-ba65b092aaa1 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:07.423648 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16b4ff-ffb7-4eec-a457-ba65b092aaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:07.445497 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-4e16b4ff-ffb7-4eec-a457-ba65b092aaa1 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:07.446724 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-4e16b4ff-ffb7-4eec-a457-ba65b092aaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:07.448628 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7688402-9f2c-4594-bfc3-57fa9c5cacb9 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:07.497977 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165580d-8835-4a44-8049-b9580afa55fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:07.499199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165580d-8835-4a44-8049-b9580afa55fb None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:07.499939 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165580d-8835-4a44-8049-b9580afa55fb None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:07.500421 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165580d-8835-4a44-8049-b9580afa55fb None admin] PATH_INFO: `/v3/projects/50c0c9efd04543c4baaf687248d2cb4e` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:07.504750 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165580d-8835-4a44-8049-b9580afa55fb None admin] RBAC: Authorizing `identity:get_project(project_id=50c0c9efd04543c4baaf687248d2cb4e)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:07.506680 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165580d-8835-4a44-8049-b9580afa55fb None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:07.514080 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 229/438] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:33:07 2022] GET /identity/v3/projects/50c0c9efd04543c4baaf687248d2cb4e => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:33:07.518028 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165580d-8835-4a44-8049-b9580afa55fb None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:07.554709 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 210/439] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:33:07.581334 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16b4ff-ffb7-4eec-a457-ba65b092aaa1 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:07.680832 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165580d-8835-4a44-8049-b9580afa55fb None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:07.716811 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16b4ff-ffb7-4eec-a457-ba65b092aaa1 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:07.718786 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a594c-3ce4-4e05-b5bc-744f20c6134f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:07.720585 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a594c-3ce4-4e05-b5bc-744f20c6134f None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:07.720938 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a594c-3ce4-4e05-b5bc-744f20c6134f None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:07.721220 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a594c-3ce4-4e05-b5bc-744f20c6134f None admin] PATH_INFO: `/v3/groups/b354a8e530004d14b14d84cd6c43d12d` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:07.722537 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a594c-3ce4-4e05-b5bc-744f20c6134f None admin] RBAC: Authorizing `identity:get_group(group_id=b354a8e530004d14b14d84cd6c43d12d)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:07.724024 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a594c-3ce4-4e05-b5bc-744f20c6134f None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:07.726104 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 230/440] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:33:07 2022] GET /identity/v3/groups/b354a8e530004d14b14d84cd6c43d12d => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:07.732006 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a594c-3ce4-4e05-b5bc-744f20c6134f None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:07.765142 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda9b8f-ba36-44cd-90a9-077a37b372e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:07.765883 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda9b8f-ba36-44cd-90a9-077a37b372e5 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:07.766194 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda9b8f-ba36-44cd-90a9-077a37b372e5 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:07.766440 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda9b8f-ba36-44cd-90a9-077a37b372e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:07.784692 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda9b8f-ba36-44cd-90a9-077a37b372e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:07.793310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-9eda9b8f-ba36-44cd-90a9-077a37b372e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:33:07.793310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:07.793310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:07.793310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:07.793310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:07.793310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:07.793310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:07.793310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:07.793310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:07.793310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:07.793310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:07.793310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:07.793310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:07.793310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:07.793310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:07.793310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:07.794543 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:07.794543 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:07.794543 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:07.794543 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:07.794543 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:07.794543 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:07.794543 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:07.794543 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:07.794543 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:07.794543 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:07.794543 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:07.794543 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:07.794543 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:07.794543 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:07.794543 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:07.794543 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:07.795441 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:07.795441 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:07.795441 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:07.795441 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:07.795441 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:07.795441 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:07.795441 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:07.795441 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:07.795441 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:07.795441 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:07.795441 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:33:07.795441 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:07.795441 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 211/441] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:33:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:33:07.796480 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026d08d-fecf-4752-9445-69443d3e5c65 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:07.796480 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026d08d-fecf-4752-9445-69443d3e5c65 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:07.796688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026d08d-fecf-4752-9445-69443d3e5c65 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:07.798378 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 212/442] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:07.801331 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026d08d-fecf-4752-9445-69443d3e5c65 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:07.848844 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a594c-3ce4-4e05-b5bc-744f20c6134f None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:07.890268 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce680b2-8e9b-4576-bad1-e5cc83389ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:07.891425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce680b2-8e9b-4576-bad1-e5cc83389ea9 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:07.893857 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce680b2-8e9b-4576-bad1-e5cc83389ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:07.894237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce680b2-8e9b-4576-bad1-e5cc83389ea9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:07.895511 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce680b2-8e9b-4576-bad1-e5cc83389ea9 None admin] RBAC: Adding query filter params (group.id=b354a8e530004d14b14d84cd6c43d12d, role.id=607698024b4d44f0a109bb69deafc0c5, scope.project.id=50c0c9efd04543c4baaf687248d2cb4e) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:07.895900 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce680b2-8e9b-4576-bad1-e5cc83389ea9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:07.897760 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce680b2-8e9b-4576-bad1-e5cc83389ea9 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:07.904188 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 231/443] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:33:07 2022] GET /identity/v3/role_assignments?group.id=b354a8e530004d14b14d84cd6c43d12d&scope.project.id=50c0c9efd04543c4baaf687248d2cb4e&role.id=607698024b4d44f0a109bb69deafc0c5 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:33:07.905508 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f64663-222a-4572-ba76-f82d9c2f9924 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:07.905859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f64663-222a-4572-ba76-f82d9c2f9924 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:07.906034 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f64663-222a-4572-ba76-f82d9c2f9924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:07.936980 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026d08d-fecf-4752-9445-69443d3e5c65 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:07.938035 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-83f64663-222a-4572-ba76-f82d9c2f9924 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:07.939469 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-83f64663-222a-4572-ba76-f82d9c2f9924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:07.982504 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2fce3-41e4-4c41-b8f5-68e4c9a84cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:07.983072 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2fce3-41e4-4c41-b8f5-68e4c9a84cf3 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:07.983367 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2fce3-41e4-4c41-b8f5-68e4c9a84cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:07.983698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2fce3-41e4-4c41-b8f5-68e4c9a84cf3 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:07.984487 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2fce3-41e4-4c41-b8f5-68e4c9a84cf3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:07.984800 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2fce3-41e4-4c41-b8f5-68e4c9a84cf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:07.987133 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2fce3-41e4-4c41-b8f5-68e4c9a84cf3 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:07.997327 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 213/444] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:08.003917 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2fce3-41e4-4c41-b8f5-68e4c9a84cf3 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:08.030725 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 232/445] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:33:08.055810 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f64663-222a-4572-ba76-f82d9c2f9924 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:08.153190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2fce3-41e4-4c41-b8f5-68e4c9a84cf3 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:08.196157 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f64663-222a-4572-ba76-f82d9c2f9924 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:08.204017 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c329a29-10c1-4cbd-83cc-a64d54e046d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:08.204762 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c329a29-10c1-4cbd-83cc-a64d54e046d1 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:08.205046 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c329a29-10c1-4cbd-83cc-a64d54e046d1 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:08.205322 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c329a29-10c1-4cbd-83cc-a64d54e046d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:08.244539 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f0ae1-c893-44b0-8a26-072dfaf4b3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:08.245217 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f0ae1-c893-44b0-8a26-072dfaf4b3b3 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:08.245784 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f0ae1-c893-44b0-8a26-072dfaf4b3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:08.246311 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f0ae1-c893-44b0-8a26-072dfaf4b3b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:08.263446 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f0ae1-c893-44b0-8a26-072dfaf4b3b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:08.271662 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-c39f0ae1-c893-44b0-8a26-072dfaf4b3b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:33:08.271662 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:08.271662 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:08.271662 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:08.271662 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:08.271662 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:08.271662 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:08.271662 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:08.271662 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:08.271662 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:08.271662 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:08.271662 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:08.271662 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:08.271662 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:08.271662 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:08.271662 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:08.272754 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:08.272754 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:08.272754 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:08.272754 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:08.272754 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:08.272754 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:08.272754 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:08.272754 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:08.272754 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:08.272754 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:08.272754 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:08.272754 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:08.272754 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:08.272754 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:08.272754 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:08.272754 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:08.274306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:08.274306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:08.274306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:08.274306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:08.274306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:08.274306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:08.274306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:08.274306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:08.274306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:08.274306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:08.274306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:33:08.274306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:08.274306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 233/446] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:33:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:33:08.283454 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f0ae1-c893-44b0-8a26-072dfaf4b3b3 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:08.308212 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c329a29-10c1-4cbd-83cc-a64d54e046d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:08.311053 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c329a29-10c1-4cbd-83cc-a64d54e046d1 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:08.439930 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f0ae1-c893-44b0-8a26-072dfaf4b3b3 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:08.462215 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 214/447] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:33:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:33:08.471923 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c329a29-10c1-4cbd-83cc-a64d54e046d1 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:08.486965 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3eca36-5a31-4e9a-87f3-fe768bd91dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:08.488033 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3eca36-5a31-4e9a-87f3-fe768bd91dff None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:08.488761 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3eca36-5a31-4e9a-87f3-fe768bd91dff None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:08.488761 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3eca36-5a31-4e9a-87f3-fe768bd91dff None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:08.489572 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3eca36-5a31-4e9a-87f3-fe768bd91dff None admin] RBAC: Adding query filter params (name=admin) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:08.489893 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3eca36-5a31-4e9a-87f3-fe768bd91dff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:08.491752 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3eca36-5a31-4e9a-87f3-fe768bd91dff None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:08.501154 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 234/448] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:33:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:33:08.508164 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3eca36-5a31-4e9a-87f3-fe768bd91dff None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:08.625613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c329a29-10c1-4cbd-83cc-a64d54e046d1 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:08.638992 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3eca36-5a31-4e9a-87f3-fe768bd91dff None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:08.669599 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d51101-716d-4af0-937c-fbb417e1a6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:08.670470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d51101-716d-4af0-937c-fbb417e1a6d8 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:08.670761 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d51101-716d-4af0-937c-fbb417e1a6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:08.671033 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d51101-716d-4af0-937c-fbb417e1a6d8 None admin] PATH_INFO: `/v3/projects/f097dc1a2c714aada1ee8228564936d7` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:08.672277 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d51101-716d-4af0-937c-fbb417e1a6d8 None admin] RBAC: Authorizing `identity:get_project(project_id=f097dc1a2c714aada1ee8228564936d7)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:08.674009 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d51101-716d-4af0-937c-fbb417e1a6d8 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:08.676044 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 215/449] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:33:08 2022] GET /identity/v3/projects/f097dc1a2c714aada1ee8228564936d7 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:08.677883 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc92493-aef9-4198-bd58-ba38dad06608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:08.678548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc92493-aef9-4198-bd58-ba38dad06608 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:08.678853 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc92493-aef9-4198-bd58-ba38dad06608 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:08.679145 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc92493-aef9-4198-bd58-ba38dad06608 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:08.686486 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d51101-716d-4af0-937c-fbb417e1a6d8 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:08.749967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc92493-aef9-4198-bd58-ba38dad06608 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:08.751505 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc92493-aef9-4198-bd58-ba38dad06608 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:08.823213 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d51101-716d-4af0-937c-fbb417e1a6d8 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:08.857624 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 235/450] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:33:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:33:08.863971 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc92493-aef9-4198-bd58-ba38dad06608 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:08.884387 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5a571-0f5f-483a-ab77-b982e02280a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:08.885789 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5a571-0f5f-483a-ab77-b982e02280a5 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:08.886278 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5a571-0f5f-483a-ab77-b982e02280a5 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:08.886896 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5a571-0f5f-483a-ab77-b982e02280a5 None admin] PATH_INFO: `/v3/groups/b354a8e530004d14b14d84cd6c43d12d` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:08.888435 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5a571-0f5f-483a-ab77-b982e02280a5 None admin] RBAC: Authorizing `identity:get_group(group_id=b354a8e530004d14b14d84cd6c43d12d)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:08.890890 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5a571-0f5f-483a-ab77-b982e02280a5 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:08.899448 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 216/451] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:33:08 2022] GET /identity/v3/groups/b354a8e530004d14b14d84cd6c43d12d => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:33:08.900641 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5a571-0f5f-483a-ab77-b982e02280a5 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:09.004523 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5a571-0f5f-483a-ab77-b982e02280a5 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:09.006404 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc92493-aef9-4198-bd58-ba38dad06608 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:09.041429 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c6778-8921-4b4c-a8bb-36228bd89d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:09.042136 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c6778-8921-4b4c-a8bb-36228bd89d02 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:09.042417 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c6778-8921-4b4c-a8bb-36228bd89d02 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:09.042705 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c6778-8921-4b4c-a8bb-36228bd89d02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:09.043665 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c6778-8921-4b4c-a8bb-36228bd89d02 None admin] RBAC: Adding query filter params (group.id=b354a8e530004d14b14d84cd6c43d12d, role.id=607698024b4d44f0a109bb69deafc0c5, scope.project.id=f097dc1a2c714aada1ee8228564936d7) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:09.043980 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c6778-8921-4b4c-a8bb-36228bd89d02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:09.045494 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c6778-8921-4b4c-a8bb-36228bd89d02 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:09.048548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75c123-05f6-4458-8932-df45a7f7b559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:09.049571 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75c123-05f6-4458-8932-df45a7f7b559 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:09.049880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75c123-05f6-4458-8932-df45a7f7b559 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:09.050139 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75c123-05f6-4458-8932-df45a7f7b559 None admin] PATH_INFO: `/v3/projects/0a83b0c5040146dc9a4ba09b4fd4dfe7` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:09.051477 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75c123-05f6-4458-8932-df45a7f7b559 None admin] RBAC: Authorizing `identity:get_project(project_id=0a83b0c5040146dc9a4ba09b4fd4dfe7)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:09.052288 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 217/452] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:33:08 2022] GET /identity/v3/role_assignments?group.id=b354a8e530004d14b14d84cd6c43d12d&scope.project.id=f097dc1a2c714aada1ee8228564936d7&role.id=607698024b4d44f0a109bb69deafc0c5 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:33:09.052958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75c123-05f6-4458-8932-df45a7f7b559 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:09.054726 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 236/453] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:33:08 2022] GET /identity/v3/projects/0a83b0c5040146dc9a4ba09b4fd4dfe7 => generated 344 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:33:09.060466 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c6778-8921-4b4c-a8bb-36228bd89d02 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:09.188113 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c6778-8921-4b4c-a8bb-36228bd89d02 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:09.230738 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96edd06e-3134-464a-9872-bb1590f03024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:09.231737 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edd06e-3134-464a-9872-bb1590f03024 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:09.232079 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edd06e-3134-464a-9872-bb1590f03024 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:09.232420 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edd06e-3134-464a-9872-bb1590f03024 None admin] PATH_INFO: `/v3/groups/80d71fe4181d413392e4b1e64a8fe69f` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:09.233921 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96edd06e-3134-464a-9872-bb1590f03024 None admin] RBAC: Authorizing `identity:get_group(group_id=80d71fe4181d413392e4b1e64a8fe69f)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:09.236449 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96edd06e-3134-464a-9872-bb1590f03024 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:09.238718 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 218/454] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:33:09 2022] GET /identity/v3/groups/80d71fe4181d413392e4b1e64a8fe69f => generated 229 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:09.245274 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75c123-05f6-4458-8932-df45a7f7b559 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:09.359438 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75c123-05f6-4458-8932-df45a7f7b559 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:09.406170 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143045d7-4cb6-40d4-ba48-c3251ec139b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:09.408305 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143045d7-4cb6-40d4-ba48-c3251ec139b2 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:09.408909 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143045d7-4cb6-40d4-ba48-c3251ec139b2 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:09.409469 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143045d7-4cb6-40d4-ba48-c3251ec139b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:09.411137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143045d7-4cb6-40d4-ba48-c3251ec139b2 None admin] RBAC: Adding query filter params (group.id=80d71fe4181d413392e4b1e64a8fe69f, role.id=a5cb8d37261d486cbc1b06d167a9c05c, scope.project.id=0a83b0c5040146dc9a4ba09b4fd4dfe7) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:09.411527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143045d7-4cb6-40d4-ba48-c3251ec139b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:09.413827 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143045d7-4cb6-40d4-ba48-c3251ec139b2 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:09.422650 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 237/455] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:33:09 2022] GET /identity/v3/role_assignments?group.id=80d71fe4181d413392e4b1e64a8fe69f&scope.project.id=0a83b0c5040146dc9a4ba09b4fd4dfe7&role.id=a5cb8d37261d486cbc1b06d167a9c05c => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:12.468860 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaefb59-d0b2-4c48-9b56-d331e01239f2 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:12.470150 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaefb59-d0b2-4c48-9b56-d331e01239f2 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:12.470834 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaefb59-d0b2-4c48-9b56-d331e01239f2 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:12.473128 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 219/456] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:12.480121 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ab216-8d3c-440d-bb94-bc631e697e2a None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:12.481151 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ab216-8d3c-440d-bb94-bc631e697e2a None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:12.481692 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ab216-8d3c-440d-bb94-bc631e697e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:12.510594 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-b14ab216-8d3c-440d-bb94-bc631e697e2a None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:12.512248 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-b14ab216-8d3c-440d-bb94-bc631e697e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:12.619697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 238/457] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:33:12.665071 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaefb59-d0b2-4c48-9b56-d331e01239f2 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:12.817113 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119dde3-a699-4b15-bac0-6d3a15be7a03 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:12.817844 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119dde3-a699-4b15-bac0-6d3a15be7a03 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:12.818380 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119dde3-a699-4b15-bac0-6d3a15be7a03 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:12.820341 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 239/458] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:12.826087 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14a501-595b-420c-a25c-060cd7ac81e4 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:12.826709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14a501-595b-420c-a25c-060cd7ac81e4 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:12.827204 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14a501-595b-420c-a25c-060cd7ac81e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:12.846084 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-2b14a501-595b-420c-a25c-060cd7ac81e4 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:12.847918 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-2b14a501-595b-420c-a25c-060cd7ac81e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:12.868477 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaefb59-d0b2-4c48-9b56-d331e01239f2 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:12.946778 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54aefd-eec4-4dd2-9c97-686ed40cf701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:12.948048 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54aefd-eec4-4dd2-9c97-686ed40cf701 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:12.948582 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54aefd-eec4-4dd2-9c97-686ed40cf701 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:12.949093 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54aefd-eec4-4dd2-9c97-686ed40cf701 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:12.964851 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54aefd-eec4-4dd2-9c97-686ed40cf701 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:12.966952 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54aefd-eec4-4dd2-9c97-686ed40cf701 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:12.988368 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-db54aefd-eec4-4dd2-9c97-686ed40cf701 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:12.988368 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:12.988368 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:12.988368 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:12.988368 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:12.988368 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:12.988368 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:12.988368 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:12.988368 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:12.988368 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:12.988368 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:12.988368 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:12.988368 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:12.988368 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:12.988368 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:12.989540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:12.989540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:12.989540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:12.989540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:12.989540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:12.989540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:12.989540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:12.989540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:12.989540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:12.989540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:12.989540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:12.989540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:12.989540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:12.989540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:12.989540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:12.989540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:12.989540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:12.990513 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:12.990513 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:12.990513 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:12.990513 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:12.990786 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 240/459] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:33:12.997966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 220/460] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:33:13.004898 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14a501-595b-420c-a25c-060cd7ac81e4 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:13.026521 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54aefd-eec4-4dd2-9c97-686ed40cf701 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:13.182763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54aefd-eec4-4dd2-9c97-686ed40cf701 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:13.222512 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6d27e-c8fc-44e8-844c-3061961ce973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:13.223844 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6d27e-c8fc-44e8-844c-3061961ce973 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:13.224362 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6d27e-c8fc-44e8-844c-3061961ce973 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:13.224794 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6d27e-c8fc-44e8-844c-3061961ce973 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:13.239344 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6d27e-c8fc-44e8-844c-3061961ce973 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:13.240901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14a501-595b-420c-a25c-060cd7ac81e4 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:13.241339 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6d27e-c8fc-44e8-844c-3061961ce973 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:13.262110 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-5fa6d27e-c8fc-44e8-844c-3061961ce973 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:13.262110 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:13.262110 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:13.262110 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:13.262110 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:13.262110 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:13.262110 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:13.262110 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:13.262110 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:13.262110 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:13.262110 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:13.262110 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:13.262110 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:13.262110 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:13.262110 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:13.263349 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:13.263349 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:13.263349 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:13.263349 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:13.263349 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:13.263349 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:13.263349 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:13.263349 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:13.263349 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:13.263349 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:13.263349 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:13.263349 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:13.263349 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:13.263349 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:13.263349 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:13.263349 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:13.263349 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:13.264336 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:13.264336 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:13.264336 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:13.264336 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:13.264336 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 221/461] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:33:13.264918 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243abf06-f298-4098-85b6-43e1dcf039bf None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:13.265202 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243abf06-f298-4098-85b6-43e1dcf039bf None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:13.265570 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243abf06-f298-4098-85b6-43e1dcf039bf None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:13.267078 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 222/462] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:13.268029 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd36c8-2d6b-4e1e-8c11-223c8a14d700 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:13.268315 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd36c8-2d6b-4e1e-8c11-223c8a14d700 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:13.268660 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd36c8-2d6b-4e1e-8c11-223c8a14d700 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:13.270227 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 223/463] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:13.274476 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1b617-ef91-4165-89ec-9564258a902d None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:13.274833 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1b617-ef91-4165-89ec-9564258a902d None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:13.275156 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1b617-ef91-4165-89ec-9564258a902d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:13.291234 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f3298-fbe2-463b-aeda-ed89a1feb486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:13.291916 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f3298-fbe2-463b-aeda-ed89a1feb486 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:13.292202 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f3298-fbe2-463b-aeda-ed89a1feb486 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:13.292482 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f3298-fbe2-463b-aeda-ed89a1feb486 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:13.293215 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f3298-fbe2-463b-aeda-ed89a1feb486 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:13.293555 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f3298-fbe2-463b-aeda-ed89a1feb486 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:13.294950 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f3298-fbe2-463b-aeda-ed89a1feb486 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:13.295185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-44b1b617-ef91-4165-89ec-9564258a902d None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:13.296565 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-44b1b617-ef91-4165-89ec-9564258a902d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:13.314049 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 241/464] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:13.314049 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f3298-fbe2-463b-aeda-ed89a1feb486 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:13.376255 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 224/465] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:33:13.377586 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a472f94-e5e4-4e7e-a5d2-664b2e5d70e5 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:13.377879 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a472f94-e5e4-4e7e-a5d2-664b2e5d70e5 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:13.378174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a472f94-e5e4-4e7e-a5d2-664b2e5d70e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:13.398282 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-4a472f94-e5e4-4e7e-a5d2-664b2e5d70e5 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:13.400199 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-4a472f94-e5e4-4e7e-a5d2-664b2e5d70e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:13.448934 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f3298-fbe2-463b-aeda-ed89a1feb486 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:13.491380 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873d8ec-7dfe-4c59-bf91-b2ac86118e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:13.492099 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873d8ec-7dfe-4c59-bf91-b2ac86118e8a None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:13.492272 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 225/466] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:33:13.493193 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873d8ec-7dfe-4c59-bf91-b2ac86118e8a None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:13.493193 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873d8ec-7dfe-4c59-bf91-b2ac86118e8a None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:13.493842 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873d8ec-7dfe-4c59-bf91-b2ac86118e8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:13.493983 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873d8ec-7dfe-4c59-bf91-b2ac86118e8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:13.495636 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873d8ec-7dfe-4c59-bf91-b2ac86118e8a None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:13.498858 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a472f94-e5e4-4e7e-a5d2-664b2e5d70e5 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:13.522457 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 242/467] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:13.523947 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873d8ec-7dfe-4c59-bf91-b2ac86118e8a None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:13.653062 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a472f94-e5e4-4e7e-a5d2-664b2e5d70e5 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:13.661481 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873d8ec-7dfe-4c59-bf91-b2ac86118e8a None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:13.696773 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fff0b6-e0ce-4d4a-9f2d-d0acb6e5102d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:13.697507 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fff0b6-e0ce-4d4a-9f2d-d0acb6e5102d None admin] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:13.697822 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fff0b6-e0ce-4d4a-9f2d-d0acb6e5102d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:13.698106 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fff0b6-e0ce-4d4a-9f2d-d0acb6e5102d None admin] PATH_INFO: `/v3/users` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:13.699001 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fff0b6-e0ce-4d4a-9f2d-d0acb6e5102d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:13.700648 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fff0b6-e0ce-4d4a-9f2d-d0acb6e5102d None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:13.708862 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f2537-9474-4701-9a1f-bdab31b0c5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:13.710493 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f2537-9474-4701-9a1f-bdab31b0c5cc None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:13.711065 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f2537-9474-4701-9a1f-bdab31b0c5cc None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:13.711838 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f2537-9474-4701-9a1f-bdab31b0c5cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:13.728839 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f2537-9474-4701-9a1f-bdab31b0c5cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:13.731674 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f2537-9474-4701-9a1f-bdab31b0c5cc None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:13.735956 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 226/468] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:33:13 2022] POST /identity/v3/users => generated 246 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:33:13.735956 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fff0b6-e0ce-4d4a-9f2d-d0acb6e5102d None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:13.756190 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-ec9f2537-9474-4701-9a1f-bdab31b0c5cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:13.756190 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:13.756190 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:13.756190 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:13.756190 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:13.756190 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:13.756190 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:13.756190 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:13.756190 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:13.756190 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:13.756190 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:13.756190 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:13.756190 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:13.756190 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:13.756190 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:13.757294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:13.757294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:13.757294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:13.757294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:13.757294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:13.757294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:13.757294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:13.757294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:13.757294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:13.757294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:13.757294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:13.757294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:13.757294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:13.757294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:13.757294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:13.757294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:13.757294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:13.758329 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:13.758329 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:13.758329 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:13.758329 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:13.765625 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 243/469] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:13.767039 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f2537-9474-4701-9a1f-bdab31b0c5cc None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:13.885516 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f2537-9474-4701-9a1f-bdab31b0c5cc None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:13.887803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fff0b6-e0ce-4d4a-9f2d-d0acb6e5102d None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:13.927201 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11765e22-1f80-49cf-93cd-4d30fa5ef7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:13.928288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11765e22-1f80-49cf-93cd-4d30fa5ef7c7 None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:13.928767 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11765e22-1f80-49cf-93cd-4d30fa5ef7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:13.929310 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11765e22-1f80-49cf-93cd-4d30fa5ef7c7 None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:13.930295 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11765e22-1f80-49cf-93cd-4d30fa5ef7c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:13.932018 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11765e22-1f80-49cf-93cd-4d30fa5ef7c7 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:13.951533 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67233f-6e3a-4a77-af7e-a6dc16b5efb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:13.952442 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67233f-6e3a-4a77-af7e-a6dc16b5efb2 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:13.952843 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67233f-6e3a-4a77-af7e-a6dc16b5efb2 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:13.953279 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67233f-6e3a-4a77-af7e-a6dc16b5efb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:13.956931 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 244/470] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:33:13 2022] POST /identity/v3/users => generated 248 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:33:13.958103 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11765e22-1f80-49cf-93cd-4d30fa5ef7c7 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:13.980688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67233f-6e3a-4a77-af7e-a6dc16b5efb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:13.982408 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67233f-6e3a-4a77-af7e-a6dc16b5efb2 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:14.007247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-1d67233f-6e3a-4a77-af7e-a6dc16b5efb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:14.007247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:14.007247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:14.007247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:14.007247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:14.007247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:14.007247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:14.007247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:14.007247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:14.007247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:14.007247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:14.007247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:14.007247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:14.007247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:14.007247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:14.008693 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:14.008693 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:14.008693 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:14.008693 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:14.008693 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:14.008693 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:14.008693 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:14.008693 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:14.008693 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:14.008693 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:14.008693 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:14.008693 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:14.008693 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:14.008693 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:14.008693 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:14.008693 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:14.008693 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:14.009893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:14.009893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:14.009893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:14.009893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:14.009893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 227/471] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:14.018853 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67233f-6e3a-4a77-af7e-a6dc16b5efb2 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:14.109183 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11765e22-1f80-49cf-93cd-4d30fa5ef7c7 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:14.162071 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2c06e-f9cb-4aab-9f08-d81c07345d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:14.163686 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2c06e-f9cb-4aab-9f08-d81c07345d3b None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:14.164384 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2c06e-f9cb-4aab-9f08-d81c07345d3b None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:14.164800 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67233f-6e3a-4a77-af7e-a6dc16b5efb2 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:14.165547 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2c06e-f9cb-4aab-9f08-d81c07345d3b None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:14.168702 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2c06e-f9cb-4aab-9f08-d81c07345d3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:14.169576 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2c06e-f9cb-4aab-9f08-d81c07345d3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:14.171418 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2c06e-f9cb-4aab-9f08-d81c07345d3b None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:14.189000 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 245/472] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:14.190973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee22cc-705a-49b6-96e8-a5eb3ef16338 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:14.191268 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee22cc-705a-49b6-96e8-a5eb3ef16338 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:14.191554 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee22cc-705a-49b6-96e8-a5eb3ef16338 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:14.193254 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 246/473] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:14.198611 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee22cc-705a-49b6-96e8-a5eb3ef16338 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:14.228272 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf2fd6-3fc6-4f14-a778-3ec2bf41cc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:14.229005 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf2fd6-3fc6-4f14-a778-3ec2bf41cc65 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:14.229319 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf2fd6-3fc6-4f14-a778-3ec2bf41cc65 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:14.229658 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf2fd6-3fc6-4f14-a778-3ec2bf41cc65 None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:14.230556 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf2fd6-3fc6-4f14-a778-3ec2bf41cc65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:14.231003 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf2fd6-3fc6-4f14-a778-3ec2bf41cc65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:14.232461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf2fd6-3fc6-4f14-a778-3ec2bf41cc65 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:14.262466 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 228/474] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:33:14.264267 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db4802-9edf-4f68-96f7-ab491a172d9f None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:14.264682 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db4802-9edf-4f68-96f7-ab491a172d9f None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:14.265078 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db4802-9edf-4f68-96f7-ab491a172d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:14.287153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-26db4802-9edf-4f68-96f7-ab491a172d9f None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:14.288412 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-26db4802-9edf-4f68-96f7-ab491a172d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:14.362112 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee22cc-705a-49b6-96e8-a5eb3ef16338 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:14.421953 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 229/475] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:33:14.423667 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db4802-9edf-4f68-96f7-ab491a172d9f None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:14.432145 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd59209-970a-45a7-8122-5c9ced72f7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:14.433262 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd59209-970a-45a7-8122-5c9ced72f7bf None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:14.433765 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd59209-970a-45a7-8122-5c9ced72f7bf None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:14.434229 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd59209-970a-45a7-8122-5c9ced72f7bf None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:14.435483 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd59209-970a-45a7-8122-5c9ced72f7bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:14.438124 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd59209-970a-45a7-8122-5c9ced72f7bf None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:14.498718 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 247/476] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:33:14 2022] POST /identity/v3/users => generated 248 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:33:14.505100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd59209-970a-45a7-8122-5c9ced72f7bf None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:14.666621 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db4802-9edf-4f68-96f7-ab491a172d9f None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:14.701604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd59209-970a-45a7-8122-5c9ced72f7bf None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:14.736214 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000c59f-444e-44bd-997d-bb2a79a768f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:14.737341 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000c59f-444e-44bd-997d-bb2a79a768f7 None admin] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:14.737918 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000c59f-444e-44bd-997d-bb2a79a768f7 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:14.738408 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000c59f-444e-44bd-997d-bb2a79a768f7 None admin] PATH_INFO: `/v3/users` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:14.739899 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000c59f-444e-44bd-997d-bb2a79a768f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:14.742966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000c59f-444e-44bd-997d-bb2a79a768f7 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:14.765618 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6771dc-09fc-4696-8b7e-1f01297e51ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:14.766673 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6771dc-09fc-4696-8b7e-1f01297e51ea None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:14.767143 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6771dc-09fc-4696-8b7e-1f01297e51ea None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:14.767601 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6771dc-09fc-4696-8b7e-1f01297e51ea None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:14.768897 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6771dc-09fc-4696-8b7e-1f01297e51ea None admin] RBAC: Authorizing `identity:create_role()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:14.771345 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6771dc-09fc-4696-8b7e-1f01297e51ea None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:14.781880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.sql.core [None req-5b6771dc-09fc-4696-8b7e-1f01297e51ea None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 15:33:14.781880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 09 15:33:14.781880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [parameters: {'id': '23807cf679aa49f4a3be2397c4f9c18d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 09 15:33:14.781880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=212999) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 15:33:14.805050 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 230/477] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:33:14 2022] POST /identity/v3/users => generated 249 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:33:14.815101 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-5b6771dc-09fc-4696-8b7e-1f01297e51ea None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 09 15:33:14.815101 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:14.815101 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:33:14.815101 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:33:14.815101 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:33:14.815101 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:33:14.815101 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:33:14.815101 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:33:14.815101 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:33:14.815101 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application conn.query(q) May 09 15:33:14.815101 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:33:14.815101 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:33:14.815101 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:33:14.815101 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application result.read() May 09 15:33:14.815101 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:33:14.816199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:33:14.816199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:33:14.816199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:33:14.816199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:33:14.816199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:33:14.816199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:33:14.816199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:33:14.816199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 15:33:14.816199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:14.816199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 15:33:14.816199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:14.816199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:14.816199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 15:33:14.816199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 15:33:14.816199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 09 15:33:14.816199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return ref.to_dict() May 09 15:33:14.816199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:33:14.816199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application next(self.gen) May 09 15:33:14.817267 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 15:33:14.817267 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application yield resource May 09 15:33:14.817267 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:33:14.817267 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application next(self.gen) May 09 15:33:14.817267 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 15:33:14.817267 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self.session.rollback() May 09 15:33:14.817267 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 15:33:14.817267 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self.force_reraise() May 09 15:33:14.817267 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 15:33:14.817267 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise self.value May 09 15:33:14.817267 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 15:33:14.817267 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 15:33:14.817267 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 15:33:14.817267 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application session.commit() May 09 15:33:14.817267 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 15:33:14.817267 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 15:33:14.817267 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 15:33:14.819707 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._prepare_impl() May 09 15:33:14.819707 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 15:33:14.819707 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self.session.flush() May 09 15:33:14.819707 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 15:33:14.819707 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._flush(objects) May 09 15:33:14.819707 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 15:33:14.819707 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 15:33:14.819707 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 15:33:14.819707 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application compat.raise_( May 09 15:33:14.819707 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:33:14.819707 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception May 09 15:33:14.819707 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 15:33:14.819707 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application flush_context.execute() May 09 15:33:14.819707 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 15:33:14.819707 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rec.execute(self) May 09 15:33:14.819707 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 15:33:14.819707 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 15:33:14.822055 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 15:33:14.822055 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 15:33:14.822055 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 09 15:33:14.822055 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application c = connection._execute_20( May 09 15:33:14.822055 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 15:33:14.822055 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 15:33:14.822055 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 15:33:14.822055 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 15:33:14.822055 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 15:33:14.822055 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 15:33:14.822055 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 15:33:14.822055 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 15:33:14.822055 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 15:33:14.822055 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 15:33:14.822055 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:33:14.822055 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception May 09 15:33:14.824168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:33:14.824168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:33:14.824168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:33:14.824168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:33:14.824168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:33:14.824168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:33:14.824168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:33:14.824168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application conn.query(q) May 09 15:33:14.824168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:33:14.824168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:33:14.824168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:33:14.824168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application result.read() May 09 15:33:14.824168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:33:14.824168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:33:14.824168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:33:14.824168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:33:14.831013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:33:14.831013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:33:14.831013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:33:14.831013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:33:14.831013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 15:33:14.831013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 09 15:33:14.831013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [parameters: {'id': '23807cf679aa49f4a3be2397c4f9c18d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 09 15:33:14.831013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 15:33:14.831013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:14.831013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:33:14.831013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:14.831013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:14.831013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:14.831013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:14.831013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:14.831013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:14.833329 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:14.833329 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:14.833329 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:14.833329 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:14.833329 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:14.833329 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:14.833329 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 09 15:33:14.833329 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 09 15:33:14.833329 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:14.833329 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:14.833329 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 09 15:33:14.833329 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 09 15:33:14.833329 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 15:33:14.833329 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 15:33:14.833329 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 09 15:33:14.833329 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:14.835548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 248/478] 10.222.0.48 () {60 vars in 1131 bytes} [Mon May 9 15:33:14 2022] POST /identity/v3/roles => generated 144 bytes in 314 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 09 15:33:14.835728 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000c59f-444e-44bd-997d-bb2a79a768f7 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:15.037948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000c59f-444e-44bd-997d-bb2a79a768f7 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:15.081198 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05f1b1-11b4-4c74-8513-11a8cd7ea59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:15.082119 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05f1b1-11b4-4c74-8513-11a8cd7ea59a None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:15.082410 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05f1b1-11b4-4c74-8513-11a8cd7ea59a None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:15.082691 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05f1b1-11b4-4c74-8513-11a8cd7ea59a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:15.097248 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05f1b1-11b4-4c74-8513-11a8cd7ea59a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:15.105913 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-af05f1b1-11b4-4c74-8513-11a8cd7ea59a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:33:15.105913 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:15.105913 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:15.105913 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:15.105913 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:15.105913 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:15.105913 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:15.105913 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:15.105913 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:15.105913 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:15.105913 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:15.105913 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:15.105913 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:15.105913 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:15.105913 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:15.105913 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:15.107340 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:15.107340 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:15.107340 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:15.107340 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:15.107340 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:15.107340 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:15.107340 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:15.107340 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:15.107340 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:15.107340 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:15.107340 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:15.107340 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:15.107340 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:15.107340 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:15.107340 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:15.107340 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:15.108460 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:15.108460 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:15.108460 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:15.108460 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:15.108460 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:15.108460 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:15.108460 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:15.108460 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:15.108460 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:15.108460 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:15.108460 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:33:15.108460 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:15.108460 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 231/479] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:33:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:15.113799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6771dc-09fc-4696-8b7e-1f01297e51ea None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:15.306298 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6771dc-09fc-4696-8b7e-1f01297e51ea None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:15.390651 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bc75b-4efb-42e0-a6e2-de12f8a549cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:15.392888 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bc75b-4efb-42e0-a6e2-de12f8a549cf None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:15.393755 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bc75b-4efb-42e0-a6e2-de12f8a549cf None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:15.394585 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bc75b-4efb-42e0-a6e2-de12f8a549cf None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:15.396264 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bc75b-4efb-42e0-a6e2-de12f8a549cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:15.402279 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bc75b-4efb-42e0-a6e2-de12f8a549cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:15.405451 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bc75b-4efb-42e0-a6e2-de12f8a549cf None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:15.425280 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 249/480] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:17.003155 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b86a0a-f1ed-4bac-b269-cdb5b2aa89b1 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:17.003950 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b86a0a-f1ed-4bac-b269-cdb5b2aa89b1 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:17.003950 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b86a0a-f1ed-4bac-b269-cdb5b2aa89b1 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:17.005452 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 232/481] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:17.024669 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c631c-61e3-48bd-a150-c877b80a14df None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:17.025442 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c631c-61e3-48bd-a150-c877b80a14df None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:17.025442 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c631c-61e3-48bd-a150-c877b80a14df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:17.046660 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-5f8c631c-61e3-48bd-a150-c877b80a14df None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:17.048686 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-5f8c631c-61e3-48bd-a150-c877b80a14df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:17.111526 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8d46d-2c2a-4736-a296-8028579a141c None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:17.112189 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8d46d-2c2a-4736-a296-8028579a141c None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:17.112696 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8d46d-2c2a-4736-a296-8028579a141c None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:17.115853 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 233/482] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:17.121713 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742c9f0-bbd2-46cf-a3fc-2498bea555c7 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:17.122404 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742c9f0-bbd2-46cf-a3fc-2498bea555c7 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:17.123004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742c9f0-bbd2-46cf-a3fc-2498bea555c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:17.148448 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 250/483] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:33:17.161082 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-f742c9f0-bbd2-46cf-a3fc-2498bea555c7 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:17.162945 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-f742c9f0-bbd2-46cf-a3fc-2498bea555c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:17.198814 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c631c-61e3-48bd-a150-c877b80a14df None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:17.263946 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 234/484] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:33:17.306670 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742c9f0-bbd2-46cf-a3fc-2498bea555c7 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:17.354861 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c631c-61e3-48bd-a150-c877b80a14df None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:17.401900 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b874cfa-cc6b-4a6c-aeb5-1527aa9defaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:17.402722 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b874cfa-cc6b-4a6c-aeb5-1527aa9defaa None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:17.403005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b874cfa-cc6b-4a6c-aeb5-1527aa9defaa None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:17.403768 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b874cfa-cc6b-4a6c-aeb5-1527aa9defaa None admin] PATH_INFO: `/v3/roles/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:17.417612 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b874cfa-cc6b-4a6c-aeb5-1527aa9defaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:17.427437 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-7b874cfa-cc6b-4a6c-aeb5-1527aa9defaa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:17.427437 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:17.427437 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:17.427437 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:17.427437 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:17.427437 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:17.427437 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:17.427437 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:17.427437 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:17.427437 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:17.427437 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:17.427437 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:17.427437 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:17.427437 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:17.427437 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:17.427437 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:17.428733 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:17.428733 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:17.428733 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:17.428733 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:17.428733 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:17.428733 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:17.428733 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:17.428733 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:17.428733 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:17.428733 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:17.428733 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:17.428733 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:17.428733 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:17.428733 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:17.428733 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:17.428733 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:17.429692 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:17.429692 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:17.429692 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:17.429692 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:17.429692 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:17.429692 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:17.429692 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:17.429692 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:17.429692 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:17.429692 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:17.429692 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:17.429692 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:17.432007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 251/485] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:33:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:17.436792 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b874cfa-cc6b-4a6c-aeb5-1527aa9defaa None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:17.567967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b874cfa-cc6b-4a6c-aeb5-1527aa9defaa None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:17.580443 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742c9f0-bbd2-46cf-a3fc-2498bea555c7 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:17.612331 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465295c-9c28-4cf1-b51c-54376a2b002e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:17.613063 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465295c-9c28-4cf1-b51c-54376a2b002e None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:17.613345 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465295c-9c28-4cf1-b51c-54376a2b002e None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:17.613654 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465295c-9c28-4cf1-b51c-54376a2b002e None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:17.614460 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465295c-9c28-4cf1-b51c-54376a2b002e None admin] RBAC: Adding query filter params (name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:17.615328 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465295c-9c28-4cf1-b51c-54376a2b002e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:17.617009 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465295c-9c28-4cf1-b51c-54376a2b002e None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:17.628338 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 252/486] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:33:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:17.634016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465295c-9c28-4cf1-b51c-54376a2b002e None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:17.648492 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3a5f9-f6e2-4cb6-997a-063258c6afcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:17.649319 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3a5f9-f6e2-4cb6-997a-063258c6afcc None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:17.649654 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3a5f9-f6e2-4cb6-997a-063258c6afcc None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:17.653399 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3a5f9-f6e2-4cb6-997a-063258c6afcc None admin] PATH_INFO: `/v3/roles/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:17.675117 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3a5f9-f6e2-4cb6-997a-063258c6afcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:17.683159 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-c4d3a5f9-f6e2-4cb6-997a-063258c6afcc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:17.683159 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:17.683159 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:17.683159 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:17.683159 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:17.683159 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:17.683159 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:17.683159 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:17.683159 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:17.683159 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:17.683159 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:17.683159 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:17.683159 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:17.683159 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:17.683159 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:17.683159 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:17.684223 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:17.684223 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:17.684223 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:17.684223 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:17.684223 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:17.684223 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:17.684223 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:17.684223 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:17.684223 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:17.684223 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:17.684223 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:17.684223 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:17.684223 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:17.684223 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:17.684223 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:17.684223 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:17.685128 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:17.685128 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:17.685128 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:17.685128 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:17.685128 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:17.685128 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:17.685128 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:17.685128 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:17.685128 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:17.685128 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:17.685128 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:17.685128 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:17.689172 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 235/487] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:33:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:17.697318 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3a5f9-f6e2-4cb6-997a-063258c6afcc None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:17.784220 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465295c-9c28-4cf1-b51c-54376a2b002e None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:17.807962 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3a5f9-f6e2-4cb6-997a-063258c6afcc None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:17.832103 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70e6a3-308c-4b9b-a5a9-5bd61912c60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:17.832902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70e6a3-308c-4b9b-a5a9-5bd61912c60a None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:17.833187 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70e6a3-308c-4b9b-a5a9-5bd61912c60a None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:17.833522 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70e6a3-308c-4b9b-a5a9-5bd61912c60a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:17.847839 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0daa647-7840-442e-ba92-809e004b6156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:17.848925 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daa647-7840-442e-ba92-809e004b6156 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:17.849458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daa647-7840-442e-ba92-809e004b6156 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:17.849978 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daa647-7840-442e-ba92-809e004b6156 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:17.850963 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0daa647-7840-442e-ba92-809e004b6156 None admin] RBAC: Adding query filter params (name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:17.851502 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0daa647-7840-442e-ba92-809e004b6156 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:17.853197 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0daa647-7840-442e-ba92-809e004b6156 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:17.858254 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70e6a3-308c-4b9b-a5a9-5bd61912c60a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:17.859783 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70e6a3-308c-4b9b-a5a9-5bd61912c60a None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:17.864009 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 236/488] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:33:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:33:17.874514 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0daa647-7840-442e-ba92-809e004b6156 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:17.885563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-6c70e6a3-308c-4b9b-a5a9-5bd61912c60a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:17.885563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:17.885563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:17.885563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:17.885563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:17.885563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:17.885563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:17.885563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:17.885563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:17.885563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:17.885563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:17.885563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:17.885563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:17.885563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:17.885563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:17.886644 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:17.886644 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:17.886644 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:17.886644 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:17.886644 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:17.886644 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:17.886644 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:17.886644 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:17.886644 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:17.886644 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:17.886644 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:17.886644 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:17.886644 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:17.886644 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:17.886644 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:17.886644 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:17.886644 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:17.887616 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:17.887616 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:17.887616 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:17.887616 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:17.890032 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 253/489] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:33:17.902486 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70e6a3-308c-4b9b-a5a9-5bd61912c60a None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:18.065168 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0daa647-7840-442e-ba92-809e004b6156 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:18.098363 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70e6a3-308c-4b9b-a5a9-5bd61912c60a None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:18.133920 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afa078-5c96-4134-8fb5-27df61647ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:18.134989 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afa078-5c96-4134-8fb5-27df61647ef5 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:18.135325 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afa078-5c96-4134-8fb5-27df61647ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:18.135664 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afa078-5c96-4134-8fb5-27df61647ef5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:18.151033 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afa078-5c96-4134-8fb5-27df61647ef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:18.153160 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afa078-5c96-4134-8fb5-27df61647ef5 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:18.155471 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea7f26-90af-4103-8fcc-6f9faf3761a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:18.156823 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea7f26-90af-4103-8fcc-6f9faf3761a0 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:18.158559 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea7f26-90af-4103-8fcc-6f9faf3761a0 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:18.159150 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea7f26-90af-4103-8fcc-6f9faf3761a0 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:18.160243 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea7f26-90af-4103-8fcc-6f9faf3761a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:18.160778 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea7f26-90af-4103-8fcc-6f9faf3761a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:18.162865 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea7f26-90af-4103-8fcc-6f9faf3761a0 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:18.179160 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 254/490] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:18.180776 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-79afa078-5c96-4134-8fb5-27df61647ef5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:18.180776 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:18.180776 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:18.180776 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:18.180776 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:18.180776 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:18.180776 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:18.180776 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:18.180776 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:18.180776 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:18.180776 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:18.180776 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:18.180776 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:18.180776 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:18.180776 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:18.181835 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:18.181835 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:18.181835 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:18.181835 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:18.181835 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:18.181835 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:18.181835 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:18.181835 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:18.181835 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:18.181835 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:18.181835 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:18.181835 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:18.181835 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:18.181835 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:18.181835 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:18.181835 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:18.181835 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:18.182815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:18.182815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:18.182815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:18.182815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:18.185510 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c0b4a-d8d0-48e8-945f-be88ba9b1f3b None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:18.185890 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 237/491] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:18.186218 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c0b4a-d8d0-48e8-945f-be88ba9b1f3b None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:18.186741 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c0b4a-d8d0-48e8-945f-be88ba9b1f3b None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:18.187228 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afa078-5c96-4134-8fb5-27df61647ef5 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:18.188982 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 255/492] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:18.195903 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c0b4a-d8d0-48e8-945f-be88ba9b1f3b None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:18.338322 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c0b4a-d8d0-48e8-945f-be88ba9b1f3b None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:18.367388 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afa078-5c96-4134-8fb5-27df61647ef5 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:18.378333 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e401fb1-4c9a-4cca-982a-349c41b61c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:18.379764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e401fb1-4c9a-4cca-982a-349c41b61c94 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:18.380346 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e401fb1-4c9a-4cca-982a-349c41b61c94 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:18.380986 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e401fb1-4c9a-4cca-982a-349c41b61c94 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:18.382497 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e401fb1-4c9a-4cca-982a-349c41b61c94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:18.383181 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e401fb1-4c9a-4cca-982a-349c41b61c94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:18.385085 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e401fb1-4c9a-4cca-982a-349c41b61c94 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:18.402586 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 256/493] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:18.405066 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3de010-28f2-4a0c-aca4-a7c2a65c4255 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:18.405687 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3de010-28f2-4a0c-aca4-a7c2a65c4255 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:18.406206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3de010-28f2-4a0c-aca4-a7c2a65c4255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:18.407626 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ad955-93be-4b35-b918-6b09e28d9dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:18.408564 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ad955-93be-4b35-b918-6b09e28d9dac None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:18.408939 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ad955-93be-4b35-b918-6b09e28d9dac None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:18.409637 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ad955-93be-4b35-b918-6b09e28d9dac None admin] PATH_INFO: `/v3/users/nova` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:18.418769 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ad955-93be-4b35-b918-6b09e28d9dac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:18.420635 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ad955-93be-4b35-b918-6b09e28d9dac None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:18.428004 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-df3de010-28f2-4a0c-aca4-a7c2a65c4255 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:18.430291 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-df3de010-28f2-4a0c-aca4-a7c2a65c4255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:18.442344 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-400ad955-93be-4b35-b918-6b09e28d9dac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:33:18.442344 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:18.442344 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:18.442344 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:18.442344 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:18.442344 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:18.442344 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:18.442344 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:18.442344 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:18.442344 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:18.442344 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:18.442344 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:18.442344 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:33:18.442344 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:33:18.442344 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:33:18.442344 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:33:18.443948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:18.443948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:18.443948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:33:18.443948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:18.443948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:33:18.443948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:18.443948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:18.443948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:18.443948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:18.443948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:18.443948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:18.443948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:18.443948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:18.443948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:18.443948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:18.443948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:18.443948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:18.443948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:18.445387 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:18.445387 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:18.445387 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:33:18.445387 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:33:18.445387 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:33:18.445387 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:33:18.445387 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:33:18.445387 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:33:18.445387 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:33:18.445387 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:18.449713 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 238/494] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:33:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:18.450950 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ad955-93be-4b35-b918-6b09e28d9dac None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:18.544088 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 257/495] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:33:18.545202 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3de010-28f2-4a0c-aca4-a7c2a65c4255 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:18.591420 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ad955-93be-4b35-b918-6b09e28d9dac None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:18.641928 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f902d-1cd6-437b-9e63-ba13845db31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:18.642763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f902d-1cd6-437b-9e63-ba13845db31c None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:18.643040 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f902d-1cd6-437b-9e63-ba13845db31c None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:18.643520 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f902d-1cd6-437b-9e63-ba13845db31c None admin] PATH_INFO: `/v3/users/glance` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:18.651941 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f902d-1cd6-437b-9e63-ba13845db31c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:18.653431 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f902d-1cd6-437b-9e63-ba13845db31c None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:18.663434 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3de010-28f2-4a0c-aca4-a7c2a65c4255 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:18.669359 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-ef3f902d-1cd6-437b-9e63-ba13845db31c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 15:33:18.669359 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:18.669359 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:18.669359 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:18.669359 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:18.669359 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:18.669359 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:18.669359 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:18.669359 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:18.669359 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:18.669359 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:18.669359 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:18.669359 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:33:18.669359 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:33:18.669359 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:33:18.669359 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:33:18.670555 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:18.670555 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:18.670555 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:33:18.670555 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:18.670555 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:33:18.670555 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:18.670555 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:18.670555 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:18.670555 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:18.670555 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:18.670555 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:18.670555 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:18.670555 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:18.670555 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:18.670555 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:18.670555 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:18.670555 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:18.670555 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:18.671592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:18.671592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:18.671592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:33:18.671592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:33:18.671592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:33:18.671592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:33:18.671592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:33:18.671592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:33:18.671592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 15:33:18.671592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:18.671592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 239/496] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:33:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:18.672757 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832f76b-e028-4152-a6bf-417812b02b4a None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:18.672757 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832f76b-e028-4152-a6bf-417812b02b4a None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:18.672757 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832f76b-e028-4152-a6bf-417812b02b4a None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:18.675412 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 240/497] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:18.675412 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832f76b-e028-4152-a6bf-417812b02b4a None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:18.707228 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d6e4e-87bb-4a3d-9c7c-c6fcea19316a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:18.707922 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d6e4e-87bb-4a3d-9c7c-c6fcea19316a None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:18.708287 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d6e4e-87bb-4a3d-9c7c-c6fcea19316a None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:18.708570 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d6e4e-87bb-4a3d-9c7c-c6fcea19316a None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:18.709461 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d6e4e-87bb-4a3d-9c7c-c6fcea19316a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:18.709774 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d6e4e-87bb-4a3d-9c7c-c6fcea19316a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:18.711235 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d6e4e-87bb-4a3d-9c7c-c6fcea19316a None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:18.750551 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 258/498] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:33:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:18.752093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbd7f0-c718-4a50-b8d8-928ce6e88a8e None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:18.752391 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbd7f0-c718-4a50-b8d8-928ce6e88a8e None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:18.752662 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbd7f0-c718-4a50-b8d8-928ce6e88a8e None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:18.754194 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 259/499] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:18.754669 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbd7f0-c718-4a50-b8d8-928ce6e88a8e None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:18.797459 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832f76b-e028-4152-a6bf-417812b02b4a None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:18.836564 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f320cfa-fd7e-47f0-af30-11bf0a544c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:18.837383 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f320cfa-fd7e-47f0-af30-11bf0a544c8b None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:18.837681 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f320cfa-fd7e-47f0-af30-11bf0a544c8b None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:18.837957 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f320cfa-fd7e-47f0-af30-11bf0a544c8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:18.851294 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f320cfa-fd7e-47f0-af30-11bf0a544c8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:18.860185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-0f320cfa-fd7e-47f0-af30-11bf0a544c8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:18.860185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:18.860185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:18.860185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:18.860185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:18.860185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:18.860185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:18.860185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:18.860185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:18.860185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:18.860185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:18.860185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:18.860185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:18.860185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:18.860185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:18.860185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:18.861419 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:18.861419 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:18.861419 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:18.861419 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:18.861419 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:18.861419 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:18.861419 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:18.861419 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:18.861419 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:18.861419 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:18.861419 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:18.861419 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:18.861419 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:18.861419 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:18.861419 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:18.861419 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:18.862418 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:18.862418 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:18.862418 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:18.862418 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:18.862418 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:18.862418 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:18.862418 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:18.862418 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:18.862418 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:18.862418 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:18.862418 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:18.862418 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:18.862418 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 241/500] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:33:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:18.863725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0507fd-478c-4041-a7c7-31ed56a244f4 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:18.863975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0507fd-478c-4041-a7c7-31ed56a244f4 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:18.864256 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0507fd-478c-4041-a7c7-31ed56a244f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:18.883115 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-2e0507fd-478c-4041-a7c7-31ed56a244f4 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:18.884324 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-2e0507fd-478c-4041-a7c7-31ed56a244f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:18.891260 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbd7f0-c718-4a50-b8d8-928ce6e88a8e None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:18.936600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1e1fd-3159-453a-9302-2201ce4741b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:18.937692 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1e1fd-3159-453a-9302-2201ce4741b0 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:18.937692 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1e1fd-3159-453a-9302-2201ce4741b0 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:18.937997 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1e1fd-3159-453a-9302-2201ce4741b0 None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:18.938862 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1e1fd-3159-453a-9302-2201ce4741b0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:18.939152 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1e1fd-3159-453a-9302-2201ce4741b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:18.940870 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1e1fd-3159-453a-9302-2201ce4741b0 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:18.961628 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 260/501] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 9 15:33:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:18.962460 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1e1fd-3159-453a-9302-2201ce4741b0 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:18.978331 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 242/502] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:33:18.978331 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66c420-c565-40c4-be46-b087cda53b3e None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:18.978331 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66c420-c565-40c4-be46-b087cda53b3e None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:18.978331 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66c420-c565-40c4-be46-b087cda53b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:18.995071 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-df66c420-c565-40c4-be46-b087cda53b3e None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:18.996341 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-df66c420-c565-40c4-be46-b087cda53b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:19.071869 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 243/503] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:33:19.072547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66c420-c565-40c4-be46-b087cda53b3e None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:19.092024 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1e1fd-3159-453a-9302-2201ce4741b0 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:19.131877 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441514f-c7fe-4b14-902b-7b6558408a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:19.132612 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441514f-c7fe-4b14-902b-7b6558408a95 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:19.132808 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441514f-c7fe-4b14-902b-7b6558408a95 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:19.133093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441514f-c7fe-4b14-902b-7b6558408a95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:19.192691 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66c420-c565-40c4-be46-b087cda53b3e None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:19.210511 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441514f-c7fe-4b14-902b-7b6558408a95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:19.212311 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441514f-c7fe-4b14-902b-7b6558408a95 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:19.240163 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c2f4f-4839-4aaf-95e6-0188015396a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:19.240840 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c2f4f-4839-4aaf-95e6-0188015396a0 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:19.241126 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c2f4f-4839-4aaf-95e6-0188015396a0 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:19.241440 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c2f4f-4839-4aaf-95e6-0188015396a0 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:19.242198 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c2f4f-4839-4aaf-95e6-0188015396a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:19.242508 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c2f4f-4839-4aaf-95e6-0188015396a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:19.243915 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c2f4f-4839-4aaf-95e6-0188015396a0 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:19.253748 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 244/504] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:33:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:19.255932 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c2f4f-4839-4aaf-95e6-0188015396a0 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:19.346786 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 261/505] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:33:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:33:19.348086 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441514f-c7fe-4b14-902b-7b6558408a95 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:19.393775 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c2f4f-4839-4aaf-95e6-0188015396a0 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:19.455427 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd65e6-4747-416c-9bb7-77a580f7d9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:19.455893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd65e6-4747-416c-9bb7-77a580f7d9e3 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:19.456180 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd65e6-4747-416c-9bb7-77a580f7d9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:19.456458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd65e6-4747-416c-9bb7-77a580f7d9e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:19.463973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441514f-c7fe-4b14-902b-7b6558408a95 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:19.500318 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a150fe-2899-4a27-96c2-c029150f1c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:19.501762 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a150fe-2899-4a27-96c2-c029150f1c71 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:19.502049 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a150fe-2899-4a27-96c2-c029150f1c71 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:19.502351 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a150fe-2899-4a27-96c2-c029150f1c71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:19.513941 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a150fe-2899-4a27-96c2-c029150f1c71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:19.522156 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-37a150fe-2899-4a27-96c2-c029150f1c71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:19.522156 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:19.522156 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:19.522156 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:19.522156 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:19.522156 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:19.522156 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:19.522156 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:19.522156 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:19.522156 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:19.522156 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:19.522156 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:19.522156 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:19.522156 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:19.522156 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:19.522156 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:19.523382 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:19.523382 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:19.523382 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:19.523382 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:19.523382 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:19.523382 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:19.523382 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:19.523382 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:19.523382 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:19.523382 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:19.523382 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:19.523382 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:19.523382 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:19.523382 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:19.523382 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:19.523382 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:19.524316 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:19.524316 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:19.524316 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:19.524316 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:19.524316 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:19.524316 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:19.524316 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:19.524316 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:19.524316 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:19.524316 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:19.524316 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:19.524316 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:19.524316 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 262/506] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:33:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:19.524316 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a150fe-2899-4a27-96c2-c029150f1c71 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:19.536754 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd65e6-4747-416c-9bb7-77a580f7d9e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:19.538445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd65e6-4747-416c-9bb7-77a580f7d9e3 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:19.631538 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a150fe-2899-4a27-96c2-c029150f1c71 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:19.643343 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 245/507] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:33:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:33:19.644065 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd65e6-4747-416c-9bb7-77a580f7d9e3 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:19.670289 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52016a11-5869-4de6-8a9b-665374adf740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:19.671093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52016a11-5869-4de6-8a9b-665374adf740 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:19.671378 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52016a11-5869-4de6-8a9b-665374adf740 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:19.671657 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52016a11-5869-4de6-8a9b-665374adf740 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:19.684777 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52016a11-5869-4de6-8a9b-665374adf740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:19.686319 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52016a11-5869-4de6-8a9b-665374adf740 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:19.704466 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-52016a11-5869-4de6-8a9b-665374adf740 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:19.704466 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:19.704466 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:19.704466 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:19.704466 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:19.704466 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:19.704466 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:19.704466 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:19.704466 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:19.704466 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:19.704466 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:19.704466 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:19.704466 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:19.704466 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:19.704466 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:19.705676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:19.705676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:19.705676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:19.705676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:19.705676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:19.705676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:19.705676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:19.705676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:19.705676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:19.705676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:19.705676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:19.705676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:19.705676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:19.705676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:19.705676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:19.705676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:19.705676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:19.707225 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:19.707225 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:19.707225 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:19.707225 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:19.707225 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 263/508] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:19.707607 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52016a11-5869-4de6-8a9b-665374adf740 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:19.760418 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd65e6-4747-416c-9bb7-77a580f7d9e3 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:19.799617 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d6dfc-b42d-46ff-8058-d65fe740c894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:19.800439 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d6dfc-b42d-46ff-8058-d65fe740c894 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:19.800727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d6dfc-b42d-46ff-8058-d65fe740c894 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:19.801004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d6dfc-b42d-46ff-8058-d65fe740c894 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:19.813303 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d6dfc-b42d-46ff-8058-d65fe740c894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:19.814879 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d6dfc-b42d-46ff-8058-d65fe740c894 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:19.833712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-589d6dfc-b42d-46ff-8058-d65fe740c894 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:19.833712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:19.833712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:19.833712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:19.833712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:19.833712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:19.833712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:19.833712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:19.833712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:19.833712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:19.833712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:19.833712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:19.833712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:19.833712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:19.833712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:19.834800 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:19.834800 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:19.834800 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:19.834800 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:19.834800 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:19.834800 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:19.834800 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:19.834800 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:19.834800 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:19.834800 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:19.834800 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:19.834800 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:19.834800 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:19.834800 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:19.834800 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:19.834800 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:19.834800 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:19.835754 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:19.835754 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:19.835754 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:19.835754 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:19.835754 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 246/509] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:19.836055 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52016a11-5869-4de6-8a9b-665374adf740 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:19.836148 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d6dfc-b42d-46ff-8058-d65fe740c894 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:19.870596 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc49959-9333-48cf-9ef9-11c015fa40b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:19.871406 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc49959-9333-48cf-9ef9-11c015fa40b9 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:19.871687 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc49959-9333-48cf-9ef9-11c015fa40b9 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:19.871967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc49959-9333-48cf-9ef9-11c015fa40b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:19.883991 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc49959-9333-48cf-9ef9-11c015fa40b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:19.885541 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc49959-9333-48cf-9ef9-11c015fa40b9 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:19.904782 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-2fc49959-9333-48cf-9ef9-11c015fa40b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:19.904782 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:19.904782 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:19.904782 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:19.904782 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:19.904782 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:19.904782 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:19.904782 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:19.904782 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:19.904782 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:19.904782 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:19.904782 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:19.904782 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:19.904782 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:19.904782 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:19.906053 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:19.906053 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:19.906053 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:19.906053 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:19.906053 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:19.906053 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:19.906053 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:19.906053 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:19.906053 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:19.906053 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:19.906053 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:19.906053 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:19.906053 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:19.906053 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:19.906053 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:19.906053 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:19.906053 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:19.907089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:19.907089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:19.907089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:19.907089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:19.907089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 264/510] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:19.907089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc49959-9333-48cf-9ef9-11c015fa40b9 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:19.944407 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d6dfc-b42d-46ff-8058-d65fe740c894 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:19.982582 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe78daa-3555-412e-b2a1-6bb3e9f29a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:19.983169 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe78daa-3555-412e-b2a1-6bb3e9f29a60 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:19.983455 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe78daa-3555-412e-b2a1-6bb3e9f29a60 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:19.983729 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe78daa-3555-412e-b2a1-6bb3e9f29a60 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:19.984489 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe78daa-3555-412e-b2a1-6bb3e9f29a60 None admin] RBAC: Adding query filter params (name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:19.984799 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe78daa-3555-412e-b2a1-6bb3e9f29a60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:19.986310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe78daa-3555-412e-b2a1-6bb3e9f29a60 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:19.995069 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 247/511] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:33:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:19.995988 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe78daa-3555-412e-b2a1-6bb3e9f29a60 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:20.015646 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc49959-9333-48cf-9ef9-11c015fa40b9 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:20.048848 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09dc62-c2dd-4641-a798-e3054b4be97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:20.049680 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09dc62-c2dd-4641-a798-e3054b4be97a None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:20.049966 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09dc62-c2dd-4641-a798-e3054b4be97a None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:20.050242 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09dc62-c2dd-4641-a798-e3054b4be97a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:20.060763 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09dc62-c2dd-4641-a798-e3054b4be97a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:20.062268 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09dc62-c2dd-4641-a798-e3054b4be97a None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:20.080384 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-6c09dc62-c2dd-4641-a798-e3054b4be97a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:20.080384 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:20.080384 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:20.080384 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:20.080384 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:20.080384 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:20.080384 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:20.080384 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:20.080384 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:20.080384 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:20.080384 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:20.080384 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:20.080384 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:20.080384 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:20.080384 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:20.081583 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:20.081583 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:20.081583 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:20.081583 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:20.081583 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:20.081583 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:20.081583 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:20.081583 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:20.081583 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:20.081583 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:20.081583 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:20.081583 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:20.081583 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:20.081583 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:20.081583 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:20.081583 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:20.081583 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:20.082548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:20.082548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:20.082548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:20.082548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:20.082548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 265/512] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:20.082548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09dc62-c2dd-4641-a798-e3054b4be97a None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:20.100762 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe78daa-3555-412e-b2a1-6bb3e9f29a60 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:20.147991 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e2187-af79-4c86-896b-93efb270783b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:20.148665 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e2187-af79-4c86-896b-93efb270783b None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:20.148948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e2187-af79-4c86-896b-93efb270783b None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:20.149222 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e2187-af79-4c86-896b-93efb270783b None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:20.149986 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e2187-af79-4c86-896b-93efb270783b None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:20.150293 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e2187-af79-4c86-896b-93efb270783b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:20.151688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e2187-af79-4c86-896b-93efb270783b None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:20.163949 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 248/513] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:20.164614 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e2187-af79-4c86-896b-93efb270783b None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:20.205462 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09dc62-c2dd-4641-a798-e3054b4be97a None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:20.238968 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c6a58-dfdf-4a44-a25e-845193286328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:20.239553 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c6a58-dfdf-4a44-a25e-845193286328 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:20.239840 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c6a58-dfdf-4a44-a25e-845193286328 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:20.240120 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c6a58-dfdf-4a44-a25e-845193286328 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:20.240856 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c6a58-dfdf-4a44-a25e-845193286328 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:20.241168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c6a58-dfdf-4a44-a25e-845193286328 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:20.242591 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c6a58-dfdf-4a44-a25e-845193286328 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:20.255670 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 266/514] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:20.256496 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c6a58-dfdf-4a44-a25e-845193286328 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:20.265811 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e2187-af79-4c86-896b-93efb270783b None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:20.300594 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c7375-ef9a-4098-a800-372a781a1223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:20.301256 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c7375-ef9a-4098-a800-372a781a1223 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:20.301571 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c7375-ef9a-4098-a800-372a781a1223 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:20.301842 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c7375-ef9a-4098-a800-372a781a1223 None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:20.302572 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c7375-ef9a-4098-a800-372a781a1223 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:20.302872 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c7375-ef9a-4098-a800-372a781a1223 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:20.304243 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c7375-ef9a-4098-a800-372a781a1223 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:20.317486 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 249/515] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:20.318324 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c7375-ef9a-4098-a800-372a781a1223 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:20.360875 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c6a58-dfdf-4a44-a25e-845193286328 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:20.394530 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e3293-f518-4e22-966b-816c9cbb928a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:20.395342 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e3293-f518-4e22-966b-816c9cbb928a None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:20.395626 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e3293-f518-4e22-966b-816c9cbb928a None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:20.395904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e3293-f518-4e22-966b-816c9cbb928a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:20.406050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e3293-f518-4e22-966b-816c9cbb928a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:20.407626 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e3293-f518-4e22-966b-816c9cbb928a None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:20.421766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c7375-ef9a-4098-a800-372a781a1223 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:20.426118 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-e99e3293-f518-4e22-966b-816c9cbb928a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:20.426118 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:20.426118 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:20.426118 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:20.426118 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:20.426118 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:20.426118 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:20.426118 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:20.426118 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:20.426118 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:20.426118 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:20.426118 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:20.426118 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:20.426118 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:20.426118 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:20.427277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:20.427277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:20.427277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:20.427277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:20.427277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:20.427277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:20.427277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:20.427277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:20.427277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:20.427277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:20.427277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:20.427277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:20.427277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:20.427277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:20.427277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:20.427277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:20.427277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:20.428674 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:20.428674 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:20.428674 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:20.428674 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:20.428674 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 267/516] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:20.428674 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e3293-f518-4e22-966b-816c9cbb928a None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:20.459140 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b4b2f-254f-4c7f-8a9f-de280c1f3c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:20.459808 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b4b2f-254f-4c7f-8a9f-de280c1f3c9f None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:20.460096 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b4b2f-254f-4c7f-8a9f-de280c1f3c9f None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:20.460376 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b4b2f-254f-4c7f-8a9f-de280c1f3c9f None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:20.461281 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b4b2f-254f-4c7f-8a9f-de280c1f3c9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:20.461423 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b4b2f-254f-4c7f-8a9f-de280c1f3c9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:20.462819 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b4b2f-254f-4c7f-8a9f-de280c1f3c9f None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:20.474902 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 250/517] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:20.476386 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b4b2f-254f-4c7f-8a9f-de280c1f3c9f None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:20.528955 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e3293-f518-4e22-966b-816c9cbb928a None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:20.564127 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a043a5-11d0-4b69-b4ba-f3d01077dfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:20.564880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a043a5-11d0-4b69-b4ba-f3d01077dfee None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:20.565168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a043a5-11d0-4b69-b4ba-f3d01077dfee None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:20.565484 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a043a5-11d0-4b69-b4ba-f3d01077dfee None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:20.566204 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a043a5-11d0-4b69-b4ba-f3d01077dfee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:20.567669 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a043a5-11d0-4b69-b4ba-f3d01077dfee None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:20.576657 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b4b2f-254f-4c7f-8a9f-de280c1f3c9f None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:20.590120 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 268/518] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:33:20 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:33:20.590963 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a043a5-11d0-4b69-b4ba-f3d01077dfee None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:20.631878 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b1645-833f-4f8f-b8da-b48ecf62caf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:20.632761 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b1645-833f-4f8f-b8da-b48ecf62caf3 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:20.633101 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b1645-833f-4f8f-b8da-b48ecf62caf3 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:20.633421 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b1645-833f-4f8f-b8da-b48ecf62caf3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:20.642439 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b1645-833f-4f8f-b8da-b48ecf62caf3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:20.643982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b1645-833f-4f8f-b8da-b48ecf62caf3 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:20.660815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-117b1645-833f-4f8f-b8da-b48ecf62caf3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:33:20.660815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:20.660815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:20.660815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:20.660815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:20.660815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:20.660815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:20.660815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:20.660815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:20.660815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:20.660815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:20.660815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:20.660815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:33:20.660815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:33:20.660815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:33:20.660815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:33:20.662004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:20.662004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:20.662004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:33:20.662004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:20.662004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:33:20.662004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:20.662004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:20.662004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:20.662004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:20.662004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:20.662004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:20.662004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:20.662004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:20.662004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:20.662004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:20.662004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:20.662004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:20.662004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:20.663048 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:20.663048 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:20.663048 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:33:20.663048 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:33:20.663048 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:33:20.663048 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:33:20.663048 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:33:20.663048 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:33:20.663048 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:33:20.663048 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:20.663048 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 251/519] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:33:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:20.664431 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b1645-833f-4f8f-b8da-b48ecf62caf3 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:20.710286 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a043a5-11d0-4b69-b4ba-f3d01077dfee None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:20.758822 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e68db-ca0f-44d4-89a6-bab82494689f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:20.759655 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e68db-ca0f-44d4-89a6-bab82494689f None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:20.759963 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e68db-ca0f-44d4-89a6-bab82494689f None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:20.760253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e68db-ca0f-44d4-89a6-bab82494689f None admin] PATH_INFO: `/v3/projects/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:20.768500 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e68db-ca0f-44d4-89a6-bab82494689f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:20.770073 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e68db-ca0f-44d4-89a6-bab82494689f None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:20.787114 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-296e68db-ca0f-44d4-89a6-bab82494689f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:20.787114 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:20.787114 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:20.787114 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:20.787114 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:20.787114 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:20.787114 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:20.787114 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:20.787114 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:20.787114 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:20.787114 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:20.787114 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:20.787114 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:33:20.787114 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:33:20.787114 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:33:20.788174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:33:20.788174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:20.788174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:20.788174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:20.788174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:20.788174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:20.788174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:20.788174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:20.788174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:20.788174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:20.788174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:20.788174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:20.788174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:20.788174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:20.788174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:20.788174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:20.788174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:20.790958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:33:20.790958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:33:20.790958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:33:20.790958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:33:20.790958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:33:20.790958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:33:20.790958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:20.790958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:20.790958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 269/520] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:20.790958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e68db-ca0f-44d4-89a6-bab82494689f None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:20.791607 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b1645-833f-4f8f-b8da-b48ecf62caf3 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:20.831347 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb69d0-22c5-42f2-987a-5761f74b4b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:20.832067 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb69d0-22c5-42f2-987a-5761f74b4b45 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:20.832360 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb69d0-22c5-42f2-987a-5761f74b4b45 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:20.832692 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb69d0-22c5-42f2-987a-5761f74b4b45 None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:20.833531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb69d0-22c5-42f2-987a-5761f74b4b45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:20.833850 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb69d0-22c5-42f2-987a-5761f74b4b45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:20.835342 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb69d0-22c5-42f2-987a-5761f74b4b45 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:20.850423 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 252/521] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:20.850423 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb69d0-22c5-42f2-987a-5761f74b4b45 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:20.909394 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e68db-ca0f-44d4-89a6-bab82494689f None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:20.944816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307094c6-33cc-4974-9749-4f8300b81aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:20.945719 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307094c6-33cc-4974-9749-4f8300b81aa1 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:20.946003 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307094c6-33cc-4974-9749-4f8300b81aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:20.946278 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307094c6-33cc-4974-9749-4f8300b81aa1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:20.953489 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307094c6-33cc-4974-9749-4f8300b81aa1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:20.955041 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307094c6-33cc-4974-9749-4f8300b81aa1 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:20.958619 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb69d0-22c5-42f2-987a-5761f74b4b45 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:20.969149 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-307094c6-33cc-4974-9749-4f8300b81aa1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:20.969149 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:20.969149 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:20.969149 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:20.969149 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:20.969149 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:20.969149 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:20.969149 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:20.969149 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:20.969149 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:20.969149 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:20.969149 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:20.969149 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:33:20.969149 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:33:20.969149 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:33:20.970785 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:33:20.970785 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:20.970785 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:20.970785 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:20.970785 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:20.970785 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:20.970785 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:20.970785 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:20.970785 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:20.970785 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:20.970785 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:20.970785 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:20.970785 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:20.970785 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:20.970785 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:20.970785 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:20.970785 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:20.972398 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:33:20.972398 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:33:20.972398 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:33:20.972398 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:33:20.972398 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:33:20.972398 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:33:20.972398 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:20.972398 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:20.972398 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 270/522] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:20.972398 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307094c6-33cc-4974-9749-4f8300b81aa1 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:21.000536 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc296990-2b2e-4942-b99f-a15428d70f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:21.001786 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc296990-2b2e-4942-b99f-a15428d70f94 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:21.002435 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc296990-2b2e-4942-b99f-a15428d70f94 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:21.002925 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc296990-2b2e-4942-b99f-a15428d70f94 None admin] PATH_INFO: `/v3/users` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:21.003974 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc296990-2b2e-4942-b99f-a15428d70f94 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:21.004483 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc296990-2b2e-4942-b99f-a15428d70f94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:21.006192 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc296990-2b2e-4942-b99f-a15428d70f94 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:21.046063 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 253/523] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 9 15:33:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:21.047216 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc296990-2b2e-4942-b99f-a15428d70f94 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:21.079580 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307094c6-33cc-4974-9749-4f8300b81aa1 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:21.123697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ba832-9b6b-469b-9e9e-131767db1a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:21.125042 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ba832-9b6b-469b-9e9e-131767db1a2a None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:21.125347 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ba832-9b6b-469b-9e9e-131767db1a2a None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:21.126133 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ba832-9b6b-469b-9e9e-131767db1a2a None admin] PATH_INFO: `/v3/projects` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:21.127103 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ba832-9b6b-469b-9e9e-131767db1a2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:21.127403 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ba832-9b6b-469b-9e9e-131767db1a2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:21.129152 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ba832-9b6b-469b-9e9e-131767db1a2a None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:21.149757 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 271/524] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:33:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:21.150621 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ba832-9b6b-469b-9e9e-131767db1a2a None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:21.163353 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc296990-2b2e-4942-b99f-a15428d70f94 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:21.200454 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4734738-4752-4f57-8f8d-b048950b708f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:21.201261 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4734738-4752-4f57-8f8d-b048950b708f None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:21.201590 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4734738-4752-4f57-8f8d-b048950b708f None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:21.201864 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4734738-4752-4f57-8f8d-b048950b708f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:21.209982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4734738-4752-4f57-8f8d-b048950b708f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:21.211461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4734738-4752-4f57-8f8d-b048950b708f None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:21.227314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-f4734738-4752-4f57-8f8d-b048950b708f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:33:21.227314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:21.227314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:21.227314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:21.227314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:21.227314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:21.227314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:21.227314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:21.227314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:21.227314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:21.227314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:21.227314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:21.227314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:33:21.227314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:33:21.227314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:33:21.227314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:33:21.228445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:21.228445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:21.228445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:33:21.228445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:21.228445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:33:21.228445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:21.228445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:21.228445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:21.228445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:21.228445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:21.228445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:21.228445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:21.228445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:21.228445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:21.228445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:21.228445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:21.228445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:21.228445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:21.229583 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:21.229583 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:21.229583 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:33:21.229583 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:33:21.229583 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:33:21.229583 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:33:21.229583 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:33:21.229583 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:33:21.229583 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:33:21.229583 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:21.233219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 254/525] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:33:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:21.233956 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4734738-4752-4f57-8f8d-b048950b708f None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:21.257216 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ba832-9b6b-469b-9e9e-131767db1a2a None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:21.292554 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fc497-922b-4bed-95f7-620b847cdd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:21.293342 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fc497-922b-4bed-95f7-620b847cdd51 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:21.293723 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fc497-922b-4bed-95f7-620b847cdd51 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:21.294071 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fc497-922b-4bed-95f7-620b847cdd51 None admin] PATH_INFO: `/v3/projects` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:21.294971 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fc497-922b-4bed-95f7-620b847cdd51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:21.295320 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fc497-922b-4bed-95f7-620b847cdd51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:21.297085 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fc497-922b-4bed-95f7-620b847cdd51 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:21.313793 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 272/526] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:33:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:21.313793 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fc497-922b-4bed-95f7-620b847cdd51 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:21.341363 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4734738-4752-4f57-8f8d-b048950b708f None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:21.380242 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4880fc1-c2f7-4a06-997c-786a52d8f8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:21.380996 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4880fc1-c2f7-4a06-997c-786a52d8f8f8 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:21.381348 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4880fc1-c2f7-4a06-997c-786a52d8f8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:21.381722 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4880fc1-c2f7-4a06-997c-786a52d8f8f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:21.440620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fc497-922b-4bed-95f7-620b847cdd51 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:21.450874 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4880fc1-c2f7-4a06-997c-786a52d8f8f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:21.452362 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4880fc1-c2f7-4a06-997c-786a52d8f8f8 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:21.501290 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb4884-0201-4af7-b585-997f41f6caa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:21.502474 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb4884-0201-4af7-b585-997f41f6caa9 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:21.503001 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb4884-0201-4af7-b585-997f41f6caa9 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:21.503521 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb4884-0201-4af7-b585-997f41f6caa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:21.505001 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb4884-0201-4af7-b585-997f41f6caa9 None admin] RBAC: Adding query filter params (role.id=b22352a378fb404d90e3b3ae182757ad, scope.project.id=db5768a93e754372808fc69f898cc853, user.id=d398283fc99c4bfe83170ad3d1538f38) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:21.505624 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb4884-0201-4af7-b585-997f41f6caa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:21.508544 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb4884-0201-4af7-b585-997f41f6caa9 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:21.529260 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 273/527] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:33:21 2022] GET /identity/v3/role_assignments?user.id=d398283fc99c4bfe83170ad3d1538f38&scope.project.id=db5768a93e754372808fc69f898cc853&role.id=b22352a378fb404d90e3b3ae182757ad => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:21.529260 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb4884-0201-4af7-b585-997f41f6caa9 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:21.577418 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 255/528] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:33:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:33:21.578421 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4880fc1-c2f7-4a06-997c-786a52d8f8f8 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:21.641972 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb4884-0201-4af7-b585-997f41f6caa9 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:21.679778 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ecf7c-8c06-49c5-a6c8-e0c4208b63b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:21.680471 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ecf7c-8c06-49c5-a6c8-e0c4208b63b6 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:21.680759 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ecf7c-8c06-49c5-a6c8-e0c4208b63b6 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:21.681036 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ecf7c-8c06-49c5-a6c8-e0c4208b63b6 None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:21.682000 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ecf7c-8c06-49c5-a6c8-e0c4208b63b6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:21.682311 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ecf7c-8c06-49c5-a6c8-e0c4208b63b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:21.683810 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ecf7c-8c06-49c5-a6c8-e0c4208b63b6 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:21.700813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4880fc1-c2f7-4a06-997c-786a52d8f8f8 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:21.704183 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 274/529] 10.222.0.48 () {56 vars in 1139 bytes} [Mon May 9 15:33:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:21.704898 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ecf7c-8c06-49c5-a6c8-e0c4208b63b6 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:21.743095 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a4681-a097-474b-960f-cf1eaad7bb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:21.743767 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a4681-a097-474b-960f-cf1eaad7bb72 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:21.744050 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a4681-a097-474b-960f-cf1eaad7bb72 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:21.744332 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a4681-a097-474b-960f-cf1eaad7bb72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:21.746533 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a4681-a097-474b-960f-cf1eaad7bb72 None admin] RBAC: Adding query filter params (role.id=b22352a378fb404d90e3b3ae182757ad, scope.project.id=db5768a93e754372808fc69f898cc853, user.id=bf5867b42cf64de3aafef27b7ed99c28) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:21.746533 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a4681-a097-474b-960f-cf1eaad7bb72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:21.748687 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a4681-a097-474b-960f-cf1eaad7bb72 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:21.755857 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 256/530] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:33:21 2022] GET /identity/v3/role_assignments?user.id=bf5867b42cf64de3aafef27b7ed99c28&scope.project.id=db5768a93e754372808fc69f898cc853&role.id=b22352a378fb404d90e3b3ae182757ad => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:21.756212 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a4681-a097-474b-960f-cf1eaad7bb72 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:21.887702 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ecf7c-8c06-49c5-a6c8-e0c4208b63b6 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:21.967053 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e161a-8375-4dc4-8ab0-c5f6c26522cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:21.967958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e161a-8375-4dc4-8ab0-c5f6c26522cd None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:21.968245 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e161a-8375-4dc4-8ab0-c5f6c26522cd None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:21.968583 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e161a-8375-4dc4-8ab0-c5f6c26522cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:21.983783 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a4681-a097-474b-960f-cf1eaad7bb72 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:21.984251 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e161a-8375-4dc4-8ab0-c5f6c26522cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:21.986289 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e161a-8375-4dc4-8ab0-c5f6c26522cd None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:22.008501 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-b69e161a-8375-4dc4-8ab0-c5f6c26522cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:22.008501 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:22.008501 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:22.008501 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:22.008501 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:22.008501 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:22.008501 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:22.008501 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:22.008501 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:22.008501 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:22.008501 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:22.008501 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:22.008501 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:22.008501 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:22.008501 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:22.009604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:22.009604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:22.009604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:22.009604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:22.009604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:22.009604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:22.009604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:22.009604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:22.009604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:22.009604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:22.009604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:22.009604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:22.009604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:22.009604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:22.009604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:22.009604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:22.009604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:22.010559 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:22.010559 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:22.010559 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:22.010559 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:22.010559 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 275/531] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:22.017477 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e161a-8375-4dc4-8ab0-c5f6c26522cd None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:22.050631 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df36165-32d3-48ec-ae8d-65cbd59dcd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:22.051297 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df36165-32d3-48ec-ae8d-65cbd59dcd55 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:22.051582 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df36165-32d3-48ec-ae8d-65cbd59dcd55 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:22.051860 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df36165-32d3-48ec-ae8d-65cbd59dcd55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:22.148098 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e161a-8375-4dc4-8ab0-c5f6c26522cd None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:22.173409 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df36165-32d3-48ec-ae8d-65cbd59dcd55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:22.175815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df36165-32d3-48ec-ae8d-65cbd59dcd55 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:22.195858 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02983379-cdac-4ead-8c82-2c419e27a07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:22.196571 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02983379-cdac-4ead-8c82-2c419e27a07e None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:22.196872 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02983379-cdac-4ead-8c82-2c419e27a07e None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:22.197128 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02983379-cdac-4ead-8c82-2c419e27a07e None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:22.197913 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02983379-cdac-4ead-8c82-2c419e27a07e None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:22.198223 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02983379-cdac-4ead-8c82-2c419e27a07e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:22.199638 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02983379-cdac-4ead-8c82-2c419e27a07e None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:22.213044 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 276/532] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:22.218543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02983379-cdac-4ead-8c82-2c419e27a07e None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:22.334206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02983379-cdac-4ead-8c82-2c419e27a07e None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:22.371437 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98a763-4dc0-4979-91dd-db1b66aa50d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:22.372396 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98a763-4dc0-4979-91dd-db1b66aa50d6 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:22.372587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98a763-4dc0-4979-91dd-db1b66aa50d6 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:22.372829 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98a763-4dc0-4979-91dd-db1b66aa50d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:22.377148 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 257/533] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:33:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:33:22.385433 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98a763-4dc0-4979-91dd-db1b66aa50d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:22.385433 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98a763-4dc0-4979-91dd-db1b66aa50d6 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:22.386801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df36165-32d3-48ec-ae8d-65cbd59dcd55 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:22.416100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-3f98a763-4dc0-4979-91dd-db1b66aa50d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:22.416100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:22.416100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:22.416100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:22.416100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:22.416100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:22.416100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:22.416100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:22.416100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:22.416100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:22.416100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:22.416100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:22.416100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:33:22.416100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:33:22.416100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:33:22.417328 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:33:22.417328 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:22.417328 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:22.417328 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:22.417328 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:22.417328 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:22.417328 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:22.417328 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:22.417328 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:22.417328 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:22.417328 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:22.417328 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:22.417328 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:22.417328 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:22.417328 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:22.417328 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:22.417328 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:22.418450 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:33:22.418450 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:33:22.418450 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:33:22.418450 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:33:22.418450 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:33:22.418450 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:33:22.418450 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:22.418450 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:22.430365 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 277/534] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:22.431821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98a763-4dc0-4979-91dd-db1b66aa50d6 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:22.556448 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98a763-4dc0-4979-91dd-db1b66aa50d6 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:22.603247 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7729d-2599-40d8-888e-60c550d6faa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:22.603924 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7729d-2599-40d8-888e-60c550d6faa5 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:22.604212 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7729d-2599-40d8-888e-60c550d6faa5 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:22.604492 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7729d-2599-40d8-888e-60c550d6faa5 None admin] PATH_INFO: `/v3/projects` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:22.605308 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7729d-2599-40d8-888e-60c550d6faa5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:22.605648 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7729d-2599-40d8-888e-60c550d6faa5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:22.607129 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7729d-2599-40d8-888e-60c550d6faa5 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:22.627600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 278/535] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:33:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:22.642698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df36165-32d3-48ec-ae8d-65cbd59dcd55 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:22.650773 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7729d-2599-40d8-888e-60c550d6faa5 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:22.727506 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86247f67-f39c-4e15-9e30-5b5465a008de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:22.728321 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86247f67-f39c-4e15-9e30-5b5465a008de None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:22.728605 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86247f67-f39c-4e15-9e30-5b5465a008de None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:22.728881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86247f67-f39c-4e15-9e30-5b5465a008de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:22.752031 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86247f67-f39c-4e15-9e30-5b5465a008de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:22.753768 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86247f67-f39c-4e15-9e30-5b5465a008de None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:22.790884 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-86247f67-f39c-4e15-9e30-5b5465a008de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:22.790884 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:22.790884 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:22.790884 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:22.790884 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:22.790884 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:22.790884 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:22.790884 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:22.790884 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:22.790884 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:22.790884 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:22.790884 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:22.790884 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:22.790884 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:22.790884 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:22.791926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:22.791926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:22.791926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:22.791926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:22.791926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:22.791926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:22.791926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:22.791926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:22.791926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:22.791926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:22.791926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:22.791926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:22.791926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:22.791926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:22.791926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:22.791926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:22.791926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:22.792890 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:22.792890 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:22.792890 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:22.792890 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:22.792890 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 258/536] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:22.798435 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86247f67-f39c-4e15-9e30-5b5465a008de None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:22.803357 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7729d-2599-40d8-888e-60c550d6faa5 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:22.849011 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324d571-2b54-4fcc-9b47-2e2687ca09fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:22.849722 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324d571-2b54-4fcc-9b47-2e2687ca09fb None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:22.852456 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324d571-2b54-4fcc-9b47-2e2687ca09fb None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:22.852748 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324d571-2b54-4fcc-9b47-2e2687ca09fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:22.853631 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324d571-2b54-4fcc-9b47-2e2687ca09fb None admin] RBAC: Adding query filter params (role.id=b22352a378fb404d90e3b3ae182757ad, scope.project.id=db5768a93e754372808fc69f898cc853, user.id=673a97c146144369937b1288797ab1ba) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:22.853957 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324d571-2b54-4fcc-9b47-2e2687ca09fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:22.858377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324d571-2b54-4fcc-9b47-2e2687ca09fb None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:22.871310 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 279/537] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:33:22 2022] GET /identity/v3/role_assignments?user.id=673a97c146144369937b1288797ab1ba&scope.project.id=db5768a93e754372808fc69f898cc853&role.id=b22352a378fb404d90e3b3ae182757ad => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:33:22.919766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86247f67-f39c-4e15-9e30-5b5465a008de None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:22.972453 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52120f1b-fe41-4d74-8ecb-629c9ec7e92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:22.973151 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52120f1b-fe41-4d74-8ecb-629c9ec7e92b None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:22.973458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52120f1b-fe41-4d74-8ecb-629c9ec7e92b None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:22.973738 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52120f1b-fe41-4d74-8ecb-629c9ec7e92b None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:22.974501 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52120f1b-fe41-4d74-8ecb-629c9ec7e92b None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:22.974814 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52120f1b-fe41-4d74-8ecb-629c9ec7e92b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:22.976280 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52120f1b-fe41-4d74-8ecb-629c9ec7e92b None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:22.998695 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 259/538] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:33:23.004889 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324d571-2b54-4fcc-9b47-2e2687ca09fb None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:23.138363 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324d571-2b54-4fcc-9b47-2e2687ca09fb None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:23.176473 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e90125-18cf-494a-89bf-c35165917a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:23.177296 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e90125-18cf-494a-89bf-c35165917a2f None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:23.177617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e90125-18cf-494a-89bf-c35165917a2f None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:23.177902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e90125-18cf-494a-89bf-c35165917a2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:23.185793 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e90125-18cf-494a-89bf-c35165917a2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:23.187294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e90125-18cf-494a-89bf-c35165917a2f None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:23.203485 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-a0e90125-18cf-494a-89bf-c35165917a2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:23.203485 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:23.203485 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:23.203485 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:23.203485 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:23.203485 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:23.203485 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:23.203485 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:23.203485 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:23.203485 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:23.203485 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:23.203485 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:23.203485 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:33:23.203485 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:33:23.203485 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:33:23.204627 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:33:23.204627 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:23.204627 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:23.204627 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:23.204627 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:23.204627 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:23.204627 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:23.204627 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:23.204627 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:23.204627 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:23.204627 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:23.204627 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:23.204627 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:23.204627 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:23.204627 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:23.204627 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:23.204627 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:23.205637 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:33:23.205637 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:33:23.205637 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:33:23.205637 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:33:23.205637 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:33:23.205637 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:33:23.205637 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:23.205637 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:23.205637 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 280/539] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:23.214761 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52120f1b-fe41-4d74-8ecb-629c9ec7e92b None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:23.338574 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52120f1b-fe41-4d74-8ecb-629c9ec7e92b None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:23.373058 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776eaaa-c7f2-4d4c-8bf9-3c111c78414f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:23.373765 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776eaaa-c7f2-4d4c-8bf9-3c111c78414f None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:23.374050 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776eaaa-c7f2-4d4c-8bf9-3c111c78414f None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:23.374326 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776eaaa-c7f2-4d4c-8bf9-3c111c78414f None admin] PATH_INFO: `/v3/projects` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:23.375117 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776eaaa-c7f2-4d4c-8bf9-3c111c78414f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:23.375427 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776eaaa-c7f2-4d4c-8bf9-3c111c78414f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:23.377171 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776eaaa-c7f2-4d4c-8bf9-3c111c78414f None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:23.405016 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 260/540] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:33:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:23.411568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e90125-18cf-494a-89bf-c35165917a2f None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:23.482494 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a4095-395f-414b-aa6e-aec6c6f9346a None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:23.482494 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a4095-395f-414b-aa6e-aec6c6f9346a None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:23.483414 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a4095-395f-414b-aa6e-aec6c6f9346a None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:23.486432 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 261/541] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:23.495118 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e04917-8678-49bf-bc95-226c5ebeb2c8 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:23.495599 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e04917-8678-49bf-bc95-226c5ebeb2c8 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:23.496077 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e04917-8678-49bf-bc95-226c5ebeb2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:23.535844 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-58e04917-8678-49bf-bc95-226c5ebeb2c8 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:23.538343 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-58e04917-8678-49bf-bc95-226c5ebeb2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:23.568550 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e90125-18cf-494a-89bf-c35165917a2f None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:23.650191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6974f1b-8700-461d-a735-7a5564c00992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:23.650859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6974f1b-8700-461d-a735-7a5564c00992 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:23.651151 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6974f1b-8700-461d-a735-7a5564c00992 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:23.651435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6974f1b-8700-461d-a735-7a5564c00992 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:23.652286 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6974f1b-8700-461d-a735-7a5564c00992 None admin] RBAC: Adding query filter params (role.id=b22352a378fb404d90e3b3ae182757ad, scope.project.id=db5768a93e754372808fc69f898cc853, user.id=74924b56be0243eda3144664dd01cc13) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:23.652602 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6974f1b-8700-461d-a735-7a5564c00992 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:23.654086 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6974f1b-8700-461d-a735-7a5564c00992 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:23.661183 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 281/542] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:33:23 2022] GET /identity/v3/role_assignments?user.id=74924b56be0243eda3144664dd01cc13&scope.project.id=db5768a93e754372808fc69f898cc853&role.id=b22352a378fb404d90e3b3ae182757ad => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:23.667193 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 262/543] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:33:23.718526 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6974f1b-8700-461d-a735-7a5564c00992 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:23.851768 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6974f1b-8700-461d-a735-7a5564c00992 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:23.895520 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3205a-da9f-4b1c-8c58-8b9dc19c178d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:23.896271 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3205a-da9f-4b1c-8c58-8b9dc19c178d None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:23.896559 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3205a-da9f-4b1c-8c58-8b9dc19c178d None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:23.896845 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3205a-da9f-4b1c-8c58-8b9dc19c178d None admin] PATH_INFO: `/v3/roles/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:23.917862 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3205a-da9f-4b1c-8c58-8b9dc19c178d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:23.926911 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-a1d3205a-da9f-4b1c-8c58-8b9dc19c178d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:23.926911 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:23.926911 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:23.926911 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:23.926911 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:23.926911 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:23.926911 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:23.926911 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:23.926911 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:23.926911 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:23.926911 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:23.926911 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:23.926911 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:23.926911 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:23.926911 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:23.926911 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:23.929209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:23.929209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:23.929209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:23.929209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:23.929209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:23.929209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:23.929209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:23.929209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:23.929209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:23.929209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:23.929209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:23.929209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:23.929209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:23.929209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:23.929209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:23.929209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:23.931368 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:23.931368 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:23.931368 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:23.931368 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:23.931368 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:23.931368 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:23.931368 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:23.931368 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:23.931368 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:23.931368 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:23.931368 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:23.931368 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:23.932960 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 282/544] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:33:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:23.937419 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e04917-8678-49bf-bc95-226c5ebeb2c8 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:24.089406 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e04917-8678-49bf-bc95-226c5ebeb2c8 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:24.136665 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071fffd-739f-4cd7-8f1e-508f82404c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:24.137450 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071fffd-739f-4cd7-8f1e-508f82404c03 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:24.137741 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071fffd-739f-4cd7-8f1e-508f82404c03 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:24.138027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071fffd-739f-4cd7-8f1e-508f82404c03 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:24.138787 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071fffd-739f-4cd7-8f1e-508f82404c03 None admin] RBAC: Adding query filter params (name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:24.139099 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071fffd-739f-4cd7-8f1e-508f82404c03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:24.140503 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071fffd-739f-4cd7-8f1e-508f82404c03 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:24.153189 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 263/545] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:33:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:24.158671 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3205a-da9f-4b1c-8c58-8b9dc19c178d None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:24.309200 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3205a-da9f-4b1c-8c58-8b9dc19c178d None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:24.363377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ade06-907e-42a0-94f8-455ca15a0e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:24.364624 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ade06-907e-42a0-94f8-455ca15a0e04 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:24.365154 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ade06-907e-42a0-94f8-455ca15a0e04 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:24.365702 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ade06-907e-42a0-94f8-455ca15a0e04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:24.382108 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ade06-907e-42a0-94f8-455ca15a0e04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:24.383674 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ade06-907e-42a0-94f8-455ca15a0e04 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:24.404923 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-440ade06-907e-42a0-94f8-455ca15a0e04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:24.404923 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:24.404923 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:24.404923 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:24.404923 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:24.404923 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:24.404923 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:24.404923 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:24.404923 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:24.404923 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:24.404923 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:24.404923 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:24.404923 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:24.404923 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:24.404923 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:24.405977 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:24.405977 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:24.405977 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:24.405977 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:24.405977 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:24.405977 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:24.405977 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:24.405977 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:24.405977 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:24.405977 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:24.405977 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:24.405977 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:24.405977 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:24.405977 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:24.405977 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:24.405977 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:24.405977 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:24.406995 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:24.406995 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:24.406995 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:24.406995 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:24.406995 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 283/546] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:24.412971 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071fffd-739f-4cd7-8f1e-508f82404c03 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:24.539638 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071fffd-739f-4cd7-8f1e-508f82404c03 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:24.577322 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e725e3-fb5d-4bc0-9873-fcf64a45dbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:24.578038 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e725e3-fb5d-4bc0-9873-fcf64a45dbcd None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:24.578322 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e725e3-fb5d-4bc0-9873-fcf64a45dbcd None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:24.578605 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e725e3-fb5d-4bc0-9873-fcf64a45dbcd None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:24.580633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e725e3-fb5d-4bc0-9873-fcf64a45dbcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:24.580988 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e725e3-fb5d-4bc0-9873-fcf64a45dbcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:24.582437 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e725e3-fb5d-4bc0-9873-fcf64a45dbcd None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:24.596668 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 264/547] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:24.602196 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ade06-907e-42a0-94f8-455ca15a0e04 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:24.665435 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43eb60-cbba-443f-8f84-4a3e4c556376 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:24.665735 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43eb60-cbba-443f-8f84-4a3e4c556376 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:24.665920 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43eb60-cbba-443f-8f84-4a3e4c556376 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:24.667629 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 265/548] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:24.687156 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c039c1-9d5b-44e6-973c-1eac23ff3703 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:24.687513 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c039c1-9d5b-44e6-973c-1eac23ff3703 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:24.687702 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c039c1-9d5b-44e6-973c-1eac23ff3703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:24.715418 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-e3c039c1-9d5b-44e6-973c-1eac23ff3703 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:24.717413 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-e3c039c1-9d5b-44e6-973c-1eac23ff3703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:24.809053 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ade06-907e-42a0-94f8-455ca15a0e04 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:24.819763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 266/549] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:33:24.847133 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c039c1-9d5b-44e6-973c-1eac23ff3703 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:24.857509 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929bf55-d257-4051-80a4-94d99c2d20e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:24.858645 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929bf55-d257-4051-80a4-94d99c2d20e5 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:24.859162 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929bf55-d257-4051-80a4-94d99c2d20e5 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:24.859652 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929bf55-d257-4051-80a4-94d99c2d20e5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:24.870232 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929bf55-d257-4051-80a4-94d99c2d20e5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:24.872524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929bf55-d257-4051-80a4-94d99c2d20e5 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:24.900519 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-5929bf55-d257-4051-80a4-94d99c2d20e5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:33:24.900519 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:24.900519 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:24.900519 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:24.900519 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:24.900519 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:24.900519 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:24.900519 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:24.900519 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:24.900519 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:24.900519 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:24.900519 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:24.900519 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:33:24.900519 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:33:24.900519 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:33:24.900519 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:33:24.901689 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:24.901689 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:24.901689 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:33:24.901689 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:24.901689 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:33:24.901689 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:24.901689 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:24.901689 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:24.901689 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:24.901689 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:24.901689 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:24.901689 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:24.901689 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:24.901689 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:24.901689 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:24.901689 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:24.901689 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:24.901689 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:24.902734 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:24.902734 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:24.902734 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:33:24.902734 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:33:24.902734 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:33:24.902734 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:33:24.902734 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:33:24.902734 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:33:24.902734 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:33:24.902734 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:24.906122 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 284/550] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:33:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:24.913745 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929bf55-d257-4051-80a4-94d99c2d20e5 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:25.001894 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c039c1-9d5b-44e6-973c-1eac23ff3703 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:25.024641 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929bf55-d257-4051-80a4-94d99c2d20e5 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:25.041395 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748700b-f9a5-4271-9fe2-074036fd1c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:25.042207 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748700b-f9a5-4271-9fe2-074036fd1c15 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:25.042494 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748700b-f9a5-4271-9fe2-074036fd1c15 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:25.042774 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748700b-f9a5-4271-9fe2-074036fd1c15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:25.054350 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748700b-f9a5-4271-9fe2-074036fd1c15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:25.062260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-6748700b-f9a5-4271-9fe2-074036fd1c15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:25.062260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:25.062260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:25.062260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:25.062260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:25.062260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:25.062260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:25.062260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:25.062260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:25.062260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:25.062260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:25.062260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:25.062260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:25.062260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:25.062260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:25.062260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:25.064064 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:25.064064 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:25.064064 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:25.064064 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:25.064064 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:25.064064 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:25.064064 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:25.064064 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:25.064064 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:25.064064 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:25.064064 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:25.064064 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:25.064064 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:25.064064 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:25.064064 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:25.064064 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:25.065030 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:25.065030 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:25.065030 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:25.065030 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:25.065030 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:25.065030 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:25.065030 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:25.065030 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:25.065030 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:25.065030 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:25.065030 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:25.065030 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:25.068377 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 267/551] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:33:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:33:25.069863 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a997e-abfe-4a21-87c7-fb2bc545d5e1 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:25.070209 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a997e-abfe-4a21-87c7-fb2bc545d5e1 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:25.070491 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a997e-abfe-4a21-87c7-fb2bc545d5e1 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:25.071071 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c315e-7d77-41e6-a7ed-a8c3ca3014b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:25.072007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c315e-7d77-41e6-a7ed-a8c3ca3014b0 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:25.072503 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c315e-7d77-41e6-a7ed-a8c3ca3014b0 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:25.073011 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c315e-7d77-41e6-a7ed-a8c3ca3014b0 None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:25.074146 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c315e-7d77-41e6-a7ed-a8c3ca3014b0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:25.074678 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c315e-7d77-41e6-a7ed-a8c3ca3014b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:25.076037 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 268/552] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:25.076605 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c315e-7d77-41e6-a7ed-a8c3ca3014b0 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:25.077966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183014db-508f-47a0-984c-3c22e9330e88 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:25.078258 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183014db-508f-47a0-984c-3c22e9330e88 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:25.078544 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183014db-508f-47a0-984c-3c22e9330e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:25.097546 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-183014db-508f-47a0-984c-3c22e9330e88 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:25.098824 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-183014db-508f-47a0-984c-3c22e9330e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:25.100600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 285/553] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 9 15:33:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:25.106329 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c315e-7d77-41e6-a7ed-a8c3ca3014b0 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:25.205399 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 269/554] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:33:25.206113 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183014db-508f-47a0-984c-3c22e9330e88 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:25.240409 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c315e-7d77-41e6-a7ed-a8c3ca3014b0 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:25.278974 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977d10a-12b8-4e8c-bf7c-8a576bb18c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:25.279627 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977d10a-12b8-4e8c-bf7c-8a576bb18c6d None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:25.279852 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977d10a-12b8-4e8c-bf7c-8a576bb18c6d None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:25.280134 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977d10a-12b8-4e8c-bf7c-8a576bb18c6d None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:25.280897 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977d10a-12b8-4e8c-bf7c-8a576bb18c6d None admin] RBAC: Adding query filter params (name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:25.281206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977d10a-12b8-4e8c-bf7c-8a576bb18c6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:25.283500 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977d10a-12b8-4e8c-bf7c-8a576bb18c6d None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:25.292378 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 286/555] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:33:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:25.293057 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977d10a-12b8-4e8c-bf7c-8a576bb18c6d None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:25.351284 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183014db-508f-47a0-984c-3c22e9330e88 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:25.387590 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51513a1-9ef3-4567-8aa1-85a03c2f566a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:25.388172 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51513a1-9ef3-4567-8aa1-85a03c2f566a None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:25.388478 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51513a1-9ef3-4567-8aa1-85a03c2f566a None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:25.388794 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51513a1-9ef3-4567-8aa1-85a03c2f566a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:25.410737 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977d10a-12b8-4e8c-bf7c-8a576bb18c6d None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:25.448711 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86b082-7ea6-490e-a2d0-7569ffc57272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:25.449960 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86b082-7ea6-490e-a2d0-7569ffc57272 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:25.450468 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86b082-7ea6-490e-a2d0-7569ffc57272 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:25.450960 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86b082-7ea6-490e-a2d0-7569ffc57272 None admin] PATH_INFO: `/v3/roles/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:25.460074 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51513a1-9ef3-4567-8aa1-85a03c2f566a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:25.461485 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51513a1-9ef3-4567-8aa1-85a03c2f566a None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:25.463912 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86b082-7ea6-490e-a2d0-7569ffc57272 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:25.473465 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-4f86b082-7ea6-490e-a2d0-7569ffc57272 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:25.473465 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:25.473465 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:25.473465 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:25.473465 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:25.473465 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:25.473465 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:25.473465 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:25.473465 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:25.473465 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:25.473465 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:25.473465 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:25.473465 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:25.473465 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:25.473465 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:25.473465 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:25.474556 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:25.474556 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:25.474556 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:25.474556 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:25.474556 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:25.474556 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:25.474556 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:25.474556 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:25.474556 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:25.474556 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:25.474556 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:25.474556 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:25.474556 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:25.474556 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:25.474556 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:25.474556 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:25.475477 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:25.475477 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:25.475477 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:25.475477 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:25.475477 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:25.475477 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:25.475477 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:25.475477 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:25.475477 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:25.475477 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:25.475477 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:25.475477 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:25.478391 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 287/556] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:33:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:25.479481 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86b082-7ea6-490e-a2d0-7569ffc57272 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:25.577494 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 270/557] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:33:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:33:25.577494 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51513a1-9ef3-4567-8aa1-85a03c2f566a None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:25.603226 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86b082-7ea6-490e-a2d0-7569ffc57272 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:25.655036 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d27f2-b438-4b27-913c-6c1a5ac0d45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:25.656435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d27f2-b438-4b27-913c-6c1a5ac0d45c None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:25.658186 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d27f2-b438-4b27-913c-6c1a5ac0d45c None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:25.658186 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d27f2-b438-4b27-913c-6c1a5ac0d45c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:25.677902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d27f2-b438-4b27-913c-6c1a5ac0d45c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:25.680118 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d27f2-b438-4b27-913c-6c1a5ac0d45c None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:25.689733 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51513a1-9ef3-4567-8aa1-85a03c2f566a None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:25.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-3f5d27f2-b438-4b27-913c-6c1a5ac0d45c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:25.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:25.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:25.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:25.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:25.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:25.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:25.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:25.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:25.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:25.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:25.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:25.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:25.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:25.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:25.707005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:25.707005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:25.707005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:25.707005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:25.707005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:25.707005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:25.707005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:25.707005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:25.707005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:25.707005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:25.707005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:25.707005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:25.707005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:25.707005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:25.707005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:25.707005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:25.707005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:25.707988 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:25.707988 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:25.707988 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:25.707988 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:25.707988 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 288/558] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:25.708300 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d27f2-b438-4b27-913c-6c1a5ac0d45c None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:25.730425 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cccdf-7ac0-41b3-816c-1ea1845cb908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:25.731836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cccdf-7ac0-41b3-816c-1ea1845cb908 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:25.732163 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cccdf-7ac0-41b3-816c-1ea1845cb908 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:25.732451 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cccdf-7ac0-41b3-816c-1ea1845cb908 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:25.733165 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cccdf-7ac0-41b3-816c-1ea1845cb908 None admin] RBAC: Adding query filter params (name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:25.733504 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cccdf-7ac0-41b3-816c-1ea1845cb908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:25.734906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cccdf-7ac0-41b3-816c-1ea1845cb908 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:25.748899 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 271/559] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:33:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:25.752015 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9af44-d44a-4143-bd60-b9f0dfebb2ca None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:25.752634 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9af44-d44a-4143-bd60-b9f0dfebb2ca None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:25.753226 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9af44-d44a-4143-bd60-b9f0dfebb2ca None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:25.755948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 272/560] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:25.757433 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9af44-d44a-4143-bd60-b9f0dfebb2ca None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:25.835351 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d27f2-b438-4b27-913c-6c1a5ac0d45c None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:25.873135 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9af44-d44a-4143-bd60-b9f0dfebb2ca None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:25.878815 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d26c4-13ab-46e5-bee3-d1c6f433fbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:25.879922 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d26c4-13ab-46e5-bee3-d1c6f433fbd9 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:25.880414 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d26c4-13ab-46e5-bee3-d1c6f433fbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:25.880891 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d26c4-13ab-46e5-bee3-d1c6f433fbd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:25.892637 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d26c4-13ab-46e5-bee3-d1c6f433fbd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:25.894482 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d26c4-13ab-46e5-bee3-d1c6f433fbd9 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:25.911598 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6121f-75d1-491d-a64f-d1f7a29ebe32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:25.912261 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6121f-75d1-491d-a64f-d1f7a29ebe32 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:25.912544 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6121f-75d1-491d-a64f-d1f7a29ebe32 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:25.912821 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6121f-75d1-491d-a64f-d1f7a29ebe32 None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:25.913590 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6121f-75d1-491d-a64f-d1f7a29ebe32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:25.913893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6121f-75d1-491d-a64f-d1f7a29ebe32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:25.914277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-9b5d26c4-13ab-46e5-bee3-d1c6f433fbd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:25.914277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:25.914277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:25.914277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:25.914277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:25.914277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:25.914277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:25.914277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:25.914277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:25.914277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:25.914277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:25.914277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:25.914277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:25.914277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:25.914277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:25.915205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:25.915205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:25.915205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:25.915205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:25.915205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:25.915205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:25.915205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:25.915205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:25.915205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:25.915205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:25.915205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:25.915205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:25.915205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:25.915205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:25.915205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:25.915205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:25.915205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:25.916259 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:25.916259 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:25.916259 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:25.916259 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:25.916504 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6121f-75d1-491d-a64f-d1f7a29ebe32 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:25.922417 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 289/561] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:25.923834 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d26c4-13ab-46e5-bee3-d1c6f433fbd9 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:25.927310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 273/562] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:25.928851 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11595882-6481-473c-9b0d-ea40b9a61f3e None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:25.929141 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11595882-6481-473c-9b0d-ea40b9a61f3e None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:25.929508 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11595882-6481-473c-9b0d-ea40b9a61f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:25.947389 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-11595882-6481-473c-9b0d-ea40b9a61f3e None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:25.948592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-11595882-6481-473c-9b0d-ea40b9a61f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:26.040360 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 274/563] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:33:26.042188 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11595882-6481-473c-9b0d-ea40b9a61f3e None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:26.059805 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d26c4-13ab-46e5-bee3-d1c6f433fbd9 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:26.122009 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecdd00c-4817-4bfd-aeaa-ee90540ae476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:26.123145 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdd00c-4817-4bfd-aeaa-ee90540ae476 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:26.123431 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdd00c-4817-4bfd-aeaa-ee90540ae476 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:26.123709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecdd00c-4817-4bfd-aeaa-ee90540ae476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:26.136184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecdd00c-4817-4bfd-aeaa-ee90540ae476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:26.137769 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecdd00c-4817-4bfd-aeaa-ee90540ae476 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:26.156416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-7ecdd00c-4817-4bfd-aeaa-ee90540ae476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:26.156416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:26.156416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:26.156416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:26.156416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:26.156416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:26.156416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:26.156416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:26.156416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:26.156416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:26.156416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:26.156416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:26.156416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:26.156416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:26.156416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:26.163402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:26.163402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:26.163402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:26.163402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:26.163402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:26.163402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:26.163402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:26.163402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:26.163402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:26.163402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:26.163402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:26.163402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:26.163402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:26.163402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:26.163402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:26.163402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:26.163402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:26.164415 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:26.164415 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:26.164415 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:26.164415 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:26.164415 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 290/564] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:26.164415 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecdd00c-4817-4bfd-aeaa-ee90540ae476 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:26.182619 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11595882-6481-473c-9b0d-ea40b9a61f3e None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:26.226512 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0356e9f-d051-437f-b7f3-b5efd1a8584c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:26.227187 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0356e9f-d051-437f-b7f3-b5efd1a8584c None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:26.227470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0356e9f-d051-437f-b7f3-b5efd1a8584c None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:26.227744 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0356e9f-d051-437f-b7f3-b5efd1a8584c None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:26.228472 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0356e9f-d051-437f-b7f3-b5efd1a8584c None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:26.228782 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0356e9f-d051-437f-b7f3-b5efd1a8584c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:26.230195 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0356e9f-d051-437f-b7f3-b5efd1a8584c None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:26.242801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 275/565] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:26.243398 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0356e9f-d051-437f-b7f3-b5efd1a8584c None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:26.275980 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecdd00c-4817-4bfd-aeaa-ee90540ae476 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:26.311812 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3d8a2-cfc7-4666-be16-d8143b41c5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:26.312139 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3d8a2-cfc7-4666-be16-d8143b41c5b7 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:26.312421 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3d8a2-cfc7-4666-be16-d8143b41c5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:26.312694 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3d8a2-cfc7-4666-be16-d8143b41c5b7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:26.321799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3d8a2-cfc7-4666-be16-d8143b41c5b7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:26.323255 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3d8a2-cfc7-4666-be16-d8143b41c5b7 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:26.338185 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-5ab3d8a2-cfc7-4666-be16-d8143b41c5b7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:33:26.338185 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:26.338185 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:26.338185 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:26.338185 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:26.338185 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:26.338185 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:26.338185 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:26.338185 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:26.338185 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:26.338185 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:26.338185 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:26.338185 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:33:26.338185 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:33:26.338185 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:33:26.338185 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:33:26.339422 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:26.339422 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:26.339422 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:33:26.339422 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:26.339422 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:33:26.339422 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:26.339422 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:26.339422 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:26.339422 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:26.339422 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:26.339422 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:26.339422 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:26.339422 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:26.339422 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:26.339422 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:26.339422 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:26.339422 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:26.339422 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:26.340445 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:26.340445 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:26.340445 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:33:26.340445 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:33:26.340445 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:33:26.340445 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:33:26.340445 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:33:26.340445 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:33:26.340445 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:33:26.340445 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:26.340445 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 291/566] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:33:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:26.340445 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3d8a2-cfc7-4666-be16-d8143b41c5b7 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:26.354317 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0356e9f-d051-437f-b7f3-b5efd1a8584c None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:26.387921 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d717e3-3a6b-4186-96e7-639722c9a5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:26.388650 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d717e3-3a6b-4186-96e7-639722c9a5ad None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:26.388932 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d717e3-3a6b-4186-96e7-639722c9a5ad None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:26.389215 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d717e3-3a6b-4186-96e7-639722c9a5ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:26.400091 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d717e3-3a6b-4186-96e7-639722c9a5ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:26.408531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-e5d717e3-3a6b-4186-96e7-639722c9a5ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:26.408531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:26.408531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:26.408531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:26.408531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:26.408531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:26.408531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:26.408531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:26.408531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:26.408531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:26.408531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:26.408531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:26.408531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:26.408531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:26.408531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:26.408531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:26.409737 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:26.409737 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:26.409737 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:26.409737 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:26.409737 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:26.409737 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:26.409737 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:26.409737 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:26.409737 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:26.409737 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:26.409737 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:26.409737 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:26.409737 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:26.409737 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:26.409737 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:26.409737 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:26.410680 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:26.410680 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:26.410680 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:26.410680 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:26.410680 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:26.410680 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:26.410680 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:26.410680 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:26.410680 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:26.410680 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:26.410680 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:26.410680 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:26.410680 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 276/567] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:33:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:26.410680 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d717e3-3a6b-4186-96e7-639722c9a5ad None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:26.445890 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3d8a2-cfc7-4666-be16-d8143b41c5b7 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:26.479826 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f2b21-2f14-4e16-bc83-c685805f7bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:26.480492 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f2b21-2f14-4e16-bc83-c685805f7bac None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:26.480775 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f2b21-2f14-4e16-bc83-c685805f7bac None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:26.481051 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f2b21-2f14-4e16-bc83-c685805f7bac None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:26.481801 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f2b21-2f14-4e16-bc83-c685805f7bac None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:26.482108 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f2b21-2f14-4e16-bc83-c685805f7bac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:26.483496 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f2b21-2f14-4e16-bc83-c685805f7bac None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:26.495843 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 292/568] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:26.497168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df74f5-4df7-43e8-a74d-e04b07b76eb6 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:26.497490 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df74f5-4df7-43e8-a74d-e04b07b76eb6 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:26.497772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df74f5-4df7-43e8-a74d-e04b07b76eb6 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:26.499003 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 293/569] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:26.499699 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df74f5-4df7-43e8-a74d-e04b07b76eb6 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:26.517391 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d717e3-3a6b-4186-96e7-639722c9a5ad None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:26.551246 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563d3fb-8518-4e6e-a105-d4afd18cb4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:26.552054 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563d3fb-8518-4e6e-a105-d4afd18cb4ca None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:26.552338 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563d3fb-8518-4e6e-a105-d4afd18cb4ca None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:26.552615 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563d3fb-8518-4e6e-a105-d4afd18cb4ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:26.559516 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563d3fb-8518-4e6e-a105-d4afd18cb4ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:26.560998 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563d3fb-8518-4e6e-a105-d4afd18cb4ca None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:26.576252 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-f563d3fb-8518-4e6e-a105-d4afd18cb4ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:26.576252 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:26.576252 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:26.576252 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:26.576252 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:26.576252 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:26.576252 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:26.576252 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:26.576252 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:26.576252 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:26.576252 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:26.576252 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:26.576252 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:33:26.576252 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:33:26.576252 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:33:26.577498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:33:26.577498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:26.577498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:26.577498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:26.577498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:26.577498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:26.577498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:26.577498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:26.577498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:26.577498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:26.577498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:26.577498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:26.577498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:26.577498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:26.577498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:26.577498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:26.577498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:26.579373 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:33:26.579373 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:33:26.579373 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:33:26.579373 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:33:26.579373 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:33:26.579373 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:33:26.579373 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:26.579373 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:26.579373 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 277/570] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:26.579373 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563d3fb-8518-4e6e-a105-d4afd18cb4ca None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:26.606885 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df74f5-4df7-43e8-a74d-e04b07b76eb6 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:26.644800 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddb8de-674f-47e6-8fca-6db6cbb6c51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:26.645429 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddb8de-674f-47e6-8fca-6db6cbb6c51f None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:26.645718 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddb8de-674f-47e6-8fca-6db6cbb6c51f None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:26.646002 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddb8de-674f-47e6-8fca-6db6cbb6c51f None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:26.646875 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cddb8de-674f-47e6-8fca-6db6cbb6c51f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:26.647187 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cddb8de-674f-47e6-8fca-6db6cbb6c51f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:26.648760 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cddb8de-674f-47e6-8fca-6db6cbb6c51f None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:26.667353 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 294/571] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:33:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:26.668211 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddb8de-674f-47e6-8fca-6db6cbb6c51f None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:26.683862 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563d3fb-8518-4e6e-a105-d4afd18cb4ca None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:26.716822 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed791ec-ae06-448d-a51d-0a4c4e0efad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:26.717530 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed791ec-ae06-448d-a51d-0a4c4e0efad1 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:26.717815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed791ec-ae06-448d-a51d-0a4c4e0efad1 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:26.718091 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed791ec-ae06-448d-a51d-0a4c4e0efad1 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:26.718844 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed791ec-ae06-448d-a51d-0a4c4e0efad1 None admin] RBAC: Adding query filter params (name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:26.719155 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed791ec-ae06-448d-a51d-0a4c4e0efad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:26.721407 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed791ec-ae06-448d-a51d-0a4c4e0efad1 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:26.729667 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 278/572] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:33:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:26.730911 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1589c49-a17f-47cb-8fa6-ee9e55ab1822 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:26.731205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1589c49-a17f-47cb-8fa6-ee9e55ab1822 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:26.731484 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1589c49-a17f-47cb-8fa6-ee9e55ab1822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:26.749304 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-d1589c49-a17f-47cb-8fa6-ee9e55ab1822 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:26.750597 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-d1589c49-a17f-47cb-8fa6-ee9e55ab1822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:26.768793 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddb8de-674f-47e6-8fca-6db6cbb6c51f None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:26.803080 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbcb24-37e3-4dfd-98a7-faf62b3fd01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:26.803884 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbcb24-37e3-4dfd-98a7-faf62b3fd01e None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:26.804164 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbcb24-37e3-4dfd-98a7-faf62b3fd01e None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:26.804434 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbcb24-37e3-4dfd-98a7-faf62b3fd01e None admin] PATH_INFO: `/v3/users/glance` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:26.811722 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dbcb24-37e3-4dfd-98a7-faf62b3fd01e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:26.813276 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dbcb24-37e3-4dfd-98a7-faf62b3fd01e None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:26.818645 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 279/573] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:33:26.819517 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1589c49-a17f-47cb-8fa6-ee9e55ab1822 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:26.838377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-f2dbcb24-37e3-4dfd-98a7-faf62b3fd01e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 15:33:26.838377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:26.838377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:26.838377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:26.838377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:26.838377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:26.838377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:26.838377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:26.838377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:26.838377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:26.838377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:26.838377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:26.838377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:33:26.838377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:33:26.838377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:33:26.838377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:33:26.839567 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:26.839567 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:26.839567 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:33:26.839567 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:26.839567 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:33:26.839567 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:26.839567 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:26.839567 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:26.839567 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:26.839567 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:26.839567 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:26.839567 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:26.839567 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:26.839567 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:26.839567 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:26.839567 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:26.839567 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:26.839567 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:26.840587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:26.840587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:26.840587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:33:26.840587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:33:26.840587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:33:26.840587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:33:26.840587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:33:26.840587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:33:26.840587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 15:33:26.840587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:26.840587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 295/574] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:33:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:26.841221 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbcb24-37e3-4dfd-98a7-faf62b3fd01e None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:26.922427 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1589c49-a17f-47cb-8fa6-ee9e55ab1822 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:26.942699 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbcb24-37e3-4dfd-98a7-faf62b3fd01e None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:26.955956 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd02ea-d601-4f16-b710-246336f99c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:26.956625 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd02ea-d601-4f16-b710-246336f99c5f None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:26.956907 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd02ea-d601-4f16-b710-246336f99c5f None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:26.957181 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd02ea-d601-4f16-b710-246336f99c5f None admin] PATH_INFO: `/v3/projects` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:26.958018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd02ea-d601-4f16-b710-246336f99c5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:26.958328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd02ea-d601-4f16-b710-246336f99c5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:26.959774 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd02ea-d601-4f16-b710-246336f99c5f None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:26.972560 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 280/575] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:33:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:26.973432 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd02ea-d601-4f16-b710-246336f99c5f None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:26.977033 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169edba-5307-4e34-b293-20b582753132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:26.977900 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169edba-5307-4e34-b293-20b582753132 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:26.978189 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169edba-5307-4e34-b293-20b582753132 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:26.978475 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169edba-5307-4e34-b293-20b582753132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:26.990084 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169edba-5307-4e34-b293-20b582753132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:26.991574 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169edba-5307-4e34-b293-20b582753132 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:27.009815 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-b169edba-5307-4e34-b293-20b582753132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:27.009815 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:27.009815 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:27.009815 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:27.009815 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:27.009815 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:27.009815 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:27.009815 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:27.009815 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:27.009815 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:27.009815 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:27.009815 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:27.009815 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:27.009815 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:27.009815 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:27.010899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:27.010899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:27.010899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:27.010899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:27.010899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:27.010899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:27.010899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:27.010899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:27.010899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:27.010899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:27.010899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:27.010899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:27.010899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:27.010899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:27.010899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:27.010899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:27.010899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:27.011886 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:27.011886 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:27.011886 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:27.011886 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:27.011886 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 296/576] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:27.011886 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169edba-5307-4e34-b293-20b582753132 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:27.075228 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd02ea-d601-4f16-b710-246336f99c5f None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:27.114793 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2daa31-c4b3-430f-9a06-c703ec97f255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:27.115608 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2daa31-c4b3-430f-9a06-c703ec97f255 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:27.115897 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2daa31-c4b3-430f-9a06-c703ec97f255 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:27.116180 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2daa31-c4b3-430f-9a06-c703ec97f255 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:27.120165 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169edba-5307-4e34-b293-20b582753132 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:27.127852 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2daa31-c4b3-430f-9a06-c703ec97f255 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:27.129392 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2daa31-c4b3-430f-9a06-c703ec97f255 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:27.147817 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-bb2daa31-c4b3-430f-9a06-c703ec97f255 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:27.147817 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:27.147817 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:27.147817 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:27.147817 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:27.147817 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:27.147817 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:27.147817 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:27.147817 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:27.147817 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:27.147817 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:27.147817 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:27.147817 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:27.147817 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:27.147817 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:27.148966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:27.148966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:27.148966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:27.148966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:27.148966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:27.148966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:27.148966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:27.148966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:27.148966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:27.148966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:27.148966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:27.148966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:27.148966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:27.148966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:27.148966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:27.148966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:27.148966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:27.150238 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:27.150238 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:27.150238 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:27.150238 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:27.150238 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 281/577] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:27.150238 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2daa31-c4b3-430f-9a06-c703ec97f255 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:27.160672 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e3cb5-2661-4c34-84b7-b59f9c61766b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:27.161348 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e3cb5-2661-4c34-84b7-b59f9c61766b None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:27.161348 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e3cb5-2661-4c34-84b7-b59f9c61766b None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:27.161348 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e3cb5-2661-4c34-84b7-b59f9c61766b None admin] PATH_INFO: `/v3/roles/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:27.172660 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e3cb5-2661-4c34-84b7-b59f9c61766b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:27.181020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-5b6e3cb5-2661-4c34-84b7-b59f9c61766b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:27.181020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:27.181020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:27.181020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:27.181020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:27.181020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:27.181020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:27.181020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:27.181020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:27.181020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:27.181020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:27.181020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:27.181020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:27.181020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:27.181020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:27.181020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:27.182255 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:27.182255 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:27.182255 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:27.182255 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:27.182255 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:27.182255 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:27.182255 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:27.182255 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:27.182255 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:27.182255 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:27.182255 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:27.182255 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:27.182255 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:27.182255 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:27.182255 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:27.182255 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:27.183175 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:27.183175 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:27.183175 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:27.183175 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:27.183175 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:27.183175 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:27.183175 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:27.183175 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:27.183175 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:27.183175 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:27.183175 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:27.183175 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:27.183175 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 297/578] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:33:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:27.183175 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e3cb5-2661-4c34-84b7-b59f9c61766b None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:27.257825 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2daa31-c4b3-430f-9a06-c703ec97f255 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:27.287855 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e3cb5-2661-4c34-84b7-b59f9c61766b None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:27.293237 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0155847-e4cb-499c-b8e8-b7b09b4ef10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:27.294027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0155847-e4cb-499c-b8e8-b7b09b4ef10a None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:27.294224 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0155847-e4cb-499c-b8e8-b7b09b4ef10a None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:27.294555 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0155847-e4cb-499c-b8e8-b7b09b4ef10a None admin] PATH_INFO: `/v3/users` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:27.295355 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0155847-e4cb-499c-b8e8-b7b09b4ef10a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:27.295665 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0155847-e4cb-499c-b8e8-b7b09b4ef10a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:27.297130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0155847-e4cb-499c-b8e8-b7b09b4ef10a None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:27.314559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 282/579] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 9 15:33:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:27.315471 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0155847-e4cb-499c-b8e8-b7b09b4ef10a None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:27.332890 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6dbe5-1e3a-4d6d-b05a-4f9e216acc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:27.333587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6dbe5-1e3a-4d6d-b05a-4f9e216acc29 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:27.333874 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6dbe5-1e3a-4d6d-b05a-4f9e216acc29 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:27.334156 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6dbe5-1e3a-4d6d-b05a-4f9e216acc29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:27.335003 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6dbe5-1e3a-4d6d-b05a-4f9e216acc29 None admin] RBAC: Adding query filter params (role.id=b22352a378fb404d90e3b3ae182757ad, scope.project.id=db5768a93e754372808fc69f898cc853, user.id=6e553afd9da345b29b3b164e34e5a506) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:27.335323 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6dbe5-1e3a-4d6d-b05a-4f9e216acc29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:27.336764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6dbe5-1e3a-4d6d-b05a-4f9e216acc29 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:27.342320 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 298/580] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:33:27 2022] GET /identity/v3/role_assignments?user.id=6e553afd9da345b29b3b164e34e5a506&scope.project.id=db5768a93e754372808fc69f898cc853&role.id=b22352a378fb404d90e3b3ae182757ad => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:27.343131 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6dbe5-1e3a-4d6d-b05a-4f9e216acc29 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:27.427032 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0155847-e4cb-499c-b8e8-b7b09b4ef10a None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:27.460144 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6dbe5-1e3a-4d6d-b05a-4f9e216acc29 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:27.468542 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a06854-e7f9-4b33-8ebe-2b9219a7230f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:27.469226 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a06854-e7f9-4b33-8ebe-2b9219a7230f None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:27.470547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a06854-e7f9-4b33-8ebe-2b9219a7230f None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:27.470825 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a06854-e7f9-4b33-8ebe-2b9219a7230f None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:27.471571 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a06854-e7f9-4b33-8ebe-2b9219a7230f None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:27.471877 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a06854-e7f9-4b33-8ebe-2b9219a7230f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:27.473310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a06854-e7f9-4b33-8ebe-2b9219a7230f None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:27.486319 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 283/581] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:27.487666 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a06854-e7f9-4b33-8ebe-2b9219a7230f None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:27.508352 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4e83a-828b-4b43-9055-45ff568c145b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:27.509259 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4e83a-828b-4b43-9055-45ff568c145b None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:27.509588 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4e83a-828b-4b43-9055-45ff568c145b None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:27.510088 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4e83a-828b-4b43-9055-45ff568c145b None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:27.511287 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4e83a-828b-4b43-9055-45ff568c145b None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:27.511610 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4e83a-828b-4b43-9055-45ff568c145b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:27.513051 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4e83a-828b-4b43-9055-45ff568c145b None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:27.530114 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 299/582] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:27.531034 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4e83a-828b-4b43-9055-45ff568c145b None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:27.606236 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a06854-e7f9-4b33-8ebe-2b9219a7230f None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:27.649995 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19350e2c-17bc-46ea-b901-d3db92a5cc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:27.650673 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19350e2c-17bc-46ea-b901-d3db92a5cc2e None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:27.651051 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19350e2c-17bc-46ea-b901-d3db92a5cc2e None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:27.651215 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19350e2c-17bc-46ea-b901-d3db92a5cc2e None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:27.651985 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19350e2c-17bc-46ea-b901-d3db92a5cc2e None admin] RBAC: Adding query filter params (name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:27.652377 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19350e2c-17bc-46ea-b901-d3db92a5cc2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:27.653826 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19350e2c-17bc-46ea-b901-d3db92a5cc2e None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:27.661928 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4e83a-828b-4b43-9055-45ff568c145b None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:27.667761 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 284/583] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:33:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:27.667761 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19350e2c-17bc-46ea-b901-d3db92a5cc2e None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:27.703365 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827178e-19a4-4202-9419-ff287b1b9c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:27.704354 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827178e-19a4-4202-9419-ff287b1b9c88 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:27.704709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827178e-19a4-4202-9419-ff287b1b9c88 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:27.705045 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827178e-19a4-4202-9419-ff287b1b9c88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:27.716694 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827178e-19a4-4202-9419-ff287b1b9c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:27.717398 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827178e-19a4-4202-9419-ff287b1b9c88 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:27.737141 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-c827178e-19a4-4202-9419-ff287b1b9c88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:27.737141 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:27.737141 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:27.737141 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:27.737141 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:27.737141 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:27.737141 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:27.737141 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:27.737141 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:27.737141 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:27.737141 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:27.737141 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:27.737141 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:27.737141 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:27.737141 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:27.738396 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:27.738396 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:27.738396 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:27.738396 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:27.738396 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:27.738396 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:27.738396 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:27.738396 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:27.738396 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:27.738396 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:27.738396 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:27.738396 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:27.738396 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:27.738396 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:27.738396 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:27.738396 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:27.738396 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:27.739524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:27.739524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:27.739524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:27.739524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:27.739524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 300/584] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:27.743532 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827178e-19a4-4202-9419-ff287b1b9c88 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:27.783595 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19350e2c-17bc-46ea-b901-d3db92a5cc2e None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:27.822382 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ad21d-bde6-49da-ad62-b3e01bdf1366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:27.823285 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ad21d-bde6-49da-ad62-b3e01bdf1366 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:27.823639 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ad21d-bde6-49da-ad62-b3e01bdf1366 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:27.823988 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ad21d-bde6-49da-ad62-b3e01bdf1366 None admin] PATH_INFO: `/v3/projects/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:27.833755 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ad21d-bde6-49da-ad62-b3e01bdf1366 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:27.835320 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ad21d-bde6-49da-ad62-b3e01bdf1366 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:27.850605 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827178e-19a4-4202-9419-ff287b1b9c88 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:27.851905 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-154ad21d-bde6-49da-ad62-b3e01bdf1366 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:27.851905 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:27.851905 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:27.851905 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:27.851905 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:27.851905 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:27.851905 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:27.851905 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:27.851905 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:27.851905 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:27.851905 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:27.851905 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:27.851905 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:33:27.851905 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:33:27.851905 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:33:27.852983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:33:27.852983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:27.852983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:27.852983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:27.852983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:27.852983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:27.852983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:27.852983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:27.852983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:27.852983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:27.852983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:27.852983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:27.852983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:27.852983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:27.852983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:27.852983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:27.852983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:27.854201 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:33:27.854201 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:33:27.854201 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:33:27.854201 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:33:27.854201 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:33:27.854201 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:33:27.854201 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:27.854201 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:27.857690 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 285/585] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:27.858741 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ad21d-bde6-49da-ad62-b3e01bdf1366 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:27.890319 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe067520-15c7-4dd8-b2c2-01e2df194b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:27.891758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe067520-15c7-4dd8-b2c2-01e2df194b25 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:27.892160 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe067520-15c7-4dd8-b2c2-01e2df194b25 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:27.892673 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe067520-15c7-4dd8-b2c2-01e2df194b25 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:27.903608 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe067520-15c7-4dd8-b2c2-01e2df194b25 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:27.905256 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe067520-15c7-4dd8-b2c2-01e2df194b25 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:27.927563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-fe067520-15c7-4dd8-b2c2-01e2df194b25 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:33:27.927563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:27.927563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:27.927563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:27.927563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:27.927563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:27.927563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:27.927563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:27.927563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:27.927563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:27.927563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:27.927563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:27.927563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:33:27.927563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:33:27.927563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:33:27.927563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:33:27.928676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:27.928676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:27.928676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:33:27.928676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:27.928676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:33:27.928676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:27.928676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:27.928676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:27.928676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:27.928676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:27.928676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:27.928676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:27.928676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:27.928676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:27.928676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:27.928676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:27.928676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:27.928676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:27.929732 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:27.929732 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:27.929732 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:33:27.929732 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:33:27.929732 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:33:27.929732 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:33:27.929732 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:33:27.929732 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:33:27.929732 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:33:27.929732 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:27.929732 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 301/586] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:33:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:27.929732 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe067520-15c7-4dd8-b2c2-01e2df194b25 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:27.971346 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ad21d-bde6-49da-ad62-b3e01bdf1366 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:28.005558 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb8879-7c84-481d-9252-f382efcf6640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:28.006361 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb8879-7c84-481d-9252-f382efcf6640 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:28.006655 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb8879-7c84-481d-9252-f382efcf6640 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:28.006938 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb8879-7c84-481d-9252-f382efcf6640 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:28.017702 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb8879-7c84-481d-9252-f382efcf6640 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:28.019164 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb8879-7c84-481d-9252-f382efcf6640 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:28.032050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe067520-15c7-4dd8-b2c2-01e2df194b25 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:28.037205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-05cb8879-7c84-481d-9252-f382efcf6640 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:28.037205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:28.037205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:28.037205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:28.037205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:28.037205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:28.037205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:28.037205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:28.037205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:28.037205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:28.037205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:28.037205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:28.037205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:28.037205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:28.037205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:28.038229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:28.038229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:28.038229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:28.038229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:28.038229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:28.038229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:28.038229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:28.038229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:28.038229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:28.038229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:28.038229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:28.038229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:28.038229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:28.038229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:28.038229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:28.038229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:28.038229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:28.044194 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:28.044194 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:28.044194 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:28.044194 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:28.044194 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 286/587] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:28.044194 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb8879-7c84-481d-9252-f382efcf6640 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:28.074378 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2db84-860c-4036-8cd8-1e60bafd830f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:28.075053 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2db84-860c-4036-8cd8-1e60bafd830f None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:28.075336 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2db84-860c-4036-8cd8-1e60bafd830f None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:28.075616 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2db84-860c-4036-8cd8-1e60bafd830f None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:28.076347 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f2db84-860c-4036-8cd8-1e60bafd830f None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:28.076655 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f2db84-860c-4036-8cd8-1e60bafd830f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:28.078067 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f2db84-860c-4036-8cd8-1e60bafd830f None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:28.092305 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 302/588] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:28.093406 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2db84-860c-4036-8cd8-1e60bafd830f None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:28.163659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb8879-7c84-481d-9252-f382efcf6640 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:28.210849 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3b91a-546f-4545-8c2e-7185424776aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:28.211523 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3b91a-546f-4545-8c2e-7185424776aa None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:28.211807 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3b91a-546f-4545-8c2e-7185424776aa None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:28.212082 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3b91a-546f-4545-8c2e-7185424776aa None admin] PATH_INFO: `/v3/projects` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:28.212873 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3b91a-546f-4545-8c2e-7185424776aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:28.213181 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3b91a-546f-4545-8c2e-7185424776aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:28.214684 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3b91a-546f-4545-8c2e-7185424776aa None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:28.216974 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f2db84-860c-4036-8cd8-1e60bafd830f None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:28.228511 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 287/589] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:33:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:28.229058 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3b91a-546f-4545-8c2e-7185424776aa None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:28.258815 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6de5a5-9c3d-42bb-98aa-856f0b563870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:28.259505 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6de5a5-9c3d-42bb-98aa-856f0b563870 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:28.259778 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6de5a5-9c3d-42bb-98aa-856f0b563870 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:28.260058 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6de5a5-9c3d-42bb-98aa-856f0b563870 None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:28.260903 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6de5a5-9c3d-42bb-98aa-856f0b563870 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:28.261424 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6de5a5-9c3d-42bb-98aa-856f0b563870 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:28.262666 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6de5a5-9c3d-42bb-98aa-856f0b563870 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:28.280940 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 303/590] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 9 15:33:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:28.282794 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6de5a5-9c3d-42bb-98aa-856f0b563870 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:28.335692 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3b91a-546f-4545-8c2e-7185424776aa None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:28.373211 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ad1f5-5476-4543-9a28-feaefbf1beb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:28.373902 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ad1f5-5476-4543-9a28-feaefbf1beb6 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:28.374185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ad1f5-5476-4543-9a28-feaefbf1beb6 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:28.374460 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ad1f5-5476-4543-9a28-feaefbf1beb6 None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:28.375185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ad1f5-5476-4543-9a28-feaefbf1beb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:28.375486 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ad1f5-5476-4543-9a28-feaefbf1beb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:28.376931 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ad1f5-5476-4543-9a28-feaefbf1beb6 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:28.392997 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 288/591] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:28.392997 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ad1f5-5476-4543-9a28-feaefbf1beb6 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:28.400339 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6de5a5-9c3d-42bb-98aa-856f0b563870 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:28.436854 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63c49a-2670-45ac-80ad-64cf3775f50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:28.437916 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63c49a-2670-45ac-80ad-64cf3775f50b None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:28.438624 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63c49a-2670-45ac-80ad-64cf3775f50b None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:28.438903 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63c49a-2670-45ac-80ad-64cf3775f50b None admin] PATH_INFO: `/v3/projects/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:28.446258 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63c49a-2670-45ac-80ad-64cf3775f50b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:28.447755 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63c49a-2670-45ac-80ad-64cf3775f50b None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:28.461684 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-9b63c49a-2670-45ac-80ad-64cf3775f50b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:28.461684 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:28.461684 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:28.461684 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:28.461684 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:28.461684 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:28.461684 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:28.461684 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:28.461684 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:28.461684 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:28.461684 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:28.461684 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:28.461684 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:33:28.461684 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:33:28.461684 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:33:28.462763 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:33:28.462763 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:28.462763 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:28.462763 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:28.462763 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:28.462763 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:28.462763 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:28.462763 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:28.462763 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:28.462763 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:28.462763 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:28.462763 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:28.462763 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:28.462763 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:28.462763 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:28.462763 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:28.462763 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:28.463764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:33:28.463764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:33:28.463764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:33:28.463764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:33:28.463764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:33:28.463764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:33:28.463764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:28.463764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:28.463764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 304/592] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:28.463764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63c49a-2670-45ac-80ad-64cf3775f50b None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:28.499998 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ad1f5-5476-4543-9a28-feaefbf1beb6 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:28.548751 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812532d-fced-41d8-a3af-cea3f0b1001d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:28.549791 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812532d-fced-41d8-a3af-cea3f0b1001d None admin] REQUEST_METHOD: `PUT` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:28.550139 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812532d-fced-41d8-a3af-cea3f0b1001d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:28.550425 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812532d-fced-41d8-a3af-cea3f0b1001d None admin] PATH_INFO: `/v3/projects/db5768a93e754372808fc69f898cc853/users/d398283fc99c4bfe83170ad3d1538f38/roles/b22352a378fb404d90e3b3ae182757ad` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:28.566487 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812532d-fced-41d8-a3af-cea3f0b1001d None admin] RBAC: Authorizing `identity:create_grant(project_id=db5768a93e754372808fc69f898cc853, user_id=d398283fc99c4bfe83170ad3d1538f38, role_id=b22352a378fb404d90e3b3ae182757ad)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:28.567942 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812532d-fced-41d8-a3af-cea3f0b1001d None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:28.568066 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63c49a-2670-45ac-80ad-64cf3775f50b None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:28.582877 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 289/593] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:33:28 2022] PUT /identity/v3/projects/db5768a93e754372808fc69f898cc853/users/d398283fc99c4bfe83170ad3d1538f38/roles/b22352a378fb404d90e3b3ae182757ad => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:33:28.583506 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812532d-fced-41d8-a3af-cea3f0b1001d None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:28.621715 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e2d23-94cb-4a0c-a7bb-5d4960797834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:28.622603 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e2d23-94cb-4a0c-a7bb-5d4960797834 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:28.622889 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e2d23-94cb-4a0c-a7bb-5d4960797834 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:28.623568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e2d23-94cb-4a0c-a7bb-5d4960797834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:28.635998 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e2d23-94cb-4a0c-a7bb-5d4960797834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:28.638095 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e2d23-94cb-4a0c-a7bb-5d4960797834 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:28.657746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-ca5e2d23-94cb-4a0c-a7bb-5d4960797834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:28.657746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:28.657746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:28.657746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:28.657746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:28.657746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:28.657746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:28.657746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:28.657746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:28.657746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:28.657746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:28.657746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:28.657746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:28.657746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:28.657746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:28.658821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:28.658821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:28.658821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:28.658821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:28.658821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:28.658821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:28.658821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:28.658821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:28.658821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:28.658821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:28.658821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:28.658821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:28.658821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:28.658821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:28.658821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:28.658821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:28.658821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:28.659800 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:28.659800 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:28.659800 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:28.659800 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:28.664249 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 305/594] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:28.665291 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e2d23-94cb-4a0c-a7bb-5d4960797834 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:28.710281 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812532d-fced-41d8-a3af-cea3f0b1001d None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:28.750212 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f0987-6d94-416c-aa42-03cfba35250e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:28.751482 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f0987-6d94-416c-aa42-03cfba35250e None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:28.751979 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f0987-6d94-416c-aa42-03cfba35250e None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:28.752460 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f0987-6d94-416c-aa42-03cfba35250e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:28.761106 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f0987-6d94-416c-aa42-03cfba35250e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:28.763064 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f0987-6d94-416c-aa42-03cfba35250e None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:28.779855 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-e43f0987-6d94-416c-aa42-03cfba35250e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:33:28.779855 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:28.779855 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:28.779855 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:28.779855 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:28.779855 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:28.779855 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:28.779855 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:28.779855 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:28.779855 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:28.779855 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:28.779855 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:28.779855 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:33:28.779855 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:33:28.779855 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:33:28.779855 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:33:28.780947 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:28.780947 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:28.780947 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:33:28.780947 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:28.780947 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:33:28.780947 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:28.780947 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:28.780947 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:28.780947 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:28.780947 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:28.780947 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:28.780947 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:28.780947 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:28.780947 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:28.780947 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:28.780947 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:28.780947 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:28.780947 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:28.782482 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:28.782482 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:28.782482 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:33:28.782482 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:33:28.782482 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:33:28.782482 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:33:28.782482 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:33:28.782482 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:33:28.782482 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:33:28.782482 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:28.783061 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e2d23-94cb-4a0c-a7bb-5d4960797834 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:28.785077 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 290/595] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:33:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:28.786319 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f0987-6d94-416c-aa42-03cfba35250e None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:28.824446 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c61e7-1d79-4163-9376-5487cf01570c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:28.825177 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c61e7-1d79-4163-9376-5487cf01570c None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:28.825507 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c61e7-1d79-4163-9376-5487cf01570c None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:28.825787 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c61e7-1d79-4163-9376-5487cf01570c None admin] PATH_INFO: `/v3/projects` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:28.826586 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c61e7-1d79-4163-9376-5487cf01570c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:28.826896 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c61e7-1d79-4163-9376-5487cf01570c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:28.828343 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c61e7-1d79-4163-9376-5487cf01570c None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:28.844128 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 306/596] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:33:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:28.845808 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c61e7-1d79-4163-9376-5487cf01570c None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:28.916071 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f0987-6d94-416c-aa42-03cfba35250e None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:28.952345 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b07fe4-3991-4066-8304-cacdf74d018a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:28.953054 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b07fe4-3991-4066-8304-cacdf74d018a None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:28.953329 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b07fe4-3991-4066-8304-cacdf74d018a None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:28.954059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b07fe4-3991-4066-8304-cacdf74d018a None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:28.955263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b07fe4-3991-4066-8304-cacdf74d018a None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:28.955578 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b07fe4-3991-4066-8304-cacdf74d018a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:28.956972 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b07fe4-3991-4066-8304-cacdf74d018a None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:28.968500 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 291/597] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:28.969780 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b07fe4-3991-4066-8304-cacdf74d018a None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:28.980166 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c61e7-1d79-4163-9376-5487cf01570c None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:29.025647 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802caaec-f5d7-4343-b9fb-d40f6d57bbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:29.026284 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802caaec-f5d7-4343-b9fb-d40f6d57bbd3 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:29.026577 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802caaec-f5d7-4343-b9fb-d40f6d57bbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:29.026860 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802caaec-f5d7-4343-b9fb-d40f6d57bbd3 None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:29.027724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802caaec-f5d7-4343-b9fb-d40f6d57bbd3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:29.028037 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802caaec-f5d7-4343-b9fb-d40f6d57bbd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:29.029517 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802caaec-f5d7-4343-b9fb-d40f6d57bbd3 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:29.052701 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 307/598] 10.222.0.48 () {56 vars in 1139 bytes} [Mon May 9 15:33:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:29.053681 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802caaec-f5d7-4343-b9fb-d40f6d57bbd3 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:29.093781 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b07fe4-3991-4066-8304-cacdf74d018a None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:29.142308 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014e8f3-8db3-49d4-8526-f6a7c2b218c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:29.143865 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014e8f3-8db3-49d4-8526-f6a7c2b218c4 None admin] REQUEST_METHOD: `PUT` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:29.144517 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014e8f3-8db3-49d4-8526-f6a7c2b218c4 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:29.145335 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014e8f3-8db3-49d4-8526-f6a7c2b218c4 None admin] PATH_INFO: `/v3/projects/db5768a93e754372808fc69f898cc853/users/bf5867b42cf64de3aafef27b7ed99c28/roles/b22352a378fb404d90e3b3ae182757ad` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:29.164203 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802caaec-f5d7-4343-b9fb-d40f6d57bbd3 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:29.165675 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014e8f3-8db3-49d4-8526-f6a7c2b218c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=db5768a93e754372808fc69f898cc853, user_id=bf5867b42cf64de3aafef27b7ed99c28, role_id=b22352a378fb404d90e3b3ae182757ad)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:29.167385 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014e8f3-8db3-49d4-8526-f6a7c2b218c4 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:29.184126 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 292/599] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:33:28 2022] PUT /identity/v3/projects/db5768a93e754372808fc69f898cc853/users/bf5867b42cf64de3aafef27b7ed99c28/roles/b22352a378fb404d90e3b3ae182757ad => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:33:29.185320 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014e8f3-8db3-49d4-8526-f6a7c2b218c4 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:29.229312 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cada31b-9806-42bd-95e2-6cff3dbfe43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:29.231582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cada31b-9806-42bd-95e2-6cff3dbfe43c None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:29.233773 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cada31b-9806-42bd-95e2-6cff3dbfe43c None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:29.234357 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cada31b-9806-42bd-95e2-6cff3dbfe43c None admin] PATH_INFO: `/v3/projects/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:29.248437 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cada31b-9806-42bd-95e2-6cff3dbfe43c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:29.253703 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cada31b-9806-42bd-95e2-6cff3dbfe43c None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:29.271309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-6cada31b-9806-42bd-95e2-6cff3dbfe43c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:29.271309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:29.271309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:29.271309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:29.271309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:29.271309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:29.271309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:29.271309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:29.271309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:29.271309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:29.271309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:29.271309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:29.271309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:33:29.271309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:33:29.271309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:33:29.272360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:33:29.272360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:29.272360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:29.272360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:29.272360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:29.272360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:29.272360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:29.272360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:29.272360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:29.272360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:29.272360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:29.272360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:29.272360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:29.272360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:29.272360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:29.272360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:29.272360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:29.273318 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:33:29.273318 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:33:29.273318 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:33:29.273318 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:33:29.273318 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:33:29.273318 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:33:29.273318 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:29.273318 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:29.276055 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 308/600] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:29.286090 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cada31b-9806-42bd-95e2-6cff3dbfe43c None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:29.380437 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014e8f3-8db3-49d4-8526-f6a7c2b218c4 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:29.426098 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6005e-a5b3-4862-aeb3-967098ee7707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:29.426912 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6005e-a5b3-4862-aeb3-967098ee7707 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:29.427191 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6005e-a5b3-4862-aeb3-967098ee7707 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:29.427467 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6005e-a5b3-4862-aeb3-967098ee7707 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:29.441713 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6005e-a5b3-4862-aeb3-967098ee7707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:29.443675 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6005e-a5b3-4862-aeb3-967098ee7707 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:29.467289 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-d7b6005e-a5b3-4862-aeb3-967098ee7707 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:29.467289 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:29.467289 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:29.467289 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:29.467289 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:29.467289 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:29.467289 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:29.467289 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:29.467289 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:29.467289 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:29.467289 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:29.467289 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:29.467289 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:29.467289 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:29.467289 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:29.468314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:29.468314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:29.468314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:29.468314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:29.468314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:29.468314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:29.468314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:29.468314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:29.468314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:29.468314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:29.468314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:29.468314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:29.468314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:29.468314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:29.468314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:29.468314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:29.468314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:29.470081 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:29.470081 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:29.470081 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:29.470081 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:29.470081 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 293/601] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:29.474885 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cada31b-9806-42bd-95e2-6cff3dbfe43c None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:29.475783 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6005e-a5b3-4862-aeb3-967098ee7707 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:29.517168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf830d23-8581-41a4-b2d4-4f827cc478ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:29.517938 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf830d23-8581-41a4-b2d4-4f827cc478ff None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:29.518226 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf830d23-8581-41a4-b2d4-4f827cc478ff None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:29.518509 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf830d23-8581-41a4-b2d4-4f827cc478ff None admin] PATH_INFO: `/v3/projects` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:29.519338 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf830d23-8581-41a4-b2d4-4f827cc478ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:29.519653 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf830d23-8581-41a4-b2d4-4f827cc478ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:29.521157 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf830d23-8581-41a4-b2d4-4f827cc478ff None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:29.541604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 309/602] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:33:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:29.543846 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf830d23-8581-41a4-b2d4-4f827cc478ff None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:29.601834 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6005e-a5b3-4862-aeb3-967098ee7707 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:29.642106 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b7ba0-8a96-430a-aba2-7987371aaa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:29.642786 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b7ba0-8a96-430a-aba2-7987371aaa42 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:29.643745 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b7ba0-8a96-430a-aba2-7987371aaa42 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:29.644052 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b7ba0-8a96-430a-aba2-7987371aaa42 None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:29.649496 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b7ba0-8a96-430a-aba2-7987371aaa42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:29.649496 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b7ba0-8a96-430a-aba2-7987371aaa42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:29.649496 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b7ba0-8a96-430a-aba2-7987371aaa42 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:29.662147 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 294/603] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:29.674814 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b7ba0-8a96-430a-aba2-7987371aaa42 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:29.733029 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf830d23-8581-41a4-b2d4-4f827cc478ff None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:29.779980 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e588e1-ff9e-48e9-8f15-f87af17700da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:29.781176 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e588e1-ff9e-48e9-8f15-f87af17700da None admin] REQUEST_METHOD: `PUT` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:29.782711 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e588e1-ff9e-48e9-8f15-f87af17700da None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:29.783153 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e588e1-ff9e-48e9-8f15-f87af17700da None admin] PATH_INFO: `/v3/projects/db5768a93e754372808fc69f898cc853/users/673a97c146144369937b1288797ab1ba/roles/b22352a378fb404d90e3b3ae182757ad` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:29.804531 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e588e1-ff9e-48e9-8f15-f87af17700da None admin] RBAC: Authorizing `identity:create_grant(project_id=db5768a93e754372808fc69f898cc853, user_id=673a97c146144369937b1288797ab1ba, role_id=b22352a378fb404d90e3b3ae182757ad)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:29.806115 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e588e1-ff9e-48e9-8f15-f87af17700da None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:29.812804 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b7ba0-8a96-430a-aba2-7987371aaa42 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:29.822444 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 310/604] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:33:29 2022] PUT /identity/v3/projects/db5768a93e754372808fc69f898cc853/users/673a97c146144369937b1288797ab1ba/roles/b22352a378fb404d90e3b3ae182757ad => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:33:29.824791 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c18604-7daa-4857-8077-b7a1fcaa1c82 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:29.825315 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c18604-7daa-4857-8077-b7a1fcaa1c82 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:29.825967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c18604-7daa-4857-8077-b7a1fcaa1c82 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:29.833704 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 311/605] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:29.835110 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc19689-0b11-43bf-898f-7b130285f765 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:29.835406 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc19689-0b11-43bf-898f-7b130285f765 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:29.835688 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc19689-0b11-43bf-898f-7b130285f765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:29.859729 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-cfc19689-0b11-43bf-898f-7b130285f765 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:29.861121 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-cfc19689-0b11-43bf-898f-7b130285f765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:29.872776 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e4d02-6b2e-496c-a81c-f7878153d74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:29.874032 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e4d02-6b2e-496c-a81c-f7878153d74e None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:29.875248 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e4d02-6b2e-496c-a81c-f7878153d74e None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:29.876399 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e4d02-6b2e-496c-a81c-f7878153d74e None admin] PATH_INFO: `/v3/projects/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:29.886550 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e4d02-6b2e-496c-a81c-f7878153d74e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:29.889018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e4d02-6b2e-496c-a81c-f7878153d74e None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:29.911652 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-fe1e4d02-6b2e-496c-a81c-f7878153d74e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:29.911652 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:29.911652 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:29.911652 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:29.911652 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:29.911652 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:29.911652 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:29.911652 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:29.911652 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:29.911652 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:29.911652 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:29.911652 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:29.911652 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:33:29.911652 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:33:29.911652 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:33:29.912969 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:33:29.912969 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:29.912969 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:29.912969 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:29.912969 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:29.912969 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:29.912969 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:29.912969 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:29.912969 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:29.912969 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:29.912969 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:29.912969 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:29.912969 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:29.912969 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:29.912969 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:29.912969 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:29.912969 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:29.914257 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:33:29.914257 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:33:29.914257 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:33:29.914257 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:33:29.914257 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:33:29.914257 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:33:29.914257 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:29.914257 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:29.916905 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 295/606] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:29.927481 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e4d02-6b2e-496c-a81c-f7878153d74e None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:30.008588 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 312/607] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:33:30.040716 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc19689-0b11-43bf-898f-7b130285f765 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:30.096586 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e4d02-6b2e-496c-a81c-f7878153d74e None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:30.149084 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3cdfcb-8c95-40ab-a7cf-11859592f7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:30.150530 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cdfcb-8c95-40ab-a7cf-11859592f7b8 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:30.151035 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cdfcb-8c95-40ab-a7cf-11859592f7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:30.151679 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cdfcb-8c95-40ab-a7cf-11859592f7b8 None admin] PATH_INFO: `/v3/projects` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:30.152987 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3cdfcb-8c95-40ab-a7cf-11859592f7b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:30.153921 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3cdfcb-8c95-40ab-a7cf-11859592f7b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:30.156056 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3cdfcb-8c95-40ab-a7cf-11859592f7b8 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:30.175531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 296/608] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:33:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:30.185960 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3cdfcb-8c95-40ab-a7cf-11859592f7b8 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:30.219296 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc19689-0b11-43bf-898f-7b130285f765 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:30.272381 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084c658-5665-4783-8432-35bd6afaf790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:30.273198 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084c658-5665-4783-8432-35bd6afaf790 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:30.273510 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084c658-5665-4783-8432-35bd6afaf790 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:30.273787 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084c658-5665-4783-8432-35bd6afaf790 None admin] PATH_INFO: `/v3/roles/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:30.296606 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084c658-5665-4783-8432-35bd6afaf790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:30.305967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-6084c658-5665-4783-8432-35bd6afaf790 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:30.305967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:30.305967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:30.305967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:30.305967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:30.305967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:30.305967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:30.305967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:30.305967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:30.305967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:30.305967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:30.305967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:30.305967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:30.305967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:30.305967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:30.305967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:30.307034 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:30.307034 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:30.307034 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:30.307034 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:30.307034 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:30.307034 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:30.307034 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:30.307034 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:30.307034 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:30.307034 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:30.307034 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:30.307034 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:30.307034 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:30.307034 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:30.307034 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:30.307034 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:30.308201 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:30.308201 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:30.308201 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:30.308201 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:30.308201 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:30.308201 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:30.308201 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:30.308201 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:30.308201 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:30.308201 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:30.308201 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:30.308201 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:30.308201 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 313/609] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:33:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:33:30.322587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084c658-5665-4783-8432-35bd6afaf790 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:30.363120 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3cdfcb-8c95-40ab-a7cf-11859592f7b8 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:30.401731 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724b0f4-706e-44cc-a509-28919b8f6f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:30.402628 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724b0f4-706e-44cc-a509-28919b8f6f2c None admin] REQUEST_METHOD: `PUT` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:30.402912 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724b0f4-706e-44cc-a509-28919b8f6f2c None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:30.403264 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724b0f4-706e-44cc-a509-28919b8f6f2c None admin] PATH_INFO: `/v3/projects/db5768a93e754372808fc69f898cc853/users/74924b56be0243eda3144664dd01cc13/roles/b22352a378fb404d90e3b3ae182757ad` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:30.439785 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724b0f4-706e-44cc-a509-28919b8f6f2c None admin] RBAC: Authorizing `identity:create_grant(project_id=db5768a93e754372808fc69f898cc853, user_id=74924b56be0243eda3144664dd01cc13, role_id=b22352a378fb404d90e3b3ae182757ad)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:30.441293 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724b0f4-706e-44cc-a509-28919b8f6f2c None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:30.467363 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 297/610] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:33:30 2022] PUT /identity/v3/projects/db5768a93e754372808fc69f898cc853/users/74924b56be0243eda3144664dd01cc13/roles/b22352a378fb404d90e3b3ae182757ad => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:33:30.498567 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084c658-5665-4783-8432-35bd6afaf790 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:30.545400 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407e03e-5c6f-4718-bcc5-4c5625d6bba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:30.546199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407e03e-5c6f-4718-bcc5-4c5625d6bba9 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:30.546503 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407e03e-5c6f-4718-bcc5-4c5625d6bba9 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:30.546784 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407e03e-5c6f-4718-bcc5-4c5625d6bba9 None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:30.548505 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407e03e-5c6f-4718-bcc5-4c5625d6bba9 None admin] RBAC: Adding query filter params (name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:30.548945 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407e03e-5c6f-4718-bcc5-4c5625d6bba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:30.555012 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407e03e-5c6f-4718-bcc5-4c5625d6bba9 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:30.565531 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 314/611] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:33:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:30.571662 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724b0f4-706e-44cc-a509-28919b8f6f2c None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:30.693886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724b0f4-706e-44cc-a509-28919b8f6f2c None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:30.734293 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d9593-8be4-4e75-b62c-dce20fb31272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:30.735695 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d9593-8be4-4e75-b62c-dce20fb31272 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:30.735959 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d9593-8be4-4e75-b62c-dce20fb31272 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:30.736212 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d9593-8be4-4e75-b62c-dce20fb31272 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:30.748448 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d9593-8be4-4e75-b62c-dce20fb31272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:30.749981 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d9593-8be4-4e75-b62c-dce20fb31272 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:30.770241 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-0d6d9593-8be4-4e75-b62c-dce20fb31272 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:30.770241 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:30.770241 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:30.770241 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:30.770241 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:30.770241 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:30.770241 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:30.770241 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:30.770241 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:30.770241 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:30.770241 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:30.770241 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:30.770241 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:30.770241 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:30.770241 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:30.772534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:30.772534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:30.772534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:30.772534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:30.772534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:30.772534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:30.772534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:30.772534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:30.772534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:30.772534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:30.772534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:30.772534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:30.772534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:30.772534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:30.772534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:30.772534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:30.772534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:30.774819 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:30.774819 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:30.774819 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:30.774819 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:30.774819 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 298/612] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:30.783332 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407e03e-5c6f-4718-bcc5-4c5625d6bba9 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:30.897509 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407e03e-5c6f-4718-bcc5-4c5625d6bba9 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:30.941200 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d3926-55ff-4bfd-ba3a-e673822a991c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:30.941913 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d3926-55ff-4bfd-ba3a-e673822a991c None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:30.942206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d3926-55ff-4bfd-ba3a-e673822a991c None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:30.942494 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d3926-55ff-4bfd-ba3a-e673822a991c None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:30.943244 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d3926-55ff-4bfd-ba3a-e673822a991c None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:30.943560 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d3926-55ff-4bfd-ba3a-e673822a991c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:30.944952 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d3926-55ff-4bfd-ba3a-e673822a991c None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:30.958819 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 315/613] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:30.964068 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d9593-8be4-4e75-b62c-dce20fb31272 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:31.104308 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d9593-8be4-4e75-b62c-dce20fb31272 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:31.145008 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0033d-dc18-4cb8-9931-4170a296440c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:31.145854 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0033d-dc18-4cb8-9931-4170a296440c None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:31.146139 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0033d-dc18-4cb8-9931-4170a296440c None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:31.146419 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0033d-dc18-4cb8-9931-4170a296440c None admin] PATH_INFO: `/v3/users/swift` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:31.154796 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0033d-dc18-4cb8-9931-4170a296440c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:31.156194 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0033d-dc18-4cb8-9931-4170a296440c None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:31.171664 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-0ca0033d-dc18-4cb8-9931-4170a296440c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:33:31.171664 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:31.171664 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:31.171664 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:31.171664 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:31.171664 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:31.171664 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:31.171664 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:31.171664 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:31.171664 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:31.171664 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:31.171664 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:31.171664 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:33:31.171664 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:33:31.171664 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:33:31.171664 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:33:31.174232 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:31.174232 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:31.174232 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:33:31.174232 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:31.174232 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:33:31.174232 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:31.174232 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:31.174232 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:31.174232 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:31.174232 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:31.174232 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:31.174232 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:31.174232 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:31.174232 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:31.174232 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:31.174232 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:31.174232 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:31.174232 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:31.176633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:31.176633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:31.176633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:33:31.176633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:33:31.176633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:33:31.176633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:33:31.176633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:33:31.176633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:33:31.176633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:33:31.176633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:31.176633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 299/614] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:33:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:31.181602 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d3926-55ff-4bfd-ba3a-e673822a991c None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:31.301235 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ada5ed-5910-4f7b-99cb-fa3be307d009 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:31.301951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ada5ed-5910-4f7b-99cb-fa3be307d009 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:31.302462 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ada5ed-5910-4f7b-99cb-fa3be307d009 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:31.304332 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 300/615] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:33:31.309233 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd6220-6c71-4ff0-acbd-c0ca4de75b19 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:31.309828 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd6220-6c71-4ff0-acbd-c0ca4de75b19 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:31.310314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd6220-6c71-4ff0-acbd-c0ca4de75b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:31.334798 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d3926-55ff-4bfd-ba3a-e673822a991c None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:31.346485 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-d1cd6220-6c71-4ff0-acbd-c0ca4de75b19 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:31.347697 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-d1cd6220-6c71-4ff0-acbd-c0ca4de75b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:31.376739 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b8cfd-30bf-47d2-8529-c74b8f180c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:31.377462 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b8cfd-30bf-47d2-8529-c74b8f180c3b None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:31.377725 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b8cfd-30bf-47d2-8529-c74b8f180c3b None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:31.378001 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b8cfd-30bf-47d2-8529-c74b8f180c3b None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:31.378846 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b8cfd-30bf-47d2-8529-c74b8f180c3b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:31.379153 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b8cfd-30bf-47d2-8529-c74b8f180c3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:31.380608 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b8cfd-30bf-47d2-8529-c74b8f180c3b None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:31.412796 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 316/616] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 9 15:33:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:31.419897 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b8cfd-30bf-47d2-8529-c74b8f180c3b None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:31.496253 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 301/617] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:33:31.533150 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b8cfd-30bf-47d2-8529-c74b8f180c3b None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:31.536197 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd6220-6c71-4ff0-acbd-c0ca4de75b19 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:31.567293 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6cec6-faea-4af7-8df0-5a2efe323f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:31.568093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6cec6-faea-4af7-8df0-5a2efe323f1e None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:31.568374 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6cec6-faea-4af7-8df0-5a2efe323f1e None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:31.568646 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6cec6-faea-4af7-8df0-5a2efe323f1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:31.591766 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6cec6-faea-4af7-8df0-5a2efe323f1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:31.593223 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6cec6-faea-4af7-8df0-5a2efe323f1e None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:31.625694 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-b9b6cec6-faea-4af7-8df0-5a2efe323f1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:31.625694 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:31.625694 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:31.625694 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:31.625694 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:31.625694 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:31.625694 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:31.625694 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:31.625694 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:31.625694 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:31.625694 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:31.625694 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:31.625694 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:31.625694 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:31.625694 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:31.626949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:31.626949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:31.626949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:31.626949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:31.626949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:31.626949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:31.626949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:31.626949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:31.626949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:31.626949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:31.626949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:31.626949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:31.626949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:31.626949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:31.626949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:31.626949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:31.626949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:31.628445 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:31.628445 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:31.628445 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:31.628445 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:31.628445 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 317/618] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:31.637767 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6cec6-faea-4af7-8df0-5a2efe323f1e None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:31.731871 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd6220-6c71-4ff0-acbd-c0ca4de75b19 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:31.808646 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a2205-3ecf-4f80-8380-8498e01c6a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:31.809470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a2205-3ecf-4f80-8380-8498e01c6a73 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:31.809751 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a2205-3ecf-4f80-8380-8498e01c6a73 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:31.810024 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a2205-3ecf-4f80-8380-8498e01c6a73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:31.832532 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a2205-3ecf-4f80-8380-8498e01c6a73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:31.840351 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-536a2205-3ecf-4f80-8380-8498e01c6a73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:31.840351 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:31.840351 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:31.840351 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:31.840351 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:31.840351 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:31.840351 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:31.840351 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:31.840351 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:31.840351 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:31.840351 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:31.840351 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:31.840351 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:31.840351 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:31.840351 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:31.840351 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:31.842674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:31.842674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:31.842674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:31.842674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:31.842674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:31.842674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:31.842674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:31.842674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:31.842674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:31.842674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:31.842674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:31.842674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:31.842674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:31.842674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:31.842674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:31.842674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:31.848143 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:31.848143 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:31.848143 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:31.848143 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:31.848143 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:31.848143 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:31.848143 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:31.848143 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:31.848143 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:31.848143 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:31.848143 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:31.848143 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:31.849824 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6cec6-faea-4af7-8df0-5a2efe323f1e None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:31.850330 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 302/619] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:33:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:33:31.853501 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a2205-3ecf-4f80-8380-8498e01c6a73 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:31.881684 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b4eff-8222-4f38-98f1-147b52c08ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:31.882366 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b4eff-8222-4f38-98f1-147b52c08ed6 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:31.882653 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b4eff-8222-4f38-98f1-147b52c08ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:31.882934 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b4eff-8222-4f38-98f1-147b52c08ed6 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:31.883673 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b4eff-8222-4f38-98f1-147b52c08ed6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:31.883983 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b4eff-8222-4f38-98f1-147b52c08ed6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:31.885395 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b4eff-8222-4f38-98f1-147b52c08ed6 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:31.897887 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 318/620] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:31.903211 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b4eff-8222-4f38-98f1-147b52c08ed6 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:32.018141 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b4eff-8222-4f38-98f1-147b52c08ed6 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:32.055928 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277a1ed-d697-4e7d-930a-2d8595c5bf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:32.056743 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277a1ed-d697-4e7d-930a-2d8595c5bf24 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:32.057030 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277a1ed-d697-4e7d-930a-2d8595c5bf24 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:32.057313 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277a1ed-d697-4e7d-930a-2d8595c5bf24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:32.066314 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277a1ed-d697-4e7d-930a-2d8595c5bf24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:32.067936 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277a1ed-d697-4e7d-930a-2d8595c5bf24 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:32.085100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-b277a1ed-d697-4e7d-930a-2d8595c5bf24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:32.085100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:32.085100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:32.085100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:32.085100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:32.085100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:32.085100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:32.085100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:32.085100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:32.085100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:32.085100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:32.085100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:32.085100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:33:32.085100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:33:32.085100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:33:32.087306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:33:32.087306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:32.087306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:32.087306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:32.087306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:32.087306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:32.087306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:32.087306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:32.087306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:32.087306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:32.087306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:32.087306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:32.087306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:32.087306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:32.087306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:32.087306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:32.087306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:32.089640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:33:32.089640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:33:32.089640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:33:32.089640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:33:32.089640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:33:32.089640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:33:32.089640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:32.089640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:32.089640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 319/621] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:32.097719 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277a1ed-d697-4e7d-930a-2d8595c5bf24 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:32.113497 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a2205-3ecf-4f80-8380-8498e01c6a73 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:32.217801 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277a1ed-d697-4e7d-930a-2d8595c5bf24 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:32.226245 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a6340-93bd-4903-8bc1-401d70cf3398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:32.226961 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a6340-93bd-4903-8bc1-401d70cf3398 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:32.227247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a6340-93bd-4903-8bc1-401d70cf3398 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:32.227530 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a6340-93bd-4903-8bc1-401d70cf3398 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:32.228327 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a6340-93bd-4903-8bc1-401d70cf3398 None admin] RBAC: Adding query filter params (name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:32.228639 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a6340-93bd-4903-8bc1-401d70cf3398 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:32.230227 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a6340-93bd-4903-8bc1-401d70cf3398 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:32.252806 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 303/622] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:33:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:33:32.258513 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a6340-93bd-4903-8bc1-401d70cf3398 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:32.261547 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b000f58-402b-45cb-a46f-be55f76d56f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:32.262236 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b000f58-402b-45cb-a46f-be55f76d56f1 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:32.262522 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b000f58-402b-45cb-a46f-be55f76d56f1 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:32.262802 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b000f58-402b-45cb-a46f-be55f76d56f1 None admin] PATH_INFO: `/v3/projects` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:32.263616 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b000f58-402b-45cb-a46f-be55f76d56f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:32.264179 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b000f58-402b-45cb-a46f-be55f76d56f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:32.265737 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b000f58-402b-45cb-a46f-be55f76d56f1 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:32.281177 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 320/623] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:33:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:32.288270 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b000f58-402b-45cb-a46f-be55f76d56f1 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:32.410445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a6340-93bd-4903-8bc1-401d70cf3398 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:32.450931 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d7080-92ce-4115-aa4c-61fc31e9657e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:32.451740 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d7080-92ce-4115-aa4c-61fc31e9657e None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:32.452026 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d7080-92ce-4115-aa4c-61fc31e9657e None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:32.452303 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d7080-92ce-4115-aa4c-61fc31e9657e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:32.465601 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d7080-92ce-4115-aa4c-61fc31e9657e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:32.467072 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d7080-92ce-4115-aa4c-61fc31e9657e None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:32.473194 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b000f58-402b-45cb-a46f-be55f76d56f1 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:32.487797 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-979d7080-92ce-4115-aa4c-61fc31e9657e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:32.487797 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:32.487797 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:32.487797 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:32.487797 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:32.487797 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:32.487797 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:32.487797 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:32.487797 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:32.487797 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:32.487797 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:32.487797 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:32.487797 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:32.487797 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:32.487797 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:32.488780 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:32.488780 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:32.488780 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:32.488780 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:32.488780 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:32.488780 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:32.488780 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:32.488780 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:32.488780 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:32.488780 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:32.488780 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:32.488780 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:32.488780 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:32.488780 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:32.488780 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:32.488780 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:32.488780 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:32.489805 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:32.489805 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:32.489805 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:32.489805 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:32.490568 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 304/624] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:33:32.491448 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b3e3d-1f60-48a5-af4c-d69d050a7650 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:32.491739 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b3e3d-1f60-48a5-af4c-d69d050a7650 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:32.492024 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b3e3d-1f60-48a5-af4c-d69d050a7650 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:32.497949 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 305/625] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:32.497949 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14b1cc-104b-4c0c-9153-bb224ca1ec4f None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:32.497949 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14b1cc-104b-4c0c-9153-bb224ca1ec4f None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:32.497949 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14b1cc-104b-4c0c-9153-bb224ca1ec4f None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:32.497949 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 306/626] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:32.497949 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14b1cc-104b-4c0c-9153-bb224ca1ec4f None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:32.519725 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f85f2f-ade2-478b-b487-d0a6d77a5eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:32.520722 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f85f2f-ade2-478b-b487-d0a6d77a5eb0 None admin] REQUEST_METHOD: `PUT` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:32.521090 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f85f2f-ade2-478b-b487-d0a6d77a5eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:32.521475 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f85f2f-ade2-478b-b487-d0a6d77a5eb0 None admin] PATH_INFO: `/v3/projects/db5768a93e754372808fc69f898cc853/users/6e553afd9da345b29b3b164e34e5a506/roles/b22352a378fb404d90e3b3ae182757ad` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:32.537434 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f85f2f-ade2-478b-b487-d0a6d77a5eb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=db5768a93e754372808fc69f898cc853, user_id=6e553afd9da345b29b3b164e34e5a506, role_id=b22352a378fb404d90e3b3ae182757ad)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:32.538876 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f85f2f-ade2-478b-b487-d0a6d77a5eb0 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:32.555753 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 321/627] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:33:32 2022] PUT /identity/v3/projects/db5768a93e754372808fc69f898cc853/users/6e553afd9da345b29b3b164e34e5a506/roles/b22352a378fb404d90e3b3ae182757ad => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:33:32.557139 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6f0be-ee1e-4620-a264-9d73424bd95f None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:32.557474 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6f0be-ee1e-4620-a264-9d73424bd95f None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:32.557762 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6f0be-ee1e-4620-a264-9d73424bd95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:32.579821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-32c6f0be-ee1e-4620-a264-9d73424bd95f None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:32.581079 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-32c6f0be-ee1e-4620-a264-9d73424bd95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:32.618472 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14b1cc-104b-4c0c-9153-bb224ca1ec4f None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:32.659218 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 322/628] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:33:32.660655 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751e647-e833-4751-8b45-d320a76b604c None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:32.660951 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751e647-e833-4751-8b45-d320a76b604c None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:32.661235 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751e647-e833-4751-8b45-d320a76b604c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:32.672033 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbc26a-e27f-4f3d-ada0-c57d395274c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:32.674012 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbc26a-e27f-4f3d-ada0-c57d395274c4 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:32.674554 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbc26a-e27f-4f3d-ada0-c57d395274c4 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:32.675051 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbc26a-e27f-4f3d-ada0-c57d395274c4 None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:32.676050 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dbc26a-e27f-4f3d-ada0-c57d395274c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:32.676580 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dbc26a-e27f-4f3d-ada0-c57d395274c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:32.678398 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dbc26a-e27f-4f3d-ada0-c57d395274c4 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:32.679218 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-8751e647-e833-4751-8b45-d320a76b604c None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:32.680488 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-8751e647-e833-4751-8b45-d320a76b604c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:32.693185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 307/629] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:32.699766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbc26a-e27f-4f3d-ada0-c57d395274c4 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:32.793575 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 323/630] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:33:32.794476 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751e647-e833-4751-8b45-d320a76b604c None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:32.827947 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbc26a-e27f-4f3d-ada0-c57d395274c4 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:32.877886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ee73d-ee8f-4d04-a26d-85228ff06a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:32.878738 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ee73d-ee8f-4d04-a26d-85228ff06a02 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:32.879030 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ee73d-ee8f-4d04-a26d-85228ff06a02 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:32.879313 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ee73d-ee8f-4d04-a26d-85228ff06a02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:32.894216 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ee73d-ee8f-4d04-a26d-85228ff06a02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:32.905174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-182ee73d-ee8f-4d04-a26d-85228ff06a02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:32.905174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:32.905174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:32.905174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:32.905174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:32.905174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:32.905174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:32.905174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:32.905174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:32.905174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:32.905174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:32.905174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:32.905174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:32.905174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:32.905174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:32.905174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:32.906261 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:32.906261 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:32.906261 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:32.906261 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:32.906261 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:32.906261 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:32.906261 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:32.906261 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:32.906261 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:32.906261 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:32.906261 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:32.906261 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:32.906261 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:32.906261 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:32.906261 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:32.906261 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:32.907260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:32.907260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:32.907260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:32.907260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:32.907260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:32.907260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:32.907260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:32.907260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:32.907260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:32.907260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:32.907260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:32.907260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:32.907260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 308/631] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:33:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:32.908046 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ee73d-ee8f-4d04-a26d-85228ff06a02 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:32.908118 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751e647-e833-4751-8b45-d320a76b604c None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:32.960309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92516d4-d4ba-4b1d-b264-2cfafe46175a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:32.961242 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92516d4-d4ba-4b1d-b264-2cfafe46175a None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:32.961586 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92516d4-d4ba-4b1d-b264-2cfafe46175a None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:32.961865 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92516d4-d4ba-4b1d-b264-2cfafe46175a None admin] PATH_INFO: `/v3/users/nova` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:32.970093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92516d4-d4ba-4b1d-b264-2cfafe46175a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:32.971572 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92516d4-d4ba-4b1d-b264-2cfafe46175a None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:32.988299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-b92516d4-d4ba-4b1d-b264-2cfafe46175a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:33:32.988299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:32.988299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:32.988299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:32.988299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:32.988299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:32.988299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:32.988299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:32.988299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:32.988299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:32.988299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:32.988299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:32.988299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:33:32.988299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:33:32.988299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:33:32.988299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:33:32.990617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:32.990617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:32.990617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:33:32.990617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:32.990617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:33:32.990617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:32.990617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:32.990617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:32.990617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:32.990617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:32.990617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:32.990617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:32.990617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:32.990617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:32.990617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:32.990617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:32.990617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:32.990617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:32.993103 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:32.993103 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:32.993103 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:33:32.993103 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:33:32.993103 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:33:32.993103 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:33:32.993103 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:33:32.993103 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:33:32.993103 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:33:32.993103 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:32.993103 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 324/632] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:33:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:32.993103 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92516d4-d4ba-4b1d-b264-2cfafe46175a None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:33.048375 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ee73d-ee8f-4d04-a26d-85228ff06a02 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:33.096266 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a95ed-1839-42e1-b341-d95af5010319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:33.098162 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a95ed-1839-42e1-b341-d95af5010319 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:33.098525 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a95ed-1839-42e1-b341-d95af5010319 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:33.098963 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a95ed-1839-42e1-b341-d95af5010319 None admin] PATH_INFO: `/v3/roles/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:33.099748 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92516d4-d4ba-4b1d-b264-2cfafe46175a None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:33.119829 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a95ed-1839-42e1-b341-d95af5010319 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:33.133996 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-0f7a95ed-1839-42e1-b341-d95af5010319 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:33.133996 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:33.133996 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:33.133996 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:33.133996 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:33.133996 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:33.133996 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:33.133996 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:33.133996 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:33.133996 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:33.133996 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:33.133996 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:33.133996 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:33.133996 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:33.133996 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:33.133996 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:33.135701 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:33.135701 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:33.135701 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:33.135701 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:33.135701 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:33.135701 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:33.135701 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:33.135701 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:33.135701 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:33.135701 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:33.135701 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:33.135701 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:33.135701 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:33.135701 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:33.135701 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:33.135701 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:33.137588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:33.137588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:33.137588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:33.137588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:33.137588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:33.137588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:33.137588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:33.137588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:33.137588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:33.137588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:33.137588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:33.137588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:33.142443 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 309/633] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:33:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:33.144250 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a95ed-1839-42e1-b341-d95af5010319 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:33.169288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1db418-a594-4c4e-845e-1c226a6e872f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:33.170904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1db418-a594-4c4e-845e-1c226a6e872f None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:33.171853 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1db418-a594-4c4e-845e-1c226a6e872f None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:33.173127 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1db418-a594-4c4e-845e-1c226a6e872f None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:33.175111 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1db418-a594-4c4e-845e-1c226a6e872f None admin] RBAC: Adding query filter params (name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:33.175709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1db418-a594-4c4e-845e-1c226a6e872f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:33.178823 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1db418-a594-4c4e-845e-1c226a6e872f None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:33.192854 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 325/634] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:33:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:33.194796 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1db418-a594-4c4e-845e-1c226a6e872f None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:33.294573 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a95ed-1839-42e1-b341-d95af5010319 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:33.327909 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1db418-a594-4c4e-845e-1c226a6e872f None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:33.339741 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8bb37-8b7d-4ba8-bc67-5a296d31fbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:33.340489 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8bb37-8b7d-4ba8-bc67-5a296d31fbfe None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:33.340777 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8bb37-8b7d-4ba8-bc67-5a296d31fbfe None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:33.341056 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8bb37-8b7d-4ba8-bc67-5a296d31fbfe None admin] PATH_INFO: `/v3/users` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:33.342010 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8bb37-8b7d-4ba8-bc67-5a296d31fbfe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:33.342323 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8bb37-8b7d-4ba8-bc67-5a296d31fbfe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:33.343795 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8bb37-8b7d-4ba8-bc67-5a296d31fbfe None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:33.369766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 310/635] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:33:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:33.369766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8bb37-8b7d-4ba8-bc67-5a296d31fbfe None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:33.386051 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a80a8-6947-4cb0-8ae7-563cfc3a37b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:33.387333 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a80a8-6947-4cb0-8ae7-563cfc3a37b7 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:33.387807 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a80a8-6947-4cb0-8ae7-563cfc3a37b7 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:33.388265 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a80a8-6947-4cb0-8ae7-563cfc3a37b7 None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:33.389790 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a80a8-6947-4cb0-8ae7-563cfc3a37b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:33.390283 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a80a8-6947-4cb0-8ae7-563cfc3a37b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:33.392532 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a80a8-6947-4cb0-8ae7-563cfc3a37b7 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:33.409735 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 326/636] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:33:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:33.410680 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a80a8-6947-4cb0-8ae7-563cfc3a37b7 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:33.487796 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8bb37-8b7d-4ba8-bc67-5a296d31fbfe None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:33.525975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720758d-0d0d-416c-b4a8-dbd6e4f9152b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:33.526781 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720758d-0d0d-416c-b4a8-dbd6e4f9152b None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:33.526992 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a80a8-6947-4cb0-8ae7-563cfc3a37b7 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:33.527106 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720758d-0d0d-416c-b4a8-dbd6e4f9152b None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:33.527326 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720758d-0d0d-416c-b4a8-dbd6e4f9152b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:33.538069 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720758d-0d0d-416c-b4a8-dbd6e4f9152b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:33.539548 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720758d-0d0d-416c-b4a8-dbd6e4f9152b None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:33.557505 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-3720758d-0d0d-416c-b4a8-dbd6e4f9152b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:33.557505 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:33.557505 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:33.557505 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:33.557505 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:33.557505 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:33.557505 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:33.557505 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:33.557505 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:33.557505 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:33.557505 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:33.557505 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:33.557505 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:33.557505 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:33.557505 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:33.559378 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:33.559378 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:33.559378 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:33.559378 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:33.559378 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:33.559378 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:33.559378 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:33.559378 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:33.559378 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:33.559378 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:33.559378 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:33.559378 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:33.559378 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:33.559378 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:33.559378 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:33.559378 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:33.559378 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:33.561133 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:33.561133 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:33.561133 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:33.561133 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:33.561133 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 311/637] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:33.561133 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720758d-0d0d-416c-b4a8-dbd6e4f9152b None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:33.579342 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f887e-b946-48d5-805d-2ca025fc2078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:33.579897 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f887e-b946-48d5-805d-2ca025fc2078 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:33.580294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f887e-b946-48d5-805d-2ca025fc2078 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:33.580580 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f887e-b946-48d5-805d-2ca025fc2078 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:33.656199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f887e-b946-48d5-805d-2ca025fc2078 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:33.658128 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f887e-b946-48d5-805d-2ca025fc2078 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:33.674113 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720758d-0d0d-416c-b4a8-dbd6e4f9152b None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:33.709299 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00546020-38a2-41ea-b035-968c26596fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:33.710137 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00546020-38a2-41ea-b035-968c26596fc7 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:33.710427 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00546020-38a2-41ea-b035-968c26596fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:33.710710 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00546020-38a2-41ea-b035-968c26596fc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:33.722569 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00546020-38a2-41ea-b035-968c26596fc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:33.724044 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00546020-38a2-41ea-b035-968c26596fc7 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:33.742479 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-00546020-38a2-41ea-b035-968c26596fc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:33.742479 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:33.742479 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:33.742479 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:33.742479 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:33.742479 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:33.742479 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:33.742479 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:33.742479 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:33.742479 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:33.742479 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:33.742479 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:33.742479 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:33.742479 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:33.742479 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:33.743550 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:33.743550 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:33.743550 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:33.743550 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:33.743550 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:33.743550 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:33.743550 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:33.743550 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:33.743550 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:33.743550 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:33.743550 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:33.743550 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:33.743550 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:33.743550 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:33.743550 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:33.743550 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:33.743550 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:33.744520 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:33.744520 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:33.744520 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:33.744520 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:33.744520 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 312/638] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:33.745648 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac284c-ed89-472e-8f9d-a2659ed227de None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:33.745648 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac284c-ed89-472e-8f9d-a2659ed227de None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:33.745798 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac284c-ed89-472e-8f9d-a2659ed227de None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:33.748661 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 313/639] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:33.750178 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac284c-ed89-472e-8f9d-a2659ed227de None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:33.770677 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 327/640] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:33:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:33:33.771884 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f887e-b946-48d5-805d-2ca025fc2078 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:33.864044 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac284c-ed89-472e-8f9d-a2659ed227de None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:33.879525 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f887e-b946-48d5-805d-2ca025fc2078 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:33.903088 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a77c4c-6868-403a-80a9-6969768bd94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:33.903759 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a77c4c-6868-403a-80a9-6969768bd94c None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:33.904049 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a77c4c-6868-403a-80a9-6969768bd94c None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:33.904322 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a77c4c-6868-403a-80a9-6969768bd94c None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:33.905047 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a77c4c-6868-403a-80a9-6969768bd94c None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:33.905353 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a77c4c-6868-403a-80a9-6969768bd94c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:33.907360 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a77c4c-6868-403a-80a9-6969768bd94c None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:33.918840 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 314/641] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:33.919338 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895b73e-c505-4382-bfb5-5ab279746b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:33.920130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226ec15-2b03-4f30-a0dd-ac40803cfdc3 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:33.920415 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226ec15-2b03-4f30-a0dd-ac40803cfdc3 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:33.920694 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226ec15-2b03-4f30-a0dd-ac40803cfdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:33.921091 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895b73e-c505-4382-bfb5-5ab279746b72 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:33.921598 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895b73e-c505-4382-bfb5-5ab279746b72 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:33.922081 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895b73e-c505-4382-bfb5-5ab279746b72 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:33.922867 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895b73e-c505-4382-bfb5-5ab279746b72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:33.923483 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895b73e-c505-4382-bfb5-5ab279746b72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:33.924581 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895b73e-c505-4382-bfb5-5ab279746b72 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:33.941011 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 328/642] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:33.941011 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895b73e-c505-4382-bfb5-5ab279746b72 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:33.942695 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-d226ec15-2b03-4f30-a0dd-ac40803cfdc3 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:33.943914 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-d226ec15-2b03-4f30-a0dd-ac40803cfdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:34.009964 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 315/643] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:33:34.010823 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226ec15-2b03-4f30-a0dd-ac40803cfdc3 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:34.053233 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895b73e-c505-4382-bfb5-5ab279746b72 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:34.088451 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ce7c4-a817-4b8a-b107-aaf3ab3a65bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:34.089355 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ce7c4-a817-4b8a-b107-aaf3ab3a65bc None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:34.089697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ce7c4-a817-4b8a-b107-aaf3ab3a65bc None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:34.090053 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ce7c4-a817-4b8a-b107-aaf3ab3a65bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:34.103775 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ce7c4-a817-4b8a-b107-aaf3ab3a65bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:34.105434 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ce7c4-a817-4b8a-b107-aaf3ab3a65bc None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:34.124791 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-e52ce7c4-a817-4b8a-b107-aaf3ab3a65bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:34.124791 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:34.124791 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:34.124791 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:34.124791 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:34.124791 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:34.124791 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:34.124791 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:34.124791 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:34.124791 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:34.124791 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:34.124791 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:34.124791 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:34.124791 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:34.124791 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:34.126513 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:34.126513 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:34.126513 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:34.126513 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:34.126513 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:34.126513 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:34.126513 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:34.126513 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:34.126513 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:34.126513 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:34.126513 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:34.126513 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:34.126513 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:34.126513 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:34.126513 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:34.126513 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:34.126513 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:34.127514 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:34.127514 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:34.127514 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:34.127514 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:34.131531 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 329/644] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:34.131958 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226ec15-2b03-4f30-a0dd-ac40803cfdc3 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:34.132403 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ce7c4-a817-4b8a-b107-aaf3ab3a65bc None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:34.167550 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3105326-7fea-40e6-825a-fde0391aedf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:34.168353 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3105326-7fea-40e6-825a-fde0391aedf0 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:34.168640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3105326-7fea-40e6-825a-fde0391aedf0 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:34.168919 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3105326-7fea-40e6-825a-fde0391aedf0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:34.177574 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3105326-7fea-40e6-825a-fde0391aedf0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:34.179061 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3105326-7fea-40e6-825a-fde0391aedf0 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:34.194559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-e3105326-7fea-40e6-825a-fde0391aedf0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 15:33:34.194559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:34.194559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:34.194559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:34.194559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:34.194559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:34.194559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:34.194559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:34.194559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:34.194559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:34.194559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:34.194559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:34.194559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:33:34.194559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:33:34.194559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:33:34.194559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:33:34.195672 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:34.195672 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:34.195672 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:33:34.195672 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:34.195672 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:33:34.195672 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:34.195672 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:34.195672 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:34.195672 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:34.195672 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:34.195672 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:34.195672 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:34.195672 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:34.195672 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:34.195672 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:34.195672 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:34.195672 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:34.195672 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:34.196704 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:34.196704 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:34.196704 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:33:34.196704 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:33:34.196704 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:33:34.196704 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:33:34.196704 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:33:34.196704 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:33:34.196704 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 15:33:34.196704 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:34.196704 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 316/645] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:33:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:34.196704 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3105326-7fea-40e6-825a-fde0391aedf0 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:34.239538 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ce7c4-a817-4b8a-b107-aaf3ab3a65bc None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:34.273277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207bd02-17f5-42d9-9571-51dd980b5533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:34.274116 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207bd02-17f5-42d9-9571-51dd980b5533 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:34.274404 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207bd02-17f5-42d9-9571-51dd980b5533 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:34.274682 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207bd02-17f5-42d9-9571-51dd980b5533 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:34.283754 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f207bd02-17f5-42d9-9571-51dd980b5533 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:34.285239 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f207bd02-17f5-42d9-9571-51dd980b5533 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:34.304763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3105326-7fea-40e6-825a-fde0391aedf0 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:34.306271 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-f207bd02-17f5-42d9-9571-51dd980b5533 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:33:34.306271 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:34.306271 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:34.306271 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:34.306271 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:34.306271 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:34.306271 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:34.306271 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:34.306271 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:34.306271 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:34.306271 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:34.306271 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:34.306271 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:33:34.306271 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:33:34.306271 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:33:34.306271 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:33:34.307256 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:34.307256 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:34.307256 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:33:34.307256 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:34.307256 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:33:34.307256 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:34.307256 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:34.307256 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:34.307256 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:34.307256 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:34.307256 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:34.307256 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:34.307256 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:34.307256 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:34.307256 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:34.307256 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:34.307256 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:34.307256 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:34.308370 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:34.308370 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:34.308370 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:33:34.308370 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:33:34.308370 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:33:34.308370 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:33:34.308370 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:33:34.308370 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:33:34.308370 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:33:34.308370 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:34.308370 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 330/646] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:33:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:34.308370 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207bd02-17f5-42d9-9571-51dd980b5533 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:34.343427 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b813f-2a80-49e4-8823-fe72a8fddd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:34.344739 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b813f-2a80-49e4-8823-fe72a8fddd63 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:34.345027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b813f-2a80-49e4-8823-fe72a8fddd63 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:34.345305 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b813f-2a80-49e4-8823-fe72a8fddd63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:34.355973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b813f-2a80-49e4-8823-fe72a8fddd63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:34.364670 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-9e3b813f-2a80-49e4-8823-fe72a8fddd63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:34.364670 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:34.364670 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:34.364670 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:34.364670 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:34.364670 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:34.364670 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:34.364670 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:34.364670 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:34.364670 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:34.364670 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:34.364670 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:34.364670 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:34.364670 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:34.364670 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:34.364670 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:34.371082 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:34.371082 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:34.371082 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:34.371082 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:34.371082 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:34.371082 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:34.371082 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:34.371082 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:34.371082 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:34.371082 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:34.371082 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:34.371082 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:34.371082 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:34.371082 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:34.371082 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:34.371082 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:34.372268 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:34.372268 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:34.372268 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:34.372268 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:34.372268 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:34.372268 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:34.372268 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:34.372268 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:34.372268 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:34.372268 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:34.372268 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:34.372268 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:34.372268 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 317/647] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:33:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:34.372268 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b813f-2a80-49e4-8823-fe72a8fddd63 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:34.417750 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207bd02-17f5-42d9-9571-51dd980b5533 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:34.467385 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd72d55-2fef-45ee-b504-c29dc336b434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:34.468155 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd72d55-2fef-45ee-b504-c29dc336b434 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:34.468516 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd72d55-2fef-45ee-b504-c29dc336b434 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:34.468865 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd72d55-2fef-45ee-b504-c29dc336b434 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:34.470322 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd72d55-2fef-45ee-b504-c29dc336b434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:34.470778 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd72d55-2fef-45ee-b504-c29dc336b434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:34.472230 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd72d55-2fef-45ee-b504-c29dc336b434 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:34.473354 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b813f-2a80-49e4-8823-fe72a8fddd63 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:34.484759 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 331/648] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:34.486486 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd72d55-2fef-45ee-b504-c29dc336b434 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:34.511432 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288833ad-e2dc-4935-857b-8c399eee65e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:34.512104 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288833ad-e2dc-4935-857b-8c399eee65e7 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:34.512383 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288833ad-e2dc-4935-857b-8c399eee65e7 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:34.512656 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288833ad-e2dc-4935-857b-8c399eee65e7 None admin] PATH_INFO: `/v3/users` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:34.513654 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288833ad-e2dc-4935-857b-8c399eee65e7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:34.513879 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288833ad-e2dc-4935-857b-8c399eee65e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:34.515326 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288833ad-e2dc-4935-857b-8c399eee65e7 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:34.535607 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 318/649] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 9 15:33:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:34.536625 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288833ad-e2dc-4935-857b-8c399eee65e7 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:34.602294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd72d55-2fef-45ee-b504-c29dc336b434 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:34.639248 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618d4ea-10a2-47a2-95f1-526dbe52ce2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:34.640177 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618d4ea-10a2-47a2-95f1-526dbe52ce2d None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:34.640459 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618d4ea-10a2-47a2-95f1-526dbe52ce2d None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:34.640735 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618d4ea-10a2-47a2-95f1-526dbe52ce2d None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:34.642218 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618d4ea-10a2-47a2-95f1-526dbe52ce2d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:34.642535 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618d4ea-10a2-47a2-95f1-526dbe52ce2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:34.643998 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618d4ea-10a2-47a2-95f1-526dbe52ce2d None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:34.659136 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288833ad-e2dc-4935-857b-8c399eee65e7 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:34.662311 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 332/650] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 9 15:33:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:34.665597 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618d4ea-10a2-47a2-95f1-526dbe52ce2d None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:34.694552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f987642-432a-45ee-9443-efebbb77d787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:34.695375 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f987642-432a-45ee-9443-efebbb77d787 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:34.695816 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f987642-432a-45ee-9443-efebbb77d787 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:34.696197 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f987642-432a-45ee-9443-efebbb77d787 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:34.697041 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f987642-432a-45ee-9443-efebbb77d787 None admin] RBAC: Adding query filter params (name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:34.697447 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f987642-432a-45ee-9443-efebbb77d787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:34.698898 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f987642-432a-45ee-9443-efebbb77d787 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:34.711945 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 319/651] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:33:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:34.711945 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f987642-432a-45ee-9443-efebbb77d787 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:34.769534 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618d4ea-10a2-47a2-95f1-526dbe52ce2d None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:34.806466 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ad0c1-16eb-4578-85ef-08b59003908b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:34.807395 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ad0c1-16eb-4578-85ef-08b59003908b None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:34.807730 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ad0c1-16eb-4578-85ef-08b59003908b None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:34.808074 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ad0c1-16eb-4578-85ef-08b59003908b None admin] PATH_INFO: `/v3/projects/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:34.814862 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f987642-432a-45ee-9443-efebbb77d787 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:34.815571 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ad0c1-16eb-4578-85ef-08b59003908b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:34.817078 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ad0c1-16eb-4578-85ef-08b59003908b None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:34.831679 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-d87ad0c1-16eb-4578-85ef-08b59003908b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:34.831679 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:34.831679 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:34.831679 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:34.831679 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:34.831679 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:34.831679 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:34.831679 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:34.831679 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:34.831679 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:34.831679 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:34.831679 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:34.831679 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:33:34.831679 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:33:34.831679 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:33:34.832919 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:33:34.832919 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:34.832919 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:34.832919 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:34.832919 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:34.832919 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:34.832919 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:34.832919 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:34.832919 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:34.832919 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:34.832919 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:34.832919 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:34.832919 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:34.832919 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:34.832919 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:34.832919 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:34.832919 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:34.834108 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:33:34.834108 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:33:34.834108 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:33:34.834108 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:33:34.834108 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:33:34.834108 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:33:34.834108 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:34.834108 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:34.837548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 333/652] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:34.837548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ad0c1-16eb-4578-85ef-08b59003908b None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:34.854084 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e58497-e407-440a-a622-59e941e590c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:34.854736 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e58497-e407-440a-a622-59e941e590c7 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:34.855016 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e58497-e407-440a-a622-59e941e590c7 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:34.855287 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e58497-e407-440a-a622-59e941e590c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:34.928137 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e58497-e407-440a-a622-59e941e590c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:34.929803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e58497-e407-440a-a622-59e941e590c7 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:34.938105 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ad0c1-16eb-4578-85ef-08b59003908b None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:34.973990 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e89efa-5ad2-46b4-bdd4-fa0c202a27a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:34.974568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e89efa-5ad2-46b4-bdd4-fa0c202a27a1 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:34.974858 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e89efa-5ad2-46b4-bdd4-fa0c202a27a1 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:34.975140 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e89efa-5ad2-46b4-bdd4-fa0c202a27a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:35.035111 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 320/653] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:33:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:33:35.036017 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e58497-e407-440a-a622-59e941e590c7 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:35.044081 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e89efa-5ad2-46b4-bdd4-fa0c202a27a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:35.045592 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e89efa-5ad2-46b4-bdd4-fa0c202a27a1 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:35.132411 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e58497-e407-440a-a622-59e941e590c7 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:35.144358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 334/654] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:33:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:33:35.145217 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e89efa-5ad2-46b4-bdd4-fa0c202a27a1 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:35.166359 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b737c7-0569-473b-af25-69c33da853c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:35.167153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b737c7-0569-473b-af25-69c33da853c2 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:35.167434 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b737c7-0569-473b-af25-69c33da853c2 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:35.167709 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b737c7-0569-473b-af25-69c33da853c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:35.178475 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b737c7-0569-473b-af25-69c33da853c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:35.179925 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b737c7-0569-473b-af25-69c33da853c2 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:35.197272 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-00b737c7-0569-473b-af25-69c33da853c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:35.197272 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:35.197272 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:35.197272 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:35.197272 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:35.197272 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:35.197272 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:35.197272 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:35.197272 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:35.197272 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:35.197272 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:35.197272 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:35.197272 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:35.197272 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:35.197272 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:35.198613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:35.198613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:35.198613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:35.198613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:35.198613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:35.198613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:35.198613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:35.198613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:35.198613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:35.198613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:35.198613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:35.198613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:35.198613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:35.198613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:35.198613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:35.198613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:35.198613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:35.199613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:35.199613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:35.199613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:35.199613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:35.199613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 321/655] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:35.199916 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923a9e5-d741-4749-b416-3a556f2ce2e3 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:35.200084 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923a9e5-d741-4749-b416-3a556f2ce2e3 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:35.200308 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923a9e5-d741-4749-b416-3a556f2ce2e3 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:35.201617 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 322/656] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:35.202308 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923a9e5-d741-4749-b416-3a556f2ce2e3 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:35.249553 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e89efa-5ad2-46b4-bdd4-fa0c202a27a1 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:35.289599 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c321ea6-077c-40d2-8c29-14041c36a1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:35.290268 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c321ea6-077c-40d2-8c29-14041c36a1fd None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:35.290556 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c321ea6-077c-40d2-8c29-14041c36a1fd None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:35.290836 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c321ea6-077c-40d2-8c29-14041c36a1fd None admin] PATH_INFO: `/v3/projects` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:35.291640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c321ea6-077c-40d2-8c29-14041c36a1fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:35.291947 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c321ea6-077c-40d2-8c29-14041c36a1fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:35.293408 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c321ea6-077c-40d2-8c29-14041c36a1fd None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:35.305433 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 335/657] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:33:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:35.306429 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c321ea6-077c-40d2-8c29-14041c36a1fd None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:35.307784 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923a9e5-d741-4749-b416-3a556f2ce2e3 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:35.341603 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42c7ea-3a22-4618-a93f-c463e2d7d444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:35.342397 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42c7ea-3a22-4618-a93f-c463e2d7d444 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:35.342678 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42c7ea-3a22-4618-a93f-c463e2d7d444 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:35.342946 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42c7ea-3a22-4618-a93f-c463e2d7d444 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:35.353556 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42c7ea-3a22-4618-a93f-c463e2d7d444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:35.355026 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42c7ea-3a22-4618-a93f-c463e2d7d444 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:35.372662 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-ac42c7ea-3a22-4618-a93f-c463e2d7d444 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:35.372662 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:35.372662 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:35.372662 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:35.372662 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:35.372662 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:35.372662 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:35.372662 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:35.372662 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:35.372662 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:35.372662 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:35.372662 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:35.372662 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:35.372662 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:35.372662 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:35.373893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:35.373893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:35.373893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:35.373893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:35.373893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:35.373893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:35.373893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:35.373893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:35.373893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:35.373893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:35.373893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:35.373893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:35.373893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:35.373893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:35.373893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:35.373893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:35.373893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:35.380080 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:35.380080 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:35.380080 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:35.380080 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:35.380080 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 323/658] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:35.380080 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42c7ea-3a22-4618-a93f-c463e2d7d444 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:35.407286 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c321ea6-077c-40d2-8c29-14041c36a1fd None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:35.441030 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab700dc-2a8f-4df7-a6ce-deb93b206a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:35.441862 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab700dc-2a8f-4df7-a6ce-deb93b206a6e None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:35.442149 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab700dc-2a8f-4df7-a6ce-deb93b206a6e None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:35.442427 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab700dc-2a8f-4df7-a6ce-deb93b206a6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:35.453235 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab700dc-2a8f-4df7-a6ce-deb93b206a6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:35.455427 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab700dc-2a8f-4df7-a6ce-deb93b206a6e None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:35.474324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-0ab700dc-2a8f-4df7-a6ce-deb93b206a6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:35.474324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:35.474324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:35.474324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:35.474324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:35.474324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:35.474324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:35.474324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:35.474324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:35.474324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:35.474324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:35.474324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:35.474324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:35.474324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:35.474324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:35.475552 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:35.475552 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:35.475552 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:35.475552 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:35.475552 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:35.475552 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:35.475552 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:35.475552 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:35.475552 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:35.475552 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:35.475552 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:35.475552 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:35.475552 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:35.475552 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:35.475552 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:35.475552 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:35.475552 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:35.476639 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:35.476639 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:35.476639 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:35.476639 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:35.476639 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 336/659] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:35.477427 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4981b2b-20cd-42e1-9364-db0361431d81 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:35.477719 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4981b2b-20cd-42e1-9364-db0361431d81 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:35.477998 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4981b2b-20cd-42e1-9364-db0361431d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:35.485952 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42c7ea-3a22-4618-a93f-c463e2d7d444 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:35.495524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-e4981b2b-20cd-42e1-9364-db0361431d81 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:35.496754 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-e4981b2b-20cd-42e1-9364-db0361431d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:35.520434 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ad453-c8af-4ad9-921b-b00e30f78256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:35.521017 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ad453-c8af-4ad9-921b-b00e30f78256 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:35.521296 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ad453-c8af-4ad9-921b-b00e30f78256 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:35.521606 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ad453-c8af-4ad9-921b-b00e30f78256 None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:35.522325 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ad453-c8af-4ad9-921b-b00e30f78256 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:35.522630 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ad453-c8af-4ad9-921b-b00e30f78256 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:35.523998 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ad453-c8af-4ad9-921b-b00e30f78256 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:35.536278 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 324/660] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:35.537111 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ad453-c8af-4ad9-921b-b00e30f78256 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:35.563592 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 337/661] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:33:35.564552 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4981b2b-20cd-42e1-9364-db0361431d81 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:35.634843 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ad453-c8af-4ad9-921b-b00e30f78256 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:35.665816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4981b2b-20cd-42e1-9364-db0361431d81 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:35.669137 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad256f-2ee8-4883-8855-7c2f13c5d270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:35.669831 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad256f-2ee8-4883-8855-7c2f13c5d270 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:35.670113 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad256f-2ee8-4883-8855-7c2f13c5d270 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:35.670388 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad256f-2ee8-4883-8855-7c2f13c5d270 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:35.671224 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad256f-2ee8-4883-8855-7c2f13c5d270 None admin] RBAC: Adding query filter params (role.id=b22352a378fb404d90e3b3ae182757ad, scope.project.id=db5768a93e754372808fc69f898cc853, user.id=d398283fc99c4bfe83170ad3d1538f38) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:35.671535 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad256f-2ee8-4883-8855-7c2f13c5d270 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:35.673042 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad256f-2ee8-4883-8855-7c2f13c5d270 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:35.678994 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 325/662] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:33:35 2022] GET /identity/v3/role_assignments?user.id=d398283fc99c4bfe83170ad3d1538f38&scope.project.id=db5768a93e754372808fc69f898cc853&role.id=b22352a378fb404d90e3b3ae182757ad => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:35.679812 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad256f-2ee8-4883-8855-7c2f13c5d270 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:35.706269 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9729e3e-de0f-4a9f-8d81-ea099e9697a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:35.707247 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9729e3e-de0f-4a9f-8d81-ea099e9697a6 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:35.707721 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9729e3e-de0f-4a9f-8d81-ea099e9697a6 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:35.708197 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9729e3e-de0f-4a9f-8d81-ea099e9697a6 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:35.708958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9729e3e-de0f-4a9f-8d81-ea099e9697a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:35.709276 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9729e3e-de0f-4a9f-8d81-ea099e9697a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:35.710794 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9729e3e-de0f-4a9f-8d81-ea099e9697a6 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:35.728583 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 338/663] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:35.728583 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9729e3e-de0f-4a9f-8d81-ea099e9697a6 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:35.822344 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad256f-2ee8-4883-8855-7c2f13c5d270 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:35.862287 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a095a5-7aeb-4f57-b207-429d455aa59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:35.862974 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a095a5-7aeb-4f57-b207-429d455aa59d None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:35.863264 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a095a5-7aeb-4f57-b207-429d455aa59d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:35.863546 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a095a5-7aeb-4f57-b207-429d455aa59d None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:35.864290 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a095a5-7aeb-4f57-b207-429d455aa59d None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:35.864606 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a095a5-7aeb-4f57-b207-429d455aa59d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:35.866054 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a095a5-7aeb-4f57-b207-429d455aa59d None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:35.868649 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9729e3e-de0f-4a9f-8d81-ea099e9697a6 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:35.881051 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 326/664] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:35.881779 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a095a5-7aeb-4f57-b207-429d455aa59d None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:35.910546 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde9cfd-44c7-46d9-bb9f-c85be2fe9dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:35.912209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde9cfd-44c7-46d9-bb9f-c85be2fe9dce None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:35.912209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde9cfd-44c7-46d9-bb9f-c85be2fe9dce None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:35.912718 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde9cfd-44c7-46d9-bb9f-c85be2fe9dce None admin] PATH_INFO: `/v3/users/neutron` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:35.921300 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde9cfd-44c7-46d9-bb9f-c85be2fe9dce None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:35.922939 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde9cfd-44c7-46d9-bb9f-c85be2fe9dce None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:35.939211 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-0cde9cfd-44c7-46d9-bb9f-c85be2fe9dce None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:33:35.939211 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:35.939211 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:35.939211 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:35.939211 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:35.939211 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:35.939211 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:35.939211 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:35.939211 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:35.939211 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:35.939211 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:35.939211 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:35.939211 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:33:35.939211 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:33:35.939211 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:33:35.939211 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:33:35.940902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:35.940902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:35.940902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:33:35.940902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:35.940902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:33:35.940902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:35.940902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:35.940902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:35.940902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:35.940902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:35.940902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:35.940902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:35.940902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:35.940902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:35.940902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:35.940902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:35.940902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:35.940902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:35.942012 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:35.942012 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:35.942012 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:33:35.942012 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:33:35.942012 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:33:35.942012 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:33:35.942012 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:33:35.942012 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:33:35.942012 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:33:35.942012 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:35.942012 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 339/665] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:33:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:35.942012 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde9cfd-44c7-46d9-bb9f-c85be2fe9dce None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:36.000120 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a095a5-7aeb-4f57-b207-429d455aa59d None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:36.044706 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae398a-286f-4e8b-897a-29d993dd2b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:36.045538 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae398a-286f-4e8b-897a-29d993dd2b09 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:36.045820 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae398a-286f-4e8b-897a-29d993dd2b09 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:36.046094 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae398a-286f-4e8b-897a-29d993dd2b09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:36.057091 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae398a-286f-4e8b-897a-29d993dd2b09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:36.065514 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-faae398a-286f-4e8b-897a-29d993dd2b09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:36.065514 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:36.065514 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:36.065514 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:36.065514 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:36.065514 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:36.065514 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:36.065514 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:36.065514 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:36.065514 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:36.065514 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:36.065514 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:36.065514 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:36.065514 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:36.065514 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:36.065514 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:36.066763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:36.066763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:36.066763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:36.066763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:36.066763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:36.066763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:36.066763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:36.066763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:36.066763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:36.066763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:36.066763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:36.066763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:36.066763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:36.066763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:36.066763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:36.066763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:36.067688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:36.067688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:36.067688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:36.067688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:36.067688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:36.067688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:36.067688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:36.067688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:36.067688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:36.067688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:36.067688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:36.067688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:36.067688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 327/666] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:33:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:36.068435 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae398a-286f-4e8b-897a-29d993dd2b09 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:36.075327 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde9cfd-44c7-46d9-bb9f-c85be2fe9dce None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:36.122252 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd730b52-280b-46a7-8300-ce5501ee089a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:36.123088 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd730b52-280b-46a7-8300-ce5501ee089a None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:36.123395 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd730b52-280b-46a7-8300-ce5501ee089a None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:36.123675 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd730b52-280b-46a7-8300-ce5501ee089a None admin] PATH_INFO: `/v3/projects/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:36.131885 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd730b52-280b-46a7-8300-ce5501ee089a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:36.133602 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd730b52-280b-46a7-8300-ce5501ee089a None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:36.150848 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-cd730b52-280b-46a7-8300-ce5501ee089a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:36.150848 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:36.150848 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:36.150848 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:36.150848 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:36.150848 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:36.150848 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:36.150848 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:36.150848 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:36.150848 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:36.150848 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:36.150848 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:36.150848 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:33:36.150848 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:33:36.150848 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:33:36.151909 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:33:36.151909 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:36.151909 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:36.151909 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:36.151909 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:36.151909 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:36.151909 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:36.151909 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:36.151909 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:36.151909 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:36.151909 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:36.151909 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:36.151909 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:36.151909 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:36.151909 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:36.151909 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:36.151909 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:36.152958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:33:36.152958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:33:36.152958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:33:36.152958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:33:36.152958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:33:36.152958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:33:36.152958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:36.152958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:36.152958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 340/667] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:36.153533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd730b52-280b-46a7-8300-ce5501ee089a None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:36.194059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae398a-286f-4e8b-897a-29d993dd2b09 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:36.232814 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c82b65-95b0-4474-89d0-38aa72c80c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:36.233652 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c82b65-95b0-4474-89d0-38aa72c80c90 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:36.233936 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c82b65-95b0-4474-89d0-38aa72c80c90 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:36.234212 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c82b65-95b0-4474-89d0-38aa72c80c90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:36.241425 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c82b65-95b0-4474-89d0-38aa72c80c90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:36.242917 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c82b65-95b0-4474-89d0-38aa72c80c90 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:36.257982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-21c82b65-95b0-4474-89d0-38aa72c80c90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:36.257982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:36.257982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:36.257982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:36.257982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:36.257982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:36.257982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:36.257982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:36.257982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:36.257982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:36.257982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:36.257982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:36.257982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:33:36.257982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:33:36.257982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:33:36.259021 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:33:36.259021 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:36.259021 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:36.259021 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:36.259021 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:36.259021 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:36.259021 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:36.259021 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:36.259021 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:36.259021 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:36.259021 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:36.259021 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:36.259021 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:36.259021 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:36.259021 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:36.259021 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:36.259021 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:36.260122 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:33:36.260122 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:33:36.260122 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:33:36.260122 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:33:36.260122 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:33:36.260122 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:33:36.260122 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:36.260122 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:36.260122 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 328/668] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:36.260658 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c82b65-95b0-4474-89d0-38aa72c80c90 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:36.265700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd730b52-280b-46a7-8300-ce5501ee089a None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:36.303317 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2ea90-c378-4cc4-95f2-d69e346add22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:36.304122 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2ea90-c378-4cc4-95f2-d69e346add22 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:36.304411 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2ea90-c378-4cc4-95f2-d69e346add22 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:36.304739 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2ea90-c378-4cc4-95f2-d69e346add22 None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:36.305628 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2ea90-c378-4cc4-95f2-d69e346add22 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:36.305940 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2ea90-c378-4cc4-95f2-d69e346add22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:36.307406 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2ea90-c378-4cc4-95f2-d69e346add22 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:36.326747 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 341/669] 10.222.0.48 () {56 vars in 1139 bytes} [Mon May 9 15:33:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:36.327946 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2ea90-c378-4cc4-95f2-d69e346add22 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:36.379223 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c82b65-95b0-4474-89d0-38aa72c80c90 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:36.418941 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19ce5d-6adb-4e3a-bd60-d41bb20b4040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:36.419774 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19ce5d-6adb-4e3a-bd60-d41bb20b4040 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:36.420175 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19ce5d-6adb-4e3a-bd60-d41bb20b4040 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:36.420574 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19ce5d-6adb-4e3a-bd60-d41bb20b4040 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:36.421519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19ce5d-6adb-4e3a-bd60-d41bb20b4040 None admin] RBAC: Adding query filter params (name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:36.421929 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19ce5d-6adb-4e3a-bd60-d41bb20b4040 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:36.424053 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19ce5d-6adb-4e3a-bd60-d41bb20b4040 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:36.439973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 329/670] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:33:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:36.439973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19ce5d-6adb-4e3a-bd60-d41bb20b4040 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:36.440278 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2ea90-c378-4cc4-95f2-d69e346add22 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:36.475205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192dd90f-6b1c-4541-86c4-ff72ec43c271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:36.475885 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dd90f-6b1c-4541-86c4-ff72ec43c271 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:36.476173 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dd90f-6b1c-4541-86c4-ff72ec43c271 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:36.476452 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dd90f-6b1c-4541-86c4-ff72ec43c271 None admin] PATH_INFO: `/v3/projects` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:36.477428 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192dd90f-6b1c-4541-86c4-ff72ec43c271 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:36.477726 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192dd90f-6b1c-4541-86c4-ff72ec43c271 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:36.479054 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192dd90f-6b1c-4541-86c4-ff72ec43c271 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:36.497689 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 342/671] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:33:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:36.497689 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192dd90f-6b1c-4541-86c4-ff72ec43c271 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:36.555778 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19ce5d-6adb-4e3a-bd60-d41bb20b4040 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:36.608913 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce774890-a875-49f6-82cd-26d94a4465c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:36.609761 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce774890-a875-49f6-82cd-26d94a4465c7 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:36.610776 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce774890-a875-49f6-82cd-26d94a4465c7 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:36.611240 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce774890-a875-49f6-82cd-26d94a4465c7 None admin] PATH_INFO: `/v3/projects` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:36.612607 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce774890-a875-49f6-82cd-26d94a4465c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:36.613129 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce774890-a875-49f6-82cd-26d94a4465c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:36.615651 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce774890-a875-49f6-82cd-26d94a4465c7 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:36.635028 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 330/672] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:33:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:36.635923 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce774890-a875-49f6-82cd-26d94a4465c7 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:36.636073 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192dd90f-6b1c-4541-86c4-ff72ec43c271 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:36.674516 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97645ebd-17c9-4a6b-82b7-9be7535e4323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:36.675207 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97645ebd-17c9-4a6b-82b7-9be7535e4323 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:36.675538 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97645ebd-17c9-4a6b-82b7-9be7535e4323 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:36.675828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97645ebd-17c9-4a6b-82b7-9be7535e4323 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:36.750320 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97645ebd-17c9-4a6b-82b7-9be7535e4323 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:36.751407 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce774890-a875-49f6-82cd-26d94a4465c7 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:36.751893 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97645ebd-17c9-4a6b-82b7-9be7535e4323 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:36.789901 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f0944-6341-4199-9dbc-624a4c8a6c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:36.790971 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f0944-6341-4199-9dbc-624a4c8a6c2e None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:36.791450 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f0944-6341-4199-9dbc-624a4c8a6c2e None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:36.791882 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f0944-6341-4199-9dbc-624a4c8a6c2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:36.804047 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f0944-6341-4199-9dbc-624a4c8a6c2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:36.805832 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f0944-6341-4199-9dbc-624a4c8a6c2e None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:36.830310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-741f0944-6341-4199-9dbc-624a4c8a6c2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:36.830310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:36.830310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:36.830310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:36.830310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:36.830310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:36.830310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:36.830310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:36.830310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:36.830310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:36.830310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:36.830310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:36.830310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:36.830310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:36.830310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:36.831540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:36.831540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:36.831540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:36.831540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:36.831540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:36.831540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:36.831540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:36.831540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:36.831540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:36.831540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:36.831540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:36.831540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:36.831540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:36.831540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:36.831540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:36.831540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:36.831540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:36.832739 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:36.832739 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:36.832739 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:36.832739 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:36.834388 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 331/673] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:36.835359 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f0944-6341-4199-9dbc-624a4c8a6c2e None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:36.863443 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 343/674] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:33:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:33:36.864580 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97645ebd-17c9-4a6b-82b7-9be7535e4323 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:36.948381 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f0944-6341-4199-9dbc-624a4c8a6c2e None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:36.972861 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97645ebd-17c9-4a6b-82b7-9be7535e4323 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:36.985696 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6aa309-c5aa-4cc8-8910-dd614030ebcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:36.986579 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aa309-c5aa-4cc8-8910-dd614030ebcf None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:36.986975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aa309-c5aa-4cc8-8910-dd614030ebcf None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:36.987360 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aa309-c5aa-4cc8-8910-dd614030ebcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:36.988411 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6aa309-c5aa-4cc8-8910-dd614030ebcf None admin] RBAC: Adding query filter params (role.id=b22352a378fb404d90e3b3ae182757ad, scope.project.id=db5768a93e754372808fc69f898cc853, user.id=bf5867b42cf64de3aafef27b7ed99c28) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:36.988840 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6aa309-c5aa-4cc8-8910-dd614030ebcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:36.990347 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6aa309-c5aa-4cc8-8910-dd614030ebcf None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:36.996633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 332/675] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:33:36 2022] GET /identity/v3/role_assignments?user.id=bf5867b42cf64de3aafef27b7ed99c28&scope.project.id=db5768a93e754372808fc69f898cc853&role.id=b22352a378fb404d90e3b3ae182757ad => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:36.997564 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6aa309-c5aa-4cc8-8910-dd614030ebcf None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:37.023055 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3ce51-a72d-451c-ae3c-6f8bb1d874e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:37.024381 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3ce51-a72d-451c-ae3c-6f8bb1d874e3 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:37.024848 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3ce51-a72d-451c-ae3c-6f8bb1d874e3 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:37.025566 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3ce51-a72d-451c-ae3c-6f8bb1d874e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:37.027263 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3ce51-a72d-451c-ae3c-6f8bb1d874e3 None admin] RBAC: Adding query filter params (role.id=b22352a378fb404d90e3b3ae182757ad, scope.project.id=db5768a93e754372808fc69f898cc853, user.id=673a97c146144369937b1288797ab1ba) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:37.027880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3ce51-a72d-451c-ae3c-6f8bb1d874e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:37.030227 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3ce51-a72d-451c-ae3c-6f8bb1d874e3 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:37.040923 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 344/676] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:33:36 2022] GET /identity/v3/role_assignments?user.id=673a97c146144369937b1288797ab1ba&scope.project.id=db5768a93e754372808fc69f898cc853&role.id=b22352a378fb404d90e3b3ae182757ad => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:37.042131 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3ce51-a72d-451c-ae3c-6f8bb1d874e3 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:37.113989 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6aa309-c5aa-4cc8-8910-dd614030ebcf None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:37.166629 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c172c6a-f870-4a69-83a2-b81cd1018716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:37.167311 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c172c6a-f870-4a69-83a2-b81cd1018716 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:37.167591 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c172c6a-f870-4a69-83a2-b81cd1018716 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:37.167865 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c172c6a-f870-4a69-83a2-b81cd1018716 None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:37.168603 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c172c6a-f870-4a69-83a2-b81cd1018716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:37.168909 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c172c6a-f870-4a69-83a2-b81cd1018716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:37.172702 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c172c6a-f870-4a69-83a2-b81cd1018716 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:37.187770 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 333/677] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:37.194752 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c172c6a-f870-4a69-83a2-b81cd1018716 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:37.208761 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3ce51-a72d-451c-ae3c-6f8bb1d874e3 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:37.286135 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebefa7e-b902-4f41-a06a-fa3027b84c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:37.287072 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebefa7e-b902-4f41-a06a-fa3027b84c5e None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:37.287356 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebefa7e-b902-4f41-a06a-fa3027b84c5e None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:37.287632 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebefa7e-b902-4f41-a06a-fa3027b84c5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:37.299974 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebefa7e-b902-4f41-a06a-fa3027b84c5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:37.301515 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebefa7e-b902-4f41-a06a-fa3027b84c5e None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:37.323386 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-5ebefa7e-b902-4f41-a06a-fa3027b84c5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:37.323386 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:37.323386 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:37.323386 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:37.323386 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:37.323386 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:37.323386 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:37.323386 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:37.323386 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:37.323386 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:37.323386 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:37.323386 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:37.323386 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:37.323386 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:37.323386 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:37.324435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:37.324435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:37.324435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:37.324435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:37.324435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:37.324435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:37.324435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:37.324435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:37.324435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:37.324435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:37.324435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:37.324435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:37.324435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:37.324435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:37.324435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:37.324435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:37.324435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:37.325533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:37.325533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:37.325533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:37.325533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:37.325533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 345/678] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:37.333404 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebefa7e-b902-4f41-a06a-fa3027b84c5e None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:37.384137 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c172c6a-f870-4a69-83a2-b81cd1018716 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:37.439535 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e695853-13f0-4d4c-b5d0-3736599b8a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:37.440698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e695853-13f0-4d4c-b5d0-3736599b8a32 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:37.440981 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e695853-13f0-4d4c-b5d0-3736599b8a32 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:37.441255 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e695853-13f0-4d4c-b5d0-3736599b8a32 None admin] PATH_INFO: `/v3/users/swift` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:37.449814 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e695853-13f0-4d4c-b5d0-3736599b8a32 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:37.451274 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e695853-13f0-4d4c-b5d0-3736599b8a32 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:37.459888 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebefa7e-b902-4f41-a06a-fa3027b84c5e None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:37.467547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-2e695853-13f0-4d4c-b5d0-3736599b8a32 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:33:37.467547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:37.467547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:37.467547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:37.467547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:37.467547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:37.467547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:37.467547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:37.467547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:37.467547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:37.467547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:37.467547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:37.467547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:33:37.467547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:33:37.467547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:33:37.467547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:33:37.468691 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:37.468691 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:37.468691 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:33:37.468691 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:37.468691 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:33:37.468691 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:37.468691 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:37.468691 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:37.468691 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:37.468691 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:37.468691 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:37.468691 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:37.468691 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:37.468691 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:37.468691 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:37.468691 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:37.468691 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:37.468691 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:37.470312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:37.470312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:37.470312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:33:37.470312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:33:37.470312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:33:37.470312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:33:37.470312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:33:37.470312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:33:37.470312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:33:37.470312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:37.470312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 334/679] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:33:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:37.482699 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e695853-13f0-4d4c-b5d0-3736599b8a32 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:37.521985 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2894f7f-78fc-4f4b-a548-474867a67f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:37.522668 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2894f7f-78fc-4f4b-a548-474867a67f23 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:37.522954 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2894f7f-78fc-4f4b-a548-474867a67f23 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:37.523232 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2894f7f-78fc-4f4b-a548-474867a67f23 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:37.523968 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2894f7f-78fc-4f4b-a548-474867a67f23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:37.524276 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2894f7f-78fc-4f4b-a548-474867a67f23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:37.527021 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2894f7f-78fc-4f4b-a548-474867a67f23 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:37.549453 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 346/680] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:37.555344 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2894f7f-78fc-4f4b-a548-474867a67f23 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:37.682624 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e695853-13f0-4d4c-b5d0-3736599b8a32 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:37.708417 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2894f7f-78fc-4f4b-a548-474867a67f23 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:37.728005 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda46d21-2f89-4db6-a4a1-e30d348f9a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:37.728685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda46d21-2f89-4db6-a4a1-e30d348f9a6d None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:37.728971 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda46d21-2f89-4db6-a4a1-e30d348f9a6d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:37.729332 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda46d21-2f89-4db6-a4a1-e30d348f9a6d None admin] PATH_INFO: `/v3/users` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:37.730140 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda46d21-2f89-4db6-a4a1-e30d348f9a6d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:37.730449 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda46d21-2f89-4db6-a4a1-e30d348f9a6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:37.731913 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda46d21-2f89-4db6-a4a1-e30d348f9a6d None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:37.744455 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09596027-0404-4271-aa25-1a9ecf7c5069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:37.745572 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09596027-0404-4271-aa25-1a9ecf7c5069 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:37.745863 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09596027-0404-4271-aa25-1a9ecf7c5069 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:37.746148 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09596027-0404-4271-aa25-1a9ecf7c5069 None admin] PATH_INFO: `/v3/projects/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:37.752001 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 335/681] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 9 15:33:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:33:37.754317 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09596027-0404-4271-aa25-1a9ecf7c5069 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:37.755866 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09596027-0404-4271-aa25-1a9ecf7c5069 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:37.762453 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda46d21-2f89-4db6-a4a1-e30d348f9a6d None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:37.771358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-09596027-0404-4271-aa25-1a9ecf7c5069 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:37.771358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:37.771358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:37.771358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:37.771358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:37.771358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:37.771358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:37.771358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:37.771358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:37.771358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:37.771358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:37.771358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:37.771358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:33:37.771358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:33:37.771358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:33:37.772377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:33:37.772377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:37.772377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:37.772377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:37.772377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:37.772377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:37.772377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:37.772377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:37.772377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:37.772377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:37.772377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:37.772377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:37.772377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:37.772377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:37.772377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:37.772377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:37.772377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:37.773332 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:33:37.773332 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:33:37.773332 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:33:37.773332 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:33:37.773332 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:33:37.773332 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:33:37.773332 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:37.773332 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:37.773332 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 347/682] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:37.779455 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09596027-0404-4271-aa25-1a9ecf7c5069 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:37.869860 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda46d21-2f89-4db6-a4a1-e30d348f9a6d None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:37.904761 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713c6be-5f76-4695-94ff-0e19295364e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:37.905440 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713c6be-5f76-4695-94ff-0e19295364e5 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:37.905731 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713c6be-5f76-4695-94ff-0e19295364e5 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:37.906009 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713c6be-5f76-4695-94ff-0e19295364e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:37.980957 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713c6be-5f76-4695-94ff-0e19295364e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:37.982815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713c6be-5f76-4695-94ff-0e19295364e5 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:38.001757 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09596027-0404-4271-aa25-1a9ecf7c5069 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:38.052998 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144923a-fea9-43bb-a9e3-090c3a3d9d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:38.053723 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144923a-fea9-43bb-a9e3-090c3a3d9d6e None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:38.054011 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144923a-fea9-43bb-a9e3-090c3a3d9d6e None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:38.054295 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144923a-fea9-43bb-a9e3-090c3a3d9d6e None admin] PATH_INFO: `/v3/projects` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:38.055135 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144923a-fea9-43bb-a9e3-090c3a3d9d6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:38.055453 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144923a-fea9-43bb-a9e3-090c3a3d9d6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:38.056955 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144923a-fea9-43bb-a9e3-090c3a3d9d6e None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:38.091227 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 348/683] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:33:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:38.097435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144923a-fea9-43bb-a9e3-090c3a3d9d6e None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:38.194259 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 336/684] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:33:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:33:38.200371 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713c6be-5f76-4695-94ff-0e19295364e5 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:38.279846 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144923a-fea9-43bb-a9e3-090c3a3d9d6e None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:38.313634 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713c6be-5f76-4695-94ff-0e19295364e5 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:38.315258 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c425c30-acdd-4cd0-add5-25dbe5306d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:38.316005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c425c30-acdd-4cd0-add5-25dbe5306d8c None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:38.316392 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c425c30-acdd-4cd0-add5-25dbe5306d8c None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:38.316747 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c425c30-acdd-4cd0-add5-25dbe5306d8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:38.318147 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c425c30-acdd-4cd0-add5-25dbe5306d8c None admin] RBAC: Adding query filter params (role.id=b22352a378fb404d90e3b3ae182757ad, scope.project.id=db5768a93e754372808fc69f898cc853, user.id=74924b56be0243eda3144664dd01cc13) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:38.318147 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c425c30-acdd-4cd0-add5-25dbe5306d8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:38.319560 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c425c30-acdd-4cd0-add5-25dbe5306d8c None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:38.333793 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 349/685] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:33:38 2022] GET /identity/v3/role_assignments?user.id=74924b56be0243eda3144664dd01cc13&scope.project.id=db5768a93e754372808fc69f898cc853&role.id=b22352a378fb404d90e3b3ae182757ad => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:33:38.335591 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c18cb-2025-4c1d-a263-006712fb4bc5 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:38.335958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c18cb-2025-4c1d-a263-006712fb4bc5 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:38.336314 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c18cb-2025-4c1d-a263-006712fb4bc5 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:38.338204 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 350/686] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:38.358415 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ccaf1-2341-42ad-b206-cca5aa21ee67 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:38.358712 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ccaf1-2341-42ad-b206-cca5aa21ee67 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:38.359150 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ccaf1-2341-42ad-b206-cca5aa21ee67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:38.392649 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-7e2ccaf1-2341-42ad-b206-cca5aa21ee67 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:38.393929 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-7e2ccaf1-2341-42ad-b206-cca5aa21ee67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:38.491969 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de6540-a7cf-474a-af6a-fa291024b1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:38.493249 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de6540-a7cf-474a-af6a-fa291024b1a3 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:38.495441 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de6540-a7cf-474a-af6a-fa291024b1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:38.496914 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de6540-a7cf-474a-af6a-fa291024b1a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:38.526758 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de6540-a7cf-474a-af6a-fa291024b1a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:38.532304 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de6540-a7cf-474a-af6a-fa291024b1a3 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:38.549062 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 351/687] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:33:38.562236 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-57de6540-a7cf-474a-af6a-fa291024b1a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:38.562236 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:38.562236 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:38.562236 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:38.562236 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:38.562236 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:38.562236 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:38.562236 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:38.562236 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:38.562236 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:38.562236 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:38.562236 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:38.562236 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:38.562236 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:38.562236 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:38.563803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:38.563803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:38.563803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:38.563803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:38.563803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:38.563803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:38.563803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:38.563803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:38.563803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:38.563803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:38.563803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:38.563803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:38.563803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:38.563803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:38.563803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:38.563803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:38.563803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:38.564827 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:38.564827 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:38.564827 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:38.564827 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:38.569693 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 337/688] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:38.570937 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ccaf1-2341-42ad-b206-cca5aa21ee67 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:38.583958 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de6540-a7cf-474a-af6a-fa291024b1a3 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:38.739527 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de6540-a7cf-474a-af6a-fa291024b1a3 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:38.741175 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ccaf1-2341-42ad-b206-cca5aa21ee67 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:38.779031 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e4d70-a1df-4f75-b47d-59d10e9b2f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:38.779504 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e4d70-a1df-4f75-b47d-59d10e9b2f2f None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:38.779792 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e4d70-a1df-4f75-b47d-59d10e9b2f2f None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:38.780073 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e4d70-a1df-4f75-b47d-59d10e9b2f2f None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:38.780805 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e4d70-a1df-4f75-b47d-59d10e9b2f2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:38.781119 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e4d70-a1df-4f75-b47d-59d10e9b2f2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:38.783324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e4d70-a1df-4f75-b47d-59d10e9b2f2f None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:38.786812 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ab736-2c9f-47e2-8a58-184786ffa3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:38.787919 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ab736-2c9f-47e2-8a58-184786ffa3fb None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:38.788416 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ab736-2c9f-47e2-8a58-184786ffa3fb None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:38.788905 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ab736-2c9f-47e2-8a58-184786ffa3fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:38.796004 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 352/689] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:38.804535 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e4d70-a1df-4f75-b47d-59d10e9b2f2f None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:38.807340 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ab736-2c9f-47e2-8a58-184786ffa3fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:38.817850 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-e10ab736-2c9f-47e2-8a58-184786ffa3fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:33:38.817850 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:38.817850 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:38.817850 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:38.817850 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:38.817850 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:38.817850 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:38.817850 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:38.817850 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:38.817850 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:38.817850 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:38.817850 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:38.817850 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:38.817850 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:38.817850 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:38.817850 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:38.819009 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:38.819009 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:38.819009 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:38.819009 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:38.819009 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:38.819009 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:38.819009 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:38.819009 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:38.819009 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:38.819009 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:38.819009 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:38.819009 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:38.819009 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:38.819009 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:38.819009 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:38.819009 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:38.819966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:38.819966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:38.819966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:38.819966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:38.819966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:38.819966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:38.819966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:38.819966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:38.819966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:38.819966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:38.819966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:33:38.819966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:38.821858 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 338/690] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:33:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:33:38.826928 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ab736-2c9f-47e2-8a58-184786ffa3fb None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:38.927470 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e4d70-a1df-4f75-b47d-59d10e9b2f2f None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:38.935723 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ab736-2c9f-47e2-8a58-184786ffa3fb None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:38.965690 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee9e09-a68e-43e9-8c0e-2e02927c512c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:38.966937 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee9e09-a68e-43e9-8c0e-2e02927c512c None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:38.967442 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee9e09-a68e-43e9-8c0e-2e02927c512c None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:38.967935 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee9e09-a68e-43e9-8c0e-2e02927c512c None admin] PATH_INFO: `/v3/projects/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:38.972203 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491be25d-2337-4c31-91fa-6af9a6b10783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:38.972704 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491be25d-2337-4c31-91fa-6af9a6b10783 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:38.972987 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491be25d-2337-4c31-91fa-6af9a6b10783 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:38.973265 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491be25d-2337-4c31-91fa-6af9a6b10783 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:38.974054 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491be25d-2337-4c31-91fa-6af9a6b10783 None admin] RBAC: Adding query filter params (name=admin) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:38.974365 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491be25d-2337-4c31-91fa-6af9a6b10783 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:38.975760 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491be25d-2337-4c31-91fa-6af9a6b10783 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:38.978556 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee9e09-a68e-43e9-8c0e-2e02927c512c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:38.980291 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee9e09-a68e-43e9-8c0e-2e02927c512c None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:38.985384 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 339/691] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:33:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:33:38.991170 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491be25d-2337-4c31-91fa-6af9a6b10783 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:39.001056 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-d2ee9e09-a68e-43e9-8c0e-2e02927c512c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:39.001056 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:39.001056 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:39.001056 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:39.001056 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:39.001056 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:39.001056 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:39.001056 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:39.001056 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:39.001056 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:39.001056 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:39.001056 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:39.001056 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:33:39.001056 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:33:39.001056 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:33:39.002587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:33:39.002587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:39.002587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:39.002587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:39.002587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:39.002587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:39.002587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:39.002587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:39.002587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:39.002587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:39.002587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:39.002587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:39.002587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:39.002587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:39.002587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:39.002587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:39.002587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:39.003588 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:33:39.003588 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:33:39.003588 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:33:39.003588 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:33:39.003588 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:33:39.003588 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:33:39.003588 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:39.003588 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:39.006283 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 353/692] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:39.013818 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee9e09-a68e-43e9-8c0e-2e02927c512c None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:39.138094 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee9e09-a68e-43e9-8c0e-2e02927c512c None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:39.178536 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a86ff-6c89-4068-8e30-e2de88648ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:39.180114 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a86ff-6c89-4068-8e30-e2de88648ded None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:39.180636 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a86ff-6c89-4068-8e30-e2de88648ded None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:39.181145 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a86ff-6c89-4068-8e30-e2de88648ded None admin] PATH_INFO: `/v3/projects` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:39.182249 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a86ff-6c89-4068-8e30-e2de88648ded None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:39.182827 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a86ff-6c89-4068-8e30-e2de88648ded None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:39.184505 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a86ff-6c89-4068-8e30-e2de88648ded None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:39.198651 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 354/693] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:33:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:39.205178 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a86ff-6c89-4068-8e30-e2de88648ded None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:39.218152 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491be25d-2337-4c31-91fa-6af9a6b10783 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:39.271586 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b81bd-4736-46b8-8340-4bff57dce8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:39.272414 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b81bd-4736-46b8-8340-4bff57dce8bf None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:39.272703 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b81bd-4736-46b8-8340-4bff57dce8bf None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:39.272983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b81bd-4736-46b8-8340-4bff57dce8bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:39.299110 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b81bd-4736-46b8-8340-4bff57dce8bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:39.300597 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b81bd-4736-46b8-8340-4bff57dce8bf None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:39.325027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-c79b81bd-4736-46b8-8340-4bff57dce8bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:39.325027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:39.325027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:39.325027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:39.325027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:39.325027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:39.325027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:39.325027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:39.325027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:39.325027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:39.325027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:39.325027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:39.325027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:39.325027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:39.325027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:39.326148 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:39.326148 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:39.326148 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:39.326148 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:39.326148 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:39.326148 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:39.326148 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:39.326148 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:39.326148 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:39.326148 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:39.326148 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:39.326148 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:39.326148 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:39.326148 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:39.326148 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:39.326148 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:39.326148 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:39.327117 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:39.327117 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:39.327117 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:39.327117 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:39.327117 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 340/694] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:33:39.332959 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b81bd-4736-46b8-8340-4bff57dce8bf None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:39.353539 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a86ff-6c89-4068-8e30-e2de88648ded None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:39.439857 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fda74-1393-4416-a68e-e56b0d303ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:39.440922 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fda74-1393-4416-a68e-e56b0d303ca4 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:39.441442 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fda74-1393-4416-a68e-e56b0d303ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:39.441943 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fda74-1393-4416-a68e-e56b0d303ca4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:39.443103 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98fda74-1393-4416-a68e-e56b0d303ca4 None admin] RBAC: Adding query filter params (role.id=b22352a378fb404d90e3b3ae182757ad, scope.project.id=db5768a93e754372808fc69f898cc853, user.id=6e553afd9da345b29b3b164e34e5a506) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:39.443646 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98fda74-1393-4416-a68e-e56b0d303ca4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:39.445325 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98fda74-1393-4416-a68e-e56b0d303ca4 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:39.457293 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b81bd-4736-46b8-8340-4bff57dce8bf None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:39.460791 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 355/695] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:33:39 2022] GET /identity/v3/role_assignments?user.id=6e553afd9da345b29b3b164e34e5a506&scope.project.id=db5768a93e754372808fc69f898cc853&role.id=b22352a378fb404d90e3b3ae182757ad => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:39.505604 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaac98a-6ccb-4858-afe9-5ceb5b0a2164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:39.506326 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaac98a-6ccb-4858-afe9-5ceb5b0a2164 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:39.506616 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaac98a-6ccb-4858-afe9-5ceb5b0a2164 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:39.506904 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaac98a-6ccb-4858-afe9-5ceb5b0a2164 None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:39.507689 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaac98a-6ccb-4858-afe9-5ceb5b0a2164 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:39.508004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaac98a-6ccb-4858-afe9-5ceb5b0a2164 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:39.509580 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaac98a-6ccb-4858-afe9-5ceb5b0a2164 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:39.530935 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 341/696] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:33:39.537514 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fda74-1393-4416-a68e-e56b0d303ca4 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:39.715925 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fda74-1393-4416-a68e-e56b0d303ca4 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:39.756320 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692ce24-ea0d-491f-8738-1c2ba13ae951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:39.757218 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692ce24-ea0d-491f-8738-1c2ba13ae951 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:39.757533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692ce24-ea0d-491f-8738-1c2ba13ae951 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:39.757869 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692ce24-ea0d-491f-8738-1c2ba13ae951 None admin] PATH_INFO: `/v3/users/nova` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:39.767068 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692ce24-ea0d-491f-8738-1c2ba13ae951 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:39.768538 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692ce24-ea0d-491f-8738-1c2ba13ae951 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:39.784682 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-7692ce24-ea0d-491f-8738-1c2ba13ae951 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:33:39.784682 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:39.784682 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:39.784682 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:39.784682 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:39.784682 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:39.784682 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:39.784682 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:39.784682 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:39.784682 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:39.784682 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:39.784682 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:39.784682 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:33:39.784682 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:33:39.784682 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:33:39.784682 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:33:39.785821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:39.785821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:39.785821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:33:39.785821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:39.785821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:33:39.785821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:39.785821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:39.785821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:39.785821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:39.785821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:39.785821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:39.785821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:39.785821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:39.785821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:39.785821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:39.785821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:39.785821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:39.785821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:39.786892 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:39.786892 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:39.786892 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:33:39.786892 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:33:39.786892 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:33:39.786892 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:33:39.786892 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:33:39.786892 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:33:39.786892 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:33:39.786892 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:39.786892 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 356/697] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:33:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:39.791964 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaac98a-6ccb-4858-afe9-5ceb5b0a2164 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:39.911878 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaac98a-6ccb-4858-afe9-5ceb5b0a2164 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:39.915518 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cb1bb-4986-470b-a95e-9e313422bd9e None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:39.915826 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cb1bb-4986-470b-a95e-9e313422bd9e None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:39.916139 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cb1bb-4986-470b-a95e-9e313422bd9e None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:39.918011 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 357/698] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:39.927691 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8235466-b745-4b27-af0a-b0920d29adc9 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:39.928046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8235466-b745-4b27-af0a-b0920d29adc9 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:39.928260 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8235466-b745-4b27-af0a-b0920d29adc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:39.950793 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-e8235466-b745-4b27-af0a-b0920d29adc9 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:39.952016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-e8235466-b745-4b27-af0a-b0920d29adc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:39.963462 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5848b9-f26f-4150-a7d2-d31ea80d0d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:39.964182 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5848b9-f26f-4150-a7d2-d31ea80d0d1a None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:39.964472 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5848b9-f26f-4150-a7d2-d31ea80d0d1a None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:39.964755 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5848b9-f26f-4150-a7d2-d31ea80d0d1a None admin] PATH_INFO: `/v3/users` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:39.965646 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5848b9-f26f-4150-a7d2-d31ea80d0d1a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:39.966324 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5848b9-f26f-4150-a7d2-d31ea80d0d1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:39.967425 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5848b9-f26f-4150-a7d2-d31ea80d0d1a None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:39.989214 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 342/699] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:33:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:39.994359 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5848b9-f26f-4150-a7d2-d31ea80d0d1a None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:40.089476 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 358/700] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:33:40.113279 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8235466-b745-4b27-af0a-b0920d29adc9 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:40.176615 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5848b9-f26f-4150-a7d2-d31ea80d0d1a None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:40.216447 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c48a9-ae14-43ea-b83a-1cbebd594512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:40.217410 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c48a9-ae14-43ea-b83a-1cbebd594512 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:40.217530 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c48a9-ae14-43ea-b83a-1cbebd594512 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:40.217818 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c48a9-ae14-43ea-b83a-1cbebd594512 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:40.242751 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8235466-b745-4b27-af0a-b0920d29adc9 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:40.291206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74e65a-38a2-48fe-b3b1-695ab31c7b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:40.292047 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74e65a-38a2-48fe-b3b1-695ab31c7b73 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:40.292884 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74e65a-38a2-48fe-b3b1-695ab31c7b73 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:40.293197 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74e65a-38a2-48fe-b3b1-695ab31c7b73 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:40.294086 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74e65a-38a2-48fe-b3b1-695ab31c7b73 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:40.295846 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74e65a-38a2-48fe-b3b1-695ab31c7b73 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:40.315007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-7f74e65a-38a2-48fe-b3b1-695ab31c7b73 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:33:40.315007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:40.315007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:33:40.315007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:33:40.315007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:33:40.315007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:33:40.315007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:33:40.315007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:33:40.315007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:33:40.315007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:40.315007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:33:40.315007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:40.315007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:40.315007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:40.315007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:40.315007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:40.316425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:40.316425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:40.316425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:40.316425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:40.316425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:40.316425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:40.316425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:40.316425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:33:40.316425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:33:40.316425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:33:40.316425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:33:40.316425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:40.316425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:40.316425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:40.316425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:40.316425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:40.317586 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:40.317586 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:40.317586 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:40.317586 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:40.317586 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:40.317586 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:40.317586 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:40.317586 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:40.317586 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:40.317586 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:40.317586 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:40.317586 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:33:40.317586 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:33:40.317586 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:33:40.317586 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:40.319934 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c48a9-ae14-43ea-b83a-1cbebd594512 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:40.319934 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c48a9-ae14-43ea-b83a-1cbebd594512 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:40.320592 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 359/701] 10.222.0.48 () {56 vars in 1129 bytes} [Mon May 9 15:33:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:33:40.320592 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9befa93-6d6a-481c-8b3b-4b626ee45cf1 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:40.320592 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9befa93-6d6a-481c-8b3b-4b626ee45cf1 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:40.320592 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9befa93-6d6a-481c-8b3b-4b626ee45cf1 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:40.326057 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 360/702] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:40.327457 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e23442-742a-43be-a28f-af4e34ea8fb8 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:40.327757 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e23442-742a-43be-a28f-af4e34ea8fb8 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:40.328045 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e23442-742a-43be-a28f-af4e34ea8fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:40.348622 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-a1e23442-742a-43be-a28f-af4e34ea8fb8 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:40.350170 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-a1e23442-742a-43be-a28f-af4e34ea8fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:40.437671 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 361/703] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:33:40.438736 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e23442-742a-43be-a28f-af4e34ea8fb8 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:40.448107 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 343/704] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:33:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:33:40.458530 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c48a9-ae14-43ea-b83a-1cbebd594512 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:40.554059 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e23442-742a-43be-a28f-af4e34ea8fb8 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:40.570901 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c48a9-ae14-43ea-b83a-1cbebd594512 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:40.592129 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc47d65-b44d-40e4-8a49-ce48f0c98334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:40.592813 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc47d65-b44d-40e4-8a49-ce48f0c98334 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:40.593099 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc47d65-b44d-40e4-8a49-ce48f0c98334 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:40.593395 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc47d65-b44d-40e4-8a49-ce48f0c98334 None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:40.594727 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc47d65-b44d-40e4-8a49-ce48f0c98334 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:40.595061 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc47d65-b44d-40e4-8a49-ce48f0c98334 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:40.596465 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc47d65-b44d-40e4-8a49-ce48f0c98334 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:40.606277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 362/705] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 9 15:33:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:40.607247 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc47d65-b44d-40e4-8a49-ce48f0c98334 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:40.609313 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aedbd6-6054-4f29-9cea-eb2d1f06542f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:40.610727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aedbd6-6054-4f29-9cea-eb2d1f06542f None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:40.610987 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aedbd6-6054-4f29-9cea-eb2d1f06542f None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:40.611273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aedbd6-6054-4f29-9cea-eb2d1f06542f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:40.628495 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aedbd6-6054-4f29-9cea-eb2d1f06542f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:40.628495 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aedbd6-6054-4f29-9cea-eb2d1f06542f None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:40.644906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-06aedbd6-6054-4f29-9cea-eb2d1f06542f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:40.644906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:40.644906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:40.644906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:40.644906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:40.644906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:40.644906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:40.644906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:40.644906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:40.644906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:40.644906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:40.644906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:40.644906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:40.644906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:40.644906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:40.647153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:40.647153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:40.647153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:40.647153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:40.647153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:40.647153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:40.647153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:40.647153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:40.647153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:40.647153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:40.647153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:40.647153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:40.647153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:40.647153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:40.647153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:40.647153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:40.647153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:40.649459 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:40.649459 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:40.649459 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:40.649459 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:40.649459 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 344/706] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:40.649459 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aedbd6-6054-4f29-9cea-eb2d1f06542f None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:40.721580 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc47d65-b44d-40e4-8a49-ce48f0c98334 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:40.757791 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aedbd6-6054-4f29-9cea-eb2d1f06542f None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:40.759388 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3488dc-e4db-4c3a-8ac0-e0c0a89a50e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:40.760204 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3488dc-e4db-4c3a-8ac0-e0c0a89a50e7 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:40.760486 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3488dc-e4db-4c3a-8ac0-e0c0a89a50e7 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:40.760763 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3488dc-e4db-4c3a-8ac0-e0c0a89a50e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:40.772123 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3488dc-e4db-4c3a-8ac0-e0c0a89a50e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:40.773637 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3488dc-e4db-4c3a-8ac0-e0c0a89a50e7 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:40.792165 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-8f3488dc-e4db-4c3a-8ac0-e0c0a89a50e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:40.792165 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:40.792165 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:40.792165 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:40.792165 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:40.792165 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:40.792165 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:40.792165 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:40.792165 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:40.792165 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:40.792165 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:40.792165 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:40.792165 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:40.792165 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:40.792165 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:40.794430 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:40.794430 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:40.794430 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:40.794430 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:40.794430 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:40.794430 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:40.794430 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:40.794430 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:40.794430 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:40.794430 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:40.794430 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:40.794430 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:40.794430 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:40.794430 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:40.794430 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:40.794430 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:40.794430 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:40.796666 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:40.796666 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:40.796666 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:40.796666 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:40.796666 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 363/707] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:40.796666 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3488dc-e4db-4c3a-8ac0-e0c0a89a50e7 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:40.805480 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a395a9f-acb0-4f7c-aada-1041f695bcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:40.805480 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a395a9f-acb0-4f7c-aada-1041f695bcca None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:40.805480 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a395a9f-acb0-4f7c-aada-1041f695bcca None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:40.805480 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a395a9f-acb0-4f7c-aada-1041f695bcca None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:40.806294 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a395a9f-acb0-4f7c-aada-1041f695bcca None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:40.806294 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a395a9f-acb0-4f7c-aada-1041f695bcca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:40.806294 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a395a9f-acb0-4f7c-aada-1041f695bcca None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:40.811166 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 345/708] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 9 15:33:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:40.812053 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a395a9f-acb0-4f7c-aada-1041f695bcca None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:40.930513 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3488dc-e4db-4c3a-8ac0-e0c0a89a50e7 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:40.970902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01bbe8-9c6a-480c-a543-9069c86df1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:40.971597 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01bbe8-9c6a-480c-a543-9069c86df1ea None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:40.971857 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01bbe8-9c6a-480c-a543-9069c86df1ea None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:40.972140 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01bbe8-9c6a-480c-a543-9069c86df1ea None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:40.972896 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01bbe8-9c6a-480c-a543-9069c86df1ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:40.973204 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01bbe8-9c6a-480c-a543-9069c86df1ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:40.974731 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01bbe8-9c6a-480c-a543-9069c86df1ea None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:40.988840 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 364/709] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:40.994054 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01bbe8-9c6a-480c-a543-9069c86df1ea None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:41.080351 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a395a9f-acb0-4f7c-aada-1041f695bcca None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:41.109190 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01bbe8-9c6a-480c-a543-9069c86df1ea None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:41.142631 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e9ec8-e3ea-4875-9ef5-df7f6ede2c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:41.144524 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e9ec8-e3ea-4875-9ef5-df7f6ede2c9e None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:41.145018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e9ec8-e3ea-4875-9ef5-df7f6ede2c9e None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:41.145750 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e9ec8-e3ea-4875-9ef5-df7f6ede2c9e None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:41.146778 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e9ec8-e3ea-4875-9ef5-df7f6ede2c9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:41.147217 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e9ec8-e3ea-4875-9ef5-df7f6ede2c9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:41.149354 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e9ec8-e3ea-4875-9ef5-df7f6ede2c9e None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:41.155730 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71596488-309a-4618-8510-a989c72f6317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:41.156685 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71596488-309a-4618-8510-a989c72f6317 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:41.157063 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71596488-309a-4618-8510-a989c72f6317 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:41.157703 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71596488-309a-4618-8510-a989c72f6317 None admin] PATH_INFO: `/v3/projects/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:41.169247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 346/710] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:41.170788 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71596488-309a-4618-8510-a989c72f6317 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:41.172328 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71596488-309a-4618-8510-a989c72f6317 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:41.180210 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e9ec8-e3ea-4875-9ef5-df7f6ede2c9e None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:41.191808 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-71596488-309a-4618-8510-a989c72f6317 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:41.191808 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:41.191808 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:41.191808 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:41.191808 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:41.191808 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:41.191808 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:41.191808 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:41.191808 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:41.191808 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:41.191808 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:41.191808 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:41.191808 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:33:41.191808 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:33:41.191808 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:33:41.192973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:33:41.192973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:41.192973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:41.192973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:41.192973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:41.192973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:41.192973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:41.192973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:41.192973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:41.192973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:41.192973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:41.192973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:41.192973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:41.192973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:41.192973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:41.192973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:41.192973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:41.194016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:33:41.194016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:33:41.194016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:33:41.194016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:33:41.194016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:33:41.194016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:33:41.194016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:41.194016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:41.198538 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 365/711] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:41.205301 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71596488-309a-4618-8510-a989c72f6317 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:41.411914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71596488-309a-4618-8510-a989c72f6317 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:41.425817 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e9ec8-e3ea-4875-9ef5-df7f6ede2c9e None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:41.448438 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a22c5-7f60-46b3-8ce1-fd007ba51ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:41.449123 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a22c5-7f60-46b3-8ce1-fd007ba51ee1 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:41.449464 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a22c5-7f60-46b3-8ce1-fd007ba51ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:41.449755 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a22c5-7f60-46b3-8ce1-fd007ba51ee1 None admin] PATH_INFO: `/v3/projects` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:41.450568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a22c5-7f60-46b3-8ce1-fd007ba51ee1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:41.450919 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a22c5-7f60-46b3-8ce1-fd007ba51ee1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:41.452823 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a22c5-7f60-46b3-8ce1-fd007ba51ee1 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:41.466274 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 366/712] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:33:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:33:41.468016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193c89a-d6a5-4a3f-8ece-86b66fc77538 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:41.468507 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193c89a-d6a5-4a3f-8ece-86b66fc77538 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:41.469362 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193c89a-d6a5-4a3f-8ece-86b66fc77538 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:41.471076 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 367/713] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:41.476957 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193c89a-d6a5-4a3f-8ece-86b66fc77538 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:41.484187 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b77e3e-8d3c-405b-89eb-4d498c1bc1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:41.486469 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b77e3e-8d3c-405b-89eb-4d498c1bc1de None admin] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:41.486992 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b77e3e-8d3c-405b-89eb-4d498c1bc1de None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:41.487492 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b77e3e-8d3c-405b-89eb-4d498c1bc1de None admin] PATH_INFO: `/v3/users` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:41.488409 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b77e3e-8d3c-405b-89eb-4d498c1bc1de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:41.490126 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b77e3e-8d3c-405b-89eb-4d498c1bc1de None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:41.513624 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 347/714] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:33:41 2022] POST /identity/v3/users => generated 254 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:33:41.515450 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded3ff1-9ec9-468a-ae67-5048dff98cef None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:41.516032 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded3ff1-9ec9-468a-ae67-5048dff98cef None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:41.517244 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded3ff1-9ec9-468a-ae67-5048dff98cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:41.537947 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-4ded3ff1-9ec9-468a-ae67-5048dff98cef None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:41.539578 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-4ded3ff1-9ec9-468a-ae67-5048dff98cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:41.630764 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 348/715] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:33:41.661045 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded3ff1-9ec9-468a-ae67-5048dff98cef None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:41.675774 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193c89a-d6a5-4a3f-8ece-86b66fc77538 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:41.720023 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d978b3b-8f71-4ffe-ad08-bdd039807dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:41.720781 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d978b3b-8f71-4ffe-ad08-bdd039807dcf None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:41.721069 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d978b3b-8f71-4ffe-ad08-bdd039807dcf None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:41.721420 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d978b3b-8f71-4ffe-ad08-bdd039807dcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:41.722358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d978b3b-8f71-4ffe-ad08-bdd039807dcf None admin] RBAC: Adding query filter params (role.id=a5cb8d37261d486cbc1b06d167a9c05c, scope.project.id=db5768a93e754372808fc69f898cc853, user.id=d398283fc99c4bfe83170ad3d1538f38) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:41.722869 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d978b3b-8f71-4ffe-ad08-bdd039807dcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:41.724521 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d978b3b-8f71-4ffe-ad08-bdd039807dcf None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:41.731936 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 368/716] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:33:41 2022] GET /identity/v3/role_assignments?user.id=d398283fc99c4bfe83170ad3d1538f38&scope.project.id=db5768a93e754372808fc69f898cc853&role.id=a5cb8d37261d486cbc1b06d167a9c05c => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:41.789793 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded3ff1-9ec9-468a-ae67-5048dff98cef None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:41.838113 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3d7be-9618-430c-9d7b-c4f4731e25a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:41.839042 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3d7be-9618-430c-9d7b-c4f4731e25a2 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:41.839366 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3d7be-9618-430c-9d7b-c4f4731e25a2 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:41.839780 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3d7be-9618-430c-9d7b-c4f4731e25a2 None admin] PATH_INFO: `/v3/services/network` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:41.840476 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b3d7be-9618-430c-9d7b-c4f4731e25a2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:41.842096 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b3d7be-9618-430c-9d7b-c4f4731e25a2 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:41.859177 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-84b3d7be-9618-430c-9d7b-c4f4731e25a2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:33:41.859177 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:41.859177 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:33:41.859177 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:33:41.859177 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:33:41.859177 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:33:41.859177 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:33:41.859177 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:33:41.859177 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:33:41.859177 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:41.859177 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:33:41.859177 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:41.859177 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:41.859177 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:41.859177 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:41.859177 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:41.859177 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:41.860515 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:41.860515 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:41.860515 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:41.860515 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:41.860515 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:41.860515 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:41.860515 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:33:41.860515 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:33:41.860515 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:33:41.860515 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:33:41.860515 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:41.860515 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:41.860515 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:41.860515 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:41.860515 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:41.860515 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:41.862465 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:41.862465 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:41.862465 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:41.862465 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:41.862465 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:41.862465 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:41.862465 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:41.862465 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:41.862465 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:41.862465 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:41.862465 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:33:41.862465 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:33:41.862465 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:33:41.862465 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:41.862465 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 349/717] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:41 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:33:41.870904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d978b3b-8f71-4ffe-ad08-bdd039807dcf None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:42.010403 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d978b3b-8f71-4ffe-ad08-bdd039807dcf None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:42.053581 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a868efb-6c6a-4daa-b0be-259e41ea401f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:42.054325 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a868efb-6c6a-4daa-b0be-259e41ea401f None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:42.054636 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a868efb-6c6a-4daa-b0be-259e41ea401f None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:42.054938 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a868efb-6c6a-4daa-b0be-259e41ea401f None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:42.055740 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a868efb-6c6a-4daa-b0be-259e41ea401f None admin] RBAC: Adding query filter params (name=network) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:42.056055 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a868efb-6c6a-4daa-b0be-259e41ea401f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:42.057708 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a868efb-6c6a-4daa-b0be-259e41ea401f None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:42.065060 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 369/718] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:33:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:42.071031 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3d7be-9618-430c-9d7b-c4f4731e25a2 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:42.205803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3d7be-9618-430c-9d7b-c4f4731e25a2 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:42.250784 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73fe60-b9b5-4162-ae1d-4ef7fc0b72c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:42.252081 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73fe60-b9b5-4162-ae1d-4ef7fc0b72c6 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:42.252646 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73fe60-b9b5-4162-ae1d-4ef7fc0b72c6 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:42.253176 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73fe60-b9b5-4162-ae1d-4ef7fc0b72c6 None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:42.254230 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b73fe60-b9b5-4162-ae1d-4ef7fc0b72c6 None admin] RBAC: Adding query filter params (type=network) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:42.254855 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b73fe60-b9b5-4162-ae1d-4ef7fc0b72c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:42.256799 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b73fe60-b9b5-4162-ae1d-4ef7fc0b72c6 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:42.262927 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 350/719] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:33:42 2022] GET /identity/v3/services?type=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:33:42.750361 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ed055-1507-4b93-86e3-e0f31cc5efe6 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:42.751822 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ed055-1507-4b93-86e3-e0f31cc5efe6 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:42.752314 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ed055-1507-4b93-86e3-e0f31cc5efe6 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:42.754480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 370/720] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:42.762860 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc29fa-bcad-40f0-970f-b96ccc6aa8c4 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:42.763804 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc29fa-bcad-40f0-970f-b96ccc6aa8c4 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:42.764365 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc29fa-bcad-40f0-970f-b96ccc6aa8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:42.786641 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-3ddc29fa-bcad-40f0-970f-b96ccc6aa8c4 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:42.788321 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-3ddc29fa-bcad-40f0-970f-b96ccc6aa8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:42.879061 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 351/721] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:33:42.933964 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ed055-1507-4b93-86e3-e0f31cc5efe6 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:43.075372 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ed055-1507-4b93-86e3-e0f31cc5efe6 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:43.126545 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7b710-517b-4524-a85d-fd758b18b712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:43.127502 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7b710-517b-4524-a85d-fd758b18b712 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:43.127809 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7b710-517b-4524-a85d-fd758b18b712 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:43.128101 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7b710-517b-4524-a85d-fd758b18b712 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:43.149967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7b710-517b-4524-a85d-fd758b18b712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:43.159174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-b7d7b710-517b-4524-a85d-fd758b18b712 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:33:43.159174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:43.159174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:43.159174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:43.159174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:43.159174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:43.159174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:43.159174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:43.159174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:43.159174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:43.159174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:43.159174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:43.159174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:43.159174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:43.159174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:43.159174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:43.160400 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:43.160400 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:43.160400 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:43.160400 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:43.160400 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:43.160400 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:43.160400 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:43.160400 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:43.160400 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:43.160400 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:43.160400 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:43.160400 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:43.160400 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:43.160400 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:43.160400 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:43.160400 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:43.161444 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:43.161444 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:43.161444 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:43.161444 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:43.161444 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:43.161444 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:43.161444 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:43.161444 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:43.161444 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:43.161444 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:43.161444 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:33:43.161444 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:43.161444 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 371/722] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:33:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:43.167247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc29fa-bcad-40f0-970f-b96ccc6aa8c4 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:43.289757 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc29fa-bcad-40f0-970f-b96ccc6aa8c4 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:43.340608 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a30dc-3fd2-42cc-8cda-d4fbc098717b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:43.341736 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a30dc-3fd2-42cc-8cda-d4fbc098717b None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:43.342242 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a30dc-3fd2-42cc-8cda-d4fbc098717b None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:43.342735 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a30dc-3fd2-42cc-8cda-d4fbc098717b None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:43.343901 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a30dc-3fd2-42cc-8cda-d4fbc098717b None admin] RBAC: Adding query filter params (name=admin) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:43.345073 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a30dc-3fd2-42cc-8cda-d4fbc098717b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:43.346808 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a30dc-3fd2-42cc-8cda-d4fbc098717b None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:43.362561 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 352/723] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:33:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:43.370999 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7b710-517b-4524-a85d-fd758b18b712 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:43.525878 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7b710-517b-4524-a85d-fd758b18b712 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:43.603060 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9860cd-226a-444e-a9bf-148e34a74ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:43.604316 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9860cd-226a-444e-a9bf-148e34a74ca5 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:43.604753 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9860cd-226a-444e-a9bf-148e34a74ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:43.605184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9860cd-226a-444e-a9bf-148e34a74ca5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:43.633599 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9860cd-226a-444e-a9bf-148e34a74ca5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:43.636001 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9860cd-226a-444e-a9bf-148e34a74ca5 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:43.687970 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-0e9860cd-226a-444e-a9bf-148e34a74ca5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:43.687970 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:43.687970 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:43.687970 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:43.687970 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:43.687970 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:43.687970 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:43.687970 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:43.687970 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:43.687970 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:43.687970 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:43.687970 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:43.687970 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:43.687970 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:43.687970 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:43.689038 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:43.689038 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:43.689038 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:43.689038 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:43.689038 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:43.689038 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:43.689038 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:43.689038 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:43.689038 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:43.689038 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:43.689038 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:43.689038 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:43.689038 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:43.689038 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:43.689038 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:43.689038 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:43.689038 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:43.690067 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:43.690067 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:43.690067 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:43.690067 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:43.690850 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 372/724] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:43.699529 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a30dc-3fd2-42cc-8cda-d4fbc098717b None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:43.861136 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a30dc-3fd2-42cc-8cda-d4fbc098717b None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:43.908592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3398dd1-df9b-436c-840c-75cc2ce7145e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:43.909764 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3398dd1-df9b-436c-840c-75cc2ce7145e None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:43.910266 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3398dd1-df9b-436c-840c-75cc2ce7145e None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:43.910745 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3398dd1-df9b-436c-840c-75cc2ce7145e None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:43.911705 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3398dd1-df9b-436c-840c-75cc2ce7145e None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:43.912229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3398dd1-df9b-436c-840c-75cc2ce7145e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:43.913925 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3398dd1-df9b-436c-840c-75cc2ce7145e None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:43.932964 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 353/725] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:43.941904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9860cd-226a-444e-a9bf-148e34a74ca5 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:43.973239 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fde349-b162-4ea6-a4f9-2af3120e398d None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:43.973795 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fde349-b162-4ea6-a4f9-2af3120e398d None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:43.974246 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fde349-b162-4ea6-a4f9-2af3120e398d None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:43.976744 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 354/726] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:33:43.998994 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e7174-38a3-47ec-b14b-7fff334b2f15 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:43.999485 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e7174-38a3-47ec-b14b-7fff334b2f15 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:43.999970 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e7174-38a3-47ec-b14b-7fff334b2f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:44.059801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-3e2e7174-38a3-47ec-b14b-7fff334b2f15 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:44.061415 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-3e2e7174-38a3-47ec-b14b-7fff334b2f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:44.070929 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9860cd-226a-444e-a9bf-148e34a74ca5 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:44.122312 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b17596-142e-4dc5-8f96-11aff0a12a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:44.123063 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b17596-142e-4dc5-8f96-11aff0a12a04 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:44.123360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b17596-142e-4dc5-8f96-11aff0a12a04 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:44.123675 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b17596-142e-4dc5-8f96-11aff0a12a04 None admin] PATH_INFO: `/v3/users/swift` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:44.134616 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b17596-142e-4dc5-8f96-11aff0a12a04 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:44.136293 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b17596-142e-4dc5-8f96-11aff0a12a04 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:44.162871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-f0b17596-142e-4dc5-8f96-11aff0a12a04 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:33:44.162871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:44.162871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:44.162871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:44.162871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:44.162871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:44.162871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:44.162871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:44.162871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:44.162871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:44.162871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:44.162871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:44.162871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:33:44.162871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:33:44.162871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:33:44.162871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:33:44.164003 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:44.164003 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:44.164003 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:33:44.164003 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:44.164003 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:33:44.164003 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:44.164003 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:44.164003 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:44.164003 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:44.164003 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:44.164003 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:44.164003 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:44.164003 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:44.164003 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:44.164003 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:44.164003 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:44.164003 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:44.164003 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:44.165050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:44.165050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:44.165050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:33:44.165050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:33:44.165050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:33:44.165050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:33:44.165050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:33:44.165050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:33:44.165050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:33:44.165050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:44.165050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 373/727] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:33:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:44.174613 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b17596-142e-4dc5-8f96-11aff0a12a04 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:44.203294 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 355/728] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:33:44.224380 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e7174-38a3-47ec-b14b-7fff334b2f15 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:44.374526 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b17596-142e-4dc5-8f96-11aff0a12a04 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:44.412084 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7e4b8-2628-4875-b04d-4e026a9ac136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:44.413086 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7e4b8-2628-4875-b04d-4e026a9ac136 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:44.413755 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7e4b8-2628-4875-b04d-4e026a9ac136 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:44.414206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7e4b8-2628-4875-b04d-4e026a9ac136 None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:44.415231 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7e4b8-2628-4875-b04d-4e026a9ac136 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:44.415696 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7e4b8-2628-4875-b04d-4e026a9ac136 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:44.417525 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7e4b8-2628-4875-b04d-4e026a9ac136 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:44.439377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 374/729] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 9 15:33:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:44.456471 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7e4b8-2628-4875-b04d-4e026a9ac136 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:44.496470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e7174-38a3-47ec-b14b-7fff334b2f15 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:44.573682 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7e4b8-2628-4875-b04d-4e026a9ac136 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:44.609026 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b474e95-2fb5-431a-bb65-1ecfd14e678a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:44.610290 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b474e95-2fb5-431a-bb65-1ecfd14e678a None admin] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:44.610576 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b474e95-2fb5-431a-bb65-1ecfd14e678a None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:44.610856 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b474e95-2fb5-431a-bb65-1ecfd14e678a None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:44.611608 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b474e95-2fb5-431a-bb65-1ecfd14e678a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:44.613222 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b474e95-2fb5-431a-bb65-1ecfd14e678a None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:44.614559 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462668db-2306-4c5f-942c-f2da1a9865e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:44.615675 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462668db-2306-4c5f-942c-f2da1a9865e7 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:44.616202 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462668db-2306-4c5f-942c-f2da1a9865e7 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:44.616685 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462668db-2306-4c5f-942c-f2da1a9865e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:44.654137 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 356/730] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:33:44 2022] POST /identity/v3/services => generated 251 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:33:44.720969 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462668db-2306-4c5f-942c-f2da1a9865e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:44.722533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462668db-2306-4c5f-942c-f2da1a9865e7 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:44.844749 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 375/731] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:33:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:33:44.852753 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b474e95-2fb5-431a-bb65-1ecfd14e678a None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:44.986506 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b474e95-2fb5-431a-bb65-1ecfd14e678a None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:45.036821 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1db358-da3c-4eef-b0f7-b35bb2d5c908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:45.037720 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1db358-da3c-4eef-b0f7-b35bb2d5c908 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:45.038007 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1db358-da3c-4eef-b0f7-b35bb2d5c908 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:45.038336 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1db358-da3c-4eef-b0f7-b35bb2d5c908 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:45.058830 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1db358-da3c-4eef-b0f7-b35bb2d5c908 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:45.060339 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1db358-da3c-4eef-b0f7-b35bb2d5c908 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:45.082648 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-4f1db358-da3c-4eef-b0f7-b35bb2d5c908 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:45.082648 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:45.082648 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:45.082648 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:45.082648 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:45.082648 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:45.082648 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:45.082648 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:45.082648 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:45.082648 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:45.082648 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:45.082648 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:45.082648 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:45.082648 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:45.082648 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:45.083731 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:45.083731 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:45.083731 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:45.083731 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:45.083731 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:45.083731 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:45.083731 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:45.083731 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:45.083731 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:45.083731 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:45.083731 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:45.083731 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:45.083731 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:45.083731 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:45.083731 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:45.083731 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:45.083731 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:45.084727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:45.084727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:45.084727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:45.084727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:45.084727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 357/732] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:45.093227 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462668db-2306-4c5f-942c-f2da1a9865e7 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:45.218853 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462668db-2306-4c5f-942c-f2da1a9865e7 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:45.264772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5804f95-871b-426e-a54d-a49016a86060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:45.265424 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5804f95-871b-426e-a54d-a49016a86060 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:45.266354 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5804f95-871b-426e-a54d-a49016a86060 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:45.266643 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5804f95-871b-426e-a54d-a49016a86060 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:45.267548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5804f95-871b-426e-a54d-a49016a86060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:45.267861 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5804f95-871b-426e-a54d-a49016a86060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:45.270107 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5804f95-871b-426e-a54d-a49016a86060 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:45.288162 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 376/733] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:33:45.295449 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1db358-da3c-4eef-b0f7-b35bb2d5c908 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:45.417532 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ded9e-8e76-47e3-aa18-c39c0640023c None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:45.417882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ded9e-8e76-47e3-aa18-c39c0640023c None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:45.418147 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ded9e-8e76-47e3-aa18-c39c0640023c None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:45.419909 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 377/734] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:45.426324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac2903-86e1-4d11-a0bf-2cd1ae88b3a0 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:45.426655 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac2903-86e1-4d11-a0bf-2cd1ae88b3a0 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:45.427814 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac2903-86e1-4d11-a0bf-2cd1ae88b3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:45.450239 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1db358-da3c-4eef-b0f7-b35bb2d5c908 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:45.459108 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-9aac2903-86e1-4d11-a0bf-2cd1ae88b3a0 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:45.466318 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-9aac2903-86e1-4d11-a0bf-2cd1ae88b3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:45.526611 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0188ca-aca4-41a2-91b5-7a3129c5d52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:45.527901 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0188ca-aca4-41a2-91b5-7a3129c5d52a None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:45.528403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0188ca-aca4-41a2-91b5-7a3129c5d52a None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:45.530248 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0188ca-aca4-41a2-91b5-7a3129c5d52a None admin] PATH_INFO: `/v3/projects/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:45.543625 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0188ca-aca4-41a2-91b5-7a3129c5d52a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:45.546397 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0188ca-aca4-41a2-91b5-7a3129c5d52a None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:45.563986 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-be0188ca-aca4-41a2-91b5-7a3129c5d52a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:45.563986 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:45.563986 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:45.563986 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:45.563986 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:45.563986 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:45.563986 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:45.563986 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:45.563986 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:45.563986 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:45.563986 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:45.563986 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:45.563986 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:33:45.563986 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:33:45.563986 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:33:45.565059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:33:45.565059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:45.565059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:45.565059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:45.565059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:45.565059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:45.565059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:45.565059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:45.565059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:45.565059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:45.565059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:45.565059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:45.565059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:45.565059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:45.565059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:45.565059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:45.565059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:45.566102 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:33:45.566102 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:33:45.566102 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:33:45.566102 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:33:45.566102 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:33:45.566102 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:33:45.566102 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:45.566102 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:45.568826 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 358/735] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:45.575008 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcd69d-2364-4b24-9b52-a0e94bdc4116 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:45.575631 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcd69d-2364-4b24-9b52-a0e94bdc4116 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:45.576023 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcd69d-2364-4b24-9b52-a0e94bdc4116 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:45.581657 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 359/736] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:45.581657 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcd69d-2364-4b24-9b52-a0e94bdc4116 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:45.607795 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 378/737] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:45 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:33:45.609624 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccfc8a-ab77-40d1-82aa-ea7d27717875 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:45.610153 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccfc8a-ab77-40d1-82aa-ea7d27717875 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:45.610585 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccfc8a-ab77-40d1-82aa-ea7d27717875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:45.642593 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-09ccfc8a-ab77-40d1-82aa-ea7d27717875 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:45.644019 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-09ccfc8a-ab77-40d1-82aa-ea7d27717875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:45.739800 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcd69d-2364-4b24-9b52-a0e94bdc4116 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:45.766364 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 379/738] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:45 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:33:45.768653 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ccfc8a-ab77-40d1-82aa-ea7d27717875 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:45.798924 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0adee-6ee4-467c-8fd6-aad804be6189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:45.799964 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0adee-6ee4-467c-8fd6-aad804be6189 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:45.800465 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0adee-6ee4-467c-8fd6-aad804be6189 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:45.800978 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0adee-6ee4-467c-8fd6-aad804be6189 None admin] PATH_INFO: `/v3/projects` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:45.802528 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0adee-6ee4-467c-8fd6-aad804be6189 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:45.803082 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0adee-6ee4-467c-8fd6-aad804be6189 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:45.805776 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0adee-6ee4-467c-8fd6-aad804be6189 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:45.824332 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 360/739] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:33:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:45.825581 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11761168-9e73-4cf3-a791-be69f4a14b06 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:45.825964 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11761168-9e73-4cf3-a791-be69f4a14b06 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:45.826246 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11761168-9e73-4cf3-a791-be69f4a14b06 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:45.827717 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 361/740] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:45.828327 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11761168-9e73-4cf3-a791-be69f4a14b06 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:45.918997 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ccfc8a-ab77-40d1-82aa-ea7d27717875 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:45.944485 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11761168-9e73-4cf3-a791-be69f4a14b06 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:45.980850 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3888b0b-6c23-4de7-b0b8-20d8907cc0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:45.981715 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3888b0b-6c23-4de7-b0b8-20d8907cc0b5 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:45.982002 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3888b0b-6c23-4de7-b0b8-20d8907cc0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:45.982279 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3888b0b-6c23-4de7-b0b8-20d8907cc0b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:45.994457 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857562f-dc72-4696-a601-550965002800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:45.995545 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857562f-dc72-4696-a601-550965002800 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:45.995874 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857562f-dc72-4696-a601-550965002800 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:45.996157 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857562f-dc72-4696-a601-550965002800 None admin] PATH_INFO: `/v3/roles/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:45.996358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3888b0b-6c23-4de7-b0b8-20d8907cc0b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:46.005342 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-e3888b0b-6c23-4de7-b0b8-20d8907cc0b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:33:46.005342 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:46.005342 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:46.005342 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:46.005342 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:46.005342 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:46.005342 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:46.005342 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:46.005342 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:46.005342 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:46.005342 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:46.005342 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:46.005342 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:46.005342 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:46.005342 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:46.005342 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:46.007678 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:46.007678 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:46.007678 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:46.007678 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:46.007678 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:46.007678 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:46.007678 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:46.007678 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:46.007678 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:46.007678 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:46.007678 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:46.007678 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:46.007678 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:46.007678 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:46.007678 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:46.007678 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:46.010561 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:46.010561 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:46.010561 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:46.010561 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:46.010561 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:46.010561 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:46.010561 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:46.010561 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:46.010561 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:46.010561 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:46.010561 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:33:46.010561 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:46.010561 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 380/741] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:33:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:46.014382 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3888b0b-6c23-4de7-b0b8-20d8907cc0b5 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:46.014743 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857562f-dc72-4696-a601-550965002800 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:46.022991 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-9857562f-dc72-4696-a601-550965002800 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:46.022991 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:46.022991 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:46.022991 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:46.022991 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:46.022991 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:46.022991 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:46.022991 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:46.022991 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:46.022991 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:46.022991 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:46.022991 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:46.022991 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:46.022991 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:46.022991 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:46.022991 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:46.024219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:46.024219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:46.024219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:46.024219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:46.024219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:46.024219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:46.024219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:46.024219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:46.024219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:46.024219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:46.024219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:46.024219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:46.024219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:46.024219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:46.024219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:46.024219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:46.025190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:46.025190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:46.025190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:46.025190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:46.025190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:46.025190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:46.025190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:46.025190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:46.025190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:46.025190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:46.025190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:46.025190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:46.029886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 362/742] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:33:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:46.031289 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebf26b-d663-4bb2-a690-ba93d704da26 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:46.032735 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebf26b-d663-4bb2-a690-ba93d704da26 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:46.033031 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebf26b-d663-4bb2-a690-ba93d704da26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:46.051250 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-04ebf26b-d663-4bb2-a690-ba93d704da26 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:46.052387 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-04ebf26b-d663-4bb2-a690-ba93d704da26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:46.146975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 363/743] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:33:46.147936 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebf26b-d663-4bb2-a690-ba93d704da26 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:46.193008 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3888b0b-6c23-4de7-b0b8-20d8907cc0b5 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:46.240401 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2a603-67be-4a5c-88e1-eaf71516591e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:46.241094 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2a603-67be-4a5c-88e1-eaf71516591e None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:46.241420 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2a603-67be-4a5c-88e1-eaf71516591e None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:46.241729 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2a603-67be-4a5c-88e1-eaf71516591e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:46.242619 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2a603-67be-4a5c-88e1-eaf71516591e None admin] RBAC: Adding query filter params (role.id=a5cb8d37261d486cbc1b06d167a9c05c, scope.project.id=db5768a93e754372808fc69f898cc853, user.id=6e553afd9da345b29b3b164e34e5a506) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:46.242940 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2a603-67be-4a5c-88e1-eaf71516591e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:46.244487 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2a603-67be-4a5c-88e1-eaf71516591e None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:46.261419 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 381/744] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:33:46 2022] GET /identity/v3/role_assignments?user.id=6e553afd9da345b29b3b164e34e5a506&scope.project.id=db5768a93e754372808fc69f898cc853&role.id=a5cb8d37261d486cbc1b06d167a9c05c => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:46.261419 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2a603-67be-4a5c-88e1-eaf71516591e None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:46.341208 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebf26b-d663-4bb2-a690-ba93d704da26 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:46.417584 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19feb874-9675-4449-8e27-de4b3f01cab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:46.419643 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19feb874-9675-4449-8e27-de4b3f01cab5 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:46.420288 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19feb874-9675-4449-8e27-de4b3f01cab5 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:46.420830 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19feb874-9675-4449-8e27-de4b3f01cab5 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:46.423139 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19feb874-9675-4449-8e27-de4b3f01cab5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:46.423687 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19feb874-9675-4449-8e27-de4b3f01cab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:46.426635 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19feb874-9675-4449-8e27-de4b3f01cab5 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:46.446292 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 364/745] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:33:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:46.448444 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19feb874-9675-4449-8e27-de4b3f01cab5 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:46.464493 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2a603-67be-4a5c-88e1-eaf71516591e None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:46.527696 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46331e-affe-485f-b66a-ff203368ca2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:46.528394 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46331e-affe-485f-b66a-ff203368ca2d None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:46.528683 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46331e-affe-485f-b66a-ff203368ca2d None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:46.528960 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46331e-affe-485f-b66a-ff203368ca2d None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:46.530332 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46331e-affe-485f-b66a-ff203368ca2d None admin] RBAC: Adding query filter params (name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:46.530649 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46331e-affe-485f-b66a-ff203368ca2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:46.534025 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46331e-affe-485f-b66a-ff203368ca2d None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:46.544784 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 382/746] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:33:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:46.546299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46331e-affe-485f-b66a-ff203368ca2d None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:46.606280 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19feb874-9675-4449-8e27-de4b3f01cab5 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:46.663670 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324c92a-25c5-478a-b499-394d3c7445f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:46.664113 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324c92a-25c5-478a-b499-394d3c7445f9 None admin] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:46.664403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324c92a-25c5-478a-b499-394d3c7445f9 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:46.664694 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324c92a-25c5-478a-b499-394d3c7445f9 None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:46.665505 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324c92a-25c5-478a-b499-394d3c7445f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:46.666960 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324c92a-25c5-478a-b499-394d3c7445f9 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:46.689415 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 365/747] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:33:46 2022] POST /identity/v3/services => generated 240 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:33:46.689415 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324c92a-25c5-478a-b499-394d3c7445f9 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:46.717645 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46331e-affe-485f-b66a-ff203368ca2d None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:46.789317 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654b4f1-d196-46f9-bf76-c7c06c6ed859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:46.790207 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654b4f1-d196-46f9-bf76-c7c06c6ed859 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:46.790498 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654b4f1-d196-46f9-bf76-c7c06c6ed859 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:46.790779 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654b4f1-d196-46f9-bf76-c7c06c6ed859 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:46.805422 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654b4f1-d196-46f9-bf76-c7c06c6ed859 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:46.807104 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654b4f1-d196-46f9-bf76-c7c06c6ed859 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:46.832037 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-d654b4f1-d196-46f9-bf76-c7c06c6ed859 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:46.832037 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:46.832037 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:46.832037 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:46.832037 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:46.832037 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:46.832037 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:46.832037 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:46.832037 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:46.832037 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:46.832037 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:46.832037 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:46.832037 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:46.832037 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:46.832037 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:46.833462 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:46.833462 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:46.833462 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:46.833462 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:46.833462 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:46.833462 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:46.833462 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:46.833462 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:46.833462 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:46.833462 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:46.833462 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:46.833462 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:46.833462 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:46.833462 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:46.833462 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:46.833462 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:46.833462 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:46.834617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:46.834617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:46.834617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:46.834617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:46.834617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 383/748] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:46.841131 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654b4f1-d196-46f9-bf76-c7c06c6ed859 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:46.919862 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324c92a-25c5-478a-b499-394d3c7445f9 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:47.003721 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689f95e-60ab-4cbb-80b0-89c8b06929a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:47.004714 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689f95e-60ab-4cbb-80b0-89c8b06929a8 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:47.005490 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689f95e-60ab-4cbb-80b0-89c8b06929a8 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:47.005816 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689f95e-60ab-4cbb-80b0-89c8b06929a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:47.023058 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689f95e-60ab-4cbb-80b0-89c8b06929a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:47.025534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689f95e-60ab-4cbb-80b0-89c8b06929a8 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:47.054025 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-9689f95e-60ab-4cbb-80b0-89c8b06929a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:47.054025 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:47.054025 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:47.054025 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:47.054025 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:47.054025 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:47.054025 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:47.054025 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:47.054025 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:47.054025 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:47.054025 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:47.054025 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:47.054025 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:47.054025 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:47.054025 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:47.055111 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:47.055111 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:47.055111 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:47.055111 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:47.055111 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:47.055111 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:47.055111 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:47.055111 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:47.055111 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:47.055111 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:47.055111 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:47.055111 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:47.055111 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:47.055111 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:47.055111 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:47.055111 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:47.055111 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:47.056296 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:47.056296 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:47.056296 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:47.056296 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:47.056548 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 366/749] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:47.067847 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689f95e-60ab-4cbb-80b0-89c8b06929a8 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:47.114280 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654b4f1-d196-46f9-bf76-c7c06c6ed859 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:47.203661 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0133d-f98d-44e1-b2a1-40b4c1167a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:47.204728 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0133d-f98d-44e1-b2a1-40b4c1167a5e None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:47.204907 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0133d-f98d-44e1-b2a1-40b4c1167a5e None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:47.205180 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0133d-f98d-44e1-b2a1-40b4c1167a5e None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:47.209399 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0133d-f98d-44e1-b2a1-40b4c1167a5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:47.209399 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0133d-f98d-44e1-b2a1-40b4c1167a5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:47.209399 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0133d-f98d-44e1-b2a1-40b4c1167a5e None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:47.229412 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689f95e-60ab-4cbb-80b0-89c8b06929a8 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:47.235889 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 384/750] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:47.246789 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0133d-f98d-44e1-b2a1-40b4c1167a5e None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:47.320006 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b87db7-b94d-43a9-bdb4-9a3a987fa687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:47.321208 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b87db7-b94d-43a9-bdb4-9a3a987fa687 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:47.321780 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b87db7-b94d-43a9-bdb4-9a3a987fa687 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:47.322277 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b87db7-b94d-43a9-bdb4-9a3a987fa687 None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:47.323426 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b87db7-b94d-43a9-bdb4-9a3a987fa687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:47.323998 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b87db7-b94d-43a9-bdb4-9a3a987fa687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:47.325889 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b87db7-b94d-43a9-bdb4-9a3a987fa687 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:47.365455 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 367/751] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:47.374073 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b87db7-b94d-43a9-bdb4-9a3a987fa687 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:47.374325 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0133d-f98d-44e1-b2a1-40b4c1167a5e None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:47.433607 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9436b1-b0ce-42a1-a219-aefed64d5368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:47.435020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9436b1-b0ce-42a1-a219-aefed64d5368 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:47.441476 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9436b1-b0ce-42a1-a219-aefed64d5368 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:47.441476 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9436b1-b0ce-42a1-a219-aefed64d5368 None admin] PATH_INFO: `/v3/users/nova` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:47.450224 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9436b1-b0ce-42a1-a219-aefed64d5368 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:47.451850 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9436b1-b0ce-42a1-a219-aefed64d5368 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:47.477440 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-3d9436b1-b0ce-42a1-a219-aefed64d5368 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:33:47.477440 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:47.477440 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:47.477440 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:47.477440 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:47.477440 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:47.477440 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:47.477440 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:47.477440 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:47.477440 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:47.477440 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:47.477440 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:47.477440 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:33:47.477440 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:33:47.477440 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:33:47.477440 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:33:47.478895 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:47.478895 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:47.478895 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:33:47.478895 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:47.478895 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:33:47.478895 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:47.478895 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:47.478895 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:47.478895 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:47.478895 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:47.478895 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:47.478895 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:47.478895 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:47.478895 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:47.478895 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:47.478895 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:47.478895 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:47.478895 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:47.479990 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:47.479990 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:47.479990 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:33:47.479990 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:33:47.479990 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:33:47.479990 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:33:47.479990 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:33:47.479990 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:33:47.479990 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:33:47.479990 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:47.479990 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 385/752] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:33:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:33:47.487007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9436b1-b0ce-42a1-a219-aefed64d5368 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:47.637445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b87db7-b94d-43a9-bdb4-9a3a987fa687 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:47.715945 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9436b1-b0ce-42a1-a219-aefed64d5368 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:47.726145 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639c608-8f9b-438c-823d-d5256888c43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:47.727273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639c608-8f9b-438c-823d-d5256888c43b None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:47.727777 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639c608-8f9b-438c-823d-d5256888c43b None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:47.728218 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639c608-8f9b-438c-823d-d5256888c43b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:47.740528 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639c608-8f9b-438c-823d-d5256888c43b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:47.743893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639c608-8f9b-438c-823d-d5256888c43b None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:47.773794 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-4639c608-8f9b-438c-823d-d5256888c43b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:33:47.773794 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:47.773794 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:47.773794 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:47.773794 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:47.773794 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:47.773794 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:47.773794 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:47.773794 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:47.773794 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:47.773794 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:47.773794 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:47.773794 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:33:47.773794 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:33:47.773794 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:33:47.773794 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:33:47.775199 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:47.775199 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:47.775199 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:33:47.775199 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:47.775199 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:33:47.775199 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:47.775199 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:47.775199 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:47.775199 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:47.775199 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:47.775199 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:47.775199 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:47.775199 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:47.775199 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:47.775199 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:47.775199 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:47.775199 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:47.775199 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:47.776490 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:47.776490 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:47.776490 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:33:47.776490 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:33:47.776490 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:33:47.776490 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:33:47.776490 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:33:47.776490 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:33:47.776490 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:33:47.776490 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:47.787849 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 368/753] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:33:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:33:47.789121 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639c608-8f9b-438c-823d-d5256888c43b None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:47.807506 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1964d-8d6a-4726-8766-695702240877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:47.808510 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1964d-8d6a-4726-8766-695702240877 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:47.808962 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1964d-8d6a-4726-8766-695702240877 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:47.809419 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1964d-8d6a-4726-8766-695702240877 None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:47.810443 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1964d-8d6a-4726-8766-695702240877 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:47.810921 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1964d-8d6a-4726-8766-695702240877 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:47.812535 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1964d-8d6a-4726-8766-695702240877 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:47.850884 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 386/754] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:33:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:47.852210 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1964d-8d6a-4726-8766-695702240877 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:47.986788 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639c608-8f9b-438c-823d-d5256888c43b None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:48.026812 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42ea0a-d3ab-4dcc-bfb5-066d18318527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:48.028437 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42ea0a-d3ab-4dcc-bfb5-066d18318527 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:48.028915 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42ea0a-d3ab-4dcc-bfb5-066d18318527 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:48.029441 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42ea0a-d3ab-4dcc-bfb5-066d18318527 None admin] PATH_INFO: `/v3/users` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:48.030516 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42ea0a-d3ab-4dcc-bfb5-066d18318527 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:48.031033 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42ea0a-d3ab-4dcc-bfb5-066d18318527 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:48.033059 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42ea0a-d3ab-4dcc-bfb5-066d18318527 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:48.056214 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 369/755] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 9 15:33:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:48.062718 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42ea0a-d3ab-4dcc-bfb5-066d18318527 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:48.107930 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1964d-8d6a-4726-8766-695702240877 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:48.182967 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42ea0a-d3ab-4dcc-bfb5-066d18318527 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:48.221224 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2ca07-9e03-46cb-8d94-7eaac17fcc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:48.222331 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2ca07-9e03-46cb-8d94-7eaac17fcc6a None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:48.222832 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2ca07-9e03-46cb-8d94-7eaac17fcc6a None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:48.223276 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2ca07-9e03-46cb-8d94-7eaac17fcc6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:48.230079 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ba480-e5d3-426d-9a08-ae1cf6f6753b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:48.231159 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ba480-e5d3-426d-9a08-ae1cf6f6753b None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:48.231571 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ba480-e5d3-426d-9a08-ae1cf6f6753b None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:48.231853 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ba480-e5d3-426d-9a08-ae1cf6f6753b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:48.258690 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ba480-e5d3-426d-9a08-ae1cf6f6753b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:48.260392 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ba480-e5d3-426d-9a08-ae1cf6f6753b None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:48.294927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-8b6ba480-e5d3-426d-9a08-ae1cf6f6753b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:48.294927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:48.294927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:48.294927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:48.294927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:48.294927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:48.294927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:48.294927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:48.294927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:48.294927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:48.294927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:48.294927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:48.294927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:48.294927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:48.294927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:48.296215 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:48.296215 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:48.296215 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:48.296215 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:48.296215 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:48.296215 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:48.296215 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:48.296215 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:48.296215 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:48.296215 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:48.296215 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:48.296215 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:48.296215 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:48.296215 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:48.296215 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:48.296215 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:48.296215 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:48.297921 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:48.297921 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:48.297921 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:48.297921 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:48.301516 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 387/756] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 445 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:48.303715 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fb77d-ad56-4e1a-ac5f-56358b8b54ea None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:48.303715 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fb77d-ad56-4e1a-ac5f-56358b8b54ea None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:48.304015 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fb77d-ad56-4e1a-ac5f-56358b8b54ea None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:48.306373 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2ca07-9e03-46cb-8d94-7eaac17fcc6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:48.307387 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 388/757] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:48.308366 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fb77d-ad56-4e1a-ac5f-56358b8b54ea None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:48.308661 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2ca07-9e03-46cb-8d94-7eaac17fcc6a None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:48.432172 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 370/758] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:33:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:33:48.434259 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157882a-c7ff-4d7c-8f13-1d59fc5e302f None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:48.434806 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157882a-c7ff-4d7c-8f13-1d59fc5e302f None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:48.435255 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157882a-c7ff-4d7c-8f13-1d59fc5e302f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:48.456559 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-4157882a-c7ff-4d7c-8f13-1d59fc5e302f None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:48.458246 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-4157882a-c7ff-4d7c-8f13-1d59fc5e302f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:48.542157 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 371/759] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:33:48.543445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157882a-c7ff-4d7c-8f13-1d59fc5e302f None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:48.587748 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fb77d-ad56-4e1a-ac5f-56358b8b54ea None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:48.629099 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d71bab-c220-43ac-b987-c81d19417460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:48.629099 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d71bab-c220-43ac-b987-c81d19417460 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:48.629099 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d71bab-c220-43ac-b987-c81d19417460 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:48.629099 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d71bab-c220-43ac-b987-c81d19417460 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:48.630359 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d71bab-c220-43ac-b987-c81d19417460 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:48.630779 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d71bab-c220-43ac-b987-c81d19417460 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:48.632305 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d71bab-c220-43ac-b987-c81d19417460 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:48.645956 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 389/760] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:33:48.647210 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d71bab-c220-43ac-b987-c81d19417460 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:48.668974 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157882a-c7ff-4d7c-8f13-1d59fc5e302f None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:48.709643 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400af231-d69d-4aef-9e00-dd997e2f531c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:48.710445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400af231-d69d-4aef-9e00-dd997e2f531c None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:48.710730 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400af231-d69d-4aef-9e00-dd997e2f531c None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:48.711023 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400af231-d69d-4aef-9e00-dd997e2f531c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:48.723800 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400af231-d69d-4aef-9e00-dd997e2f531c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:48.725489 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400af231-d69d-4aef-9e00-dd997e2f531c None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:48.750565 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-400af231-d69d-4aef-9e00-dd997e2f531c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:48.750565 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:48.750565 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:48.750565 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:48.750565 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:48.750565 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:48.750565 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:48.750565 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:48.750565 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:48.750565 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:48.750565 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:48.750565 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:48.750565 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:48.750565 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:48.750565 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:48.752027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:48.752027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:48.752027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:48.752027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:48.752027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:48.752027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:48.752027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:48.752027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:48.752027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:48.752027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:48.752027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:48.752027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:48.752027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:48.752027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:48.752027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:48.752027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:48.752027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:48.753304 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:48.753304 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:48.753304 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:48.753304 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:48.756719 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 372/761] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:48.757824 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400af231-d69d-4aef-9e00-dd997e2f531c None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:48.764731 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d71bab-c220-43ac-b987-c81d19417460 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:48.804029 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745f1f2-cc2e-4254-9afa-99878887ec4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:48.804926 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745f1f2-cc2e-4254-9afa-99878887ec4a None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:48.805321 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745f1f2-cc2e-4254-9afa-99878887ec4a None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:48.805816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745f1f2-cc2e-4254-9afa-99878887ec4a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:48.806649 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745f1f2-cc2e-4254-9afa-99878887ec4a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:48.808195 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745f1f2-cc2e-4254-9afa-99878887ec4a None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:48.821799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-2745f1f2-cc2e-4254-9afa-99878887ec4a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:33:48.821799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:48.821799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:33:48.821799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:33:48.821799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:33:48.821799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:33:48.821799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:33:48.821799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:33:48.821799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:33:48.821799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:48.821799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:33:48.821799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:48.821799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:48.821799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:48.821799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:48.821799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:48.823205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:48.823205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:48.823205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:48.823205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:48.823205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:48.823205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:48.823205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:48.823205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:33:48.823205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:33:48.823205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:33:48.823205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:33:48.823205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:48.823205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:48.823205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:48.823205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:48.823205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:48.826140 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:48.826140 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:48.826140 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:48.826140 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:48.826140 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:48.826140 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:48.826140 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:48.826140 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:48.826140 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:48.826140 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:48.826140 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:48.826140 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:33:48.826140 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:33:48.826140 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:33:48.826140 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:48.826140 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 390/762] 10.222.0.48 () {56 vars in 1129 bytes} [Mon May 9 15:33:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:48.829896 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745f1f2-cc2e-4254-9afa-99878887ec4a None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:48.896186 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400af231-d69d-4aef-9e00-dd997e2f531c None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:48.937620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745f1f2-cc2e-4254-9afa-99878887ec4a None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:48.950816 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427740a-8e6f-418e-8666-004ea49f1099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:48.952288 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427740a-8e6f-418e-8666-004ea49f1099 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:48.952911 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427740a-8e6f-418e-8666-004ea49f1099 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:48.954276 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427740a-8e6f-418e-8666-004ea49f1099 None admin] PATH_INFO: `/v3/projects/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:48.963549 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427740a-8e6f-418e-8666-004ea49f1099 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:48.966095 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427740a-8e6f-418e-8666-004ea49f1099 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:48.975864 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667ed86-19a8-4daf-98d3-71493dcd15b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:48.976546 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667ed86-19a8-4daf-98d3-71493dcd15b9 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:48.976846 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667ed86-19a8-4daf-98d3-71493dcd15b9 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:48.977116 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667ed86-19a8-4daf-98d3-71493dcd15b9 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:48.978099 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667ed86-19a8-4daf-98d3-71493dcd15b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:48.978460 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667ed86-19a8-4daf-98d3-71493dcd15b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:48.979835 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667ed86-19a8-4daf-98d3-71493dcd15b9 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:48.987018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-3427740a-8e6f-418e-8666-004ea49f1099 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:48.987018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:48.987018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:48.987018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:48.987018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:48.987018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:48.987018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:48.987018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:48.987018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:48.987018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:48.987018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:48.987018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:48.987018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:33:48.987018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:33:48.987018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:33:48.988314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:33:48.988314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:48.988314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:48.988314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:48.988314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:48.988314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:48.988314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:48.988314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:48.988314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:48.988314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:48.988314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:48.988314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:48.988314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:48.988314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:48.988314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:48.988314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:48.988314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:48.989552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:33:48.989552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:33:48.989552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:33:48.989552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:33:48.989552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:33:48.989552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:33:48.989552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:48.989552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:48.997601 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 391/764] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:48.997601 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667ed86-19a8-4daf-98d3-71493dcd15b9 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:48.998149 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 373/764] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:49.000005 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427740a-8e6f-418e-8666-004ea49f1099 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:49.112854 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667ed86-19a8-4daf-98d3-71493dcd15b9 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:49.139619 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427740a-8e6f-418e-8666-004ea49f1099 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:49.152119 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c3676-2d8c-4be8-9cd5-75e149983f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:49.153182 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c3676-2d8c-4be8-9cd5-75e149983f51 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:49.153182 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c3676-2d8c-4be8-9cd5-75e149983f51 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:49.153550 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c3676-2d8c-4be8-9cd5-75e149983f51 None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:49.154500 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c3676-2d8c-4be8-9cd5-75e149983f51 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:49.154923 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c3676-2d8c-4be8-9cd5-75e149983f51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:49.156988 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c3676-2d8c-4be8-9cd5-75e149983f51 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:49.162956 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 392/765] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 9 15:33:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:49.163917 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c3676-2d8c-4be8-9cd5-75e149983f51 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:49.187537 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ce586-3188-4cd8-8ee7-f4d78baa0955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:49.189555 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ce586-3188-4cd8-8ee7-f4d78baa0955 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:49.190075 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ce586-3188-4cd8-8ee7-f4d78baa0955 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:49.190836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ce586-3188-4cd8-8ee7-f4d78baa0955 None admin] PATH_INFO: `/v3/projects` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:49.192327 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ce586-3188-4cd8-8ee7-f4d78baa0955 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:49.192906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ce586-3188-4cd8-8ee7-f4d78baa0955 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:49.194987 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ce586-3188-4cd8-8ee7-f4d78baa0955 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:49.218171 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 374/766] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:33:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:49.219837 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ce586-3188-4cd8-8ee7-f4d78baa0955 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:49.277149 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c3676-2d8c-4be8-9cd5-75e149983f51 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:49.316383 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b508c15-075d-49a9-b7e9-abe578194168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:49.317444 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b508c15-075d-49a9-b7e9-abe578194168 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:49.317643 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b508c15-075d-49a9-b7e9-abe578194168 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:49.317809 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b508c15-075d-49a9-b7e9-abe578194168 None admin] PATH_INFO: `/v3/projects/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:49.325705 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b508c15-075d-49a9-b7e9-abe578194168 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:49.327224 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b508c15-075d-49a9-b7e9-abe578194168 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:49.343379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-6b508c15-075d-49a9-b7e9-abe578194168 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:49.343379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:49.343379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:49.343379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:49.343379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:49.343379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:49.343379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:49.343379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:49.343379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:49.343379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:49.343379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:49.343379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:49.343379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:33:49.343379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:33:49.343379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:33:49.345446 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:33:49.345446 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:49.345446 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:49.345446 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:49.345446 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:49.345446 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:49.345446 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:49.345446 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:49.345446 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:49.345446 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:49.345446 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:49.345446 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:49.345446 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:49.345446 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:49.345446 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:49.345446 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:49.345446 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:49.346495 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:33:49.346495 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:33:49.346495 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:33:49.346495 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:33:49.346495 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:33:49.346495 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:33:49.346495 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:49.346495 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:49.346495 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 393/767] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:49.346495 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b508c15-075d-49a9-b7e9-abe578194168 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:49.374452 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ce586-3188-4cd8-8ee7-f4d78baa0955 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:49.421445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5769649-7147-46a5-b415-f696bd624e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:49.424139 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5769649-7147-46a5-b415-f696bd624e0e None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:49.424905 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5769649-7147-46a5-b415-f696bd624e0e None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:49.425593 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5769649-7147-46a5-b415-f696bd624e0e None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:49.426658 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5769649-7147-46a5-b415-f696bd624e0e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:49.427139 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5769649-7147-46a5-b415-f696bd624e0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:49.429397 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5769649-7147-46a5-b415-f696bd624e0e None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:49.436780 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 375/768] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 9 15:33:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:49.439169 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116ec0e-5161-4c21-9f7b-d0a8fdb24e5c None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:49.439459 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116ec0e-5161-4c21-9f7b-d0a8fdb24e5c None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:49.439745 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116ec0e-5161-4c21-9f7b-d0a8fdb24e5c None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:49.445412 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 376/769] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:49.445412 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116ec0e-5161-4c21-9f7b-d0a8fdb24e5c None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:49.501628 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b508c15-075d-49a9-b7e9-abe578194168 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:49.542541 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ecd67-f1d7-44d1-9a90-f0a448478c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:49.543608 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ecd67-f1d7-44d1-9a90-f0a448478c5e None admin] REQUEST_METHOD: `PUT` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:49.543947 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ecd67-f1d7-44d1-9a90-f0a448478c5e None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:49.544382 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ecd67-f1d7-44d1-9a90-f0a448478c5e None admin] PATH_INFO: `/v3/projects/db5768a93e754372808fc69f898cc853/users/d398283fc99c4bfe83170ad3d1538f38/roles/a5cb8d37261d486cbc1b06d167a9c05c` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:49.547130 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ecd67-f1d7-44d1-9a90-f0a448478c5e None admin] RBAC: Authorizing `identity:create_grant(project_id=db5768a93e754372808fc69f898cc853, user_id=d398283fc99c4bfe83170ad3d1538f38, role_id=a5cb8d37261d486cbc1b06d167a9c05c)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:49.548915 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ecd67-f1d7-44d1-9a90-f0a448478c5e None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:49.564754 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 394/770] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:33:49 2022] PUT /identity/v3/projects/db5768a93e754372808fc69f898cc853/users/d398283fc99c4bfe83170ad3d1538f38/roles/a5cb8d37261d486cbc1b06d167a9c05c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:33:49.566137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ecd67-f1d7-44d1-9a90-f0a448478c5e None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:49.623899 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116ec0e-5161-4c21-9f7b-d0a8fdb24e5c None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:49.700709 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755727e4-4877-4b9a-90f6-7fbbc3690fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:49.701423 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755727e4-4877-4b9a-90f6-7fbbc3690fd6 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:49.701721 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755727e4-4877-4b9a-90f6-7fbbc3690fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:49.702012 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755727e4-4877-4b9a-90f6-7fbbc3690fd6 None admin] PATH_INFO: `/v3/projects` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:49.704894 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755727e4-4877-4b9a-90f6-7fbbc3690fd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:49.705587 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755727e4-4877-4b9a-90f6-7fbbc3690fd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:49.707439 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755727e4-4877-4b9a-90f6-7fbbc3690fd6 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:49.724990 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ecd67-f1d7-44d1-9a90-f0a448478c5e None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:49.729455 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 377/771] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:33:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:49.729455 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86e0ed-410b-4ac6-a75f-ccbd78cc9b91 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:49.729455 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86e0ed-410b-4ac6-a75f-ccbd78cc9b91 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:49.729455 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86e0ed-410b-4ac6-a75f-ccbd78cc9b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:49.752011 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-be86e0ed-410b-4ac6-a75f-ccbd78cc9b91 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:49.753414 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-be86e0ed-410b-4ac6-a75f-ccbd78cc9b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:49.774761 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51d676-56b2-42d5-8fd0-0d2510cf3c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:49.775879 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51d676-56b2-42d5-8fd0-0d2510cf3c10 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:49.776389 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51d676-56b2-42d5-8fd0-0d2510cf3c10 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:49.776906 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51d676-56b2-42d5-8fd0-0d2510cf3c10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:49.778068 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51d676-56b2-42d5-8fd0-0d2510cf3c10 None admin] RBAC: Adding query filter params (interface=public, service_id=858c803085054b23b68e300aa5ebaf69, region_id=RegionOne) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:49.778637 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51d676-56b2-42d5-8fd0-0d2510cf3c10 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:49.780323 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51d676-56b2-42d5-8fd0-0d2510cf3c10 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:49.794683 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 395/772] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:33:49 2022] GET /identity/v3/endpoints?service_id=858c803085054b23b68e300aa5ebaf69&interface=public®ion_id=RegionOne => generated 194 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:49.796122 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51d676-56b2-42d5-8fd0-0d2510cf3c10 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:49.838955 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 378/773] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:33:49.840268 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86e0ed-410b-4ac6-a75f-ccbd78cc9b91 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:49.940633 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51d676-56b2-42d5-8fd0-0d2510cf3c10 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:49.992759 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb17fdb-ce92-4b18-8bf7-12863bfc0f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:49.993535 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb17fdb-ce92-4b18-8bf7-12863bfc0f44 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:49.993899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb17fdb-ce92-4b18-8bf7-12863bfc0f44 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:49.994209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb17fdb-ce92-4b18-8bf7-12863bfc0f44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:49.995511 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb17fdb-ce92-4b18-8bf7-12863bfc0f44 None admin] RBAC: Adding query filter params (role.id=b22352a378fb404d90e3b3ae182757ad, scope.project.id=db5768a93e754372808fc69f898cc853, user.id=8fcb1b0006d94847be30b28f17d041e3) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:49.995793 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb17fdb-ce92-4b18-8bf7-12863bfc0f44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:49.997547 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb17fdb-ce92-4b18-8bf7-12863bfc0f44 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:50.009454 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 396/774] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:33:49 2022] GET /identity/v3/role_assignments?user.id=8fcb1b0006d94847be30b28f17d041e3&scope.project.id=db5768a93e754372808fc69f898cc853&role.id=b22352a378fb404d90e3b3ae182757ad => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:50.009454 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb17fdb-ce92-4b18-8bf7-12863bfc0f44 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:50.017716 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86e0ed-410b-4ac6-a75f-ccbd78cc9b91 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:50.107205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44468fe9-7468-4a03-8acf-bd1a9f7ad444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:50.109572 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44468fe9-7468-4a03-8acf-bd1a9f7ad444 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:50.110326 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44468fe9-7468-4a03-8acf-bd1a9f7ad444 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:50.111096 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44468fe9-7468-4a03-8acf-bd1a9f7ad444 None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:50.112610 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44468fe9-7468-4a03-8acf-bd1a9f7ad444 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:50.114894 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44468fe9-7468-4a03-8acf-bd1a9f7ad444 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:50.124792 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 379/775] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:33:49 2022] GET /identity/v3/services => generated 772 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:50.127858 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e584996-cccc-469f-85c0-6f8e27dfb144 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:50.128743 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e584996-cccc-469f-85c0-6f8e27dfb144 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:50.129703 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e584996-cccc-469f-85c0-6f8e27dfb144 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:50.133271 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 380/776] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:50.142088 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a308b9-1c7a-45e4-a572-2fa9f5d5814e None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:50.143626 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a308b9-1c7a-45e4-a572-2fa9f5d5814e None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:50.144337 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a308b9-1c7a-45e4-a572-2fa9f5d5814e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:50.170282 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb17fdb-ce92-4b18-8bf7-12863bfc0f44 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:50.172205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-69a308b9-1c7a-45e4-a572-2fa9f5d5814e None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:50.175239 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-69a308b9-1c7a-45e4-a572-2fa9f5d5814e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:50.230844 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4118c-8bdc-460e-a6cc-973658d46575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:50.231608 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4118c-8bdc-460e-a6cc-973658d46575 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:50.231897 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4118c-8bdc-460e-a6cc-973658d46575 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:50.232182 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4118c-8bdc-460e-a6cc-973658d46575 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:50.247560 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4118c-8bdc-460e-a6cc-973658d46575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:50.258905 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-1af4118c-8bdc-460e-a6cc-973658d46575 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:33:50.258905 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:50.258905 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:50.258905 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:50.258905 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:50.258905 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:50.258905 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:50.258905 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:50.258905 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:50.258905 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:50.258905 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:50.258905 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:50.258905 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:50.258905 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:50.258905 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:50.258905 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:50.260543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:50.260543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:50.260543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:50.260543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:50.260543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:50.260543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:50.260543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:50.260543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:50.260543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:50.260543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:50.260543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:50.260543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:50.260543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:50.260543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:50.260543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:50.260543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:50.261764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:50.261764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:50.261764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:50.261764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:50.261764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:50.261764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:50.261764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:50.261764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:50.261764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:50.261764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:50.261764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:33:50.261764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:50.261764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 397/777] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:33:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:50.268293 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4118c-8bdc-460e-a6cc-973658d46575 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:50.306337 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 381/778] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:33:50.343260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a308b9-1c7a-45e4-a572-2fa9f5d5814e None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:50.487345 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4118c-8bdc-460e-a6cc-973658d46575 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:50.492744 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a308b9-1c7a-45e4-a572-2fa9f5d5814e None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:50.531246 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401e782-36ad-4beb-904f-684220fd3120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:50.532492 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401e782-36ad-4beb-904f-684220fd3120 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:50.532781 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401e782-36ad-4beb-904f-684220fd3120 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:50.533053 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401e782-36ad-4beb-904f-684220fd3120 None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:50.534827 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401e782-36ad-4beb-904f-684220fd3120 None admin] RBAC: Adding query filter params (name=admin) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:50.535256 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401e782-36ad-4beb-904f-684220fd3120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:50.536734 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401e782-36ad-4beb-904f-684220fd3120 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:50.543460 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7d412-8396-4ce8-a39e-e068c6c92744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:50.544951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7d412-8396-4ce8-a39e-e068c6c92744 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:50.545239 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7d412-8396-4ce8-a39e-e068c6c92744 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:50.545566 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7d412-8396-4ce8-a39e-e068c6c92744 None admin] PATH_INFO: `/v3/services/network` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:50.546683 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7d412-8396-4ce8-a39e-e068c6c92744 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:50.548982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7d412-8396-4ce8-a39e-e068c6c92744 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:50.549247 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 398/779] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:33:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:33:50.557610 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401e782-36ad-4beb-904f-684220fd3120 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:50.566542 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-bac7d412-8396-4ce8-a39e-e068c6c92744 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:33:50.566542 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:50.566542 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:33:50.566542 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:33:50.566542 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:33:50.566542 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:33:50.566542 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:33:50.566542 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:33:50.566542 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:33:50.566542 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:50.566542 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:33:50.566542 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:50.566542 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:50.566542 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:50.566542 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:50.566542 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:50.566542 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:50.567755 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:50.567755 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:50.567755 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:50.567755 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:50.567755 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:50.567755 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:50.567755 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:33:50.567755 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:33:50.567755 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:33:50.567755 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:33:50.567755 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:50.567755 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:50.567755 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:50.567755 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:50.567755 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:50.567755 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:50.568685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:50.568685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:50.568685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:50.568685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:50.568685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:50.568685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:50.568685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:50.568685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:50.568685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:50.568685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:50.568685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:33:50.568685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:33:50.568685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:33:50.568685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:50.569624 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 382/780] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:50 2022] GET /identity/v3/services/network => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:50.575625 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7d412-8396-4ce8-a39e-e068c6c92744 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:50.771200 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7d412-8396-4ce8-a39e-e068c6c92744 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:50.793006 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401e782-36ad-4beb-904f-684220fd3120 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:50.826267 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff51254-7ddf-4282-8318-ea5d0200a9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:50.827451 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff51254-7ddf-4282-8318-ea5d0200a9ed None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:50.827743 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff51254-7ddf-4282-8318-ea5d0200a9ed None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:50.828031 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff51254-7ddf-4282-8318-ea5d0200a9ed None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:50.830913 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff51254-7ddf-4282-8318-ea5d0200a9ed None admin] RBAC: Adding query filter params (name=network) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:50.830913 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff51254-7ddf-4282-8318-ea5d0200a9ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:50.830913 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff51254-7ddf-4282-8318-ea5d0200a9ed None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:50.846258 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 383/781] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:33:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:50.853279 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff51254-7ddf-4282-8318-ea5d0200a9ed None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:50.883960 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b2738-edfc-440d-9363-c642d16187c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:50.886740 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b2738-edfc-440d-9363-c642d16187c9 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:50.887339 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b2738-edfc-440d-9363-c642d16187c9 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:50.890189 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b2738-edfc-440d-9363-c642d16187c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:50.923538 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b2738-edfc-440d-9363-c642d16187c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:50.925182 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b2738-edfc-440d-9363-c642d16187c9 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:50.967237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-f08b2738-edfc-440d-9363-c642d16187c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:50.967237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:50.967237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:50.967237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:50.967237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:50.967237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:50.967237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:50.967237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:50.967237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:50.967237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:50.967237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:50.967237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:50.967237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:50.967237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:50.967237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:50.968416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:50.968416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:50.968416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:50.968416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:50.968416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:50.968416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:50.968416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:50.968416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:50.968416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:50.968416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:50.968416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:50.968416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:50.968416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:50.968416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:50.968416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:50.968416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:50.968416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:50.970089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:50.970089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:50.970089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:50.970089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:50.973482 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 399/782] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:50.981294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b2738-edfc-440d-9363-c642d16187c9 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:51.081416 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff51254-7ddf-4282-8318-ea5d0200a9ed None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:51.151083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329aa42-97eb-4d44-87ee-668ebab557c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:51.153618 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329aa42-97eb-4d44-87ee-668ebab557c9 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:51.154387 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329aa42-97eb-4d44-87ee-668ebab557c9 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:51.156235 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329aa42-97eb-4d44-87ee-668ebab557c9 None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:51.157347 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329aa42-97eb-4d44-87ee-668ebab557c9 None admin] RBAC: Adding query filter params (type=network) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:51.158599 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329aa42-97eb-4d44-87ee-668ebab557c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:51.161464 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329aa42-97eb-4d44-87ee-668ebab557c9 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:51.175753 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 384/783] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:33:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:33:51.180923 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329aa42-97eb-4d44-87ee-668ebab557c9 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:51.201975 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b2738-edfc-440d-9363-c642d16187c9 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:51.272794 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128b9e8-bdb1-4d61-aa9f-a50ab1f06e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:51.273978 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128b9e8-bdb1-4d61-aa9f-a50ab1f06e25 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:51.275395 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128b9e8-bdb1-4d61-aa9f-a50ab1f06e25 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:51.275950 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128b9e8-bdb1-4d61-aa9f-a50ab1f06e25 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:51.278876 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128b9e8-bdb1-4d61-aa9f-a50ab1f06e25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:51.279466 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128b9e8-bdb1-4d61-aa9f-a50ab1f06e25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:51.281102 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128b9e8-bdb1-4d61-aa9f-a50ab1f06e25 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:51.317066 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 400/784] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:51.324828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128b9e8-bdb1-4d61-aa9f-a50ab1f06e25 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:51.355016 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329aa42-97eb-4d44-87ee-668ebab557c9 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:51.395753 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15b3a9-e0e3-496d-8a2a-c5ce1b33c7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:51.396837 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15b3a9-e0e3-496d-8a2a-c5ce1b33c7e9 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:51.397345 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15b3a9-e0e3-496d-8a2a-c5ce1b33c7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:51.397884 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15b3a9-e0e3-496d-8a2a-c5ce1b33c7e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:51.398961 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15b3a9-e0e3-496d-8a2a-c5ce1b33c7e9 None admin] RBAC: Adding query filter params (interface=public, service_id=c1c54a611c3f472394d1dc058b1371cf, region_id=RegionOne) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:51.399531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15b3a9-e0e3-496d-8a2a-c5ce1b33c7e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:51.401205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15b3a9-e0e3-496d-8a2a-c5ce1b33c7e9 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:51.411397 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 385/785] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:33:51 2022] GET /identity/v3/endpoints?service_id=c1c54a611c3f472394d1dc058b1371cf&interface=public®ion_id=RegionOne => generated 194 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:51.417183 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15b3a9-e0e3-496d-8a2a-c5ce1b33c7e9 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:51.544039 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15b3a9-e0e3-496d-8a2a-c5ce1b33c7e9 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:51.585570 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee7d64-6ff0-4e4b-96dc-1d44aac638f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:51.586655 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee7d64-6ff0-4e4b-96dc-1d44aac638f9 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:51.587154 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee7d64-6ff0-4e4b-96dc-1d44aac638f9 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:51.587657 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee7d64-6ff0-4e4b-96dc-1d44aac638f9 None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:51.588645 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee7d64-6ff0-4e4b-96dc-1d44aac638f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:51.590575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee7d64-6ff0-4e4b-96dc-1d44aac638f9 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:51.598924 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 386/786] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:33:51 2022] GET /identity/v3/services => generated 772 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:51.629596 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128b9e8-bdb1-4d61-aa9f-a50ab1f06e25 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:51.686559 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da6922-180b-43c4-b992-d7d5425d3c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:51.688262 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da6922-180b-43c4-b992-d7d5425d3c78 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:51.688888 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da6922-180b-43c4-b992-d7d5425d3c78 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:51.689335 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da6922-180b-43c4-b992-d7d5425d3c78 None admin] PATH_INFO: `/v3/users/swift` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:51.700900 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da6922-180b-43c4-b992-d7d5425d3c78 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:51.702804 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da6922-180b-43c4-b992-d7d5425d3c78 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:51.729724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-b5da6922-180b-43c4-b992-d7d5425d3c78 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:33:51.729724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:51.729724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:51.729724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:51.729724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:51.729724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:51.729724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:51.729724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:51.729724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:51.729724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:51.729724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:51.729724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:51.729724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:33:51.729724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:33:51.729724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:33:51.729724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:33:51.730888 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:51.730888 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:51.730888 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:33:51.730888 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:51.730888 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:33:51.730888 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:51.730888 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:51.730888 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:51.730888 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:51.730888 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:51.730888 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:51.730888 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:51.730888 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:51.730888 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:51.730888 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:51.730888 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:51.730888 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:51.730888 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:51.732575 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:51.732575 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:51.732575 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:33:51.732575 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:33:51.732575 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:33:51.732575 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:33:51.732575 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:33:51.732575 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:33:51.732575 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:33:51.732575 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:51.737575 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 401/787] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:33:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:51.739844 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee7d64-6ff0-4e4b-96dc-1d44aac638f9 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:51.910051 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee7d64-6ff0-4e4b-96dc-1d44aac638f9 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:51.951069 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f4c81-55c2-449d-bc02-d88bca07bdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:51.952000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f4c81-55c2-449d-bc02-d88bca07bdbb None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:51.952293 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f4c81-55c2-449d-bc02-d88bca07bdbb None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:51.952569 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f4c81-55c2-449d-bc02-d88bca07bdbb None admin] PATH_INFO: `/v3/users` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:51.954158 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f4c81-55c2-449d-bc02-d88bca07bdbb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:51.954716 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f4c81-55c2-449d-bc02-d88bca07bdbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:51.956310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f4c81-55c2-449d-bc02-d88bca07bdbb None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:51.979527 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 387/788] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 9 15:33:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:51.987141 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da6922-180b-43c4-b992-d7d5425d3c78 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:52.132833 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da6922-180b-43c4-b992-d7d5425d3c78 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:52.180262 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd97667-7616-4223-9f7e-fc2e9d2e7617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:52.181180 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd97667-7616-4223-9f7e-fc2e9d2e7617 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:52.181545 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd97667-7616-4223-9f7e-fc2e9d2e7617 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:52.181936 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd97667-7616-4223-9f7e-fc2e9d2e7617 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:52.198772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd97667-7616-4223-9f7e-fc2e9d2e7617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:52.200554 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd97667-7616-4223-9f7e-fc2e9d2e7617 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:52.234089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-dcd97667-7616-4223-9f7e-fc2e9d2e7617 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:52.234089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:52.234089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:52.234089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:52.234089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:52.234089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:52.234089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:52.234089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:52.234089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:52.234089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:52.234089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:52.234089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:52.234089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:52.234089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:52.234089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:52.235984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:52.235984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:52.235984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:52.235984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:52.235984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:52.235984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:52.235984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:52.235984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:52.235984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:52.235984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:52.235984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:52.235984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:52.235984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:52.235984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:52.235984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:52.235984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:52.235984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:52.237074 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:52.237074 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:52.237074 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:52.237074 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:52.241510 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 402/789] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:52.246570 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f4c81-55c2-449d-bc02-d88bca07bdbb None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:52.431551 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f4c81-55c2-449d-bc02-d88bca07bdbb None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:52.490338 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ce5af-47f7-4fbd-b3af-c56275167223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:52.491188 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ce5af-47f7-4fbd-b3af-c56275167223 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:52.491485 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ce5af-47f7-4fbd-b3af-c56275167223 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:52.491766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ce5af-47f7-4fbd-b3af-c56275167223 None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:52.492527 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ce5af-47f7-4fbd-b3af-c56275167223 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:52.492848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ce5af-47f7-4fbd-b3af-c56275167223 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:52.494316 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ce5af-47f7-4fbd-b3af-c56275167223 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:52.509086 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 388/790] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:52.515451 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd97667-7616-4223-9f7e-fc2e9d2e7617 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:52.685620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd97667-7616-4223-9f7e-fc2e9d2e7617 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:52.742070 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c107e02-87bd-4021-8a8a-a68f1fb83fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:52.743308 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c107e02-87bd-4021-8a8a-a68f1fb83fa0 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:52.743642 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c107e02-87bd-4021-8a8a-a68f1fb83fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:52.744135 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c107e02-87bd-4021-8a8a-a68f1fb83fa0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:52.760028 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c107e02-87bd-4021-8a8a-a68f1fb83fa0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:52.761624 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c107e02-87bd-4021-8a8a-a68f1fb83fa0 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:52.766753 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4cfe8-b478-4467-9f03-285785be7a9e None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:52.767209 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4cfe8-b478-4467-9f03-285785be7a9e None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:52.767580 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4cfe8-b478-4467-9f03-285785be7a9e None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:52.769146 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 389/791] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:52.781571 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e21dbc-85e5-4c63-976d-df9e97b0b74d None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:52.781915 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e21dbc-85e5-4c63-976d-df9e97b0b74d None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:52.782250 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e21dbc-85e5-4c63-976d-df9e97b0b74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:52.788657 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-9c107e02-87bd-4021-8a8a-a68f1fb83fa0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:52.788657 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:52.788657 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:52.788657 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:52.788657 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:52.788657 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:52.788657 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:52.788657 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:52.788657 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:52.788657 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:52.788657 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:52.788657 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:52.788657 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:33:52.788657 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:33:52.788657 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:33:52.791849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:33:52.791849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:52.791849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:52.791849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:52.791849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:52.791849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:52.791849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:52.791849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:52.791849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:52.791849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:52.791849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:52.791849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:52.791849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:52.791849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:52.791849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:52.791849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:52.791849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:52.795288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:33:52.795288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:33:52.795288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:33:52.795288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:33:52.795288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:33:52.795288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:33:52.795288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:52.795288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:52.795288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 403/792] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:52.801527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c107e02-87bd-4021-8a8a-a68f1fb83fa0 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:52.834375 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-e0e21dbc-85e5-4c63-976d-df9e97b0b74d None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:52.836121 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-e0e21dbc-85e5-4c63-976d-df9e97b0b74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:52.953023 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 390/793] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:33:52.955232 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f6fc7-2b17-4d52-bd22-42bf9d8d5934 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:52.955525 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f6fc7-2b17-4d52-bd22-42bf9d8d5934 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:52.955808 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f6fc7-2b17-4d52-bd22-42bf9d8d5934 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:52.957677 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 391/794] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:52.975694 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a2d89-67ac-40ac-aaed-bf965648c097 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:52.976099 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a2d89-67ac-40ac-aaed-bf965648c097 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:52.976498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a2d89-67ac-40ac-aaed-bf965648c097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:52.986316 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c107e02-87bd-4021-8a8a-a68f1fb83fa0 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:53.001107 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-1a2a2d89-67ac-40ac-aaed-bf965648c097 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:53.002932 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-1a2a2d89-67ac-40ac-aaed-bf965648c097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:53.037637 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0e62d-a4b3-44de-995c-e8f52b13db31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:53.038332 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0e62d-a4b3-44de-995c-e8f52b13db31 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:53.038624 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0e62d-a4b3-44de-995c-e8f52b13db31 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:53.038909 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0e62d-a4b3-44de-995c-e8f52b13db31 None admin] PATH_INFO: `/v3/projects` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:53.040114 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0e62d-a4b3-44de-995c-e8f52b13db31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:53.040491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0e62d-a4b3-44de-995c-e8f52b13db31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:53.042563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0e62d-a4b3-44de-995c-e8f52b13db31 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:53.064234 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 404/795] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:33:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:33:53.065336 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0e62d-a4b3-44de-995c-e8f52b13db31 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:53.086211 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 392/796] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:33:53.087093 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a2d89-67ac-40ac-aaed-bf965648c097 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:53.235509 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0e62d-a4b3-44de-995c-e8f52b13db31 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:53.253092 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a2d89-67ac-40ac-aaed-bf965648c097 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:53.278286 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c74ac-05ca-4753-8eeb-4831ab87084f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:53.279199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c74ac-05ca-4753-8eeb-4831ab87084f None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:53.279547 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c74ac-05ca-4753-8eeb-4831ab87084f None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:53.279858 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c74ac-05ca-4753-8eeb-4831ab87084f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:53.317408 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c74ac-05ca-4753-8eeb-4831ab87084f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:53.330855 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-010c74ac-05ca-4753-8eeb-4831ab87084f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:33:53.330855 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:53.330855 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:53.330855 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:53.330855 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:53.330855 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:53.330855 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:53.330855 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:53.330855 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:53.330855 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:53.330855 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:53.330855 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:53.330855 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:53.330855 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:53.330855 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:53.330855 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:53.333315 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:53.333315 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:53.333315 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:53.333315 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:53.333315 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:53.333315 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:53.333315 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:53.333315 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:53.333315 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:53.333315 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:53.333315 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:53.333315 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:53.333315 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:53.333315 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:53.333315 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:53.333315 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:53.335964 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:53.335964 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:53.335964 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:53.335964 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:53.335964 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:53.335964 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:53.335964 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:53.335964 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:53.335964 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:53.335964 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:53.335964 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:33:53.335964 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:53.342331 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 405/797] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:33:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:53.342331 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c74ac-05ca-4753-8eeb-4831ab87084f None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:53.343524 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff487a-7034-4900-a6a8-eb5dac277f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:53.345393 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff487a-7034-4900-a6a8-eb5dac277f91 None admin] REQUEST_METHOD: `PUT` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:53.345931 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff487a-7034-4900-a6a8-eb5dac277f91 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:53.346804 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff487a-7034-4900-a6a8-eb5dac277f91 None admin] PATH_INFO: `/v3/projects/db5768a93e754372808fc69f898cc853/users/6e553afd9da345b29b3b164e34e5a506/roles/a5cb8d37261d486cbc1b06d167a9c05c` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:53.353398 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff487a-7034-4900-a6a8-eb5dac277f91 None admin] RBAC: Authorizing `identity:create_grant(project_id=db5768a93e754372808fc69f898cc853, user_id=6e553afd9da345b29b3b164e34e5a506, role_id=a5cb8d37261d486cbc1b06d167a9c05c)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:53.355677 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff487a-7034-4900-a6a8-eb5dac277f91 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:53.405577 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 393/798] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:33:53 2022] PUT /identity/v3/projects/db5768a93e754372808fc69f898cc853/users/6e553afd9da345b29b3b164e34e5a506/roles/a5cb8d37261d486cbc1b06d167a9c05c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:33:53.408550 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff487a-7034-4900-a6a8-eb5dac277f91 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:53.727569 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c74ac-05ca-4753-8eeb-4831ab87084f None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:53.729793 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff487a-7034-4900-a6a8-eb5dac277f91 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:53.807669 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6c4fd-7db0-48d4-be88-ab1bb137f2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:53.808495 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6c4fd-7db0-48d4-be88-ab1bb137f2fb None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:53.808774 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6c4fd-7db0-48d4-be88-ab1bb137f2fb None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:53.809053 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6c4fd-7db0-48d4-be88-ab1bb137f2fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:53.818448 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5d668-6025-4c30-9a89-d52b464f4503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:53.819150 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5d668-6025-4c30-9a89-d52b464f4503 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:53.819821 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5d668-6025-4c30-9a89-d52b464f4503 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:53.820110 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5d668-6025-4c30-9a89-d52b464f4503 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:53.820891 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5d668-6025-4c30-9a89-d52b464f4503 None admin] RBAC: Adding query filter params (name=admin) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:53.821206 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5d668-6025-4c30-9a89-d52b464f4503 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:53.823239 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5d668-6025-4c30-9a89-d52b464f4503 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:53.823412 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6c4fd-7db0-48d4-be88-ab1bb137f2fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:53.833728 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-ffc6c4fd-7db0-48d4-be88-ab1bb137f2fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:53.833728 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:53.833728 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:53.833728 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:53.833728 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:53.833728 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:53.833728 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:53.833728 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:53.833728 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:53.833728 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:53.833728 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:53.833728 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:53.833728 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:53.833728 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:53.833728 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:53.833728 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:53.834914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:53.834914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:53.834914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:53.834914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:53.834914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:53.834914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:53.834914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:53.834914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:53.834914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:53.834914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:53.834914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:53.834914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:53.834914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:53.834914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:53.834914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:53.834914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:53.836517 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:53.836517 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:53.836517 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:53.836517 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:53.836517 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:53.836517 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:53.836517 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:53.836517 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:53.836517 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:53.836517 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:53.836517 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:33:53.836517 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:53.836517 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 406/799] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:33:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 497 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:53.838144 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 394/800] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:33:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:53.838288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6bee0-a23e-4cb1-95eb-f7ccdbedc52a None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:53.838288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6bee0-a23e-4cb1-95eb-f7ccdbedc52a None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:53.838288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6bee0-a23e-4cb1-95eb-f7ccdbedc52a None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:53.840297 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 407/801] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:53.843546 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5d668-6025-4c30-9a89-d52b464f4503 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:53.850639 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6bee0-a23e-4cb1-95eb-f7ccdbedc52a None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:54.018831 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6bee0-a23e-4cb1-95eb-f7ccdbedc52a None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:54.023504 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5d668-6025-4c30-9a89-d52b464f4503 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:54.063477 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbc6ee-103a-41cb-a228-c6325bdb0b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:54.064635 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abda97-c5bf-4fcc-b6af-89938ba4bd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:54.065018 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbc6ee-103a-41cb-a228-c6325bdb0b2e None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:54.065528 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abda97-c5bf-4fcc-b6af-89938ba4bd7a None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:54.065801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abda97-c5bf-4fcc-b6af-89938ba4bd7a None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:54.066083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abda97-c5bf-4fcc-b6af-89938ba4bd7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:54.066404 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbc6ee-103a-41cb-a228-c6325bdb0b2e None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:54.067096 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbc6ee-103a-41cb-a228-c6325bdb0b2e None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:54.068239 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbc6ee-103a-41cb-a228-c6325bdb0b2e None admin] RBAC: Adding query filter params (name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:54.068853 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbc6ee-103a-41cb-a228-c6325bdb0b2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:54.070843 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbc6ee-103a-41cb-a228-c6325bdb0b2e None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:54.079509 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abda97-c5bf-4fcc-b6af-89938ba4bd7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:54.080865 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abda97-c5bf-4fcc-b6af-89938ba4bd7a None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:54.089149 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 408/802] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:33:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:54.091370 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d0ae2-6359-4a05-a6ea-9d585ee61ddf None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:54.092089 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d0ae2-6359-4a05-a6ea-9d585ee61ddf None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:54.092589 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d0ae2-6359-4a05-a6ea-9d585ee61ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:54.102182 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-61abda97-c5bf-4fcc-b6af-89938ba4bd7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:54.102182 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:54.102182 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:54.102182 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:54.102182 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:54.102182 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:54.102182 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:54.102182 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:54.102182 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:54.102182 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:54.102182 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:54.102182 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:54.102182 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:54.102182 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:54.102182 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:54.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:54.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:54.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:54.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:54.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:54.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:54.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:54.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:54.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:54.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:54.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:54.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:54.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:54.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:54.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:54.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:54.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:54.105088 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:54.105088 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:54.105088 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:54.105088 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:54.105088 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 395/803] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:54.111119 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abda97-c5bf-4fcc-b6af-89938ba4bd7a None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:54.120717 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-c74d0ae2-6359-4a05-a6ea-9d585ee61ddf None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:54.122684 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-c74d0ae2-6359-4a05-a6ea-9d585ee61ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:54.227347 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 409/804] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:33:54.227347 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d0ae2-6359-4a05-a6ea-9d585ee61ddf None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:54.247113 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abda97-c5bf-4fcc-b6af-89938ba4bd7a None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:54.295895 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e52e1-884c-47b5-aeaa-e2768309a30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:54.297123 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e52e1-884c-47b5-aeaa-e2768309a30b None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:54.297123 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e52e1-884c-47b5-aeaa-e2768309a30b None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:54.297731 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e52e1-884c-47b5-aeaa-e2768309a30b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:54.310506 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e52e1-884c-47b5-aeaa-e2768309a30b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:54.311965 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e52e1-884c-47b5-aeaa-e2768309a30b None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:54.333353 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-cd5e52e1-884c-47b5-aeaa-e2768309a30b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:54.333353 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:54.333353 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:54.333353 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:54.333353 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:54.333353 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:54.333353 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:54.333353 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:54.333353 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:54.333353 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:54.333353 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:54.333353 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:54.333353 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:54.333353 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:54.333353 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:54.335660 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:54.335660 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:54.335660 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:54.335660 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:54.335660 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:54.335660 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:54.335660 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:54.335660 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:54.335660 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:54.335660 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:54.335660 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:54.335660 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:54.335660 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:54.335660 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:54.335660 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:54.335660 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:54.335660 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:54.337039 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:54.337039 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:54.337039 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:54.337039 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:54.339916 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 396/805] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:54.340737 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e52e1-884c-47b5-aeaa-e2768309a30b None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:54.450117 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d0ae2-6359-4a05-a6ea-9d585ee61ddf None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:54.468606 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e52e1-884c-47b5-aeaa-e2768309a30b None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:54.494783 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a8a47-0ce6-4ae4-be96-262fea530e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:54.496179 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a8a47-0ce6-4ae4-be96-262fea530e42 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:54.496735 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a8a47-0ce6-4ae4-be96-262fea530e42 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:54.497383 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a8a47-0ce6-4ae4-be96-262fea530e42 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:54.498458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a8a47-0ce6-4ae4-be96-262fea530e42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:54.499072 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a8a47-0ce6-4ae4-be96-262fea530e42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:54.501671 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a8a47-0ce6-4ae4-be96-262fea530e42 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:54.508884 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754ed71-2681-4258-91e8-7a85177ebd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:54.509741 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754ed71-2681-4258-91e8-7a85177ebd84 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:54.510027 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754ed71-2681-4258-91e8-7a85177ebd84 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:54.510307 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754ed71-2681-4258-91e8-7a85177ebd84 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:54.510982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754ed71-2681-4258-91e8-7a85177ebd84 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:54.512640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754ed71-2681-4258-91e8-7a85177ebd84 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:54.519590 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 410/806] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:54.520906 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a8a47-0ce6-4ae4-be96-262fea530e42 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:54.532522 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-2754ed71-2681-4258-91e8-7a85177ebd84 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:33:54.532522 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:54.532522 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:33:54.532522 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:33:54.532522 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:33:54.532522 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:33:54.532522 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:33:54.532522 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:33:54.532522 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:33:54.532522 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:54.532522 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:33:54.532522 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:54.532522 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:54.532522 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:54.532522 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:54.532522 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:54.533853 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:54.533853 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:54.533853 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:54.533853 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:54.533853 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:54.533853 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:54.533853 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:54.533853 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:33:54.533853 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:33:54.533853 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:33:54.533853 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:33:54.533853 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:54.533853 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:54.533853 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:54.533853 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:54.533853 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:54.534906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:54.534906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:54.534906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:54.534906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:54.534906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:54.534906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:54.534906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:54.534906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:54.534906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:54.534906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:54.534906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:54.534906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:33:54.534906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:33:54.534906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:33:54.534906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:54.539425 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 397/807] 10.222.0.48 () {56 vars in 1129 bytes} [Mon May 9 15:33:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:54.540622 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754ed71-2681-4258-91e8-7a85177ebd84 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:54.660729 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a8a47-0ce6-4ae4-be96-262fea530e42 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:54.670547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754ed71-2681-4258-91e8-7a85177ebd84 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:54.710430 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8356c85-7c0e-48b8-9674-4cb3aa1ec503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:54.711327 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8356c85-7c0e-48b8-9674-4cb3aa1ec503 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:54.711618 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8356c85-7c0e-48b8-9674-4cb3aa1ec503 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:54.711923 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8356c85-7c0e-48b8-9674-4cb3aa1ec503 None admin] PATH_INFO: `/v3/users/nova` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:54.718026 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e558e06-cfc1-4b36-b576-31738ed673ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:54.719787 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e558e06-cfc1-4b36-b576-31738ed673ae None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:54.720298 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e558e06-cfc1-4b36-b576-31738ed673ae None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:54.720877 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e558e06-cfc1-4b36-b576-31738ed673ae None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:54.722001 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8356c85-7c0e-48b8-9674-4cb3aa1ec503 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:54.722623 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e558e06-cfc1-4b36-b576-31738ed673ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:54.723396 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e558e06-cfc1-4b36-b576-31738ed673ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:54.723944 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8356c85-7c0e-48b8-9674-4cb3aa1ec503 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:54.726572 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e558e06-cfc1-4b36-b576-31738ed673ae None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:54.742973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-e8356c85-7c0e-48b8-9674-4cb3aa1ec503 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:33:54.742973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:54.742973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:54.742973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:54.742973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:54.742973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:54.742973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:54.742973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:54.742973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:54.742973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:54.742973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:54.742973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:54.742973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:33:54.742973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:33:54.742973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:33:54.742973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:33:54.744295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:54.744295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:54.744295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:33:54.744295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:54.744295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:33:54.744295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:54.744295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:54.744295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:54.744295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:54.744295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:54.744295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:54.744295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:54.744295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:54.744295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:54.744295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:54.744295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:54.744295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:54.744295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:54.746667 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:54.746667 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:54.746667 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:33:54.746667 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:33:54.746667 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:33:54.746667 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:33:54.746667 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:33:54.746667 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:33:54.746667 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:33:54.746667 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:54.749593 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 398/808] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:33:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:54.750664 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8356c85-7c0e-48b8-9674-4cb3aa1ec503 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:54.752248 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 411/809] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:54.755021 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df0b7b-a267-4665-981e-cdbb31bf1537 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:54.755346 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df0b7b-a267-4665-981e-cdbb31bf1537 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:54.755659 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df0b7b-a267-4665-981e-cdbb31bf1537 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:54.757268 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 412/810] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:54.758142 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df0b7b-a267-4665-981e-cdbb31bf1537 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:54.887345 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8356c85-7c0e-48b8-9674-4cb3aa1ec503 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:54.928204 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df0b7b-a267-4665-981e-cdbb31bf1537 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:54.951178 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b6115-c977-4164-bb77-e086684f9ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:54.952437 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b6115-c977-4164-bb77-e086684f9ca5 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:54.952944 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b6115-c977-4164-bb77-e086684f9ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:54.954187 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b6115-c977-4164-bb77-e086684f9ca5 None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:54.955708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b6115-c977-4164-bb77-e086684f9ca5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:54.956309 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b6115-c977-4164-bb77-e086684f9ca5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:54.958996 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b6115-c977-4164-bb77-e086684f9ca5 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:54.967271 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 399/811] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 9 15:33:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:54.968882 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b6115-c977-4164-bb77-e086684f9ca5 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:54.987604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09fc1d-2cb6-42d7-96a0-2acc060d95c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:54.989055 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09fc1d-2cb6-42d7-96a0-2acc060d95c1 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:54.989615 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09fc1d-2cb6-42d7-96a0-2acc060d95c1 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:54.990095 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09fc1d-2cb6-42d7-96a0-2acc060d95c1 None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:54.991544 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09fc1d-2cb6-42d7-96a0-2acc060d95c1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:54.992401 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09fc1d-2cb6-42d7-96a0-2acc060d95c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:54.994842 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09fc1d-2cb6-42d7-96a0-2acc060d95c1 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:55.021032 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 413/812] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:33:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:55.022895 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58eaba-555e-471f-ad89-0c39751470a4 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:55.023414 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58eaba-555e-471f-ad89-0c39751470a4 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:55.023951 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58eaba-555e-471f-ad89-0c39751470a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:55.046738 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-5d58eaba-555e-471f-ad89-0c39751470a4 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:55.049949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-5d58eaba-555e-471f-ad89-0c39751470a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:55.160470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b6115-c977-4164-bb77-e086684f9ca5 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:55.178011 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 414/813] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:33:55.178011 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58eaba-555e-471f-ad89-0c39751470a4 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:55.224618 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35f718-4fc0-4dec-b9af-73dda52d817a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:55.226005 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35f718-4fc0-4dec-b9af-73dda52d817a None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:55.226479 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35f718-4fc0-4dec-b9af-73dda52d817a None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:55.226948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35f718-4fc0-4dec-b9af-73dda52d817a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:55.239180 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35f718-4fc0-4dec-b9af-73dda52d817a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:55.241418 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35f718-4fc0-4dec-b9af-73dda52d817a None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:55.264708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-8f35f718-4fc0-4dec-b9af-73dda52d817a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:33:55.264708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:55.264708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:55.264708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:55.264708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:55.264708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:55.264708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:55.264708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:55.264708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:55.264708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:55.264708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:55.264708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:55.264708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:33:55.264708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:33:55.264708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:33:55.264708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:33:55.266552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:55.266552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:55.266552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:33:55.266552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:55.266552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:33:55.266552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:55.266552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:55.266552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:55.266552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:55.266552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:55.266552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:55.266552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:55.266552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:55.266552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:55.266552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:55.266552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:55.266552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:55.266552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:55.269084 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:55.269084 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:55.269084 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:33:55.269084 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:33:55.269084 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:33:55.269084 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:33:55.269084 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:33:55.269084 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:33:55.269084 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:33:55.269084 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:55.271415 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 400/814] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:33:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:55.272476 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35f718-4fc0-4dec-b9af-73dda52d817a None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:55.318083 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58eaba-555e-471f-ad89-0c39751470a4 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:55.365171 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29796e9-9c47-41a4-a5dd-b0a97506afc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:55.366349 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29796e9-9c47-41a4-a5dd-b0a97506afc2 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:55.366832 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29796e9-9c47-41a4-a5dd-b0a97506afc2 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:55.367183 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29796e9-9c47-41a4-a5dd-b0a97506afc2 None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:55.368275 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29796e9-9c47-41a4-a5dd-b0a97506afc2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:55.368624 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29796e9-9c47-41a4-a5dd-b0a97506afc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:55.372060 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29796e9-9c47-41a4-a5dd-b0a97506afc2 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:55.380847 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 415/815] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 9 15:33:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:55.382228 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29796e9-9c47-41a4-a5dd-b0a97506afc2 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:55.441698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35f718-4fc0-4dec-b9af-73dda52d817a None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:55.499012 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11757a-0f2b-4835-8ff0-c70c2cd967e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:55.499012 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11757a-0f2b-4835-8ff0-c70c2cd967e0 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:55.499012 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11757a-0f2b-4835-8ff0-c70c2cd967e0 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:55.499416 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11757a-0f2b-4835-8ff0-c70c2cd967e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:55.546137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29796e9-9c47-41a4-a5dd-b0a97506afc2 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:55.596360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97ee38-3115-4752-8590-3c674f80d0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:55.597207 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97ee38-3115-4752-8590-3c674f80d0f3 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:55.597602 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97ee38-3115-4752-8590-3c674f80d0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:55.597912 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97ee38-3115-4752-8590-3c674f80d0f3 None admin] PATH_INFO: `/v3/services/network` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:55.598708 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97ee38-3115-4752-8590-3c674f80d0f3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:55.600356 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97ee38-3115-4752-8590-3c674f80d0f3 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:55.609165 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11757a-0f2b-4835-8ff0-c70c2cd967e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:55.611575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11757a-0f2b-4835-8ff0-c70c2cd967e0 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:55.615528 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-cd97ee38-3115-4752-8590-3c674f80d0f3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:33:55.615528 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:55.615528 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:33:55.615528 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:33:55.615528 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:33:55.615528 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:33:55.615528 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:33:55.615528 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:33:55.615528 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:33:55.615528 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:55.615528 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:33:55.615528 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:55.615528 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:55.615528 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:55.615528 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:55.615528 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:55.615528 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:55.617995 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:55.617995 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:55.617995 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:55.617995 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:55.617995 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:55.617995 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:55.617995 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:33:55.617995 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:33:55.617995 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:33:55.617995 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:33:55.617995 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:55.617995 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:55.617995 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:55.617995 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:55.617995 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:55.617995 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:55.620036 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:55.620036 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:55.620036 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:55.620036 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:55.620036 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:55.620036 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:55.620036 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:55.620036 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:55.620036 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:55.620036 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:55.620036 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:33:55.620036 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:33:55.620036 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:33:55.620036 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:55.620036 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 416/816] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:55 2022] GET /identity/v3/services/network => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:55.622219 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97ee38-3115-4752-8590-3c674f80d0f3 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:55.792477 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97ee38-3115-4752-8590-3c674f80d0f3 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:55.802510 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 401/817] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:33:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:33:55.803959 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11757a-0f2b-4835-8ff0-c70c2cd967e0 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:55.862489 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835d216-a7d9-4491-8534-f515b0cc5a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:55.863510 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835d216-a7d9-4491-8534-f515b0cc5a17 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:55.864063 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835d216-a7d9-4491-8534-f515b0cc5a17 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:55.864591 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835d216-a7d9-4491-8534-f515b0cc5a17 None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:55.866199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835d216-a7d9-4491-8534-f515b0cc5a17 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:55.866771 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835d216-a7d9-4491-8534-f515b0cc5a17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:55.869644 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835d216-a7d9-4491-8534-f515b0cc5a17 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:55.907119 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 417/818] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 9 15:33:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:55.908470 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835d216-a7d9-4491-8534-f515b0cc5a17 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:55.966543 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11757a-0f2b-4835-8ff0-c70c2cd967e0 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:56.034929 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a2465-df36-4e47-b010-f08621a9d188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:56.036024 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a2465-df36-4e47-b010-f08621a9d188 None admin] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:56.036490 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a2465-df36-4e47-b010-f08621a9d188 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:56.036925 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a2465-df36-4e47-b010-f08621a9d188 None admin] PATH_INFO: `/v3/endpoints` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:56.038296 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a2465-df36-4e47-b010-f08621a9d188 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:56.040984 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a2465-df36-4e47-b010-f08621a9d188 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:56.047609 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835d216-a7d9-4491-8534-f515b0cc5a17 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:56.083877 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 402/819] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:33:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:33:56.085290 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a2465-df36-4e47-b010-f08621a9d188 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:56.128799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe333b-e90d-4cb0-afd5-6ce2125106ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:56.130325 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe333b-e90d-4cb0-afd5-6ce2125106ff None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:56.131009 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe333b-e90d-4cb0-afd5-6ce2125106ff None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:56.131553 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe333b-e90d-4cb0-afd5-6ce2125106ff None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:56.132955 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe333b-e90d-4cb0-afd5-6ce2125106ff None admin] RBAC: Adding query filter params (name=network) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:56.133828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe333b-e90d-4cb0-afd5-6ce2125106ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:56.136593 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe333b-e90d-4cb0-afd5-6ce2125106ff None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:56.144868 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 418/820] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:33:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:56.146712 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe333b-e90d-4cb0-afd5-6ce2125106ff None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:56.242759 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a2465-df36-4e47-b010-f08621a9d188 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:56.286540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d08893-15a0-4be9-8b4d-44e2b52fe1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:56.287418 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d08893-15a0-4be9-8b4d-44e2b52fe1ad None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:56.287739 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d08893-15a0-4be9-8b4d-44e2b52fe1ad None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:56.288067 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d08893-15a0-4be9-8b4d-44e2b52fe1ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:56.301639 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d08893-15a0-4be9-8b4d-44e2b52fe1ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:56.303829 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d08893-15a0-4be9-8b4d-44e2b52fe1ad None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:56.313836 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe333b-e90d-4cb0-afd5-6ce2125106ff None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:56.329711 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-b4d08893-15a0-4be9-8b4d-44e2b52fe1ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:56.329711 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:56.329711 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:56.329711 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:56.329711 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:56.329711 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:56.329711 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:56.329711 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:56.329711 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:56.329711 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:56.329711 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:56.329711 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:56.329711 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:56.329711 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:56.329711 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:56.330939 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:56.330939 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:56.330939 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:56.330939 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:56.330939 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:56.330939 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:56.330939 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:56.330939 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:56.330939 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:56.330939 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:56.330939 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:56.330939 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:56.330939 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:56.330939 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:56.330939 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:56.330939 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:56.330939 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:56.332291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:56.332291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:56.332291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:56.332291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:56.332291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 403/821] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:56.332291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d08893-15a0-4be9-8b4d-44e2b52fe1ad None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:56.365790 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297219df-bb9a-4ddb-b0bb-7757591d145a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:56.367304 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297219df-bb9a-4ddb-b0bb-7757591d145a None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:56.367984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297219df-bb9a-4ddb-b0bb-7757591d145a None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:56.368581 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297219df-bb9a-4ddb-b0bb-7757591d145a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:56.384129 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297219df-bb9a-4ddb-b0bb-7757591d145a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:56.386058 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297219df-bb9a-4ddb-b0bb-7757591d145a None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:56.410372 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-297219df-bb9a-4ddb-b0bb-7757591d145a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:56.410372 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:56.410372 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:56.410372 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:56.410372 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:56.410372 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:56.410372 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:56.410372 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:56.410372 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:56.410372 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:56.410372 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:56.410372 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:56.410372 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:56.410372 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:56.410372 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:56.412120 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:56.412120 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:56.412120 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:56.412120 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:56.412120 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:56.412120 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:56.412120 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:56.412120 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:56.412120 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:56.412120 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:56.412120 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:56.412120 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:56.412120 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:56.412120 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:56.412120 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:56.412120 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:56.412120 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:56.413828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:56.413828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:56.413828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:56.413828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:56.413828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 419/822] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:56.413828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297219df-bb9a-4ddb-b0bb-7757591d145a None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:56.491199 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d08893-15a0-4be9-8b4d-44e2b52fe1ad None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:56.539085 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d935f4-926b-4753-a706-3a81a9ef1a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:56.540067 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d935f4-926b-4753-a706-3a81a9ef1a50 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:56.540226 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297219df-bb9a-4ddb-b0bb-7757591d145a None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:56.544816 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d935f4-926b-4753-a706-3a81a9ef1a50 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:56.545179 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d935f4-926b-4753-a706-3a81a9ef1a50 None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:56.546398 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d935f4-926b-4753-a706-3a81a9ef1a50 None admin] RBAC: Adding query filter params (type=network) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:56.546823 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d935f4-926b-4753-a706-3a81a9ef1a50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:56.550146 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d935f4-926b-4753-a706-3a81a9ef1a50 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:56.561513 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 404/823] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:33:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:56.561513 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d935f4-926b-4753-a706-3a81a9ef1a50 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:56.581413 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce38211-883a-4792-aa85-27b2d1a064a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:56.582086 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce38211-883a-4792-aa85-27b2d1a064a3 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:56.582377 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce38211-883a-4792-aa85-27b2d1a064a3 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:56.582658 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce38211-883a-4792-aa85-27b2d1a064a3 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:56.583398 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce38211-883a-4792-aa85-27b2d1a064a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:56.584030 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce38211-883a-4792-aa85-27b2d1a064a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:56.585500 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce38211-883a-4792-aa85-27b2d1a064a3 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:56.601026 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 420/824] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:56.605724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925301b8-d625-4428-934b-3a199c1bd62a None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:56.605724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925301b8-d625-4428-934b-3a199c1bd62a None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:56.605724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925301b8-d625-4428-934b-3a199c1bd62a None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:56.605724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 421/825] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:56.605724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925301b8-d625-4428-934b-3a199c1bd62a None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:56.715771 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d935f4-926b-4753-a706-3a81a9ef1a50 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:56.749424 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925301b8-d625-4428-934b-3a199c1bd62a None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:56.753692 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9609c-5809-45c9-92c9-e5541aa11116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:56.754408 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9609c-5809-45c9-92c9-e5541aa11116 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:56.754681 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9609c-5809-45c9-92c9-e5541aa11116 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:56.754984 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9609c-5809-45c9-92c9-e5541aa11116 None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:56.755891 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9609c-5809-45c9-92c9-e5541aa11116 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:56.756231 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9609c-5809-45c9-92c9-e5541aa11116 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:56.757757 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9609c-5809-45c9-92c9-e5541aa11116 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:56.780532 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 405/826] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:56.780532 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9609c-5809-45c9-92c9-e5541aa11116 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:56.817760 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bf28b-7a8a-4f94-92b9-50fb9b64b78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:56.818775 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bf28b-7a8a-4f94-92b9-50fb9b64b78f None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:56.819354 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bf28b-7a8a-4f94-92b9-50fb9b64b78f None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:56.819835 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bf28b-7a8a-4f94-92b9-50fb9b64b78f None admin] PATH_INFO: `/v3/endpoints` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:56.821001 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771bf28b-7a8a-4f94-92b9-50fb9b64b78f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:56.823842 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771bf28b-7a8a-4f94-92b9-50fb9b64b78f None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:56.855261 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 422/827] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:33:56 2022] POST /identity/v3/endpoints => generated 327 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:33:56.857125 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14927266-c949-405f-b2f7-e7ce884e013a None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:56.857695 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14927266-c949-405f-b2f7-e7ce884e013a None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:56.858222 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14927266-c949-405f-b2f7-e7ce884e013a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:56.887348 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-14927266-c949-405f-b2f7-e7ce884e013a None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:56.888819 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-14927266-c949-405f-b2f7-e7ce884e013a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:56.937798 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9609c-5809-45c9-92c9-e5541aa11116 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:56.991429 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 423/828] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:33:56.992539 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14927266-c949-405f-b2f7-e7ce884e013a None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:57.007862 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d248f-32c1-4f05-9d02-70a3e55c886e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:57.009512 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d248f-32c1-4f05-9d02-70a3e55c886e None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:57.009946 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d248f-32c1-4f05-9d02-70a3e55c886e None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:57.010439 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d248f-32c1-4f05-9d02-70a3e55c886e None admin] PATH_INFO: `/v3/projects/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:57.032248 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d248f-32c1-4f05-9d02-70a3e55c886e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:57.034973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d248f-32c1-4f05-9d02-70a3e55c886e None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:57.069881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-501d248f-32c1-4f05-9d02-70a3e55c886e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:57.069881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:57.069881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:57.069881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:57.069881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:57.069881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:57.069881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:57.069881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:57.069881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:57.069881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:57.069881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:57.069881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:57.069881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:33:57.069881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:33:57.069881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:33:57.070926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:33:57.070926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:57.070926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:57.070926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:57.070926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:57.070926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:57.070926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:57.070926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:57.070926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:57.070926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:57.070926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:57.070926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:57.070926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:57.070926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:57.070926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:57.070926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:57.070926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:57.071900 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:33:57.071900 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:33:57.071900 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:33:57.071900 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:33:57.071900 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:33:57.071900 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:33:57.071900 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:57.071900 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:57.072400 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 406/829] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:57.077425 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d248f-32c1-4f05-9d02-70a3e55c886e None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:57.156799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14927266-c949-405f-b2f7-e7ce884e013a None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:57.205617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a30e66-4445-408b-9107-0cb523826734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:57.206507 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a30e66-4445-408b-9107-0cb523826734 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:57.206794 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a30e66-4445-408b-9107-0cb523826734 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:57.207072 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a30e66-4445-408b-9107-0cb523826734 None admin] PATH_INFO: `/v3/projects/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:57.214899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a30e66-4445-408b-9107-0cb523826734 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:57.216417 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a30e66-4445-408b-9107-0cb523826734 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:57.232729 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-20a30e66-4445-408b-9107-0cb523826734 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:57.232729 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:57.232729 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:57.232729 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:57.232729 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:57.232729 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:57.232729 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:57.232729 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:57.232729 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:57.232729 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:57.232729 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:57.232729 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:57.232729 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:33:57.232729 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:33:57.232729 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:33:57.234122 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:33:57.234122 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:57.234122 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:57.234122 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:57.234122 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:57.234122 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:57.234122 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:57.234122 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:57.234122 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:57.234122 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:57.234122 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:57.234122 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:57.234122 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:57.234122 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:57.234122 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:57.234122 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:57.234122 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:57.236278 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:33:57.236278 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:33:57.236278 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:33:57.236278 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:33:57.236278 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:33:57.236278 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:33:57.236278 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:57.236278 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:57.236278 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 424/830] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:57.236825 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a30e66-4445-408b-9107-0cb523826734 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:57.249952 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d248f-32c1-4f05-9d02-70a3e55c886e None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:57.302854 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d639bd8-3541-410b-8668-410bec2e773a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:57.303680 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d639bd8-3541-410b-8668-410bec2e773a None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:57.303973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d639bd8-3541-410b-8668-410bec2e773a None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:57.304243 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d639bd8-3541-410b-8668-410bec2e773a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:57.317996 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d639bd8-3541-410b-8668-410bec2e773a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:33:57.326881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-9d639bd8-3541-410b-8668-410bec2e773a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:33:57.326881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:57.326881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:57.326881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:57.326881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:57.326881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:57.326881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:57.326881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:57.326881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:57.326881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:57.326881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:57.326881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:57.326881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:33:57.326881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:33:57.326881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:33:57.326881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:33:57.327950 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:33:57.327950 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:33:57.327950 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:33:57.327950 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:33:57.327950 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:57.327950 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:57.327950 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:57.327950 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:57.327950 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:57.327950 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:57.327950 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:57.327950 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:57.327950 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:57.327950 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:57.327950 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:57.327950 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:57.330585 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:57.330585 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:57.330585 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:57.330585 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:57.330585 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:33:57.330585 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:33:57.330585 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:33:57.330585 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:33:57.330585 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:33:57.330585 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:33:57.330585 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:33:57.330585 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:57.334600 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 407/831] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:33:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:57.335629 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d639bd8-3541-410b-8668-410bec2e773a None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:57.370822 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a30e66-4445-408b-9107-0cb523826734 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:57.415660 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660371f-8956-4d83-8c88-88380e64b891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:57.416808 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660371f-8956-4d83-8c88-88380e64b891 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:57.417297 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660371f-8956-4d83-8c88-88380e64b891 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:57.417796 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660371f-8956-4d83-8c88-88380e64b891 None admin] PATH_INFO: `/v3/projects` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:57.418946 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660371f-8956-4d83-8c88-88380e64b891 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:57.419611 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660371f-8956-4d83-8c88-88380e64b891 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:57.422091 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660371f-8956-4d83-8c88-88380e64b891 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:57.445321 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 425/832] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:33:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:57.445321 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660371f-8956-4d83-8c88-88380e64b891 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:57.473033 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d639bd8-3541-410b-8668-410bec2e773a None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:57.513503 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c47471-a529-41bc-a4ff-c35f1355de7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:57.514304 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c47471-a529-41bc-a4ff-c35f1355de7b None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:57.514499 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c47471-a529-41bc-a4ff-c35f1355de7b None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:57.514736 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c47471-a529-41bc-a4ff-c35f1355de7b None admin] PATH_INFO: `/v3/projects` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:57.515567 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c47471-a529-41bc-a4ff-c35f1355de7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:57.515881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c47471-a529-41bc-a4ff-c35f1355de7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:57.517892 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c47471-a529-41bc-a4ff-c35f1355de7b None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:57.536584 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 408/833] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:33:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:57.536584 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c47471-a529-41bc-a4ff-c35f1355de7b None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:57.554869 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660371f-8956-4d83-8c88-88380e64b891 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:57.595713 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e41423-a8a5-46a0-bf60-449d3db393eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:57.596292 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e41423-a8a5-46a0-bf60-449d3db393eb None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:57.596608 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e41423-a8a5-46a0-bf60-449d3db393eb None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:57.596875 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e41423-a8a5-46a0-bf60-449d3db393eb None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:57.597673 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e41423-a8a5-46a0-bf60-449d3db393eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:57.598007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e41423-a8a5-46a0-bf60-449d3db393eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:57.599483 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e41423-a8a5-46a0-bf60-449d3db393eb None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:57.615546 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 426/834] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:33:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:57.615546 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e41423-a8a5-46a0-bf60-449d3db393eb None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:57.666513 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c47471-a529-41bc-a4ff-c35f1355de7b None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:57.717159 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f238f3-42ba-420e-b456-f655c1411322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:57.718314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f238f3-42ba-420e-b456-f655c1411322 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:57.719365 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f238f3-42ba-420e-b456-f655c1411322 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:57.719876 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f238f3-42ba-420e-b456-f655c1411322 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:57.721513 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f238f3-42ba-420e-b456-f655c1411322 None admin] RBAC: Adding query filter params (role.id=a5cb8d37261d486cbc1b06d167a9c05c, scope.project.id=db5768a93e754372808fc69f898cc853, user.id=d398283fc99c4bfe83170ad3d1538f38) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:57.722079 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f238f3-42ba-420e-b456-f655c1411322 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:57.724260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f238f3-42ba-420e-b456-f655c1411322 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:57.732073 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e41423-a8a5-46a0-bf60-449d3db393eb None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:57.743221 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 409/835] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:33:57 2022] GET /identity/v3/role_assignments?user.id=d398283fc99c4bfe83170ad3d1538f38&scope.project.id=db5768a93e754372808fc69f898cc853&role.id=a5cb8d37261d486cbc1b06d167a9c05c => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:57.743221 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f238f3-42ba-420e-b456-f655c1411322 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:57.784850 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be715c3c-69e0-46c7-81c8-4bb063981682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:57.786248 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be715c3c-69e0-46c7-81c8-4bb063981682 None admin] REQUEST_METHOD: `PUT` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:57.786938 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be715c3c-69e0-46c7-81c8-4bb063981682 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:57.787953 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be715c3c-69e0-46c7-81c8-4bb063981682 None admin] PATH_INFO: `/v3/projects/db5768a93e754372808fc69f898cc853/users/8fcb1b0006d94847be30b28f17d041e3/roles/b22352a378fb404d90e3b3ae182757ad` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:57.811569 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be715c3c-69e0-46c7-81c8-4bb063981682 None admin] RBAC: Authorizing `identity:create_grant(project_id=db5768a93e754372808fc69f898cc853, user_id=8fcb1b0006d94847be30b28f17d041e3, role_id=b22352a378fb404d90e3b3ae182757ad)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:57.813905 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be715c3c-69e0-46c7-81c8-4bb063981682 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:57.834920 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 427/836] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:33:57 2022] PUT /identity/v3/projects/db5768a93e754372808fc69f898cc853/users/8fcb1b0006d94847be30b28f17d041e3/roles/b22352a378fb404d90e3b3ae182757ad => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:33:57.895836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f238f3-42ba-420e-b456-f655c1411322 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:57.941910 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfa307-fa48-4b25-a18d-71814926b09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:57.942757 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfa307-fa48-4b25-a18d-71814926b09e None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:57.943048 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfa307-fa48-4b25-a18d-71814926b09e None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:57.943327 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfa307-fa48-4b25-a18d-71814926b09e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:57.959365 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfa307-fa48-4b25-a18d-71814926b09e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:57.961015 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfa307-fa48-4b25-a18d-71814926b09e None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:57.982536 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-44cfa307-fa48-4b25-a18d-71814926b09e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:57.982536 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:57.982536 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:57.982536 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:57.982536 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:57.982536 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:57.982536 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:57.982536 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:57.982536 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:57.982536 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:57.982536 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:57.982536 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:57.982536 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:57.982536 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:57.982536 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:57.983614 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:57.983614 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:57.983614 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:57.983614 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:57.983614 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:57.983614 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:57.983614 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:57.983614 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:57.983614 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:57.983614 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:57.983614 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:57.983614 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:57.983614 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:57.983614 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:57.983614 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:57.983614 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:57.983614 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:57.984704 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:57.984704 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:57.984704 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:57.984704 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:57.984704 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 410/837] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:57.990757 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be715c3c-69e0-46c7-81c8-4bb063981682 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:58.117875 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be715c3c-69e0-46c7-81c8-4bb063981682 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:58.171519 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff166a-302d-4363-a7c4-c7e3c7533f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:58.172710 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff166a-302d-4363-a7c4-c7e3c7533f18 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:58.173061 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff166a-302d-4363-a7c4-c7e3c7533f18 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:58.173387 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff166a-302d-4363-a7c4-c7e3c7533f18 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:58.174257 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff166a-302d-4363-a7c4-c7e3c7533f18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:58.174624 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff166a-302d-4363-a7c4-c7e3c7533f18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:58.176275 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff166a-302d-4363-a7c4-c7e3c7533f18 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:58.191925 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 428/838] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:58.197570 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfa307-fa48-4b25-a18d-71814926b09e None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:58.311810 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfa307-fa48-4b25-a18d-71814926b09e None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:58.354053 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bc466-6ba8-43bd-99e4-5759a614076a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:58.354866 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bc466-6ba8-43bd-99e4-5759a614076a None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:58.355152 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bc466-6ba8-43bd-99e4-5759a614076a None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:58.355433 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bc466-6ba8-43bd-99e4-5759a614076a None admin] PATH_INFO: `/v3/users/swift` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:58.364612 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bc466-6ba8-43bd-99e4-5759a614076a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:58.366125 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bc466-6ba8-43bd-99e4-5759a614076a None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:58.381231 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-2b2bc466-6ba8-43bd-99e4-5759a614076a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:33:58.381231 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:58.381231 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:58.381231 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:58.381231 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:58.381231 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:58.381231 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:58.381231 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:58.381231 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:58.381231 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:58.381231 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:58.381231 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:58.381231 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:33:58.381231 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:33:58.381231 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:33:58.381231 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:33:58.382561 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:58.382561 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:58.382561 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:33:58.382561 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:58.382561 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:33:58.382561 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:33:58.382561 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:58.382561 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:58.382561 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:58.382561 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:58.382561 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:58.382561 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:58.382561 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:58.382561 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:58.382561 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:58.382561 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:58.382561 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:58.382561 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:58.383803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:58.383803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:58.383803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:33:58.383803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:33:58.383803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:33:58.383803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:33:58.383803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:33:58.383803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:33:58.383803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:33:58.383803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:58.383803 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 411/839] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:33:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:58.390526 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff166a-302d-4363-a7c4-c7e3c7533f18 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:58.512267 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff166a-302d-4363-a7c4-c7e3c7533f18 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:58.551348 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f708f7-1d60-4e2d-a536-8eb83b0f4022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:58.552452 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f708f7-1d60-4e2d-a536-8eb83b0f4022 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:58.552956 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f708f7-1d60-4e2d-a536-8eb83b0f4022 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:58.553552 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f708f7-1d60-4e2d-a536-8eb83b0f4022 None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:58.554629 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f708f7-1d60-4e2d-a536-8eb83b0f4022 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:58.555181 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f708f7-1d60-4e2d-a536-8eb83b0f4022 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:58.556885 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f708f7-1d60-4e2d-a536-8eb83b0f4022 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:58.576825 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 429/840] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 9 15:33:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:58.584557 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bc466-6ba8-43bd-99e4-5759a614076a None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:58.639488 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6560d-b1ed-4c19-b5ac-1c4fe83dae4d None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:58.639872 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6560d-b1ed-4c19-b5ac-1c4fe83dae4d None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:58.640093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6560d-b1ed-4c19-b5ac-1c4fe83dae4d None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:58.643007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 430/841] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:33:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:33:58.648663 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f9ee7-d4df-4d02-8f9a-36178861ee16 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:58.648946 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f9ee7-d4df-4d02-8f9a-36178861ee16 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:58.649230 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f9ee7-d4df-4d02-8f9a-36178861ee16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:58.667709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-6e8f9ee7-d4df-4d02-8f9a-36178861ee16 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:33:58.668936 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-6e8f9ee7-d4df-4d02-8f9a-36178861ee16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:33:58.709460 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bc466-6ba8-43bd-99e4-5759a614076a None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:58.743878 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efdb8cd-6830-4ccc-b61b-d0e9d24cbbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:58.749507 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 431/842] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:33:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:33:58.749693 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdb8cd-6830-4ccc-b61b-d0e9d24cbbb7 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:58.749693 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdb8cd-6830-4ccc-b61b-d0e9d24cbbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:58.749693 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdb8cd-6830-4ccc-b61b-d0e9d24cbbb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:58.767737 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f9ee7-d4df-4d02-8f9a-36178861ee16 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:58.822233 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efdb8cd-6830-4ccc-b61b-d0e9d24cbbb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:58.824134 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efdb8cd-6830-4ccc-b61b-d0e9d24cbbb7 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:58.876853 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f9ee7-d4df-4d02-8f9a-36178861ee16 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:58.913423 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e9b00-e212-47e0-8acc-3fb35f4de8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:58.914256 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e9b00-e212-47e0-8acc-3fb35f4de8d9 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:58.914611 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e9b00-e212-47e0-8acc-3fb35f4de8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:58.914892 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e9b00-e212-47e0-8acc-3fb35f4de8d9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:58.915607 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e9b00-e212-47e0-8acc-3fb35f4de8d9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:58.916996 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e9b00-e212-47e0-8acc-3fb35f4de8d9 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:58.928840 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 412/843] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:33:58 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:33:58.930836 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-368e9b00-e212-47e0-8acc-3fb35f4de8d9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:33:58.930836 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:58.930836 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:33:58.930836 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:33:58.930836 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:33:58.930836 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:33:58.930836 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:33:58.930836 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:33:58.930836 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:33:58.930836 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:58.930836 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:33:58.930836 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:58.930836 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:58.930836 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:58.930836 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:58.930836 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:58.930836 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:58.931904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:58.931904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:58.931904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:58.931904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:58.931904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:58.931904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:58.931904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:33:58.931904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:33:58.931904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:33:58.931904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:33:58.931904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:58.931904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:58.931904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:58.931904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:58.931904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:58.931904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:58.932835 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:58.932835 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:58.932835 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:58.932835 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:58.932835 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:58.932835 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:58.932835 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:58.932835 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:58.932835 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:58.932835 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:58.932835 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:33:58.932835 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:33:58.932835 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:33:58.932835 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:58.933684 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 432/844] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:33:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:58.934577 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efdb8cd-6830-4ccc-b61b-d0e9d24cbbb7 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:58.942192 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e9b00-e212-47e0-8acc-3fb35f4de8d9 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:59.046104 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e9b00-e212-47e0-8acc-3fb35f4de8d9 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:59.069634 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efdb8cd-6830-4ccc-b61b-d0e9d24cbbb7 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:59.086621 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd8037-afe0-433f-989d-b22e449bc5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:59.087305 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd8037-afe0-433f-989d-b22e449bc5fa None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:59.087595 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd8037-afe0-433f-989d-b22e449bc5fa None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:59.087874 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd8037-afe0-433f-989d-b22e449bc5fa None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:59.088597 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd8037-afe0-433f-989d-b22e449bc5fa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:59.088907 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd8037-afe0-433f-989d-b22e449bc5fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:59.090369 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd8037-afe0-433f-989d-b22e449bc5fa None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:59.101548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 433/845] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:33:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:59.102517 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd8037-afe0-433f-989d-b22e449bc5fa None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:59.121500 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a060d37-2d22-434e-af24-258884c40b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:59.123005 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a060d37-2d22-434e-af24-258884c40b50 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:59.123706 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a060d37-2d22-434e-af24-258884c40b50 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:59.124237 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a060d37-2d22-434e-af24-258884c40b50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:59.138962 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a060d37-2d22-434e-af24-258884c40b50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:59.140452 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a060d37-2d22-434e-af24-258884c40b50 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:59.166193 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-6a060d37-2d22-434e-af24-258884c40b50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:59.166193 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:59.166193 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:59.166193 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:59.166193 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:59.166193 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:59.166193 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:59.166193 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:59.166193 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:59.166193 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:59.166193 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:59.166193 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:59.166193 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:33:59.166193 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:33:59.166193 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:33:59.167263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:33:59.167263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:59.167263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:59.167263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:59.167263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:59.167263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:59.167263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:59.167263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:59.167263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:33:59.167263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:59.167263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:59.167263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:59.167263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:59.167263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:59.167263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:59.167263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:59.167263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:59.168254 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:33:59.168254 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:33:59.168254 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:33:59.168254 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:33:59.172551 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 413/846] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:59.173949 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a060d37-2d22-434e-af24-258884c40b50 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:59.238191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd8037-afe0-433f-989d-b22e449bc5fa None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:59.282585 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de31a0d-7a44-4178-a373-f091748e32f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:59.283615 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de31a0d-7a44-4178-a373-f091748e32f8 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:59.284217 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de31a0d-7a44-4178-a373-f091748e32f8 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:59.284521 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de31a0d-7a44-4178-a373-f091748e32f8 None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:59.285572 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de31a0d-7a44-4178-a373-f091748e32f8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:59.285880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de31a0d-7a44-4178-a373-f091748e32f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:59.288210 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de31a0d-7a44-4178-a373-f091748e32f8 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:59.292595 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a060d37-2d22-434e-af24-258884c40b50 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:59.294336 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 434/847] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:33:59 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:59.335198 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447b4e9-ec0d-4972-93e5-ca5555e4bd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:59.335802 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447b4e9-ec0d-4972-93e5-ca5555e4bd21 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:59.336092 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447b4e9-ec0d-4972-93e5-ca5555e4bd21 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:59.336373 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447b4e9-ec0d-4972-93e5-ca5555e4bd21 None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:59.337129 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447b4e9-ec0d-4972-93e5-ca5555e4bd21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:59.337473 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447b4e9-ec0d-4972-93e5-ca5555e4bd21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:59.338899 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447b4e9-ec0d-4972-93e5-ca5555e4bd21 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:59.354387 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 414/848] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:59.361561 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de31a0d-7a44-4178-a373-f091748e32f8 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:59.486792 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de31a0d-7a44-4178-a373-f091748e32f8 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:59.527609 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de476cc2-ba2d-44a0-bce8-cc9a9e129731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:59.528419 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de476cc2-ba2d-44a0-bce8-cc9a9e129731 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:59.528705 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de476cc2-ba2d-44a0-bce8-cc9a9e129731 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:59.528984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de476cc2-ba2d-44a0-bce8-cc9a9e129731 None admin] PATH_INFO: `/v3/projects/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:59.536440 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de476cc2-ba2d-44a0-bce8-cc9a9e129731 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:59.537946 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de476cc2-ba2d-44a0-bce8-cc9a9e129731 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:59.553219 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-de476cc2-ba2d-44a0-bce8-cc9a9e129731 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:59.553219 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:33:59.553219 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:33:59.553219 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:33:59.553219 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:33:59.553219 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:33:59.553219 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:33:59.553219 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:33:59.553219 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:33:59.553219 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:33:59.553219 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:33:59.553219 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:33:59.553219 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:33:59.553219 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:33:59.553219 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:33:59.554303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:33:59.554303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:33:59.554303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:33:59.554303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:33:59.554303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:33:59.554303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:33:59.554303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:33:59.554303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:33:59.554303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:33:59.554303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:33:59.554303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:33:59.554303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:33:59.554303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:33:59.554303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:33:59.554303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:33:59.554303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:33:59.554303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:33:59.555299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:33:59.555299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:33:59.555299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:33:59.555299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:33:59.555299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:33:59.555299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:33:59.555299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:33:59.555299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:33:59.555299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 435/849] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:33:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:33:59.560814 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447b4e9-ec0d-4972-93e5-ca5555e4bd21 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:59.675361 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447b4e9-ec0d-4972-93e5-ca5555e4bd21 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:59.714143 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10aa921-3ba1-46af-96ff-cb6cecb1c24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:59.714823 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10aa921-3ba1-46af-96ff-cb6cecb1c24d None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:59.717413 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10aa921-3ba1-46af-96ff-cb6cecb1c24d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:59.717413 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10aa921-3ba1-46af-96ff-cb6cecb1c24d None admin] PATH_INFO: `/v3/projects` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:59.717413 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10aa921-3ba1-46af-96ff-cb6cecb1c24d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:59.717413 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10aa921-3ba1-46af-96ff-cb6cecb1c24d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:59.717973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10aa921-3ba1-46af-96ff-cb6cecb1c24d None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:59.731978 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 415/850] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:33:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:33:59.742598 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de476cc2-ba2d-44a0-bce8-cc9a9e129731 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:33:59.851036 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de476cc2-ba2d-44a0-bce8-cc9a9e129731 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:33:59.892440 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691cfd76-968b-4e8d-be11-b4fafd48acc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:33:59.893218 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cfd76-968b-4e8d-be11-b4fafd48acc0 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:33:59.893435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cfd76-968b-4e8d-be11-b4fafd48acc0 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:33:59.893618 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cfd76-968b-4e8d-be11-b4fafd48acc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:33:59.894412 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691cfd76-968b-4e8d-be11-b4fafd48acc0 None admin] RBAC: Adding query filter params (role.id=a5cb8d37261d486cbc1b06d167a9c05c, scope.project.id=db5768a93e754372808fc69f898cc853, user.id=6e553afd9da345b29b3b164e34e5a506) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:33:59.894728 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691cfd76-968b-4e8d-be11-b4fafd48acc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:33:59.896220 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691cfd76-968b-4e8d-be11-b4fafd48acc0 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:33:59.902863 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 436/851] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:33:59 2022] GET /identity/v3/role_assignments?user.id=6e553afd9da345b29b3b164e34e5a506&scope.project.id=db5768a93e754372808fc69f898cc853&role.id=a5cb8d37261d486cbc1b06d167a9c05c => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:00.314914 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccd70a-ac2d-4259-8db8-9687b6d04a50 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:00.315332 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccd70a-ac2d-4259-8db8-9687b6d04a50 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:00.315516 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccd70a-ac2d-4259-8db8-9687b6d04a50 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:00.317004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 416/852] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:00.322833 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aceb66-4b9d-4a52-b354-942099c1ec65 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:00.323123 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aceb66-4b9d-4a52-b354-942099c1ec65 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:00.323404 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aceb66-4b9d-4a52-b354-942099c1ec65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:00.341018 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-f5aceb66-4b9d-4a52-b354-942099c1ec65 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:00.342249 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-f5aceb66-4b9d-4a52-b354-942099c1ec65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:00.396554 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364e543-9df3-4031-a6cf-bfdbfa15c6a0 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:00.397241 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364e543-9df3-4031-a6cf-bfdbfa15c6a0 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:00.397797 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364e543-9df3-4031-a6cf-bfdbfa15c6a0 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:00.400833 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 417/853] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:00.407078 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b75bb-f375-4ed6-8189-7c8bd5f91d20 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:00.407748 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b75bb-f375-4ed6-8189-7c8bd5f91d20 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:00.408250 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b75bb-f375-4ed6-8189-7c8bd5f91d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:00.429407 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 437/854] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:00.435800 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-e70b75bb-f375-4ed6-8189-7c8bd5f91d20 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:00.437437 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-e70b75bb-f375-4ed6-8189-7c8bd5f91d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:00.453075 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aceb66-4b9d-4a52-b354-942099c1ec65 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:00.533576 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 418/855] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:00.550299 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b75bb-f375-4ed6-8189-7c8bd5f91d20 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:00.577914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aceb66-4b9d-4a52-b354-942099c1ec65 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:00.628827 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409a101-20d3-46d3-b8aa-01fdf2228e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:00.628827 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409a101-20d3-46d3-b8aa-01fdf2228e58 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:00.628827 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409a101-20d3-46d3-b8aa-01fdf2228e58 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:00.628827 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409a101-20d3-46d3-b8aa-01fdf2228e58 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:00.629281 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409a101-20d3-46d3-b8aa-01fdf2228e58 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:00.633395 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409a101-20d3-46d3-b8aa-01fdf2228e58 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:00.645828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-f409a101-20d3-46d3-b8aa-01fdf2228e58 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:34:00.645828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:00.645828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:34:00.645828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:34:00.645828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:34:00.645828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:34:00.645828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:34:00.645828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:00.645828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:34:00.645828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:00.645828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:34:00.645828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:00.645828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:00.645828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:00.645828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:00.645828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:00.646927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:00.646927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:00.646927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:00.646927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:00.646927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:00.646927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:00.646927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:00.646927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:34:00.646927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:34:00.646927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:34:00.646927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:34:00.646927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:00.646927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:00.646927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:00.646927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:00.646927 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:00.648358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:00.648358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:00.648358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:00.648358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:00.648358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:00.648358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:00.648358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:00.648358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:00.648358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:00.648358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:00.648358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:00.648358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:34:00.648358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:00.648358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:34:00.648358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:00.648358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 438/856] 10.222.0.48 () {56 vars in 1132 bytes} [Mon May 9 15:34:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:34:00.655631 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409a101-20d3-46d3-b8aa-01fdf2228e58 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:00.659870 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b75bb-f375-4ed6-8189-7c8bd5f91d20 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:00.700815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90324b5e-bbe0-4eed-ae7a-78b6e32a1cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:00.702422 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90324b5e-bbe0-4eed-ae7a-78b6e32a1cb2 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:00.702709 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90324b5e-bbe0-4eed-ae7a-78b6e32a1cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:00.702987 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90324b5e-bbe0-4eed-ae7a-78b6e32a1cb2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:00.719944 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90324b5e-bbe0-4eed-ae7a-78b6e32a1cb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:34:00.731420 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-90324b5e-bbe0-4eed-ae7a-78b6e32a1cb2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:34:00.731420 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:00.731420 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:00.731420 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:00.731420 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:00.731420 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:00.731420 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:00.731420 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:00.731420 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:00.731420 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:00.731420 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:00.731420 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:00.731420 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:34:00.731420 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:34:00.731420 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:34:00.731420 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:34:00.732507 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:34:00.732507 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:34:00.732507 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:34:00.732507 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:34:00.732507 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:00.732507 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:00.732507 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:00.732507 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:00.732507 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:00.732507 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:00.732507 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:00.732507 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:00.732507 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:00.732507 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:00.732507 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:00.732507 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:00.733461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:00.733461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:00.733461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:00.733461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:00.733461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:34:00.733461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:34:00.733461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:34:00.733461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:34:00.733461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:34:00.733461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:34:00.733461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:34:00.733461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:00.737436 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 419/857] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:34:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:34:00.741516 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90324b5e-bbe0-4eed-ae7a-78b6e32a1cb2 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:00.776144 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409a101-20d3-46d3-b8aa-01fdf2228e58 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:00.819735 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180d4db-dcbe-4597-b5d1-b8be7a95e67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:00.821018 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180d4db-dcbe-4597-b5d1-b8be7a95e67d None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:00.821696 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180d4db-dcbe-4597-b5d1-b8be7a95e67d None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:00.822543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180d4db-dcbe-4597-b5d1-b8be7a95e67d None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:00.823841 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180d4db-dcbe-4597-b5d1-b8be7a95e67d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:00.824456 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180d4db-dcbe-4597-b5d1-b8be7a95e67d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:00.826856 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180d4db-dcbe-4597-b5d1-b8be7a95e67d None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:00.839402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 439/858] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:34:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:00.841491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180d4db-dcbe-4597-b5d1-b8be7a95e67d None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:00.865331 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90324b5e-bbe0-4eed-ae7a-78b6e32a1cb2 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:00.902251 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cff96a-0f01-4f0d-9514-d2d004cc34cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:00.902955 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cff96a-0f01-4f0d-9514-d2d004cc34cc None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:00.903243 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cff96a-0f01-4f0d-9514-d2d004cc34cc None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:00.903519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cff96a-0f01-4f0d-9514-d2d004cc34cc None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:00.904279 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cff96a-0f01-4f0d-9514-d2d004cc34cc None admin] RBAC: Adding query filter params (name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:00.904586 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cff96a-0f01-4f0d-9514-d2d004cc34cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:00.905998 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cff96a-0f01-4f0d-9514-d2d004cc34cc None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:00.920061 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 420/859] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:34:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:00.920982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cff96a-0f01-4f0d-9514-d2d004cc34cc None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:00.977904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180d4db-dcbe-4597-b5d1-b8be7a95e67d None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:01.025409 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c294f13-9bc7-481d-a137-3779e3b2713b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:01.026498 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c294f13-9bc7-481d-a137-3779e3b2713b None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:01.027023 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c294f13-9bc7-481d-a137-3779e3b2713b None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:01.027159 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cff96a-0f01-4f0d-9514-d2d004cc34cc None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:01.027648 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c294f13-9bc7-481d-a137-3779e3b2713b None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:01.028758 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c294f13-9bc7-481d-a137-3779e3b2713b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:01.030145 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c294f13-9bc7-481d-a137-3779e3b2713b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:01.031817 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c294f13-9bc7-481d-a137-3779e3b2713b None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:01.045427 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 440/860] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:34:00 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:01.072761 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3cf479-ae57-48ec-8f07-2d65ab4da691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:01.073626 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cf479-ae57-48ec-8f07-2d65ab4da691 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:01.073906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cf479-ae57-48ec-8f07-2d65ab4da691 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:01.074186 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cf479-ae57-48ec-8f07-2d65ab4da691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:01.087066 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3cf479-ae57-48ec-8f07-2d65ab4da691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:01.088566 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3cf479-ae57-48ec-8f07-2d65ab4da691 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:01.110769 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-3e3cf479-ae57-48ec-8f07-2d65ab4da691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:01.110769 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:01.110769 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:01.110769 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:01.110769 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:01.110769 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:01.110769 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:01.110769 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:01.110769 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:01.110769 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:01.110769 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:01.110769 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:01.110769 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:34:01.110769 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:34:01.110769 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:34:01.112291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:34:01.112291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:01.112291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:01.112291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:01.112291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:01.112291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:01.112291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:01.112291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:01.112291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:01.112291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:01.112291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:01.112291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:01.112291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:01.112291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:01.112291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:01.112291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:01.112291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:01.114012 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:34:01.114012 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:34:01.114012 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:01.114012 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:01.117941 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c294f13-9bc7-481d-a137-3779e3b2713b None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:01.122340 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 421/861] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:01.259821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c294f13-9bc7-481d-a137-3779e3b2713b None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:01.297448 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870885e-e42d-4abc-9f06-11c03948fe82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:01.298209 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870885e-e42d-4abc-9f06-11c03948fe82 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:01.298535 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870885e-e42d-4abc-9f06-11c03948fe82 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:01.298816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870885e-e42d-4abc-9f06-11c03948fe82 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:01.299555 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870885e-e42d-4abc-9f06-11c03948fe82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:01.299861 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870885e-e42d-4abc-9f06-11c03948fe82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:01.301247 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870885e-e42d-4abc-9f06-11c03948fe82 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:01.314964 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 441/862] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:01.320495 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3cf479-ae57-48ec-8f07-2d65ab4da691 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:01.425991 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3cf479-ae57-48ec-8f07-2d65ab4da691 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:01.463025 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8f2ce-58c4-4ff3-8180-0c7027da8494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:01.463848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8f2ce-58c4-4ff3-8180-0c7027da8494 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:01.464128 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8f2ce-58c4-4ff3-8180-0c7027da8494 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:01.464394 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8f2ce-58c4-4ff3-8180-0c7027da8494 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:01.475083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8f2ce-58c4-4ff3-8180-0c7027da8494 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:01.476538 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8f2ce-58c4-4ff3-8180-0c7027da8494 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:01.494842 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-08a8f2ce-58c4-4ff3-8180-0c7027da8494 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:34:01.494842 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:01.494842 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:01.494842 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:01.494842 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:01.494842 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:01.494842 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:01.494842 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:01.494842 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:01.494842 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:01.494842 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:01.494842 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:01.494842 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:34:01.494842 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:34:01.494842 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:34:01.494842 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:34:01.497280 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:01.497280 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:01.497280 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:34:01.497280 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:34:01.497280 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:34:01.497280 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:34:01.497280 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:01.497280 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:01.497280 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:01.497280 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:01.497280 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:01.497280 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:01.497280 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:01.497280 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:01.497280 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:01.497280 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:01.497280 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:01.497280 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:01.498987 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:01.498987 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:01.498987 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:34:01.498987 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:34:01.498987 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:34:01.498987 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:34:01.498987 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:34:01.498987 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:34:01.498987 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:34:01.498987 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:01.498987 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 422/863] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:34:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:01.509007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870885e-e42d-4abc-9f06-11c03948fe82 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:01.622805 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870885e-e42d-4abc-9f06-11c03948fe82 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:01.661677 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31646162-5b47-45ee-a5f1-66617571b03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:01.662371 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31646162-5b47-45ee-a5f1-66617571b03c None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:01.662661 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31646162-5b47-45ee-a5f1-66617571b03c None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:01.662944 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31646162-5b47-45ee-a5f1-66617571b03c None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:01.663819 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31646162-5b47-45ee-a5f1-66617571b03c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:01.664132 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31646162-5b47-45ee-a5f1-66617571b03c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:01.665611 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31646162-5b47-45ee-a5f1-66617571b03c None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:01.690398 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 442/864] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 9 15:34:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:01.693207 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8f2ce-58c4-4ff3-8180-0c7027da8494 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:01.721261 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c49ecc-563f-4d6f-97e7-b53655de5bf1 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:01.721654 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c49ecc-563f-4d6f-97e7-b53655de5bf1 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:01.721858 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c49ecc-563f-4d6f-97e7-b53655de5bf1 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:01.723386 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 443/865] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:34:01.729058 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a51c2b-e988-4e7e-b002-bd7c44c5e3c0 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:01.729698 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a51c2b-e988-4e7e-b002-bd7c44c5e3c0 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:01.730213 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a51c2b-e988-4e7e-b002-bd7c44c5e3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:01.756486 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-a0a51c2b-e988-4e7e-b002-bd7c44c5e3c0 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:01.758114 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-a0a51c2b-e988-4e7e-b002-bd7c44c5e3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:01.842250 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 444/866] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:34:01.845993 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8f2ce-58c4-4ff3-8180-0c7027da8494 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:01.865418 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a51c2b-e988-4e7e-b002-bd7c44c5e3c0 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:01.896331 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb5d13-fa41-4f46-9460-a16838530bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:01.897138 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb5d13-fa41-4f46-9460-a16838530bc1 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:01.897442 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb5d13-fa41-4f46-9460-a16838530bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:01.897710 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb5d13-fa41-4f46-9460-a16838530bc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:01.976752 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb5d13-fa41-4f46-9460-a16838530bc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:01.978617 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb5d13-fa41-4f46-9460-a16838530bc1 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:02.002128 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a51c2b-e988-4e7e-b002-bd7c44c5e3c0 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:02.046210 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d785a5-5ced-4579-ba11-9075036e6052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:02.046945 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d785a5-5ced-4579-ba11-9075036e6052 None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:02.048186 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d785a5-5ced-4579-ba11-9075036e6052 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:02.048476 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d785a5-5ced-4579-ba11-9075036e6052 None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:02.049569 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d785a5-5ced-4579-ba11-9075036e6052 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:02.051182 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d785a5-5ced-4579-ba11-9075036e6052 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:02.077430 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 445/867] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:34:01 2022] POST /identity/v3/services => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:34:02.111208 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 423/868] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:34:01 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:34:02.114723 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d785a5-5ced-4579-ba11-9075036e6052 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:02.263879 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d785a5-5ced-4579-ba11-9075036e6052 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:02.301498 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35200960-3c8a-424d-8962-bc122d5b4eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:02.302333 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35200960-3c8a-424d-8962-bc122d5b4eb4 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:02.302623 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35200960-3c8a-424d-8962-bc122d5b4eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:02.302904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35200960-3c8a-424d-8962-bc122d5b4eb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:02.315081 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35200960-3c8a-424d-8962-bc122d5b4eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:02.316744 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35200960-3c8a-424d-8962-bc122d5b4eb4 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:02.335925 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-35200960-3c8a-424d-8962-bc122d5b4eb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:02.335925 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:02.335925 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:02.335925 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:02.335925 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:02.335925 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:02.335925 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:02.335925 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:02.335925 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:02.335925 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:02.335925 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:02.335925 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:02.335925 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:34:02.335925 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:34:02.335925 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:34:02.336948 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:34:02.336948 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:02.336948 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:02.336948 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:02.336948 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:02.336948 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:02.336948 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:02.336948 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:02.336948 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:02.336948 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:02.336948 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:02.336948 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:02.336948 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:02.336948 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:02.336948 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:02.336948 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:02.336948 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:02.337967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:34:02.337967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:34:02.337967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:02.337967 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:02.341623 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 446/869] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:02.343202 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb5d13-fa41-4f46-9460-a16838530bc1 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:02.351061 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0315d3-f5e5-4126-b3b1-f467d8ee2921 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:02.351406 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0315d3-f5e5-4126-b3b1-f467d8ee2921 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:02.351697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0315d3-f5e5-4126-b3b1-f467d8ee2921 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:02.353326 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 447/870] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:02.358903 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c7266-f6d9-47f5-9b5b-9a66ac44b3d8 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:02.359201 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c7266-f6d9-47f5-9b5b-9a66ac44b3d8 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:02.359531 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c7266-f6d9-47f5-9b5b-9a66ac44b3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:02.382295 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-885c7266-f6d9-47f5-9b5b-9a66ac44b3d8 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:02.383561 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-885c7266-f6d9-47f5-9b5b-9a66ac44b3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:02.468261 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 448/871] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:02 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:02.482575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb5d13-fa41-4f46-9460-a16838530bc1 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:02.487497 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c7266-f6d9-47f5-9b5b-9a66ac44b3d8 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:02.534211 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25573e28-161d-4bfd-901d-975d753a484e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:02.535533 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25573e28-161d-4bfd-901d-975d753a484e None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:02.536310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25573e28-161d-4bfd-901d-975d753a484e None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:02.536783 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25573e28-161d-4bfd-901d-975d753a484e None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:02.538020 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25573e28-161d-4bfd-901d-975d753a484e None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:02.538520 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25573e28-161d-4bfd-901d-975d753a484e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:02.540835 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25573e28-161d-4bfd-901d-975d753a484e None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:02.557268 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 424/872] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:02.563753 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25573e28-161d-4bfd-901d-975d753a484e None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:02.610935 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c7266-f6d9-47f5-9b5b-9a66ac44b3d8 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:02.660106 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b28296-1d5a-4e3c-96e7-d5137c08c6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:02.661753 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b28296-1d5a-4e3c-96e7-d5137c08c6a9 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:02.662270 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b28296-1d5a-4e3c-96e7-d5137c08c6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:02.662856 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b28296-1d5a-4e3c-96e7-d5137c08c6a9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:02.663745 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b28296-1d5a-4e3c-96e7-d5137c08c6a9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:02.665522 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b28296-1d5a-4e3c-96e7-d5137c08c6a9 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:02.679188 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-98b28296-1d5a-4e3c-96e7-d5137c08c6a9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:34:02.679188 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:02.679188 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:34:02.679188 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:34:02.679188 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:34:02.679188 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:34:02.679188 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:34:02.679188 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:02.679188 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:34:02.679188 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:02.679188 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:34:02.679188 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:02.679188 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:02.679188 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:02.679188 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:02.679188 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:02.679188 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:02.680379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:02.680379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:02.680379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:02.680379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:02.680379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:02.680379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:02.680379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:34:02.680379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:34:02.680379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:34:02.680379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:34:02.680379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:02.680379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:02.680379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:02.680379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:02.680379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:02.680379 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:02.681305 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:02.681305 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:02.681305 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:02.681305 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:02.681305 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:02.681305 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:02.681305 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:02.681305 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:02.681305 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:02.681305 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:02.681305 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:34:02.681305 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:02.681305 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:34:02.681305 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:02.684663 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 449/873] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:34:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:34:02.691546 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b28296-1d5a-4e3c-96e7-d5137c08c6a9 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:02.693661 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25573e28-161d-4bfd-901d-975d753a484e None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:02.735635 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bca94e-f1bb-4192-8126-a8c8c0996f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:02.736886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bca94e-f1bb-4192-8126-a8c8c0996f19 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:02.737452 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bca94e-f1bb-4192-8126-a8c8c0996f19 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:02.737978 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bca94e-f1bb-4192-8126-a8c8c0996f19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:02.746286 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bca94e-f1bb-4192-8126-a8c8c0996f19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:02.748207 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bca94e-f1bb-4192-8126-a8c8c0996f19 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:02.764498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-57bca94e-f1bb-4192-8126-a8c8c0996f19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:34:02.764498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:02.764498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:02.764498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:02.764498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:02.764498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:02.764498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:02.764498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:02.764498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:02.764498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:02.764498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:02.764498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:02.764498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:34:02.764498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:34:02.764498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:34:02.765801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:34:02.765801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:02.765801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:02.765801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:02.765801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:02.765801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:02.765801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:02.765801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:02.765801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:02.765801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:02.765801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:02.765801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:02.765801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:02.765801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:02.765801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:02.765801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:02.765801 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:02.767066 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:34:02.767066 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:34:02.767066 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:34:02.767066 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:34:02.767066 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:34:02.767066 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:34:02.767066 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:34:02.767066 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:02.774412 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 425/874] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:34:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:02.776143 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bca94e-f1bb-4192-8126-a8c8c0996f19 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:02.805811 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b28296-1d5a-4e3c-96e7-d5137c08c6a9 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:02.846844 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcbcc7-e3ec-49f2-8185-cb2a7f59541f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:02.847539 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcbcc7-e3ec-49f2-8185-cb2a7f59541f None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:02.847824 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcbcc7-e3ec-49f2-8185-cb2a7f59541f None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:02.848105 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcbcc7-e3ec-49f2-8185-cb2a7f59541f None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:02.848831 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcbcc7-e3ec-49f2-8185-cb2a7f59541f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:02.849135 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcbcc7-e3ec-49f2-8185-cb2a7f59541f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:02.850674 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcbcc7-e3ec-49f2-8185-cb2a7f59541f None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:02.861196 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 450/875] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:34:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:02.862355 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcbcc7-e3ec-49f2-8185-cb2a7f59541f None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:02.915836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bca94e-f1bb-4192-8126-a8c8c0996f19 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:02.956819 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709eda0-f7bf-4744-8613-111381a66729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:02.957950 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709eda0-f7bf-4744-8613-111381a66729 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:02.958458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709eda0-f7bf-4744-8613-111381a66729 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:02.958953 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709eda0-f7bf-4744-8613-111381a66729 None admin] PATH_INFO: `/v3/projects` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:02.959992 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709eda0-f7bf-4744-8613-111381a66729 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:02.960526 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709eda0-f7bf-4744-8613-111381a66729 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:02.962300 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709eda0-f7bf-4744-8613-111381a66729 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:02.974411 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcbcc7-e3ec-49f2-8185-cb2a7f59541f None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:02.981347 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 426/876] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:34:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:02.983114 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709eda0-f7bf-4744-8613-111381a66729 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:03.015193 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947be3e9-07fc-4099-8829-d325881d3493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:03.016560 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947be3e9-07fc-4099-8829-d325881d3493 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:03.016560 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947be3e9-07fc-4099-8829-d325881d3493 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:03.016560 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947be3e9-07fc-4099-8829-d325881d3493 None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:03.017258 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947be3e9-07fc-4099-8829-d325881d3493 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:03.017602 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947be3e9-07fc-4099-8829-d325881d3493 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:03.019019 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947be3e9-07fc-4099-8829-d325881d3493 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:03.033488 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 451/877] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:34:02 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:03.117227 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709eda0-f7bf-4744-8613-111381a66729 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:03.179437 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b760c-2e46-462d-9fdb-90154e3868db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:03.185439 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b760c-2e46-462d-9fdb-90154e3868db None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:03.185439 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b760c-2e46-462d-9fdb-90154e3868db None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:03.185439 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b760c-2e46-462d-9fdb-90154e3868db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:03.185439 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b760c-2e46-462d-9fdb-90154e3868db None admin] RBAC: Adding query filter params (role.id=b22352a378fb404d90e3b3ae182757ad, scope.project.id=db5768a93e754372808fc69f898cc853, user.id=8fcb1b0006d94847be30b28f17d041e3) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:03.185439 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b760c-2e46-462d-9fdb-90154e3868db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:03.186085 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b760c-2e46-462d-9fdb-90154e3868db None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:03.192957 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 427/878] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:34:02 2022] GET /identity/v3/role_assignments?user.id=8fcb1b0006d94847be30b28f17d041e3&scope.project.id=db5768a93e754372808fc69f898cc853&role.id=b22352a378fb404d90e3b3ae182757ad => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:03.585574 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9876a9b-d10a-4d95-9ffb-6ef721f46302 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:03.585922 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9876a9b-d10a-4d95-9ffb-6ef721f46302 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:03.586148 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9876a9b-d10a-4d95-9ffb-6ef721f46302 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:03.587912 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 452/879] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:03.593205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ada2d-66dd-49f5-8cb6-4ebef89ea040 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:03.593534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ada2d-66dd-49f5-8cb6-4ebef89ea040 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:03.594343 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ada2d-66dd-49f5-8cb6-4ebef89ea040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:03.611813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-6a1ada2d-66dd-49f5-8cb6-4ebef89ea040 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:03.613018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-6a1ada2d-66dd-49f5-8cb6-4ebef89ea040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:03.685179 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 428/880] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:03 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:03.707339 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9876a9b-d10a-4d95-9ffb-6ef721f46302 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:03.814118 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9876a9b-d10a-4d95-9ffb-6ef721f46302 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:03.856228 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afeccad-3353-438b-b298-2d350dc53fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:03.856821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afeccad-3353-438b-b298-2d350dc53fe1 None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:03.857102 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afeccad-3353-438b-b298-2d350dc53fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:03.857450 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afeccad-3353-438b-b298-2d350dc53fe1 None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:03.858193 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afeccad-3353-438b-b298-2d350dc53fe1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:03.859721 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afeccad-3353-438b-b298-2d350dc53fe1 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:03.875483 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 453/881] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:34:03 2022] POST /identity/v3/services => generated 269 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:34:04.452140 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57faf09b-bf7a-4732-8107-bcb0900f74d5 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:04.452725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57faf09b-bf7a-4732-8107-bcb0900f74d5 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:04.452725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57faf09b-bf7a-4732-8107-bcb0900f74d5 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:04.454567 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 429/882] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:04.460102 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f69d9-e997-49e8-a38b-ad0bb0ae0fa3 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:04.460548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f69d9-e997-49e8-a38b-ad0bb0ae0fa3 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:04.460725 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f69d9-e997-49e8-a38b-ad0bb0ae0fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:04.478914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-d12f69d9-e997-49e8-a38b-ad0bb0ae0fa3 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:04.480138 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-d12f69d9-e997-49e8-a38b-ad0bb0ae0fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:04.561665 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 454/883] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:04.583441 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57faf09b-bf7a-4732-8107-bcb0900f74d5 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:04.693592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57faf09b-bf7a-4732-8107-bcb0900f74d5 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:04.729085 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc21a6-b901-4cd7-b16c-5596214c01f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:04.729935 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc21a6-b901-4cd7-b16c-5596214c01f7 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:04.730221 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc21a6-b901-4cd7-b16c-5596214c01f7 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:04.730499 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc21a6-b901-4cd7-b16c-5596214c01f7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:04.731163 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc21a6-b901-4cd7-b16c-5596214c01f7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:04.732636 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc21a6-b901-4cd7-b16c-5596214c01f7 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:04.745537 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-3efc21a6-b901-4cd7-b16c-5596214c01f7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:34:04.745537 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:04.745537 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:34:04.745537 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:34:04.745537 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:34:04.745537 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:34:04.745537 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:34:04.745537 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:04.745537 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:34:04.745537 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:04.745537 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:34:04.745537 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:04.745537 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:04.745537 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:04.745537 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:04.745537 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:04.745537 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:04.747983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:04.747983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:04.747983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:04.747983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:04.747983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:04.747983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:04.747983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:34:04.747983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:34:04.747983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:34:04.747983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:34:04.747983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:04.747983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:04.747983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:04.747983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:04.747983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:04.747983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:04.750659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:04.750659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:04.750659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:04.750659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:04.750659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:04.750659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:04.750659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:04.750659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:04.750659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:04.750659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:04.750659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:34:04.750659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:04.750659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:34:04.750659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:04.752966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 430/884] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:34:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:04.757479 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f69d9-e997-49e8-a38b-ad0bb0ae0fa3 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:04.858806 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f69d9-e997-49e8-a38b-ad0bb0ae0fa3 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:04.896071 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60271200-06a0-4dc5-afe7-21c3f2c2f9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:04.897071 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60271200-06a0-4dc5-afe7-21c3f2c2f9cd None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:04.897595 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60271200-06a0-4dc5-afe7-21c3f2c2f9cd None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:04.898119 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60271200-06a0-4dc5-afe7-21c3f2c2f9cd None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:04.899052 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60271200-06a0-4dc5-afe7-21c3f2c2f9cd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:04.899586 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60271200-06a0-4dc5-afe7-21c3f2c2f9cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:04.901164 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60271200-06a0-4dc5-afe7-21c3f2c2f9cd None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:04.911690 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 455/885] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:34:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:04.913360 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc21a6-b901-4cd7-b16c-5596214c01f7 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:05.029819 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc21a6-b901-4cd7-b16c-5596214c01f7 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:05.070836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39953bb3-52ea-4ca0-8104-7dd404ebb10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:05.071829 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39953bb3-52ea-4ca0-8104-7dd404ebb10b None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:05.072311 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39953bb3-52ea-4ca0-8104-7dd404ebb10b None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:05.072798 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39953bb3-52ea-4ca0-8104-7dd404ebb10b None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:05.073751 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39953bb3-52ea-4ca0-8104-7dd404ebb10b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:05.074255 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39953bb3-52ea-4ca0-8104-7dd404ebb10b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:05.075838 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39953bb3-52ea-4ca0-8104-7dd404ebb10b None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:05.085509 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 431/886] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:34:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:05.088553 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60271200-06a0-4dc5-afe7-21c3f2c2f9cd None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:05.211925 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60271200-06a0-4dc5-afe7-21c3f2c2f9cd None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:05.252915 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fed50b-62c6-4009-b8d1-c9b01a575a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:05.254041 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fed50b-62c6-4009-b8d1-c9b01a575a18 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:05.254606 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fed50b-62c6-4009-b8d1-c9b01a575a18 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:05.255175 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fed50b-62c6-4009-b8d1-c9b01a575a18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:05.256233 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fed50b-62c6-4009-b8d1-c9b01a575a18 None admin] RBAC: Adding query filter params (interface=public, service_id=96b3433125ba49d484ebb307602b9976, region_id=RegionOne) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:05.256730 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fed50b-62c6-4009-b8d1-c9b01a575a18 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:05.258341 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fed50b-62c6-4009-b8d1-c9b01a575a18 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:05.265120 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 456/887] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:34:05 2022] GET /identity/v3/endpoints?service_id=96b3433125ba49d484ebb307602b9976&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:05.271540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39953bb3-52ea-4ca0-8104-7dd404ebb10b None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:05.384637 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39953bb3-52ea-4ca0-8104-7dd404ebb10b None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:05.422083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef06c7-9e5d-44a3-80ec-443cea7af9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:05.423476 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef06c7-9e5d-44a3-80ec-443cea7af9f5 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:05.423766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef06c7-9e5d-44a3-80ec-443cea7af9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:05.424055 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef06c7-9e5d-44a3-80ec-443cea7af9f5 None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:05.424764 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef06c7-9e5d-44a3-80ec-443cea7af9f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:05.426273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef06c7-9e5d-44a3-80ec-443cea7af9f5 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:05.433032 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 432/888] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:34:05 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:34:05.454394 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea670047-e523-47c0-991a-06ea42f755f3 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:05.454705 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea670047-e523-47c0-991a-06ea42f755f3 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:05.455103 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea670047-e523-47c0-991a-06ea42f755f3 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:05.456902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 457/889] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:05.462922 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819d351-bb13-4a03-ab2b-55c4b21c0469 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:05.463447 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819d351-bb13-4a03-ab2b-55c4b21c0469 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:05.463447 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819d351-bb13-4a03-ab2b-55c4b21c0469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:05.481813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-d819d351-bb13-4a03-ab2b-55c4b21c0469 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:05.483024 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-d819d351-bb13-4a03-ab2b-55c4b21c0469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:05.570870 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 433/890] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:05.594623 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea670047-e523-47c0-991a-06ea42f755f3 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:05.705673 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea670047-e523-47c0-991a-06ea42f755f3 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:05.743466 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99526c-b912-4771-aa0b-d5c4254c27e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:05.744166 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99526c-b912-4771-aa0b-d5c4254c27e4 None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:05.744454 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99526c-b912-4771-aa0b-d5c4254c27e4 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:05.744735 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99526c-b912-4771-aa0b-d5c4254c27e4 None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:05.745823 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99526c-b912-4771-aa0b-d5c4254c27e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:05.747393 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99526c-b912-4771-aa0b-d5c4254c27e4 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:05.758515 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba88f8-d43f-44d8-af1a-05067e7353f6 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:05.759173 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba88f8-d43f-44d8-af1a-05067e7353f6 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:05.759683 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba88f8-d43f-44d8-af1a-05067e7353f6 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:05.761855 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 434/891] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:05.765480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 458/892] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:34:05 2022] POST /identity/v3/services => generated 241 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:34:05.768613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f832c-9163-4660-8d09-455458fe0810 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:05.769262 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f832c-9163-4660-8d09-455458fe0810 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:05.769880 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f832c-9163-4660-8d09-455458fe0810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:05.796524 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-cb8f832c-9163-4660-8d09-455458fe0810 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:05.799237 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-cb8f832c-9163-4660-8d09-455458fe0810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:05.888717 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 435/893] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:05.913519 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99526c-b912-4771-aa0b-d5c4254c27e4 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:06.025457 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99526c-b912-4771-aa0b-d5c4254c27e4 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:06.060836 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09b2bd-5b62-4632-8a5f-3e1841b38cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:06.061686 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09b2bd-5b62-4632-8a5f-3e1841b38cbc None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:06.061968 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09b2bd-5b62-4632-8a5f-3e1841b38cbc None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:06.062243 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09b2bd-5b62-4632-8a5f-3e1841b38cbc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:06.073361 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09b2bd-5b62-4632-8a5f-3e1841b38cbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:34:06.082002 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-bc09b2bd-5b62-4632-8a5f-3e1841b38cbc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:34:06.082002 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:06.082002 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:06.082002 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:06.082002 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:06.082002 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:06.082002 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:06.082002 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:06.082002 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:06.082002 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:06.082002 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:06.082002 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:06.082002 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:34:06.082002 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:34:06.082002 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:34:06.082002 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:34:06.083063 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:34:06.083063 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:34:06.083063 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:34:06.083063 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:34:06.083063 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:06.083063 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:06.083063 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:06.083063 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:06.083063 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:06.083063 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:06.083063 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:06.083063 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:06.083063 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:06.083063 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:06.083063 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:06.083063 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:06.083984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:06.083984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:06.083984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:06.083984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:06.083984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:34:06.083984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:34:06.083984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:34:06.083984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:34:06.083984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:34:06.083984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:34:06.083984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:34:06.083984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:06.083984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 459/894] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 9 15:34:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:06.091451 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f832c-9163-4660-8d09-455458fe0810 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:06.214110 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f832c-9163-4660-8d09-455458fe0810 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:06.252111 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65f5bd-cdd9-4c83-a419-404e7fabc370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:06.253196 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65f5bd-cdd9-4c83-a419-404e7fabc370 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:06.253733 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65f5bd-cdd9-4c83-a419-404e7fabc370 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:06.254218 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65f5bd-cdd9-4c83-a419-404e7fabc370 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:06.255180 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65f5bd-cdd9-4c83-a419-404e7fabc370 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:06.255711 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65f5bd-cdd9-4c83-a419-404e7fabc370 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:06.257328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65f5bd-cdd9-4c83-a419-404e7fabc370 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:06.266782 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 436/895] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:34:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:06.272748 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09b2bd-5b62-4632-8a5f-3e1841b38cbc None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:06.334062 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea850d9-8881-40e0-889e-59bf65384dd9 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:06.334263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea850d9-8881-40e0-889e-59bf65384dd9 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:06.334548 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea850d9-8881-40e0-889e-59bf65384dd9 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:06.336262 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 437/896] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:34:06.341819 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80c78e-4ddb-494b-9daa-4d2c39415a7e None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:06.342130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80c78e-4ddb-494b-9daa-4d2c39415a7e None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:06.342417 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80c78e-4ddb-494b-9daa-4d2c39415a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:06.362352 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-aa80c78e-4ddb-494b-9daa-4d2c39415a7e None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:06.363608 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-aa80c78e-4ddb-494b-9daa-4d2c39415a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:06.393075 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09b2bd-5b62-4632-8a5f-3e1841b38cbc None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:06.437747 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfc0b4-a9d3-4e0a-b11d-4a4864b6459a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:06.438959 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfc0b4-a9d3-4e0a-b11d-4a4864b6459a None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:06.439450 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfc0b4-a9d3-4e0a-b11d-4a4864b6459a None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:06.439939 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfc0b4-a9d3-4e0a-b11d-4a4864b6459a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:06.441514 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 438/897] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:34:06.456744 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cfc0b4-a9d3-4e0a-b11d-4a4864b6459a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:06.458593 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cfc0b4-a9d3-4e0a-b11d-4a4864b6459a None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:06.461763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80c78e-4ddb-494b-9daa-4d2c39415a7e None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:06.481526 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-57cfc0b4-a9d3-4e0a-b11d-4a4864b6459a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:06.481526 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:06.481526 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:06.481526 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:06.481526 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:06.481526 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:06.481526 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:06.481526 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:06.481526 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:06.481526 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:06.481526 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:06.481526 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:06.481526 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:34:06.481526 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:34:06.481526 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:34:06.482582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:34:06.482582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:06.482582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:06.482582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:06.482582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:06.482582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:06.482582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:06.482582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:06.482582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:06.482582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:06.482582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:06.482582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:06.482582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:06.482582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:06.482582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:06.482582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:06.482582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:06.483561 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:34:06.483561 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:34:06.483561 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:06.483561 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:06.489595 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 460/898] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:06.491865 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfc0b4-a9d3-4e0a-b11d-4a4864b6459a None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:06.593268 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80c78e-4ddb-494b-9daa-4d2c39415a7e None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:06.607502 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfc0b4-a9d3-4e0a-b11d-4a4864b6459a None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:06.644859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f58aa9-775e-4b78-b9fb-c3892f5ba499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:06.645593 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f58aa9-775e-4b78-b9fb-c3892f5ba499 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:06.645924 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f58aa9-775e-4b78-b9fb-c3892f5ba499 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:06.646208 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f58aa9-775e-4b78-b9fb-c3892f5ba499 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:06.646779 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613c58e-bcb9-4a79-81bb-979b376d3c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:06.646924 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f58aa9-775e-4b78-b9fb-c3892f5ba499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:06.647242 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f58aa9-775e-4b78-b9fb-c3892f5ba499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:06.648178 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613c58e-bcb9-4a79-81bb-979b376d3c17 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:06.648623 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f58aa9-775e-4b78-b9fb-c3892f5ba499 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:06.648870 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613c58e-bcb9-4a79-81bb-979b376d3c17 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:06.649354 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613c58e-bcb9-4a79-81bb-979b376d3c17 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:06.650247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613c58e-bcb9-4a79-81bb-979b376d3c17 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:06.651823 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613c58e-bcb9-4a79-81bb-979b376d3c17 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:06.667074 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 461/899] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:06.668545 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-6613c58e-bcb9-4a79-81bb-979b376d3c17 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:34:06.668545 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:06.668545 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:34:06.668545 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:34:06.668545 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:34:06.668545 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:34:06.668545 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:34:06.668545 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:06.668545 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:34:06.668545 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:06.668545 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:34:06.668545 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:06.668545 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:06.668545 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:06.668545 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:06.668545 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:06.669592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:06.669592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:06.669592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:06.669592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:06.669592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:06.669592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:06.669592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:06.669592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:34:06.669592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:34:06.669592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:34:06.669592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:34:06.669592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:06.669592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:06.669592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:06.669592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:06.669592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:06.670527 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:06.670527 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:06.670527 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:06.670527 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:06.670527 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:06.670527 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:06.670527 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:06.670527 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:06.670527 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:06.670527 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:06.670527 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:06.670527 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:34:06.670527 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:06.670527 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:34:06.670527 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:06.672648 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f58aa9-775e-4b78-b9fb-c3892f5ba499 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:06.675521 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 439/900] 10.222.0.48 () {56 vars in 1132 bytes} [Mon May 9 15:34:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:34:06.678055 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613c58e-bcb9-4a79-81bb-979b376d3c17 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:06.797530 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f58aa9-775e-4b78-b9fb-c3892f5ba499 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:06.801536 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613c58e-bcb9-4a79-81bb-979b376d3c17 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:06.836540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8bc5f-c790-43b6-8b2a-bfdd69026da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:06.837460 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8bc5f-c790-43b6-8b2a-bfdd69026da0 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:06.837855 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8bc5f-c790-43b6-8b2a-bfdd69026da0 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:06.838162 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8bc5f-c790-43b6-8b2a-bfdd69026da0 None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:06.838952 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8bc5f-c790-43b6-8b2a-bfdd69026da0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:06.839335 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8bc5f-c790-43b6-8b2a-bfdd69026da0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:06.840802 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8bc5f-c790-43b6-8b2a-bfdd69026da0 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:06.843159 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e60469-56c7-4ad9-ae41-a158fed164e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:06.844731 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e60469-56c7-4ad9-ae41-a158fed164e8 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:06.845213 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e60469-56c7-4ad9-ae41-a158fed164e8 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:06.845696 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e60469-56c7-4ad9-ae41-a158fed164e8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:06.850918 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 440/901] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:34:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:06.851995 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8bc5f-c790-43b6-8b2a-bfdd69026da0 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:06.860281 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e60469-56c7-4ad9-ae41-a158fed164e8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:06.861816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e60469-56c7-4ad9-ae41-a158fed164e8 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:06.877973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-47e60469-56c7-4ad9-ae41-a158fed164e8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:34:06.877973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:06.877973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:06.877973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:06.877973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:06.877973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:06.877973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:06.877973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:06.877973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:06.877973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:06.877973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:06.877973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:06.877973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:34:06.877973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:34:06.877973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:34:06.877973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:34:06.879168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:06.879168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:06.879168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:34:06.879168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:34:06.879168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:34:06.879168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:34:06.879168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:06.879168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:06.879168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:06.879168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:06.879168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:06.879168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:06.879168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:06.879168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:06.879168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:06.879168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:06.879168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:06.879168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:06.880210 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:06.880210 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:06.880210 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:34:06.880210 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:34:06.880210 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:34:06.880210 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:34:06.880210 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:34:06.880210 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:34:06.880210 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:34:06.880210 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:06.884196 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 462/902] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:34:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:06.885594 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e60469-56c7-4ad9-ae41-a158fed164e8 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:06.982359 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8bc5f-c790-43b6-8b2a-bfdd69026da0 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:07.001605 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e60469-56c7-4ad9-ae41-a158fed164e8 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:07.022423 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c992e3-0cf6-44a6-8b3b-f8741152ddca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:07.023124 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c992e3-0cf6-44a6-8b3b-f8741152ddca None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:07.023410 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c992e3-0cf6-44a6-8b3b-f8741152ddca None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:07.023688 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c992e3-0cf6-44a6-8b3b-f8741152ddca None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:07.024501 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c992e3-0cf6-44a6-8b3b-f8741152ddca None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:07.024721 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c992e3-0cf6-44a6-8b3b-f8741152ddca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:07.026269 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c992e3-0cf6-44a6-8b3b-f8741152ddca None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:07.033421 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 441/903] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:34:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:07.039324 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c992e3-0cf6-44a6-8b3b-f8741152ddca None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:07.053411 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3666b6-9509-42fe-b248-70b5d10f7279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:07.053636 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3666b6-9509-42fe-b248-70b5d10f7279 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:07.054392 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3666b6-9509-42fe-b248-70b5d10f7279 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:07.054392 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3666b6-9509-42fe-b248-70b5d10f7279 None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:07.055046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3666b6-9509-42fe-b248-70b5d10f7279 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:07.055362 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3666b6-9509-42fe-b248-70b5d10f7279 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:07.056851 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3666b6-9509-42fe-b248-70b5d10f7279 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:07.076563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 463/904] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 9 15:34:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:07.082796 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3666b6-9509-42fe-b248-70b5d10f7279 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:07.199448 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c992e3-0cf6-44a6-8b3b-f8741152ddca None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:07.236942 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3666b6-9509-42fe-b248-70b5d10f7279 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:07.238195 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181eeb0a-36eb-4350-b34c-6505d1c86f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:07.239151 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181eeb0a-36eb-4350-b34c-6505d1c86f5e None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:07.239647 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181eeb0a-36eb-4350-b34c-6505d1c86f5e None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:07.240135 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181eeb0a-36eb-4350-b34c-6505d1c86f5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:07.241159 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181eeb0a-36eb-4350-b34c-6505d1c86f5e None admin] RBAC: Adding query filter params (interface=public, service_id=ecb37bb9fae445208c0bb90897f4c5dc, region_id=RegionOne) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:07.241710 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181eeb0a-36eb-4350-b34c-6505d1c86f5e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:07.243381 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181eeb0a-36eb-4350-b34c-6505d1c86f5e None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:07.254658 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 442/905] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:34:07 2022] GET /identity/v3/endpoints?service_id=ecb37bb9fae445208c0bb90897f4c5dc&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:07.256045 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181eeb0a-36eb-4350-b34c-6505d1c86f5e None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:07.287542 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f67ca-f722-4cd3-be52-a6804f9e2f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:07.288641 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f67ca-f722-4cd3-be52-a6804f9e2f3c None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:07.288980 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f67ca-f722-4cd3-be52-a6804f9e2f3c None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:07.289268 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f67ca-f722-4cd3-be52-a6804f9e2f3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:07.372940 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181eeb0a-36eb-4350-b34c-6505d1c86f5e None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:07.387849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698f67ca-f722-4cd3-be52-a6804f9e2f3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:07.389669 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698f67ca-f722-4cd3-be52-a6804f9e2f3c None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:07.412317 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4df65-c3ef-4466-a40c-e782d717d5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:07.413431 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4df65-c3ef-4466-a40c-e782d717d5b6 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:07.413959 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4df65-c3ef-4466-a40c-e782d717d5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:07.414698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4df65-c3ef-4466-a40c-e782d717d5b6 None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:07.415694 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb4df65-c3ef-4466-a40c-e782d717d5b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:07.417402 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb4df65-c3ef-4466-a40c-e782d717d5b6 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:07.429844 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 443/906] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:34:07 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:34:07.533600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 464/907] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:34:07 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:34:07.535677 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4df65-c3ef-4466-a40c-e782d717d5b6 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:07.664636 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4df65-c3ef-4466-a40c-e782d717d5b6 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:07.708029 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb986852-2ec8-430d-962f-150198fbcda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:07.708859 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb986852-2ec8-430d-962f-150198fbcda0 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:07.709146 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb986852-2ec8-430d-962f-150198fbcda0 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:07.709491 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb986852-2ec8-430d-962f-150198fbcda0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:07.722359 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb986852-2ec8-430d-962f-150198fbcda0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:07.723903 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb986852-2ec8-430d-962f-150198fbcda0 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:07.744050 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-fb986852-2ec8-430d-962f-150198fbcda0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:07.744050 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:07.744050 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:07.744050 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:07.744050 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:07.744050 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:07.744050 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:07.744050 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:07.744050 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:07.744050 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:07.744050 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:07.744050 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:07.744050 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:34:07.744050 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:34:07.744050 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:34:07.745836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:34:07.745836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:07.745836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:07.745836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:07.745836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:07.745836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:07.745836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:07.745836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:07.745836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:07.745836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:07.745836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:07.745836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:07.745836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:07.745836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:07.745836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:07.745836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:07.745836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:07.747512 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:34:07.747512 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:34:07.747512 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:07.747512 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:07.751511 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 444/908] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:07.752883 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f67ca-f722-4cd3-be52-a6804f9e2f3c None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:07.861820 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f67ca-f722-4cd3-be52-a6804f9e2f3c None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:07.900746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f3e60-3834-4616-9b5c-31439270db66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:07.901461 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f3e60-3834-4616-9b5c-31439270db66 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:07.901747 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f3e60-3834-4616-9b5c-31439270db66 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:07.902029 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f3e60-3834-4616-9b5c-31439270db66 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:07.902767 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f3e60-3834-4616-9b5c-31439270db66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:07.903070 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f3e60-3834-4616-9b5c-31439270db66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:07.904463 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f3e60-3834-4616-9b5c-31439270db66 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:07.921729 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 465/909] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:07.923902 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb986852-2ec8-430d-962f-150198fbcda0 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:07.935160 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258db928-5d9c-43fd-abd7-2cf57b915234 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:07.935489 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258db928-5d9c-43fd-abd7-2cf57b915234 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:07.935725 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258db928-5d9c-43fd-abd7-2cf57b915234 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:07.938404 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 466/910] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:07.944290 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e47dd0-0b46-45d1-a533-661f20817a63 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:07.944588 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e47dd0-0b46-45d1-a533-661f20817a63 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:07.944863 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e47dd0-0b46-45d1-a533-661f20817a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:07.966925 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-d1e47dd0-0b46-45d1-a533-661f20817a63 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:07.970407 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-d1e47dd0-0b46-45d1-a533-661f20817a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:08.073558 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 467/911] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:34:08.081104 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb986852-2ec8-430d-962f-150198fbcda0 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:08.095743 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e47dd0-0b46-45d1-a533-661f20817a63 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:08.130068 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5739c58-b2ff-437a-9741-91aad9a56890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:08.131289 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5739c58-b2ff-437a-9741-91aad9a56890 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:08.131827 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5739c58-b2ff-437a-9741-91aad9a56890 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:08.132394 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5739c58-b2ff-437a-9741-91aad9a56890 None admin] PATH_INFO: `/v3/projects/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:08.140604 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5739c58-b2ff-437a-9741-91aad9a56890 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:08.142498 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5739c58-b2ff-437a-9741-91aad9a56890 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:08.158796 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-d5739c58-b2ff-437a-9741-91aad9a56890 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:34:08.158796 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:08.158796 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:08.158796 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:08.158796 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:08.158796 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:08.158796 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:08.158796 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:08.158796 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:08.158796 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:08.158796 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:08.158796 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:08.158796 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:34:08.158796 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:34:08.158796 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:34:08.159836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:34:08.159836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:08.159836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:08.159836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:08.159836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:08.159836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:08.159836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:08.159836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:08.159836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:08.159836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:08.159836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:08.159836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:08.159836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:08.159836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:08.159836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:08.159836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:08.159836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:08.160821 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:34:08.160821 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:34:08.160821 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:34:08.160821 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:34:08.160821 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:34:08.160821 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:34:08.160821 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:34:08.160821 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:08.163484 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 445/912] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:34:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:08.169504 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5739c58-b2ff-437a-9741-91aad9a56890 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:08.217528 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e47dd0-0b46-45d1-a533-661f20817a63 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:08.267087 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268a720-ecc2-4446-b485-d82430731dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:08.267955 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268a720-ecc2-4446-b485-d82430731dc3 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:08.268240 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268a720-ecc2-4446-b485-d82430731dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:08.268524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268a720-ecc2-4446-b485-d82430731dc3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:08.269192 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268a720-ecc2-4446-b485-d82430731dc3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:08.270635 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268a720-ecc2-4446-b485-d82430731dc3 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:08.280783 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5739c58-b2ff-437a-9741-91aad9a56890 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:08.283801 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-e268a720-ecc2-4446-b485-d82430731dc3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:34:08.283801 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:08.283801 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:34:08.283801 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:34:08.283801 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:34:08.283801 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:34:08.283801 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:34:08.283801 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:08.283801 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:34:08.283801 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:08.283801 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:34:08.283801 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:08.283801 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:08.283801 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:08.283801 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:08.283801 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:08.283801 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:08.285347 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:08.285347 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:08.285347 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:08.285347 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:08.285347 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:08.285347 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:08.285347 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:34:08.285347 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:34:08.285347 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:34:08.285347 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:34:08.285347 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:08.285347 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:08.285347 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:08.285347 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:08.285347 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:08.285347 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:08.287901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:08.287901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:08.287901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:08.287901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:08.287901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:08.287901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:08.287901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:08.287901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:08.287901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:08.287901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:08.287901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:34:08.287901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:08.287901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:34:08.287901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:08.287901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 468/913] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:34:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:08.290724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9a5a9-bcb0-4a09-95fe-de31e3b07e85 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:08.290724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9a5a9-bcb0-4a09-95fe-de31e3b07e85 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:08.290724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9a5a9-bcb0-4a09-95fe-de31e3b07e85 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:08.292649 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 469/914] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:08.293403 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9a5a9-bcb0-4a09-95fe-de31e3b07e85 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:08.335849 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90c93a-21d8-4b0c-b3e7-491af3fc95df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:08.336528 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90c93a-21d8-4b0c-b3e7-491af3fc95df None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:08.336805 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90c93a-21d8-4b0c-b3e7-491af3fc95df None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:08.337091 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90c93a-21d8-4b0c-b3e7-491af3fc95df None admin] PATH_INFO: `/v3/projects` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:08.338273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90c93a-21d8-4b0c-b3e7-491af3fc95df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:08.338273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90c93a-21d8-4b0c-b3e7-491af3fc95df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:08.339744 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90c93a-21d8-4b0c-b3e7-491af3fc95df None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:08.356517 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 446/915] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:34:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:08.357716 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475abc6b-fe52-473d-bf23-4115521b8865 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:08.358019 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475abc6b-fe52-473d-bf23-4115521b8865 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:08.358306 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475abc6b-fe52-473d-bf23-4115521b8865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:08.376714 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-475abc6b-fe52-473d-bf23-4115521b8865 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:08.377975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-475abc6b-fe52-473d-bf23-4115521b8865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:08.448456 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9a5a9-bcb0-4a09-95fe-de31e3b07e85 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:08.461425 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 447/916] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:08.462268 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475abc6b-fe52-473d-bf23-4115521b8865 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:08.503691 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a829f-6dff-463d-9e87-58a32a520fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:08.505201 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a829f-6dff-463d-9e87-58a32a520fa1 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:08.505697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a829f-6dff-463d-9e87-58a32a520fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:08.506446 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a829f-6dff-463d-9e87-58a32a520fa1 None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:08.507600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a829f-6dff-463d-9e87-58a32a520fa1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:08.508415 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a829f-6dff-463d-9e87-58a32a520fa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:08.510470 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a829f-6dff-463d-9e87-58a32a520fa1 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:08.522123 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 470/917] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:34:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:08.523677 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a829f-6dff-463d-9e87-58a32a520fa1 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:08.615303 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475abc6b-fe52-473d-bf23-4115521b8865 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:08.661754 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76106fe2-62c8-4b1d-8568-35743f0453ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:08.662428 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76106fe2-62c8-4b1d-8568-35743f0453ee None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:08.662714 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76106fe2-62c8-4b1d-8568-35743f0453ee None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:08.662996 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76106fe2-62c8-4b1d-8568-35743f0453ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:08.663851 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76106fe2-62c8-4b1d-8568-35743f0453ee None admin] RBAC: Adding query filter params (role.id=61a5e0d3dab54d758c4f70299c19f603, scope.project.id=db5768a93e754372808fc69f898cc853, user.id=8fcb1b0006d94847be30b28f17d041e3) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:08.663966 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a829f-6dff-463d-9e87-58a32a520fa1 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:08.664167 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76106fe2-62c8-4b1d-8568-35743f0453ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:08.665661 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76106fe2-62c8-4b1d-8568-35743f0453ee None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:08.681811 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 448/918] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:34:08 2022] GET /identity/v3/role_assignments?user.id=8fcb1b0006d94847be30b28f17d041e3&scope.project.id=db5768a93e754372808fc69f898cc853&role.id=61a5e0d3dab54d758c4f70299c19f603 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:08.681811 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76106fe2-62c8-4b1d-8568-35743f0453ee None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:08.723990 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df860298-97d4-4a90-bc39-95bffbd03135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:08.724845 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df860298-97d4-4a90-bc39-95bffbd03135 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:08.725396 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df860298-97d4-4a90-bc39-95bffbd03135 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:08.725763 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df860298-97d4-4a90-bc39-95bffbd03135 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:08.726937 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df860298-97d4-4a90-bc39-95bffbd03135 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:08.728891 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df860298-97d4-4a90-bc39-95bffbd03135 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:08.746344 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-df860298-97d4-4a90-bc39-95bffbd03135 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:34:08.746344 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:08.746344 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:34:08.746344 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:34:08.746344 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:34:08.746344 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:34:08.746344 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:34:08.746344 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:08.746344 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:34:08.746344 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:08.746344 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:34:08.746344 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:08.746344 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:08.746344 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:08.746344 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:08.746344 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:08.746344 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:08.747524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:08.747524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:08.747524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:08.747524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:08.747524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:08.747524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:08.747524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:34:08.747524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:34:08.747524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:34:08.747524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:34:08.747524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:08.747524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:08.747524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:08.747524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:08.747524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:08.747524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:08.748439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:08.748439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:08.748439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:08.748439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:08.748439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:08.748439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:08.748439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:08.748439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:08.748439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:08.748439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:08.748439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:34:08.748439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:08.748439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:34:08.748439 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:08.753742 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 471/919] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:34:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:08.756435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df860298-97d4-4a90-bc39-95bffbd03135 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:08.836683 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76106fe2-62c8-4b1d-8568-35743f0453ee None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:08.877754 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128fb91-3772-4bdf-ab54-abd433497221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:08.878474 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128fb91-3772-4bdf-ab54-abd433497221 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:08.878770 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128fb91-3772-4bdf-ab54-abd433497221 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:08.879040 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128fb91-3772-4bdf-ab54-abd433497221 None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:08.879776 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128fb91-3772-4bdf-ab54-abd433497221 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:08.880079 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128fb91-3772-4bdf-ab54-abd433497221 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:08.882971 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128fb91-3772-4bdf-ab54-abd433497221 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:08.888139 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 449/920] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:34:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:08.895413 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128fb91-3772-4bdf-ab54-abd433497221 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:08.911674 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df860298-97d4-4a90-bc39-95bffbd03135 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:08.969612 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce27f2-3e54-434a-82f5-a701263ebd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:08.971037 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce27f2-3e54-434a-82f5-a701263ebd4e None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:08.971532 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce27f2-3e54-434a-82f5-a701263ebd4e None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:08.972001 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce27f2-3e54-434a-82f5-a701263ebd4e None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:08.972919 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce27f2-3e54-434a-82f5-a701263ebd4e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:08.973624 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce27f2-3e54-434a-82f5-a701263ebd4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:08.976775 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce27f2-3e54-434a-82f5-a701263ebd4e None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:08.987765 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 472/921] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:34:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:08.995846 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce27f2-3e54-434a-82f5-a701263ebd4e None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:09.043938 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128fb91-3772-4bdf-ab54-abd433497221 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:09.090608 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd47f0-b7be-485e-b65d-8f2b966c0e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:09.091690 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd47f0-b7be-485e-b65d-8f2b966c0e4a None admin] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:09.092189 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd47f0-b7be-485e-b65d-8f2b966c0e4a None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:09.092656 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd47f0-b7be-485e-b65d-8f2b966c0e4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:09.094258 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd47f0-b7be-485e-b65d-8f2b966c0e4a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:09.096249 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd47f0-b7be-485e-b65d-8f2b966c0e4a None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:09.133646 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 450/922] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:34:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:34:09.150020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce27f2-3e54-434a-82f5-a701263ebd4e None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:09.215746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff78d7-161a-437b-a651-90227612cbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:09.216529 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff78d7-161a-437b-a651-90227612cbb0 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:09.216849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff78d7-161a-437b-a651-90227612cbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:09.217156 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff78d7-161a-437b-a651-90227612cbb0 None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:09.218125 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff78d7-161a-437b-a651-90227612cbb0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:09.218636 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff78d7-161a-437b-a651-90227612cbb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:09.221387 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff78d7-161a-437b-a651-90227612cbb0 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:09.234934 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 473/923] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:34:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:09.239522 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd47f0-b7be-485e-b65d-8f2b966c0e4a None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:09.380120 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd47f0-b7be-485e-b65d-8f2b966c0e4a None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:09.418772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b3245-1381-471f-9f21-8a02bffd80fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:09.418772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b3245-1381-471f-9f21-8a02bffd80fc None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:09.419087 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b3245-1381-471f-9f21-8a02bffd80fc None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:09.419313 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b3245-1381-471f-9f21-8a02bffd80fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:09.420181 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b3245-1381-471f-9f21-8a02bffd80fc None admin] RBAC: Adding query filter params (interface=public, service_id=5571931aa73b43c4bf7375324ebcad6c, region_id=RegionOne) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:09.420504 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b3245-1381-471f-9f21-8a02bffd80fc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:09.422103 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b3245-1381-471f-9f21-8a02bffd80fc None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:09.428266 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 451/924] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:34:09 2022] GET /identity/v3/endpoints?service_id=5571931aa73b43c4bf7375324ebcad6c&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:09.434690 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff78d7-161a-437b-a651-90227612cbb0 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:09.552131 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff78d7-161a-437b-a651-90227612cbb0 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:09.591529 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6af42b-f53e-4c3b-98bd-18966c24d6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:09.592603 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6af42b-f53e-4c3b-98bd-18966c24d6df None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:09.593134 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6af42b-f53e-4c3b-98bd-18966c24d6df None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:09.594198 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6af42b-f53e-4c3b-98bd-18966c24d6df None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:09.595793 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6af42b-f53e-4c3b-98bd-18966c24d6df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:09.597576 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6af42b-f53e-4c3b-98bd-18966c24d6df None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:09.604778 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 474/925] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:34:09 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:34:09.941956 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3acb77-09aa-4941-ba2c-1989f2345dc0 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:09.942472 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3acb77-09aa-4941-ba2c-1989f2345dc0 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:09.942557 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3acb77-09aa-4941-ba2c-1989f2345dc0 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:09.944137 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 452/926] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:09.950029 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eeadac-7154-4193-a43b-03d40d3ea234 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:09.950922 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eeadac-7154-4193-a43b-03d40d3ea234 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:09.951443 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eeadac-7154-4193-a43b-03d40d3ea234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:09.970519 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-f7eeadac-7154-4193-a43b-03d40d3ea234 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:09.972121 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-f7eeadac-7154-4193-a43b-03d40d3ea234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:10.068366 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 475/927] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:10.093004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3acb77-09aa-4941-ba2c-1989f2345dc0 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:10.236162 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3acb77-09aa-4941-ba2c-1989f2345dc0 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:10.275217 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d737d-441e-4d31-af4f-7a956568d6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:10.276049 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d737d-441e-4d31-af4f-7a956568d6b4 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:10.276334 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d737d-441e-4d31-af4f-7a956568d6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:10.276632 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d737d-441e-4d31-af4f-7a956568d6b4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:10.277278 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d737d-441e-4d31-af4f-7a956568d6b4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:10.278707 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d737d-441e-4d31-af4f-7a956568d6b4 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:10.292091 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-6f1d737d-441e-4d31-af4f-7a956568d6b4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:34:10.292091 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:10.292091 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:34:10.292091 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:34:10.292091 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:34:10.292091 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:34:10.292091 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:34:10.292091 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:10.292091 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:34:10.292091 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:10.292091 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:34:10.292091 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:10.292091 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:10.292091 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:10.292091 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:10.292091 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:10.293190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:10.293190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:10.293190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:10.293190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:10.293190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:10.293190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:10.293190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:10.293190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:34:10.293190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:34:10.293190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:34:10.293190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:34:10.293190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:10.293190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:10.293190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:10.293190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:10.293190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:10.294620 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:10.294620 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:10.294620 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:10.294620 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:10.294620 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:10.294620 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:10.294620 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:10.294620 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:10.294620 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:10.294620 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:10.294620 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:10.294620 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:34:10.294620 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:10.294620 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:34:10.294620 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:10.294620 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 453/928] 10.222.0.48 () {56 vars in 1132 bytes} [Mon May 9 15:34:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:10.302210 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eeadac-7154-4193-a43b-03d40d3ea234 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:10.424098 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eeadac-7154-4193-a43b-03d40d3ea234 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:10.475152 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ec397-4b1a-48bb-9085-963fddf4ee83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:10.475830 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ec397-4b1a-48bb-9085-963fddf4ee83 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:10.476181 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ec397-4b1a-48bb-9085-963fddf4ee83 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:10.476565 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ec397-4b1a-48bb-9085-963fddf4ee83 None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:10.477618 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ec397-4b1a-48bb-9085-963fddf4ee83 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:10.478068 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ec397-4b1a-48bb-9085-963fddf4ee83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:10.480087 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ec397-4b1a-48bb-9085-963fddf4ee83 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:10.486831 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 476/929] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:34:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:10.494291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d737d-441e-4d31-af4f-7a956568d6b4 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:10.617185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d737d-441e-4d31-af4f-7a956568d6b4 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:10.664941 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952941f-a813-4435-9be4-59f763a07246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:10.666035 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952941f-a813-4435-9be4-59f763a07246 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:10.666561 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952941f-a813-4435-9be4-59f763a07246 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:10.667063 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952941f-a813-4435-9be4-59f763a07246 None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:10.668022 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952941f-a813-4435-9be4-59f763a07246 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:10.668553 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952941f-a813-4435-9be4-59f763a07246 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:10.670190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952941f-a813-4435-9be4-59f763a07246 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:10.677659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 454/930] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:34:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:10.683389 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ec397-4b1a-48bb-9085-963fddf4ee83 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:10.809435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ec397-4b1a-48bb-9085-963fddf4ee83 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:10.848309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8baa95-a12c-4a83-a120-e431d24d6723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:10.848982 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8baa95-a12c-4a83-a120-e431d24d6723 None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:10.849267 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8baa95-a12c-4a83-a120-e431d24d6723 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:10.849577 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8baa95-a12c-4a83-a120-e431d24d6723 None admin] PATH_INFO: `/v3/endpoints` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:10.850333 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8baa95-a12c-4a83-a120-e431d24d6723 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:10.852066 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8baa95-a12c-4a83-a120-e431d24d6723 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:10.878118 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 477/931] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:34:10 2022] POST /identity/v3/endpoints => generated 347 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:34:11.227445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb86eae-5143-43d5-9692-35f820b2d11e None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:11.228325 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb86eae-5143-43d5-9692-35f820b2d11e None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:11.228795 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb86eae-5143-43d5-9692-35f820b2d11e None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:11.230623 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 455/932] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:11.237261 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951e674-1c89-4b1c-be4b-3f0b8a594716 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:11.238216 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951e674-1c89-4b1c-be4b-3f0b8a594716 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:11.238733 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951e674-1c89-4b1c-be4b-3f0b8a594716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:11.257131 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-2951e674-1c89-4b1c-be4b-3f0b8a594716 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:11.258761 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-2951e674-1c89-4b1c-be4b-3f0b8a594716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:11.339517 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 478/933] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:11.364415 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb86eae-5143-43d5-9692-35f820b2d11e None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:11.486026 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb86eae-5143-43d5-9692-35f820b2d11e None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:11.538369 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d917e60-9a82-4f6a-8e0a-2b274eaade89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:11.539662 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d917e60-9a82-4f6a-8e0a-2b274eaade89 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:11.540101 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d917e60-9a82-4f6a-8e0a-2b274eaade89 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:11.540523 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d917e60-9a82-4f6a-8e0a-2b274eaade89 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:11.557963 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d917e60-9a82-4f6a-8e0a-2b274eaade89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:34:11.573932 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-2d917e60-9a82-4f6a-8e0a-2b274eaade89 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:34:11.573932 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:11.573932 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:11.573932 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:11.573932 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:11.573932 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:11.573932 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:11.573932 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:11.573932 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:11.573932 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:11.573932 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:11.573932 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:11.573932 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:34:11.573932 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:34:11.573932 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:34:11.573932 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:34:11.575031 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:34:11.575031 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:34:11.575031 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:34:11.575031 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:34:11.575031 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:11.575031 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:11.575031 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:11.575031 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:11.575031 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:11.575031 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:11.575031 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:11.575031 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:11.575031 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:11.575031 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:11.575031 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:11.575031 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:11.576079 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:11.576079 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:11.576079 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:11.576079 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:11.576079 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:34:11.576079 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:34:11.576079 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:34:11.576079 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:34:11.576079 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:34:11.576079 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:34:11.576079 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:34:11.576079 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:11.576788 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 456/934] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 9 15:34:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:11.584715 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951e674-1c89-4b1c-be4b-3f0b8a594716 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:11.675528 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451366d-7d39-4150-918f-3067771d67f4 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:11.675528 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451366d-7d39-4150-918f-3067771d67f4 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:11.675528 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451366d-7d39-4150-918f-3067771d67f4 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:11.675528 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 457/935] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:11.683437 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aedadf-e926-443e-af6a-e722dece7946 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:11.683886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aedadf-e926-443e-af6a-e722dece7946 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:11.684317 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aedadf-e926-443e-af6a-e722dece7946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:11.713882 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-09aedadf-e926-443e-af6a-e722dece7946 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:11.714294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951e674-1c89-4b1c-be4b-3f0b8a594716 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:11.715617 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-09aedadf-e926-443e-af6a-e722dece7946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:11.756175 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1013263-42ba-4d98-ae95-67c965b6bb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:11.757115 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1013263-42ba-4d98-ae95-67c965b6bb5f None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:11.757422 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1013263-42ba-4d98-ae95-67c965b6bb5f None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:11.757993 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1013263-42ba-4d98-ae95-67c965b6bb5f None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:11.758757 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1013263-42ba-4d98-ae95-67c965b6bb5f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:11.759069 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1013263-42ba-4d98-ae95-67c965b6bb5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:11.760961 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1013263-42ba-4d98-ae95-67c965b6bb5f None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:11.774253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 479/936] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:34:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:11.780162 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1013263-42ba-4d98-ae95-67c965b6bb5f None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:11.811622 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 458/937] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:34:11.836024 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aedadf-e926-443e-af6a-e722dece7946 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:11.898559 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1013263-42ba-4d98-ae95-67c965b6bb5f None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:11.934060 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bf697-bfb4-451f-ad0e-692b8393f586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:11.935131 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bf697-bfb4-451f-ad0e-692b8393f586 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:11.935580 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bf697-bfb4-451f-ad0e-692b8393f586 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:11.936046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bf697-bfb4-451f-ad0e-692b8393f586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:11.943135 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aedadf-e926-443e-af6a-e722dece7946 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:11.949175 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620bf697-bfb4-451f-ad0e-692b8393f586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:11.951056 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620bf697-bfb4-451f-ad0e-692b8393f586 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:11.971050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-620bf697-bfb4-451f-ad0e-692b8393f586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:11.971050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:11.971050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:11.971050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:11.971050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:11.971050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:11.971050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:11.971050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:11.971050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:11.971050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:11.971050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:11.971050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:11.971050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:34:11.971050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:34:11.971050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:34:11.972301 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:34:11.972301 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:11.972301 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:11.972301 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:11.972301 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:11.972301 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:11.972301 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:11.972301 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:11.972301 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:11.972301 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:11.972301 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:11.972301 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:11.972301 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:11.972301 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:11.972301 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:11.972301 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:11.972301 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:11.973520 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:34:11.973520 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:34:11.973520 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:11.973520 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:11.980112 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 480/938] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:11.981515 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bf697-bfb4-451f-ad0e-692b8393f586 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:11.983777 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af7272-5e5e-45c5-90e3-f99d64b2b150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:11.985029 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af7272-5e5e-45c5-90e3-f99d64b2b150 None admin] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:11.985333 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af7272-5e5e-45c5-90e3-f99d64b2b150 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:11.985593 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af7272-5e5e-45c5-90e3-f99d64b2b150 None admin] PATH_INFO: `/v3/projects` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:11.986390 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af7272-5e5e-45c5-90e3-f99d64b2b150 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:11.988262 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af7272-5e5e-45c5-90e3-f99d64b2b150 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:11.989151 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: WARNING keystone.server.flask.common [None req-31af7272-5e5e-45c5-90e3-f99d64b2b150 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 09 15:34:12.009577 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.sql.core [None req-31af7272-5e5e-45c5-90e3-f99d64b2b150 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 15:34:12.009577 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 09 15:34:12.009577 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [parameters: {'id': '09afe1e67e3244a3ad857d482a982139', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 09 15:34:12.009577 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=212998) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 15:34:12.027744 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-31af7272-5e5e-45c5-90e3-f99d64b2b150 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 09afe1e67e3244a3ad857d482a982139.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 09afe1e67e3244a3ad857d482a982139. May 09 15:34:12.027744 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:12.027744 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:34:12.027744 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:34:12.027744 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:34:12.027744 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:34:12.027744 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:34:12.027744 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:34:12.027744 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:34:12.027744 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application conn.query(q) May 09 15:34:12.027744 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:34:12.027744 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:34:12.027744 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:34:12.028763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application result.read() May 09 15:34:12.028763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:34:12.028763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:34:12.028763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:34:12.028763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:34:12.028763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:34:12.028763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:34:12.028763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:34:12.028763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:34:12.028763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 15:34:12.028763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:12.028763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 15:34:12.028763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:12.028763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:12.028763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 15:34:12.028763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 15:34:12.028763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 09 15:34:12.028763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return project_ref.to_dict() May 09 15:34:12.029863 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:34:12.029863 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application next(self.gen) May 09 15:34:12.029863 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 15:34:12.029863 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application yield resource May 09 15:34:12.029863 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:34:12.029863 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application next(self.gen) May 09 15:34:12.029863 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 15:34:12.029863 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self.session.rollback() May 09 15:34:12.029863 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 15:34:12.029863 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self.force_reraise() May 09 15:34:12.029863 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 15:34:12.029863 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise self.value May 09 15:34:12.029863 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 15:34:12.029863 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 15:34:12.029863 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 15:34:12.029863 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application session.commit() May 09 15:34:12.029863 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 15:34:12.030886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 15:34:12.030886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 15:34:12.030886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self._prepare_impl() May 09 15:34:12.030886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 15:34:12.030886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self.session.flush() May 09 15:34:12.030886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 15:34:12.030886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self._flush(objects) May 09 15:34:12.030886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 15:34:12.030886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 15:34:12.030886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 15:34:12.030886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application compat.raise_( May 09 15:34:12.030886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:34:12.030886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception May 09 15:34:12.030886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 15:34:12.030886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application flush_context.execute() May 09 15:34:12.030886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 15:34:12.030886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rec.execute(self) May 09 15:34:12.033065 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 15:34:12.033065 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 15:34:12.033065 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 15:34:12.033065 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 15:34:12.033065 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 09 15:34:12.033065 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application c = connection._execute_20( May 09 15:34:12.033065 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 15:34:12.033065 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 15:34:12.033065 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 15:34:12.033065 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 15:34:12.033065 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 15:34:12.033065 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 15:34:12.033065 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 15:34:12.033065 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 15:34:12.033065 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 15:34:12.034007 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 15:34:12.034007 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:34:12.034007 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception May 09 15:34:12.034007 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:34:12.034007 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:34:12.034007 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:34:12.034007 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:34:12.034007 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:34:12.034007 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:34:12.034007 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:34:12.034007 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application conn.query(q) May 09 15:34:12.034007 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:34:12.034007 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:34:12.034007 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:34:12.034007 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application result.read() May 09 15:34:12.034007 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:34:12.034007 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:34:12.036640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:34:12.036640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:34:12.036640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:34:12.036640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:34:12.036640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:34:12.036640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:34:12.036640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 15:34:12.036640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 09 15:34:12.036640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [parameters: {'id': '09afe1e67e3244a3ad857d482a982139', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 09 15:34:12.036640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 15:34:12.036640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:12.036640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:34:12.036640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:12.036640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:12.036640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 09 15:34:12.038839 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 09 15:34:12.038839 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 15:34:12.038839 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 15:34:12.038839 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 09 15:34:12.038839 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:12.038839 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:34:12.038839 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:12.038839 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:12.038839 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:12.038839 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:12.038839 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:12.038839 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:12.038839 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:12.038839 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:12.038839 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:12.038839 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:12.038839 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:12.043673 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:12.043673 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 09 15:34:12.043673 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 09 15:34:12.043673 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:12.043673 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:12.043673 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 09 15:34:12.043673 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.Conflict( May 09 15:34:12.043673 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 09afe1e67e3244a3ad857d482a982139. May 09 15:34:12.043673 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:12.043673 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 459/939] 10.222.0.48 () {60 vars in 1140 bytes} [Mon May 9 15:34:11 2022] POST /identity/v3/projects => generated 262 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 09 15:34:12.043673 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af7272-5e5e-45c5-90e3-f99d64b2b150 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:12.120945 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bf697-bfb4-451f-ad0e-692b8393f586 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:12.163357 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af7272-5e5e-45c5-90e3-f99d64b2b150 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:12.164953 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b540b-4fa6-445d-9ed8-5466f5f401c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:12.165914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b540b-4fa6-445d-9ed8-5466f5f401c9 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:12.166425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b540b-4fa6-445d-9ed8-5466f5f401c9 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:12.166955 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b540b-4fa6-445d-9ed8-5466f5f401c9 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:12.167917 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b540b-4fa6-445d-9ed8-5466f5f401c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:12.168446 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b540b-4fa6-445d-9ed8-5466f5f401c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:12.170104 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b540b-4fa6-445d-9ed8-5466f5f401c9 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:12.191259 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 481/940] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:12.192643 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b540b-4fa6-445d-9ed8-5466f5f401c9 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:12.214606 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d73d4-87af-4631-8387-2edb9c9bae9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:12.215517 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d73d4-87af-4631-8387-2edb9c9bae9d None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:12.215802 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d73d4-87af-4631-8387-2edb9c9bae9d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:12.216078 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d73d4-87af-4631-8387-2edb9c9bae9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:12.223929 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d73d4-87af-4631-8387-2edb9c9bae9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:12.225652 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d73d4-87af-4631-8387-2edb9c9bae9d None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:12.241131 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-851d73d4-87af-4631-8387-2edb9c9bae9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:34:12.241131 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:12.241131 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:12.241131 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:12.241131 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:12.241131 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:12.241131 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:12.241131 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:12.241131 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:12.241131 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:12.241131 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:12.241131 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:12.241131 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:34:12.241131 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:34:12.241131 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:34:12.242727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:34:12.242727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:12.242727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:12.242727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:12.242727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:12.242727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:12.242727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:12.242727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:12.242727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:12.242727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:12.242727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:12.242727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:12.242727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:12.242727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:12.242727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:12.242727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:12.242727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:12.243735 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:34:12.243735 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:34:12.243735 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:34:12.243735 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:34:12.243735 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:34:12.243735 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:34:12.243735 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:34:12.243735 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:12.247473 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 460/941] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:34:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:12.248652 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d73d4-87af-4631-8387-2edb9c9bae9d None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:12.315253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b540b-4fa6-445d-9ed8-5466f5f401c9 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:12.357181 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d73d4-87af-4631-8387-2edb9c9bae9d None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:12.357457 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabef89-c493-414c-ada1-e3705615cea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:12.358573 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabef89-c493-414c-ada1-e3705615cea1 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:12.359621 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabef89-c493-414c-ada1-e3705615cea1 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:12.360008 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabef89-c493-414c-ada1-e3705615cea1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:12.373233 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabef89-c493-414c-ada1-e3705615cea1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:12.375363 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabef89-c493-414c-ada1-e3705615cea1 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:12.391949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-aaabef89-c493-414c-ada1-e3705615cea1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:34:12.391949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:12.391949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:12.391949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:12.391949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:12.391949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:12.391949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:12.391949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:12.391949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:12.391949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:12.391949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:12.391949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:12.391949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:34:12.391949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:34:12.391949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:34:12.391949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:34:12.397880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:12.397880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:12.397880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:34:12.397880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:34:12.397880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:34:12.397880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:34:12.397880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:12.397880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:12.397880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:12.397880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:12.397880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:12.397880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:12.397880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:12.397880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:12.397880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:12.397880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:12.397880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:12.397880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:12.398957 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:12.398957 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:12.398957 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:34:12.398957 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:34:12.398957 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:34:12.398957 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:34:12.398957 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:34:12.398957 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:34:12.398957 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:34:12.398957 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:12.398957 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 482/942] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:34:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:12.398957 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d2c8b-8f13-4beb-9d5b-4bd946823601 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:12.398957 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d2c8b-8f13-4beb-9d5b-4bd946823601 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:12.399762 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d2c8b-8f13-4beb-9d5b-4bd946823601 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:12.401466 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 483/943] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:12.402039 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257df43e-317a-408c-a22f-07e300611fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:12.402829 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a61971-ec49-45b8-b779-be84e05029d5 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:12.403124 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a61971-ec49-45b8-b779-be84e05029d5 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:12.403287 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257df43e-317a-408c-a22f-07e300611fba None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:12.403444 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a61971-ec49-45b8-b779-be84e05029d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:12.403612 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257df43e-317a-408c-a22f-07e300611fba None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:12.403791 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257df43e-317a-408c-a22f-07e300611fba None admin] PATH_INFO: `/v3/projects` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:12.404558 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257df43e-317a-408c-a22f-07e300611fba None admin] RBAC: Adding query filter params (name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:12.404995 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257df43e-317a-408c-a22f-07e300611fba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:12.407154 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257df43e-317a-408c-a22f-07e300611fba None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:12.422276 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-56a61971-ec49-45b8-b779-be84e05029d5 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:12.423694 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-56a61971-ec49-45b8-b779-be84e05029d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:12.438018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 461/944] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:34:12 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:12.438018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257df43e-317a-408c-a22f-07e300611fba None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:12.555978 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 484/945] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:12.581047 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a61971-ec49-45b8-b779-be84e05029d5 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:12.589356 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257df43e-317a-408c-a22f-07e300611fba None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:12.648677 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6304a4-9b85-47b4-998d-05928de3174d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:12.649874 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6304a4-9b85-47b4-998d-05928de3174d None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:12.650410 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6304a4-9b85-47b4-998d-05928de3174d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:12.650927 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6304a4-9b85-47b4-998d-05928de3174d None admin] PATH_INFO: `/v3/users` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:12.652041 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6304a4-9b85-47b4-998d-05928de3174d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:12.652591 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6304a4-9b85-47b4-998d-05928de3174d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:12.654385 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6304a4-9b85-47b4-998d-05928de3174d None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:12.678829 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 462/946] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 9 15:34:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:12.684970 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6304a4-9b85-47b4-998d-05928de3174d None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:12.743072 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a61971-ec49-45b8-b779-be84e05029d5 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:12.798962 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdb43c-9a51-4067-9ca5-87cde8590763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:12.801203 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdb43c-9a51-4067-9ca5-87cde8590763 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:12.801751 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdb43c-9a51-4067-9ca5-87cde8590763 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:12.802283 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdb43c-9a51-4067-9ca5-87cde8590763 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:12.803591 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdb43c-9a51-4067-9ca5-87cde8590763 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:12.806528 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdb43c-9a51-4067-9ca5-87cde8590763 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:12.822516 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-b8cdb43c-9a51-4067-9ca5-87cde8590763 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:34:12.822516 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:12.822516 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:34:12.822516 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:34:12.822516 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:34:12.822516 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:34:12.822516 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:34:12.822516 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:12.822516 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:34:12.822516 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:12.822516 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:34:12.822516 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:12.822516 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:12.822516 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:12.822516 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:12.822516 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:12.822516 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:12.823712 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:12.823712 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:12.823712 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:12.823712 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:12.823712 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:12.823712 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:12.823712 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:34:12.823712 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:34:12.823712 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:34:12.823712 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:34:12.823712 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:12.823712 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:12.823712 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:12.823712 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:12.823712 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:12.823712 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:12.824663 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:12.824663 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:12.824663 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:12.824663 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:12.824663 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:12.824663 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:12.824663 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:12.824663 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:12.824663 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:12.824663 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:12.824663 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:34:12.824663 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:12.824663 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:34:12.824663 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:12.828973 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 485/947] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:34:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:12.835278 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdb43c-9a51-4067-9ca5-87cde8590763 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:12.850085 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6304a4-9b85-47b4-998d-05928de3174d None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:12.911674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d4fa7-2ddd-415e-b490-43374e1c6d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:12.913409 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d4fa7-2ddd-415e-b490-43374e1c6d4a None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:12.913603 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d4fa7-2ddd-415e-b490-43374e1c6d4a None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:12.914076 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d4fa7-2ddd-415e-b490-43374e1c6d4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:12.932613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d4fa7-2ddd-415e-b490-43374e1c6d4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:12.935351 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d4fa7-2ddd-415e-b490-43374e1c6d4a None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:12.963405 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-fc9d4fa7-2ddd-415e-b490-43374e1c6d4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:12.963405 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:12.963405 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:12.963405 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:12.963405 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:12.963405 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:12.963405 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:12.963405 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:12.963405 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:12.963405 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:12.963405 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:12.963405 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:12.963405 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:34:12.963405 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:34:12.963405 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:34:12.964449 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:34:12.964449 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:12.964449 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:12.964449 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:12.964449 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:12.964449 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:12.964449 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:12.964449 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:12.964449 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:12.964449 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:12.964449 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:12.964449 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:12.964449 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:12.964449 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:12.964449 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:12.964449 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:12.964449 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:12.965725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:34:12.965725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:34:12.965725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:12.965725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:12.965725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 463/948] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:12.971579 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d4fa7-2ddd-415e-b490-43374e1c6d4a None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:12.985837 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdb43c-9a51-4067-9ca5-87cde8590763 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:13.022675 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22ff82-eb9c-41c7-a931-a50f98f9817f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:13.023398 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22ff82-eb9c-41c7-a931-a50f98f9817f None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:13.023705 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22ff82-eb9c-41c7-a931-a50f98f9817f None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:13.023983 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22ff82-eb9c-41c7-a931-a50f98f9817f None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:13.024704 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22ff82-eb9c-41c7-a931-a50f98f9817f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:13.025009 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22ff82-eb9c-41c7-a931-a50f98f9817f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:13.026576 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22ff82-eb9c-41c7-a931-a50f98f9817f None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:13.032346 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 486/949] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:34:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:13.037759 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22ff82-eb9c-41c7-a931-a50f98f9817f None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:13.106034 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d4fa7-2ddd-415e-b490-43374e1c6d4a None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:13.155136 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658522b4-04c7-44ba-beee-3884f8b5b783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:13.156864 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658522b4-04c7-44ba-beee-3884f8b5b783 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:13.157326 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658522b4-04c7-44ba-beee-3884f8b5b783 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:13.157641 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658522b4-04c7-44ba-beee-3884f8b5b783 None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:13.158402 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658522b4-04c7-44ba-beee-3884f8b5b783 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:13.158716 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658522b4-04c7-44ba-beee-3884f8b5b783 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:13.159334 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22ff82-eb9c-41c7-a931-a50f98f9817f None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:13.160132 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658522b4-04c7-44ba-beee-3884f8b5b783 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:13.176180 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 464/950] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:13.182433 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658522b4-04c7-44ba-beee-3884f8b5b783 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:13.206429 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aae0df-02d7-4d15-88ae-39f6b7764b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:13.208193 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aae0df-02d7-4d15-88ae-39f6b7764b27 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:13.209001 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aae0df-02d7-4d15-88ae-39f6b7764b27 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:13.210567 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aae0df-02d7-4d15-88ae-39f6b7764b27 None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:13.212592 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aae0df-02d7-4d15-88ae-39f6b7764b27 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:13.213518 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aae0df-02d7-4d15-88ae-39f6b7764b27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:13.217484 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aae0df-02d7-4d15-88ae-39f6b7764b27 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:13.232005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 487/951] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:34:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:13.234355 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aae0df-02d7-4d15-88ae-39f6b7764b27 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:13.348189 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658522b4-04c7-44ba-beee-3884f8b5b783 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:13.392757 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aae0df-02d7-4d15-88ae-39f6b7764b27 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:13.406881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42c73a-c05c-4d57-afd6-57505738d8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:13.409606 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42c73a-c05c-4d57-afd6-57505738d8e9 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:13.410392 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42c73a-c05c-4d57-afd6-57505738d8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:13.411103 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42c73a-c05c-4d57-afd6-57505738d8e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:13.424311 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42c73a-c05c-4d57-afd6-57505738d8e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:13.427111 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42c73a-c05c-4d57-afd6-57505738d8e9 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:13.427632 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3be92e-df7e-4d0c-b1dd-109bc86001a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:13.428300 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3be92e-df7e-4d0c-b1dd-109bc86001a4 None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:13.428610 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3be92e-df7e-4d0c-b1dd-109bc86001a4 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:13.428853 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3be92e-df7e-4d0c-b1dd-109bc86001a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:13.429623 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3be92e-df7e-4d0c-b1dd-109bc86001a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:13.430984 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3be92e-df7e-4d0c-b1dd-109bc86001a4 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:13.450907 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 488/952] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:34:13 2022] POST /identity/v3/endpoints => generated 349 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:34:13.452273 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92213ee-ec3d-40fc-8290-cab1ad946f2e None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:13.452560 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92213ee-ec3d-40fc-8290-cab1ad946f2e None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:13.452965 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92213ee-ec3d-40fc-8290-cab1ad946f2e None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:13.454725 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 489/953] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:13.457481 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-4a42c73a-c05c-4d57-afd6-57505738d8e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:34:13.457481 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:13.457481 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:13.457481 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:13.457481 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:13.457481 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:13.457481 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:13.457481 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:13.457481 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:13.457481 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:13.457481 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:13.457481 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:13.457481 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:34:13.457481 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:34:13.457481 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:34:13.459247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:34:13.459247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:13.459247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:13.459247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:13.459247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:13.459247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:13.459247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:13.459247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:13.459247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:13.459247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:13.459247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:13.459247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:13.459247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:13.459247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:13.459247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:13.459247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:13.459247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:13.460994 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:34:13.460994 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:34:13.460994 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:34:13.460994 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:34:13.460994 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:34:13.460994 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:34:13.460994 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:34:13.460994 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:13.464011 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65b40a-19d3-46b8-9f14-43fc5a227e42 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:13.473347 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65b40a-19d3-46b8-9f14-43fc5a227e42 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:13.473347 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65b40a-19d3-46b8-9f14-43fc5a227e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:13.474288 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 465/954] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:34:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:13.476128 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42c73a-c05c-4d57-afd6-57505738d8e9 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:13.498728 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-2b65b40a-19d3-46b8-9f14-43fc5a227e42 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:13.500815 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-2b65b40a-19d3-46b8-9f14-43fc5a227e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:13.624805 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 490/955] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:13.653643 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65b40a-19d3-46b8-9f14-43fc5a227e42 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:13.666157 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42c73a-c05c-4d57-afd6-57505738d8e9 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:13.722074 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796425c-d675-47ca-8c7b-13ce3222b07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:13.723028 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796425c-d675-47ca-8c7b-13ce3222b07c None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:13.723335 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796425c-d675-47ca-8c7b-13ce3222b07c None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:13.723842 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796425c-d675-47ca-8c7b-13ce3222b07c None admin] PATH_INFO: `/v3/projects` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:13.724965 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796425c-d675-47ca-8c7b-13ce3222b07c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:13.725580 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796425c-d675-47ca-8c7b-13ce3222b07c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:13.727055 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796425c-d675-47ca-8c7b-13ce3222b07c None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:13.744980 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 466/956] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:34:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:13.754405 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796425c-d675-47ca-8c7b-13ce3222b07c None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:13.767118 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65b40a-19d3-46b8-9f14-43fc5a227e42 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:13.803887 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb81d4-cffb-496a-9903-e3454a05a093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:13.804553 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb81d4-cffb-496a-9903-e3454a05a093 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:13.804846 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb81d4-cffb-496a-9903-e3454a05a093 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:13.805127 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb81d4-cffb-496a-9903-e3454a05a093 None admin] PATH_INFO: `/v3/services/compute` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:13.805839 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb81d4-cffb-496a-9903-e3454a05a093 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:13.807262 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb81d4-cffb-496a-9903-e3454a05a093 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:13.822832 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-4fdb81d4-cffb-496a-9903-e3454a05a093 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:34:13.822832 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:13.822832 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:34:13.822832 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:34:13.822832 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:34:13.822832 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:34:13.822832 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:34:13.822832 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:13.822832 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:34:13.822832 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:13.822832 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:34:13.822832 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:13.822832 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:13.822832 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:13.822832 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:13.822832 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:13.822832 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:13.824040 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:13.824040 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:13.824040 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:13.824040 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:13.824040 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:13.824040 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:13.824040 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:34:13.824040 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:34:13.824040 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:34:13.824040 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:34:13.824040 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:13.824040 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:13.824040 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:13.824040 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:13.824040 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:13.824040 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:13.824962 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:13.824962 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:13.824962 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:13.824962 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:13.824962 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:13.824962 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:13.824962 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:13.824962 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:13.824962 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:13.824962 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:13.824962 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:34:13.824962 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:13.824962 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:34:13.824962 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:13.824962 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 491/957] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:34:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:34:13.830727 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb81d4-cffb-496a-9903-e3454a05a093 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:13.902521 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796425c-d675-47ca-8c7b-13ce3222b07c None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:13.954495 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610090a-1f4e-4dcd-847c-41678630ba12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:13.955702 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610090a-1f4e-4dcd-847c-41678630ba12 None admin] REQUEST_METHOD: `PUT` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:13.955992 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610090a-1f4e-4dcd-847c-41678630ba12 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:13.956275 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610090a-1f4e-4dcd-847c-41678630ba12 None admin] PATH_INFO: `/v3/projects/db5768a93e754372808fc69f898cc853/users/8fcb1b0006d94847be30b28f17d041e3/roles/61a5e0d3dab54d758c4f70299c19f603` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:13.959654 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610090a-1f4e-4dcd-847c-41678630ba12 None admin] RBAC: Authorizing `identity:create_grant(project_id=db5768a93e754372808fc69f898cc853, user_id=8fcb1b0006d94847be30b28f17d041e3, role_id=61a5e0d3dab54d758c4f70299c19f603)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:13.961123 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb81d4-cffb-496a-9903-e3454a05a093 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:13.961251 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610090a-1f4e-4dcd-847c-41678630ba12 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:13.985486 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 467/958] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:34:13 2022] PUT /identity/v3/projects/db5768a93e754372808fc69f898cc853/users/8fcb1b0006d94847be30b28f17d041e3/roles/61a5e0d3dab54d758c4f70299c19f603 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:34:14.011806 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12119d7-a562-48e9-bd38-7a6cd179e8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:14.012543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12119d7-a562-48e9-bd38-7a6cd179e8de None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:14.012837 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12119d7-a562-48e9-bd38-7a6cd179e8de None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:14.013118 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12119d7-a562-48e9-bd38-7a6cd179e8de None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:14.014088 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12119d7-a562-48e9-bd38-7a6cd179e8de None admin] RBAC: Adding query filter params (name=compute) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:14.014413 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12119d7-a562-48e9-bd38-7a6cd179e8de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:14.016457 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12119d7-a562-48e9-bd38-7a6cd179e8de None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:14.022658 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 492/959] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:34:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:14.030769 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610090a-1f4e-4dcd-847c-41678630ba12 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:14.224479 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610090a-1f4e-4dcd-847c-41678630ba12 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:14.285841 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bd886-2c91-452a-8142-a6cf7c123b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:14.286929 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bd886-2c91-452a-8142-a6cf7c123b58 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:14.287420 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bd886-2c91-452a-8142-a6cf7c123b58 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:14.287902 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bd886-2c91-452a-8142-a6cf7c123b58 None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:14.289186 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bd886-2c91-452a-8142-a6cf7c123b58 None admin] RBAC: Adding query filter params (type=compute) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:14.289744 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bd886-2c91-452a-8142-a6cf7c123b58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:14.292232 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bd886-2c91-452a-8142-a6cf7c123b58 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:14.302062 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 468/960] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:34:14 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:15.119054 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d29855-6457-4020-856f-6ed8e179a488 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:15.119608 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d29855-6457-4020-856f-6ed8e179a488 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:15.119608 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d29855-6457-4020-856f-6ed8e179a488 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:15.121667 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 493/961] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:15.129318 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd692e-32ac-4b98-b7c7-0662c0acea46 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:15.130326 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd692e-32ac-4b98-b7c7-0662c0acea46 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:15.130815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd692e-32ac-4b98-b7c7-0662c0acea46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:15.159093 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-9bdd692e-32ac-4b98-b7c7-0662c0acea46 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:15.161018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-9bdd692e-32ac-4b98-b7c7-0662c0acea46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:15.239758 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 469/962] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:15.266751 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d29855-6457-4020-856f-6ed8e179a488 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:15.388985 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d29855-6457-4020-856f-6ed8e179a488 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:15.432620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9dad6-29d3-4931-895c-2b04e51b908d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:15.433303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9dad6-29d3-4931-895c-2b04e51b908d None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:15.433794 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9dad6-29d3-4931-895c-2b04e51b908d None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:15.434201 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9dad6-29d3-4931-895c-2b04e51b908d None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:15.435208 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9dad6-29d3-4931-895c-2b04e51b908d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:15.438056 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9dad6-29d3-4931-895c-2b04e51b908d None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:15.440348 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: WARNING keystone.server.flask.common [None req-2fd9dad6-29d3-4931-895c-2b04e51b908d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 09 15:34:15.457559 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.sql.core [None req-2fd9dad6-29d3-4931-895c-2b04e51b908d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 15:34:15.457559 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 09 15:34:15.457559 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [parameters: {'user_id': '48732c00fe8342eab5dbaf2be1133da2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 09 15:34:15.457559 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=212999) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 15:34:15.465558 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-2fd9dad6-29d3-4931-895c-2b04e51b908d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 09 15:34:15.465558 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:15.465558 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:34:15.465558 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:34:15.465558 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:34:15.465558 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:34:15.465558 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:34:15.465558 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:34:15.465558 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:34:15.465558 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application conn.query(q) May 09 15:34:15.465558 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:34:15.465558 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:34:15.465558 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:34:15.465558 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application result.read() May 09 15:34:15.465558 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:34:15.467646 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:34:15.467646 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:34:15.467646 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:34:15.467646 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:34:15.467646 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:34:15.467646 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:34:15.467646 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:34:15.467646 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 15:34:15.467646 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:15.467646 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 15:34:15.467646 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:15.467646 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:15.467646 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 15:34:15.467646 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 15:34:15.467646 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 09 15:34:15.467646 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 09 15:34:15.467646 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:34:15.467646 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application next(self.gen) May 09 15:34:15.470135 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 15:34:15.470135 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application yield resource May 09 15:34:15.470135 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:34:15.470135 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application next(self.gen) May 09 15:34:15.470135 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 15:34:15.470135 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self.session.rollback() May 09 15:34:15.470135 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 15:34:15.470135 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self.force_reraise() May 09 15:34:15.470135 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 15:34:15.470135 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise self.value May 09 15:34:15.470135 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 15:34:15.470135 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 15:34:15.470135 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 15:34:15.470135 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application session.commit() May 09 15:34:15.470135 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 15:34:15.470135 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 15:34:15.470135 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 15:34:15.471868 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._prepare_impl() May 09 15:34:15.471868 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 15:34:15.471868 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self.session.flush() May 09 15:34:15.471868 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 15:34:15.471868 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._flush(objects) May 09 15:34:15.471868 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 15:34:15.471868 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 15:34:15.471868 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 15:34:15.471868 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application compat.raise_( May 09 15:34:15.471868 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:34:15.471868 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception May 09 15:34:15.471868 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 15:34:15.471868 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application flush_context.execute() May 09 15:34:15.471868 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 15:34:15.471868 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rec.execute(self) May 09 15:34:15.471868 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 15:34:15.471868 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 15:34:15.476568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 15:34:15.476568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 15:34:15.476568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 09 15:34:15.476568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application result = connection._execute_20( May 09 15:34:15.476568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 15:34:15.476568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 15:34:15.476568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 15:34:15.476568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 15:34:15.476568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 15:34:15.476568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 15:34:15.476568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 15:34:15.476568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 15:34:15.476568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 15:34:15.476568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 15:34:15.476568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:34:15.476568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception May 09 15:34:15.484196 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:34:15.484196 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:34:15.484196 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:34:15.484196 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:34:15.484196 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:34:15.484196 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:34:15.484196 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:34:15.484196 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application conn.query(q) May 09 15:34:15.484196 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:34:15.484196 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:34:15.484196 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:34:15.484196 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application result.read() May 09 15:34:15.484196 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:34:15.484196 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:34:15.484196 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:34:15.484196 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:34:15.487323 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:34:15.487323 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:34:15.487323 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:34:15.487323 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:34:15.487323 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 15:34:15.487323 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 09 15:34:15.487323 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [parameters: {'user_id': '48732c00fe8342eab5dbaf2be1133da2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 09 15:34:15.487323 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 15:34:15.487323 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:15.487323 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:34:15.487323 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:15.487323 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:15.487323 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:15.487323 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:15.487323 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:15.492940 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:15.492940 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:15.492940 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:15.492940 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:15.492940 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:15.492940 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:15.492940 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:15.492940 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 09 15:34:15.492940 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 09 15:34:15.492940 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:15.492940 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:15.492940 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:34:15.492940 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:34:15.492940 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:34:15.492940 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:34:15.492940 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 09 15:34:15.492940 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 09 15:34:15.496783 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 09 15:34:15.496783 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 09 15:34:15.496783 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 15:34:15.496783 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 15:34:15.496783 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 09 15:34:15.496783 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:15.496783 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 494/963] 10.222.0.48 () {60 vars in 1131 bytes} [Mon May 9 15:34:15 2022] POST /identity/v3/users => generated 160 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:15.504695 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd692e-32ac-4b98-b7c7-0662c0acea46 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:15.661516 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd692e-32ac-4b98-b7c7-0662c0acea46 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:15.699871 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a6362-f51e-4990-9d59-a93a1d413371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:15.700694 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a6362-f51e-4990-9d59-a93a1d413371 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:15.701032 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a6362-f51e-4990-9d59-a93a1d413371 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:15.701313 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a6362-f51e-4990-9d59-a93a1d413371 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:15.710205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a6362-f51e-4990-9d59-a93a1d413371 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:15.711685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a6362-f51e-4990-9d59-a93a1d413371 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:15.728085 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-960a6362-f51e-4990-9d59-a93a1d413371 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:34:15.728085 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:15.728085 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:15.728085 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:15.728085 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:15.728085 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:15.728085 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:15.728085 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:15.728085 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:15.728085 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:15.728085 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:15.728085 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:15.728085 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:34:15.728085 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:34:15.728085 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:34:15.728085 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:34:15.729197 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:15.729197 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:15.729197 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:34:15.729197 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:34:15.729197 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:34:15.729197 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:34:15.729197 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:15.729197 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:15.729197 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:15.729197 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:15.729197 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:15.729197 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:15.729197 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:15.729197 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:15.729197 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:15.729197 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:15.729197 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:15.729197 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:15.730275 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:15.730275 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:15.730275 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:34:15.730275 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:34:15.730275 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:34:15.730275 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:34:15.730275 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:34:15.730275 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:34:15.730275 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:34:15.730275 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:15.730275 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 470/964] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:34:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:15.740761 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9dad6-29d3-4931-895c-2b04e51b908d None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:15.855632 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9dad6-29d3-4931-895c-2b04e51b908d None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:15.892329 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d46b2-7c6e-422e-8e35-5cad2b054a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:15.893015 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d46b2-7c6e-422e-8e35-5cad2b054a54 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:15.893299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d46b2-7c6e-422e-8e35-5cad2b054a54 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:15.893607 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d46b2-7c6e-422e-8e35-5cad2b054a54 None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:15.894434 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d46b2-7c6e-422e-8e35-5cad2b054a54 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:15.894740 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d46b2-7c6e-422e-8e35-5cad2b054a54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:15.896401 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d46b2-7c6e-422e-8e35-5cad2b054a54 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:15.938584 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 495/965] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:34:15 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:16.185667 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bc385-f5e7-4b53-91c3-2cae7611763d None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:16.187388 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bc385-f5e7-4b53-91c3-2cae7611763d None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:16.188141 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bc385-f5e7-4b53-91c3-2cae7611763d None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:16.190766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 471/966] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:16.197400 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1054f1-1696-4c22-b8e3-d934b28b9f8f None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:16.197921 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1054f1-1696-4c22-b8e3-d934b28b9f8f None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:16.198043 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1054f1-1696-4c22-b8e3-d934b28b9f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:16.217746 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-6e1054f1-1696-4c22-b8e3-d934b28b9f8f None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:16.221287 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-6e1054f1-1696-4c22-b8e3-d934b28b9f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:16.316656 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 496/967] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:16.357435 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379bc385-f5e7-4b53-91c3-2cae7611763d None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:16.484736 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379bc385-f5e7-4b53-91c3-2cae7611763d None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:16.523164 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a09f08-3447-4389-9f25-f31ed7f11664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:16.524090 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a09f08-3447-4389-9f25-f31ed7f11664 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:16.524380 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a09f08-3447-4389-9f25-f31ed7f11664 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:16.524657 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a09f08-3447-4389-9f25-f31ed7f11664 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:16.525321 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a09f08-3447-4389-9f25-f31ed7f11664 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:16.526735 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a09f08-3447-4389-9f25-f31ed7f11664 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:16.539226 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-44a09f08-3447-4389-9f25-f31ed7f11664 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:34:16.539226 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:16.539226 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:34:16.539226 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:34:16.539226 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:34:16.539226 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:34:16.539226 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:34:16.539226 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:16.539226 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:34:16.539226 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:16.539226 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:34:16.539226 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:16.539226 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:16.539226 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:16.539226 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:16.539226 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:16.539226 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:16.540560 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:16.540560 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:16.540560 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:16.540560 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:16.540560 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:16.540560 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:16.540560 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:34:16.540560 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:34:16.540560 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:34:16.540560 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:34:16.540560 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:16.540560 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:16.540560 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:16.540560 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:16.540560 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:16.540560 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:16.541679 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:16.541679 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:16.541679 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:16.541679 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:16.541679 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:16.541679 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:16.541679 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:16.541679 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:16.541679 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:16.541679 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:16.541679 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:34:16.541679 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:16.541679 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:34:16.541679 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:16.541679 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 472/968] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:34:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:16.550341 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1054f1-1696-4c22-b8e3-d934b28b9f8f None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:16.672625 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1054f1-1696-4c22-b8e3-d934b28b9f8f None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:16.683531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8545be-ad10-4b6f-bf6e-cc7c719b65a4 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:16.684407 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8545be-ad10-4b6f-bf6e-cc7c719b65a4 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:16.684804 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8545be-ad10-4b6f-bf6e-cc7c719b65a4 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:16.687258 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 473/969] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:16.693747 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b4390-e865-40f3-9313-e76ce25070c2 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:16.694042 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b4390-e865-40f3-9313-e76ce25070c2 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:16.694481 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b4390-e865-40f3-9313-e76ce25070c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:16.712869 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-672b4390-e865-40f3-9313-e76ce25070c2 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:16.714459 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-672b4390-e865-40f3-9313-e76ce25070c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:16.718495 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63f29a-7afd-4103-a6b5-ba01bd19d929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:16.720120 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63f29a-7afd-4103-a6b5-ba01bd19d929 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:16.720613 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63f29a-7afd-4103-a6b5-ba01bd19d929 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:16.721100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63f29a-7afd-4103-a6b5-ba01bd19d929 None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:16.722524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63f29a-7afd-4103-a6b5-ba01bd19d929 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:16.723072 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63f29a-7afd-4103-a6b5-ba01bd19d929 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:16.725663 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63f29a-7afd-4103-a6b5-ba01bd19d929 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:16.734403 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 497/970] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:34:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:16.744107 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63f29a-7afd-4103-a6b5-ba01bd19d929 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:16.796301 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 474/971] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:34:16.812020 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56166f9b-3af7-4a95-9671-acaf626da113 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:16.812596 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56166f9b-3af7-4a95-9671-acaf626da113 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:16.813123 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56166f9b-3af7-4a95-9671-acaf626da113 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:16.816100 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 475/972] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:16.822256 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb1438-85c4-4d34-9010-17628cd00797 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:16.822659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb1438-85c4-4d34-9010-17628cd00797 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:16.822842 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb1438-85c4-4d34-9010-17628cd00797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:16.842154 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-72cb1438-85c4-4d34-9010-17628cd00797 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:16.843429 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-72cb1438-85c4-4d34-9010-17628cd00797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:16.887743 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63f29a-7afd-4103-a6b5-ba01bd19d929 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:16.916519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 476/973] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:34:16.917261 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb1438-85c4-4d34-9010-17628cd00797 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:16.941159 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb8d4f-b704-4a54-974f-2e90057186bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:16.942152 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb8d4f-b704-4a54-974f-2e90057186bd None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:16.942631 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb8d4f-b704-4a54-974f-2e90057186bd None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:16.943070 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb8d4f-b704-4a54-974f-2e90057186bd None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:16.944034 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb8d4f-b704-4a54-974f-2e90057186bd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:16.944576 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb8d4f-b704-4a54-974f-2e90057186bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:16.946261 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb8d4f-b704-4a54-974f-2e90057186bd None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:16.952189 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 498/974] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:34:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:16.954284 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb8d4f-b704-4a54-974f-2e90057186bd None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:17.024732 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb1438-85c4-4d34-9010-17628cd00797 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:17.054945 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb8d4f-b704-4a54-974f-2e90057186bd None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:17.060519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7ed7c-c021-4600-84fa-116a41ad9c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:17.061348 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7ed7c-c021-4600-84fa-116a41ad9c72 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:17.061678 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7ed7c-c021-4600-84fa-116a41ad9c72 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:17.063041 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7ed7c-c021-4600-84fa-116a41ad9c72 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:17.079522 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7ed7c-c021-4600-84fa-116a41ad9c72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:34:17.087841 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-dee7ed7c-c021-4600-84fa-116a41ad9c72 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:34:17.087841 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:17.087841 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:17.087841 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:17.087841 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:17.087841 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:17.087841 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:17.087841 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:17.087841 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:17.087841 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:17.087841 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:17.087841 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:17.087841 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:34:17.087841 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:34:17.087841 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:34:17.087841 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:34:17.088936 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:34:17.088936 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:34:17.088936 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:34:17.088936 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:34:17.088936 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:17.088936 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:17.088936 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:17.088936 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:17.088936 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:17.088936 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:17.088936 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:17.088936 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:17.088936 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:17.088936 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:17.088936 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:17.088936 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:17.089958 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:17.089958 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:17.089958 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:17.089958 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:17.089958 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:34:17.089958 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:34:17.089958 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:34:17.089958 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:34:17.089958 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:34:17.089958 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:34:17.089958 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:34:17.089958 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:17.089958 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 477/975] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 9 15:34:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:17.089958 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7ed7c-c021-4600-84fa-116a41ad9c72 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:17.097185 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462a0ba-9265-4d0d-be47-ebebb92a2fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:17.097912 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462a0ba-9265-4d0d-be47-ebebb92a2fa3 None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:17.098204 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462a0ba-9265-4d0d-be47-ebebb92a2fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:17.098489 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462a0ba-9265-4d0d-be47-ebebb92a2fa3 None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:17.099235 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462a0ba-9265-4d0d-be47-ebebb92a2fa3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:17.100662 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462a0ba-9265-4d0d-be47-ebebb92a2fa3 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:17.115390 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 499/976] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:34:16 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:34:17.116067 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462a0ba-9265-4d0d-be47-ebebb92a2fa3 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:17.243721 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7ed7c-c021-4600-84fa-116a41ad9c72 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:17.282579 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462a0ba-9265-4d0d-be47-ebebb92a2fa3 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:17.290649 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cdf31-55f6-4b93-a360-e37ead8fa94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:17.291618 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cdf31-55f6-4b93-a360-e37ead8fa94a None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:17.291927 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cdf31-55f6-4b93-a360-e37ead8fa94a None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:17.292216 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cdf31-55f6-4b93-a360-e37ead8fa94a None admin] PATH_INFO: `/v3/endpoints` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:17.293672 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0cdf31-55f6-4b93-a360-e37ead8fa94a None admin] RBAC: Adding query filter params (interface=admin, service_id=5571931aa73b43c4bf7375324ebcad6c, region_id=RegionOne) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:17.294011 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0cdf31-55f6-4b93-a360-e37ead8fa94a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:17.295948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0cdf31-55f6-4b93-a360-e37ead8fa94a None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:17.305436 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 478/977] 10.222.0.48 () {56 vars in 1249 bytes} [Mon May 9 15:34:17 2022] GET /identity/v3/endpoints?service_id=5571931aa73b43c4bf7375324ebcad6c&interface=admin®ion_id=RegionOne => generated 193 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:17.310520 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cdf31-55f6-4b93-a360-e37ead8fa94a None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:17.328843 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adba6d-5532-41b6-ab96-7fa69c6cca6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:17.329565 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adba6d-5532-41b6-ab96-7fa69c6cca6b None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:17.329852 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adba6d-5532-41b6-ab96-7fa69c6cca6b None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:17.330150 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adba6d-5532-41b6-ab96-7fa69c6cca6b None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:17.330888 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adba6d-5532-41b6-ab96-7fa69c6cca6b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:17.331194 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adba6d-5532-41b6-ab96-7fa69c6cca6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:17.332735 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adba6d-5532-41b6-ab96-7fa69c6cca6b None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:17.344521 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 500/978] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:34:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:17.352469 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adba6d-5532-41b6-ab96-7fa69c6cca6b None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:17.432862 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cdf31-55f6-4b93-a360-e37ead8fa94a None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:17.479129 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adba6d-5532-41b6-ab96-7fa69c6cca6b None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:17.486061 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177d4b0-47c8-449a-8e5d-104688429a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:17.486964 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177d4b0-47c8-449a-8e5d-104688429a1e None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:17.487121 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177d4b0-47c8-449a-8e5d-104688429a1e None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:17.487395 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177d4b0-47c8-449a-8e5d-104688429a1e None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:17.488102 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177d4b0-47c8-449a-8e5d-104688429a1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:17.489795 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177d4b0-47c8-449a-8e5d-104688429a1e None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:17.498248 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 479/979] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:34:17 2022] GET /identity/v3/services => generated 1727 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 15:34:17.529362 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c36bb-3035-4557-a296-50e05780c68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:17.530448 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c36bb-3035-4557-a296-50e05780c68c None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:17.530926 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c36bb-3035-4557-a296-50e05780c68c None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:17.531356 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c36bb-3035-4557-a296-50e05780c68c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:17.544696 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c36bb-3035-4557-a296-50e05780c68c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:17.547009 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c36bb-3035-4557-a296-50e05780c68c None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:17.570639 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-5c5c36bb-3035-4557-a296-50e05780c68c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:17.570639 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:17.570639 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:17.570639 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:17.570639 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:17.570639 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:17.570639 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:17.570639 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:17.570639 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:17.570639 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:17.570639 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:17.570639 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:17.570639 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:34:17.570639 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:34:17.570639 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:34:17.571983 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:34:17.571983 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:17.571983 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:17.571983 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:17.571983 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:17.571983 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:17.571983 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:17.571983 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:17.571983 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:17.571983 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:17.571983 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:17.571983 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:17.571983 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:17.571983 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:17.571983 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:17.571983 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:17.571983 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:17.580545 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:34:17.580545 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:34:17.580545 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:17.580545 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:17.580545 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 501/980] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:34:17.585329 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177d4b0-47c8-449a-8e5d-104688429a1e None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:17.749911 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177d4b0-47c8-449a-8e5d-104688429a1e None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:17.787972 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54c704-cf63-4db1-a071-802e12531c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:17.788651 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54c704-cf63-4db1-a071-802e12531c1a None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:17.788928 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54c704-cf63-4db1-a071-802e12531c1a None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:17.789201 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54c704-cf63-4db1-a071-802e12531c1a None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:17.789978 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54c704-cf63-4db1-a071-802e12531c1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:17.790285 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54c704-cf63-4db1-a071-802e12531c1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:17.791681 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54c704-cf63-4db1-a071-802e12531c1a None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:17.805588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 480/981] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:17.811035 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c36bb-3035-4557-a296-50e05780c68c None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:17.929399 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c36bb-3035-4557-a296-50e05780c68c None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:17.968950 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e528f-484a-43c6-81ca-a96e2b731352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:17.969958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e528f-484a-43c6-81ca-a96e2b731352 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:17.970259 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e528f-484a-43c6-81ca-a96e2b731352 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:17.970534 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e528f-484a-43c6-81ca-a96e2b731352 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:17.978614 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e528f-484a-43c6-81ca-a96e2b731352 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:17.980114 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e528f-484a-43c6-81ca-a96e2b731352 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:17.998874 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-b55e528f-484a-43c6-81ca-a96e2b731352 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:34:17.998874 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:17.998874 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:17.998874 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:17.998874 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:17.998874 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:17.998874 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:17.998874 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:17.998874 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:17.998874 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:17.998874 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:17.998874 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:17.998874 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:34:17.998874 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:34:17.998874 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:34:17.998874 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:34:18.001527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:18.001527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:18.001527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:34:18.001527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:34:18.001527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:34:18.001527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:34:18.001527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:18.001527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:18.001527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:18.001527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:18.001527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:18.001527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:18.001527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:18.001527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:18.001527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:18.001527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:18.001527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:18.001527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:18.008709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:18.008709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:18.008709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:34:18.008709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:34:18.008709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:34:18.008709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:34:18.008709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:34:18.008709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:34:18.008709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:34:18.008709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:18.008709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 502/982] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:34:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:18.010838 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54c704-cf63-4db1-a071-802e12531c1a None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:18.145634 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54c704-cf63-4db1-a071-802e12531c1a None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:18.180184 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90a301-a058-468d-86e2-51235ad31da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:18.180861 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90a301-a058-468d-86e2-51235ad31da9 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:18.181144 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90a301-a058-468d-86e2-51235ad31da9 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:18.181441 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90a301-a058-468d-86e2-51235ad31da9 None admin] PATH_INFO: `/v3/users` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:18.182283 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90a301-a058-468d-86e2-51235ad31da9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:18.182592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90a301-a058-468d-86e2-51235ad31da9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:18.184034 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90a301-a058-468d-86e2-51235ad31da9 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:18.203842 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 481/983] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 9 15:34:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:18.209689 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e528f-484a-43c6-81ca-a96e2b731352 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:18.322991 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e528f-484a-43c6-81ca-a96e2b731352 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:18.366343 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee66657-e517-43c1-a6bc-aafb60304f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:18.367399 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee66657-e517-43c1-a6bc-aafb60304f54 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:18.367887 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee66657-e517-43c1-a6bc-aafb60304f54 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:18.368351 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee66657-e517-43c1-a6bc-aafb60304f54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:18.464435 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee66657-e517-43c1-a6bc-aafb60304f54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:18.467060 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee66657-e517-43c1-a6bc-aafb60304f54 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:18.625422 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 503/984] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:34:18 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:34:18.628903 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90a301-a058-468d-86e2-51235ad31da9 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:18.744452 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90a301-a058-468d-86e2-51235ad31da9 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:18.778441 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d34223-a3b9-46b7-9449-d9f8f1d488e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:18.779249 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d34223-a3b9-46b7-9449-d9f8f1d488e7 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:18.779535 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d34223-a3b9-46b7-9449-d9f8f1d488e7 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:18.779810 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d34223-a3b9-46b7-9449-d9f8f1d488e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:18.792923 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d34223-a3b9-46b7-9449-d9f8f1d488e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:18.794434 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d34223-a3b9-46b7-9449-d9f8f1d488e7 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:18.811879 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-53d34223-a3b9-46b7-9449-d9f8f1d488e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:18.811879 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:18.811879 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:18.811879 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:18.811879 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:18.811879 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:18.811879 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:18.811879 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:18.811879 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:18.811879 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:18.811879 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:18.811879 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:18.811879 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:34:18.811879 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:34:18.811879 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:34:18.813120 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:34:18.813120 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:18.813120 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:18.813120 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:18.813120 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:18.813120 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:18.813120 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:18.813120 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:18.813120 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:18.813120 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:18.813120 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:18.813120 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:18.813120 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:18.813120 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:18.813120 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:18.813120 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:18.813120 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:18.819088 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:34:18.819088 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:34:18.819088 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:18.819088 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:18.819088 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 482/985] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:18.819411 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee66657-e517-43c1-a6bc-aafb60304f54 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:18.919156 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee66657-e517-43c1-a6bc-aafb60304f54 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:18.953855 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed02f1-bbbf-4bf5-8227-1bcccaac5816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:18.954571 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed02f1-bbbf-4bf5-8227-1bcccaac5816 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:18.954861 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed02f1-bbbf-4bf5-8227-1bcccaac5816 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:18.955146 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed02f1-bbbf-4bf5-8227-1bcccaac5816 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:18.955878 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed02f1-bbbf-4bf5-8227-1bcccaac5816 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:18.956190 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed02f1-bbbf-4bf5-8227-1bcccaac5816 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:18.957592 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed02f1-bbbf-4bf5-8227-1bcccaac5816 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:18.978903 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 504/986] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:18.980459 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d34223-a3b9-46b7-9449-d9f8f1d488e7 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:19.079438 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d34223-a3b9-46b7-9449-d9f8f1d488e7 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:19.117148 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848eb116-e980-4141-987d-eddced728171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:19.118004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848eb116-e980-4141-987d-eddced728171 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:19.118296 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848eb116-e980-4141-987d-eddced728171 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:19.118573 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848eb116-e980-4141-987d-eddced728171 None admin] PATH_INFO: `/v3/projects/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:19.134739 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848eb116-e980-4141-987d-eddced728171 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:19.136354 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848eb116-e980-4141-987d-eddced728171 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:19.160429 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-848eb116-e980-4141-987d-eddced728171 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:34:19.160429 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:19.160429 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:19.160429 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:19.160429 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:19.160429 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:19.160429 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:19.160429 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:19.160429 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:19.160429 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:19.160429 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:19.160429 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:19.160429 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:34:19.160429 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:34:19.160429 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:34:19.161579 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:34:19.161579 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:19.161579 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:19.161579 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:19.161579 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:19.161579 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:19.161579 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:19.161579 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:19.161579 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:19.161579 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:19.161579 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:19.161579 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:19.161579 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:19.161579 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:19.161579 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:19.161579 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:19.161579 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:19.167772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:34:19.167772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:34:19.167772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:34:19.167772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:34:19.167772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:34:19.167772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:34:19.167772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:34:19.167772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:19.167772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 483/987] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:34:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:34:19.168351 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed02f1-bbbf-4bf5-8227-1bcccaac5816 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:19.275713 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed02f1-bbbf-4bf5-8227-1bcccaac5816 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:19.310180 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b794e6-9d19-4f65-a417-b8ab8712d27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:19.310848 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b794e6-9d19-4f65-a417-b8ab8712d27f None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:19.311135 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b794e6-9d19-4f65-a417-b8ab8712d27f None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:19.311409 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b794e6-9d19-4f65-a417-b8ab8712d27f None admin] PATH_INFO: `/v3/projects` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:19.312413 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b794e6-9d19-4f65-a417-b8ab8712d27f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:19.312887 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b794e6-9d19-4f65-a417-b8ab8712d27f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:19.314555 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b794e6-9d19-4f65-a417-b8ab8712d27f None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:19.327385 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 505/988] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:34:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:19.333625 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848eb116-e980-4141-987d-eddced728171 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:19.434264 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848eb116-e980-4141-987d-eddced728171 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:19.468239 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa8779-0a2e-45f8-a370-0cde94d31c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:19.469593 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa8779-0a2e-45f8-a370-0cde94d31c4d None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:19.469878 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa8779-0a2e-45f8-a370-0cde94d31c4d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:19.470155 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa8779-0a2e-45f8-a370-0cde94d31c4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:19.470994 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa8779-0a2e-45f8-a370-0cde94d31c4d None admin] RBAC: Adding query filter params (role.id=61a5e0d3dab54d758c4f70299c19f603, scope.project.id=db5768a93e754372808fc69f898cc853, user.id=8fcb1b0006d94847be30b28f17d041e3) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:19.471303 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa8779-0a2e-45f8-a370-0cde94d31c4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:19.472763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa8779-0a2e-45f8-a370-0cde94d31c4d None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:19.484853 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 484/989] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:34:19 2022] GET /identity/v3/role_assignments?user.id=8fcb1b0006d94847be30b28f17d041e3&scope.project.id=db5768a93e754372808fc69f898cc853&role.id=61a5e0d3dab54d758c4f70299c19f603 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:19.723480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfe57f-91e7-4a5d-929b-2564c4499932 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:19.723859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfe57f-91e7-4a5d-929b-2564c4499932 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:19.724046 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfe57f-91e7-4a5d-929b-2564c4499932 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:19.725726 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 506/990] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:19.731188 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a470d02-db8b-4fa0-a0ee-3d195d7b7816 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:19.731671 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a470d02-db8b-4fa0-a0ee-3d195d7b7816 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:19.731764 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a470d02-db8b-4fa0-a0ee-3d195d7b7816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:19.749008 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-2a470d02-db8b-4fa0-a0ee-3d195d7b7816 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:19.750540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-2a470d02-db8b-4fa0-a0ee-3d195d7b7816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:19.817057 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 485/991] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:19.834507 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21b640-69b3-47df-8b95-97e2145c449c None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:19.834796 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21b640-69b3-47df-8b95-97e2145c449c None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:19.835079 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21b640-69b3-47df-8b95-97e2145c449c None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:19.836463 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 507/992] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:19.839921 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a470d02-db8b-4fa0-a0ee-3d195d7b7816 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:19.841803 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efb604-2ce0-4c7a-8688-d05d7ce9bb48 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:19.842095 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efb604-2ce0-4c7a-8688-d05d7ce9bb48 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:19.842381 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93efb604-2ce0-4c7a-8688-d05d7ce9bb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:19.859531 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-93efb604-2ce0-4c7a-8688-d05d7ce9bb48 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:19.860732 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-93efb604-2ce0-4c7a-8688-d05d7ce9bb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:19.929431 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 508/993] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:34:19.942866 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a470d02-db8b-4fa0-a0ee-3d195d7b7816 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:19.953401 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efb604-2ce0-4c7a-8688-d05d7ce9bb48 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:19.978241 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586de18-3f30-4642-9a0b-7f5df86290fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:19.979049 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586de18-3f30-4642-9a0b-7f5df86290fe None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:19.979335 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586de18-3f30-4642-9a0b-7f5df86290fe None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:19.979613 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586de18-3f30-4642-9a0b-7f5df86290fe None admin] PATH_INFO: `/v3/services/compute` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:19.980268 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586de18-3f30-4642-9a0b-7f5df86290fe None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:19.981681 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586de18-3f30-4642-9a0b-7f5df86290fe None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:19.994026 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-c586de18-3f30-4642-9a0b-7f5df86290fe None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:34:19.994026 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:19.994026 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:34:19.994026 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:34:19.994026 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:34:19.994026 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:34:19.994026 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:34:19.994026 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:19.994026 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:34:19.994026 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:19.994026 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:34:19.994026 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:19.994026 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:19.994026 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:19.994026 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:19.994026 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:19.994026 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:19.995174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:19.995174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:19.995174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:19.995174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:19.995174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:19.995174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:19.995174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:34:19.995174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:34:19.995174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:34:19.995174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:34:19.995174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:19.995174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:19.995174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:19.995174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:19.995174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:19.995174 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:19.996403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:19.996403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:19.996403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:19.996403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:19.996403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:19.996403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:19.996403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:19.996403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:19.996403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:19.996403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:19.996403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:34:19.996403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:19.996403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:34:19.996403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:19.996403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 486/994] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:34:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:20.002869 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586de18-3f30-4642-9a0b-7f5df86290fe None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:20.060525 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93efb604-2ce0-4c7a-8688-d05d7ce9bb48 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:20.096035 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9e8fe-1fa0-4ea4-a32e-9859d0f20033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:20.096861 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9e8fe-1fa0-4ea4-a32e-9859d0f20033 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:20.097144 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9e8fe-1fa0-4ea4-a32e-9859d0f20033 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:20.097448 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9e8fe-1fa0-4ea4-a32e-9859d0f20033 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:20.098112 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9e8fe-1fa0-4ea4-a32e-9859d0f20033 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:20.099488 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9e8fe-1fa0-4ea4-a32e-9859d0f20033 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:20.104524 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586de18-3f30-4642-9a0b-7f5df86290fe None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:20.112564 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-23e9e8fe-1fa0-4ea4-a32e-9859d0f20033 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:34:20.112564 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:20.112564 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:34:20.112564 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:34:20.112564 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:34:20.112564 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:34:20.112564 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:34:20.112564 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:20.112564 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:34:20.112564 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:20.112564 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:34:20.112564 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:20.112564 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:20.112564 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:20.112564 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:20.112564 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:20.112564 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:20.113883 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:20.113883 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:20.113883 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:20.113883 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:20.113883 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:20.113883 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:20.113883 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:34:20.113883 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:34:20.113883 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:34:20.113883 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:34:20.113883 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:20.113883 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:20.113883 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:20.113883 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:20.113883 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:20.113883 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:20.114824 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:20.114824 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:20.114824 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:20.114824 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:20.114824 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:20.114824 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:20.114824 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:20.114824 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:20.114824 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:20.114824 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:20.114824 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:34:20.114824 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:20.114824 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:34:20.114824 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:20.114824 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 509/995] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:34:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:34:20.120916 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9e8fe-1fa0-4ea4-a32e-9859d0f20033 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:20.143651 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb5a57-9bc8-448f-b853-d10f091fe161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:20.144326 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb5a57-9bc8-448f-b853-d10f091fe161 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:20.144606 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb5a57-9bc8-448f-b853-d10f091fe161 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:20.144881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb5a57-9bc8-448f-b853-d10f091fe161 None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:20.145614 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb5a57-9bc8-448f-b853-d10f091fe161 None admin] RBAC: Adding query filter params (name=compute) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:20.145921 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb5a57-9bc8-448f-b853-d10f091fe161 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:20.147309 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb5a57-9bc8-448f-b853-d10f091fe161 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:20.157645 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 487/996] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:34:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:20.159192 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb5a57-9bc8-448f-b853-d10f091fe161 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:20.225255 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9e8fe-1fa0-4ea4-a32e-9859d0f20033 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:20.261532 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53803fe4-ab0d-43d1-9b33-63c374cf0a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:20.262401 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53803fe4-ab0d-43d1-9b33-63c374cf0a49 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:20.262529 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53803fe4-ab0d-43d1-9b33-63c374cf0a49 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:20.262767 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53803fe4-ab0d-43d1-9b33-63c374cf0a49 None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:20.263384 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb5a57-9bc8-448f-b853-d10f091fe161 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:20.263488 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53803fe4-ab0d-43d1-9b33-63c374cf0a49 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:20.264070 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53803fe4-ab0d-43d1-9b33-63c374cf0a49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:20.266595 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53803fe4-ab0d-43d1-9b33-63c374cf0a49 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:20.276367 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 510/997] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:34:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:20.277197 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53803fe4-ab0d-43d1-9b33-63c374cf0a49 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:20.312526 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23ee11-b678-4a84-93fe-d66f7571f49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:20.313512 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23ee11-b678-4a84-93fe-d66f7571f49a None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:20.313818 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23ee11-b678-4a84-93fe-d66f7571f49a None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:20.314104 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23ee11-b678-4a84-93fe-d66f7571f49a None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:20.314831 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23ee11-b678-4a84-93fe-d66f7571f49a None admin] RBAC: Adding query filter params (type=compute) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:20.315320 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23ee11-b678-4a84-93fe-d66f7571f49a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:20.317624 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23ee11-b678-4a84-93fe-d66f7571f49a None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:20.329429 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 488/998] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:34:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:20.330552 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23ee11-b678-4a84-93fe-d66f7571f49a None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:20.383921 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53803fe4-ab0d-43d1-9b33-63c374cf0a49 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:20.420213 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc199c5-64c8-488c-90d3-7d5cc0416a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:20.420975 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc199c5-64c8-488c-90d3-7d5cc0416a05 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:20.421327 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc199c5-64c8-488c-90d3-7d5cc0416a05 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:20.421638 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc199c5-64c8-488c-90d3-7d5cc0416a05 None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:20.422351 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc199c5-64c8-488c-90d3-7d5cc0416a05 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:20.422657 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc199c5-64c8-488c-90d3-7d5cc0416a05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:20.424045 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc199c5-64c8-488c-90d3-7d5cc0416a05 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:20.429237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 511/999] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:34:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:20.434693 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc199c5-64c8-488c-90d3-7d5cc0416a05 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:20.444189 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23ee11-b678-4a84-93fe-d66f7571f49a None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:20.480177 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2da29-23d1-4637-8d9d-888e8cf567dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:20.481118 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2da29-23d1-4637-8d9d-888e8cf567dd None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:20.481433 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2da29-23d1-4637-8d9d-888e8cf567dd None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:20.481727 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2da29-23d1-4637-8d9d-888e8cf567dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:20.482516 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2da29-23d1-4637-8d9d-888e8cf567dd None admin] RBAC: Adding query filter params (interface=public, service_id=b5289512c56c47cab7cfad677c5f8023, region_id=RegionOne) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:20.483051 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2da29-23d1-4637-8d9d-888e8cf567dd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:20.484392 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2da29-23d1-4637-8d9d-888e8cf567dd None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:20.494590 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 489/1000] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:34:20 2022] GET /identity/v3/endpoints?service_id=b5289512c56c47cab7cfad677c5f8023&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:20.495321 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2da29-23d1-4637-8d9d-888e8cf567dd None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:20.538926 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc199c5-64c8-488c-90d3-7d5cc0416a05 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:20.571629 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59111515-65eb-4e01-8528-ac62ae674b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:20.572309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59111515-65eb-4e01-8528-ac62ae674b59 None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:20.572598 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59111515-65eb-4e01-8528-ac62ae674b59 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:20.572881 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59111515-65eb-4e01-8528-ac62ae674b59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:20.573665 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59111515-65eb-4e01-8528-ac62ae674b59 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:20.575045 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59111515-65eb-4e01-8528-ac62ae674b59 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:20.597635 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 512/1001] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:34:20 2022] POST /identity/v3/endpoints => generated 325 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:34:20.605617 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2da29-23d1-4637-8d9d-888e8cf567dd None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:20.678345 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7fcf0-4ed9-4017-b66f-308055727426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:20.679204 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7fcf0-4ed9-4017-b66f-308055727426 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:20.679617 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7fcf0-4ed9-4017-b66f-308055727426 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:20.680002 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7fcf0-4ed9-4017-b66f-308055727426 None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:20.680846 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7fcf0-4ed9-4017-b66f-308055727426 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:20.682445 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7fcf0-4ed9-4017-b66f-308055727426 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:20.690339 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 490/1002] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:34:20 2022] GET /identity/v3/services => generated 1727 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 15:34:21.792754 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecf4e1-e792-4711-beaa-46900f2664e9 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:21.793322 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecf4e1-e792-4711-beaa-46900f2664e9 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:21.793322 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecf4e1-e792-4711-beaa-46900f2664e9 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:21.794697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 513/1003] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:21.800370 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed143313-77c8-45be-b5b8-49879a185f45 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:21.800815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed143313-77c8-45be-b5b8-49879a185f45 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:21.801022 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed143313-77c8-45be-b5b8-49879a185f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:21.817653 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-ed143313-77c8-45be-b5b8-49879a185f45 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:21.818856 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-ed143313-77c8-45be-b5b8-49879a185f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:21.893689 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 491/1004] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:21 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:21.915303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecf4e1-e792-4711-beaa-46900f2664e9 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:22.017310 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecf4e1-e792-4711-beaa-46900f2664e9 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:22.050491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e2971-4592-4b4f-a5a8-bde284d8b721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:22.051291 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e2971-4592-4b4f-a5a8-bde284d8b721 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:22.051574 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e2971-4592-4b4f-a5a8-bde284d8b721 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:22.051849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e2971-4592-4b4f-a5a8-bde284d8b721 None admin] PATH_INFO: `/v3/services/image` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:22.052509 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e2971-4592-4b4f-a5a8-bde284d8b721 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:22.053905 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e2971-4592-4b4f-a5a8-bde284d8b721 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:22.065296 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-8d3e2971-4592-4b4f-a5a8-bde284d8b721 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:34:22.065296 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:22.065296 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:34:22.065296 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:34:22.065296 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:34:22.065296 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:34:22.065296 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:34:22.065296 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:22.065296 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:34:22.065296 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:22.065296 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:34:22.065296 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:22.065296 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:22.065296 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:22.065296 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:22.065296 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:22.065296 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:22.066419 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:22.066419 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:22.066419 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:22.066419 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:22.066419 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:22.066419 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:22.066419 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:34:22.066419 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:34:22.066419 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:34:22.066419 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:34:22.066419 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:22.066419 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:22.066419 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:22.066419 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:22.066419 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:22.066419 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:22.067913 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:22.067913 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:22.067913 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:22.067913 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:22.067913 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:22.067913 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:22.067913 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:22.067913 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:22.067913 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:22.067913 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:22.067913 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:34:22.067913 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:22.067913 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:34:22.067913 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:22.069135 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 514/1005] 10.222.0.48 () {56 vars in 1105 bytes} [Mon May 9 15:34:21 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:22.072432 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed143313-77c8-45be-b5b8-49879a185f45 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:22.170695 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed143313-77c8-45be-b5b8-49879a185f45 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:22.205650 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a2c54-63b8-401b-88d6-71adc81e5649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:22.206322 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a2c54-63b8-401b-88d6-71adc81e5649 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:22.206606 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a2c54-63b8-401b-88d6-71adc81e5649 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:22.206883 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a2c54-63b8-401b-88d6-71adc81e5649 None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:22.207591 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a2c54-63b8-401b-88d6-71adc81e5649 None admin] RBAC: Adding query filter params (name=image) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:22.207897 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a2c54-63b8-401b-88d6-71adc81e5649 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:22.209281 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a2c54-63b8-401b-88d6-71adc81e5649 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:22.217448 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 492/1006] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:22.220527 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e2971-4592-4b4f-a5a8-bde284d8b721 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:22.322611 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e2971-4592-4b4f-a5a8-bde284d8b721 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:22.356499 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9819b2-dbde-4da1-a990-d47a8bdbd818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:22.357174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9819b2-dbde-4da1-a990-d47a8bdbd818 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:22.357619 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9819b2-dbde-4da1-a990-d47a8bdbd818 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:22.357821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9819b2-dbde-4da1-a990-d47a8bdbd818 None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:22.358484 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9819b2-dbde-4da1-a990-d47a8bdbd818 None admin] RBAC: Adding query filter params (type=image) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:22.358810 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9819b2-dbde-4da1-a990-d47a8bdbd818 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:22.360197 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9819b2-dbde-4da1-a990-d47a8bdbd818 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:22.373703 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 515/1007] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:22 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:22.917250 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e8b53-ce9b-44eb-813f-0f32ffcf9a11 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:22.917808 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e8b53-ce9b-44eb-813f-0f32ffcf9a11 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:22.917808 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e8b53-ce9b-44eb-813f-0f32ffcf9a11 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:22.919297 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 493/1008] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:22.924722 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518e108-14ed-463a-be96-99d32fc5183d None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:22.925245 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518e108-14ed-463a-be96-99d32fc5183d None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:22.925340 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518e108-14ed-463a-be96-99d32fc5183d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:22.942709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-a518e108-14ed-463a-be96-99d32fc5183d None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:22.943914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-a518e108-14ed-463a-be96-99d32fc5183d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:22.988786 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd45cdc-204e-4ae3-8f19-aaf614560cf4 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:22.989155 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd45cdc-204e-4ae3-8f19-aaf614560cf4 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:22.989362 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd45cdc-204e-4ae3-8f19-aaf614560cf4 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:22.990964 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 494/1009] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:22.996345 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2aa2fa-1854-4440-a489-4a29b249db59 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:22.996637 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2aa2fa-1854-4440-a489-4a29b249db59 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:22.996926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2aa2fa-1854-4440-a489-4a29b249db59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:23.018712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-3b2aa2fa-1854-4440-a489-4a29b249db59 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:23.020479 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-3b2aa2fa-1854-4440-a489-4a29b249db59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:23.022000 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 516/1010] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:22 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:23.045237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518e108-14ed-463a-be96-99d32fc5183d None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:23.097342 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 495/1011] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:22 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:34:23.120952 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2aa2fa-1854-4440-a489-4a29b249db59 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:23.156217 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518e108-14ed-463a-be96-99d32fc5183d None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:23.197999 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b1b0d-528e-4f22-9961-a7830b76b5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:23.198838 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b1b0d-528e-4f22-9961-a7830b76b5d1 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:23.199103 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b1b0d-528e-4f22-9961-a7830b76b5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:23.199381 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b1b0d-528e-4f22-9961-a7830b76b5d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:23.200613 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b1b0d-528e-4f22-9961-a7830b76b5d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:23.202122 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b1b0d-528e-4f22-9961-a7830b76b5d1 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:23.204774 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 517/1012] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:23.211112 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b1b0d-528e-4f22-9961-a7830b76b5d1 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:23.236525 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2aa2fa-1854-4440-a489-4a29b249db59 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:23.275912 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d489fa-775f-41fc-b5e9-b464217c511c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:23.276720 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d489fa-775f-41fc-b5e9-b464217c511c None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:23.277086 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d489fa-775f-41fc-b5e9-b464217c511c None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:23.277401 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d489fa-775f-41fc-b5e9-b464217c511c None admin] PATH_INFO: `/v3/services/compute` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:23.278072 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d489fa-775f-41fc-b5e9-b464217c511c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:23.279482 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d489fa-775f-41fc-b5e9-b464217c511c None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:23.292305 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-69d489fa-775f-41fc-b5e9-b464217c511c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:34:23.292305 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:23.292305 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:34:23.292305 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:34:23.292305 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:34:23.292305 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:34:23.292305 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:34:23.292305 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:23.292305 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:34:23.292305 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:23.292305 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:34:23.292305 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:23.292305 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:23.292305 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:23.292305 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:23.292305 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:23.292305 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:23.293540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:23.293540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:23.293540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:23.293540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:23.293540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:23.293540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:23.293540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:34:23.293540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:34:23.293540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:34:23.293540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:34:23.293540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:23.293540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:23.293540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:23.293540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:23.293540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:23.293540 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:23.294525 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:23.294525 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:23.294525 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:23.294525 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:23.294525 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:23.294525 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:23.294525 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:23.294525 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:23.294525 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:23.294525 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:23.294525 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:34:23.294525 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:23.294525 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:34:23.294525 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:23.294525 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 496/1013] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:34:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:34:23.300691 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d489fa-775f-41fc-b5e9-b464217c511c None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:23.338173 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b1b0d-528e-4f22-9961-a7830b76b5d1 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:23.380850 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c8d9b-b820-456a-a161-21a10956d9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:23.381555 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c8d9b-b820-456a-a161-21a10956d9db None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:23.381848 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c8d9b-b820-456a-a161-21a10956d9db None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:23.382137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c8d9b-b820-456a-a161-21a10956d9db None admin] PATH_INFO: `/v3/projects` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:23.382862 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c8d9b-b820-456a-a161-21a10956d9db None admin] RBAC: Authorizing `identity:create_project()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:23.384326 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c8d9b-b820-456a-a161-21a10956d9db None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:23.415993 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 518/1014] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:34:23 2022] POST /identity/v3/projects => generated 311 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:34:23.417468 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d489fa-775f-41fc-b5e9-b464217c511c None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:23.460370 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d91448-ce38-4eb4-a27e-0762e68b671d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:23.460810 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d91448-ce38-4eb4-a27e-0762e68b671d None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:23.461083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d91448-ce38-4eb4-a27e-0762e68b671d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:23.461417 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d91448-ce38-4eb4-a27e-0762e68b671d None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:23.462147 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d91448-ce38-4eb4-a27e-0762e68b671d None admin] RBAC: Adding query filter params (name=compute) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:23.462461 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d91448-ce38-4eb4-a27e-0762e68b671d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:23.463917 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d91448-ce38-4eb4-a27e-0762e68b671d None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:23.470774 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 497/1015] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:34:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:23.476426 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c8d9b-b820-456a-a161-21a10956d9db None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:23.628977 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c8d9b-b820-456a-a161-21a10956d9db None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:23.667093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25b280-6651-4500-becc-c7d049682b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:23.668044 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25b280-6651-4500-becc-c7d049682b8b None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:23.668531 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25b280-6651-4500-becc-c7d049682b8b None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:23.668987 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25b280-6651-4500-becc-c7d049682b8b None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:23.669760 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25b280-6651-4500-becc-c7d049682b8b None admin] RBAC: Adding query filter params (type=compute) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:23.670206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25b280-6651-4500-becc-c7d049682b8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:23.671519 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25b280-6651-4500-becc-c7d049682b8b None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:23.677655 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 519/1016] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:34:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:23.683291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d91448-ce38-4eb4-a27e-0762e68b671d None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:23.798082 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d91448-ce38-4eb4-a27e-0762e68b671d None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:23.832495 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22627d14-13bd-43a1-8206-031f2efc9ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:23.833163 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22627d14-13bd-43a1-8206-031f2efc9ef7 None admin] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:23.833474 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22627d14-13bd-43a1-8206-031f2efc9ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:23.833761 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22627d14-13bd-43a1-8206-031f2efc9ef7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:23.834516 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22627d14-13bd-43a1-8206-031f2efc9ef7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:23.835895 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22627d14-13bd-43a1-8206-031f2efc9ef7 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:23.854716 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 498/1017] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:34:23 2022] POST /identity/v3/endpoints => generated 334 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:34:24.675070 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ee4d0-1488-4496-ad9c-3722dfd0fd92 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:24.675649 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ee4d0-1488-4496-ad9c-3722dfd0fd92 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:24.675649 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ee4d0-1488-4496-ad9c-3722dfd0fd92 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:24.677127 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 520/1018] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:24.683433 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288d3f2-e4b6-4d35-9d99-d0a6491ce67b None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:24.683955 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288d3f2-e4b6-4d35-9d99-d0a6491ce67b None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:24.684061 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288d3f2-e4b6-4d35-9d99-d0a6491ce67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:24.701407 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-2288d3f2-e4b6-4d35-9d99-d0a6491ce67b None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:24.702637 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-2288d3f2-e4b6-4d35-9d99-d0a6491ce67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:24.780444 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 499/1019] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:24 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:24.804303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ee4d0-1488-4496-ad9c-3722dfd0fd92 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:24.944118 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ee4d0-1488-4496-ad9c-3722dfd0fd92 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:24.977934 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedaca5e-7c76-4cf5-8409-27164aba6473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:24.978596 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedaca5e-7c76-4cf5-8409-27164aba6473 None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:24.978879 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedaca5e-7c76-4cf5-8409-27164aba6473 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:24.979154 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedaca5e-7c76-4cf5-8409-27164aba6473 None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:24.979877 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedaca5e-7c76-4cf5-8409-27164aba6473 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:24.981243 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedaca5e-7c76-4cf5-8409-27164aba6473 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:25.000790 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 521/1020] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:34:24 2022] POST /identity/v3/services => generated 242 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:34:25.879162 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec71523-04f4-4368-8e7e-f3c863df04e9 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:25.879700 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec71523-04f4-4368-8e7e-f3c863df04e9 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:25.879700 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec71523-04f4-4368-8e7e-f3c863df04e9 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:25.881208 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 500/1021] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:25.887273 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f0365-7acd-4b19-9ba2-4e508f1f5f87 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:25.887810 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f0365-7acd-4b19-9ba2-4e508f1f5f87 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:25.887896 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f0365-7acd-4b19-9ba2-4e508f1f5f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:25.905438 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-dc4f0365-7acd-4b19-9ba2-4e508f1f5f87 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:25.907397 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-dc4f0365-7acd-4b19-9ba2-4e508f1f5f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:25.981691 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 522/1022] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:26.007103 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec71523-04f4-4368-8e7e-f3c863df04e9 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:26.113276 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec71523-04f4-4368-8e7e-f3c863df04e9 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:26.154186 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afe455-6173-422e-8d38-484e20c78944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:26.155451 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afe455-6173-422e-8d38-484e20c78944 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:26.156500 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afe455-6173-422e-8d38-484e20c78944 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:26.157079 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afe455-6173-422e-8d38-484e20c78944 None admin] PATH_INFO: `/v3/domains/default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:26.158641 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32afe455-6173-422e-8d38-484e20c78944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:26.160502 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32afe455-6173-422e-8d38-484e20c78944 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:26.162831 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 501/1023] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:26.168569 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f0365-7acd-4b19-9ba2-4e508f1f5f87 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:26.274305 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f0365-7acd-4b19-9ba2-4e508f1f5f87 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:26.302221 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32133ceb-590d-4c46-afca-deb4b46449b2 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:26.302853 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32133ceb-590d-4c46-afca-deb4b46449b2 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:26.303213 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32133ceb-590d-4c46-afca-deb4b46449b2 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:26.304834 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 502/1024] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:34:26.310232 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34599b5a-e4b4-4ad2-9e02-604f4ba10785 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:26.310524 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34599b5a-e4b4-4ad2-9e02-604f4ba10785 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:26.310713 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751265f6-6b78-4a5f-a180-294051e1676b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:26.310840 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34599b5a-e4b4-4ad2-9e02-604f4ba10785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:26.311356 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751265f6-6b78-4a5f-a180-294051e1676b None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:26.311643 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751265f6-6b78-4a5f-a180-294051e1676b None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:26.312049 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751265f6-6b78-4a5f-a180-294051e1676b None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:26.312991 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751265f6-6b78-4a5f-a180-294051e1676b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:26.314461 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751265f6-6b78-4a5f-a180-294051e1676b None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:26.331006 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-34599b5a-e4b4-4ad2-9e02-604f4ba10785 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:26.332338 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-34599b5a-e4b4-4ad2-9e02-604f4ba10785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:26.345405 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 523/1025] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:34:26 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:34:26.412053 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 503/1026] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:26.439784 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751265f6-6b78-4a5f-a180-294051e1676b None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:26.561573 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751265f6-6b78-4a5f-a180-294051e1676b None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:26.596970 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0c19c-cd9c-4796-9863-82e2c2d22dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:26.597907 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0c19c-cd9c-4796-9863-82e2c2d22dce None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:26.598134 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0c19c-cd9c-4796-9863-82e2c2d22dce None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:26.598415 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0c19c-cd9c-4796-9863-82e2c2d22dce None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:26.613972 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba0c19c-cd9c-4796-9863-82e2c2d22dce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:34:26.623239 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-5ba0c19c-cd9c-4796-9863-82e2c2d22dce None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:34:26.623239 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:26.623239 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:26.623239 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:26.623239 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:26.623239 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:26.623239 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:26.623239 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:26.623239 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:26.623239 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:26.623239 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:26.623239 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:26.623239 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:34:26.623239 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:34:26.623239 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:34:26.623239 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:34:26.625206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:34:26.625206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:34:26.625206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:34:26.625206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:34:26.625206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:26.625206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:26.625206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:26.625206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:26.625206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:26.625206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:26.625206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:26.625206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:26.625206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:26.625206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:26.625206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:26.625206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:26.626480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:26.626480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:26.626480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:26.626480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:26.626480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:34:26.626480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:34:26.626480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:34:26.626480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:34:26.626480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:34:26.626480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:34:26.626480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:34:26.626480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:26.626480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 524/1027] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 9 15:34:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:34:26.633990 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34599b5a-e4b4-4ad2-9e02-604f4ba10785 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:26.744184 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34599b5a-e4b4-4ad2-9e02-604f4ba10785 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:26.782213 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed096ab-a84d-4df7-bdef-e88d9f082783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:26.782910 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed096ab-a84d-4df7-bdef-e88d9f082783 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:26.783197 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed096ab-a84d-4df7-bdef-e88d9f082783 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:26.783479 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed096ab-a84d-4df7-bdef-e88d9f082783 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:26.784243 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed096ab-a84d-4df7-bdef-e88d9f082783 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:26.784555 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed096ab-a84d-4df7-bdef-e88d9f082783 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:26.785995 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed096ab-a84d-4df7-bdef-e88d9f082783 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:26.800928 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 504/1028] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:34:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:26.802357 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0c19c-cd9c-4796-9863-82e2c2d22dce None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:26.909550 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0c19c-cd9c-4796-9863-82e2c2d22dce None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:26.950047 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46338e7b-1c6d-48f5-ae3e-1e6a7eea513a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:26.950891 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46338e7b-1c6d-48f5-ae3e-1e6a7eea513a None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:26.951170 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46338e7b-1c6d-48f5-ae3e-1e6a7eea513a None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:26.951445 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46338e7b-1c6d-48f5-ae3e-1e6a7eea513a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:26.965265 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46338e7b-1c6d-48f5-ae3e-1e6a7eea513a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:26.966795 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46338e7b-1c6d-48f5-ae3e-1e6a7eea513a None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:26.985697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-46338e7b-1c6d-48f5-ae3e-1e6a7eea513a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:26.985697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:26.985697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:26.985697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:26.985697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:26.985697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:26.985697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:26.985697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:26.985697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:26.985697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:26.985697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:26.985697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:26.985697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:34:26.985697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:34:26.985697 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:34:26.986792 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:34:26.986792 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:26.986792 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:26.986792 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:26.986792 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:26.986792 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:26.986792 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:26.986792 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:26.986792 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:26.986792 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:26.986792 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:26.986792 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:26.986792 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:26.986792 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:26.986792 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:26.986792 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:26.986792 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:26.987825 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:34:26.987825 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:34:26.987825 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:26.987825 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:26.989715 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 525/1029] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:26.992650 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed096ab-a84d-4df7-bdef-e88d9f082783 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:27.100070 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed096ab-a84d-4df7-bdef-e88d9f082783 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:27.143553 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78c422-3bc2-4916-843f-fea770451aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:27.144257 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78c422-3bc2-4916-843f-fea770451aa1 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:27.144539 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78c422-3bc2-4916-843f-fea770451aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:27.144816 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78c422-3bc2-4916-843f-fea770451aa1 None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:27.145596 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78c422-3bc2-4916-843f-fea770451aa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:27.145903 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78c422-3bc2-4916-843f-fea770451aa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:27.147307 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78c422-3bc2-4916-843f-fea770451aa1 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:27.160871 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 505/1030] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:27.166352 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46338e7b-1c6d-48f5-ae3e-1e6a7eea513a None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:27.275483 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46338e7b-1c6d-48f5-ae3e-1e6a7eea513a None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:27.311010 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56040314-acc0-42df-81ee-5d83dc9f861a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:27.312409 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56040314-acc0-42df-81ee-5d83dc9f861a None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:27.313020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56040314-acc0-42df-81ee-5d83dc9f861a None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:27.313571 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56040314-acc0-42df-81ee-5d83dc9f861a None admin] PATH_INFO: `/v3/users/nova` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:27.322180 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56040314-acc0-42df-81ee-5d83dc9f861a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:27.323961 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56040314-acc0-42df-81ee-5d83dc9f861a None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:27.339635 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-56040314-acc0-42df-81ee-5d83dc9f861a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:34:27.339635 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:27.339635 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:27.339635 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:27.339635 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:27.339635 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:27.339635 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:27.339635 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:27.339635 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:27.339635 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:27.339635 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:27.339635 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:27.339635 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:34:27.339635 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:34:27.339635 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:34:27.339635 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:34:27.340772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:27.340772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:27.340772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:34:27.340772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:34:27.340772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:34:27.340772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:34:27.340772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:27.340772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:27.340772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:27.340772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:27.340772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:27.340772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:27.340772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:27.340772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:27.340772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:27.340772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:27.340772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:27.340772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:27.341882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:27.341882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:27.341882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:34:27.341882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:34:27.341882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:34:27.341882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:34:27.341882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:34:27.341882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:34:27.341882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:34:27.341882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:27.345554 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 526/1031] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:34:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:27.349239 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78c422-3bc2-4916-843f-fea770451aa1 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:27.416360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd9614-d407-4e49-9cf8-4f83233b037f None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:27.416600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd9614-d407-4e49-9cf8-4f83233b037f None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:27.416940 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd9614-d407-4e49-9cf8-4f83233b037f None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:27.418733 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 527/1032] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:34:27.425152 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a8a05-0afa-43fe-9417-479286748c50 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:27.425825 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a8a05-0afa-43fe-9417-479286748c50 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:27.426116 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a8a05-0afa-43fe-9417-479286748c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:27.445738 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-b66a8a05-0afa-43fe-9417-479286748c50 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:27.446960 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-b66a8a05-0afa-43fe-9417-479286748c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:27.485255 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78c422-3bc2-4916-843f-fea770451aa1 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:27.525038 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 528/1033] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:27.534941 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226334c-34e2-44fc-a44a-615dd92351f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:27.535621 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226334c-34e2-44fc-a44a-615dd92351f1 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:27.535911 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226334c-34e2-44fc-a44a-615dd92351f1 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:27.536193 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226334c-34e2-44fc-a44a-615dd92351f1 None admin] PATH_INFO: `/v3/users` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:27.537042 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226334c-34e2-44fc-a44a-615dd92351f1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:27.537357 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226334c-34e2-44fc-a44a-615dd92351f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:27.538834 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226334c-34e2-44fc-a44a-615dd92351f1 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:27.548825 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a8a05-0afa-43fe-9417-479286748c50 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:27.563760 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 506/1034] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:34:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:27.565432 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226334c-34e2-44fc-a44a-615dd92351f1 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:27.662597 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a8a05-0afa-43fe-9417-479286748c50 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:27.691118 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226334c-34e2-44fc-a44a-615dd92351f1 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:27.709886 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b921b-36a4-4f78-9af1-b6f80398099b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:27.710735 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b921b-36a4-4f78-9af1-b6f80398099b None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:27.711026 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b921b-36a4-4f78-9af1-b6f80398099b None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:27.711306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b921b-36a4-4f78-9af1-b6f80398099b None admin] PATH_INFO: `/v3/services/image` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:27.712011 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b921b-36a4-4f78-9af1-b6f80398099b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:27.713532 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b921b-36a4-4f78-9af1-b6f80398099b None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:27.727543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-e34b921b-36a4-4f78-9af1-b6f80398099b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:34:27.727543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:27.727543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:34:27.727543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:34:27.727543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:34:27.727543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:34:27.727543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:34:27.727543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:27.727543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:34:27.727543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:27.727543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:34:27.727543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:27.727543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:27.727543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:27.727543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:27.727543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:27.727543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:27.728882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:27.728882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:27.728882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:27.728882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:27.728882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:27.728882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:27.728882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:34:27.728882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:34:27.728882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:34:27.728882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:34:27.728882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:27.728882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:27.728882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:27.728882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:27.728882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:27.728882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:27.729902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:27.729902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:27.729902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:27.729902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:27.729902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:27.729902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:27.729902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:27.729902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:27.729902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:27.729902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:27.729902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:34:27.729902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:27.729902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:34:27.729902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:27.729902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 529/1035] 10.222.0.48 () {56 vars in 1105 bytes} [Mon May 9 15:34:27 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:34:27.736264 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b921b-36a4-4f78-9af1-b6f80398099b None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:27.736440 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5953ca5-9fe8-44e3-b963-eca173388910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:27.737075 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5953ca5-9fe8-44e3-b963-eca173388910 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:27.737361 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5953ca5-9fe8-44e3-b963-eca173388910 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:27.737672 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5953ca5-9fe8-44e3-b963-eca173388910 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:27.814807 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5953ca5-9fe8-44e3-b963-eca173388910 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:27.816297 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5953ca5-9fe8-44e3-b963-eca173388910 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:27.845196 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b921b-36a4-4f78-9af1-b6f80398099b None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:27.881072 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1cb89-92a3-4e8e-a749-604efbd2ae8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:27.881783 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1cb89-92a3-4e8e-a749-604efbd2ae8f None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:27.882073 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1cb89-92a3-4e8e-a749-604efbd2ae8f None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:27.882355 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1cb89-92a3-4e8e-a749-604efbd2ae8f None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:27.883075 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1cb89-92a3-4e8e-a749-604efbd2ae8f None admin] RBAC: Adding query filter params (name=image) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:27.883387 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1cb89-92a3-4e8e-a749-604efbd2ae8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:27.884780 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1cb89-92a3-4e8e-a749-604efbd2ae8f None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:27.892007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 530/1036] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:27.897811 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1cb89-92a3-4e8e-a749-604efbd2ae8f None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:27.923846 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 507/1037] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:34:27 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:34:27.929338 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5953ca5-9fe8-44e3-b963-eca173388910 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:28.004832 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1cb89-92a3-4e8e-a749-604efbd2ae8f None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:28.029962 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5953ca5-9fe8-44e3-b963-eca173388910 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:28.039288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9008e-cd27-48ad-b9ad-b60f8d8380ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:28.039971 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9008e-cd27-48ad-b9ad-b60f8d8380ec None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:28.040260 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9008e-cd27-48ad-b9ad-b60f8d8380ec None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:28.040540 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9008e-cd27-48ad-b9ad-b60f8d8380ec None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:28.041258 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9008e-cd27-48ad-b9ad-b60f8d8380ec None admin] RBAC: Adding query filter params (type=image) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:28.041595 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9008e-cd27-48ad-b9ad-b60f8d8380ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:28.043013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9008e-cd27-48ad-b9ad-b60f8d8380ec None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:28.049318 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 531/1038] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:28.054989 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9008e-cd27-48ad-b9ad-b60f8d8380ec None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:28.068189 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64db47d-7417-4779-bdd1-aa5801acdd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:28.069050 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64db47d-7417-4779-bdd1-aa5801acdd3f None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:28.069344 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64db47d-7417-4779-bdd1-aa5801acdd3f None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:28.069654 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64db47d-7417-4779-bdd1-aa5801acdd3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:28.082055 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64db47d-7417-4779-bdd1-aa5801acdd3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:28.083555 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64db47d-7417-4779-bdd1-aa5801acdd3f None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:28.102075 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-c64db47d-7417-4779-bdd1-aa5801acdd3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:28.102075 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:28.102075 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:28.102075 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:28.102075 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:28.102075 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:28.102075 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:28.102075 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:28.102075 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:28.102075 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:28.102075 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:28.102075 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:28.102075 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:34:28.102075 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:34:28.102075 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:34:28.103314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:34:28.103314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:28.103314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:28.103314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:28.103314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:28.103314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:28.103314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:28.103314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:28.103314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:28.103314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:28.103314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:28.103314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:28.103314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:28.103314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:28.103314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:28.103314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:28.103314 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:28.104321 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:34:28.104321 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:34:28.104321 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:28.104321 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:28.104321 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 508/1039] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:34:28.109575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64db47d-7417-4779-bdd1-aa5801acdd3f None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:28.179018 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9008e-cd27-48ad-b9ad-b60f8d8380ec None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:28.215429 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118df6e-a89c-4c7f-aa67-f381bd0891aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:28.216106 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118df6e-a89c-4c7f-aa67-f381bd0891aa None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:28.216387 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118df6e-a89c-4c7f-aa67-f381bd0891aa None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:28.216663 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118df6e-a89c-4c7f-aa67-f381bd0891aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:28.217484 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118df6e-a89c-4c7f-aa67-f381bd0891aa None admin] RBAC: Adding query filter params (interface=public, service_id=b5c32643eaa44f03ad84cb712d1a36ab, region_id=RegionOne) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:28.217796 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118df6e-a89c-4c7f-aa67-f381bd0891aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:28.219883 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118df6e-a89c-4c7f-aa67-f381bd0891aa None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:28.220376 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64db47d-7417-4779-bdd1-aa5801acdd3f None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:28.229698 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 532/1040] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:34:28 2022] GET /identity/v3/endpoints?service_id=b5c32643eaa44f03ad84cb712d1a36ab&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:28.231102 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118df6e-a89c-4c7f-aa67-f381bd0891aa None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:28.256450 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9411fd-8ab4-4169-b053-07b95f99e62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:28.257048 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9411fd-8ab4-4169-b053-07b95f99e62d None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:28.257338 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9411fd-8ab4-4169-b053-07b95f99e62d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:28.257652 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9411fd-8ab4-4169-b053-07b95f99e62d None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:28.258385 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9411fd-8ab4-4169-b053-07b95f99e62d None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:28.258695 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9411fd-8ab4-4169-b053-07b95f99e62d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:28.260074 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9411fd-8ab4-4169-b053-07b95f99e62d None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:28.272254 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 509/1041] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:28.278984 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9411fd-8ab4-4169-b053-07b95f99e62d None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:28.341755 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118df6e-a89c-4c7f-aa67-f381bd0891aa None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:28.380830 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9411fd-8ab4-4169-b053-07b95f99e62d None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:28.382390 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670d357-1b7b-432f-8dde-55b1770f48f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:28.384108 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670d357-1b7b-432f-8dde-55b1770f48f5 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:28.384622 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670d357-1b7b-432f-8dde-55b1770f48f5 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:28.385106 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670d357-1b7b-432f-8dde-55b1770f48f5 None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:28.386032 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670d357-1b7b-432f-8dde-55b1770f48f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:28.387611 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670d357-1b7b-432f-8dde-55b1770f48f5 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:28.397340 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 533/1042] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:34:28 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:34:28.416213 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fb130-21a2-49c9-b803-e4f2e64dd7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:28.417052 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fb130-21a2-49c9-b803-e4f2e64dd7a0 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:28.417338 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fb130-21a2-49c9-b803-e4f2e64dd7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:28.417836 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fb130-21a2-49c9-b803-e4f2e64dd7a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:28.426814 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fb130-21a2-49c9-b803-e4f2e64dd7a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:28.428322 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fb130-21a2-49c9-b803-e4f2e64dd7a0 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:28.444185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-b26fb130-21a2-49c9-b803-e4f2e64dd7a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:34:28.444185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:28.444185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:28.444185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:28.444185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:28.444185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:28.444185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:28.444185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:28.444185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:28.444185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:28.444185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:28.444185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:28.444185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:34:28.444185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:34:28.444185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:34:28.445242 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:34:28.445242 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:28.445242 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:28.445242 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:28.445242 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:28.445242 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:28.445242 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:28.445242 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:28.445242 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:28.445242 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:28.445242 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:28.445242 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:28.445242 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:28.445242 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:28.445242 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:28.445242 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:28.445242 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:28.446854 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:34:28.446854 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:34:28.446854 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:34:28.446854 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:34:28.446854 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:34:28.446854 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:34:28.446854 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:34:28.446854 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:28.449779 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 510/1043] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:34:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:34:28.451507 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670d357-1b7b-432f-8dde-55b1770f48f5 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:28.564847 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670d357-1b7b-432f-8dde-55b1770f48f5 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:28.604600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a088b1-9270-4eee-8e36-f0a6e2b342a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:28.605297 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a088b1-9270-4eee-8e36-f0a6e2b342a0 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:28.605635 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a088b1-9270-4eee-8e36-f0a6e2b342a0 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:28.605979 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a088b1-9270-4eee-8e36-f0a6e2b342a0 None admin] PATH_INFO: `/v3/projects` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:28.606749 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a088b1-9270-4eee-8e36-f0a6e2b342a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:28.607069 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a088b1-9270-4eee-8e36-f0a6e2b342a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:28.608567 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a088b1-9270-4eee-8e36-f0a6e2b342a0 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:28.623551 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 534/1044] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:34:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:28.630422 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fb130-21a2-49c9-b803-e4f2e64dd7a0 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:28.735382 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fb130-21a2-49c9-b803-e4f2e64dd7a0 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:28.770435 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b8e62-8315-42f1-993b-241a72311a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:28.771102 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b8e62-8315-42f1-993b-241a72311a81 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:28.771387 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b8e62-8315-42f1-993b-241a72311a81 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:28.771668 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b8e62-8315-42f1-993b-241a72311a81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:28.772516 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b8e62-8315-42f1-993b-241a72311a81 None admin] RBAC: Adding query filter params (role.id=61a5e0d3dab54d758c4f70299c19f603, scope.project.id=db5768a93e754372808fc69f898cc853, user.id=d398283fc99c4bfe83170ad3d1538f38) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:28.772835 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b8e62-8315-42f1-993b-241a72311a81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:28.774327 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b8e62-8315-42f1-993b-241a72311a81 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:28.780133 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 511/1045] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:34:28 2022] GET /identity/v3/role_assignments?user.id=d398283fc99c4bfe83170ad3d1538f38&scope.project.id=db5768a93e754372808fc69f898cc853&role.id=61a5e0d3dab54d758c4f70299c19f603 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:28.784452 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c483d-aa99-4599-a89a-2e199b4e0679 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:28.784747 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c483d-aa99-4599-a89a-2e199b4e0679 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:28.785032 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c483d-aa99-4599-a89a-2e199b4e0679 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:28.786813 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 535/1046] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:28.792555 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e8c10-496d-4659-bce7-f35f38e929e1 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:28.792881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e8c10-496d-4659-bce7-f35f38e929e1 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:28.793130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e8c10-496d-4659-bce7-f35f38e929e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:28.813149 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-b42e8c10-496d-4659-bce7-f35f38e929e1 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:28.814735 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-b42e8c10-496d-4659-bce7-f35f38e929e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:28.901229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 512/1047] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:28.920478 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c483d-aa99-4599-a89a-2e199b4e0679 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:29.041149 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c483d-aa99-4599-a89a-2e199b4e0679 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:29.080201 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67158af-c9f4-4ceb-a8e1-ff30b0c10b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:29.081421 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67158af-c9f4-4ceb-a8e1-ff30b0c10b9d None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:29.081945 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67158af-c9f4-4ceb-a8e1-ff30b0c10b9d None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:29.082437 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67158af-c9f4-4ceb-a8e1-ff30b0c10b9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:29.095390 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67158af-c9f4-4ceb-a8e1-ff30b0c10b9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:34:29.103781 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-e67158af-c9f4-4ceb-a8e1-ff30b0c10b9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:34:29.103781 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:29.103781 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:29.103781 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:29.103781 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:29.103781 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:29.103781 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:29.103781 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:29.103781 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:29.103781 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:29.103781 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:29.103781 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:29.103781 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:34:29.103781 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:34:29.103781 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:34:29.103781 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:34:29.104873 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:34:29.104873 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:34:29.104873 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:34:29.104873 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:34:29.104873 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:29.104873 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:29.104873 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:29.104873 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:29.104873 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:29.104873 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:29.104873 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:29.104873 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:29.104873 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:29.104873 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:29.104873 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:29.104873 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:29.105856 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:29.105856 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:29.105856 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:29.105856 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:29.105856 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:34:29.105856 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:34:29.105856 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:34:29.105856 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:34:29.105856 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:34:29.105856 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:34:29.105856 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:34:29.105856 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:29.107187 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 536/1048] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:34:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:29.113751 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e8c10-496d-4659-bce7-f35f38e929e1 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:29.224262 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e8c10-496d-4659-bce7-f35f38e929e1 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:29.263916 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7df871-5702-4824-be0d-6c5a9a18290c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:29.264631 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7df871-5702-4824-be0d-6c5a9a18290c None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:29.264920 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7df871-5702-4824-be0d-6c5a9a18290c None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:29.265718 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7df871-5702-4824-be0d-6c5a9a18290c None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:29.266969 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7df871-5702-4824-be0d-6c5a9a18290c None admin] RBAC: Adding query filter params (name=admin) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:29.267284 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7df871-5702-4824-be0d-6c5a9a18290c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:29.268849 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7df871-5702-4824-be0d-6c5a9a18290c None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:29.279616 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 513/1049] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:34:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:29.286673 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67158af-c9f4-4ceb-a8e1-ff30b0c10b9d None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:29.402714 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67158af-c9f4-4ceb-a8e1-ff30b0c10b9d None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:29.441875 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb53e39-c0c6-429e-b080-6378fc7b0cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:29.442766 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb53e39-c0c6-429e-b080-6378fc7b0cea None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:29.443056 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb53e39-c0c6-429e-b080-6378fc7b0cea None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:29.443340 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb53e39-c0c6-429e-b080-6378fc7b0cea None admin] PATH_INFO: `/v3/users/e4ceb91af06746ae833fec791b86c276` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:29.458636 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb53e39-c0c6-429e-b080-6378fc7b0cea None admin] RBAC: Authorizing `identity:get_user(user_id=e4ceb91af06746ae833fec791b86c276)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:29.460098 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb53e39-c0c6-429e-b080-6378fc7b0cea None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:29.462150 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 537/1050] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:34:29 2022] GET /identity/v3/users/e4ceb91af06746ae833fec791b86c276 => generated 285 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:29.467693 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7df871-5702-4824-be0d-6c5a9a18290c None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:29.576304 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7df871-5702-4824-be0d-6c5a9a18290c None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:29.614846 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7adf3f-16bb-4ac8-b8f6-524db646e614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:29.615510 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7adf3f-16bb-4ac8-b8f6-524db646e614 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:29.615805 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7adf3f-16bb-4ac8-b8f6-524db646e614 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:29.616063 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7adf3f-16bb-4ac8-b8f6-524db646e614 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:29.731052 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7adf3f-16bb-4ac8-b8f6-524db646e614 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:29.733636 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7adf3f-16bb-4ac8-b8f6-524db646e614 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:29.907520 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 514/1051] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:34:29 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:34:29.908855 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb53e39-c0c6-429e-b080-6378fc7b0cea None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:30.014184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb53e39-c0c6-429e-b080-6378fc7b0cea None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:30.052352 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1f37e-0e15-4087-9622-b20a09f7ba3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:30.053238 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1f37e-0e15-4087-9622-b20a09f7ba3e None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:30.053559 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1f37e-0e15-4087-9622-b20a09f7ba3e None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:30.053844 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1f37e-0e15-4087-9622-b20a09f7ba3e None admin] PATH_INFO: `/v3/projects/3dc8136f3eb648b5ba218095dbd9826c` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:30.055060 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1f37e-0e15-4087-9622-b20a09f7ba3e None admin] RBAC: Authorizing `identity:get_project(project_id=3dc8136f3eb648b5ba218095dbd9826c)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:30.056525 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1f37e-0e15-4087-9622-b20a09f7ba3e None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:30.058543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 538/1052] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:34:29 2022] GET /identity/v3/projects/3dc8136f3eb648b5ba218095dbd9826c => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:30.064982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7adf3f-16bb-4ac8-b8f6-524db646e614 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:30.172661 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7adf3f-16bb-4ac8-b8f6-524db646e614 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:30.207658 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a042283-a970-4ea3-a352-c94a500b058d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:30.208321 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a042283-a970-4ea3-a352-c94a500b058d None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:30.208602 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a042283-a970-4ea3-a352-c94a500b058d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:30.208881 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a042283-a970-4ea3-a352-c94a500b058d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:30.209763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a042283-a970-4ea3-a352-c94a500b058d None admin] RBAC: Adding query filter params (role.id=a5cb8d37261d486cbc1b06d167a9c05c, scope.project.id=3dc8136f3eb648b5ba218095dbd9826c, user.id=e4ceb91af06746ae833fec791b86c276) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:30.210081 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a042283-a970-4ea3-a352-c94a500b058d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:30.211530 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a042283-a970-4ea3-a352-c94a500b058d None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:30.225709 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 515/1053] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:34:30 2022] GET /identity/v3/role_assignments?user.id=e4ceb91af06746ae833fec791b86c276&scope.project.id=3dc8136f3eb648b5ba218095dbd9826c&role.id=a5cb8d37261d486cbc1b06d167a9c05c => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:30.835227 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a22fde-15bf-485c-8a9f-46cf940ce88e None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:30.835654 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a22fde-15bf-485c-8a9f-46cf940ce88e None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:30.835790 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a22fde-15bf-485c-8a9f-46cf940ce88e None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:30.837487 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 539/1054] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:30.844278 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662f240-0586-4f05-873f-c2c90b31cfd5 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:30.844840 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662f240-0586-4f05-873f-c2c90b31cfd5 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:30.845136 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662f240-0586-4f05-873f-c2c90b31cfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:30.863662 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-3662f240-0586-4f05-873f-c2c90b31cfd5 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:30.864998 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-3662f240-0586-4f05-873f-c2c90b31cfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:30.945430 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 516/1055] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:34:30.968095 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a22fde-15bf-485c-8a9f-46cf940ce88e None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:31.077267 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a22fde-15bf-485c-8a9f-46cf940ce88e None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:31.114588 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e0dbb-23ff-4d55-8050-d90b28e11b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:31.115556 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e0dbb-23ff-4d55-8050-d90b28e11b96 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:31.116000 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e0dbb-23ff-4d55-8050-d90b28e11b96 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:31.116329 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e0dbb-23ff-4d55-8050-d90b28e11b96 None admin] PATH_INFO: `/v3/services/image` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:31.117281 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e0dbb-23ff-4d55-8050-d90b28e11b96 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:31.119113 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e0dbb-23ff-4d55-8050-d90b28e11b96 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:31.129666 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632e887-2077-4ec1-8cd2-f752a984a7df None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:31.129968 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632e887-2077-4ec1-8cd2-f752a984a7df None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:31.130242 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632e887-2077-4ec1-8cd2-f752a984a7df None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:31.131779 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 517/1056] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:34:31.132480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-726e0dbb-23ff-4d55-8050-d90b28e11b96 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:34:31.132480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:31.132480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:34:31.132480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:34:31.132480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:34:31.132480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:34:31.132480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:34:31.132480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:31.132480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:34:31.132480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:31.132480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:34:31.132480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:31.132480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:31.132480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:31.132480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:31.132480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:31.132480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:31.133816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:31.133816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:31.133816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:31.133816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:31.133816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:31.133816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:31.133816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:34:31.133816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:34:31.133816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:34:31.133816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:34:31.133816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:31.133816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:31.133816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:31.133816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:31.133816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:31.133816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:31.139714 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:31.139714 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:31.139714 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:31.139714 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:31.139714 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:31.139714 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:31.139714 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:31.139714 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:31.139714 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:31.139714 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:31.139714 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:34:31.139714 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:34:31.139714 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:34:31.139714 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:31.139714 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 540/1057] 10.222.0.48 () {56 vars in 1105 bytes} [Mon May 9 15:34:30 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:31.140646 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493d313-0814-4716-a062-1e86548ce007 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:31.140646 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493d313-0814-4716-a062-1e86548ce007 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:31.140646 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493d313-0814-4716-a062-1e86548ce007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:31.141540 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e0dbb-23ff-4d55-8050-d90b28e11b96 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:31.154935 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-6493d313-0814-4716-a062-1e86548ce007 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:31.156908 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-6493d313-0814-4716-a062-1e86548ce007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:31.238738 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 518/1058] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:31.246694 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e0dbb-23ff-4d55-8050-d90b28e11b96 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:31.255851 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493d313-0814-4716-a062-1e86548ce007 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:31.284245 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e4c4e-5352-43a6-8cca-36afd9f2362b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:31.284937 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e4c4e-5352-43a6-8cca-36afd9f2362b None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:31.285210 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e4c4e-5352-43a6-8cca-36afd9f2362b None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:31.285521 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e4c4e-5352-43a6-8cca-36afd9f2362b None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:31.286234 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e4c4e-5352-43a6-8cca-36afd9f2362b None admin] RBAC: Adding query filter params (name=image) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:31.286539 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e4c4e-5352-43a6-8cca-36afd9f2362b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:31.287932 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e4c4e-5352-43a6-8cca-36afd9f2362b None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:31.292978 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 541/1059] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:31.299545 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e4c4e-5352-43a6-8cca-36afd9f2362b None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:31.378693 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493d313-0814-4716-a062-1e86548ce007 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:31.429063 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e4c4e-5352-43a6-8cca-36afd9f2362b None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:31.432187 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e5c17-5b18-4570-8aae-35dc51753fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:31.433082 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e5c17-5b18-4570-8aae-35dc51753fea None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:31.433391 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e5c17-5b18-4570-8aae-35dc51753fea None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:31.433677 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e5c17-5b18-4570-8aae-35dc51753fea None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:31.445024 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e5c17-5b18-4570-8aae-35dc51753fea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:34:31.453640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-5b0e5c17-5b18-4570-8aae-35dc51753fea None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:34:31.453640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:31.453640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:31.453640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:31.453640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:31.453640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:31.453640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:31.453640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:31.453640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:31.453640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:31.453640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:31.453640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:31.453640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:34:31.453640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:34:31.453640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:34:31.453640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:34:31.458708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:34:31.458708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:34:31.458708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:34:31.458708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:34:31.458708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:31.458708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:31.458708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:31.458708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:31.458708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:31.458708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:31.458708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:31.458708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:31.458708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:31.458708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:31.458708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:31.458708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:31.463908 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:31.463908 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:31.463908 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:31.463908 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:31.463908 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:34:31.463908 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:34:31.463908 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:34:31.463908 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:34:31.463908 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:34:31.463908 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:34:31.463908 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:34:31.463908 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:31.463908 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 519/1060] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 9 15:34:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:34:31.463908 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e5c17-5b18-4570-8aae-35dc51753fea None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:31.470703 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f996fc2-969b-4acc-ba57-6f54f19e7678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:31.471568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f996fc2-969b-4acc-ba57-6f54f19e7678 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:31.472262 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f996fc2-969b-4acc-ba57-6f54f19e7678 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:31.472262 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f996fc2-969b-4acc-ba57-6f54f19e7678 None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:31.472799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f996fc2-969b-4acc-ba57-6f54f19e7678 None admin] RBAC: Adding query filter params (type=image) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:31.473098 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f996fc2-969b-4acc-ba57-6f54f19e7678 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:31.474536 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f996fc2-969b-4acc-ba57-6f54f19e7678 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:31.480693 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 542/1061] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:31.487693 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f996fc2-969b-4acc-ba57-6f54f19e7678 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:31.588470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e5c17-5b18-4570-8aae-35dc51753fea None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:31.607460 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f996fc2-969b-4acc-ba57-6f54f19e7678 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:31.629401 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bfbedf-3fc3-49ed-93b6-483f28881d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:31.630608 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfbedf-3fc3-49ed-93b6-483f28881d89 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:31.630894 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfbedf-3fc3-49ed-93b6-483f28881d89 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:31.631173 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfbedf-3fc3-49ed-93b6-483f28881d89 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:31.632547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bfbedf-3fc3-49ed-93b6-483f28881d89 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:31.632547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bfbedf-3fc3-49ed-93b6-483f28881d89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:31.633661 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bfbedf-3fc3-49ed-93b6-483f28881d89 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:31.652379 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 520/1062] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:34:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:31.653543 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bfbedf-3fc3-49ed-93b6-483f28881d89 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:31.662504 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c9d12-cb66-4846-bef2-c7e77c2a1b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:31.663260 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c9d12-cb66-4846-bef2-c7e77c2a1b60 None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:31.663622 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c9d12-cb66-4846-bef2-c7e77c2a1b60 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:31.663971 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c9d12-cb66-4846-bef2-c7e77c2a1b60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:31.664759 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c9d12-cb66-4846-bef2-c7e77c2a1b60 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:31.666223 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c9d12-cb66-4846-bef2-c7e77c2a1b60 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:31.689595 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 543/1063] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:34:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:34:31.783953 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bfbedf-3fc3-49ed-93b6-483f28881d89 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:31.831738 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca7237-4229-4f10-b0c4-242ad70af0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:31.832898 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca7237-4229-4f10-b0c4-242ad70af0b3 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:31.833451 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca7237-4229-4f10-b0c4-242ad70af0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:31.833936 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca7237-4229-4f10-b0c4-242ad70af0b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:31.849900 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca7237-4229-4f10-b0c4-242ad70af0b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:31.851807 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca7237-4229-4f10-b0c4-242ad70af0b3 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:31.871762 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-26ca7237-4229-4f10-b0c4-242ad70af0b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:31.871762 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:31.871762 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:31.871762 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:31.871762 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:31.871762 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:31.871762 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:31.871762 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:31.871762 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:31.871762 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:31.871762 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:31.871762 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:31.871762 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:34:31.871762 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:34:31.871762 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:34:31.872868 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:34:31.872868 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:31.872868 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:31.872868 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:31.872868 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:31.872868 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:31.872868 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:31.872868 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:31.872868 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:31.872868 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:31.872868 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:31.872868 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:31.872868 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:31.872868 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:31.872868 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:31.872868 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:31.872868 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:31.873951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:34:31.873951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:34:31.873951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:31.873951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:31.876012 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 521/1064] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:31.883009 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c9d12-cb66-4846-bef2-c7e77c2a1b60 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:32.001945 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c9d12-cb66-4846-bef2-c7e77c2a1b60 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:32.041916 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa4508-1319-4483-92c1-3793c8efe86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:32.042597 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa4508-1319-4483-92c1-3793c8efe86d None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:32.042882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa4508-1319-4483-92c1-3793c8efe86d None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:32.043159 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa4508-1319-4483-92c1-3793c8efe86d None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:32.043894 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa4508-1319-4483-92c1-3793c8efe86d None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:32.044199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa4508-1319-4483-92c1-3793c8efe86d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:32.045621 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa4508-1319-4483-92c1-3793c8efe86d None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:32.058983 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 544/1065] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:32.065318 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca7237-4229-4f10-b0c4-242ad70af0b3 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:32.194746 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca7237-4229-4f10-b0c4-242ad70af0b3 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:32.244042 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3c7d3-e3eb-466a-91f5-17203050014e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:32.245343 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3c7d3-e3eb-466a-91f5-17203050014e None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:32.246135 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3c7d3-e3eb-466a-91f5-17203050014e None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:32.246631 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3c7d3-e3eb-466a-91f5-17203050014e None admin] PATH_INFO: `/v3/users/nova` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:32.262597 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3c7d3-e3eb-466a-91f5-17203050014e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:32.265403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3c7d3-e3eb-466a-91f5-17203050014e None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:32.280580 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-80d3c7d3-e3eb-466a-91f5-17203050014e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:34:32.280580 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:32.280580 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:32.280580 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:32.280580 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:32.280580 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:32.280580 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:32.280580 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:32.280580 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:32.280580 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:32.280580 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:32.280580 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:32.280580 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:34:32.280580 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:34:32.280580 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:34:32.280580 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:34:32.282519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:32.282519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:32.282519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:34:32.282519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:34:32.282519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:34:32.282519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:34:32.282519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:32.282519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:32.282519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:32.282519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:32.282519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:32.282519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:32.282519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:32.282519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:32.282519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:32.282519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:32.282519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:32.282519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:32.283604 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:32.283604 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:32.283604 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:34:32.283604 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:34:32.283604 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:34:32.283604 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:34:32.283604 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:34:32.283604 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:34:32.283604 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:34:32.283604 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:32.285726 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 522/1066] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:34:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:32.293751 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa4508-1319-4483-92c1-3793c8efe86d None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:32.415294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa4508-1319-4483-92c1-3793c8efe86d None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:32.454391 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f952b-3e95-4584-ae18-ddd510d3f014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:32.455007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f952b-3e95-4584-ae18-ddd510d3f014 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:32.455299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f952b-3e95-4584-ae18-ddd510d3f014 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:32.455582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f952b-3e95-4584-ae18-ddd510d3f014 None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:32.456442 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f952b-3e95-4584-ae18-ddd510d3f014 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:32.456760 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f952b-3e95-4584-ae18-ddd510d3f014 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:32.458235 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f952b-3e95-4584-ae18-ddd510d3f014 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:32.482081 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 545/1067] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:34:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:32.483558 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3c7d3-e3eb-466a-91f5-17203050014e None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:32.599729 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3c7d3-e3eb-466a-91f5-17203050014e None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:32.635028 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15753ebc-449b-43ac-8fe9-5f4c806ffacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:32.635838 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15753ebc-449b-43ac-8fe9-5f4c806ffacd None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:32.636126 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15753ebc-449b-43ac-8fe9-5f4c806ffacd None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:32.636404 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15753ebc-449b-43ac-8fe9-5f4c806ffacd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:32.652120 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15753ebc-449b-43ac-8fe9-5f4c806ffacd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:32.653637 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15753ebc-449b-43ac-8fe9-5f4c806ffacd None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:32.673256 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-15753ebc-449b-43ac-8fe9-5f4c806ffacd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:32.673256 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:32.673256 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:32.673256 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:32.673256 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:32.673256 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:32.673256 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:32.673256 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:32.673256 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:32.673256 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:32.673256 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:32.673256 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:32.673256 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:34:32.673256 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:34:32.673256 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:34:32.674330 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:34:32.674330 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:32.674330 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:32.674330 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:32.674330 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:32.674330 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:32.674330 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:32.674330 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:32.674330 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:32.674330 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:32.674330 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:32.674330 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:32.674330 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:32.674330 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:32.674330 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:32.674330 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:32.674330 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:32.680328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:34:32.680328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:34:32.680328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:32.680328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:32.680328 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 523/1068] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:34:32.680664 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f952b-3e95-4584-ae18-ddd510d3f014 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:32.703157 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357b045-0975-4404-8337-e1e700852e18 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:32.703624 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357b045-0975-4404-8337-e1e700852e18 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:32.704063 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357b045-0975-4404-8337-e1e700852e18 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:32.706524 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 524/1069] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:32.711900 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac40d4a-e708-44bb-8204-d16be27ced61 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:32.712220 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac40d4a-e708-44bb-8204-d16be27ced61 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:32.712503 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac40d4a-e708-44bb-8204-d16be27ced61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:32.729524 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-eac40d4a-e708-44bb-8204-d16be27ced61 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:32.730788 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-eac40d4a-e708-44bb-8204-d16be27ced61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:32.816606 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 525/1070] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:34:32.834423 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f952b-3e95-4584-ae18-ddd510d3f014 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:32.839879 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac40d4a-e708-44bb-8204-d16be27ced61 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:32.889239 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1247b-2f9f-4cea-ab9a-2a95782ca683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:32.890825 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1247b-2f9f-4cea-ab9a-2a95782ca683 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:32.891550 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1247b-2f9f-4cea-ab9a-2a95782ca683 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:32.892281 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1247b-2f9f-4cea-ab9a-2a95782ca683 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:32.893672 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1247b-2f9f-4cea-ab9a-2a95782ca683 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:32.894228 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1247b-2f9f-4cea-ab9a-2a95782ca683 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:32.896793 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1247b-2f9f-4cea-ab9a-2a95782ca683 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:32.915590 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 546/1071] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:32.924097 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1247b-2f9f-4cea-ab9a-2a95782ca683 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:32.961061 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac40d4a-e708-44bb-8204-d16be27ced61 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:33.000040 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88eeab-6f35-47ac-b66b-855728839efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:33.001011 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88eeab-6f35-47ac-b66b-855728839efd None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:33.001430 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88eeab-6f35-47ac-b66b-855728839efd None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:33.001789 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88eeab-6f35-47ac-b66b-855728839efd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:33.014566 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88eeab-6f35-47ac-b66b-855728839efd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:34:33.024610 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-6f88eeab-6f35-47ac-b66b-855728839efd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:34:33.024610 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:33.024610 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:33.024610 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:33.024610 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:33.024610 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:33.024610 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:33.024610 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:33.024610 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:33.024610 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:33.024610 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:33.024610 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:33.024610 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:34:33.024610 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:34:33.024610 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:34:33.024610 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:34:33.026698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:34:33.026698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:34:33.026698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:34:33.026698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:34:33.026698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:33.026698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:33.026698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:33.026698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:33.026698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:33.026698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:33.026698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:33.026698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:33.026698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:33.026698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:33.026698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:33.026698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:33.028584 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:33.028584 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:33.028584 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:33.028584 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:33.028584 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:34:33.028584 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:34:33.028584 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:34:33.028584 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:34:33.028584 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:34:33.028584 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:34:33.028584 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:34:33.028584 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:33.028584 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 526/1072] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:34:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:34:33.038438 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88eeab-6f35-47ac-b66b-855728839efd None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:33.048979 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1247b-2f9f-4cea-ab9a-2a95782ca683 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:33.096226 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d4800-4e3a-4bd6-a2a6-0173147d2ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:33.097055 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d4800-4e3a-4bd6-a2a6-0173147d2ee0 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:33.097339 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d4800-4e3a-4bd6-a2a6-0173147d2ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:33.097655 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d4800-4e3a-4bd6-a2a6-0173147d2ee0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:33.104529 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d4800-4e3a-4bd6-a2a6-0173147d2ee0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:33.106026 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d4800-4e3a-4bd6-a2a6-0173147d2ee0 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:33.122013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-446d4800-4e3a-4bd6-a2a6-0173147d2ee0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:34:33.122013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:33.122013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:33.122013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:33.122013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:33.122013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:33.122013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:33.122013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:33.122013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:33.122013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:33.122013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:33.122013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:33.122013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:34:33.122013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:34:33.122013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:34:33.123253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:34:33.123253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:33.123253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:33.123253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:33.123253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:33.123253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:33.123253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:33.123253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:33.123253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:33.123253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:33.123253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:33.123253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:33.123253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:33.123253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:33.123253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:33.123253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:33.123253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:33.125071 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:34:33.125071 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:34:33.125071 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:34:33.125071 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:34:33.125071 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:34:33.125071 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:34:33.125071 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:34:33.125071 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:33.128837 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 547/1073] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:34:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:34:33.129948 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d4800-4e3a-4bd6-a2a6-0173147d2ee0 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:33.166493 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88eeab-6f35-47ac-b66b-855728839efd None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:33.199918 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931767b-b013-45fe-9f69-981d02dfdf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:33.200598 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931767b-b013-45fe-9f69-981d02dfdf95 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:33.200886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931767b-b013-45fe-9f69-981d02dfdf95 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:33.201168 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931767b-b013-45fe-9f69-981d02dfdf95 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:33.201957 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931767b-b013-45fe-9f69-981d02dfdf95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:33.202272 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931767b-b013-45fe-9f69-981d02dfdf95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:33.204216 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931767b-b013-45fe-9f69-981d02dfdf95 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:33.217240 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 527/1074] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:34:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:33.218177 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931767b-b013-45fe-9f69-981d02dfdf95 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:33.231151 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d4800-4e3a-4bd6-a2a6-0173147d2ee0 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:33.266590 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979b700-2a72-43d7-bc70-cc92cbec28ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:33.267418 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979b700-2a72-43d7-bc70-cc92cbec28ed None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:33.267954 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979b700-2a72-43d7-bc70-cc92cbec28ed None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:33.268215 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979b700-2a72-43d7-bc70-cc92cbec28ed None admin] PATH_INFO: `/v3/projects` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:33.269129 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979b700-2a72-43d7-bc70-cc92cbec28ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:33.269610 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979b700-2a72-43d7-bc70-cc92cbec28ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:33.271198 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979b700-2a72-43d7-bc70-cc92cbec28ed None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:33.283290 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 548/1075] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:34:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:33.289276 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979b700-2a72-43d7-bc70-cc92cbec28ed None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:33.321468 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931767b-b013-45fe-9f69-981d02dfdf95 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:33.355807 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331c171-83d6-42ea-a7f8-46eb7afc348d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:33.356846 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331c171-83d6-42ea-a7f8-46eb7afc348d None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:33.357199 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331c171-83d6-42ea-a7f8-46eb7afc348d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:33.357577 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331c171-83d6-42ea-a7f8-46eb7afc348d None admin] PATH_INFO: `/v3/users/e4ceb91af06746ae833fec791b86c276` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:33.359400 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331c171-83d6-42ea-a7f8-46eb7afc348d None admin] RBAC: Authorizing `identity:get_user(user_id=e4ceb91af06746ae833fec791b86c276)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:33.360939 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331c171-83d6-42ea-a7f8-46eb7afc348d None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:33.367279 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 528/1076] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:34:33 2022] GET /identity/v3/users/e4ceb91af06746ae833fec791b86c276 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:33.368298 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331c171-83d6-42ea-a7f8-46eb7afc348d None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:33.401862 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979b700-2a72-43d7-bc70-cc92cbec28ed None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:33.440628 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bfbf7-e671-4dce-891e-13abd9210525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:33.441582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bfbf7-e671-4dce-891e-13abd9210525 None admin] REQUEST_METHOD: `PUT` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:33.441871 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bfbf7-e671-4dce-891e-13abd9210525 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:33.442153 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bfbf7-e671-4dce-891e-13abd9210525 None admin] PATH_INFO: `/v3/projects/db5768a93e754372808fc69f898cc853/users/d398283fc99c4bfe83170ad3d1538f38/roles/61a5e0d3dab54d758c4f70299c19f603` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:33.444584 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bfbf7-e671-4dce-891e-13abd9210525 None admin] RBAC: Authorizing `identity:create_grant(project_id=db5768a93e754372808fc69f898cc853, user_id=d398283fc99c4bfe83170ad3d1538f38, role_id=61a5e0d3dab54d758c4f70299c19f603)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:33.446137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bfbf7-e671-4dce-891e-13abd9210525 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:33.462649 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 549/1077] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:34:33 2022] PUT /identity/v3/projects/db5768a93e754372808fc69f898cc853/users/d398283fc99c4bfe83170ad3d1538f38/roles/61a5e0d3dab54d758c4f70299c19f603 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:34:33.503529 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331c171-83d6-42ea-a7f8-46eb7afc348d None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:33.557190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92104a93-f4d0-4ddc-9a35-8dc6c81e8ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:33.558142 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92104a93-f4d0-4ddc-9a35-8dc6c81e8ec6 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:33.558435 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92104a93-f4d0-4ddc-9a35-8dc6c81e8ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:33.558729 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92104a93-f4d0-4ddc-9a35-8dc6c81e8ec6 None admin] PATH_INFO: `/v3/projects/3dc8136f3eb648b5ba218095dbd9826c` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:33.560077 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92104a93-f4d0-4ddc-9a35-8dc6c81e8ec6 None admin] RBAC: Authorizing `identity:get_project(project_id=3dc8136f3eb648b5ba218095dbd9826c)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:33.561608 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92104a93-f4d0-4ddc-9a35-8dc6c81e8ec6 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:33.564076 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 529/1078] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:34:33 2022] GET /identity/v3/projects/3dc8136f3eb648b5ba218095dbd9826c => generated 311 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:33.570035 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bfbf7-e671-4dce-891e-13abd9210525 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:33.684959 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bfbf7-e671-4dce-891e-13abd9210525 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:33.719941 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16166df0-f2ec-4f87-a000-48c9e2d64f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:33.720866 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16166df0-f2ec-4f87-a000-48c9e2d64f68 None admin] REQUEST_METHOD: `PUT` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:33.721153 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16166df0-f2ec-4f87-a000-48c9e2d64f68 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:33.721453 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16166df0-f2ec-4f87-a000-48c9e2d64f68 None admin] PATH_INFO: `/v3/projects/3dc8136f3eb648b5ba218095dbd9826c/users/e4ceb91af06746ae833fec791b86c276/roles/a5cb8d37261d486cbc1b06d167a9c05c` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:33.723442 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16166df0-f2ec-4f87-a000-48c9e2d64f68 None admin] RBAC: Authorizing `identity:create_grant(project_id=3dc8136f3eb648b5ba218095dbd9826c, user_id=e4ceb91af06746ae833fec791b86c276, role_id=a5cb8d37261d486cbc1b06d167a9c05c)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:33.724891 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16166df0-f2ec-4f87-a000-48c9e2d64f68 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:33.740238 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 550/1079] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:34:33 2022] PUT /identity/v3/projects/3dc8136f3eb648b5ba218095dbd9826c/users/e4ceb91af06746ae833fec791b86c276/roles/a5cb8d37261d486cbc1b06d167a9c05c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:34:34.081856 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d549dd5-8a11-402d-906d-297c0c7903bd None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:34.082148 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d549dd5-8a11-402d-906d-297c0c7903bd None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:34.082431 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d549dd5-8a11-402d-906d-297c0c7903bd None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:34.083872 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 530/1080] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:34.089242 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171123a-2cf3-4f44-8126-48ac9d11642b None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:34.089574 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171123a-2cf3-4f44-8126-48ac9d11642b None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:34.089861 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171123a-2cf3-4f44-8126-48ac9d11642b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:34.107196 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-8171123a-2cf3-4f44-8126-48ac9d11642b None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:34.108402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-8171123a-2cf3-4f44-8126-48ac9d11642b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:34.179914 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 551/1081] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:34.206527 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d549dd5-8a11-402d-906d-297c0c7903bd None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:34.311305 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d549dd5-8a11-402d-906d-297c0c7903bd None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:34.363360 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa2691-0da3-47cb-a407-3e0262a7c635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:34.364349 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa2691-0da3-47cb-a407-3e0262a7c635 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:34.364830 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa2691-0da3-47cb-a407-3e0262a7c635 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:34.365316 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa2691-0da3-47cb-a407-3e0262a7c635 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:34.475684 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa2691-0da3-47cb-a407-3e0262a7c635 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:34.478382 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa2691-0da3-47cb-a407-3e0262a7c635 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:34.645598 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 531/1082] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:34:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:34:34.649708 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171123a-2cf3-4f44-8126-48ac9d11642b None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:34.790576 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171123a-2cf3-4f44-8126-48ac9d11642b None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:34.826398 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed11650-d1ce-4cff-85e0-16153d6cbd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:34.827205 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed11650-d1ce-4cff-85e0-16153d6cbd8b None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:34.827583 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed11650-d1ce-4cff-85e0-16153d6cbd8b None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:34.827866 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed11650-d1ce-4cff-85e0-16153d6cbd8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:34.838281 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed11650-d1ce-4cff-85e0-16153d6cbd8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:34.839757 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed11650-d1ce-4cff-85e0-16153d6cbd8b None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:34.857676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-9ed11650-d1ce-4cff-85e0-16153d6cbd8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:34.857676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:34.857676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:34.857676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:34.857676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:34.857676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:34.857676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:34.857676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:34.857676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:34.857676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:34.857676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:34.857676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:34.857676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:34:34.857676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:34:34.857676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:34:34.859293 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:34:34.859293 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:34.859293 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:34.859293 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:34.859293 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:34.859293 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:34.859293 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:34.859293 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:34.859293 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:34.859293 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:34.859293 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:34.859293 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:34.859293 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:34.859293 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:34.859293 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:34.859293 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:34.859293 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:34.860307 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:34:34.860307 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:34:34.860307 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:34.860307 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:34.860307 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 552/1083] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:34.867422 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa2691-0da3-47cb-a407-3e0262a7c635 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:34.966646 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa2691-0da3-47cb-a407-3e0262a7c635 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:35.004728 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c2c83-5b4c-4ecc-a99f-a487dc14bce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:35.005449 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c2c83-5b4c-4ecc-a99f-a487dc14bce5 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:35.005743 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c2c83-5b4c-4ecc-a99f-a487dc14bce5 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:35.006028 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c2c83-5b4c-4ecc-a99f-a487dc14bce5 None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:35.006778 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c2c83-5b4c-4ecc-a99f-a487dc14bce5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:35.007093 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c2c83-5b4c-4ecc-a99f-a487dc14bce5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:35.008517 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c2c83-5b4c-4ecc-a99f-a487dc14bce5 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:35.022012 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 532/1084] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:35.802610 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41873c3-a5dd-4a95-b935-bdd2cc3ccde4 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:35.803184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41873c3-a5dd-4a95-b935-bdd2cc3ccde4 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:35.803184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41873c3-a5dd-4a95-b935-bdd2cc3ccde4 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:35.804533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 553/1085] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:35.810109 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a2652-36bf-4796-9f18-987e1ec81cf9 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:35.810598 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a2652-36bf-4796-9f18-987e1ec81cf9 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:35.810696 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a2652-36bf-4796-9f18-987e1ec81cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:35.829158 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-124a2652-36bf-4796-9f18-987e1ec81cf9 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:35.830423 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-124a2652-36bf-4796-9f18-987e1ec81cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:35.897694 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 533/1086] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:35.920872 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41873c3-a5dd-4a95-b935-bdd2cc3ccde4 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:36.020022 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41873c3-a5dd-4a95-b935-bdd2cc3ccde4 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:36.054197 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d5661-5a99-4174-8fa5-62930c3beb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:36.055024 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d5661-5a99-4174-8fa5-62930c3beb0e None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:36.055309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d5661-5a99-4174-8fa5-62930c3beb0e None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:36.055586 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d5661-5a99-4174-8fa5-62930c3beb0e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:36.067040 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d5661-5a99-4174-8fa5-62930c3beb0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:34:36.075625 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-e25d5661-5a99-4174-8fa5-62930c3beb0e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:34:36.075625 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:36.075625 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:36.075625 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:36.075625 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:36.075625 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:36.075625 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:36.075625 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:36.075625 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:36.075625 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:36.075625 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:36.075625 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:36.075625 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:34:36.075625 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:34:36.075625 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:34:36.075625 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:34:36.076901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:34:36.076901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:34:36.076901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:34:36.076901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:34:36.076901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:36.076901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:36.076901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:36.076901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:36.076901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:36.076901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:36.076901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:36.076901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:36.076901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:36.076901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:36.076901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:36.076901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:36.078237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:36.078237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:36.078237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:36.078237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:36.078237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:34:36.078237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:34:36.078237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:34:36.078237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:34:36.078237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:34:36.078237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:34:36.078237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:34:36.078237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:36.078237 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 554/1087] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 9 15:34:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:36.083667 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a2652-36bf-4796-9f18-987e1ec81cf9 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:36.185114 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a2652-36bf-4796-9f18-987e1ec81cf9 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:36.220444 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b15c6-720f-4197-9662-c8110215c569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:36.221122 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b15c6-720f-4197-9662-c8110215c569 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:36.221433 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b15c6-720f-4197-9662-c8110215c569 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:36.221719 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b15c6-720f-4197-9662-c8110215c569 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:36.222505 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b15c6-720f-4197-9662-c8110215c569 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:36.222817 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b15c6-720f-4197-9662-c8110215c569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:36.224219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b15c6-720f-4197-9662-c8110215c569 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:36.232677 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 534/1088] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:34:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:36.238588 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d5661-5a99-4174-8fa5-62930c3beb0e None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:36.274987 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65ee2f-0149-4d3d-be52-b634fabb6242 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:36.275280 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65ee2f-0149-4d3d-be52-b634fabb6242 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:36.275567 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65ee2f-0149-4d3d-be52-b634fabb6242 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:36.276970 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 535/1089] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:36.284103 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f83bb3-b241-4f1c-b04c-889b6a0326b6 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:36.284401 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f83bb3-b241-4f1c-b04c-889b6a0326b6 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:36.284685 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f83bb3-b241-4f1c-b04c-889b6a0326b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:36.300877 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-d2f83bb3-b241-4f1c-b04c-889b6a0326b6 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:36.302125 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-d2f83bb3-b241-4f1c-b04c-889b6a0326b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:36.343585 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d5661-5a99-4174-8fa5-62930c3beb0e None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:36.379276 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec14a39-77b9-485f-ab2d-92912cb7b4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:36.379714 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 536/1090] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:34:36.380073 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec14a39-77b9-485f-ab2d-92912cb7b4bb None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:36.380356 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec14a39-77b9-485f-ab2d-92912cb7b4bb None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:36.380631 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec14a39-77b9-485f-ab2d-92912cb7b4bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:36.392349 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec14a39-77b9-485f-ab2d-92912cb7b4bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:36.393849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec14a39-77b9-485f-ab2d-92912cb7b4bb None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:36.406581 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f83bb3-b241-4f1c-b04c-889b6a0326b6 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:36.410643 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-4ec14a39-77b9-485f-ab2d-92912cb7b4bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:36.410643 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:36.410643 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:36.410643 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:36.410643 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:36.410643 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:36.410643 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:36.410643 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:36.410643 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:36.410643 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:36.410643 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:36.410643 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:36.410643 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:34:36.410643 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:34:36.410643 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:34:36.411700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:34:36.411700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:36.411700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:36.411700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:36.411700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:36.411700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:36.411700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:36.411700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:36.411700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:36.411700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:36.411700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:36.411700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:36.411700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:36.411700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:36.411700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:36.411700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:36.411700 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:36.413309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:34:36.413309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:34:36.413309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:36.413309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:36.413309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 555/1091] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:34:36.417598 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec14a39-77b9-485f-ab2d-92912cb7b4bb None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:36.511933 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f83bb3-b241-4f1c-b04c-889b6a0326b6 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:36.525445 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec14a39-77b9-485f-ab2d-92912cb7b4bb None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:36.546150 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66730409-2d81-45bd-b978-6e6d2b30855d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:36.546951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66730409-2d81-45bd-b978-6e6d2b30855d None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:36.547233 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66730409-2d81-45bd-b978-6e6d2b30855d None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:36.547514 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66730409-2d81-45bd-b978-6e6d2b30855d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:36.557463 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66730409-2d81-45bd-b978-6e6d2b30855d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:34:36.557636 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1158f8-bc25-4850-a033-e79acc213373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:36.558243 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1158f8-bc25-4850-a033-e79acc213373 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:36.558521 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1158f8-bc25-4850-a033-e79acc213373 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:36.558794 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1158f8-bc25-4850-a033-e79acc213373 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:36.559513 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1158f8-bc25-4850-a033-e79acc213373 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:36.559822 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1158f8-bc25-4850-a033-e79acc213373 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:36.561197 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1158f8-bc25-4850-a033-e79acc213373 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:36.565624 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-66730409-2d81-45bd-b978-6e6d2b30855d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:34:36.565624 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:36.565624 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:36.565624 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:36.565624 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:36.565624 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:36.565624 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:36.565624 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:36.565624 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:36.565624 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:36.565624 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:36.565624 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:36.565624 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:34:36.565624 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:34:36.565624 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:34:36.565624 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:34:36.566723 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:34:36.566723 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:34:36.566723 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:34:36.566723 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:34:36.566723 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:36.566723 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:36.566723 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:36.566723 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:36.566723 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:36.566723 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:36.566723 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:36.566723 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:36.566723 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:36.566723 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:36.566723 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:36.566723 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:36.567684 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:36.567684 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:36.567684 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:36.567684 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:36.567684 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:34:36.567684 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:34:36.567684 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:34:36.567684 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:34:36.567684 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:34:36.567684 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:34:36.567684 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:34:36.567684 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:36.567684 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 537/1092] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:34:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:34:36.572869 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66730409-2d81-45bd-b978-6e6d2b30855d None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:36.579829 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 556/1093] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:36.581199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1158f8-bc25-4850-a033-e79acc213373 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:36.675007 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66730409-2d81-45bd-b978-6e6d2b30855d None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:36.684468 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1158f8-bc25-4850-a033-e79acc213373 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:36.708075 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cae9c5-2631-49c1-a459-4b3aaf0c33a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:36.708749 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cae9c5-2631-49c1-a459-4b3aaf0c33a1 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:36.709034 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cae9c5-2631-49c1-a459-4b3aaf0c33a1 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:36.709318 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cae9c5-2631-49c1-a459-4b3aaf0c33a1 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:36.710094 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cae9c5-2631-49c1-a459-4b3aaf0c33a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:36.710405 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cae9c5-2631-49c1-a459-4b3aaf0c33a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:36.711783 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cae9c5-2631-49c1-a459-4b3aaf0c33a1 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:36.720062 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c061796-8e6d-45d2-88ab-afc327cfbd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:36.724356 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 538/1094] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:34:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:36.724515 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c061796-8e6d-45d2-88ab-afc327cfbd3c None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:36.724515 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c061796-8e6d-45d2-88ab-afc327cfbd3c None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:36.724515 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c061796-8e6d-45d2-88ab-afc327cfbd3c None admin] PATH_INFO: `/v3/users/nova` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:36.726006 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cae9c5-2631-49c1-a459-4b3aaf0c33a1 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:36.729143 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c061796-8e6d-45d2-88ab-afc327cfbd3c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:36.730651 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c061796-8e6d-45d2-88ab-afc327cfbd3c None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:36.746473 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-7c061796-8e6d-45d2-88ab-afc327cfbd3c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:34:36.746473 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:36.746473 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:36.746473 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:36.746473 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:36.746473 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:36.746473 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:36.746473 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:36.746473 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:36.746473 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:36.746473 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:36.746473 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:36.746473 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:34:36.746473 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:34:36.746473 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:34:36.746473 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:34:36.747600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:36.747600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:36.747600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:34:36.747600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:34:36.747600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:34:36.747600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:34:36.747600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:36.747600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:36.747600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:36.747600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:36.747600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:36.747600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:36.747600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:36.747600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:36.747600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:36.747600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:36.747600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:36.747600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:36.748668 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:36.748668 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:36.748668 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:34:36.748668 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:34:36.748668 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:34:36.748668 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:34:36.748668 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:34:36.748668 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:34:36.748668 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:34:36.748668 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:36.748668 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 557/1095] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:34:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:34:36.754085 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c061796-8e6d-45d2-88ab-afc327cfbd3c None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:36.825111 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cae9c5-2631-49c1-a459-4b3aaf0c33a1 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:36.856152 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c061796-8e6d-45d2-88ab-afc327cfbd3c None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:36.859205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ffc74-96ec-4acf-bd94-61e49030b5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:36.860080 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ffc74-96ec-4acf-bd94-61e49030b5bf None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:36.860367 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ffc74-96ec-4acf-bd94-61e49030b5bf None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:36.860647 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ffc74-96ec-4acf-bd94-61e49030b5bf None admin] PATH_INFO: `/v3/users/e4ceb91af06746ae833fec791b86c276` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:36.861924 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ffc74-96ec-4acf-bd94-61e49030b5bf None admin] RBAC: Authorizing `identity:get_user(user_id=e4ceb91af06746ae833fec791b86c276)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:36.863408 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ffc74-96ec-4acf-bd94-61e49030b5bf None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:36.865087 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 539/1096] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:34:36 2022] GET /identity/v3/users/e4ceb91af06746ae833fec791b86c276 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:36.871208 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ffc74-96ec-4acf-bd94-61e49030b5bf None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:36.891995 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89c20e-7e58-4605-b3de-9689c1551cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:36.892720 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89c20e-7e58-4605-b3de-9689c1551cc1 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:36.892946 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89c20e-7e58-4605-b3de-9689c1551cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:36.893223 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89c20e-7e58-4605-b3de-9689c1551cc1 None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:36.894098 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89c20e-7e58-4605-b3de-9689c1551cc1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:36.894406 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89c20e-7e58-4605-b3de-9689c1551cc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:36.895855 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89c20e-7e58-4605-b3de-9689c1551cc1 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:36.913926 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 558/1097] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:34:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:36.919533 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89c20e-7e58-4605-b3de-9689c1551cc1 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:36.970227 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ffc74-96ec-4acf-bd94-61e49030b5bf None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:37.002956 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead71c3-4c8d-41ae-8793-0ee44592d4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:37.003609 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead71c3-4c8d-41ae-8793-0ee44592d4b5 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:37.003895 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead71c3-4c8d-41ae-8793-0ee44592d4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:37.004173 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead71c3-4c8d-41ae-8793-0ee44592d4b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:37.016463 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89c20e-7e58-4605-b3de-9689c1551cc1 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:37.051324 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489669af-ce84-4b85-bcf4-5e7d1b038cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:37.051974 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489669af-ce84-4b85-bcf4-5e7d1b038cba None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:37.052258 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489669af-ce84-4b85-bcf4-5e7d1b038cba None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:37.052532 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489669af-ce84-4b85-bcf4-5e7d1b038cba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:37.070607 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead71c3-4c8d-41ae-8793-0ee44592d4b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:37.072090 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead71c3-4c8d-41ae-8793-0ee44592d4b5 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:37.118917 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489669af-ce84-4b85-bcf4-5e7d1b038cba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:37.120306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489669af-ce84-4b85-bcf4-5e7d1b038cba None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:37.174322 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 540/1098] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:34:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:34:37.180294 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead71c3-4c8d-41ae-8793-0ee44592d4b5 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:37.220903 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 559/1099] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:34:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:34:37.226600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489669af-ce84-4b85-bcf4-5e7d1b038cba None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:37.276659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead71c3-4c8d-41ae-8793-0ee44592d4b5 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:37.310975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e32c56-b7f7-4bb5-ac5a-2905bf18a2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:37.312007 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e32c56-b7f7-4bb5-ac5a-2905bf18a2e3 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:37.312205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e32c56-b7f7-4bb5-ac5a-2905bf18a2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:37.312408 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e32c56-b7f7-4bb5-ac5a-2905bf18a2e3 None admin] PATH_INFO: `/v3/projects/3dc8136f3eb648b5ba218095dbd9826c` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:37.313658 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e32c56-b7f7-4bb5-ac5a-2905bf18a2e3 None admin] RBAC: Authorizing `identity:get_project(project_id=3dc8136f3eb648b5ba218095dbd9826c)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:37.315108 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e32c56-b7f7-4bb5-ac5a-2905bf18a2e3 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:37.316837 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 541/1100] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:34:37 2022] GET /identity/v3/projects/3dc8136f3eb648b5ba218095dbd9826c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:37.322857 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e32c56-b7f7-4bb5-ac5a-2905bf18a2e3 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:37.326796 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489669af-ce84-4b85-bcf4-5e7d1b038cba None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:37.362331 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726ac9b-65cb-47a2-a664-9e758795d446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:37.363138 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726ac9b-65cb-47a2-a664-9e758795d446 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:37.363427 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726ac9b-65cb-47a2-a664-9e758795d446 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:37.363711 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726ac9b-65cb-47a2-a664-9e758795d446 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:37.374396 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6726ac9b-65cb-47a2-a664-9e758795d446 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:37.376015 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6726ac9b-65cb-47a2-a664-9e758795d446 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:37.393899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-6726ac9b-65cb-47a2-a664-9e758795d446 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:37.393899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:37.393899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:37.393899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:37.393899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:37.393899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:37.393899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:37.393899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:37.393899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:37.393899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:37.393899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:37.393899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:37.393899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:34:37.393899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:34:37.393899 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:34:37.395095 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:34:37.395095 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:37.395095 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:37.395095 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:37.395095 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:37.395095 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:37.395095 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:37.395095 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:37.395095 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:37.395095 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:37.395095 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:37.395095 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:37.395095 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:37.395095 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:37.395095 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:37.395095 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:37.395095 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:37.396243 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:34:37.396243 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:34:37.396243 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:34:37.396243 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:37.396243 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 560/1101] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:37.401019 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726ac9b-65cb-47a2-a664-9e758795d446 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:37.425074 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e32c56-b7f7-4bb5-ac5a-2905bf18a2e3 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:37.462034 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef28543-387c-4bd5-958d-39a53a9ec0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:37.462713 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef28543-387c-4bd5-958d-39a53a9ec0ac None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:37.462992 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef28543-387c-4bd5-958d-39a53a9ec0ac None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:37.463269 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef28543-387c-4bd5-958d-39a53a9ec0ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:37.464125 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef28543-387c-4bd5-958d-39a53a9ec0ac None admin] RBAC: Adding query filter params (role.id=a5cb8d37261d486cbc1b06d167a9c05c, scope.project.id=3dc8136f3eb648b5ba218095dbd9826c, user.id=e4ceb91af06746ae833fec791b86c276) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:37.464442 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef28543-387c-4bd5-958d-39a53a9ec0ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:37.465966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef28543-387c-4bd5-958d-39a53a9ec0ac None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:37.481598 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 542/1102] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:34:37 2022] GET /identity/v3/role_assignments?user.id=e4ceb91af06746ae833fec791b86c276&scope.project.id=3dc8136f3eb648b5ba218095dbd9826c&role.id=a5cb8d37261d486cbc1b06d167a9c05c => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:37.521584 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726ac9b-65cb-47a2-a664-9e758795d446 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:37.559465 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc8a97-0389-4af8-99bf-cc2b6202885f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:37.560148 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc8a97-0389-4af8-99bf-cc2b6202885f None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:37.560434 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc8a97-0389-4af8-99bf-cc2b6202885f None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:37.560711 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc8a97-0389-4af8-99bf-cc2b6202885f None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:37.561481 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc8a97-0389-4af8-99bf-cc2b6202885f None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:37.561858 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc8a97-0389-4af8-99bf-cc2b6202885f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:37.563279 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc8a97-0389-4af8-99bf-cc2b6202885f None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:37.576098 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 561/1103] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:37.582753 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef28543-387c-4bd5-958d-39a53a9ec0ac None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:37.696007 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef28543-387c-4bd5-958d-39a53a9ec0ac None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:37.729535 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6e141-7680-4a55-975e-084408f2bc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:37.730340 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6e141-7680-4a55-975e-084408f2bc91 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:37.730622 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6e141-7680-4a55-975e-084408f2bc91 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:37.730899 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6e141-7680-4a55-975e-084408f2bc91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:37.738926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6e141-7680-4a55-975e-084408f2bc91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:37.740396 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6e141-7680-4a55-975e-084408f2bc91 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:37.755772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-8ac6e141-7680-4a55-975e-084408f2bc91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:34:37.755772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:37.755772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:37.755772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:37.755772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:37.755772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:37.755772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:37.755772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:37.755772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:37.755772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:37.755772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:37.755772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:37.755772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:34:37.755772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:34:37.755772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:34:37.757265 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:34:37.757265 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:37.757265 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:37.757265 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:37.757265 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:37.757265 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:37.757265 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:37.757265 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:37.757265 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:34:37.757265 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:37.757265 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:37.757265 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:37.757265 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:37.757265 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:37.757265 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:37.757265 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:37.757265 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:37.758442 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:34:37.758442 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:34:37.758442 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:34:37.758442 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:34:37.758442 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:34:37.758442 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:34:37.758442 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:34:37.758442 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:34:37.758442 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 543/1104] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:34:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:37.762835 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc8a97-0389-4af8-99bf-cc2b6202885f None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:37.862860 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc8a97-0389-4af8-99bf-cc2b6202885f None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:37.897327 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9725b4-260a-40f5-a063-75043ffc492c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:37.897930 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9725b4-260a-40f5-a063-75043ffc492c None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:37.898214 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9725b4-260a-40f5-a063-75043ffc492c None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:37.898488 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9725b4-260a-40f5-a063-75043ffc492c None admin] PATH_INFO: `/v3/projects` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:37.899280 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9725b4-260a-40f5-a063-75043ffc492c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:37.899588 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9725b4-260a-40f5-a063-75043ffc492c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:37.901019 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9725b4-260a-40f5-a063-75043ffc492c None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:37.913508 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 562/1105] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:34:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:37.919677 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6e141-7680-4a55-975e-084408f2bc91 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:38.021652 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6e141-7680-4a55-975e-084408f2bc91 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:38.056691 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da6e07-a2c5-40f5-b3fe-6c23c1766160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:38.057351 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da6e07-a2c5-40f5-b3fe-6c23c1766160 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:38.057667 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da6e07-a2c5-40f5-b3fe-6c23c1766160 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:38.057945 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da6e07-a2c5-40f5-b3fe-6c23c1766160 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:38.058783 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da6e07-a2c5-40f5-b3fe-6c23c1766160 None admin] RBAC: Adding query filter params (role.id=61a5e0d3dab54d758c4f70299c19f603, scope.project.id=db5768a93e754372808fc69f898cc853, user.id=d398283fc99c4bfe83170ad3d1538f38) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:38.059100 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da6e07-a2c5-40f5-b3fe-6c23c1766160 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:38.060538 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da6e07-a2c5-40f5-b3fe-6c23c1766160 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:38.066968 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 544/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:34:37 2022] GET /identity/v3/role_assignments?user.id=d398283fc99c4bfe83170ad3d1538f38&scope.project.id=db5768a93e754372808fc69f898cc853&role.id=61a5e0d3dab54d758c4f70299c19f603 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:39.823972 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61af1a-ef6d-44c3-bbbd-bb90f38be538 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:39.824515 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61af1a-ef6d-44c3-bbbd-bb90f38be538 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:39.824515 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61af1a-ef6d-44c3-bbbd-bb90f38be538 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:39.825970 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 563/1107] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:39.832130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e13320-55b3-4dff-ab94-d483a05cc053 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:39.832615 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e13320-55b3-4dff-ab94-d483a05cc053 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:39.832725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e13320-55b3-4dff-ab94-d483a05cc053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:39.849947 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-82e13320-55b3-4dff-ab94-d483a05cc053 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:39.851155 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-82e13320-55b3-4dff-ab94-d483a05cc053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:39.919560 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 545/1108] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:39.944279 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61af1a-ef6d-44c3-bbbd-bb90f38be538 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:40.051020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61af1a-ef6d-44c3-bbbd-bb90f38be538 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:40.086233 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d4bd2-bcfd-43e9-bdf3-5d5f2746abf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:40.087045 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d4bd2-bcfd-43e9-bdf3-5d5f2746abf1 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:40.087336 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d4bd2-bcfd-43e9-bdf3-5d5f2746abf1 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:40.087621 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d4bd2-bcfd-43e9-bdf3-5d5f2746abf1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:40.088903 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d4bd2-bcfd-43e9-bdf3-5d5f2746abf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:40.090412 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d4bd2-bcfd-43e9-bdf3-5d5f2746abf1 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:40.092145 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 564/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:40.101146 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e13320-55b3-4dff-ab94-d483a05cc053 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:40.208954 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e13320-55b3-4dff-ab94-d483a05cc053 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:40.241701 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2cbc5-42d8-4c8e-8d64-d5679061f230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:40.242372 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2cbc5-42d8-4c8e-8d64-d5679061f230 None admin] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:40.242657 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2cbc5-42d8-4c8e-8d64-d5679061f230 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:40.242934 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2cbc5-42d8-4c8e-8d64-d5679061f230 None admin] PATH_INFO: `/v3/users` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:40.243640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2cbc5-42d8-4c8e-8d64-d5679061f230 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:40.245091 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2cbc5-42d8-4c8e-8d64-d5679061f230 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:40.266427 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 546/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:34:40 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:34:42.581233 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72fe39-f3e7-49d8-b98b-18c6f5f56ae2 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:42.581859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72fe39-f3e7-49d8-b98b-18c6f5f56ae2 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:42.582008 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72fe39-f3e7-49d8-b98b-18c6f5f56ae2 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:42.583384 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 565/1111] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:42.588712 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5251827-c2a9-4693-bcf4-dca96c264131 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:42.589121 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5251827-c2a9-4693-bcf4-dca96c264131 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:42.589275 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5251827-c2a9-4693-bcf4-dca96c264131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:42.606928 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-a5251827-c2a9-4693-bcf4-dca96c264131 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:42.608121 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-a5251827-c2a9-4693-bcf4-dca96c264131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:42.676553 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 547/1112] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:42.701540 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72fe39-f3e7-49d8-b98b-18c6f5f56ae2 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:42.804018 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72fe39-f3e7-49d8-b98b-18c6f5f56ae2 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:42.837462 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f64e5-c243-4a42-9304-03234f2d5c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:42.838248 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f64e5-c243-4a42-9304-03234f2d5c88 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:42.838529 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f64e5-c243-4a42-9304-03234f2d5c88 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:42.838805 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f64e5-c243-4a42-9304-03234f2d5c88 None admin] PATH_INFO: `/v3/roles/607698024b4d44f0a109bb69deafc0c5` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:42.840276 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f64e5-c243-4a42-9304-03234f2d5c88 None admin] RBAC: Authorizing `identity:get_role(role_id=607698024b4d44f0a109bb69deafc0c5)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:42.841665 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f64e5-c243-4a42-9304-03234f2d5c88 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:42.843105 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 566/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:34:42 2022] GET /identity/v3/roles/607698024b4d44f0a109bb69deafc0c5 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:42.849176 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5251827-c2a9-4693-bcf4-dca96c264131 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:42.947032 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5251827-c2a9-4693-bcf4-dca96c264131 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:42.991365 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b25e5-dfe6-45b5-a756-30139911e06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:42.992252 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b25e5-dfe6-45b5-a756-30139911e06a None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:42.992532 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b25e5-dfe6-45b5-a756-30139911e06a None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:42.992809 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b25e5-dfe6-45b5-a756-30139911e06a None admin] PATH_INFO: `/v3/users/8da745c65b4141edb978a965b85a4f2d` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:43.017294 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b25e5-dfe6-45b5-a756-30139911e06a None admin] RBAC: Authorizing `identity:get_user(user_id=8da745c65b4141edb978a965b85a4f2d)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:43.018788 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b25e5-dfe6-45b5-a756-30139911e06a None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:43.020550 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 548/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:34:42 2022] GET /identity/v3/users/8da745c65b4141edb978a965b85a4f2d => generated 286 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:43.026396 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f64e5-c243-4a42-9304-03234f2d5c88 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:43.132219 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f64e5-c243-4a42-9304-03234f2d5c88 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:43.166436 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf415d6-1539-4e5a-b2a5-d0bf03faa4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:43.167088 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf415d6-1539-4e5a-b2a5-d0bf03faa4ea None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:43.167372 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf415d6-1539-4e5a-b2a5-d0bf03faa4ea None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:43.167676 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf415d6-1539-4e5a-b2a5-d0bf03faa4ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:43.234262 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf415d6-1539-4e5a-b2a5-d0bf03faa4ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:43.235743 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf415d6-1539-4e5a-b2a5-d0bf03faa4ea None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:43.337343 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 567/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:34:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:34:43.344322 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b25e5-dfe6-45b5-a756-30139911e06a None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:43.445998 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b25e5-dfe6-45b5-a756-30139911e06a None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:43.479192 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69ddba-8c67-4524-b6ed-f2dd76faf683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:43.480042 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69ddba-8c67-4524-b6ed-f2dd76faf683 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:43.480323 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69ddba-8c67-4524-b6ed-f2dd76faf683 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:43.480599 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69ddba-8c67-4524-b6ed-f2dd76faf683 None admin] PATH_INFO: `/v3/projects/3dc8136f3eb648b5ba218095dbd9826c` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:43.481788 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69ddba-8c67-4524-b6ed-f2dd76faf683 None admin] RBAC: Authorizing `identity:get_project(project_id=3dc8136f3eb648b5ba218095dbd9826c)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:43.483224 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69ddba-8c67-4524-b6ed-f2dd76faf683 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:43.485663 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 549/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:34:43 2022] GET /identity/v3/projects/3dc8136f3eb648b5ba218095dbd9826c => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:43.491804 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf415d6-1539-4e5a-b2a5-d0bf03faa4ea None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:43.590677 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf415d6-1539-4e5a-b2a5-d0bf03faa4ea None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:43.628113 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c25cb-31d4-4964-a66e-114c0eea250c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:43.629121 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c25cb-31d4-4964-a66e-114c0eea250c None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:43.629644 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c25cb-31d4-4964-a66e-114c0eea250c None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:43.630100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c25cb-31d4-4964-a66e-114c0eea250c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:43.631639 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c25cb-31d4-4964-a66e-114c0eea250c None admin] RBAC: Adding query filter params (role.id=607698024b4d44f0a109bb69deafc0c5, scope.project.id=3dc8136f3eb648b5ba218095dbd9826c, user.id=8da745c65b4141edb978a965b85a4f2d) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:43.632413 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c25cb-31d4-4964-a66e-114c0eea250c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:43.634418 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c25cb-31d4-4964-a66e-114c0eea250c None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:43.642012 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 568/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:34:43 2022] GET /identity/v3/role_assignments?user.id=8da745c65b4141edb978a965b85a4f2d&scope.project.id=3dc8136f3eb648b5ba218095dbd9826c&role.id=607698024b4d44f0a109bb69deafc0c5 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:45.937387 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9415c3-378b-4e6e-b4e3-9da3042b384c None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:45.938090 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9415c3-378b-4e6e-b4e3-9da3042b384c None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:45.938090 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9415c3-378b-4e6e-b4e3-9da3042b384c None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:45.939407 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 550/1118] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:34:45.945454 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e49cfc-429a-45d9-88b8-62cff71cffdb None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:45.946177 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e49cfc-429a-45d9-88b8-62cff71cffdb None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:45.946177 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e49cfc-429a-45d9-88b8-62cff71cffdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:45.966935 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-99e49cfc-429a-45d9-88b8-62cff71cffdb None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:45.968721 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-99e49cfc-429a-45d9-88b8-62cff71cffdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:46.040402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 569/1119] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:46.063447 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9415c3-378b-4e6e-b4e3-9da3042b384c None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:46.169684 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9415c3-378b-4e6e-b4e3-9da3042b384c None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:46.204318 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd72af3-6613-4fa2-bc1c-761c6bec22e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:46.205081 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd72af3-6613-4fa2-bc1c-761c6bec22e8 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:46.205364 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd72af3-6613-4fa2-bc1c-761c6bec22e8 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:46.205670 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd72af3-6613-4fa2-bc1c-761c6bec22e8 None admin] PATH_INFO: `/v3/roles/607698024b4d44f0a109bb69deafc0c5` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:46.207140 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd72af3-6613-4fa2-bc1c-761c6bec22e8 None admin] RBAC: Authorizing `identity:get_role(role_id=607698024b4d44f0a109bb69deafc0c5)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:46.208537 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd72af3-6613-4fa2-bc1c-761c6bec22e8 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:46.209966 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 551/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:34:46 2022] GET /identity/v3/roles/607698024b4d44f0a109bb69deafc0c5 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:46.215928 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e49cfc-429a-45d9-88b8-62cff71cffdb None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:46.313853 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e49cfc-429a-45d9-88b8-62cff71cffdb None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:46.349158 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7ca20-bdaa-4c2b-84a7-7d8ea90ba8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:46.350074 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7ca20-bdaa-4c2b-84a7-7d8ea90ba8aa None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:46.350360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7ca20-bdaa-4c2b-84a7-7d8ea90ba8aa None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:46.350640 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7ca20-bdaa-4c2b-84a7-7d8ea90ba8aa None admin] PATH_INFO: `/v3/users/8da745c65b4141edb978a965b85a4f2d` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:46.351856 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7ca20-bdaa-4c2b-84a7-7d8ea90ba8aa None admin] RBAC: Authorizing `identity:get_user(user_id=8da745c65b4141edb978a965b85a4f2d)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:46.353299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7ca20-bdaa-4c2b-84a7-7d8ea90ba8aa None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:46.355010 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 570/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:34:46 2022] GET /identity/v3/users/8da745c65b4141edb978a965b85a4f2d => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:46.370127 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd72af3-6613-4fa2-bc1c-761c6bec22e8 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:46.503335 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd72af3-6613-4fa2-bc1c-761c6bec22e8 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:46.537832 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21940f-4b18-4234-af6c-c59a9b6a42be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:46.538690 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21940f-4b18-4234-af6c-c59a9b6a42be None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:46.538975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21940f-4b18-4234-af6c-c59a9b6a42be None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:46.539253 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21940f-4b18-4234-af6c-c59a9b6a42be None admin] PATH_INFO: `/v3/projects/3dc8136f3eb648b5ba218095dbd9826c` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:46.540449 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21940f-4b18-4234-af6c-c59a9b6a42be None admin] RBAC: Authorizing `identity:get_project(project_id=3dc8136f3eb648b5ba218095dbd9826c)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:46.541962 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21940f-4b18-4234-af6c-c59a9b6a42be None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:46.543695 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 552/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:34:46 2022] GET /identity/v3/projects/3dc8136f3eb648b5ba218095dbd9826c => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:46.549818 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7ca20-bdaa-4c2b-84a7-7d8ea90ba8aa None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:46.648463 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7ca20-bdaa-4c2b-84a7-7d8ea90ba8aa None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:46.682614 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5d787-2aed-415a-8d14-ea09fc14b060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:46.683426 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5d787-2aed-415a-8d14-ea09fc14b060 None admin] REQUEST_METHOD: `PUT` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:46.683708 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5d787-2aed-415a-8d14-ea09fc14b060 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:46.683981 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5d787-2aed-415a-8d14-ea09fc14b060 None admin] PATH_INFO: `/v3/projects/3dc8136f3eb648b5ba218095dbd9826c/users/8da745c65b4141edb978a965b85a4f2d/roles/607698024b4d44f0a109bb69deafc0c5` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:46.686219 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5d787-2aed-415a-8d14-ea09fc14b060 None admin] RBAC: Authorizing `identity:create_grant(project_id=3dc8136f3eb648b5ba218095dbd9826c, user_id=8da745c65b4141edb978a965b85a4f2d, role_id=607698024b4d44f0a109bb69deafc0c5)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:46.688861 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5d787-2aed-415a-8d14-ea09fc14b060 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:46.702854 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 571/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:34:46 2022] PUT /identity/v3/projects/3dc8136f3eb648b5ba218095dbd9826c/users/8da745c65b4141edb978a965b85a4f2d/roles/607698024b4d44f0a109bb69deafc0c5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:34:49.075617 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43753171-a774-46d2-bc6b-90b8ef46d3ee None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:49.076263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43753171-a774-46d2-bc6b-90b8ef46d3ee None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:49.076263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43753171-a774-46d2-bc6b-90b8ef46d3ee None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:49.078134 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 553/1124] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:34:49.084207 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd85412-10d4-4ab8-bb83-3dae7435c506 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:49.084780 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd85412-10d4-4ab8-bb83-3dae7435c506 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:49.084780 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd85412-10d4-4ab8-bb83-3dae7435c506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:49.103042 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-2dd85412-10d4-4ab8-bb83-3dae7435c506 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:49.104281 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-2dd85412-10d4-4ab8-bb83-3dae7435c506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:49.176501 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 572/1125] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:49.200706 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43753171-a774-46d2-bc6b-90b8ef46d3ee None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:49.320858 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43753171-a774-46d2-bc6b-90b8ef46d3ee None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:49.361140 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c86e5d-04d8-4192-872c-a58324d3ab62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:49.361965 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c86e5d-04d8-4192-872c-a58324d3ab62 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:49.362243 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c86e5d-04d8-4192-872c-a58324d3ab62 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:49.362513 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c86e5d-04d8-4192-872c-a58324d3ab62 None admin] PATH_INFO: `/v3/roles/607698024b4d44f0a109bb69deafc0c5` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:49.364019 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c86e5d-04d8-4192-872c-a58324d3ab62 None admin] RBAC: Authorizing `identity:get_role(role_id=607698024b4d44f0a109bb69deafc0c5)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:49.365441 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c86e5d-04d8-4192-872c-a58324d3ab62 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:49.366874 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 554/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:34:49 2022] GET /identity/v3/roles/607698024b4d44f0a109bb69deafc0c5 => generated 223 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:49.376318 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd85412-10d4-4ab8-bb83-3dae7435c506 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:49.481265 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd85412-10d4-4ab8-bb83-3dae7435c506 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:49.518689 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a8a2b-1d2d-400e-a543-a0a5f678d7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:49.519567 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a8a2b-1d2d-400e-a543-a0a5f678d7fd None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:49.519854 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a8a2b-1d2d-400e-a543-a0a5f678d7fd None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:49.520133 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a8a2b-1d2d-400e-a543-a0a5f678d7fd None admin] PATH_INFO: `/v3/users/8da745c65b4141edb978a965b85a4f2d` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:49.521410 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a8a2b-1d2d-400e-a543-a0a5f678d7fd None admin] RBAC: Authorizing `identity:get_user(user_id=8da745c65b4141edb978a965b85a4f2d)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:49.522846 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a8a2b-1d2d-400e-a543-a0a5f678d7fd None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:49.524534 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 573/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:34:49 2022] GET /identity/v3/users/8da745c65b4141edb978a965b85a4f2d => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:49.534246 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c86e5d-04d8-4192-872c-a58324d3ab62 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:49.694318 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c86e5d-04d8-4192-872c-a58324d3ab62 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:49.773707 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a96ddd-c3e1-46f7-a9bb-82f3371ddaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:49.774955 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a96ddd-c3e1-46f7-a9bb-82f3371ddaca None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:49.775468 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a96ddd-c3e1-46f7-a9bb-82f3371ddaca None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:49.775973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a96ddd-c3e1-46f7-a9bb-82f3371ddaca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:49.885993 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a96ddd-c3e1-46f7-a9bb-82f3371ddaca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:49.888413 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a96ddd-c3e1-46f7-a9bb-82f3371ddaca None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:50.050605 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 555/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:34:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:34:50.056806 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a8a2b-1d2d-400e-a543-a0a5f678d7fd None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:50.160444 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a8a2b-1d2d-400e-a543-a0a5f678d7fd None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:50.197405 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8545a2-030e-4977-b089-1b7c57438fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:50.198288 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8545a2-030e-4977-b089-1b7c57438fff None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:50.198577 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8545a2-030e-4977-b089-1b7c57438fff None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:50.198857 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8545a2-030e-4977-b089-1b7c57438fff None admin] PATH_INFO: `/v3/projects/3dc8136f3eb648b5ba218095dbd9826c` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:50.200119 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8545a2-030e-4977-b089-1b7c57438fff None admin] RBAC: Authorizing `identity:get_project(project_id=3dc8136f3eb648b5ba218095dbd9826c)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:50.201603 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8545a2-030e-4977-b089-1b7c57438fff None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:50.204374 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 574/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:34:50 2022] GET /identity/v3/projects/3dc8136f3eb648b5ba218095dbd9826c => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:50.210690 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a96ddd-c3e1-46f7-a9bb-82f3371ddaca None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:50.325766 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a96ddd-c3e1-46f7-a9bb-82f3371ddaca None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:50.367774 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f919b31-7b28-44b6-843d-593217855cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:50.368463 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f919b31-7b28-44b6-843d-593217855cd7 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:50.368758 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f919b31-7b28-44b6-843d-593217855cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:50.369041 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f919b31-7b28-44b6-843d-593217855cd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:50.369946 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f919b31-7b28-44b6-843d-593217855cd7 None admin] RBAC: Adding query filter params (role.id=607698024b4d44f0a109bb69deafc0c5, scope.project.id=3dc8136f3eb648b5ba218095dbd9826c, user.id=8da745c65b4141edb978a965b85a4f2d) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:50.370270 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f919b31-7b28-44b6-843d-593217855cd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:50.372040 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f919b31-7b28-44b6-843d-593217855cd7 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:50.379534 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 556/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:34:50 2022] GET /identity/v3/role_assignments?user.id=8da745c65b4141edb978a965b85a4f2d&scope.project.id=3dc8136f3eb648b5ba218095dbd9826c&role.id=607698024b4d44f0a109bb69deafc0c5 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:52.737957 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae9c1a-0f8f-4457-951d-3b24e797fae1 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:52.738549 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae9c1a-0f8f-4457-951d-3b24e797fae1 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:52.738549 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae9c1a-0f8f-4457-951d-3b24e797fae1 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:52.740045 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 575/1131] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:52.747373 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5dd4e-22f9-4e7f-95b4-f9eabeec1f3d None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:52.747943 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5dd4e-22f9-4e7f-95b4-f9eabeec1f3d None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:52.748355 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5dd4e-22f9-4e7f-95b4-f9eabeec1f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:52.767670 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-f0a5dd4e-22f9-4e7f-95b4-f9eabeec1f3d None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:52.768913 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-f0a5dd4e-22f9-4e7f-95b4-f9eabeec1f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:52.840471 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 557/1132] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:52.867273 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae9c1a-0f8f-4457-951d-3b24e797fae1 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:52.977753 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae9c1a-0f8f-4457-951d-3b24e797fae1 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:53.016962 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873698f-f114-4778-955b-8c485001b49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:53.017804 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873698f-f114-4778-955b-8c485001b49c None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:53.018094 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873698f-f114-4778-955b-8c485001b49c None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:53.018368 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873698f-f114-4778-955b-8c485001b49c None admin] PATH_INFO: `/v3/domains/default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:53.019632 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873698f-f114-4778-955b-8c485001b49c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:53.021079 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873698f-f114-4778-955b-8c485001b49c None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:53.022770 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 576/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:53.029068 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5dd4e-22f9-4e7f-95b4-f9eabeec1f3d None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:53.132954 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5dd4e-22f9-4e7f-95b4-f9eabeec1f3d None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:53.167118 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8bc41-305f-4dec-b1fe-9de079b58bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:53.167790 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8bc41-305f-4dec-b1fe-9de079b58bc5 None admin] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:53.168075 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8bc41-305f-4dec-b1fe-9de079b58bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:53.168351 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8bc41-305f-4dec-b1fe-9de079b58bc5 None admin] PATH_INFO: `/v3/projects` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:53.169076 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8bc41-305f-4dec-b1fe-9de079b58bc5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:53.170569 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8bc41-305f-4dec-b1fe-9de079b58bc5 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:53.199535 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 558/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:34:53 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:34:55.886913 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10295d-3635-4cdb-89a8-2d77e5e87cd8 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:55.887493 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10295d-3635-4cdb-89a8-2d77e5e87cd8 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:55.887493 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10295d-3635-4cdb-89a8-2d77e5e87cd8 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:55.888792 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 577/1135] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:34:55.897620 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7f63d-9315-4e1b-b902-ad40f7ea9772 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:55.898236 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7f63d-9315-4e1b-b902-ad40f7ea9772 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:55.898583 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7f63d-9315-4e1b-b902-ad40f7ea9772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:55.926857 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-7fb7f63d-9315-4e1b-b902-ad40f7ea9772 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:55.928722 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-7fb7f63d-9315-4e1b-b902-ad40f7ea9772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:56.035263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 559/1136] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:34:56.064578 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10295d-3635-4cdb-89a8-2d77e5e87cd8 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:56.190007 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10295d-3635-4cdb-89a8-2d77e5e87cd8 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:56.226795 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab095ec-80e9-4c26-9e00-cf8db0a2481b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:56.227612 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab095ec-80e9-4c26-9e00-cf8db0a2481b None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:56.227901 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab095ec-80e9-4c26-9e00-cf8db0a2481b None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:56.228182 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab095ec-80e9-4c26-9e00-cf8db0a2481b None admin] PATH_INFO: `/v3/domains/default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:56.229438 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab095ec-80e9-4c26-9e00-cf8db0a2481b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:56.230905 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab095ec-80e9-4c26-9e00-cf8db0a2481b None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:56.232578 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 578/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:34:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:34:56.240395 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7f63d-9315-4e1b-b902-ad40f7ea9772 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:56.429296 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7f63d-9315-4e1b-b902-ad40f7ea9772 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:56.488129 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e761f5-5697-40d7-8f20-525b5ee89f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:56.489132 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e761f5-5697-40d7-8f20-525b5ee89f51 None admin] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:56.489610 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e761f5-5697-40d7-8f20-525b5ee89f51 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:56.490039 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e761f5-5697-40d7-8f20-525b5ee89f51 None admin] PATH_INFO: `/v3/users` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:56.491206 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e761f5-5697-40d7-8f20-525b5ee89f51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:56.493697 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e761f5-5697-40d7-8f20-525b5ee89f51 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:56.522215 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 560/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:34:56 2022] POST /identity/v3/users => generated 286 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:34:58.938785 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955b9b2-c102-4355-9f0e-7a651e822669 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:58.939431 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955b9b2-c102-4355-9f0e-7a651e822669 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:58.939431 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955b9b2-c102-4355-9f0e-7a651e822669 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:58.940925 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 579/1139] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:34:58.947381 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69145f-5300-4590-adef-e596eccc136a None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:58.948011 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69145f-5300-4590-adef-e596eccc136a None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:58.948011 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69145f-5300-4590-adef-e596eccc136a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:58.970126 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-bc69145f-5300-4590-adef-e596eccc136a None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:34:58.971927 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-bc69145f-5300-4590-adef-e596eccc136a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:34:59.057412 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 561/1140] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:34:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:34:59.082978 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955b9b2-c102-4355-9f0e-7a651e822669 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:59.228778 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955b9b2-c102-4355-9f0e-7a651e822669 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:59.269547 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aba77d-cb1c-4633-a57e-9baffdf41218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:59.270380 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aba77d-cb1c-4633-a57e-9baffdf41218 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:59.270665 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aba77d-cb1c-4633-a57e-9baffdf41218 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:59.270942 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aba77d-cb1c-4633-a57e-9baffdf41218 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:59.283962 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aba77d-cb1c-4633-a57e-9baffdf41218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:34:59.291932 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-82aba77d-cb1c-4633-a57e-9baffdf41218 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:34:59.291932 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:34:59.291932 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:34:59.291932 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:34:59.291932 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:34:59.291932 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:34:59.291932 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:34:59.291932 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:34:59.291932 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:34:59.291932 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:34:59.291932 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:34:59.291932 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:34:59.291932 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:34:59.291932 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:34:59.291932 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:34:59.291932 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:34:59.294184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:34:59.294184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:34:59.294184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:34:59.294184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:34:59.294184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:34:59.294184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:34:59.294184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:34:59.294184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:34:59.294184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:34:59.294184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:34:59.294184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:34:59.294184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:34:59.294184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:34:59.294184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:34:59.294184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:34:59.294184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:34:59.296491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:34:59.296491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:34:59.296491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:34:59.296491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:34:59.296491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:34:59.296491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:34:59.296491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:34:59.296491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:34:59.296491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:34:59.296491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:34:59.296491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:34:59.296491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:34:59.296491 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 580/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:34:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:34:59.301728 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69145f-5300-4590-adef-e596eccc136a None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:59.407414 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69145f-5300-4590-adef-e596eccc136a None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:59.442544 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c566f-6657-4036-97a9-30e71ece0ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:59.443229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c566f-6657-4036-97a9-30e71ece0ac4 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:59.443517 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c566f-6657-4036-97a9-30e71ece0ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:59.443798 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c566f-6657-4036-97a9-30e71ece0ac4 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:59.444562 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c566f-6657-4036-97a9-30e71ece0ac4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:34:59.444874 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c566f-6657-4036-97a9-30e71ece0ac4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:59.446310 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c566f-6657-4036-97a9-30e71ece0ac4 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:59.455726 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 562/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:34:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:59.464807 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aba77d-cb1c-4633-a57e-9baffdf41218 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:59.637000 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aba77d-cb1c-4633-a57e-9baffdf41218 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:59.680806 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f7bf8-dd6d-4a43-930a-61d5abae4412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:59.681755 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f7bf8-dd6d-4a43-930a-61d5abae4412 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:59.682047 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f7bf8-dd6d-4a43-930a-61d5abae4412 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:59.682328 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f7bf8-dd6d-4a43-930a-61d5abae4412 None admin] PATH_INFO: `/v3/users/3fd9996b56644071b2334dde8538df0c` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:59.697980 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f7bf8-dd6d-4a43-930a-61d5abae4412 None admin] RBAC: Authorizing `identity:get_user(user_id=3fd9996b56644071b2334dde8538df0c)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:59.699478 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f7bf8-dd6d-4a43-930a-61d5abae4412 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:34:59.701294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 581/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:34:59 2022] GET /identity/v3/users/3fd9996b56644071b2334dde8538df0c => generated 286 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:34:59.707399 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c566f-6657-4036-97a9-30e71ece0ac4 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:34:59.814490 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c566f-6657-4036-97a9-30e71ece0ac4 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:34:59.854088 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82559c91-23a8-4cf3-90de-932867c09281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:34:59.854761 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82559c91-23a8-4cf3-90de-932867c09281 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:34:59.855046 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82559c91-23a8-4cf3-90de-932867c09281 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:34:59.855324 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82559c91-23a8-4cf3-90de-932867c09281 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:34:59.924263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82559c91-23a8-4cf3-90de-932867c09281 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:34:59.925681 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82559c91-23a8-4cf3-90de-932867c09281 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:00.031524 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 563/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:34:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:35:00.038033 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f7bf8-dd6d-4a43-930a-61d5abae4412 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:00.149164 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f7bf8-dd6d-4a43-930a-61d5abae4412 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:00.191137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cdcf3-8700-45e6-b720-1295eb5302ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:00.192079 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cdcf3-8700-45e6-b720-1295eb5302ff None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:00.192418 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cdcf3-8700-45e6-b720-1295eb5302ff None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:00.192753 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cdcf3-8700-45e6-b720-1295eb5302ff None admin] PATH_INFO: `/v3/projects/a2da9394fcdb484b9e4bc1ac5d4c9d52` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:00.194172 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cdcf3-8700-45e6-b720-1295eb5302ff None admin] RBAC: Authorizing `identity:get_project(project_id=a2da9394fcdb484b9e4bc1ac5d4c9d52)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:00.195720 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cdcf3-8700-45e6-b720-1295eb5302ff None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:00.197617 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 582/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:35:00 2022] GET /identity/v3/projects/a2da9394fcdb484b9e4bc1ac5d4c9d52 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:35:00.205248 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82559c91-23a8-4cf3-90de-932867c09281 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:00.317721 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82559c91-23a8-4cf3-90de-932867c09281 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:00.354129 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dada44-fdc3-480c-bfb9-980cd8e826c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:00.354796 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dada44-fdc3-480c-bfb9-980cd8e826c2 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:00.355083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dada44-fdc3-480c-bfb9-980cd8e826c2 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:00.355371 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dada44-fdc3-480c-bfb9-980cd8e826c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:00.356222 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dada44-fdc3-480c-bfb9-980cd8e826c2 None admin] RBAC: Adding query filter params (role.id=a5cb8d37261d486cbc1b06d167a9c05c, scope.project.id=a2da9394fcdb484b9e4bc1ac5d4c9d52, user.id=3fd9996b56644071b2334dde8538df0c) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:35:00.356535 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dada44-fdc3-480c-bfb9-980cd8e826c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:00.358079 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dada44-fdc3-480c-bfb9-980cd8e826c2 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:00.364503 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 564/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:35:00 2022] GET /identity/v3/role_assignments?user.id=3fd9996b56644071b2334dde8538df0c&scope.project.id=a2da9394fcdb484b9e4bc1ac5d4c9d52&role.id=a5cb8d37261d486cbc1b06d167a9c05c => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:35:02.650333 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77d224-e882-4cdf-a468-33d74be36638 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:02.650864 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77d224-e882-4cdf-a468-33d74be36638 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:02.650864 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77d224-e882-4cdf-a468-33d74be36638 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:02.652273 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 583/1147] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:35:02.658832 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73697b-712a-4af1-bcb5-2c0cb6f946ee None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:02.659313 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73697b-712a-4af1-bcb5-2c0cb6f946ee None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:02.659421 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73697b-712a-4af1-bcb5-2c0cb6f946ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:02.676566 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-1e73697b-712a-4af1-bcb5-2c0cb6f946ee None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:35:02.677790 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-1e73697b-712a-4af1-bcb5-2c0cb6f946ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:35:02.744103 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 565/1148] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:35:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:35:02.767223 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77d224-e882-4cdf-a468-33d74be36638 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:02.871747 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77d224-e882-4cdf-a468-33d74be36638 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:02.907052 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed111bb-d36e-440b-b08b-cabdc6f1181c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:02.907768 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed111bb-d36e-440b-b08b-cabdc6f1181c None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:02.908061 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed111bb-d36e-440b-b08b-cabdc6f1181c None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:02.908345 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed111bb-d36e-440b-b08b-cabdc6f1181c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:02.918641 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed111bb-d36e-440b-b08b-cabdc6f1181c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:35:02.927433 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-eed111bb-d36e-440b-b08b-cabdc6f1181c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:35:02.927433 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:35:02.927433 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:35:02.927433 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:35:02.927433 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:35:02.927433 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:35:02.927433 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:35:02.927433 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:35:02.927433 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:35:02.927433 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:35:02.927433 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:35:02.927433 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:35:02.927433 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:35:02.927433 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:35:02.927433 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:35:02.927433 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:35:02.928680 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:35:02.928680 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:35:02.928680 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:35:02.928680 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:35:02.928680 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:35:02.928680 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:35:02.928680 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:35:02.928680 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:35:02.928680 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:35:02.928680 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:35:02.928680 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:35:02.928680 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:35:02.928680 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:35:02.928680 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:35:02.928680 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:35:02.928680 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:35:02.929880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:35:02.929880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:35:02.929880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:35:02.929880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:35:02.929880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:35:02.929880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:35:02.929880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:35:02.929880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:35:02.929880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:35:02.929880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:35:02.929880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:35:02.929880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:35:02.929880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 584/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:35:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:35:02.934858 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73697b-712a-4af1-bcb5-2c0cb6f946ee None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:03.033286 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73697b-712a-4af1-bcb5-2c0cb6f946ee None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:03.068276 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf446b-0fbd-4074-93c5-56409edba099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:03.068952 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf446b-0fbd-4074-93c5-56409edba099 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:03.069244 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf446b-0fbd-4074-93c5-56409edba099 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:03.069558 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf446b-0fbd-4074-93c5-56409edba099 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:03.070318 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf446b-0fbd-4074-93c5-56409edba099 None admin] RBAC: Adding query filter params (name=admin) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:35:03.070626 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf446b-0fbd-4074-93c5-56409edba099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:03.072014 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf446b-0fbd-4074-93c5-56409edba099 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:03.081135 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 566/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:35:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:35:03.087196 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed111bb-d36e-440b-b08b-cabdc6f1181c None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:03.193898 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed111bb-d36e-440b-b08b-cabdc6f1181c None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:03.228485 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b2f04-afd2-4cd9-9119-5cba4c7701cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:03.229361 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b2f04-afd2-4cd9-9119-5cba4c7701cc None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:03.229674 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b2f04-afd2-4cd9-9119-5cba4c7701cc None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:03.229953 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b2f04-afd2-4cd9-9119-5cba4c7701cc None admin] PATH_INFO: `/v3/users/3fd9996b56644071b2334dde8538df0c` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:03.231167 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b2f04-afd2-4cd9-9119-5cba4c7701cc None admin] RBAC: Authorizing `identity:get_user(user_id=3fd9996b56644071b2334dde8538df0c)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:03.232605 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b2f04-afd2-4cd9-9119-5cba4c7701cc None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:03.234344 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 585/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:35:03 2022] GET /identity/v3/users/3fd9996b56644071b2334dde8538df0c => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:35:03.240302 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf446b-0fbd-4074-93c5-56409edba099 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:03.343278 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf446b-0fbd-4074-93c5-56409edba099 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:03.377381 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffa541-e218-4542-bfbe-fa2396b294f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:03.378274 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffa541-e218-4542-bfbe-fa2396b294f7 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:03.378561 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffa541-e218-4542-bfbe-fa2396b294f7 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:03.378845 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffa541-e218-4542-bfbe-fa2396b294f7 None admin] PATH_INFO: `/v3/projects/a2da9394fcdb484b9e4bc1ac5d4c9d52` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:03.380131 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffa541-e218-4542-bfbe-fa2396b294f7 None admin] RBAC: Authorizing `identity:get_project(project_id=a2da9394fcdb484b9e4bc1ac5d4c9d52)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:03.381677 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffa541-e218-4542-bfbe-fa2396b294f7 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:03.383430 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 567/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:35:03 2022] GET /identity/v3/projects/a2da9394fcdb484b9e4bc1ac5d4c9d52 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:35:03.389600 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b2f04-afd2-4cd9-9119-5cba4c7701cc None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:03.492372 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b2f04-afd2-4cd9-9119-5cba4c7701cc None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:03.527496 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc36c3-e541-4d97-b401-77b9bccfe205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:03.528398 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc36c3-e541-4d97-b401-77b9bccfe205 None admin] REQUEST_METHOD: `PUT` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:03.528931 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc36c3-e541-4d97-b401-77b9bccfe205 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:03.529260 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc36c3-e541-4d97-b401-77b9bccfe205 None admin] PATH_INFO: `/v3/projects/a2da9394fcdb484b9e4bc1ac5d4c9d52/users/3fd9996b56644071b2334dde8538df0c/roles/a5cb8d37261d486cbc1b06d167a9c05c` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:03.531708 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc36c3-e541-4d97-b401-77b9bccfe205 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2da9394fcdb484b9e4bc1ac5d4c9d52, user_id=3fd9996b56644071b2334dde8538df0c, role_id=a5cb8d37261d486cbc1b06d167a9c05c)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:03.533157 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc36c3-e541-4d97-b401-77b9bccfe205 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:03.547920 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 586/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:35:03 2022] PUT /identity/v3/projects/a2da9394fcdb484b9e4bc1ac5d4c9d52/users/3fd9996b56644071b2334dde8538df0c/roles/a5cb8d37261d486cbc1b06d167a9c05c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:35:05.865647 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936345c-d46e-43e0-8872-b80653e0dca6 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:05.866214 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936345c-d46e-43e0-8872-b80653e0dca6 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:05.866214 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936345c-d46e-43e0-8872-b80653e0dca6 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:05.867592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 568/1154] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:35:05.873254 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4072e-224a-4e36-9d9d-b179ed30fb08 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:05.874044 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4072e-224a-4e36-9d9d-b179ed30fb08 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:05.874152 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4072e-224a-4e36-9d9d-b179ed30fb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:05.891593 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-d3b4072e-224a-4e36-9d9d-b179ed30fb08 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:35:05.892731 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-d3b4072e-224a-4e36-9d9d-b179ed30fb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:35:05.960326 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 587/1155] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:35:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:35:05.984782 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936345c-d46e-43e0-8872-b80653e0dca6 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:06.085421 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936345c-d46e-43e0-8872-b80653e0dca6 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:06.123389 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba2778-978b-4d29-8faf-4fc5957f14eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:06.124667 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba2778-978b-4d29-8faf-4fc5957f14eb None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:06.125079 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba2778-978b-4d29-8faf-4fc5957f14eb None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:06.125392 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba2778-978b-4d29-8faf-4fc5957f14eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:06.136013 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba2778-978b-4d29-8faf-4fc5957f14eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:35:06.144547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-b5ba2778-978b-4d29-8faf-4fc5957f14eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:35:06.144547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:35:06.144547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:35:06.144547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:35:06.144547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:35:06.144547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:35:06.144547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:35:06.144547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:35:06.144547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:35:06.144547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:35:06.144547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:35:06.144547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:35:06.144547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:35:06.144547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:35:06.144547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:35:06.144547 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:35:06.145810 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:35:06.145810 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:35:06.145810 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:35:06.145810 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:35:06.145810 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:35:06.145810 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:35:06.145810 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:35:06.145810 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:35:06.145810 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:35:06.145810 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:35:06.145810 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:35:06.145810 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:35:06.145810 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:35:06.145810 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:35:06.145810 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:35:06.145810 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:35:06.147147 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:35:06.147147 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:35:06.147147 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:35:06.147147 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:35:06.147147 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:35:06.147147 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:35:06.147147 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:35:06.147147 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:35:06.147147 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:35:06.147147 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:35:06.147147 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:35:06.147147 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:35:06.147147 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 569/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:35:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:35:06.151878 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4072e-224a-4e36-9d9d-b179ed30fb08 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:06.254737 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4072e-224a-4e36-9d9d-b179ed30fb08 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:06.289399 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410eba0-3b4e-4f92-aef1-b26cbe58fb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:06.290100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410eba0-3b4e-4f92-aef1-b26cbe58fb2b None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:06.290389 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410eba0-3b4e-4f92-aef1-b26cbe58fb2b None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:06.290669 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410eba0-3b4e-4f92-aef1-b26cbe58fb2b None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:06.291429 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410eba0-3b4e-4f92-aef1-b26cbe58fb2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:35:06.291743 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410eba0-3b4e-4f92-aef1-b26cbe58fb2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:06.293126 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410eba0-3b4e-4f92-aef1-b26cbe58fb2b None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:06.301806 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 588/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:35:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:35:06.307728 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba2778-978b-4d29-8faf-4fc5957f14eb None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:06.411713 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba2778-978b-4d29-8faf-4fc5957f14eb None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:06.446013 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7687cb-dc5e-49da-8362-2b459fca104c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:06.446891 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7687cb-dc5e-49da-8362-2b459fca104c None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:06.447177 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7687cb-dc5e-49da-8362-2b459fca104c None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:06.447458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7687cb-dc5e-49da-8362-2b459fca104c None admin] PATH_INFO: `/v3/users/3fd9996b56644071b2334dde8538df0c` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:06.448696 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7687cb-dc5e-49da-8362-2b459fca104c None admin] RBAC: Authorizing `identity:get_user(user_id=3fd9996b56644071b2334dde8538df0c)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:06.450695 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7687cb-dc5e-49da-8362-2b459fca104c None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:06.453561 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 570/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:35:06 2022] GET /identity/v3/users/3fd9996b56644071b2334dde8538df0c => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:35:06.459366 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410eba0-3b4e-4f92-aef1-b26cbe58fb2b None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:06.563563 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410eba0-3b4e-4f92-aef1-b26cbe58fb2b None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:06.599691 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75dac8-94a7-4894-85e1-eae8d25e872f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:06.600351 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75dac8-94a7-4894-85e1-eae8d25e872f None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:06.600641 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75dac8-94a7-4894-85e1-eae8d25e872f None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:06.600920 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75dac8-94a7-4894-85e1-eae8d25e872f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:06.677333 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75dac8-94a7-4894-85e1-eae8d25e872f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:06.678778 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75dac8-94a7-4894-85e1-eae8d25e872f None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:06.782802 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 589/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:35:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:35:06.788805 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7687cb-dc5e-49da-8362-2b459fca104c None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:06.890869 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7687cb-dc5e-49da-8362-2b459fca104c None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:06.926090 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2a487-f3a3-4da1-8214-1cd22317f33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:06.926955 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2a487-f3a3-4da1-8214-1cd22317f33c None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:06.927250 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2a487-f3a3-4da1-8214-1cd22317f33c None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:06.927582 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2a487-f3a3-4da1-8214-1cd22317f33c None admin] PATH_INFO: `/v3/projects/a2da9394fcdb484b9e4bc1ac5d4c9d52` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:06.928755 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2a487-f3a3-4da1-8214-1cd22317f33c None admin] RBAC: Authorizing `identity:get_project(project_id=a2da9394fcdb484b9e4bc1ac5d4c9d52)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:06.930242 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2a487-f3a3-4da1-8214-1cd22317f33c None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:06.931970 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 571/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:35:06 2022] GET /identity/v3/projects/a2da9394fcdb484b9e4bc1ac5d4c9d52 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:35:06.938837 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75dac8-94a7-4894-85e1-eae8d25e872f None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:07.038907 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75dac8-94a7-4894-85e1-eae8d25e872f None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:07.078489 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24f862-871b-4b00-85fe-1bc128a5a0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:07.079169 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24f862-871b-4b00-85fe-1bc128a5a0a8 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:07.079454 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24f862-871b-4b00-85fe-1bc128a5a0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:07.079732 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24f862-871b-4b00-85fe-1bc128a5a0a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:07.080596 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c24f862-871b-4b00-85fe-1bc128a5a0a8 None admin] RBAC: Adding query filter params (role.id=a5cb8d37261d486cbc1b06d167a9c05c, scope.project.id=a2da9394fcdb484b9e4bc1ac5d4c9d52, user.id=3fd9996b56644071b2334dde8538df0c) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:35:07.080910 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c24f862-871b-4b00-85fe-1bc128a5a0a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:07.082450 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c24f862-871b-4b00-85fe-1bc128a5a0a8 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:07.089167 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 590/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:35:06 2022] GET /identity/v3/role_assignments?user.id=3fd9996b56644071b2334dde8538df0c&scope.project.id=a2da9394fcdb484b9e4bc1ac5d4c9d52&role.id=a5cb8d37261d486cbc1b06d167a9c05c => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:35:09.403298 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44e48f-0ed9-4858-b80d-7083e4ccb9a0 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:09.403876 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44e48f-0ed9-4858-b80d-7083e4ccb9a0 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:09.403982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44e48f-0ed9-4858-b80d-7083e4ccb9a0 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:09.405625 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 572/1162] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:35:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:35:09.411248 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8b262-ec34-4eca-8b2d-53b83865abe0 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:09.411732 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8b262-ec34-4eca-8b2d-53b83865abe0 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:09.411838 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8b262-ec34-4eca-8b2d-53b83865abe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:09.428547 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-8bc8b262-ec34-4eca-8b2d-53b83865abe0 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:35:09.429776 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-8bc8b262-ec34-4eca-8b2d-53b83865abe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:35:09.496773 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 591/1163] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:35:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:35:09.519813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44e48f-0ed9-4858-b80d-7083e4ccb9a0 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:09.620817 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44e48f-0ed9-4858-b80d-7083e4ccb9a0 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:09.657081 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e41fc7-158e-4f7d-9794-0bfba2c41d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:09.657674 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e41fc7-158e-4f7d-9794-0bfba2c41d93 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:09.657961 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e41fc7-158e-4f7d-9794-0bfba2c41d93 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:09.658246 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e41fc7-158e-4f7d-9794-0bfba2c41d93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:09.726072 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e41fc7-158e-4f7d-9794-0bfba2c41d93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:09.727573 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e41fc7-158e-4f7d-9794-0bfba2c41d93 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:09.827543 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 573/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:35:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:35:09.837149 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8b262-ec34-4eca-8b2d-53b83865abe0 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:09.938510 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8b262-ec34-4eca-8b2d-53b83865abe0 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:09.975453 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376192b-3684-4acc-80b6-daaf38333f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:09.976259 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376192b-3684-4acc-80b6-daaf38333f6e None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:09.976543 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376192b-3684-4acc-80b6-daaf38333f6e None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:09.976817 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376192b-3684-4acc-80b6-daaf38333f6e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:09.985570 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376192b-3684-4acc-80b6-daaf38333f6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:09.987062 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376192b-3684-4acc-80b6-daaf38333f6e None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:10.003330 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-4376192b-3684-4acc-80b6-daaf38333f6e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 09 15:35:10.003330 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:35:10.003330 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 09 15:35:10.003330 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 09 15:35:10.003330 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:35:10.003330 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:35:10.003330 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:35:10.003330 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:35:10.003330 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 09 15:35:10.003330 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:35:10.003330 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:35:10.003330 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:35:10.003330 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:35:10.003330 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:35:10.003330 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:35:10.003330 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:35:10.003330 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:35:10.004756 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:35:10.004756 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:35:10.004756 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:35:10.004756 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:35:10.004756 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:35:10.004756 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:35:10.004756 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:35:10.004756 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:35:10.004756 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:35:10.004756 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:35:10.004756 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:35:10.004756 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:35:10.004756 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:35:10.004756 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:35:10.004756 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:35:10.004756 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:35:10.005939 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:35:10.005939 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:35:10.005939 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:35:10.005939 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:35:10.005939 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:35:10.005939 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:35:10.005939 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:35:10.005939 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:35:10.005939 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:35:10.005939 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:35:10.005939 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 09 15:35:10.005939 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:35:10.005939 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 09 15:35:10.005939 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:35:10.005939 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 592/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:35:09 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:35:10.010979 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e41fc7-158e-4f7d-9794-0bfba2c41d93 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:10.112612 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e41fc7-158e-4f7d-9794-0bfba2c41d93 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:10.147244 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38047c16-cd89-4d2a-8510-48759db2a119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:10.147912 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38047c16-cd89-4d2a-8510-48759db2a119 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:10.148194 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38047c16-cd89-4d2a-8510-48759db2a119 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:10.148471 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38047c16-cd89-4d2a-8510-48759db2a119 None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:10.149201 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38047c16-cd89-4d2a-8510-48759db2a119 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:35:10.149538 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38047c16-cd89-4d2a-8510-48759db2a119 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:10.150922 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38047c16-cd89-4d2a-8510-48759db2a119 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:10.159139 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 574/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:35:10 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:35:12.458839 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de656dce-2be7-4309-b9a9-2f8ca068c25c None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:12.459409 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de656dce-2be7-4309-b9a9-2f8ca068c25c None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:12.459409 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de656dce-2be7-4309-b9a9-2f8ca068c25c None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:12.460790 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 593/1167] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:35:12.466271 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e773b-3b68-47a9-9137-f35b223e8eda None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:12.466666 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e773b-3b68-47a9-9137-f35b223e8eda None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:12.466844 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e773b-3b68-47a9-9137-f35b223e8eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:12.483413 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-462e773b-3b68-47a9-9137-f35b223e8eda None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:35:12.484621 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-462e773b-3b68-47a9-9137-f35b223e8eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:35:12.557403 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 575/1168] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:35:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:35:12.581328 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de656dce-2be7-4309-b9a9-2f8ca068c25c None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:12.688708 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de656dce-2be7-4309-b9a9-2f8ca068c25c None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:12.723413 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63487578-1a5c-466d-8b0f-1b75dfc555d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:12.724004 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63487578-1a5c-466d-8b0f-1b75dfc555d8 None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:12.724294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63487578-1a5c-466d-8b0f-1b75dfc555d8 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:12.724575 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63487578-1a5c-466d-8b0f-1b75dfc555d8 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:12.725363 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63487578-1a5c-466d-8b0f-1b75dfc555d8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:12.726770 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63487578-1a5c-466d-8b0f-1b75dfc555d8 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:12.742799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 594/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Mon May 9 15:35:12 2022] POST /identity/v3/domains => generated 267 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:35:15.168113 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bd999-31d0-4613-98b5-ee75e84998df None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:15.168667 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bd999-31d0-4613-98b5-ee75e84998df None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:15.168667 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bd999-31d0-4613-98b5-ee75e84998df None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:15.170096 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 576/1170] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:35:15.175880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac5cb0-9ba5-4562-bb72-48624669bad2 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:15.176310 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac5cb0-9ba5-4562-bb72-48624669bad2 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:15.176450 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac5cb0-9ba5-4562-bb72-48624669bad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:15.193895 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-8eac5cb0-9ba5-4562-bb72-48624669bad2 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:35:15.195109 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-8eac5cb0-9ba5-4562-bb72-48624669bad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:35:15.262785 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 595/1171] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:35:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:35:15.288094 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bd999-31d0-4613-98b5-ee75e84998df None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:15.385709 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bd999-31d0-4613-98b5-ee75e84998df None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:15.420056 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719d555-38e9-48f3-b8cf-10c91baea694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:15.420901 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719d555-38e9-48f3-b8cf-10c91baea694 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:15.421183 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719d555-38e9-48f3-b8cf-10c91baea694 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:15.421484 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719d555-38e9-48f3-b8cf-10c91baea694 None admin] PATH_INFO: `/v3/domains/f31c12cd6e2b4886b95a6caaa040594f` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:15.432285 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719d555-38e9-48f3-b8cf-10c91baea694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f31c12cd6e2b4886b95a6caaa040594f)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:15.433788 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719d555-38e9-48f3-b8cf-10c91baea694 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:15.435482 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 577/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Mon May 9 15:35:15 2022] GET /identity/v3/domains/f31c12cd6e2b4886b95a6caaa040594f => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:35:15.442445 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac5cb0-9ba5-4562-bb72-48624669bad2 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:15.548068 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac5cb0-9ba5-4562-bb72-48624669bad2 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:15.582399 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a453289-28fa-435d-bfc7-e190d2c3ffb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:15.583065 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a453289-28fa-435d-bfc7-e190d2c3ffb1 None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:15.583354 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a453289-28fa-435d-bfc7-e190d2c3ffb1 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:15.583635 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a453289-28fa-435d-bfc7-e190d2c3ffb1 None admin] PATH_INFO: `/v3/projects` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:15.584346 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a453289-28fa-435d-bfc7-e190d2c3ffb1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:15.585826 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a453289-28fa-435d-bfc7-e190d2c3ffb1 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:15.611550 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 596/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:35:15 2022] POST /identity/v3/projects => generated 361 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:35:17.888329 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c81b8f-2127-4e77-9af8-7c295b686ed8 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:17.888857 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c81b8f-2127-4e77-9af8-7c295b686ed8 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:17.888857 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c81b8f-2127-4e77-9af8-7c295b686ed8 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:17.890377 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 578/1174] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:35:17.895704 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1ba9e-7b40-4f1f-825e-0ef0fc3a086d None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:17.896124 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1ba9e-7b40-4f1f-825e-0ef0fc3a086d None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:17.896261 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1ba9e-7b40-4f1f-825e-0ef0fc3a086d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:17.914021 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-0ee1ba9e-7b40-4f1f-825e-0ef0fc3a086d None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:35:17.915282 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-0ee1ba9e-7b40-4f1f-825e-0ef0fc3a086d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:35:17.981481 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 597/1175] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:35:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:35:18.007904 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c81b8f-2127-4e77-9af8-7c295b686ed8 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:18.113852 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c81b8f-2127-4e77-9af8-7c295b686ed8 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:18.153651 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc127c-972f-45f2-bb77-f3c61b30c724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:18.154440 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc127c-972f-45f2-bb77-f3c61b30c724 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:18.154849 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc127c-972f-45f2-bb77-f3c61b30c724 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:18.155230 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc127c-972f-45f2-bb77-f3c61b30c724 None admin] PATH_INFO: `/v3/domains/f31c12cd6e2b4886b95a6caaa040594f` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:18.156472 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc127c-972f-45f2-bb77-f3c61b30c724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f31c12cd6e2b4886b95a6caaa040594f)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:18.158030 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc127c-972f-45f2-bb77-f3c61b30c724 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:18.159620 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 579/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Mon May 9 15:35:18 2022] GET /identity/v3/domains/f31c12cd6e2b4886b95a6caaa040594f => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:35:18.166184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1ba9e-7b40-4f1f-825e-0ef0fc3a086d None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:18.263176 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1ba9e-7b40-4f1f-825e-0ef0fc3a086d None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:18.296290 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a352184-937c-4c2d-ad4f-b991791fa64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:18.296976 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a352184-937c-4c2d-ad4f-b991791fa64c None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:18.297263 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a352184-937c-4c2d-ad4f-b991791fa64c None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:18.297576 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a352184-937c-4c2d-ad4f-b991791fa64c None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:18.298289 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a352184-937c-4c2d-ad4f-b991791fa64c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:18.299731 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a352184-937c-4c2d-ad4f-b991791fa64c None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:18.319797 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 598/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:35:18 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:35:20.601239 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf35bb8-16bc-4347-b31e-c17092e37573 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:20.601872 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf35bb8-16bc-4347-b31e-c17092e37573 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:20.601872 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf35bb8-16bc-4347-b31e-c17092e37573 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:20.603228 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 580/1178] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:35:20.608670 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da804e-6865-4923-a7dc-78f36cb13725 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:20.609128 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da804e-6865-4923-a7dc-78f36cb13725 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:20.609234 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da804e-6865-4923-a7dc-78f36cb13725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:20.626787 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-51da804e-6865-4923-a7dc-78f36cb13725 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:35:20.627816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-51da804e-6865-4923-a7dc-78f36cb13725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:35:20.694665 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 599/1179] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:35:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:35:20.718958 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf35bb8-16bc-4347-b31e-c17092e37573 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:20.829182 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf35bb8-16bc-4347-b31e-c17092e37573 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:20.863061 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f9417-d614-4856-ad37-2c1dde4408f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:20.863786 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f9417-d614-4856-ad37-2c1dde4408f4 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:20.864068 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f9417-d614-4856-ad37-2c1dde4408f4 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:20.864344 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f9417-d614-4856-ad37-2c1dde4408f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:20.874940 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f9417-d614-4856-ad37-2c1dde4408f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:35:20.882487 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-4b7f9417-d614-4856-ad37-2c1dde4408f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:35:20.882487 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:35:20.882487 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:35:20.882487 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:35:20.882487 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:35:20.882487 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:35:20.882487 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:35:20.882487 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:35:20.882487 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:35:20.882487 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:35:20.882487 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:35:20.882487 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:35:20.882487 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:35:20.882487 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:35:20.882487 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:35:20.882487 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:35:20.883763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:35:20.883763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:35:20.883763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:35:20.883763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:35:20.883763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:35:20.883763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:35:20.883763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:35:20.883763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:35:20.883763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:35:20.883763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:35:20.883763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:35:20.883763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:35:20.883763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:35:20.883763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:35:20.883763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:35:20.883763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:35:20.885016 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:35:20.885016 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:35:20.885016 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:35:20.885016 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:35:20.885016 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:35:20.885016 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:35:20.885016 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:35:20.885016 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:35:20.885016 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:35:20.885016 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:35:20.885016 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:35:20.885016 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:35:20.885016 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 581/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:35:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:35:20.890677 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da804e-6865-4923-a7dc-78f36cb13725 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:20.987261 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da804e-6865-4923-a7dc-78f36cb13725 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:21.021588 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9602d-cfbd-44f2-863c-3bffcd7435d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:21.022261 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9602d-cfbd-44f2-863c-3bffcd7435d9 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:21.022544 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9602d-cfbd-44f2-863c-3bffcd7435d9 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:21.022818 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9602d-cfbd-44f2-863c-3bffcd7435d9 None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:21.023561 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9602d-cfbd-44f2-863c-3bffcd7435d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:35:21.023865 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9602d-cfbd-44f2-863c-3bffcd7435d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:21.025230 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9602d-cfbd-44f2-863c-3bffcd7435d9 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:21.033314 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 600/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:35:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:35:21.039162 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f9417-d614-4856-ad37-2c1dde4408f4 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:21.136791 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f9417-d614-4856-ad37-2c1dde4408f4 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:21.171051 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46562fe-0013-481d-8f02-cb071e023a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:21.172106 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46562fe-0013-481d-8f02-cb071e023a2f None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:21.172388 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46562fe-0013-481d-8f02-cb071e023a2f None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:21.172664 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46562fe-0013-481d-8f02-cb071e023a2f None admin] PATH_INFO: `/v3/users/a5837e1a7b28426eb99e82ec302ca0dd` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:21.186531 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46562fe-0013-481d-8f02-cb071e023a2f None admin] RBAC: Authorizing `identity:get_user(user_id=a5837e1a7b28426eb99e82ec302ca0dd)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:21.188265 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46562fe-0013-481d-8f02-cb071e023a2f None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:21.190010 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 582/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:35:21 2022] GET /identity/v3/users/a5837e1a7b28426eb99e82ec302ca0dd => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:35:21.195957 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9602d-cfbd-44f2-863c-3bffcd7435d9 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:21.293609 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9602d-cfbd-44f2-863c-3bffcd7435d9 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:21.327485 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9840ed-a79a-4a01-97a5-e86586051ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:21.328135 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9840ed-a79a-4a01-97a5-e86586051ad9 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:21.328426 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9840ed-a79a-4a01-97a5-e86586051ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:21.328709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9840ed-a79a-4a01-97a5-e86586051ad9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:21.395612 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9840ed-a79a-4a01-97a5-e86586051ad9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:21.397016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9840ed-a79a-4a01-97a5-e86586051ad9 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:21.499748 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 601/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:35:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:35:21.505698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46562fe-0013-481d-8f02-cb071e023a2f None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:21.602316 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46562fe-0013-481d-8f02-cb071e023a2f None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:21.637884 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983316e8-22f0-4e2f-81f6-2fb6c5604515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:21.638770 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983316e8-22f0-4e2f-81f6-2fb6c5604515 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:21.639255 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983316e8-22f0-4e2f-81f6-2fb6c5604515 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:21.639721 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983316e8-22f0-4e2f-81f6-2fb6c5604515 None admin] PATH_INFO: `/v3/projects/5fc3e7333698499794b397a0cd324319` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:21.641084 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983316e8-22f0-4e2f-81f6-2fb6c5604515 None admin] RBAC: Authorizing `identity:get_project(project_id=5fc3e7333698499794b397a0cd324319)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:21.642584 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983316e8-22f0-4e2f-81f6-2fb6c5604515 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:21.644331 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 583/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:35:21 2022] GET /identity/v3/projects/5fc3e7333698499794b397a0cd324319 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:35:21.650604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9840ed-a79a-4a01-97a5-e86586051ad9 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:21.751627 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9840ed-a79a-4a01-97a5-e86586051ad9 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:21.786134 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e885a-05fb-4729-b4d3-8706b1f1ddf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:21.786788 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e885a-05fb-4729-b4d3-8706b1f1ddf9 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:21.787073 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e885a-05fb-4729-b4d3-8706b1f1ddf9 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:21.787349 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e885a-05fb-4729-b4d3-8706b1f1ddf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:21.788181 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e885a-05fb-4729-b4d3-8706b1f1ddf9 None admin] RBAC: Adding query filter params (role.id=a5cb8d37261d486cbc1b06d167a9c05c, scope.project.id=5fc3e7333698499794b397a0cd324319, user.id=a5837e1a7b28426eb99e82ec302ca0dd) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:35:21.788499 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e885a-05fb-4729-b4d3-8706b1f1ddf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:21.789964 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e885a-05fb-4729-b4d3-8706b1f1ddf9 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:21.795321 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 602/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:35:21 2022] GET /identity/v3/role_assignments?user.id=a5837e1a7b28426eb99e82ec302ca0dd&scope.project.id=5fc3e7333698499794b397a0cd324319&role.id=a5cb8d37261d486cbc1b06d167a9c05c => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:35:24.056056 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c74592-c500-45f2-9618-16fa8c029a95 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:24.056629 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c74592-c500-45f2-9618-16fa8c029a95 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:24.056629 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c74592-c500-45f2-9618-16fa8c029a95 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:24.058045 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 584/1186] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:35:24.063614 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e47f7-9276-4d0d-b665-917c192866ac None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:24.064065 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e47f7-9276-4d0d-b665-917c192866ac None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:24.064175 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e47f7-9276-4d0d-b665-917c192866ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:24.081213 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-178e47f7-9276-4d0d-b665-917c192866ac None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:35:24.082443 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-178e47f7-9276-4d0d-b665-917c192866ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:35:24.150426 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 603/1187] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:35:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:35:24.174592 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c74592-c500-45f2-9618-16fa8c029a95 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:24.277591 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c74592-c500-45f2-9618-16fa8c029a95 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:24.310644 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824c29b-f3cc-4c1e-be0b-6488bfcf02bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:24.312190 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824c29b-f3cc-4c1e-be0b-6488bfcf02bb None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:24.312477 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824c29b-f3cc-4c1e-be0b-6488bfcf02bb None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:24.312755 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824c29b-f3cc-4c1e-be0b-6488bfcf02bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:24.322677 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824c29b-f3cc-4c1e-be0b-6488bfcf02bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:35:24.330557 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-a824c29b-f3cc-4c1e-be0b-6488bfcf02bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:35:24.330557 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:35:24.330557 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:35:24.330557 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:35:24.330557 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:35:24.330557 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:35:24.330557 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:35:24.330557 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:35:24.330557 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:35:24.330557 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:35:24.330557 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:35:24.330557 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:35:24.330557 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:35:24.330557 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:35:24.330557 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:35:24.330557 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:35:24.331808 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:35:24.331808 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:35:24.331808 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:35:24.331808 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:35:24.331808 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:35:24.331808 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:35:24.331808 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:35:24.331808 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:35:24.331808 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:35:24.331808 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:35:24.331808 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:35:24.331808 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:35:24.331808 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:35:24.331808 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:35:24.331808 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:35:24.331808 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:35:24.332982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:35:24.332982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:35:24.332982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:35:24.332982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:35:24.332982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:35:24.332982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:35:24.332982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:35:24.332982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:35:24.332982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:35:24.332982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:35:24.332982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:35:24.332982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:35:24.332982 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 585/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:35:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:35:24.338016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e47f7-9276-4d0d-b665-917c192866ac None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:24.437455 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e47f7-9276-4d0d-b665-917c192866ac None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:24.471403 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cba0a8-1c53-4c8e-89c9-421467fbea8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:24.472080 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cba0a8-1c53-4c8e-89c9-421467fbea8b None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:24.472363 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cba0a8-1c53-4c8e-89c9-421467fbea8b None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:24.472642 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cba0a8-1c53-4c8e-89c9-421467fbea8b None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:24.473412 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cba0a8-1c53-4c8e-89c9-421467fbea8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:35:24.473726 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cba0a8-1c53-4c8e-89c9-421467fbea8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:24.475102 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cba0a8-1c53-4c8e-89c9-421467fbea8b None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:24.483163 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 604/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:35:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:35:24.489320 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824c29b-f3cc-4c1e-be0b-6488bfcf02bb None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:24.586901 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824c29b-f3cc-4c1e-be0b-6488bfcf02bb None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:24.619779 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4baaf01-ea31-4671-a366-b4309ca4d9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:24.620648 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4baaf01-ea31-4671-a366-b4309ca4d9e7 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:24.620961 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4baaf01-ea31-4671-a366-b4309ca4d9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:24.621517 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4baaf01-ea31-4671-a366-b4309ca4d9e7 None admin] PATH_INFO: `/v3/users/a5837e1a7b28426eb99e82ec302ca0dd` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:24.622718 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4baaf01-ea31-4671-a366-b4309ca4d9e7 None admin] RBAC: Authorizing `identity:get_user(user_id=a5837e1a7b28426eb99e82ec302ca0dd)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:24.625446 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4baaf01-ea31-4671-a366-b4309ca4d9e7 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:24.627185 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 586/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:35:24 2022] GET /identity/v3/users/a5837e1a7b28426eb99e82ec302ca0dd => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:35:24.632995 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cba0a8-1c53-4c8e-89c9-421467fbea8b None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:24.732162 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cba0a8-1c53-4c8e-89c9-421467fbea8b None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:24.765816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dfc35-5da9-467b-96b2-ab66050fdbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:24.766678 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dfc35-5da9-467b-96b2-ab66050fdbe2 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:24.766957 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dfc35-5da9-467b-96b2-ab66050fdbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:24.767229 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dfc35-5da9-467b-96b2-ab66050fdbe2 None admin] PATH_INFO: `/v3/projects/5fc3e7333698499794b397a0cd324319` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:24.768402 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dfc35-5da9-467b-96b2-ab66050fdbe2 None admin] RBAC: Authorizing `identity:get_project(project_id=5fc3e7333698499794b397a0cd324319)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:24.769870 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dfc35-5da9-467b-96b2-ab66050fdbe2 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:24.771584 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 605/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:35:24 2022] GET /identity/v3/projects/5fc3e7333698499794b397a0cd324319 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:35:24.777548 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4baaf01-ea31-4671-a366-b4309ca4d9e7 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:24.880231 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4baaf01-ea31-4671-a366-b4309ca4d9e7 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:24.913891 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd263d91-030e-4efa-8914-b1d20a4d9aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:24.914776 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd263d91-030e-4efa-8914-b1d20a4d9aaa None admin] REQUEST_METHOD: `PUT` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:24.915055 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd263d91-030e-4efa-8914-b1d20a4d9aaa None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:24.915329 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd263d91-030e-4efa-8914-b1d20a4d9aaa None admin] PATH_INFO: `/v3/projects/5fc3e7333698499794b397a0cd324319/users/a5837e1a7b28426eb99e82ec302ca0dd/roles/a5cb8d37261d486cbc1b06d167a9c05c` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:24.917272 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd263d91-030e-4efa-8914-b1d20a4d9aaa None admin] RBAC: Authorizing `identity:create_grant(project_id=5fc3e7333698499794b397a0cd324319, user_id=a5837e1a7b28426eb99e82ec302ca0dd, role_id=a5cb8d37261d486cbc1b06d167a9c05c)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:24.918738 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd263d91-030e-4efa-8914-b1d20a4d9aaa None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:24.931583 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 587/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:35:24 2022] PUT /identity/v3/projects/5fc3e7333698499794b397a0cd324319/users/a5837e1a7b28426eb99e82ec302ca0dd/roles/a5cb8d37261d486cbc1b06d167a9c05c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:35:27.210854 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92196d-9c5c-4c79-b0f9-41632281bcc8 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:27.211430 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92196d-9c5c-4c79-b0f9-41632281bcc8 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:27.211430 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92196d-9c5c-4c79-b0f9-41632281bcc8 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:27.212818 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 606/1193] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:35:27.218345 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa80eae-af72-473c-ad55-64c4f5317b8d None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:27.218813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa80eae-af72-473c-ad55-64c4f5317b8d None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:27.219054 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa80eae-af72-473c-ad55-64c4f5317b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:27.236939 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-4fa80eae-af72-473c-ad55-64c4f5317b8d None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:35:27.238205 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-4fa80eae-af72-473c-ad55-64c4f5317b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:35:27.310398 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 588/1194] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:35:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:35:27.333847 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92196d-9c5c-4c79-b0f9-41632281bcc8 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:27.438579 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92196d-9c5c-4c79-b0f9-41632281bcc8 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:27.474179 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61711b7-9907-4497-82a4-0a4d119c539a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:27.474904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61711b7-9907-4497-82a4-0a4d119c539a None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:27.475184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61711b7-9907-4497-82a4-0a4d119c539a None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:27.475456 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61711b7-9907-4497-82a4-0a4d119c539a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:27.488366 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61711b7-9907-4497-82a4-0a4d119c539a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:35:27.496405 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-c61711b7-9907-4497-82a4-0a4d119c539a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:35:27.496405 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:35:27.496405 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:35:27.496405 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:35:27.496405 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:35:27.496405 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:35:27.496405 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:35:27.496405 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:35:27.496405 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:35:27.496405 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:35:27.496405 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:35:27.496405 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:35:27.496405 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:35:27.496405 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:35:27.496405 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:35:27.496405 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:35:27.497751 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:35:27.497751 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:35:27.497751 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:35:27.497751 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:35:27.497751 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:35:27.497751 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:35:27.497751 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:35:27.497751 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:35:27.497751 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:35:27.497751 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:35:27.497751 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:35:27.497751 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:35:27.497751 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:35:27.497751 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:35:27.497751 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:35:27.497751 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:35:27.499920 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:35:27.499920 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:35:27.499920 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:35:27.499920 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:35:27.499920 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:35:27.499920 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:35:27.499920 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:35:27.499920 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:35:27.499920 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:35:27.499920 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:35:27.499920 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:35:27.499920 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:35:27.499920 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 607/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:35:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:35:27.504714 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa80eae-af72-473c-ad55-64c4f5317b8d None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:27.610414 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa80eae-af72-473c-ad55-64c4f5317b8d None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:27.647633 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53165a61-79ee-485c-97aa-7c573452306f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:27.648317 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53165a61-79ee-485c-97aa-7c573452306f None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:27.648698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53165a61-79ee-485c-97aa-7c573452306f None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:27.648985 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53165a61-79ee-485c-97aa-7c573452306f None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:27.649786 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53165a61-79ee-485c-97aa-7c573452306f None admin] RBAC: Adding query filter params (name=admin) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:35:27.650104 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53165a61-79ee-485c-97aa-7c573452306f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:27.653466 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53165a61-79ee-485c-97aa-7c573452306f None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:27.662778 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 589/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:35:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:35:27.668642 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61711b7-9907-4497-82a4-0a4d119c539a None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:27.780889 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61711b7-9907-4497-82a4-0a4d119c539a None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:27.817646 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a0ffc-65cb-4ae3-9554-0aa689312155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:27.818537 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a0ffc-65cb-4ae3-9554-0aa689312155 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:27.818826 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a0ffc-65cb-4ae3-9554-0aa689312155 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:27.819114 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a0ffc-65cb-4ae3-9554-0aa689312155 None admin] PATH_INFO: `/v3/users/a5837e1a7b28426eb99e82ec302ca0dd` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:27.820409 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a0ffc-65cb-4ae3-9554-0aa689312155 None admin] RBAC: Authorizing `identity:get_user(user_id=a5837e1a7b28426eb99e82ec302ca0dd)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:27.821928 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a0ffc-65cb-4ae3-9554-0aa689312155 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:27.823693 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 608/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:35:27 2022] GET /identity/v3/users/a5837e1a7b28426eb99e82ec302ca0dd => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:35:27.830333 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53165a61-79ee-485c-97aa-7c573452306f None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:27.948077 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53165a61-79ee-485c-97aa-7c573452306f None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:27.983098 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d2bc6-e733-4f16-8a9c-20787fa332c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:27.983747 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d2bc6-e733-4f16-8a9c-20787fa332c0 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:27.984182 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d2bc6-e733-4f16-8a9c-20787fa332c0 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:27.984458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d2bc6-e733-4f16-8a9c-20787fa332c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:28.051349 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d2bc6-e733-4f16-8a9c-20787fa332c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:28.052720 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d2bc6-e733-4f16-8a9c-20787fa332c0 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:28.151934 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 590/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:35:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:35:28.158668 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a0ffc-65cb-4ae3-9554-0aa689312155 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:28.260769 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a0ffc-65cb-4ae3-9554-0aa689312155 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:28.295745 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960ca08-a9a7-4084-9e36-d26ecefc4d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:28.296624 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960ca08-a9a7-4084-9e36-d26ecefc4d81 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:28.296912 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960ca08-a9a7-4084-9e36-d26ecefc4d81 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:28.297192 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960ca08-a9a7-4084-9e36-d26ecefc4d81 None admin] PATH_INFO: `/v3/projects/5fc3e7333698499794b397a0cd324319` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:28.298444 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960ca08-a9a7-4084-9e36-d26ecefc4d81 None admin] RBAC: Authorizing `identity:get_project(project_id=5fc3e7333698499794b397a0cd324319)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:28.299906 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960ca08-a9a7-4084-9e36-d26ecefc4d81 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:28.301733 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 609/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:35:28 2022] GET /identity/v3/projects/5fc3e7333698499794b397a0cd324319 => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:35:28.307992 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d2bc6-e733-4f16-8a9c-20787fa332c0 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:35:28.405948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d2bc6-e733-4f16-8a9c-20787fa332c0 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:35:28.439973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aaf3b2-6ccb-45d3-936d-b99e939e90d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:35:28.440628 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aaf3b2-6ccb-45d3-936d-b99e939e90d4 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:35:28.440907 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aaf3b2-6ccb-45d3-936d-b99e939e90d4 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:35:28.441184 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aaf3b2-6ccb-45d3-936d-b99e939e90d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:35:28.442056 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aaf3b2-6ccb-45d3-936d-b99e939e90d4 None admin] RBAC: Adding query filter params (role.id=a5cb8d37261d486cbc1b06d167a9c05c, scope.project.id=5fc3e7333698499794b397a0cd324319, user.id=a5837e1a7b28426eb99e82ec302ca0dd) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:35:28.442369 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aaf3b2-6ccb-45d3-936d-b99e939e90d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:35:28.443807 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aaf3b2-6ccb-45d3-936d-b99e939e90d4 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:35:28.449942 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 591/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:35:28 2022] GET /identity/v3/role_assignments?user.id=a5837e1a7b28426eb99e82ec302ca0dd&scope.project.id=5fc3e7333698499794b397a0cd324319&role.id=a5cb8d37261d486cbc1b06d167a9c05c => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:30.464271 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e561022-af5b-456f-b2ac-5b8ddd15d33f None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:30.464904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e561022-af5b-456f-b2ac-5b8ddd15d33f None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:30.464904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e561022-af5b-456f-b2ac-5b8ddd15d33f None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:30.466378 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 610/1201] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:36:30.472719 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2f12b-bca6-4f65-ae23-3c7ccb5c4065 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:30.473303 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2f12b-bca6-4f65-ae23-3c7ccb5c4065 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:30.473303 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2f12b-bca6-4f65-ae23-3c7ccb5c4065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:30.491738 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-a3e2f12b-bca6-4f65-ae23-3c7ccb5c4065 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:36:30.493064 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-a3e2f12b-bca6-4f65-ae23-3c7ccb5c4065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:36:30.573060 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 592/1202] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:36:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:36:30.598030 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e561022-af5b-456f-b2ac-5b8ddd15d33f None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:30.749992 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e561022-af5b-456f-b2ac-5b8ddd15d33f None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:30.788934 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8356cfc-a8a8-43ad-9547-d94f81f8ca1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:30.789957 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8356cfc-a8a8-43ad-9547-d94f81f8ca1d None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:30.790257 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8356cfc-a8a8-43ad-9547-d94f81f8ca1d None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:30.790627 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8356cfc-a8a8-43ad-9547-d94f81f8ca1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:30.802334 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8356cfc-a8a8-43ad-9547-d94f81f8ca1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:30.804155 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8356cfc-a8a8-43ad-9547-d94f81f8ca1d None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:30.822773 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-d8356cfc-a8a8-43ad-9547-d94f81f8ca1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:30.822773 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:30.822773 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:30.822773 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:30.822773 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:30.822773 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:30.822773 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:30.822773 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:30.822773 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:30.822773 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:30.822773 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:30.822773 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:30.822773 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:36:30.822773 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:36:30.822773 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:36:30.824005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:36:30.824005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:30.824005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:30.824005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:30.824005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:30.824005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:30.824005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:30.824005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:30.824005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:36:30.824005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:30.824005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:30.824005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:30.824005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:30.824005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:30.824005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:30.824005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:30.824005 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:30.825101 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:36:30.825101 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:36:30.825101 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:30.825101 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:36:30.828201 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 611/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:30.833908 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2f12b-bca6-4f65-ae23-3c7ccb5c4065 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:30.931700 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2f12b-bca6-4f65-ae23-3c7ccb5c4065 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:30.965897 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f357ce8-c4e3-4008-9bb2-428b05fe560f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:30.967104 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f357ce8-c4e3-4008-9bb2-428b05fe560f None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:30.967401 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f357ce8-c4e3-4008-9bb2-428b05fe560f None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:30.967658 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f357ce8-c4e3-4008-9bb2-428b05fe560f None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:30.969993 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f357ce8-c4e3-4008-9bb2-428b05fe560f None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:30.971497 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f357ce8-c4e3-4008-9bb2-428b05fe560f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:30.974098 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f357ce8-c4e3-4008-9bb2-428b05fe560f None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:30.986539 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 593/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:36:30.991919 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8356cfc-a8a8-43ad-9547-d94f81f8ca1d None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:31.113644 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8356cfc-a8a8-43ad-9547-d94f81f8ca1d None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:31.159114 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a104b-56a0-4746-a861-cf856afc4807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:31.159889 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a104b-56a0-4746-a861-cf856afc4807 None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:31.160203 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a104b-56a0-4746-a861-cf856afc4807 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:31.160490 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a104b-56a0-4746-a861-cf856afc4807 None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:31.161348 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a104b-56a0-4746-a861-cf856afc4807 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:31.163124 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a104b-56a0-4746-a861-cf856afc4807 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:31.191911 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 612/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:36:30 2022] POST /identity/v3/users => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:36:33.686701 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3cbfe-6ab7-41cd-a939-489acf3d30fb None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:33.687300 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3cbfe-6ab7-41cd-a939-489acf3d30fb None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:33.687300 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3cbfe-6ab7-41cd-a939-489acf3d30fb None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:33.688708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 594/1206] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:36:33.694535 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645dbee-9d84-45b8-88d3-bbe94f0434b2 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:33.695029 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645dbee-9d84-45b8-88d3-bbe94f0434b2 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:33.695142 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645dbee-9d84-45b8-88d3-bbe94f0434b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:33.714258 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-4645dbee-9d84-45b8-88d3-bbe94f0434b2 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:36:33.716137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-4645dbee-9d84-45b8-88d3-bbe94f0434b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:36:33.799524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 613/1207] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:36:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:36:33.824108 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3cbfe-6ab7-41cd-a939-489acf3d30fb None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:33.986004 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3cbfe-6ab7-41cd-a939-489acf3d30fb None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:34.032724 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebcde86-002f-4401-a588-5e8afb986288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:34.033791 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcde86-002f-4401-a588-5e8afb986288 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:34.034103 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcde86-002f-4401-a588-5e8afb986288 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:34.034486 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcde86-002f-4401-a588-5e8afb986288 None admin] PATH_INFO: `/v3/roles/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:34.048343 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebcde86-002f-4401-a588-5e8afb986288 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:36:34.056657 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-cebcde86-002f-4401-a588-5e8afb986288 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:36:34.056657 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:34.056657 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:34.056657 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:34.056657 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:34.056657 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:34.056657 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:34.056657 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:34.056657 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:34.056657 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:34.056657 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:34.056657 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:34.056657 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:36:34.056657 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:36:34.056657 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:36:34.056657 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:36:34.057914 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:36:34.057914 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:36:34.057914 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:36:34.057914 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:36:34.057914 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:34.057914 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:34.057914 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:34.057914 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:34.057914 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:34.057914 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:34.057914 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:34.057914 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:36:34.057914 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:34.057914 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:34.057914 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:34.057914 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:34.059051 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:34.059051 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:34.059051 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:34.059051 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:34.059051 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:36:34.059051 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:36:34.059051 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:36:34.059051 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:36:34.059051 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:36:34.059051 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:36:34.059051 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:36:34.059051 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:36:34.059051 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 595/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:36:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:34.065987 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645dbee-9d84-45b8-88d3-bbe94f0434b2 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:34.207122 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645dbee-9d84-45b8-88d3-bbe94f0434b2 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:34.257193 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311d382-a70f-4561-8fff-98d4a3472b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:34.258047 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311d382-a70f-4561-8fff-98d4a3472b73 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:34.258470 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311d382-a70f-4561-8fff-98d4a3472b73 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:34.258921 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311d382-a70f-4561-8fff-98d4a3472b73 None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:34.259942 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311d382-a70f-4561-8fff-98d4a3472b73 None admin] RBAC: Adding query filter params (name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:34.260358 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311d382-a70f-4561-8fff-98d4a3472b73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:34.262014 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311d382-a70f-4561-8fff-98d4a3472b73 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:34.272547 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 614/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:36:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:34.278340 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebcde86-002f-4401-a588-5e8afb986288 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:34.421070 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebcde86-002f-4401-a588-5e8afb986288 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:34.479115 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b64a8-32b2-46cb-aa6f-0a4531709c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:34.480097 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b64a8-32b2-46cb-aa6f-0a4531709c31 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:34.480459 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b64a8-32b2-46cb-aa6f-0a4531709c31 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:34.480741 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b64a8-32b2-46cb-aa6f-0a4531709c31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:34.499107 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b64a8-32b2-46cb-aa6f-0a4531709c31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:34.500100 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b64a8-32b2-46cb-aa6f-0a4531709c31 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:34.525642 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-559b64a8-32b2-46cb-aa6f-0a4531709c31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:34.525642 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:34.525642 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:34.525642 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:34.525642 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:34.525642 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:34.525642 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:34.525642 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:34.525642 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:34.525642 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:34.525642 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:34.525642 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:34.525642 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:36:34.525642 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:36:34.525642 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:36:34.526706 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:36:34.526706 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:34.526706 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:34.526706 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:34.526706 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:34.526706 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:34.526706 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:34.526706 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:34.526706 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:36:34.526706 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:34.526706 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:34.526706 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:34.526706 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:34.526706 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:34.526706 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:34.526706 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:34.526706 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:34.527717 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:36:34.527717 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:36:34.527717 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:34.527717 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:36:34.527717 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 596/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:36:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:34.530830 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311d382-a70f-4561-8fff-98d4a3472b73 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:34.655921 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311d382-a70f-4561-8fff-98d4a3472b73 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:34.698454 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e6ad2-7c06-43d7-86d1-54c42884c6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:34.699144 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e6ad2-7c06-43d7-86d1-54c42884c6b4 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:34.699549 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e6ad2-7c06-43d7-86d1-54c42884c6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:34.699704 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e6ad2-7c06-43d7-86d1-54c42884c6b4 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:34.700461 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e6ad2-7c06-43d7-86d1-54c42884c6b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:34.700861 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e6ad2-7c06-43d7-86d1-54c42884c6b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:34.702747 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e6ad2-7c06-43d7-86d1-54c42884c6b4 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:34.716633 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 615/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:34.722848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b64a8-32b2-46cb-aa6f-0a4531709c31 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:34.844928 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b64a8-32b2-46cb-aa6f-0a4531709c31 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:34.884624 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f725b3c-87e2-4c93-b238-5873e8683d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:34.885470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f725b3c-87e2-4c93-b238-5873e8683d54 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:34.885744 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f725b3c-87e2-4c93-b238-5873e8683d54 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:34.886060 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f725b3c-87e2-4c93-b238-5873e8683d54 None admin] PATH_INFO: `/v3/users/placement` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:34.899987 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f725b3c-87e2-4c93-b238-5873e8683d54 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:34.902632 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f725b3c-87e2-4c93-b238-5873e8683d54 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:34.930212 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-3f725b3c-87e2-4c93-b238-5873e8683d54 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:36:34.930212 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:34.930212 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:34.930212 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:34.930212 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:34.930212 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:34.930212 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:34.930212 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:34.930212 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:34.930212 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:34.930212 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:34.930212 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:34.930212 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:36:34.930212 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:36:34.930212 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:36:34.930212 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:36:34.932130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:34.932130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:34.932130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:36:34.932130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:36:34.932130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:36:34.932130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:36:34.932130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:34.932130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:34.932130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:34.932130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:34.932130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:34.932130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:36:34.932130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:34.932130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:34.932130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:34.932130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:34.932130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:34.932130 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:34.940201 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:34.940201 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:34.940201 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:36:34.940201 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:36:34.940201 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:36:34.940201 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:36:34.940201 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:36:34.940201 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:36:34.940201 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:36:34.940201 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:36:34.940201 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 597/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:36:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:34.940976 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e6ad2-7c06-43d7-86d1-54c42884c6b4 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:35.130338 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e6ad2-7c06-43d7-86d1-54c42884c6b4 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:35.208931 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02d22a-43fa-4af4-899d-84ed9060ce2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:35.210222 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02d22a-43fa-4af4-899d-84ed9060ce2f None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:35.210666 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02d22a-43fa-4af4-899d-84ed9060ce2f None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:35.211136 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02d22a-43fa-4af4-899d-84ed9060ce2f None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:35.212828 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02d22a-43fa-4af4-899d-84ed9060ce2f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:35.213321 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02d22a-43fa-4af4-899d-84ed9060ce2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:35.217113 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02d22a-43fa-4af4-899d-84ed9060ce2f None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:35.262215 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 616/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 9 15:36:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:35.274225 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f725b3c-87e2-4c93-b238-5873e8683d54 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:35.430075 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f725b3c-87e2-4c93-b238-5873e8683d54 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:35.471681 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dc19d-8ad1-4a92-9485-c81d1bd0c60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:35.472367 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dc19d-8ad1-4a92-9485-c81d1bd0c60f None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:35.472652 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dc19d-8ad1-4a92-9485-c81d1bd0c60f None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:35.472932 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dc19d-8ad1-4a92-9485-c81d1bd0c60f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:35.564187 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6dc19d-8ad1-4a92-9485-c81d1bd0c60f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:35.565723 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6dc19d-8ad1-4a92-9485-c81d1bd0c60f None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:35.686563 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 598/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:36:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:36:35.693294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02d22a-43fa-4af4-899d-84ed9060ce2f None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:35.834111 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02d22a-43fa-4af4-899d-84ed9060ce2f None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:35.877633 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c55347-65c3-468d-a462-c49ba438e7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:35.878477 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c55347-65c3-468d-a462-c49ba438e7ca None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:35.878854 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c55347-65c3-468d-a462-c49ba438e7ca None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:35.879213 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c55347-65c3-468d-a462-c49ba438e7ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:35.891848 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c55347-65c3-468d-a462-c49ba438e7ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:35.893900 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c55347-65c3-468d-a462-c49ba438e7ca None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:35.914191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-39c55347-65c3-468d-a462-c49ba438e7ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:35.914191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:35.914191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:35.914191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:35.914191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:35.914191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:35.914191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:35.914191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:35.914191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:35.914191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:35.914191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:35.914191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:35.914191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:36:35.914191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:36:35.914191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:36:35.915458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:36:35.915458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:35.915458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:35.915458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:35.915458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:35.915458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:35.915458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:35.915458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:35.915458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:36:35.915458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:35.915458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:35.915458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:35.915458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:35.915458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:35.915458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:35.915458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:35.915458 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:35.916469 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:36:35.916469 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:36:35.916469 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:35.916469 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:36:35.916469 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 617/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:35.922639 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dc19d-8ad1-4a92-9485-c81d1bd0c60f None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:36.037813 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dc19d-8ad1-4a92-9485-c81d1bd0c60f None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:36.081763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474011b-3717-4b29-9449-e69b80b39fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:36.082446 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474011b-3717-4b29-9449-e69b80b39fc1 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:36.082730 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474011b-3717-4b29-9449-e69b80b39fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:36.083009 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474011b-3717-4b29-9449-e69b80b39fc1 None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:36.083837 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474011b-3717-4b29-9449-e69b80b39fc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:36.084253 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474011b-3717-4b29-9449-e69b80b39fc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:36.085743 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474011b-3717-4b29-9449-e69b80b39fc1 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:36.100490 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 599/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:36.106546 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c55347-65c3-468d-a462-c49ba438e7ca None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:36.233858 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c55347-65c3-468d-a462-c49ba438e7ca None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:36.273172 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94633fdb-82d7-42c1-b059-511a8d331bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:36.274059 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94633fdb-82d7-42c1-b059-511a8d331bf3 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:36.274293 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94633fdb-82d7-42c1-b059-511a8d331bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:36.274570 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94633fdb-82d7-42c1-b059-511a8d331bf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:36.282989 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94633fdb-82d7-42c1-b059-511a8d331bf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:36.284469 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94633fdb-82d7-42c1-b059-511a8d331bf3 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:36.300093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-94633fdb-82d7-42c1-b059-511a8d331bf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:36:36.300093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:36.300093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:36.300093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:36.300093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:36.300093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:36.300093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:36.300093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:36.300093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:36.300093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:36.300093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:36.300093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:36.300093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:36:36.300093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:36:36.300093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:36:36.301620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:36:36.301620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:36.301620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:36.301620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:36.301620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:36.301620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:36.301620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:36.301620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:36.301620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:36:36.301620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:36.301620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:36.301620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:36.301620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:36.301620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:36.301620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:36.301620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:36.301620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:36.302671 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:36:36.302671 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:36:36.302671 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:36:36.302671 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:36:36.302671 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:36:36.302671 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:36:36.302671 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:36:36.302671 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:36:36.302671 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 618/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:36:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:36.307506 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474011b-3717-4b29-9449-e69b80b39fc1 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:36.443211 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474011b-3717-4b29-9449-e69b80b39fc1 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:36.496878 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3e43f-e9ba-49f1-8c4d-89139c1f4548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:36.497726 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3e43f-e9ba-49f1-8c4d-89139c1f4548 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:36.498036 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3e43f-e9ba-49f1-8c4d-89139c1f4548 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:36.498309 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3e43f-e9ba-49f1-8c4d-89139c1f4548 None admin] PATH_INFO: `/v3/projects` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:36.499558 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3e43f-e9ba-49f1-8c4d-89139c1f4548 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:36.499886 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3e43f-e9ba-49f1-8c4d-89139c1f4548 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:36.501657 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3e43f-e9ba-49f1-8c4d-89139c1f4548 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:36.516565 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 600/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:36:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:36.524938 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94633fdb-82d7-42c1-b059-511a8d331bf3 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:36.649657 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94633fdb-82d7-42c1-b059-511a8d331bf3 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:36.687586 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94e60f-53a0-4d57-8ccf-d63ca27d0473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:36.688294 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94e60f-53a0-4d57-8ccf-d63ca27d0473 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:36.688620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94e60f-53a0-4d57-8ccf-d63ca27d0473 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:36.688970 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94e60f-53a0-4d57-8ccf-d63ca27d0473 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:36.689880 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94e60f-53a0-4d57-8ccf-d63ca27d0473 None admin] RBAC: Adding query filter params (role.id=b22352a378fb404d90e3b3ae182757ad, scope.project.id=db5768a93e754372808fc69f898cc853, user.id=3d51a903276d400793c4ef18d5b043cb) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:36.690297 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94e60f-53a0-4d57-8ccf-d63ca27d0473 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:36.691951 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94e60f-53a0-4d57-8ccf-d63ca27d0473 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:36.698429 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 619/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:36:36 2022] GET /identity/v3/role_assignments?user.id=3d51a903276d400793c4ef18d5b043cb&scope.project.id=db5768a93e754372808fc69f898cc853&role.id=b22352a378fb404d90e3b3ae182757ad => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:39.018474 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12868a-0b1b-4d00-a03f-d5677d13afe7 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:39.019118 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12868a-0b1b-4d00-a03f-d5677d13afe7 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:39.019118 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12868a-0b1b-4d00-a03f-d5677d13afe7 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:39.020594 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 601/1220] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:36:39.026221 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ff790-311d-4500-934a-ee4e13894e33 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:39.026724 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ff790-311d-4500-934a-ee4e13894e33 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:39.028178 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ff790-311d-4500-934a-ee4e13894e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:39.049102 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-536ff790-311d-4500-934a-ee4e13894e33 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:36:39.050554 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-536ff790-311d-4500-934a-ee4e13894e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:36:39.136452 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 620/1221] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:36:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:36:39.159521 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12868a-0b1b-4d00-a03f-d5677d13afe7 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:39.267189 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12868a-0b1b-4d00-a03f-d5677d13afe7 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:39.306750 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeadcab-7360-412b-8de8-6d0bde703570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:39.307456 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeadcab-7360-412b-8de8-6d0bde703570 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:39.307756 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeadcab-7360-412b-8de8-6d0bde703570 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:39.308019 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeadcab-7360-412b-8de8-6d0bde703570 None admin] PATH_INFO: `/v3/roles/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:39.320207 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeadcab-7360-412b-8de8-6d0bde703570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:36:39.328541 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-9eeadcab-7360-412b-8de8-6d0bde703570 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:36:39.328541 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:39.328541 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:39.328541 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:39.328541 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:39.328541 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:39.328541 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:39.328541 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:39.328541 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:39.328541 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:39.328541 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:39.328541 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:39.328541 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:36:39.328541 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:36:39.328541 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:36:39.328541 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:36:39.329917 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:36:39.329917 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:36:39.329917 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:36:39.329917 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:36:39.329917 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:39.329917 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:39.329917 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:39.329917 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:39.329917 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:39.329917 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:39.329917 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:39.329917 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:36:39.329917 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:39.329917 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:39.329917 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:39.329917 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:39.331257 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:39.331257 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:39.331257 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:39.331257 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:39.331257 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:36:39.331257 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:36:39.331257 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:36:39.331257 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:36:39.331257 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:36:39.331257 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:36:39.331257 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:36:39.331257 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:36:39.337417 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 602/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:36:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:39.337657 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ff790-311d-4500-934a-ee4e13894e33 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:39.459633 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ff790-311d-4500-934a-ee4e13894e33 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:39.502416 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d05b2-90ad-40c5-b3d8-2ee6cfcd8123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:39.503253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d05b2-90ad-40c5-b3d8-2ee6cfcd8123 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:39.503539 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d05b2-90ad-40c5-b3d8-2ee6cfcd8123 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:39.503817 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d05b2-90ad-40c5-b3d8-2ee6cfcd8123 None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:39.504648 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d05b2-90ad-40c5-b3d8-2ee6cfcd8123 None admin] RBAC: Adding query filter params (name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:39.504951 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d05b2-90ad-40c5-b3d8-2ee6cfcd8123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:39.506732 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d05b2-90ad-40c5-b3d8-2ee6cfcd8123 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:39.517115 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 621/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:36:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:39.522885 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeadcab-7360-412b-8de8-6d0bde703570 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:39.639826 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeadcab-7360-412b-8de8-6d0bde703570 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:39.675991 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc76b73-1844-4b4e-9b46-b6def5f2e9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:39.676821 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc76b73-1844-4b4e-9b46-b6def5f2e9e4 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:39.677127 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc76b73-1844-4b4e-9b46-b6def5f2e9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:39.677389 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc76b73-1844-4b4e-9b46-b6def5f2e9e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:39.687893 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc76b73-1844-4b4e-9b46-b6def5f2e9e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:39.689387 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc76b73-1844-4b4e-9b46-b6def5f2e9e4 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:39.707408 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-fcc76b73-1844-4b4e-9b46-b6def5f2e9e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:39.707408 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:39.707408 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:39.707408 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:39.707408 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:39.707408 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:39.707408 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:39.707408 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:39.707408 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:39.707408 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:39.707408 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:39.707408 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:39.707408 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:36:39.707408 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:36:39.707408 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:36:39.708699 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:36:39.708699 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:39.708699 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:39.708699 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:39.708699 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:39.708699 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:39.708699 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:39.708699 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:39.708699 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:36:39.708699 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:39.708699 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:39.708699 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:39.708699 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:39.708699 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:39.708699 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:39.708699 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:39.708699 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:39.709961 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:36:39.709961 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:36:39.709961 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:39.709961 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:36:39.711333 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 603/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:39.718528 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d05b2-90ad-40c5-b3d8-2ee6cfcd8123 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:39.831789 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d05b2-90ad-40c5-b3d8-2ee6cfcd8123 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:39.867854 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23633275-8aad-447c-94b5-8ebcb773306b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:39.868515 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23633275-8aad-447c-94b5-8ebcb773306b None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:39.868803 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23633275-8aad-447c-94b5-8ebcb773306b None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:39.869088 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23633275-8aad-447c-94b5-8ebcb773306b None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:39.869870 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23633275-8aad-447c-94b5-8ebcb773306b None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:39.870181 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23633275-8aad-447c-94b5-8ebcb773306b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:39.871566 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23633275-8aad-447c-94b5-8ebcb773306b None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:39.883852 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 622/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:39.890582 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc76b73-1844-4b4e-9b46-b6def5f2e9e4 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:40.002331 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc76b73-1844-4b4e-9b46-b6def5f2e9e4 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:40.039848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e15758-50fb-4173-901c-79f4c52e6642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:40.040784 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e15758-50fb-4173-901c-79f4c52e6642 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:40.041064 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e15758-50fb-4173-901c-79f4c52e6642 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:40.041487 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e15758-50fb-4173-901c-79f4c52e6642 None admin] PATH_INFO: `/v3/users/placement` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:40.050152 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e15758-50fb-4173-901c-79f4c52e6642 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:40.051823 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e15758-50fb-4173-901c-79f4c52e6642 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:40.068965 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-d1e15758-50fb-4173-901c-79f4c52e6642 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:36:40.068965 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:40.068965 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:40.068965 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:40.068965 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:40.068965 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:40.068965 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:40.068965 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:40.068965 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:40.068965 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:40.068965 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:40.068965 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:40.068965 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:36:40.068965 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:36:40.068965 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:36:40.068965 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:36:40.070367 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:40.070367 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:40.070367 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:36:40.070367 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:36:40.070367 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:36:40.070367 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:36:40.070367 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:40.070367 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:40.070367 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:40.070367 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:40.070367 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:40.070367 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:36:40.070367 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:40.070367 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:40.070367 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:40.070367 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:40.070367 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:40.070367 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:40.071467 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:40.071467 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:40.071467 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:36:40.071467 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:36:40.071467 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:36:40.071467 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:36:40.071467 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:36:40.071467 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:36:40.071467 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:36:40.071467 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:36:40.071467 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 604/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:36:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:40.077176 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23633275-8aad-447c-94b5-8ebcb773306b None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:40.193300 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23633275-8aad-447c-94b5-8ebcb773306b None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:40.232923 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c5af6-5f0c-4af5-acbc-04c27126ee2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:40.233818 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c5af6-5f0c-4af5-acbc-04c27126ee2b None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:40.234043 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c5af6-5f0c-4af5-acbc-04c27126ee2b None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:40.234441 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c5af6-5f0c-4af5-acbc-04c27126ee2b None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:40.235386 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c5af6-5f0c-4af5-acbc-04c27126ee2b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:40.235733 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c5af6-5f0c-4af5-acbc-04c27126ee2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:40.237446 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c5af6-5f0c-4af5-acbc-04c27126ee2b None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:40.258283 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 623/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 9 15:36:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:40.264993 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e15758-50fb-4173-901c-79f4c52e6642 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:40.372026 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e15758-50fb-4173-901c-79f4c52e6642 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:40.411401 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d6428-fee1-4cde-b052-0b88168aaac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:40.412203 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d6428-fee1-4cde-b052-0b88168aaac9 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:40.412494 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d6428-fee1-4cde-b052-0b88168aaac9 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:40.412777 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d6428-fee1-4cde-b052-0b88168aaac9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:40.424595 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d6428-fee1-4cde-b052-0b88168aaac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:40.426104 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d6428-fee1-4cde-b052-0b88168aaac9 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:40.445023 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-df5d6428-fee1-4cde-b052-0b88168aaac9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:40.445023 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:40.445023 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:40.445023 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:40.445023 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:40.445023 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:40.445023 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:40.445023 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:40.445023 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:40.445023 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:40.445023 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:40.445023 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:40.445023 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:36:40.445023 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:36:40.445023 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:36:40.447138 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:36:40.447138 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:40.447138 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:40.447138 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:40.447138 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:40.447138 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:40.447138 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:40.447138 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:40.447138 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:36:40.447138 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:40.447138 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:40.447138 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:40.447138 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:40.447138 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:40.447138 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:40.447138 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:40.447138 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:40.448502 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:36:40.448502 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:36:40.448502 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:40.448502 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:36:40.448502 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 605/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:40.452297 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c5af6-5f0c-4af5-acbc-04c27126ee2b None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:40.561645 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c5af6-5f0c-4af5-acbc-04c27126ee2b None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:40.600816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68809ce6-2043-4093-8e6d-960d99e128c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:40.601528 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68809ce6-2043-4093-8e6d-960d99e128c5 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:40.601817 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68809ce6-2043-4093-8e6d-960d99e128c5 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:40.602100 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68809ce6-2043-4093-8e6d-960d99e128c5 None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:40.602827 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68809ce6-2043-4093-8e6d-960d99e128c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:40.603138 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68809ce6-2043-4093-8e6d-960d99e128c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:40.604517 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68809ce6-2043-4093-8e6d-960d99e128c5 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:40.616417 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 624/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:40.622551 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d6428-fee1-4cde-b052-0b88168aaac9 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:40.729612 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d6428-fee1-4cde-b052-0b88168aaac9 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:40.764261 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9613d91-9aff-4181-b0cd-1a6f07a64e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:40.765054 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9613d91-9aff-4181-b0cd-1a6f07a64e48 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:40.765334 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9613d91-9aff-4181-b0cd-1a6f07a64e48 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:40.765646 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9613d91-9aff-4181-b0cd-1a6f07a64e48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:40.772538 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9613d91-9aff-4181-b0cd-1a6f07a64e48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:40.774127 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9613d91-9aff-4181-b0cd-1a6f07a64e48 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:40.788639 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-f9613d91-9aff-4181-b0cd-1a6f07a64e48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:36:40.788639 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:40.788639 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:40.788639 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:40.788639 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:40.788639 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:40.788639 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:40.788639 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:40.788639 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:40.788639 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:40.788639 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:40.788639 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:40.788639 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:36:40.788639 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:36:40.788639 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:36:40.789759 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:36:40.789759 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:40.789759 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:40.789759 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:40.789759 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:40.789759 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:40.789759 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:40.789759 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:40.789759 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:36:40.789759 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:40.789759 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:40.789759 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:40.789759 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:40.789759 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:40.789759 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:40.789759 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:40.789759 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:40.790764 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:36:40.790764 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:36:40.790764 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:36:40.790764 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:36:40.790764 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:36:40.790764 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:36:40.790764 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:36:40.790764 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:36:40.790764 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 606/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:36:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:40.796252 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68809ce6-2043-4093-8e6d-960d99e128c5 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:40.904091 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68809ce6-2043-4093-8e6d-960d99e128c5 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:40.940451 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2401b5-ce85-437e-a836-4c8491159c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:40.941112 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2401b5-ce85-437e-a836-4c8491159c52 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:40.941427 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2401b5-ce85-437e-a836-4c8491159c52 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:40.941720 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2401b5-ce85-437e-a836-4c8491159c52 None admin] PATH_INFO: `/v3/projects` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:40.942506 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2401b5-ce85-437e-a836-4c8491159c52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:40.942862 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2401b5-ce85-437e-a836-4c8491159c52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:40.944436 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2401b5-ce85-437e-a836-4c8491159c52 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:40.958030 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 625/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:36:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:40.964426 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9613d91-9aff-4181-b0cd-1a6f07a64e48 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:41.072077 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9613d91-9aff-4181-b0cd-1a6f07a64e48 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:41.113088 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0de85c-d0e2-45c5-aa24-9861b9e94854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:41.114639 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0de85c-d0e2-45c5-aa24-9861b9e94854 None admin] REQUEST_METHOD: `PUT` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:41.115134 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0de85c-d0e2-45c5-aa24-9861b9e94854 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:41.115626 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0de85c-d0e2-45c5-aa24-9861b9e94854 None admin] PATH_INFO: `/v3/projects/db5768a93e754372808fc69f898cc853/users/3d51a903276d400793c4ef18d5b043cb/roles/b22352a378fb404d90e3b3ae182757ad` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:41.142588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0de85c-d0e2-45c5-aa24-9861b9e94854 None admin] RBAC: Authorizing `identity:create_grant(project_id=db5768a93e754372808fc69f898cc853, user_id=3d51a903276d400793c4ef18d5b043cb, role_id=b22352a378fb404d90e3b3ae182757ad)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:41.144211 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0de85c-d0e2-45c5-aa24-9861b9e94854 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:41.162321 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 607/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:36:40 2022] PUT /identity/v3/projects/db5768a93e754372808fc69f898cc853/users/3d51a903276d400793c4ef18d5b043cb/roles/b22352a378fb404d90e3b3ae182757ad => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:36:43.477220 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a032c18-a8c1-45a7-afb1-b55c911359f6 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:43.478138 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a032c18-a8c1-45a7-afb1-b55c911359f6 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:43.478463 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a032c18-a8c1-45a7-afb1-b55c911359f6 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:43.481338 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 626/1233] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:36:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:36:43.492754 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d5611-c803-40c5-a88c-307ddc226b0e None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:43.493446 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d5611-c803-40c5-a88c-307ddc226b0e None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:43.493840 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d5611-c803-40c5-a88c-307ddc226b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:43.524667 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-d52d5611-c803-40c5-a88c-307ddc226b0e None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:36:43.526918 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-d52d5611-c803-40c5-a88c-307ddc226b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:36:43.664315 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 608/1234] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:36:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:36:43.712320 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a032c18-a8c1-45a7-afb1-b55c911359f6 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:43.887140 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a032c18-a8c1-45a7-afb1-b55c911359f6 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:43.922781 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5290e87-221b-4a64-be8b-46b97e7a17da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:43.923585 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5290e87-221b-4a64-be8b-46b97e7a17da None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:43.923872 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5290e87-221b-4a64-be8b-46b97e7a17da None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:43.924216 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5290e87-221b-4a64-be8b-46b97e7a17da None admin] PATH_INFO: `/v3/roles/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:43.938842 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5290e87-221b-4a64-be8b-46b97e7a17da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:36:43.947736 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-c5290e87-221b-4a64-be8b-46b97e7a17da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:36:43.947736 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:43.947736 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:43.947736 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:43.947736 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:43.947736 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:43.947736 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:43.947736 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:43.947736 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:43.947736 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:43.947736 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:43.947736 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:43.947736 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:36:43.947736 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:36:43.947736 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:36:43.947736 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:36:43.949025 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:36:43.949025 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:36:43.949025 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:36:43.949025 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:36:43.949025 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:43.949025 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:43.949025 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:43.949025 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:43.949025 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:43.949025 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:43.949025 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:43.949025 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:36:43.949025 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:43.949025 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:43.949025 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:43.949025 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:43.950008 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:43.950008 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:43.950008 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:43.950008 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:43.950008 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:36:43.950008 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:36:43.950008 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:36:43.950008 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:36:43.950008 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:36:43.950008 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:36:43.950008 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:36:43.950008 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:36:43.950008 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 627/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:36:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:43.958932 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d5611-c803-40c5-a88c-307ddc226b0e None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:44.072473 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d5611-c803-40c5-a88c-307ddc226b0e None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:44.109397 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a60ac-90b5-4a0a-a15a-9bd0cdeb665b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:44.110110 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a60ac-90b5-4a0a-a15a-9bd0cdeb665b None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:44.110404 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a60ac-90b5-4a0a-a15a-9bd0cdeb665b None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:44.110696 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a60ac-90b5-4a0a-a15a-9bd0cdeb665b None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:44.111443 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a60ac-90b5-4a0a-a15a-9bd0cdeb665b None admin] RBAC: Adding query filter params (name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:44.112147 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a60ac-90b5-4a0a-a15a-9bd0cdeb665b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:44.113144 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a60ac-90b5-4a0a-a15a-9bd0cdeb665b None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:44.123336 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 609/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:36:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:44.128870 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5290e87-221b-4a64-be8b-46b97e7a17da None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:44.240230 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5290e87-221b-4a64-be8b-46b97e7a17da None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:44.276613 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f816c-a53c-41cd-b6be-b1ffca2419d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:44.277447 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f816c-a53c-41cd-b6be-b1ffca2419d8 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:44.277733 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f816c-a53c-41cd-b6be-b1ffca2419d8 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:44.278002 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f816c-a53c-41cd-b6be-b1ffca2419d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:44.289316 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f816c-a53c-41cd-b6be-b1ffca2419d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:44.290798 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f816c-a53c-41cd-b6be-b1ffca2419d8 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:44.308016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-097f816c-a53c-41cd-b6be-b1ffca2419d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:44.308016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:44.308016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:44.308016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:44.308016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:44.308016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:44.308016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:44.308016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:44.308016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:44.308016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:44.308016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:44.308016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:44.308016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:36:44.308016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:36:44.308016 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:36:44.309191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:36:44.309191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:44.309191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:44.309191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:44.309191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:44.309191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:44.309191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:44.309191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:44.309191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:36:44.309191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:44.309191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:44.309191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:44.309191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:44.309191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:44.309191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:44.309191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:44.309191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:44.311353 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:36:44.311353 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:36:44.311353 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:44.311353 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:36:44.311353 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 628/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:36:44.315930 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a60ac-90b5-4a0a-a15a-9bd0cdeb665b None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:44.427765 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a60ac-90b5-4a0a-a15a-9bd0cdeb665b None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:44.464289 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b80ae-55ab-4a9d-943b-bd0e314fb584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:44.465000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b80ae-55ab-4a9d-943b-bd0e314fb584 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:44.465312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b80ae-55ab-4a9d-943b-bd0e314fb584 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:44.465626 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b80ae-55ab-4a9d-943b-bd0e314fb584 None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:44.467103 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b80ae-55ab-4a9d-943b-bd0e314fb584 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:44.467433 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b80ae-55ab-4a9d-943b-bd0e314fb584 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:44.468941 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b80ae-55ab-4a9d-943b-bd0e314fb584 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:44.482099 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 610/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:44.488999 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f816c-a53c-41cd-b6be-b1ffca2419d8 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:44.599837 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f816c-a53c-41cd-b6be-b1ffca2419d8 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:44.634252 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07802de5-b9cf-433a-8d84-02770ea6f1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:44.635067 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07802de5-b9cf-433a-8d84-02770ea6f1d9 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:44.635348 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07802de5-b9cf-433a-8d84-02770ea6f1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:44.635624 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07802de5-b9cf-433a-8d84-02770ea6f1d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:44.643954 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07802de5-b9cf-433a-8d84-02770ea6f1d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:44.645438 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07802de5-b9cf-433a-8d84-02770ea6f1d9 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:44.659514 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-07802de5-b9cf-433a-8d84-02770ea6f1d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:36:44.659514 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:44.659514 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:44.659514 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:44.659514 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:44.659514 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:44.659514 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:44.659514 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:44.659514 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:44.659514 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:44.659514 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:44.659514 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:44.659514 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:36:44.659514 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:36:44.659514 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:36:44.659514 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:36:44.660766 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:44.660766 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:44.660766 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:36:44.660766 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:36:44.660766 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:36:44.660766 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:36:44.660766 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:44.660766 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:44.660766 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:44.660766 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:44.660766 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:44.660766 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:36:44.660766 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:44.660766 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:44.660766 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:44.660766 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:44.660766 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:44.660766 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:44.662174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:44.662174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:44.662174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:36:44.662174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:36:44.662174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:36:44.662174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:36:44.662174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:36:44.662174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:36:44.662174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:36:44.662174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:36:44.662174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 629/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:36:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:44.670151 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b80ae-55ab-4a9d-943b-bd0e314fb584 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:44.788529 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b80ae-55ab-4a9d-943b-bd0e314fb584 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:44.825135 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d1622-0548-4579-9433-ed5e072fc134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:44.826470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d1622-0548-4579-9433-ed5e072fc134 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:44.826763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d1622-0548-4579-9433-ed5e072fc134 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:44.827043 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d1622-0548-4579-9433-ed5e072fc134 None admin] PATH_INFO: `/v3/users` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:44.828049 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d1622-0548-4579-9433-ed5e072fc134 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:44.828437 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d1622-0548-4579-9433-ed5e072fc134 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:44.830020 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d1622-0548-4579-9433-ed5e072fc134 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:44.862725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 611/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 9 15:36:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:44.864090 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07802de5-b9cf-433a-8d84-02770ea6f1d9 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:44.991240 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07802de5-b9cf-433a-8d84-02770ea6f1d9 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:45.032214 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabdbd0-ce69-4f47-a077-98dbc4c612eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:45.032882 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabdbd0-ce69-4f47-a077-98dbc4c612eb None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:45.033187 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabdbd0-ce69-4f47-a077-98dbc4c612eb None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:45.033484 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabdbd0-ce69-4f47-a077-98dbc4c612eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:45.109392 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabdbd0-ce69-4f47-a077-98dbc4c612eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:45.111054 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabdbd0-ce69-4f47-a077-98dbc4c612eb None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:45.234848 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 630/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:36:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:36:45.240811 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d1622-0548-4579-9433-ed5e072fc134 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:45.359203 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d1622-0548-4579-9433-ed5e072fc134 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:45.397218 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f02302-322d-4bcd-8b8e-b3195103d1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:45.398137 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f02302-322d-4bcd-8b8e-b3195103d1e6 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:45.398488 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f02302-322d-4bcd-8b8e-b3195103d1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:45.398772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f02302-322d-4bcd-8b8e-b3195103d1e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:45.410941 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f02302-322d-4bcd-8b8e-b3195103d1e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:45.412798 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f02302-322d-4bcd-8b8e-b3195103d1e6 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:45.434291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-b9f02302-322d-4bcd-8b8e-b3195103d1e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:45.434291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:45.434291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:45.434291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:45.434291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:45.434291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:45.434291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:45.434291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:45.434291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:45.434291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:45.434291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:45.434291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:45.434291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:36:45.434291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:36:45.434291 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:36:45.435790 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:36:45.435790 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:45.435790 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:45.435790 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:45.435790 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:45.435790 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:45.435790 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:45.435790 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:45.435790 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:36:45.435790 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:45.435790 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:45.435790 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:45.435790 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:45.435790 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:45.435790 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:45.435790 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:45.435790 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:45.437048 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:36:45.437048 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:36:45.437048 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:45.437048 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:36:45.437048 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 612/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:45.442267 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabdbd0-ce69-4f47-a077-98dbc4c612eb None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:45.552446 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabdbd0-ce69-4f47-a077-98dbc4c612eb None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:45.593570 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c4a62-69f2-4fd6-af5c-a8aa7aac949d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:45.594271 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c4a62-69f2-4fd6-af5c-a8aa7aac949d None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:45.594555 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c4a62-69f2-4fd6-af5c-a8aa7aac949d None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:45.594836 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c4a62-69f2-4fd6-af5c-a8aa7aac949d None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:45.595575 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c4a62-69f2-4fd6-af5c-a8aa7aac949d None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:45.595887 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c4a62-69f2-4fd6-af5c-a8aa7aac949d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:45.597312 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c4a62-69f2-4fd6-af5c-a8aa7aac949d None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:45.611114 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 631/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:45.616870 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f02302-322d-4bcd-8b8e-b3195103d1e6 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:45.733146 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f02302-322d-4bcd-8b8e-b3195103d1e6 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:45.771138 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90acb87-3994-4528-a8c3-cbb2061fa83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:45.772064 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90acb87-3994-4528-a8c3-cbb2061fa83f None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:45.772424 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90acb87-3994-4528-a8c3-cbb2061fa83f None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:45.772773 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90acb87-3994-4528-a8c3-cbb2061fa83f None admin] PATH_INFO: `/v3/projects/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:45.780259 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90acb87-3994-4528-a8c3-cbb2061fa83f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:45.781759 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90acb87-3994-4528-a8c3-cbb2061fa83f None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:45.798015 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-d90acb87-3994-4528-a8c3-cbb2061fa83f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:36:45.798015 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:45.798015 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:45.798015 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:45.798015 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:45.798015 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:45.798015 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:45.798015 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:45.798015 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:45.798015 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:45.798015 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:45.798015 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:45.798015 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:36:45.798015 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:36:45.798015 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:36:45.799273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:36:45.799273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:45.799273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:45.799273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:45.799273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:45.799273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:45.799273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:45.799273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:45.799273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:36:45.799273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:45.799273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:45.799273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:45.799273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:45.799273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:45.799273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:45.799273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:45.799273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:45.800470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:36:45.800470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:36:45.800470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:36:45.800470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:36:45.800470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:36:45.800470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:36:45.800470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:36:45.800470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:36:45.800470 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 613/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:36:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:45.805580 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c4a62-69f2-4fd6-af5c-a8aa7aac949d None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:45.915972 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c4a62-69f2-4fd6-af5c-a8aa7aac949d None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:45.957855 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d903f-2d48-4b22-ac6d-93e6b68f1656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:45.958536 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d903f-2d48-4b22-ac6d-93e6b68f1656 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:45.958830 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d903f-2d48-4b22-ac6d-93e6b68f1656 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:45.959106 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d903f-2d48-4b22-ac6d-93e6b68f1656 None admin] PATH_INFO: `/v3/projects` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:45.960019 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d903f-2d48-4b22-ac6d-93e6b68f1656 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:45.960378 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d903f-2d48-4b22-ac6d-93e6b68f1656 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:45.961915 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d903f-2d48-4b22-ac6d-93e6b68f1656 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:45.975908 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 632/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:36:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:45.982072 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90acb87-3994-4528-a8c3-cbb2061fa83f None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:46.093249 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90acb87-3994-4528-a8c3-cbb2061fa83f None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:46.129961 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff09e68-2ede-4382-a218-a4be05a2f613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:46.130800 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff09e68-2ede-4382-a218-a4be05a2f613 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:46.131105 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff09e68-2ede-4382-a218-a4be05a2f613 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:46.131488 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff09e68-2ede-4382-a218-a4be05a2f613 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:46.132620 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff09e68-2ede-4382-a218-a4be05a2f613 None admin] RBAC: Adding query filter params (role.id=b22352a378fb404d90e3b3ae182757ad, scope.project.id=db5768a93e754372808fc69f898cc853, user.id=3d51a903276d400793c4ef18d5b043cb) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:46.132941 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff09e68-2ede-4382-a218-a4be05a2f613 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:46.135503 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff09e68-2ede-4382-a218-a4be05a2f613 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:46.143968 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 614/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:36:45 2022] GET /identity/v3/role_assignments?user.id=3d51a903276d400793c4ef18d5b043cb&scope.project.id=db5768a93e754372808fc69f898cc853&role.id=b22352a378fb404d90e3b3ae182757ad => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:36:48.682158 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3a336-2e2c-4403-81fd-5c32ed33450f None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:48.683013 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3a336-2e2c-4403-81fd-5c32ed33450f None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:48.683171 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3a336-2e2c-4403-81fd-5c32ed33450f None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:48.686918 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 633/1247] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:36:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:36:48.692150 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd80ead-59b9-4234-863f-9a8139adc8f3 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:48.692989 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd80ead-59b9-4234-863f-9a8139adc8f3 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:48.692989 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd80ead-59b9-4234-863f-9a8139adc8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:48.713961 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-1cd80ead-59b9-4234-863f-9a8139adc8f3 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:36:48.715756 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-1cd80ead-59b9-4234-863f-9a8139adc8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:36:48.807865 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 615/1248] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:36:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:36:48.838940 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3a336-2e2c-4403-81fd-5c32ed33450f None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:48.995843 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3a336-2e2c-4403-81fd-5c32ed33450f None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:49.038554 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b44552-f1ae-4130-b10f-84dab2532015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:49.039456 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b44552-f1ae-4130-b10f-84dab2532015 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:49.039800 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b44552-f1ae-4130-b10f-84dab2532015 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:49.040084 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b44552-f1ae-4130-b10f-84dab2532015 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:49.051816 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b44552-f1ae-4130-b10f-84dab2532015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:36:49.060806 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-a6b44552-f1ae-4130-b10f-84dab2532015 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:36:49.060806 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:49.060806 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:49.060806 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:49.060806 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:49.060806 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:49.060806 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:49.060806 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:49.060806 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:49.060806 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:49.060806 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:49.060806 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:49.060806 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:36:49.060806 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:36:49.060806 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:36:49.060806 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:36:49.062124 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:36:49.062124 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:36:49.062124 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:36:49.062124 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:36:49.062124 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:49.062124 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:49.062124 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:49.062124 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:49.062124 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:49.062124 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:49.062124 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:49.062124 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:36:49.062124 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:49.062124 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:49.062124 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:49.062124 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:49.063079 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:49.063079 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:49.063079 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:49.063079 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:49.063079 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:36:49.063079 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:36:49.063079 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:36:49.063079 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:36:49.063079 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:36:49.063079 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:36:49.063079 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:36:49.063079 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:36:49.063079 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 634/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:36:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:49.068371 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd80ead-59b9-4234-863f-9a8139adc8f3 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:49.196035 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd80ead-59b9-4234-863f-9a8139adc8f3 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:49.238103 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889925f-f4a0-40ff-97a2-f40e3228e6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:49.239069 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889925f-f4a0-40ff-97a2-f40e3228e6f3 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:49.239460 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889925f-f4a0-40ff-97a2-f40e3228e6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:49.239879 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889925f-f4a0-40ff-97a2-f40e3228e6f3 None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:49.240935 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889925f-f4a0-40ff-97a2-f40e3228e6f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:49.241276 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889925f-f4a0-40ff-97a2-f40e3228e6f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:49.243103 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889925f-f4a0-40ff-97a2-f40e3228e6f3 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:49.254235 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 616/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:36:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:36:49.262091 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b44552-f1ae-4130-b10f-84dab2532015 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:49.391909 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b44552-f1ae-4130-b10f-84dab2532015 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:49.439260 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c0824-e7ca-4ccd-91c9-c13493091376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:49.440186 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c0824-e7ca-4ccd-91c9-c13493091376 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:49.440536 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c0824-e7ca-4ccd-91c9-c13493091376 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:49.440825 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c0824-e7ca-4ccd-91c9-c13493091376 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:49.454860 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c0824-e7ca-4ccd-91c9-c13493091376 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:49.456465 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c0824-e7ca-4ccd-91c9-c13493091376 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:49.476570 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-026c0824-e7ca-4ccd-91c9-c13493091376 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:49.476570 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:49.476570 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:49.476570 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:49.476570 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:49.476570 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:49.476570 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:49.476570 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:49.476570 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:49.476570 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:49.476570 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:49.476570 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:49.476570 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:36:49.476570 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:36:49.476570 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:36:49.477904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:36:49.477904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:49.477904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:49.477904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:49.477904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:49.477904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:49.477904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:49.477904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:49.477904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:36:49.477904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:49.477904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:49.477904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:49.477904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:49.477904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:49.477904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:49.477904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:49.477904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:49.479090 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:36:49.479090 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:36:49.479090 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:49.479090 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:36:49.479090 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 635/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:49.485134 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889925f-f4a0-40ff-97a2-f40e3228e6f3 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:49.601427 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889925f-f4a0-40ff-97a2-f40e3228e6f3 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:49.645273 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d426bc-e0aa-45a6-8579-a839eb49679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:49.645987 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d426bc-e0aa-45a6-8579-a839eb49679c None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:49.646274 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d426bc-e0aa-45a6-8579-a839eb49679c None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:49.646553 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d426bc-e0aa-45a6-8579-a839eb49679c None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:49.647286 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d426bc-e0aa-45a6-8579-a839eb49679c None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:49.647596 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d426bc-e0aa-45a6-8579-a839eb49679c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:49.648980 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d426bc-e0aa-45a6-8579-a839eb49679c None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:49.663315 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 617/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:49.669931 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c0824-e7ca-4ccd-91c9-c13493091376 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:49.800705 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c0824-e7ca-4ccd-91c9-c13493091376 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:49.838671 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a19e59-b7d9-40ad-8f5d-543993bc2e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:49.839764 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a19e59-b7d9-40ad-8f5d-543993bc2e25 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:49.840186 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a19e59-b7d9-40ad-8f5d-543993bc2e25 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:49.840588 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a19e59-b7d9-40ad-8f5d-543993bc2e25 None admin] PATH_INFO: `/v3/users/placement` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:49.857232 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a19e59-b7d9-40ad-8f5d-543993bc2e25 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:49.859620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a19e59-b7d9-40ad-8f5d-543993bc2e25 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:49.878467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-80a19e59-b7d9-40ad-8f5d-543993bc2e25 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:36:49.878467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:49.878467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:49.878467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:49.878467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:49.878467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:49.878467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:49.878467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:49.878467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:49.878467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:49.878467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:49.878467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:49.878467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:36:49.878467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:36:49.878467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:36:49.878467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:36:49.879876 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:49.879876 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:49.879876 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:36:49.879876 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:36:49.879876 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:36:49.879876 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:36:49.879876 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:49.879876 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:49.879876 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:49.879876 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:49.879876 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:49.879876 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:36:49.879876 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:49.879876 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:49.879876 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:49.879876 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:49.879876 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:49.879876 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:49.881028 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:49.881028 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:49.881028 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:36:49.881028 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:36:49.881028 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:36:49.881028 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:36:49.881028 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:36:49.881028 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:36:49.881028 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:36:49.881028 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:36:49.881028 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 636/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:36:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:49.885725 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d426bc-e0aa-45a6-8579-a839eb49679c None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:50.004122 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d426bc-e0aa-45a6-8579-a839eb49679c None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:50.041056 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b7da7-903e-4505-a0b7-0ef574cf7150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:50.041833 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b7da7-903e-4505-a0b7-0ef574cf7150 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:50.042119 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b7da7-903e-4505-a0b7-0ef574cf7150 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:50.042395 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b7da7-903e-4505-a0b7-0ef574cf7150 None admin] PATH_INFO: `/v3/users` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:50.043242 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b7da7-903e-4505-a0b7-0ef574cf7150 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:50.043551 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b7da7-903e-4505-a0b7-0ef574cf7150 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:50.045868 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b7da7-903e-4505-a0b7-0ef574cf7150 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:50.068133 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 618/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 9 15:36:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:50.075188 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a19e59-b7d9-40ad-8f5d-543993bc2e25 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:50.203346 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a19e59-b7d9-40ad-8f5d-543993bc2e25 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:50.251263 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7556f-450e-469f-91fe-a8b1b5822d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:50.251971 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7556f-450e-469f-91fe-a8b1b5822d31 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:50.252330 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7556f-450e-469f-91fe-a8b1b5822d31 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:50.252614 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7556f-450e-469f-91fe-a8b1b5822d31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:50.331196 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7556f-450e-469f-91fe-a8b1b5822d31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:50.333077 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7556f-450e-469f-91fe-a8b1b5822d31 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:50.451568 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 637/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:36:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:36:50.457519 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b7da7-903e-4505-a0b7-0ef574cf7150 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:50.574003 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b7da7-903e-4505-a0b7-0ef574cf7150 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:50.612840 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72caea-534f-4bc6-b5d1-e99515cdeb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:50.613662 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72caea-534f-4bc6-b5d1-e99515cdeb37 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:50.613944 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72caea-534f-4bc6-b5d1-e99515cdeb37 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:50.614221 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72caea-534f-4bc6-b5d1-e99515cdeb37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:50.627144 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72caea-534f-4bc6-b5d1-e99515cdeb37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:50.628686 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72caea-534f-4bc6-b5d1-e99515cdeb37 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:50.649898 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-6e72caea-534f-4bc6-b5d1-e99515cdeb37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:50.649898 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:50.649898 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:50.649898 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:50.649898 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:50.649898 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:50.649898 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:50.649898 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:50.649898 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:50.649898 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:50.649898 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:50.649898 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:50.649898 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:36:50.649898 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:36:50.649898 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:36:50.651358 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:36:50.651358 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:50.651358 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:50.651358 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:50.651358 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:50.651358 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:50.651358 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:50.651358 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:50.651358 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:36:50.651358 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:50.651358 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:50.651358 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:50.651358 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:50.651358 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:50.651358 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:50.651358 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:50.651358 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:50.652666 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:36:50.652666 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:36:50.652666 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:50.652666 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:36:50.652666 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 619/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:50.657615 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7556f-450e-469f-91fe-a8b1b5822d31 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:50.766312 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7556f-450e-469f-91fe-a8b1b5822d31 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:50.805668 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cdce4-2888-48ff-aa75-1bbd5b57515d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:50.806364 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cdce4-2888-48ff-aa75-1bbd5b57515d None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:50.806628 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cdce4-2888-48ff-aa75-1bbd5b57515d None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:50.806904 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cdce4-2888-48ff-aa75-1bbd5b57515d None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:50.807625 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cdce4-2888-48ff-aa75-1bbd5b57515d None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:50.807928 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cdce4-2888-48ff-aa75-1bbd5b57515d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:50.809312 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cdce4-2888-48ff-aa75-1bbd5b57515d None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:50.821253 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 638/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:50.827658 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72caea-534f-4bc6-b5d1-e99515cdeb37 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:50.933222 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72caea-534f-4bc6-b5d1-e99515cdeb37 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:50.972776 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0495da-1f6c-4bd4-816e-318455d8e57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:50.973796 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0495da-1f6c-4bd4-816e-318455d8e57f None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:50.974051 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0495da-1f6c-4bd4-816e-318455d8e57f None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:50.974410 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0495da-1f6c-4bd4-816e-318455d8e57f None admin] PATH_INFO: `/v3/projects/service` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:50.982404 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0495da-1f6c-4bd4-816e-318455d8e57f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:50.984001 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0495da-1f6c-4bd4-816e-318455d8e57f None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:51.000220 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-ac0495da-1f6c-4bd4-816e-318455d8e57f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:36:51.000220 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:51.000220 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:51.000220 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:51.000220 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:51.000220 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:51.000220 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:51.000220 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:51.000220 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:51.000220 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:51.000220 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:51.000220 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:51.000220 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:36:51.000220 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:36:51.000220 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:36:51.001509 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:36:51.001509 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:51.001509 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:51.001509 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:51.001509 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:51.001509 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:51.001509 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:51.001509 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:51.001509 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:36:51.001509 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:51.001509 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:51.001509 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:51.001509 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:51.001509 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:51.001509 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:51.001509 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:51.001509 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:51.002659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:36:51.002659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:36:51.002659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:36:51.002659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:36:51.002659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:36:51.002659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:36:51.002659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:36:51.002659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:36:51.002659 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 620/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:36:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:51.007728 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cdce4-2888-48ff-aa75-1bbd5b57515d None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:51.115504 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cdce4-2888-48ff-aa75-1bbd5b57515d None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:51.156407 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1e951-266d-4993-bcfd-e0b3166f3d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:51.157186 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1e951-266d-4993-bcfd-e0b3166f3d57 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:51.157591 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1e951-266d-4993-bcfd-e0b3166f3d57 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:51.157988 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1e951-266d-4993-bcfd-e0b3166f3d57 None admin] PATH_INFO: `/v3/projects` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:51.159133 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1e951-266d-4993-bcfd-e0b3166f3d57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:51.159490 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1e951-266d-4993-bcfd-e0b3166f3d57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:51.161449 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1e951-266d-4993-bcfd-e0b3166f3d57 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:51.182134 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 639/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:36:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:51.183550 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0495da-1f6c-4bd4-816e-318455d8e57f None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:51.291859 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0495da-1f6c-4bd4-816e-318455d8e57f None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:51.328212 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5436b0-5df4-4a3d-9ca8-18b498d15b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:51.328909 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5436b0-5df4-4a3d-9ca8-18b498d15b8f None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:51.329186 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5436b0-5df4-4a3d-9ca8-18b498d15b8f None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:51.329509 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5436b0-5df4-4a3d-9ca8-18b498d15b8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:51.330324 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5436b0-5df4-4a3d-9ca8-18b498d15b8f None admin] RBAC: Adding query filter params (role.id=a5cb8d37261d486cbc1b06d167a9c05c, scope.project.id=db5768a93e754372808fc69f898cc853, user.id=3d51a903276d400793c4ef18d5b043cb) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:51.330640 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5436b0-5df4-4a3d-9ca8-18b498d15b8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:51.332241 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5436b0-5df4-4a3d-9ca8-18b498d15b8f None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:51.338206 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 621/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:36:51 2022] GET /identity/v3/role_assignments?user.id=3d51a903276d400793c4ef18d5b043cb&scope.project.id=db5768a93e754372808fc69f898cc853&role.id=a5cb8d37261d486cbc1b06d167a9c05c => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:53.617574 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a66cb1-6a96-4a96-aa81-ef8e62b8e8e3 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:53.618125 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a66cb1-6a96-4a96-aa81-ef8e62b8e8e3 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:53.618125 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a66cb1-6a96-4a96-aa81-ef8e62b8e8e3 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:53.619551 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 640/1261] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:36:53.626246 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289e850-61c3-4adf-a128-6eb3352f7970 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:53.629344 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289e850-61c3-4adf-a128-6eb3352f7970 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:53.629344 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289e850-61c3-4adf-a128-6eb3352f7970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:53.646265 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-d289e850-61c3-4adf-a128-6eb3352f7970 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:36:53.647502 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-d289e850-61c3-4adf-a128-6eb3352f7970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:36:53.727474 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 622/1262] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:36:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:36:53.750620 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a66cb1-6a96-4a96-aa81-ef8e62b8e8e3 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:53.849291 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a66cb1-6a96-4a96-aa81-ef8e62b8e8e3 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:53.884239 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195346d5-09af-466a-bab4-6ca92a46c331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:53.884946 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195346d5-09af-466a-bab4-6ca92a46c331 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:53.885227 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195346d5-09af-466a-bab4-6ca92a46c331 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:53.885531 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195346d5-09af-466a-bab4-6ca92a46c331 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:53.895524 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195346d5-09af-466a-bab4-6ca92a46c331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:36:53.903093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-195346d5-09af-466a-bab4-6ca92a46c331 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:36:53.903093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:53.903093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:53.903093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:53.903093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:53.903093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:53.903093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:53.903093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:53.903093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:53.903093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:53.903093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:53.903093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:53.903093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:36:53.903093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:36:53.903093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:36:53.903093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:36:53.904859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:36:53.904859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:36:53.904859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:36:53.904859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:36:53.904859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:53.904859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:53.904859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:53.904859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:53.904859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:53.904859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:53.904859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:53.904859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:36:53.904859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:53.904859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:53.904859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:53.904859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:53.906050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:53.906050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:53.906050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:53.906050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:53.906050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:36:53.906050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:36:53.906050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:36:53.906050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:36:53.906050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:36:53.906050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:36:53.906050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:36:53.906050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:36:53.906050 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 641/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:36:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:53.910877 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d289e850-61c3-4adf-a128-6eb3352f7970 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:54.012146 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d289e850-61c3-4adf-a128-6eb3352f7970 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:54.049115 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cb231-3556-4cb3-9a43-fe1d8eb08bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:54.050083 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cb231-3556-4cb3-9a43-fe1d8eb08bdc None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:54.050401 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cb231-3556-4cb3-9a43-fe1d8eb08bdc None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:54.050834 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cb231-3556-4cb3-9a43-fe1d8eb08bdc None admin] PATH_INFO: `/v3/roles` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:54.051815 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cb231-3556-4cb3-9a43-fe1d8eb08bdc None admin] RBAC: Adding query filter params (name=admin) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:54.052128 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cb231-3556-4cb3-9a43-fe1d8eb08bdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:54.053550 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cb231-3556-4cb3-9a43-fe1d8eb08bdc None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:54.061872 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 623/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:36:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:54.067943 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195346d5-09af-466a-bab4-6ca92a46c331 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:54.174935 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195346d5-09af-466a-bab4-6ca92a46c331 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:54.214986 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5b5c3-d1b6-4559-ac0c-5aeb158abdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:54.217169 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5b5c3-d1b6-4559-ac0c-5aeb158abdf5 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:54.217730 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5b5c3-d1b6-4559-ac0c-5aeb158abdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:54.218084 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5b5c3-d1b6-4559-ac0c-5aeb158abdf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:54.230028 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5b5c3-d1b6-4559-ac0c-5aeb158abdf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:54.232090 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5b5c3-d1b6-4559-ac0c-5aeb158abdf5 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:54.250771 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-7cb5b5c3-d1b6-4559-ac0c-5aeb158abdf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:54.250771 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:54.250771 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:54.250771 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:54.250771 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:54.250771 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:54.250771 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:54.250771 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:54.250771 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:54.250771 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:54.250771 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:54.250771 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:54.250771 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:36:54.250771 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:36:54.250771 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:36:54.251947 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:36:54.251947 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:54.251947 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:54.251947 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:54.251947 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:54.251947 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:54.251947 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:54.251947 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:54.251947 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:36:54.251947 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:54.251947 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:54.251947 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:54.251947 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:54.251947 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:54.251947 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:54.251947 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:54.251947 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:54.253169 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:36:54.253169 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:36:54.253169 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:54.253169 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:36:54.253169 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 642/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:54.257857 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cb231-3556-4cb3-9a43-fe1d8eb08bdc None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:54.356422 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cb231-3556-4cb3-9a43-fe1d8eb08bdc None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:54.390563 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c280f-0e92-4853-84d2-a5c82ec217f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:54.391226 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c280f-0e92-4853-84d2-a5c82ec217f9 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:54.391514 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c280f-0e92-4853-84d2-a5c82ec217f9 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:54.391793 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c280f-0e92-4853-84d2-a5c82ec217f9 None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:54.392522 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c280f-0e92-4853-84d2-a5c82ec217f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:54.392831 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c280f-0e92-4853-84d2-a5c82ec217f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:54.394240 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c280f-0e92-4853-84d2-a5c82ec217f9 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:54.406855 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 624/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:54.412915 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5b5c3-d1b6-4559-ac0c-5aeb158abdf5 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:54.516540 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5b5c3-d1b6-4559-ac0c-5aeb158abdf5 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:54.558327 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf653c-ba6c-4914-ba60-c8c9a3673b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:54.559141 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf653c-ba6c-4914-ba60-c8c9a3673b3a None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:54.559423 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf653c-ba6c-4914-ba60-c8c9a3673b3a None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:54.560285 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf653c-ba6c-4914-ba60-c8c9a3673b3a None admin] PATH_INFO: `/v3/users/placement` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:54.568643 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf653c-ba6c-4914-ba60-c8c9a3673b3a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:54.570136 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf653c-ba6c-4914-ba60-c8c9a3673b3a None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:54.586184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-7adf653c-ba6c-4914-ba60-c8c9a3673b3a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:36:54.586184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:54.586184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:54.586184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:54.586184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:54.586184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:54.586184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:54.586184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:54.586184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:54.586184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:54.586184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:54.586184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:54.586184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:36:54.586184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:36:54.586184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:36:54.586184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:36:54.587548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:54.587548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:54.587548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:36:54.587548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:36:54.587548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:36:54.587548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:36:54.587548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:54.587548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:54.587548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:54.587548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:54.587548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:54.587548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:36:54.587548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:54.587548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:54.587548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:54.587548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:54.587548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:54.587548 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:54.588854 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:54.588854 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:54.588854 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:36:54.588854 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:36:54.588854 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:36:54.588854 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:36:54.588854 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:36:54.588854 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:36:54.588854 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:36:54.588854 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:36:54.593705 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c280f-0e92-4853-84d2-a5c82ec217f9 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:54.594172 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 643/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:36:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:54.708395 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c280f-0e92-4853-84d2-a5c82ec217f9 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:54.750681 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8caebb-10ab-42a3-b65c-bde582bed670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:54.751371 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8caebb-10ab-42a3-b65c-bde582bed670 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:54.751655 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8caebb-10ab-42a3-b65c-bde582bed670 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:54.751934 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8caebb-10ab-42a3-b65c-bde582bed670 None admin] PATH_INFO: `/v3/users` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:54.752781 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8caebb-10ab-42a3-b65c-bde582bed670 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:54.753089 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8caebb-10ab-42a3-b65c-bde582bed670 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:54.754600 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8caebb-10ab-42a3-b65c-bde582bed670 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:54.773228 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 625/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 9 15:36:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:54.779404 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf653c-ba6c-4914-ba60-c8c9a3673b3a None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:54.879890 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf653c-ba6c-4914-ba60-c8c9a3673b3a None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:54.913280 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5404df-ba9f-443c-a020-904900b434c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:54.914112 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5404df-ba9f-443c-a020-904900b434c8 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:54.914393 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5404df-ba9f-443c-a020-904900b434c8 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:54.914668 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5404df-ba9f-443c-a020-904900b434c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:54.925476 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5404df-ba9f-443c-a020-904900b434c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:54.926940 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5404df-ba9f-443c-a020-904900b434c8 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:54.943877 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-ff5404df-ba9f-443c-a020-904900b434c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:54.943877 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:54.943877 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:54.943877 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:54.943877 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:54.943877 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:54.943877 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:54.943877 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:54.943877 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:54.943877 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:54.943877 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:54.943877 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:54.943877 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:36:54.943877 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:36:54.943877 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:36:54.945092 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:36:54.945092 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:54.945092 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:54.945092 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:54.945092 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:54.945092 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:54.945092 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:54.945092 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:54.945092 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:36:54.945092 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:54.945092 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:54.945092 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:54.945092 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:54.945092 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:54.945092 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:54.945092 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:54.945092 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:54.946490 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:36:54.946490 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:36:54.946490 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:54.946490 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:36:54.946490 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 644/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:54.951489 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8caebb-10ab-42a3-b65c-bde582bed670 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:55.050043 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8caebb-10ab-42a3-b65c-bde582bed670 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:55.084236 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd4531-fea5-4932-b8c2-261f7cd1b670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:55.084910 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd4531-fea5-4932-b8c2-261f7cd1b670 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:55.085195 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd4531-fea5-4932-b8c2-261f7cd1b670 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:55.085499 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd4531-fea5-4932-b8c2-261f7cd1b670 None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:55.086951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd4531-fea5-4932-b8c2-261f7cd1b670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:55.086951 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd4531-fea5-4932-b8c2-261f7cd1b670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:55.087906 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd4531-fea5-4932-b8c2-261f7cd1b670 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:55.099857 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 626/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:55.105627 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5404df-ba9f-443c-a020-904900b434c8 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:55.215163 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5404df-ba9f-443c-a020-904900b434c8 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:55.248713 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b9060-a565-48c9-8574-eb2e30fecb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:55.249557 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b9060-a565-48c9-8574-eb2e30fecb67 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:55.249845 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b9060-a565-48c9-8574-eb2e30fecb67 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:55.250123 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b9060-a565-48c9-8574-eb2e30fecb67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:55.256849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b9060-a565-48c9-8574-eb2e30fecb67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:55.258327 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b9060-a565-48c9-8574-eb2e30fecb67 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:55.273257 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-2f9b9060-a565-48c9-8574-eb2e30fecb67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:36:55.273257 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:55.273257 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:55.273257 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:55.273257 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:55.273257 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:55.273257 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:55.273257 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:55.273257 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:55.273257 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:55.273257 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:55.273257 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:55.273257 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:36:55.273257 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:36:55.273257 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:36:55.274467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:36:55.274467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:55.274467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:55.274467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:55.274467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:55.274467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:55.274467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:55.274467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:55.274467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:36:55.274467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:55.274467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:55.274467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:55.274467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:55.274467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:55.274467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:55.274467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:55.274467 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:55.275495 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:36:55.275495 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:36:55.275495 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:36:55.275495 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:36:55.275495 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:36:55.275495 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:36:55.275495 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:36:55.275495 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:36:55.275495 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 645/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:36:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:55.280808 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd4531-fea5-4932-b8c2-261f7cd1b670 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:55.381935 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd4531-fea5-4932-b8c2-261f7cd1b670 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:55.415354 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f217a1-ffbc-45cc-857d-06214888d8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:55.416024 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f217a1-ffbc-45cc-857d-06214888d8d6 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:55.416312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f217a1-ffbc-45cc-857d-06214888d8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:55.416591 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f217a1-ffbc-45cc-857d-06214888d8d6 None admin] PATH_INFO: `/v3/projects` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:55.417400 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f217a1-ffbc-45cc-857d-06214888d8d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:55.417726 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f217a1-ffbc-45cc-857d-06214888d8d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:55.419772 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f217a1-ffbc-45cc-857d-06214888d8d6 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:55.431930 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 627/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:36:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:55.438632 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b9060-a565-48c9-8574-eb2e30fecb67 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:55.538534 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b9060-a565-48c9-8574-eb2e30fecb67 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:55.572885 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf468d-d02b-4eaf-b1b5-b9c97a54e11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:55.573805 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf468d-d02b-4eaf-b1b5-b9c97a54e11d None admin] REQUEST_METHOD: `PUT` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:55.574095 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf468d-d02b-4eaf-b1b5-b9c97a54e11d None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:55.574376 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf468d-d02b-4eaf-b1b5-b9c97a54e11d None admin] PATH_INFO: `/v3/projects/db5768a93e754372808fc69f898cc853/users/3d51a903276d400793c4ef18d5b043cb/roles/a5cb8d37261d486cbc1b06d167a9c05c` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:55.576398 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf468d-d02b-4eaf-b1b5-b9c97a54e11d None admin] RBAC: Authorizing `identity:create_grant(project_id=db5768a93e754372808fc69f898cc853, user_id=3d51a903276d400793c4ef18d5b043cb, role_id=a5cb8d37261d486cbc1b06d167a9c05c)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:55.577903 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf468d-d02b-4eaf-b1b5-b9c97a54e11d None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:55.592918 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 646/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:36:55 2022] PUT /identity/v3/projects/db5768a93e754372808fc69f898cc853/users/3d51a903276d400793c4ef18d5b043cb/roles/a5cb8d37261d486cbc1b06d167a9c05c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:36:57.863110 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657af70b-1f00-4331-9cfb-f63beebdfa11 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:57.863675 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657af70b-1f00-4331-9cfb-f63beebdfa11 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:57.863675 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657af70b-1f00-4331-9cfb-f63beebdfa11 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:57.865039 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 628/1274] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:36:57.870935 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047517a-f0ba-4a58-8478-24fe7506d7d6 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:57.871350 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047517a-f0ba-4a58-8478-24fe7506d7d6 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:57.871502 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047517a-f0ba-4a58-8478-24fe7506d7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:57.891217 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-5047517a-f0ba-4a58-8478-24fe7506d7d6 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:36:57.892343 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-5047517a-f0ba-4a58-8478-24fe7506d7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:36:57.959802 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 647/1275] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:36:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:36:57.985509 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657af70b-1f00-4331-9cfb-f63beebdfa11 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:58.090660 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657af70b-1f00-4331-9cfb-f63beebdfa11 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:58.126946 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3f0c1-fca2-4670-84b8-89f4adf60731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:58.127746 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3f0c1-fca2-4670-84b8-89f4adf60731 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:58.128035 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3f0c1-fca2-4670-84b8-89f4adf60731 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:58.128321 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3f0c1-fca2-4670-84b8-89f4adf60731 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:58.141632 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3f0c1-fca2-4670-84b8-89f4adf60731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:36:58.150922 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-c6d3f0c1-fca2-4670-84b8-89f4adf60731 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:36:58.150922 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:58.150922 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:58.150922 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:58.150922 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:58.150922 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:58.150922 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:58.150922 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:58.150922 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:58.150922 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:58.150922 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:58.150922 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:58.150922 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:36:58.150922 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:36:58.150922 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:36:58.150922 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:36:58.152229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:36:58.152229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:36:58.152229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:36:58.152229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:36:58.152229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:58.152229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:58.152229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:58.152229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:58.152229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:58.152229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:58.152229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:58.152229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:36:58.152229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:58.152229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:58.152229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:58.152229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:58.153219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:58.153219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:58.153219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:58.153219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:58.153219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:36:58.153219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:36:58.153219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:36:58.153219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:36:58.153219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:36:58.153219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:36:58.153219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:36:58.153219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:36:58.153219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 629/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:36:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:58.159890 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047517a-f0ba-4a58-8478-24fe7506d7d6 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:58.263896 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047517a-f0ba-4a58-8478-24fe7506d7d6 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:58.298441 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d25b6-8c74-4f60-9542-4bc2b96dbd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:58.299119 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d25b6-8c74-4f60-9542-4bc2b96dbd24 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:58.299409 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d25b6-8c74-4f60-9542-4bc2b96dbd24 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:58.299693 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d25b6-8c74-4f60-9542-4bc2b96dbd24 None admin] PATH_INFO: `/v3/roles` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:58.300449 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d25b6-8c74-4f60-9542-4bc2b96dbd24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:58.300761 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d25b6-8c74-4f60-9542-4bc2b96dbd24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:58.302180 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d25b6-8c74-4f60-9542-4bc2b96dbd24 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:58.311348 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 648/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:36:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:58.317292 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3f0c1-fca2-4670-84b8-89f4adf60731 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:58.417860 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3f0c1-fca2-4670-84b8-89f4adf60731 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:58.452300 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82525a8d-fb86-4364-94e7-974539028cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:58.453091 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82525a8d-fb86-4364-94e7-974539028cf7 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:58.453402 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82525a8d-fb86-4364-94e7-974539028cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:58.453689 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82525a8d-fb86-4364-94e7-974539028cf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:58.464395 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82525a8d-fb86-4364-94e7-974539028cf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:58.466480 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82525a8d-fb86-4364-94e7-974539028cf7 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:58.485436 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-82525a8d-fb86-4364-94e7-974539028cf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:58.485436 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:58.485436 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:58.485436 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:58.485436 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:58.485436 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:58.485436 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:58.485436 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:58.485436 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:58.485436 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:58.485436 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:58.485436 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:58.485436 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:36:58.485436 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:36:58.485436 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:36:58.486637 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:36:58.486637 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:58.486637 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:58.486637 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:58.486637 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:58.486637 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:58.486637 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:58.486637 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:58.486637 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:36:58.486637 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:58.486637 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:58.486637 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:58.486637 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:58.486637 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:58.486637 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:58.486637 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:58.486637 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:58.492795 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:36:58.492795 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:36:58.492795 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:58.492795 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:36:58.492795 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 630/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:58.493192 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d25b6-8c74-4f60-9542-4bc2b96dbd24 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:58.597353 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d25b6-8c74-4f60-9542-4bc2b96dbd24 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:58.632186 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a20064-d822-4aa1-a28e-53e188f404db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:58.632855 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a20064-d822-4aa1-a28e-53e188f404db None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:58.633145 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a20064-d822-4aa1-a28e-53e188f404db None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:58.633451 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a20064-d822-4aa1-a28e-53e188f404db None admin] PATH_INFO: `/v3/domains` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:58.634184 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a20064-d822-4aa1-a28e-53e188f404db None admin] RBAC: Adding query filter params (name=Default) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:58.634495 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a20064-d822-4aa1-a28e-53e188f404db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:58.635870 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a20064-d822-4aa1-a28e-53e188f404db None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:58.649422 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 649/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:58.655686 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82525a8d-fb86-4364-94e7-974539028cf7 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:58.762388 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82525a8d-fb86-4364-94e7-974539028cf7 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:58.795948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c373f-99b9-427d-9f6d-aea3a552e1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:58.796760 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c373f-99b9-427d-9f6d-aea3a552e1ac None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:58.797049 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c373f-99b9-427d-9f6d-aea3a552e1ac None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:58.797329 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c373f-99b9-427d-9f6d-aea3a552e1ac None admin] PATH_INFO: `/v3/users/placement` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:58.805770 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c373f-99b9-427d-9f6d-aea3a552e1ac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:58.807247 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c373f-99b9-427d-9f6d-aea3a552e1ac None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:58.823000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-319c373f-99b9-427d-9f6d-aea3a552e1ac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:36:58.823000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:58.823000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:58.823000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:58.823000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:58.823000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:58.823000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:58.823000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:58.823000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:58.823000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:58.823000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:58.823000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:58.823000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:36:58.823000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:36:58.823000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:36:58.823000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:36:58.824277 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:58.824277 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:58.824277 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:36:58.824277 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:36:58.824277 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:36:58.824277 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:36:58.824277 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:58.824277 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:58.824277 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:58.824277 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:58.824277 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:58.824277 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:36:58.824277 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:58.824277 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:58.824277 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:58.824277 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:58.824277 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:58.824277 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:58.826263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:58.826263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:58.826263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:36:58.826263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:36:58.826263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:36:58.826263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:36:58.826263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:36:58.826263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:36:58.826263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:36:58.826263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:36:58.826263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 631/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:36:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:58.831020 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a20064-d822-4aa1-a28e-53e188f404db None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:58.933928 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a20064-d822-4aa1-a28e-53e188f404db None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:58.970479 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d049ab-d9f0-4652-8410-c44503bf8ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:58.971160 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d049ab-d9f0-4652-8410-c44503bf8ace None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:58.971448 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d049ab-d9f0-4652-8410-c44503bf8ace None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:58.971727 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d049ab-d9f0-4652-8410-c44503bf8ace None admin] PATH_INFO: `/v3/users` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:58.972577 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d049ab-d9f0-4652-8410-c44503bf8ace None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:58.972889 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d049ab-d9f0-4652-8410-c44503bf8ace None admin] RBAC: Authorizing `identity:list_users()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:58.974366 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d049ab-d9f0-4652-8410-c44503bf8ace None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:58.992108 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 650/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 9 15:36:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:58.998923 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c373f-99b9-427d-9f6d-aea3a552e1ac None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:59.099625 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c373f-99b9-427d-9f6d-aea3a552e1ac None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:59.133289 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade309c-aae7-4ce6-b22b-5c97bd871c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:59.133976 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade309c-aae7-4ce6-b22b-5c97bd871c13 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:59.134255 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade309c-aae7-4ce6-b22b-5c97bd871c13 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:59.134529 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade309c-aae7-4ce6-b22b-5c97bd871c13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:59.206431 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade309c-aae7-4ce6-b22b-5c97bd871c13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:59.207900 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade309c-aae7-4ce6-b22b-5c97bd871c13 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:59.305849 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 632/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:36:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:36:59.312476 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d049ab-d9f0-4652-8410-c44503bf8ace None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:59.411351 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d049ab-d9f0-4652-8410-c44503bf8ace None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:59.447661 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf84b75-6f1e-493e-aefa-e06b4acee8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:59.448456 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf84b75-6f1e-493e-aefa-e06b4acee8ee None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:59.448740 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf84b75-6f1e-493e-aefa-e06b4acee8ee None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:59.449014 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf84b75-6f1e-493e-aefa-e06b4acee8ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:59.459425 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf84b75-6f1e-493e-aefa-e06b4acee8ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:59.460890 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf84b75-6f1e-493e-aefa-e06b4acee8ee None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:59.478432 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-1cf84b75-6f1e-493e-aefa-e06b4acee8ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:59.478432 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:59.478432 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:59.478432 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:59.478432 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:59.478432 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:59.478432 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:59.478432 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:59.478432 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:59.478432 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:59.478432 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:59.478432 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:59.478432 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:36:59.478432 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:36:59.478432 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:36:59.480363 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:36:59.480363 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:59.480363 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:59.480363 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:59.480363 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:59.480363 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:59.480363 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:59.480363 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:59.480363 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:36:59.480363 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:59.480363 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:59.480363 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:59.480363 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:59.480363 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:59.480363 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:59.480363 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:59.480363 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:59.482856 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:36:59.482856 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:36:59.482856 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:36:59.482856 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:36:59.482856 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 651/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:59.486413 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade309c-aae7-4ce6-b22b-5c97bd871c13 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:59.585242 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade309c-aae7-4ce6-b22b-5c97bd871c13 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:59.626175 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1a92a-8c0e-4baa-a274-e7934ca1a4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:59.626854 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1a92a-8c0e-4baa-a274-e7934ca1a4bc None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:59.627136 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1a92a-8c0e-4baa-a274-e7934ca1a4bc None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:59.627409 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1a92a-8c0e-4baa-a274-e7934ca1a4bc None admin] PATH_INFO: `/v3/domains` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:59.628229 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1a92a-8c0e-4baa-a274-e7934ca1a4bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:59.629001 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1a92a-8c0e-4baa-a274-e7934ca1a4bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:59.629946 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1a92a-8c0e-4baa-a274-e7934ca1a4bc None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:59.642641 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 633/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:36:59.648553 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf84b75-6f1e-493e-aefa-e06b4acee8ee None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:59.757815 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf84b75-6f1e-493e-aefa-e06b4acee8ee None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:59.798587 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6857ff-1d95-4f23-83b5-65f4196b3460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:59.799399 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6857ff-1d95-4f23-83b5-65f4196b3460 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:59.799688 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6857ff-1d95-4f23-83b5-65f4196b3460 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:59.799969 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6857ff-1d95-4f23-83b5-65f4196b3460 None admin] PATH_INFO: `/v3/projects/service` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:59.807839 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6857ff-1d95-4f23-83b5-65f4196b3460 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:59.809316 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6857ff-1d95-4f23-83b5-65f4196b3460 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:36:59.826604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application [None req-af6857ff-1d95-4f23-83b5-65f4196b3460 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:36:59.826604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:36:59.826604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:36:59.826604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:36:59.826604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:36:59.826604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:36:59.826604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:36:59.826604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:36:59.826604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:36:59.826604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:36:59.826604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:36:59.826604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:36:59.826604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:36:59.826604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:36:59.826604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:36:59.827903 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:36:59.827903 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:36:59.827903 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:36:59.827903 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:36:59.827903 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:36:59.827903 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:36:59.827903 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:36:59.827903 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:36:59.827903 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application with Lock( May 09 15:36:59.827903 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:36:59.827903 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._enter() May 09 15:36:59.827903 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:36:59.827903 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:36:59.827903 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:36:59.827903 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.creator() May 09 15:36:59.827903 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:36:59.827903 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application created_value = creator( May 09 15:36:59.829130 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:36:59.829130 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:36:59.829130 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:36:59.829130 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:36:59.829130 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:36:59.829130 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:36:59.829130 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:36:59.829130 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: ERROR keystone.server.flask.application May 09 15:36:59.829130 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 652/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:36:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:36:59.833986 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1a92a-8c0e-4baa-a274-e7934ca1a4bc None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:36:59.950062 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1a92a-8c0e-4baa-a274-e7934ca1a4bc None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:36:59.994317 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e466d42-911f-409a-97a2-a1f0bc56d5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:36:59.995379 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e466d42-911f-409a-97a2-a1f0bc56d5c4 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:36:59.995838 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e466d42-911f-409a-97a2-a1f0bc56d5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:36:59.996301 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e466d42-911f-409a-97a2-a1f0bc56d5c4 None admin] PATH_INFO: `/v3/projects` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:36:59.997428 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e466d42-911f-409a-97a2-a1f0bc56d5c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:36:59.997743 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e466d42-911f-409a-97a2-a1f0bc56d5c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:36:59.999196 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e466d42-911f-409a-97a2-a1f0bc56d5c4 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:37:00.013312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 634/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:36:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:37:00.019604 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6857ff-1d95-4f23-83b5-65f4196b3460 None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:37:00.133958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6857ff-1d95-4f23-83b5-65f4196b3460 None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:37:00.179232 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149cf5f-9dc5-4d47-8437-98b92c107123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:37:00.179893 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149cf5f-9dc5-4d47-8437-98b92c107123 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:37:00.180178 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149cf5f-9dc5-4d47-8437-98b92c107123 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:37:00.180454 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149cf5f-9dc5-4d47-8437-98b92c107123 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:37:00.181445 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149cf5f-9dc5-4d47-8437-98b92c107123 None admin] RBAC: Adding query filter params (role.id=a5cb8d37261d486cbc1b06d167a9c05c, scope.project.id=db5768a93e754372808fc69f898cc853, user.id=3d51a903276d400793c4ef18d5b043cb) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:37:00.181740 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149cf5f-9dc5-4d47-8437-98b92c107123 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:37:00.184087 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149cf5f-9dc5-4d47-8437-98b92c107123 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:37:00.191061 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 653/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:37:00 2022] GET /identity/v3/role_assignments?user.id=3d51a903276d400793c4ef18d5b043cb&scope.project.id=db5768a93e754372808fc69f898cc853&role.id=a5cb8d37261d486cbc1b06d167a9c05c => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:37:02.495858 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207822b-6d1e-4af9-997d-4ad1fcddbd6b None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:37:02.496408 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207822b-6d1e-4af9-997d-4ad1fcddbd6b None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:37:02.496408 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207822b-6d1e-4af9-997d-4ad1fcddbd6b None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:37:02.498513 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 635/1288] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:37:02.504342 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43336100-a7bf-4f14-b9fb-db9aa95ec8ad None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:37:02.504849 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43336100-a7bf-4f14-b9fb-db9aa95ec8ad None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:37:02.504978 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43336100-a7bf-4f14-b9fb-db9aa95ec8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:37:02.531559 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-43336100-a7bf-4f14-b9fb-db9aa95ec8ad None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:37:02.532804 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-43336100-a7bf-4f14-b9fb-db9aa95ec8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:37:02.612835 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 654/1289] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:37:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:37:02.636395 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207822b-6d1e-4af9-997d-4ad1fcddbd6b None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:37:02.750085 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207822b-6d1e-4af9-997d-4ad1fcddbd6b None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:37:02.785329 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288204ba-3829-42b5-8d93-83db4120d8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:37:02.786151 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288204ba-3829-42b5-8d93-83db4120d8b1 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:37:02.786432 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288204ba-3829-42b5-8d93-83db4120d8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:37:02.786710 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288204ba-3829-42b5-8d93-83db4120d8b1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:37:02.787360 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288204ba-3829-42b5-8d93-83db4120d8b1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:37:02.788754 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288204ba-3829-42b5-8d93-83db4120d8b1 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:37:02.800603 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-288204ba-3829-42b5-8d93-83db4120d8b1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:37:02.800603 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:37:02.800603 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:37:02.800603 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:37:02.800603 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:37:02.800603 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:37:02.800603 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:37:02.800603 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:37:02.800603 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:37:02.800603 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:37:02.800603 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:37:02.800603 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:37:02.800603 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:37:02.800603 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:37:02.800603 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:37:02.800603 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:37:02.800603 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:37:02.801763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:37:02.801763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:37:02.801763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:37:02.801763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:37:02.801763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:37:02.801763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:37:02.801763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:37:02.801763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:37:02.801763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:37:02.801763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:37:02.801763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:37:02.801763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:37:02.801763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:37:02.801763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:37:02.801763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:37:02.801763 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:37:02.803000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:37:02.803000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:37:02.803000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:37:02.803000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:37:02.803000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:37:02.803000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:37:02.803000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:37:02.803000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:37:02.803000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:37:02.803000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:37:02.803000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:37:02.803000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:37:02.803000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:37:02.803000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:37:02.803000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 636/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:37:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:37:02.808040 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43336100-a7bf-4f14-b9fb-db9aa95ec8ad None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:37:02.910990 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43336100-a7bf-4f14-b9fb-db9aa95ec8ad None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:37:02.946346 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92497a7b-b7cb-4d63-8c98-ac4f659f3164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:37:02.947021 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92497a7b-b7cb-4d63-8c98-ac4f659f3164 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:37:02.947306 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92497a7b-b7cb-4d63-8c98-ac4f659f3164 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:37:02.947585 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92497a7b-b7cb-4d63-8c98-ac4f659f3164 None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:37:02.948299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92497a7b-b7cb-4d63-8c98-ac4f659f3164 None admin] RBAC: Adding query filter params (name=placement) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:37:02.948609 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92497a7b-b7cb-4d63-8c98-ac4f659f3164 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:37:02.950027 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92497a7b-b7cb-4d63-8c98-ac4f659f3164 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:37:02.955360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 655/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Mon May 9 15:37:02 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:37:02.961182 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288204ba-3829-42b5-8d93-83db4120d8b1 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:37:03.064616 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288204ba-3829-42b5-8d93-83db4120d8b1 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:37:03.099240 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff29805-4e53-4355-8d4e-520823cbc814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:37:03.099910 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff29805-4e53-4355-8d4e-520823cbc814 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:37:03.100200 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff29805-4e53-4355-8d4e-520823cbc814 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:37:03.100479 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff29805-4e53-4355-8d4e-520823cbc814 None admin] PATH_INFO: `/v3/services` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:37:03.101191 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff29805-4e53-4355-8d4e-520823cbc814 None admin] RBAC: Adding query filter params (type=placement) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:37:03.101535 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff29805-4e53-4355-8d4e-520823cbc814 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:37:03.102921 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff29805-4e53-4355-8d4e-520823cbc814 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:37:03.108092 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 637/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Mon May 9 15:37:02 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:37:05.382121 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031e665-13a6-48ca-bdb0-27fcaaacebeb None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:37:05.382709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031e665-13a6-48ca-bdb0-27fcaaacebeb None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:37:05.382709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031e665-13a6-48ca-bdb0-27fcaaacebeb None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:37:05.384031 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 656/1293] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:37:05.389897 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077c431-bd26-4d57-8e18-82800fa287e5 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:37:05.390359 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077c431-bd26-4d57-8e18-82800fa287e5 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:37:05.390469 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077c431-bd26-4d57-8e18-82800fa287e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:37:05.407617 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-a077c431-bd26-4d57-8e18-82800fa287e5 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:37:05.408804 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-a077c431-bd26-4d57-8e18-82800fa287e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:37:05.477050 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 638/1294] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:37:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:37:05.500014 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031e665-13a6-48ca-bdb0-27fcaaacebeb None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:37:05.602959 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031e665-13a6-48ca-bdb0-27fcaaacebeb None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:37:05.636926 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d4865-c120-4163-ac83-754d8c8d6792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:37:05.638248 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d4865-c120-4163-ac83-754d8c8d6792 None admin] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:37:05.638690 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d4865-c120-4163-ac83-754d8c8d6792 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:37:05.638953 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d4865-c120-4163-ac83-754d8c8d6792 None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:37:05.639687 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d4865-c120-4163-ac83-754d8c8d6792 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:37:05.641069 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d4865-c120-4163-ac83-754d8c8d6792 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:37:05.656170 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 657/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:37:05 2022] POST /identity/v3/services => generated 246 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:37:07.908434 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d41b9-f996-4a48-aa46-bec92fca1419 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:37:07.908973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d41b9-f996-4a48-aa46-bec92fca1419 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:37:07.908973 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d41b9-f996-4a48-aa46-bec92fca1419 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:37:07.910338 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 639/1296] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:37:07.915492 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57084fc6-f916-46b0-9782-da7f23c366f0 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:37:07.915947 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57084fc6-f916-46b0-9782-da7f23c366f0 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:37:07.916057 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57084fc6-f916-46b0-9782-da7f23c366f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:37:07.932558 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-57084fc6-f916-46b0-9782-da7f23c366f0 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:37:07.933790 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-57084fc6-f916-46b0-9782-da7f23c366f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:37:08.004169 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 658/1297] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:37:07 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:37:08.027263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d41b9-f996-4a48-aa46-bec92fca1419 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:37:08.124109 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d41b9-f996-4a48-aa46-bec92fca1419 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:37:08.159038 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc01b0f-915f-4b17-b7fb-7a67631aa2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:37:08.159809 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc01b0f-915f-4b17-b7fb-7a67631aa2ef None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:37:08.160049 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc01b0f-915f-4b17-b7fb-7a67631aa2ef None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:37:08.160322 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc01b0f-915f-4b17-b7fb-7a67631aa2ef None admin] PATH_INFO: `/v3/services/placement` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:37:08.160983 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc01b0f-915f-4b17-b7fb-7a67631aa2ef None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:37:08.162399 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc01b0f-915f-4b17-b7fb-7a67631aa2ef None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:37:08.174975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-adc01b0f-915f-4b17-b7fb-7a67631aa2ef None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:37:08.174975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:37:08.174975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:37:08.174975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:37:08.174975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:37:08.174975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:37:08.174975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:37:08.174975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:37:08.174975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:37:08.174975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:37:08.174975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:37:08.174975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:37:08.174975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:37:08.174975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:37:08.174975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:37:08.174975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:37:08.174975 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:37:08.176165 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:37:08.176165 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:37:08.176165 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:37:08.176165 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:37:08.176165 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:37:08.176165 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:37:08.176165 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:37:08.176165 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:37:08.176165 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:37:08.176165 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:37:08.176165 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:37:08.176165 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:37:08.176165 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:37:08.176165 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:37:08.176165 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:37:08.176165 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:37:08.177202 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:37:08.177202 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:37:08.177202 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:37:08.177202 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:37:08.177202 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:37:08.177202 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:37:08.177202 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:37:08.177202 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:37:08.177202 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:37:08.177202 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:37:08.177202 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:37:08.177202 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:37:08.177202 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:37:08.177202 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:37:08.177202 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 640/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:37:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:37:08.182609 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57084fc6-f916-46b0-9782-da7f23c366f0 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:37:08.282696 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57084fc6-f916-46b0-9782-da7f23c366f0 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:37:08.315624 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35028ad-9d94-4485-a5e3-0b6c81bfa0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:37:08.316298 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35028ad-9d94-4485-a5e3-0b6c81bfa0ea None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:37:08.316581 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35028ad-9d94-4485-a5e3-0b6c81bfa0ea None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:37:08.316856 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35028ad-9d94-4485-a5e3-0b6c81bfa0ea None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:37:08.317597 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35028ad-9d94-4485-a5e3-0b6c81bfa0ea None admin] RBAC: Adding query filter params (name=placement) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:37:08.317909 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35028ad-9d94-4485-a5e3-0b6c81bfa0ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:37:08.319282 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35028ad-9d94-4485-a5e3-0b6c81bfa0ea None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:37:08.324277 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 659/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Mon May 9 15:37:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:37:08.331033 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc01b0f-915f-4b17-b7fb-7a67631aa2ef None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:37:08.428490 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc01b0f-915f-4b17-b7fb-7a67631aa2ef None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:37:08.460598 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182db40-ac66-4ba1-977f-f10e97533b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:37:08.461263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182db40-ac66-4ba1-977f-f10e97533b07 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:37:08.461584 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182db40-ac66-4ba1-977f-f10e97533b07 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:37:08.461868 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182db40-ac66-4ba1-977f-f10e97533b07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:37:08.462660 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182db40-ac66-4ba1-977f-f10e97533b07 None admin] RBAC: Adding query filter params (interface=public, service_id=ceecf981e53f43bc81f05d1c85259ea0, region_id=RegionOne) {{(pid=212998) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:37:08.462977 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182db40-ac66-4ba1-977f-f10e97533b07 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:37:08.464366 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182db40-ac66-4ba1-977f-f10e97533b07 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:37:08.469955 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 641/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:37:08 2022] GET /identity/v3/endpoints?service_id=ceecf981e53f43bc81f05d1c85259ea0&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:37:08.475656 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35028ad-9d94-4485-a5e3-0b6c81bfa0ea None admin] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:37:08.572137 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35028ad-9d94-4485-a5e3-0b6c81bfa0ea None admin] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:37:08.605117 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36a51a-7ab5-4a58-968c-7ba3430864f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:37:08.605805 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36a51a-7ab5-4a58-968c-7ba3430864f0 None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:37:08.606093 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36a51a-7ab5-4a58-968c-7ba3430864f0 None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:37:08.606476 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36a51a-7ab5-4a58-968c-7ba3430864f0 None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:37:08.607165 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36a51a-7ab5-4a58-968c-7ba3430864f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:37:08.608530 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36a51a-7ab5-4a58-968c-7ba3430864f0 None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:37:08.615226 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 660/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:37:08 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:37:10.885219 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd328de-8c02-48fd-8293-fd9e80ed29f8 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:37:10.885762 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd328de-8c02-48fd-8293-fd9e80ed29f8 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:37:10.885762 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd328de-8c02-48fd-8293-fd9e80ed29f8 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:37:10.887133 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 642/1302] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:37:10.892634 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950ed76-e3a2-4a8c-9374-f0fc0863c2f1 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:37:10.893090 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950ed76-e3a2-4a8c-9374-f0fc0863c2f1 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:37:10.893191 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950ed76-e3a2-4a8c-9374-f0fc0863c2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:37:10.910269 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-7950ed76-e3a2-4a8c-9374-f0fc0863c2f1 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:37:10.911459 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-7950ed76-e3a2-4a8c-9374-f0fc0863c2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:37:10.975312 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 661/1303] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:37:10 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:37:10.999339 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd328de-8c02-48fd-8293-fd9e80ed29f8 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:37:11.100245 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd328de-8c02-48fd-8293-fd9e80ed29f8 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:37:11.134011 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dce012-cc7b-4526-918f-cf19f11cec28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:37:11.134814 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dce012-cc7b-4526-918f-cf19f11cec28 None admin] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:37:11.135510 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dce012-cc7b-4526-918f-cf19f11cec28 None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:37:11.135510 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dce012-cc7b-4526-918f-cf19f11cec28 None admin] PATH_INFO: `/v3/services/placement` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:37:11.136066 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dce012-cc7b-4526-918f-cf19f11cec28 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:37:11.138052 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dce012-cc7b-4526-918f-cf19f11cec28 None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:37:11.150283 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application [None req-42dce012-cc7b-4526-918f-cf19f11cec28 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:37:11.150283 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:37:11.150283 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:37:11.150283 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:37:11.150283 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:37:11.150283 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:37:11.150283 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:37:11.150283 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:37:11.150283 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:37:11.150283 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:37:11.150283 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:37:11.150283 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:37:11.150283 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:37:11.150283 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:37:11.150283 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:37:11.150283 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:37:11.150283 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:37:11.151615 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:37:11.151615 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:37:11.151615 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:37:11.151615 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:37:11.151615 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:37:11.151615 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:37:11.151615 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:37:11.151615 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:37:11.151615 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:37:11.151615 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:37:11.151615 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:37:11.151615 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:37:11.151615 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:37:11.151615 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:37:11.151615 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:37:11.151615 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:37:11.152588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:37:11.152588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application with Lock( May 09 15:37:11.152588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:37:11.152588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self._enter() May 09 15:37:11.152588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:37:11.152588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:37:11.152588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:37:11.152588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application return self.creator() May 09 15:37:11.152588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:37:11.152588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application created_value = creator( May 09 15:37:11.152588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:37:11.152588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:37:11.152588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:37:11.152588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: ERROR keystone.server.flask.application May 09 15:37:11.152588 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 643/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:37:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:37:11.158147 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950ed76-e3a2-4a8c-9374-f0fc0863c2f1 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:37:11.253981 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950ed76-e3a2-4a8c-9374-f0fc0863c2f1 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:37:11.285949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85b68c-67e1-4376-b8aa-df4c5bce5bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:37:11.286609 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85b68c-67e1-4376-b8aa-df4c5bce5bdb None admin] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:37:11.286893 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85b68c-67e1-4376-b8aa-df4c5bce5bdb None admin] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:37:11.287171 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85b68c-67e1-4376-b8aa-df4c5bce5bdb None admin] PATH_INFO: `/v3/services` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:37:11.287873 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85b68c-67e1-4376-b8aa-df4c5bce5bdb None admin] RBAC: Adding query filter params (name=placement) {{(pid=212999) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:37:11.288180 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85b68c-67e1-4376-b8aa-df4c5bce5bdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:37:11.289578 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85b68c-67e1-4376-b8aa-df4c5bce5bdb None admin] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:37:11.295132 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 662/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Mon May 9 15:37:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:37:11.301000 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dce012-cc7b-4526-918f-cf19f11cec28 None admin] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:37:11.399357 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dce012-cc7b-4526-918f-cf19f11cec28 None admin] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:37:11.431217 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e868e8f-bf26-42ac-bf04-42604aeec55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7982ad69f6614806bd35b21cb21af8d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:37:11.431866 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e868e8f-bf26-42ac-bf04-42604aeec55e None admin] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:37:11.432150 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e868e8f-bf26-42ac-bf04-42604aeec55e None admin] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:37:11.432426 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e868e8f-bf26-42ac-bf04-42604aeec55e None admin] PATH_INFO: `/v3/endpoints` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:37:11.433168 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e868e8f-bf26-42ac-bf04-42604aeec55e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:37:11.435112 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e868e8f-bf26-42ac-bf04-42604aeec55e None admin] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:37:11.452518 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 644/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:37:11 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:38:18.161750 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0654c8-a29a-4cb2-b226-8af3caf32e4f None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:18.162318 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0654c8-a29a-4cb2-b226-8af3caf32e4f None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:18.162567 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0654c8-a29a-4cb2-b226-8af3caf32e4f None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:18.164349 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 663/1307] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:38:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:38:18.170957 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d3708-ad15-450c-b64e-058ecc6cce1b None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:18.171557 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d3708-ad15-450c-b64e-058ecc6cce1b None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:18.171557 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d3708-ad15-450c-b64e-058ecc6cce1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:18.346478 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-762d3708-ad15-450c-b64e-058ecc6cce1b None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:38:18.347696 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-762d3708-ad15-450c-b64e-058ecc6cce1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:18.547708 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 645/1308] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:38:18.597813 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b5c56-c74f-4236-a1e0-86ceb2ef171b None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:18.598363 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b5c56-c74f-4236-a1e0-86ceb2ef171b None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:18.598833 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b5c56-c74f-4236-a1e0-86ceb2ef171b None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:18.600961 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 664/1309] 10.222.0.48 () {54 vars in 964 bytes} [Mon May 9 15:38:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:38:18.608028 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d76b3-d5be-430f-b92f-02c640e1a1c0 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:18.608319 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d76b3-d5be-430f-b92f-02c640e1a1c0 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:18.608598 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d76b3-d5be-430f-b92f-02c640e1a1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:18.762122 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-8d5d76b3-d5be-430f-b92f-02c640e1a1c0 None None] MFA Rules not processed for user `74924b56be0243eda3144664dd01cc13`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:38:18.763333 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-8d5d76b3-d5be-430f-b92f-02c640e1a1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:18.888195 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 646/1310] 10.222.0.48 () {58 vars in 1061 bytes} [Mon May 9 15:38:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:38:18.898203 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b5c56-c74f-4236-a1e0-86ceb2ef171b None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:38:18.900325 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-be6b5c56-c74f-4236-a1e0-86ceb2ef171b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:19.175535 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b5c56-c74f-4236-a1e0-86ceb2ef171b None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:38:19.382860 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ff048-e0d1-44a2-a699-e89dd1372dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74924b56be0243eda3144664dd01cc13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5768a93e754372808fc69f898cc853', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:38:19.383870 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ff048-e0d1-44a2-a699-e89dd1372dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:19.384357 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ff048-e0d1-44a2-a699-e89dd1372dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:19.384821 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ff048-e0d1-44a2-a699-e89dd1372dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:19.387673 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-025ff048-e0d1-44a2-a699-e89dd1372dc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:19.515709 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ff048-e0d1-44a2-a699-e89dd1372dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:38:19.517559 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ff048-e0d1-44a2-a699-e89dd1372dc4 service neutron] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:38:19.541714 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 665/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:38:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:38:22.286186 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71beb7-4774-43dc-b0f4-726445bdbf01 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:22.287184 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71beb7-4774-43dc-b0f4-726445bdbf01 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:22.287632 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71beb7-4774-43dc-b0f4-726445bdbf01 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:22.294979 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aefc00-4122-4ed9-825e-f93ee239810f None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:22.295801 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aefc00-4122-4ed9-825e-f93ee239810f None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:22.296250 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aefc00-4122-4ed9-825e-f93ee239810f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:22.299889 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 647/1312] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:38:22 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:38:22.381811 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-57aefc00-4122-4ed9-825e-f93ee239810f None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:38:22.383343 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-57aefc00-4122-4ed9-825e-f93ee239810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:22.505592 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 666/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:38:22.534194 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71beb7-4774-43dc-b0f4-726445bdbf01 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:38:22.535759 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-7a71beb7-4774-43dc-b0f4-726445bdbf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:22.656213 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71beb7-4774-43dc-b0f4-726445bdbf01 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:38:22.750022 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d117f4-8b8d-47b6-b8d9-9112d586195c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74924b56be0243eda3144664dd01cc13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5768a93e754372808fc69f898cc853', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:38:22.750872 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d117f4-8b8d-47b6-b8d9-9112d586195c service neutron] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:22.751260 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d117f4-8b8d-47b6-b8d9-9112d586195c service neutron] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:22.751643 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d117f4-8b8d-47b6-b8d9-9112d586195c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:22.753864 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-a3d117f4-8b8d-47b6-b8d9-9112d586195c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:22.888999 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d117f4-8b8d-47b6-b8d9-9112d586195c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:38:22.890575 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d117f4-8b8d-47b6-b8d9-9112d586195c service neutron] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:38:22.921896 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 648/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:38:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:38:25.614982 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482aafd6-3198-4916-9f98-4a2eb7787989 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:25.615571 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482aafd6-3198-4916-9f98-4a2eb7787989 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:25.615571 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482aafd6-3198-4916-9f98-4a2eb7787989 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:25.616919 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 667/1315] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:38:25.623250 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d6a2b-cfd6-40d4-b49a-f526c6fabf8c None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:25.623698 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d6a2b-cfd6-40d4-b49a-f526c6fabf8c None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:25.623952 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d6a2b-cfd6-40d4-b49a-f526c6fabf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:25.687508 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-0e0d6a2b-cfd6-40d4-b49a-f526c6fabf8c None None] MFA Rules not processed for user `cc3d6549df2943439a77a3939535737e`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:38:25.688737 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-0e0d6a2b-cfd6-40d4-b49a-f526c6fabf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:25.781949 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 649/1316] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:38:25 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:38:25.821926 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482aafd6-3198-4916-9f98-4a2eb7787989 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:38:25.823567 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-482aafd6-3198-4916-9f98-4a2eb7787989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:25.929562 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482aafd6-3198-4916-9f98-4a2eb7787989 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:38:26.003833 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612881e-181d-4bde-a6c0-bdfa3e876732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74924b56be0243eda3144664dd01cc13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5768a93e754372808fc69f898cc853', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:38:26.004490 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612881e-181d-4bde-a6c0-bdfa3e876732 service neutron] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:26.004782 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612881e-181d-4bde-a6c0-bdfa3e876732 service neutron] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:26.005064 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612881e-181d-4bde-a6c0-bdfa3e876732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:26.006793 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-a612881e-181d-4bde-a6c0-bdfa3e876732 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:26.117810 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612881e-181d-4bde-a6c0-bdfa3e876732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:38:26.119264 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612881e-181d-4bde-a6c0-bdfa3e876732 service neutron] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:38:26.138796 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 668/1317] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:38:25 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:38:28.996312 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311e527-dd8b-483f-8d32-54513018cb2c None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:28.996875 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311e527-dd8b-483f-8d32-54513018cb2c None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:28.996875 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311e527-dd8b-483f-8d32-54513018cb2c None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:28.998545 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 650/1318] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:38:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:38:29.003921 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35630d-e8eb-4dd4-8065-56515e169e8e None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:29.004360 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35630d-e8eb-4dd4-8065-56515e169e8e None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:29.004476 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35630d-e8eb-4dd4-8065-56515e169e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:29.067815 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-9a35630d-e8eb-4dd4-8065-56515e169e8e None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:38:29.069019 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-9a35630d-e8eb-4dd4-8065-56515e169e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:29.164344 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 669/1319] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:38:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:38:29.203178 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311e527-dd8b-483f-8d32-54513018cb2c None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:38:29.204759 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-2311e527-dd8b-483f-8d32-54513018cb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:29.307023 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311e527-dd8b-483f-8d32-54513018cb2c None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:38:29.381458 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47faf385-381c-485b-bbd7-c29caa677109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74924b56be0243eda3144664dd01cc13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5768a93e754372808fc69f898cc853', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:38:29.382110 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47faf385-381c-485b-bbd7-c29caa677109 service neutron] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:29.382397 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47faf385-381c-485b-bbd7-c29caa677109 service neutron] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:29.382680 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47faf385-381c-485b-bbd7-c29caa677109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:29.384348 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-47faf385-381c-485b-bbd7-c29caa677109 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:29.492084 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47faf385-381c-485b-bbd7-c29caa677109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:38:29.493597 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47faf385-381c-485b-bbd7-c29caa677109 service neutron] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:38:29.513512 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 651/1320] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:38:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:38:32.423721 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7fc79-f600-4bcc-b29f-65c4d4c1ab07 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:32.424299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7fc79-f600-4bcc-b29f-65c4d4c1ab07 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:32.424299 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7fc79-f600-4bcc-b29f-65c4d4c1ab07 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:32.425846 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 670/1321] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:38:32.430934 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5371672-9819-43a2-93aa-b6c166449813 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:32.431382 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5371672-9819-43a2-93aa-b6c166449813 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:32.431504 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5371672-9819-43a2-93aa-b6c166449813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:32.497741 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-c5371672-9819-43a2-93aa-b6c166449813 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:38:32.498950 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-c5371672-9819-43a2-93aa-b6c166449813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:32.592186 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 652/1322] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:38:32.645859 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d8373-c4e6-402c-9dd4-5ecb5ff1d3e2 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:32.646242 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d8373-c4e6-402c-9dd4-5ecb5ff1d3e2 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:32.646618 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d8373-c4e6-402c-9dd4-5ecb5ff1d3e2 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:32.648098 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 671/1323] 10.222.0.48 () {54 vars in 964 bytes} [Mon May 9 15:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:38:32.655020 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc2208-87e3-4ba4-b09f-b6b364145780 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:32.655318 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc2208-87e3-4ba4-b09f-b6b364145780 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:32.655595 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc2208-87e3-4ba4-b09f-b6b364145780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:32.731977 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-6bdc2208-87e3-4ba4-b09f-b6b364145780 None None] MFA Rules not processed for user `74924b56be0243eda3144664dd01cc13`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:38:32.733171 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-6bdc2208-87e3-4ba4-b09f-b6b364145780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:32.808350 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 653/1324] 10.222.0.48 () {58 vars in 1061 bytes} [Mon May 9 15:38:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:38:32.817599 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d8373-c4e6-402c-9dd4-5ecb5ff1d3e2 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:38:32.819215 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-6e5d8373-c4e6-402c-9dd4-5ecb5ff1d3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:32.925309 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d8373-c4e6-402c-9dd4-5ecb5ff1d3e2 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:38:33.002773 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee662a80-d939-4ab1-92e5-8e321370f97e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74924b56be0243eda3144664dd01cc13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5768a93e754372808fc69f898cc853', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:38:33.003345 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee662a80-d939-4ab1-92e5-8e321370f97e service neutron] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:33.003629 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee662a80-d939-4ab1-92e5-8e321370f97e service neutron] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:33.003902 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee662a80-d939-4ab1-92e5-8e321370f97e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:33.005564 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-ee662a80-d939-4ab1-92e5-8e321370f97e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:33.119674 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee662a80-d939-4ab1-92e5-8e321370f97e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:38:33.121337 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee662a80-d939-4ab1-92e5-8e321370f97e service neutron] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:38:33.140949 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 672/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:38:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:38:35.696063 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269e08b-48fd-4818-a60c-09e21fad281a None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:35.696634 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269e08b-48fd-4818-a60c-09e21fad281a None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:35.696744 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269e08b-48fd-4818-a60c-09e21fad281a None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:35.698981 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 654/1326] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:38:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:38:35.704502 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f7a86-5c87-49fd-a8e6-27091828ba50 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:35.705022 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f7a86-5c87-49fd-a8e6-27091828ba50 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:35.705179 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f7a86-5c87-49fd-a8e6-27091828ba50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:35.773702 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-d08f7a86-5c87-49fd-a8e6-27091828ba50 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:38:35.774919 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-d08f7a86-5c87-49fd-a8e6-27091828ba50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:35.874917 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 673/1327] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:38:35.911324 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269e08b-48fd-4818-a60c-09e21fad281a None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:38:35.912874 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-6269e08b-48fd-4818-a60c-09e21fad281a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:36.023231 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269e08b-48fd-4818-a60c-09e21fad281a None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:38:36.099194 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619714d-00b4-4207-b778-8583c26e8800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74924b56be0243eda3144664dd01cc13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5768a93e754372808fc69f898cc853', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:38:36.099863 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619714d-00b4-4207-b778-8583c26e8800 service neutron] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:36.100153 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619714d-00b4-4207-b778-8583c26e8800 service neutron] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:36.100444 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619714d-00b4-4207-b778-8583c26e8800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:36.102204 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-2619714d-00b4-4207-b778-8583c26e8800 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:36.220699 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619714d-00b4-4207-b778-8583c26e8800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:38:36.222198 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619714d-00b4-4207-b778-8583c26e8800 service neutron] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:38:36.241421 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 655/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:38:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:38:38.576874 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0255b-7267-419a-ac96-f44c52201cae None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:38.577541 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0255b-7267-419a-ac96-f44c52201cae None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:38.577541 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0255b-7267-419a-ac96-f44c52201cae None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:38.578850 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 674/1329] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:38:38.584093 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e8e3c-a8c5-472d-933a-f031d19b373d None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:38.584524 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e8e3c-a8c5-472d-933a-f031d19b373d None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:38.584653 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e8e3c-a8c5-472d-933a-f031d19b373d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:38.649394 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-494e8e3c-a8c5-472d-933a-f031d19b373d None None] MFA Rules not processed for user `cc3d6549df2943439a77a3939535737e`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:38:38.650602 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-494e8e3c-a8c5-472d-933a-f031d19b373d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:38.748543 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 656/1330] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:38:38 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:38:38.785250 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0255b-7267-419a-ac96-f44c52201cae None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:38:38.786806 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-26a0255b-7267-419a-ac96-f44c52201cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:38.889099 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0255b-7267-419a-ac96-f44c52201cae None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:38:38.959602 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a38c2a-e575-495a-bdb5-e958b0d6d700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74924b56be0243eda3144664dd01cc13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5768a93e754372808fc69f898cc853', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:38:38.960271 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a38c2a-e575-495a-bdb5-e958b0d6d700 service neutron] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:38.960555 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a38c2a-e575-495a-bdb5-e958b0d6d700 service neutron] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:38.960830 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a38c2a-e575-495a-bdb5-e958b0d6d700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:38.962608 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-04a38c2a-e575-495a-bdb5-e958b0d6d700 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:39.071896 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a38c2a-e575-495a-bdb5-e958b0d6d700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:38:39.073726 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a38c2a-e575-495a-bdb5-e958b0d6d700 service neutron] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:38:39.092179 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 675/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:38:38 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:38:41.807208 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01100fb5-d3a0-440a-bbb4-324dd96641f6 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:41.807754 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01100fb5-d3a0-440a-bbb4-324dd96641f6 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:41.807848 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01100fb5-d3a0-440a-bbb4-324dd96641f6 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:41.809869 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 657/1332] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:38:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:38:41.815518 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac6b92-3cc1-474f-8587-2abb909704b3 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:41.816008 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac6b92-3cc1-474f-8587-2abb909704b3 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:41.816119 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac6b92-3cc1-474f-8587-2abb909704b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:41.886427 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-ecac6b92-3cc1-474f-8587-2abb909704b3 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:38:41.887588 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-ecac6b92-3cc1-474f-8587-2abb909704b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:41.988858 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 676/1333] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:38:42.027250 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01100fb5-d3a0-440a-bbb4-324dd96641f6 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:38:42.028897 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-01100fb5-d3a0-440a-bbb4-324dd96641f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:42.137018 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01100fb5-d3a0-440a-bbb4-324dd96641f6 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:38:42.213013 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b325c-2e79-4079-a499-cd458dbda1fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74924b56be0243eda3144664dd01cc13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5768a93e754372808fc69f898cc853', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:38:42.214216 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b325c-2e79-4079-a499-cd458dbda1fc service neutron] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:42.214596 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b325c-2e79-4079-a499-cd458dbda1fc service neutron] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:42.214878 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b325c-2e79-4079-a499-cd458dbda1fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:42.216550 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-2f6b325c-2e79-4079-a499-cd458dbda1fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:42.336585 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b325c-2e79-4079-a499-cd458dbda1fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:38:42.338078 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b325c-2e79-4079-a499-cd458dbda1fc service neutron] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:38:42.360484 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 658/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:38:44.656155 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74976808-e353-44c7-93db-561241ccf31b None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:44.656719 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74976808-e353-44c7-93db-561241ccf31b None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:44.656719 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74976808-e353-44c7-93db-561241ccf31b None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:44.658152 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 677/1335] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:38:44.663434 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda67cff-9b14-43dd-a87d-8e940bc28c10 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:44.663872 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda67cff-9b14-43dd-a87d-8e940bc28c10 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:44.663989 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda67cff-9b14-43dd-a87d-8e940bc28c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:44.731115 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-fda67cff-9b14-43dd-a87d-8e940bc28c10 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:38:44.732358 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-fda67cff-9b14-43dd-a87d-8e940bc28c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:44.830374 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 659/1336] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:38:44.871400 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74976808-e353-44c7-93db-561241ccf31b None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:38:44.873208 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-74976808-e353-44c7-93db-561241ccf31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:44.979008 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74976808-e353-44c7-93db-561241ccf31b None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:38:45.051212 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140e9e2-3307-4101-b7c8-c010103cee2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74924b56be0243eda3144664dd01cc13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5768a93e754372808fc69f898cc853', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:38:45.051964 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140e9e2-3307-4101-b7c8-c010103cee2f service neutron] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:45.052249 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140e9e2-3307-4101-b7c8-c010103cee2f service neutron] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:45.052523 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140e9e2-3307-4101-b7c8-c010103cee2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:45.054206 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-1140e9e2-3307-4101-b7c8-c010103cee2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:45.161958 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140e9e2-3307-4101-b7c8-c010103cee2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:38:45.163400 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140e9e2-3307-4101-b7c8-c010103cee2f service neutron] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:38:45.181397 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 678/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:38:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:38:47.913874 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda2f9a-42c4-47a1-a130-802007351276 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:47.914377 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda2f9a-42c4-47a1-a130-802007351276 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:47.914377 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda2f9a-42c4-47a1-a130-802007351276 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:47.915759 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 660/1338] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:38:47.921799 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de402d-b144-4638-aaea-f018a7b7538f None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:47.922268 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de402d-b144-4638-aaea-f018a7b7538f None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:47.922367 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de402d-b144-4638-aaea-f018a7b7538f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:47.988627 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-f9de402d-b144-4638-aaea-f018a7b7538f None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:38:47.989857 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-f9de402d-b144-4638-aaea-f018a7b7538f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:48.084835 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 679/1339] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:38:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:38:48.121111 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda2f9a-42c4-47a1-a130-802007351276 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:38:48.122956 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-ccda2f9a-42c4-47a1-a130-802007351276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:48.233361 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda2f9a-42c4-47a1-a130-802007351276 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:38:48.307740 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efd8ec-f12c-4d8a-bd86-d7f304472648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74924b56be0243eda3144664dd01cc13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5768a93e754372808fc69f898cc853', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:38:48.308390 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efd8ec-f12c-4d8a-bd86-d7f304472648 service neutron] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:48.308670 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efd8ec-f12c-4d8a-bd86-d7f304472648 service neutron] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:48.308948 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efd8ec-f12c-4d8a-bd86-d7f304472648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:48.311061 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-08efd8ec-f12c-4d8a-bd86-d7f304472648 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:48.421087 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08efd8ec-f12c-4d8a-bd86-d7f304472648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:38:48.422574 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08efd8ec-f12c-4d8a-bd86-d7f304472648 service neutron] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:38:48.440569 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 661/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:38:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:38:52.833553 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249b6bb-bbeb-43bd-8049-59e112d4f6a5 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:52.834087 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249b6bb-bbeb-43bd-8049-59e112d4f6a5 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:52.834217 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249b6bb-bbeb-43bd-8049-59e112d4f6a5 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:52.835560 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 680/1341] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:38:52.841525 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99959f-3167-4008-82b1-45a5f8878650 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:52.841959 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99959f-3167-4008-82b1-45a5f8878650 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:52.842090 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99959f-3167-4008-82b1-45a5f8878650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:52.889576 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-ee99959f-3167-4008-82b1-45a5f8878650 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:38:52.890783 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-ee99959f-3167-4008-82b1-45a5f8878650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:52.975184 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 662/1342] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:38:53.013596 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249b6bb-bbeb-43bd-8049-59e112d4f6a5 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:38:53.015772 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-e249b6bb-bbeb-43bd-8049-59e112d4f6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:53.092244 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249b6bb-bbeb-43bd-8049-59e112d4f6a5 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:38:53.095824 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0f9a2-27ae-463a-9ef7-41f2a6675601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74924b56be0243eda3144664dd01cc13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5768a93e754372808fc69f898cc853', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:38:53.096471 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0f9a2-27ae-463a-9ef7-41f2a6675601 service neutron] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:53.096755 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0f9a2-27ae-463a-9ef7-41f2a6675601 service neutron] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:53.097031 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0f9a2-27ae-463a-9ef7-41f2a6675601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:53.105991 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0f9a2-27ae-463a-9ef7-41f2a6675601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:38:53.107418 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0f9a2-27ae-463a-9ef7-41f2a6675601 service neutron] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:38:53.116601 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 681/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:38:55.972352 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40ef9f-40ac-4325-8072-f0dd5dac913b None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:55.972890 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40ef9f-40ac-4325-8072-f0dd5dac913b None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:55.972890 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40ef9f-40ac-4325-8072-f0dd5dac913b None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:55.974321 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 663/1344] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:38:55.979742 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35647a-7860-4bec-b94d-f4829c0e0016 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:55.980171 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35647a-7860-4bec-b94d-f4829c0e0016 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:55.980303 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35647a-7860-4bec-b94d-f4829c0e0016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:56.007555 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-1d35647a-7860-4bec-b94d-f4829c0e0016 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:38:56.008760 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-1d35647a-7860-4bec-b94d-f4829c0e0016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:38:56.026912 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 682/1345] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:38:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:38:56.063327 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40ef9f-40ac-4325-8072-f0dd5dac913b None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:38:56.075013 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40ef9f-40ac-4325-8072-f0dd5dac913b None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:38:56.078606 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4c28c-be8a-403c-b728-607f7ba877d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74924b56be0243eda3144664dd01cc13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5768a93e754372808fc69f898cc853', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:38:56.079257 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4c28c-be8a-403c-b728-607f7ba877d5 service neutron] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:38:56.079579 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4c28c-be8a-403c-b728-607f7ba877d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:38:56.079860 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4c28c-be8a-403c-b728-607f7ba877d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:38:56.089994 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4c28c-be8a-403c-b728-607f7ba877d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:38:56.091451 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4c28c-be8a-403c-b728-607f7ba877d5 service neutron] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:38:56.101140 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 664/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:38:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:39:00.549530 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e227034-341a-4ae7-ae84-cd8aa9c14dea None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:00.550026 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e227034-341a-4ae7-ae84-cd8aa9c14dea None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:00.550304 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e227034-341a-4ae7-ae84-cd8aa9c14dea None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:00.551505 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 683/1347] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:39:00.557202 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87221d0-35cf-4738-95de-a84193d4d286 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:00.557845 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87221d0-35cf-4738-95de-a84193d4d286 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:00.557845 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87221d0-35cf-4738-95de-a84193d4d286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:00.576354 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-c87221d0-35cf-4738-95de-a84193d4d286 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:39:00.577603 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-c87221d0-35cf-4738-95de-a84193d4d286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:39:00.585844 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 665/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:39:00.625480 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e227034-341a-4ae7-ae84-cd8aa9c14dea None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:39:00.627438 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-9e227034-341a-4ae7-ae84-cd8aa9c14dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:39:00.640614 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e227034-341a-4ae7-ae84-cd8aa9c14dea None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:39:00.644323 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006989b9-c34a-4875-a8a9-a2422f555e7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74924b56be0243eda3144664dd01cc13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5768a93e754372808fc69f898cc853', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:39:00.644972 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006989b9-c34a-4875-a8a9-a2422f555e7c service neutron] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:00.645261 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006989b9-c34a-4875-a8a9-a2422f555e7c service neutron] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:00.645582 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006989b9-c34a-4875-a8a9-a2422f555e7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:00.655357 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006989b9-c34a-4875-a8a9-a2422f555e7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:39:00.656800 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006989b9-c34a-4875-a8a9-a2422f555e7c service neutron] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:39:00.666827 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 684/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:39:06.379518 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67f1e2-b8d3-4d6e-aae0-4da36cf98ea8 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:06.379952 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67f1e2-b8d3-4d6e-aae0-4da36cf98ea8 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:06.380077 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67f1e2-b8d3-4d6e-aae0-4da36cf98ea8 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:06.381858 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 666/1350] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 9 15:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:39:06.388001 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c63d27-ecb8-4372-aa41-49b1bbc21f57 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:06.388452 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c63d27-ecb8-4372-aa41-49b1bbc21f57 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:06.388652 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c63d27-ecb8-4372-aa41-49b1bbc21f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:06.508415 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-94c63d27-ecb8-4372-aa41-49b1bbc21f57 None None] MFA Rules not processed for user `3d51a903276d400793c4ef18d5b043cb`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:39:06.510623 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-94c63d27-ecb8-4372-aa41-49b1bbc21f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:39:06.635417 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 685/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 9 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:39:11.482393 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33d77b-f903-49bf-b240-5c725c5cc159 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:11.482944 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33d77b-f903-49bf-b240-5c725c5cc159 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:11.482944 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33d77b-f903-49bf-b240-5c725c5cc159 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:11.484607 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 667/1352] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 9 15:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:39:11.490254 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec904f3-e7a2-488a-aff4-6d5f23cb8883 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:11.491234 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec904f3-e7a2-488a-aff4-6d5f23cb8883 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:11.491757 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec904f3-e7a2-488a-aff4-6d5f23cb8883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:11.511856 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-8ec904f3-e7a2-488a-aff4-6d5f23cb8883 None None] MFA Rules not processed for user `3d51a903276d400793c4ef18d5b043cb`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:39:11.513080 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-8ec904f3-e7a2-488a-aff4-6d5f23cb8883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:39:11.528211 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 686/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 9 15:39:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:39:12.921394 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a6d68-0459-4c6e-a4c1-783d50285ebd None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:12.921926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a6d68-0459-4c6e-a4c1-783d50285ebd None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:12.921926 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a6d68-0459-4c6e-a4c1-783d50285ebd None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:12.923405 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 668/1354] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 9 15:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:39:12.928607 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcef03-24b2-41e0-a1da-27e1da3230af None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:12.929042 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcef03-24b2-41e0-a1da-27e1da3230af None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:12.929248 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcef03-24b2-41e0-a1da-27e1da3230af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:12.948733 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-a1dcef03-24b2-41e0-a1da-27e1da3230af None None] MFA Rules not processed for user `3d51a903276d400793c4ef18d5b043cb`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:39:12.949990 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-a1dcef03-24b2-41e0-a1da-27e1da3230af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:39:12.958869 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 687/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 9 15:39:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:39:16.973638 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d19686-b496-4777-b440-240dc5417e35 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:16.974191 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d19686-b496-4777-b440-240dc5417e35 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:16.974191 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d19686-b496-4777-b440-240dc5417e35 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:16.975729 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 669/1356] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:39:16.982216 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3ac7c-daed-48c8-a62d-36ffd1e803a8 None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:16.982769 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3ac7c-daed-48c8-a62d-36ffd1e803a8 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:16.983174 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3ac7c-daed-48c8-a62d-36ffd1e803a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:17.003244 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-dcd3ac7c-daed-48c8-a62d-36ffd1e803a8 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:39:17.004679 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-dcd3ac7c-daed-48c8-a62d-36ffd1e803a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:39:17.020483 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 688/1357] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:39:17.062422 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cde55-cb81-44af-bde1-227a6c71d759 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:17.062910 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cde55-cb81-44af-bde1-227a6c71d759 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:17.063263 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cde55-cb81-44af-bde1-227a6c71d759 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:17.064828 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 670/1358] 10.222.0.48 () {54 vars in 961 bytes} [Mon May 9 15:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:39:17.070194 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5553d4-f866-4f26-bd2d-926e7569d33e None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:17.070486 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5553d4-f866-4f26-bd2d-926e7569d33e None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:17.070765 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5553d4-f866-4f26-bd2d-926e7569d33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:17.122196 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-3a5553d4-f866-4f26-bd2d-926e7569d33e None None] MFA Rules not processed for user `d398283fc99c4bfe83170ad3d1538f38`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:39:17.123654 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-3a5553d4-f866-4f26-bd2d-926e7569d33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:39:17.211302 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 689/1359] 10.222.0.48 () {58 vars in 1058 bytes} [Mon May 9 15:39:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:39:17.219861 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cde55-cb81-44af-bde1-227a6c71d759 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:39:17.234864 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cde55-cb81-44af-bde1-227a6c71d759 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:39:17.240184 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adbeae-b237-4536-943a-33e2379f7044 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd398283fc99c4bfe83170ad3d1538f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5768a93e754372808fc69f898cc853', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:39:17.240821 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adbeae-b237-4536-943a-33e2379f7044 service nova] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:17.241104 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adbeae-b237-4536-943a-33e2379f7044 service nova] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:17.241398 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adbeae-b237-4536-943a-33e2379f7044 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:17.250267 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65adbeae-b237-4536-943a-33e2379f7044 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:39:17.251873 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65adbeae-b237-4536-943a-33e2379f7044 service nova] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:39:17.262068 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 671/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:39:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:39:19.760569 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8d56b-f138-4055-a700-7b02756554d0 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:19.761085 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8d56b-f138-4055-a700-7b02756554d0 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:19.761199 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8d56b-f138-4055-a700-7b02756554d0 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:19.762648 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 690/1361] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:39:19.768298 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d267f1-e0d4-4463-aff8-a3c8fb02dcda None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:19.768780 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d267f1-e0d4-4463-aff8-a3c8fb02dcda None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:19.768883 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d267f1-e0d4-4463-aff8-a3c8fb02dcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:19.787981 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-15d267f1-e0d4-4463-aff8-a3c8fb02dcda None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:39:19.789200 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-15d267f1-e0d4-4463-aff8-a3c8fb02dcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:39:19.798277 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 672/1362] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:39:19.842900 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8d56b-f138-4055-a700-7b02756554d0 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:39:19.858817 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8d56b-f138-4055-a700-7b02756554d0 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:39:19.866942 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98267c3-4b34-48d4-a435-9f7d9ec3dc80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd398283fc99c4bfe83170ad3d1538f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5768a93e754372808fc69f898cc853', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:39:19.867597 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98267c3-4b34-48d4-a435-9f7d9ec3dc80 service nova] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:19.867884 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98267c3-4b34-48d4-a435-9f7d9ec3dc80 service nova] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:19.868159 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98267c3-4b34-48d4-a435-9f7d9ec3dc80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:19.878109 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98267c3-4b34-48d4-a435-9f7d9ec3dc80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:39:19.879662 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98267c3-4b34-48d4-a435-9f7d9ec3dc80 service nova] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:39:19.890058 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 691/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:39:22.504835 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0963a7-c466-4b29-835e-8b2f72e421f1 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:22.505740 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0963a7-c466-4b29-835e-8b2f72e421f1 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:22.506020 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0963a7-c466-4b29-835e-8b2f72e421f1 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:22.507413 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 673/1364] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:39:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:39:22.513049 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd5acb-ecea-4e1d-9d49-7372dfb9336e None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:22.513613 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd5acb-ecea-4e1d-9d49-7372dfb9336e None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:22.513613 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd5acb-ecea-4e1d-9d49-7372dfb9336e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:22.533755 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-f3cd5acb-ecea-4e1d-9d49-7372dfb9336e None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:39:22.535166 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-f3cd5acb-ecea-4e1d-9d49-7372dfb9336e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:39:22.544463 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 692/1365] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:39:22.591798 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9c82c-f1a6-4c32-94f3-d747930ea390 None None] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:22.592132 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9c82c-f1a6-4c32-94f3-d747930ea390 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:22.592344 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9c82c-f1a6-4c32-94f3-d747930ea390 None None] PATH_INFO: `/` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:22.594064 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 674/1366] 10.222.0.48 () {54 vars in 961 bytes} [Mon May 9 15:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:39:22.602273 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5997a3-c1d2-48e1-b93a-fdb7796f1e4d None None] REQUEST_METHOD: `POST` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:22.602560 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5997a3-c1d2-48e1-b93a-fdb7796f1e4d None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:22.603276 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5997a3-c1d2-48e1-b93a-fdb7796f1e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:22.628957 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.auth.core [None req-2c5997a3-c1d2-48e1-b93a-fdb7796f1e4d None None] MFA Rules not processed for user `d398283fc99c4bfe83170ad3d1538f38`. Rule list: `[]` (Enabled: `True`). {{(pid=212999) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:39:22.630488 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.fernet_utils [None req-2c5997a3-c1d2-48e1-b93a-fdb7796f1e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212999) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:39:22.649722 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 693/1367] 10.222.0.48 () {58 vars in 1058 bytes} [Mon May 9 15:39:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:39:22.654044 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9c82c-f1a6-4c32-94f3-d747930ea390 None None] Authenticating user token {{(pid=212998) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:39:22.669295 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9c82c-f1a6-4c32-94f3-d747930ea390 None None] Validating token access rules against request {{(pid=212998) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:39:22.674812 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248483b5-079d-46df-bf25-9e6f8f35e0bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd398283fc99c4bfe83170ad3d1538f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5768a93e754372808fc69f898cc853', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212998) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:39:22.675548 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248483b5-079d-46df-bf25-9e6f8f35e0bd service nova] REQUEST_METHOD: `GET` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:22.675901 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248483b5-079d-46df-bf25-9e6f8f35e0bd service nova] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:22.676265 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248483b5-079d-46df-bf25-9e6f8f35e0bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:22.685405 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248483b5-079d-46df-bf25-9e6f8f35e0bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:39:22.687077 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248483b5-079d-46df-bf25-9e6f8f35e0bd service nova] RBAC: Authorization granted {{(pid=212998) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:39:22.697085 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 675/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:39:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:39:23.579518 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d432d1-1f66-48c5-9674-14a666ee5ebf None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:23.580127 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d432d1-1f66-48c5-9674-14a666ee5ebf None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:23.580127 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d432d1-1f66-48c5-9674-14a666ee5ebf None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:23.581654 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 694/1369] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:39:23.588651 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81098a2-a51f-4131-9c78-9aee70f4e931 None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:23.589198 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81098a2-a51f-4131-9c78-9aee70f4e931 None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:23.589317 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81098a2-a51f-4131-9c78-9aee70f4e931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:23.609259 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-a81098a2-a51f-4131-9c78-9aee70f4e931 None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:39:23.610545 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-a81098a2-a51f-4131-9c78-9aee70f4e931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:39:23.628679 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 676/1370] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:39:25.066537 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f1dde-1fde-47f2-a00f-c01c05715633 None None] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:25.067183 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f1dde-1fde-47f2-a00f-c01c05715633 None None] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:25.067183 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f1dde-1fde-47f2-a00f-c01c05715633 None None] PATH_INFO: `/` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:25.068545 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 695/1371] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:39:25.074889 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6e7b7-788a-4a6c-b22a-66a8bb08a9df None None] REQUEST_METHOD: `POST` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:25.075378 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6e7b7-788a-4a6c-b22a-66a8bb08a9df None None] SCRIPT_NAME: `/identity` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:25.075488 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6e7b7-788a-4a6c-b22a-66a8bb08a9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=212998) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:25.093791 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.auth.core [None req-e7b6e7b7-788a-4a6c-b22a-66a8bb08a9df None None] MFA Rules not processed for user `7982ad69f6614806bd35b21cb21af8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=212998) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:39:25.094997 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: DEBUG keystone.common.fernet_utils [None req-e7b6e7b7-788a-4a6c-b22a-66a8bb08a9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=212998) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:39:25.103075 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: [pid: 212998|app: 0|req: 677/1372] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:39:25.147322 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f1dde-1fde-47f2-a00f-c01c05715633 None None] Authenticating user token {{(pid=212999) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:39:25.163833 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f1dde-1fde-47f2-a00f-c01c05715633 None None] Validating token access rules against request {{(pid=212999) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:39:25.169398 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7955e0-fea9-48ad-8abc-63db857836b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd398283fc99c4bfe83170ad3d1538f38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db5768a93e754372808fc69f898cc853', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=212999) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:39:25.170045 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7955e0-fea9-48ad-8abc-63db857836b5 service nova] REQUEST_METHOD: `GET` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:39:25.170332 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7955e0-fea9-48ad-8abc-63db857836b5 service nova] SCRIPT_NAME: `/identity` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:39:25.170605 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7955e0-fea9-48ad-8abc-63db857836b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=212999) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:39:25.178994 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7955e0-fea9-48ad-8abc-63db857836b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:39:25.180573 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7955e0-fea9-48ad-8abc-63db857836b5 service nova] RBAC: Authorization granted {{(pid=212999) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:39:25.190631 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: [pid: 212999|app: 0|req: 696/1373] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:39:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:39:47.090692 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: Mon May 9 15:39:47 2022 - graceful shutdown triggered... May 09 15:39:47.091168 dv-cinder-835881-7-iscsi devstack@keystone.service[212999]: Gracefully killing worker 2 (pid: 212999)... May 09 15:39:47.091535 dv-cinder-835881-7-iscsi devstack@keystone.service[212998]: Gracefully killing worker 1 (pid: 212998)... May 09 15:39:47.094153 dv-cinder-835881-7-iscsi systemd[1]: Stopping Devstack devstack@keystone.service... May 09 15:39:48.091834 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: worker 1 buried after 1 seconds May 09 15:39:48.091834 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: worker 2 buried after 1 seconds May 09 15:39:48.091834 dv-cinder-835881-7-iscsi devstack@keystone.service[212990]: goodbye to uWSGI. May 09 15:39:48.093476 dv-cinder-835881-7-iscsi systemd[1]: devstack@keystone.service: Succeeded. May 09 15:39:48.094024 dv-cinder-835881-7-iscsi systemd[1]: Stopped Devstack devstack@keystone.service. May 09 15:45:26.041342 dv-cinder-835881-7-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 09 15:45:26.050644 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 09 15:45:26.052626 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 9 15:45:26 2022] *** May 09 15:45:26.052626 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 09 15:45:26.052626 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 09 15:45:26.052626 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: nodename: dv-cinder-835881-7-iscsi May 09 15:45:26.052626 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: machine: x86_64 May 09 15:45:26.052626 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: clock source: unix May 09 15:45:26.052626 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: pcre jit disabled May 09 15:45:26.052626 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: detected number of CPU cores: 4 May 09 15:45:26.052626 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: current working directory: / May 09 15:45:26.052626 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: detected binary path: /usr/bin/uwsgi-core May 09 15:45:26.052626 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: your processes number limit is 47680 May 09 15:45:26.052626 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: your memory page size is 4096 bytes May 09 15:45:26.052626 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: detected max file descriptor number: 2048 May 09 15:45:26.053768 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: lock engine: pthread robust mutexes May 09 15:45:26.053768 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: thunder lock: enabled May 09 15:45:26.053768 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 09 15:45:26.053768 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 09 15:45:26.098669 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: Python main interpreter initialized at 0x5596fca639c0 May 09 15:45:26.098669 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: python threads support enabled May 09 15:45:26.098669 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: your server socket listen backlog is limited to 100 connections May 09 15:45:26.098669 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: your mercy for graceful operations on workers is 90 seconds May 09 15:45:26.099134 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: mapped 403077 bytes (393 KB) for 2 cores May 09 15:45:26.099134 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: *** Operational MODE: preforking *** May 09 15:45:26.099363 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: *** uWSGI is running in multiple interpreter mode *** May 09 15:45:26.099363 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: spawned uWSGI master process (pid: 276028) May 09 15:45:26.099575 dv-cinder-835881-7-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 09 15:45:26.101279 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: spawned uWSGI worker 1 (pid: 276029, cores: 1) May 09 15:45:26.101279 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: spawned uWSGI worker 2 (pid: 276030, cores: 1) May 09 15:45:26.101279 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 09 15:45:31.983368 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:45:31.983368 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: from cryptography.utils import int_from_bytes May 09 15:45:31.984297 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:45:31.984297 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: from cryptography.utils import int_from_bytes May 09 15:45:31.985828 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:45:31.985828 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: from cryptography.utils import int_from_bytes May 09 15:45:31.986185 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 15:45:31.986185 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: from cryptography.utils import int_from_bytes May 09 15:45:32.039242 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 15:45:32.039474 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 15:45:32.039703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 15:45:32.039834 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] command line args: [] {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 15:45:32.039919 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 15:45:32.039998 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 15:45:32.040176 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] command line args: [] {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 15:45:32.040290 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ================================================================================ {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 15:45:32.040373 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 15:45:32.040450 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] admin_token = **** {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.040527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ================================================================================ {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 15:45:32.040611 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] config_dir = [] {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.040690 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] admin_token = **** {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.040766 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.041052 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] config_source = [] {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.041162 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] config_dir = [] {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.041247 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] debug = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.041332 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.041332 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] config_source = [] {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.041521 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.042840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] debug = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.042840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.042840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.042840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] insecure_debug = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.042840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.042840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.042840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] list_limit = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.043422 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] log_config_append = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.043422 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.043422 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] log_dir = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.043641 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.043740 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] log_file = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.043818 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] insecure_debug = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.043895 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.043895 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.044053 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.044140 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.044463 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.044463 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.044640 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.044721 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.044893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.045063 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] list_limit = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.045230 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.045421 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] log_config_append = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.045603 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.045603 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.045905 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.046058 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.046214 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] log_dir = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.046367 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.046525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] log_file = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.046683 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.046683 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] notification_format = cadf {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.047568 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.047733 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.047888 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.048047 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.048047 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] publish_errors = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.048341 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.048493 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.048650 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.048650 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.048954 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.048954 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.049256 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.049432 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.049601 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.049754 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.049900 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] standard_threads = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.049900 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] strict_password_check = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.050198 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.050351 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.050513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.050666 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] use_eventlog = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.050822 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.050974 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] use_journal = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.050974 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] use_json = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.051260 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.051417 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] use_stderr = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.051569 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.051729 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] use_syslog = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.051729 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] watch_log_file = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.052037 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.052200 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.052364 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] notification_format = cadf {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.052516 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.052684 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.052838 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.052838 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.053136 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.053296 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.053472 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] publish_errors = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.053627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.053781 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.053934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.054088 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.054088 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.054382 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.054533 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.054684 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.054837 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.054997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.054997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.055287 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] standard_threads = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.055450 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.055595 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] strict_password_check = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.055746 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.055905 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.056056 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.056218 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] use_eventlog = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.056218 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] use_journal = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.056615 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.056775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] use_json = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.056944 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.057091 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] use_stderr = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.057246 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.057440 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] use_syslog = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.057440 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] watch_log_file = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 15:45:32.057743 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.057743 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.058041 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.058193 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.058351 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.058515 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.058667 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.058833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.058988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.059140 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.059298 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.059450 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.059602 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.059760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.059913 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.060065 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.060211 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.060354 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.060499 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.060676 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.060823 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.060995 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.061142 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.061293 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.061507 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.061663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.061816 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.061969 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.062115 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.062260 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.062425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.063199 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.063440 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.063607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.063761 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.063915 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.064070 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.064225 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.064372 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.064523 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.064696 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.064871 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.064871 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.065170 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.065323 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.065511 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.065745 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.065938 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.066098 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.066272 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.066491 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.066700 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.066912 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.067126 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.067367 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.067591 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.067806 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.068018 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.068230 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.068460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.068680 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.068890 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.069098 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.069098 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.069560 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.069787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.069787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.070373 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.070373 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.070896 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.071129 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.071386 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.071661 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.071898 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.072062 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.072062 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.072361 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.072524 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.072686 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.072833 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.072994 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.073140 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.073302 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.073540 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.073540 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.073983 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.074222 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.074467 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.074717 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.074925 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.075083 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.075230 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.075385 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.075552 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.075698 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.075850 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.076002 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.076149 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.076149 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.076464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.076617 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.076771 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.076923 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.077076 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.077244 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.077427 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.077597 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.077745 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.077911 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.078210 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.078425 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.078605 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.078772 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.078927 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.078927 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.079210 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.enabled = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.079363 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.079515 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.079666 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.079816 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.079968 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.080129 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.080288 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.080433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.080583 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.080728 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.080883 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.081046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.081205 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.081356 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.081538 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.081698 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.081851 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.081997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.082148 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.082300 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.082452 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.082606 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.082606 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.082908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.083073 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.083225 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.083376 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.083534 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.083687 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.083832 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.083983 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.084135 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.084287 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.084445 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.084592 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.084736 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.084886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.085042 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.enabled = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.085196 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.085354 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.085591 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.085739 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.085883 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.086058 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.086207 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.086361 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.086508 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.086659 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.086811 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.086957 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.087128 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.087295 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.087448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.087601 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.087758 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.087903 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.088048 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] auth.external = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.088202 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.088357 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] auth.mapped = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.088509 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.088654 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.088817 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.088963 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.089118 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.089286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] auth.password = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.089465 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.089623 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] auth.token = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.089623 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.089930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.090188 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] catalog.caching = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.090188 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.090676 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.090927 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.090927 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.091361 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.091612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.091830 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.092088 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.092338 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.092549 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] credential.caching = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.092784 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.093005 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] credential.driver = sql {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.093236 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.093507 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.093731 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.093938 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.094154 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.094360 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.094581 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.094806 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.095013 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.095243 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.095450 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.095660 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.095880 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.096093 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.096314 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.096537 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.096759 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] auth.external = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.096970 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.097200 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] auth.mapped = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.097435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.097673 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.097882 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.098122 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.098122 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] auth.password = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.098539 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.098744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] auth.token = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.098957 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.099165 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.099377 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.099604 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] catalog.caching = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.099831 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] federation.caching = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.100057 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.100262 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.100484 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.100696 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] federation.driver = sql {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.100901 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.101247 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.101247 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.101666 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.101882 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.102109 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.102345 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.102565 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] credential.caching = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.102770 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.102988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] credential.driver = sql {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.103203 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.103417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.103641 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.103854 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.104095 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.104306 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.104519 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.104757 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.104976 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] identity.caching = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.105185 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.105481 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.105704 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.105925 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.105925 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.106324 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.106539 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.106753 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.106968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] identity.driver = sql {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.107203 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.107411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.107633 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.107861 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.108064 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.108278 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.108483 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.108709 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.108933 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.109165 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.109884 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.110109 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.110315 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] federation.caching = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.110556 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.110774 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.110989 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.111194 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] federation.driver = sql {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.111410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.111634 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.111848 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.112065 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.112279 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.112491 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.112750 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.112959 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.113165 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.113460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.113690 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.113910 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.114116 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.114116 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.114524 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.114744 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.114955 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.115158 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.115384 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.115592 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.115808 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] identity.caching = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.116025 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.116229 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.116460 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.116675 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.116891 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.117136 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.117352 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.117585 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.117793 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.117998 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] identity.driver = sql {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.118214 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.118214 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.118214 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.118841 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.119067 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.119067 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.119490 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.119722 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.119949 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.120173 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.password = **** {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.120407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.120631 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.120850 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.121102 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.121513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.121752 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.121981 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.122198 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.122198 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.122649 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.122869 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.123097 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.123339 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.123577 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.123807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.124041 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.124272 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.124473 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.124651 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.125701 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.125887 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.126056 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.126224 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.126376 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.126527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.126527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.126828 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.126994 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.user = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.127160 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.127313 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.127472 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.127632 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.127791 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.127956 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.128116 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.128270 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.128470 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.128642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.128795 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.128958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.129111 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.129264 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.129446 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.129622 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.129787 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.129960 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.130119 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.130280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.130432 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.130594 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.130757 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.130921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.131074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.131268 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.131492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.131716 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.131930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.password = **** {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.132159 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.132375 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.132588 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.132819 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.133029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.133241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.133511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.133756 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.133978 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.134189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.134409 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.134624 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.134854 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.135078 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.135308 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.135529 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.135743 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.135974 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.136202 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.136431 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.136691 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.137021 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.137259 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.137580 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.137828 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] policy.driver = sql {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.138061 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.138310 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.138478 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.138631 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.138803 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.user = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.138973 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.139142 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.139301 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] receipt.caching = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.139477 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.139631 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.139793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.139960 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.140119 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.140281 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.140433 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.140618 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.140820 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.140985 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.141190 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.141389 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] resource.caching = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.141560 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.141721 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.141965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.142121 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] resource.driver = sql {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.142279 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.142438 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.142598 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.142766 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.142929 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.143089 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.143248 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.143401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] revoke.caching = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.143553 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.143711 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.143711 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.144074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.144296 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] role.cache_time = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.144521 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.144735 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] role.caching = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.144953 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.145186 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] role.driver = sql {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.145186 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] role.list_limit = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.145640 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.145863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.145863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.146280 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.146509 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.146730 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.146942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.147179 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.147399 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.147630 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.147860 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.148079 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.148299 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.148533 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.148744 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.148963 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.149199 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.149492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.149731 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.149951 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] policy.driver = sql {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.150191 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.150450 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.150696 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.150932 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.151167 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.151417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.151417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] receipt.caching = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.151740 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.151906 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.152059 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.152210 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.152379 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.152539 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.152700 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.152881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.153044 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.153203 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.153383 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.153546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] resource.caching = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.153717 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.153877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.154036 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.154189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] resource.driver = sql {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.154379 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.154547 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.154719 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.154885 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.155049 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.155217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.155376 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.155546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] revoke.caching = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.155714 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.155874 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.156026 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.156194 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.156383 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.156539 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] role.cache_time = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.156704 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.156704 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.157014 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] role.caching = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.157232 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.157578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] role.driver = sql {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.157801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] token.cache_time = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.158045 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] role.list_limit = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.158280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] token.caching = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.158493 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.158709 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.158921 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.159150 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] token.provider = fernet {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.159373 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.159586 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.159815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.160037 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.160262 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.160497 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.160723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.160935 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.161146 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.161357 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.161625 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.161858 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.162086 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.162305 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] trust.driver = sql {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.162519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.162737 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.162949 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.163160 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.163404 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.163635 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.163861 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.164095 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.164095 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.164535 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.164732 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.164895 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.165060 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.165214 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.165390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.165564 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.165733 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] database.connection = **** {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.165997 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.166203 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.166391 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.166548 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.166706 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.166860 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.167020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.167197 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.167197 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.167550 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.167550 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.167862 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.168023 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.168177 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.168349 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.168509 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.168675 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.168835 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.168993 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.169148 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.169148 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.169489 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.169489 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.169798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.169957 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.170135 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.170365 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.170365 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] token.cache_time = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.170793 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.171022 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] token.caching = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.171254 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.171476 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.171704 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.172426 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] token.provider = fernet {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.172426 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.172871 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.173083 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.173306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.173639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.173861 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=276029) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 15:45:32.174075 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.174075 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.174075 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.174075 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] trust.driver = sql {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.174075 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.174075 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.174075 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.174075 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.174075 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.175896 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.175896 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.175896 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.175896 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] database.connection = **** {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.175896 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.175896 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.175896 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.175896 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.175896 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.177947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.177947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.177947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.177947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.177947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.177947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.177947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.177947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.177947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.179571 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.179571 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.179571 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.179571 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 15:45:32.179571 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=276030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 15:45:32.180295 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.180295 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.180295 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.180740 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.180740 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.180740 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.180740 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.181337 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.205049 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.205311 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.206125 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.206368 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.259314 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.261008 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.315289 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.315902 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.320343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.320624 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.383111 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.383470 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.383662 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.383830 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.383994 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.384158 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.384389 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.384634 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.384868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.385097 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.385325 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.385583 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.407832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.408173 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.408343 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.408505 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.408665 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.408826 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.409006 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.409170 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.409342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.409551 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.409551 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.409880 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.410041 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.410202 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.421160 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.421581 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.436461 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.436802 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.436974 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.437154 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.437318 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.438130 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.438325 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.438325 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.438637 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.438798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.438798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=276029) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.440199 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.440461 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.440689 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=276030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 09 15:45:32.457810 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.458180 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:45:32.458373 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.458373 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:45:32.458702 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.458702 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:45:32.459029 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.459194 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.459373 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 09 15:45:32.459538 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.459700 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.459880 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.460038 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.460197 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.460402 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.460402 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.472053 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.472419 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.472584 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.472759 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.472922 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.473096 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.473286 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.473500 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.481445 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=276029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.481693 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=276030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.485309 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=276029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.485611 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.486055 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=276030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.486227 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.486409 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.486646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.486646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.486993 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.487154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.487322 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.487494 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.487664 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.487836 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.487997 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.488164 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.488337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.488498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.488659 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.488829 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.488999 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.488999 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.488999 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.515755 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.517386 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=276029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.517598 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.517725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.519263 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=276030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.519552 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.525009 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=276030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.525297 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.525612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.528460 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=276029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.528957 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.529301 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.534196 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=276030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.534497 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.537429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=276029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.537727 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.539244 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=276030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.539534 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.539823 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.540111 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.540395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.540678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.540953 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.541236 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.542471 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=276029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.542767 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.543056 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.543342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.543621 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.543898 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.544173 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.544472 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.561098 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.561405 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.564146 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.564441 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.566465 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=276030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.569050 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=276029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.570171 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.570476 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.572714 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.573014 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.575514 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=276030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.578035 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=276029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.579587 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=276030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.581797 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=276029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.583405 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.583706 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.583998 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.584290 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.584575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.584863 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.585556 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.585864 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.586152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.586439 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.586749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.587022 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.605153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=276030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.605576 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.605859 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.606134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.606842 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=276029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.607238 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.607517 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.607788 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.615126 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.616282 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.616872 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.617158 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.618054 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.618339 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.622711 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=276030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.622711 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.622711 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.622711 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.623385 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=276029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.623551 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.623725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.623725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.623725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.623725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.635809 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=276030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.636104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.636397 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.636507 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=276029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.636719 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.636826 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.637036 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.637143 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.637241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.637329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.637653 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.637767 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.637850 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.638116 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.656917 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=276029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.657117 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=276030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.660291 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=276029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.660606 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=276030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.663848 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.664238 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.665502 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.665898 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.667150 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=276029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.667447 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.667554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=276030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.667761 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.667873 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.668116 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.675551 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.676988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.677192 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=276029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.678634 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=276030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.680471 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.680769 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.681071 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.681351 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.681939 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.682237 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.682530 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.682817 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.691111 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=276029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.691416 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.691705 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.692621 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=276030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.692919 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.693207 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.699910 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=276029) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.700197 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.700480 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.700761 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.701037 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.701246 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=276030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 09 15:45:32.701458 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.701628 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.701790 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.701945 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.702113 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.702281 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.702442 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.702614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.702787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.702787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.703590 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.703590 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.703960 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.703960 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.704283 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.704453 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=276029) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.704630 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.704793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.704997 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.705294 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.705600 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.705883 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=276030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 09 15:45:32.744039 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5596fca639c0 pid: 276029 (default app) May 09 15:45:32.746461 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5596fca639c0 pid: 276030 (default app) May 09 15:45:32.747526 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba49d0-4024-4618-b542-c2252c3b0157 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:32.747832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba49d0-4024-4618-b542-c2252c3b0157 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:32.748125 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba49d0-4024-4618-b542-c2252c3b0157 None None] PATH_INFO: `/v3` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:32.752843 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Mon May 9 15:45:32 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:40.862978 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5811c0b-a721-471d-b69d-1abbca1ea60f None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:40.863583 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5811c0b-a721-471d-b69d-1abbca1ea60f None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:40.863913 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5811c0b-a721-471d-b69d-1abbca1ea60f None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:40.868211 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:45:40 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:45:40.873843 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372700c-6e2e-417d-b44e-3ce5a834624f None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:40.874282 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372700c-6e2e-417d-b44e-3ce5a834624f None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:40.874394 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372700c-6e2e-417d-b44e-3ce5a834624f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:40.906866 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG oslo_db.sqlalchemy.engines [None req-d372700c-6e2e-417d-b44e-3ce5a834624f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=276029) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 15:45:41.094117 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG passlib.handlers.bcrypt [None req-d372700c-6e2e-417d-b44e-3ce5a834624f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=276029) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 09 15:45:41.094635 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG passlib.handlers.bcrypt [None req-d372700c-6e2e-417d-b44e-3ce5a834624f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=276029) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 09 15:45:41.153184 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-d372700c-6e2e-417d-b44e-3ce5a834624f None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:45:41.154852 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-d372700c-6e2e-417d-b44e-3ce5a834624f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:45:41.280694 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:45:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 09 15:45:41.303370 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5811c0b-a721-471d-b69d-1abbca1ea60f None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:41.339050 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG oslo_db.sqlalchemy.engines [None req-c5811c0b-a721-471d-b69d-1abbca1ea60f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=276030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 15:45:41.469553 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5811c0b-a721-471d-b69d-1abbca1ea60f None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:41.473917 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b6664-ba88-4e22-bc19-224ec78fa157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd98726a0503446c8990ec97c6f98d1d8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:41.474581 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b6664-ba88-4e22-bc19-224ec78fa157 admin admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:41.474871 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b6664-ba88-4e22-bc19-224ec78fa157 admin admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:41.475154 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b6664-ba88-4e22-bc19-224ec78fa157 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:41.483332 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b6664-ba88-4e22-bc19-224ec78fa157 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:41.535028 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a82b6664-ba88-4e22-bc19-224ec78fa157 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 09 15:45:41.535282 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b6664-ba88-4e22-bc19-224ec78fa157 admin admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:41.545668 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Mon May 9 15:45:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 09 15:45:41.552303 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372700c-6e2e-417d-b44e-3ce5a834624f None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:41.566844 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372700c-6e2e-417d-b44e-3ce5a834624f None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:41.571338 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8939bed-7e21-470b-844b-aa93f0567c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd98726a0503446c8990ec97c6f98d1d8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:41.572455 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8939bed-7e21-470b-844b-aa93f0567c79 admin admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:41.572758 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8939bed-7e21-470b-844b-aa93f0567c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:41.573046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8939bed-7e21-470b-844b-aa93f0567c79 admin admin] PATH_INFO: `/v3/projects/d98726a0503446c8990ec97c6f98d1d8` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:41.574597 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8939bed-7e21-470b-844b-aa93f0567c79 admin admin] RBAC: Authorizing `identity:get_project(project_id=d98726a0503446c8990ec97c6f98d1d8)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:41.625555 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d8939bed-7e21-470b-844b-aa93f0567c79 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 09 15:45:41.626005 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8939bed-7e21-470b-844b-aa93f0567c79 admin admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:41.630779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Mon May 9 15:45:41 2022] GET /identity/v3/projects/d98726a0503446c8990ec97c6f98d1d8 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:43.894979 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ae361-ff74-43d1-8bdb-9f614cef2d3d None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:43.895520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ae361-ff74-43d1-8bdb-9f614cef2d3d None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:43.895520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ae361-ff74-43d1-8bdb-9f614cef2d3d None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:43.899689 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:45:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:45:43.905851 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491c9de-bd7f-4db5-8c5a-ca5e6b2fec6f None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:43.906607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491c9de-bd7f-4db5-8c5a-ca5e6b2fec6f None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:43.906607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491c9de-bd7f-4db5-8c5a-ca5e6b2fec6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:43.927414 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-c491c9de-bd7f-4db5-8c5a-ca5e6b2fec6f None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:45:43.929085 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-c491c9de-bd7f-4db5-8c5a-ca5e6b2fec6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:45:43.938406 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:45:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 09 15:45:43.962393 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ae361-ff74-43d1-8bdb-9f614cef2d3d None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:43.976244 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ae361-ff74-43d1-8bdb-9f614cef2d3d None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:43.980904 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943b3ea-4df3-4e56-bba8-d4d837c400f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd98726a0503446c8990ec97c6f98d1d8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:43.981587 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943b3ea-4df3-4e56-bba8-d4d837c400f4 admin admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:43.981880 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943b3ea-4df3-4e56-bba8-d4d837c400f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:43.982161 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943b3ea-4df3-4e56-bba8-d4d837c400f4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:43.991992 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943b3ea-4df3-4e56-bba8-d4d837c400f4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:43.994078 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943b3ea-4df3-4e56-bba8-d4d837c400f4 admin admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:44.005184 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Mon May 9 15:45:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 09 15:45:44.011298 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491c9de-bd7f-4db5-8c5a-ca5e6b2fec6f None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:44.021490 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491c9de-bd7f-4db5-8c5a-ca5e6b2fec6f None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:44.026361 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8670d88-c214-42e4-b05c-443e5d1a03d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd98726a0503446c8990ec97c6f98d1d8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:44.027246 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8670d88-c214-42e4-b05c-443e5d1a03d4 admin admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:44.027536 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8670d88-c214-42e4-b05c-443e5d1a03d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:44.027848 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8670d88-c214-42e4-b05c-443e5d1a03d4 admin admin] PATH_INFO: `/v3/users/d6c9373bbbf843ee901a91cc4e068dee` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:44.029285 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8670d88-c214-42e4-b05c-443e5d1a03d4 admin admin] RBAC: Authorizing `identity:get_user(user_id=d6c9373bbbf843ee901a91cc4e068dee)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:44.031941 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8670d88-c214-42e4-b05c-443e5d1a03d4 admin admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:44.033641 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Mon May 9 15:45:44 2022] GET /identity/v3/users/d6c9373bbbf843ee901a91cc4e068dee => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:45:46.410692 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743e8ca-bc4f-4ce5-af22-b3fd78975cbf None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:46.411263 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743e8ca-bc4f-4ce5-af22-b3fd78975cbf None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:46.411263 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743e8ca-bc4f-4ce5-af22-b3fd78975cbf None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:46.412617 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:45:46.418409 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c1443-94fb-43ac-865a-0aa736d06a77 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:46.418874 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c1443-94fb-43ac-865a-0aa736d06a77 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:46.418974 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c1443-94fb-43ac-865a-0aa736d06a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:46.446080 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617a4e4-40d3-4c37-97b9-7d72f69d1277 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:46.446376 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617a4e4-40d3-4c37-97b9-7d72f69d1277 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:46.446658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617a4e4-40d3-4c37-97b9-7d72f69d1277 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:46.448061 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:45:46.455185 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7770cf-cdfe-411f-9447-a86faa4e44c8 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:46.455481 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7770cf-cdfe-411f-9447-a86faa4e44c8 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:46.455770 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7770cf-cdfe-411f-9447-a86faa4e44c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:46.499109 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG passlib.handlers.bcrypt [None req-8e7770cf-cdfe-411f-9447-a86faa4e44c8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=276030) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 09 15:45:46.499671 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG passlib.handlers.bcrypt [None req-8e7770cf-cdfe-411f-9447-a86faa4e44c8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=276030) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 09 15:45:46.548046 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-8e7770cf-cdfe-411f-9447-a86faa4e44c8 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:45:46.549728 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-8e7770cf-cdfe-411f-9447-a86faa4e44c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:45:46.549960 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-8f6c1443-94fb-43ac-865a-0aa736d06a77 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:45:46.551159 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-8f6c1443-94fb-43ac-865a-0aa736d06a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:45:46.646108 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:45:46.662152 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:45:46.680400 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c1443-94fb-43ac-865a-0aa736d06a77 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:46.687471 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7770cf-cdfe-411f-9447-a86faa4e44c8 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:46.794932 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7770cf-cdfe-411f-9447-a86faa4e44c8 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:46.803687 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c1443-94fb-43ac-865a-0aa736d06a77 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:46.837909 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e0204-88bc-4d6f-b59f-b28d97b6096a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:46.838841 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e0204-88bc-4d6f-b59f-b28d97b6096a None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:46.839134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e0204-88bc-4d6f-b59f-b28d97b6096a None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:46.839417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e0204-88bc-4d6f-b59f-b28d97b6096a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:46.842205 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b15811-c600-4294-bf7a-1a4b363e48e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:46.843018 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b15811-c600-4294-bf7a-1a4b363e48e0 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:46.843875 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b15811-c600-4294-bf7a-1a4b363e48e0 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:46.844235 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b15811-c600-4294-bf7a-1a4b363e48e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:46.858675 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b15811-c600-4294-bf7a-1a4b363e48e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:45:46.872511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-37b15811-c600-4294-bf7a-1a4b363e48e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:45:46.872511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:46.872511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:46.872511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:46.872511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:46.872511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:46.872511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:46.872511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:46.872511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:46.872511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:46.872511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:46.872511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:46.872511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:45:46.872511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:45:46.872511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:45:46.872511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:45:46.875534 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:45:46.875534 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:45:46.875534 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:45:46.875534 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:45:46.875534 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:46.875534 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:46.875534 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:46.875534 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:46.875534 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:46.875534 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:46.875534 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:46.875534 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:45:46.875534 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:46.875534 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:46.875534 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:46.875534 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:46.877926 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:46.877926 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:46.877926 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:46.877926 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:46.877926 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:45:46.877926 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:45:46.877926 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:45:46.877926 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:45:46.877926 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:45:46.877926 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:45:46.877926 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:45:46.877926 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:45:46.877926 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:45:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:45:46.881193 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b15811-c600-4294-bf7a-1a4b363e48e0 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:46.925600 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e0204-88bc-4d6f-b59f-b28d97b6096a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:46.927114 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e0204-88bc-4d6f-b59f-b28d97b6096a None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:46.996883 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b15811-c600-4294-bf7a-1a4b363e48e0 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:47.043396 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 8/15] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:45:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:45:47.047890 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371af39-27a2-4eb5-912e-ea0cf6e75876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:47.048687 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371af39-27a2-4eb5-912e-ea0cf6e75876 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:47.048983 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371af39-27a2-4eb5-912e-ea0cf6e75876 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:47.049340 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371af39-27a2-4eb5-912e-ea0cf6e75876 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:47.049586 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e0204-88bc-4d6f-b59f-b28d97b6096a None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:47.050166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371af39-27a2-4eb5-912e-ea0cf6e75876 None admin] RBAC: Adding query filter params (name=admin) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:47.050511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371af39-27a2-4eb5-912e-ea0cf6e75876 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:47.051951 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371af39-27a2-4eb5-912e-ea0cf6e75876 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:47.066543 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 8/16] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:45:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:45:47.072722 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371af39-27a2-4eb5-912e-ea0cf6e75876 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:47.201462 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371af39-27a2-4eb5-912e-ea0cf6e75876 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:47.242162 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ec461-8510-478e-8281-cd00250021fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:47.243073 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ec461-8510-478e-8281-cd00250021fb None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:47.243363 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ec461-8510-478e-8281-cd00250021fb None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:47.243646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ec461-8510-478e-8281-cd00250021fb None admin] PATH_INFO: `/v3/users/d6c9373bbbf843ee901a91cc4e068dee` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:47.245037 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ec461-8510-478e-8281-cd00250021fb None admin] RBAC: Authorizing `identity:get_user(user_id=d6c9373bbbf843ee901a91cc4e068dee)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:47.246619 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ec461-8510-478e-8281-cd00250021fb None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:47.248613 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 9/17] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:45:47 2022] GET /identity/v3/users/d6c9373bbbf843ee901a91cc4e068dee => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:45:47.255263 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ec461-8510-478e-8281-cd00250021fb None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:47.285966 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e0204-88bc-4d6f-b59f-b28d97b6096a None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:47.332363 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596f838-771a-4d46-b294-abb26154f395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:47.333414 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596f838-771a-4d46-b294-abb26154f395 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:47.333789 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596f838-771a-4d46-b294-abb26154f395 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:47.334140 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596f838-771a-4d46-b294-abb26154f395 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:47.356063 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596f838-771a-4d46-b294-abb26154f395 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:47.357687 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596f838-771a-4d46-b294-abb26154f395 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:47.370660 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ec461-8510-478e-8281-cd00250021fb None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:47.381704 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-5596f838-771a-4d46-b294-abb26154f395 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:47.381704 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:47.381704 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:47.381704 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:47.381704 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:47.381704 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:47.381704 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:47.381704 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:47.381704 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:47.381704 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:47.381704 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:47.381704 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:47.381704 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:45:47.381704 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:45:47.381704 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:45:47.384047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:45:47.384047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:47.384047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:47.384047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:47.384047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:47.384047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:47.384047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:47.384047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:47.384047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:45:47.384047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:47.384047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:47.384047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:47.384047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:47.384047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:47.384047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:47.384047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:47.384047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:47.385075 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:45:47.385075 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:45:47.385075 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:47.385075 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:45:47.385075 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 9/18] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:45:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:45:47.389396 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596f838-771a-4d46-b294-abb26154f395 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:47.407066 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40e0e2-07be-4661-97c6-25eeb3158e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:47.407875 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40e0e2-07be-4661-97c6-25eeb3158e3a None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:47.408163 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40e0e2-07be-4661-97c6-25eeb3158e3a None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:47.408521 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40e0e2-07be-4661-97c6-25eeb3158e3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:47.409922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40e0e2-07be-4661-97c6-25eeb3158e3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:47.411328 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40e0e2-07be-4661-97c6-25eeb3158e3a None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:47.412967 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 10/19] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:45:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:45:47.418835 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40e0e2-07be-4661-97c6-25eeb3158e3a None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:47.517727 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596f838-771a-4d46-b294-abb26154f395 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:47.528103 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40e0e2-07be-4661-97c6-25eeb3158e3a None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:47.556028 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5794f-f482-45c4-b02b-d4a134b02d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:47.556910 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5794f-f482-45c4-b02b-d4a134b02d74 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:47.557250 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5794f-f482-45c4-b02b-d4a134b02d74 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:47.557622 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5794f-f482-45c4-b02b-d4a134b02d74 None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:47.558450 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5794f-f482-45c4-b02b-d4a134b02d74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:47.558839 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5794f-f482-45c4-b02b-d4a134b02d74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:47.560255 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5794f-f482-45c4-b02b-d4a134b02d74 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:47.564133 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46804b-e02b-44d0-9e95-bb02c629e2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:47.564953 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46804b-e02b-44d0-9e95-bb02c629e2dc None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:47.565241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46804b-e02b-44d0-9e95-bb02c629e2dc None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:47.565431 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46804b-e02b-44d0-9e95-bb02c629e2dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:47.566311 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46804b-e02b-44d0-9e95-bb02c629e2dc None admin] RBAC: Adding query filter params (role.id=2180d183afad443187521833c40ed8a1, scope.domain.id=default, user.id=d6c9373bbbf843ee901a91cc4e068dee) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:47.566572 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46804b-e02b-44d0-9e95-bb02c629e2dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:47.568051 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46804b-e02b-44d0-9e95-bb02c629e2dc None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:47.576400 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 11/20] 10.222.0.48 () {56 vars in 1322 bytes} [Mon May 9 15:45:47 2022] GET /identity/v3/role_assignments?user.id=d6c9373bbbf843ee901a91cc4e068dee&scope.domain.id=default&role.id=2180d183afad443187521833c40ed8a1 => generated 233 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:45:47.583957 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 10/21] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:45:50.753246 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92247f-76fe-42fb-b7cf-2f0e7ba5e20e None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:50.753862 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92247f-76fe-42fb-b7cf-2f0e7ba5e20e None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:50.753862 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92247f-76fe-42fb-b7cf-2f0e7ba5e20e None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:50.755429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 12/22] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:45:50.760959 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1f27f-6afa-4989-80af-cebfef7bba79 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:50.761507 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1f27f-6afa-4989-80af-cebfef7bba79 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:50.761598 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1f27f-6afa-4989-80af-cebfef7bba79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:50.790738 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-31d1f27f-6afa-4989-80af-cebfef7bba79 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:45:50.792075 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-31d1f27f-6afa-4989-80af-cebfef7bba79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:45:50.886870 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca97f42-9055-4804-812c-4f44618f88dc None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:50.887241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca97f42-9055-4804-812c-4f44618f88dc None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:50.887446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca97f42-9055-4804-812c-4f44618f88dc None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:50.888816 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 13/23] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:45:50.889937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 11/24] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:45:50.908062 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ebab7-29d6-486f-9902-a703660273b1 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:50.908389 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ebab7-29d6-486f-9902-a703660273b1 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:50.908642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ebab7-29d6-486f-9902-a703660273b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:50.933484 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-011ebab7-29d6-486f-9902-a703660273b1 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:45:50.933484 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-011ebab7-29d6-486f-9902-a703660273b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:45:50.941260 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1f27f-6afa-4989-80af-cebfef7bba79 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:51.052670 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 14/25] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:45:51.054378 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a8686-8813-40e0-a2a7-0720ed232fd3 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:51.054827 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a8686-8813-40e0-a2a7-0720ed232fd3 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:51.055286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a8686-8813-40e0-a2a7-0720ed232fd3 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:51.057100 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 15/26] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:45:51.066836 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebed2f-e2cf-4546-a4a6-8b7e890b2adf None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:51.067373 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebed2f-e2cf-4546-a4a6-8b7e890b2adf None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:51.067892 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebed2f-e2cf-4546-a4a6-8b7e890b2adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:51.094516 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-59ebed2f-e2cf-4546-a4a6-8b7e890b2adf None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:45:51.096799 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-59ebed2f-e2cf-4546-a4a6-8b7e890b2adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:45:51.101851 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1f27f-6afa-4989-80af-cebfef7bba79 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:51.151737 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343291e6-ef82-4ee1-be9a-6d192b0f7768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:51.152566 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343291e6-ef82-4ee1-be9a-6d192b0f7768 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:51.152861 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343291e6-ef82-4ee1-be9a-6d192b0f7768 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:51.153123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343291e6-ef82-4ee1-be9a-6d192b0f7768 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:51.173949 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343291e6-ef82-4ee1-be9a-6d192b0f7768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:51.176244 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343291e6-ef82-4ee1-be9a-6d192b0f7768 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:51.214627 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-343291e6-ef82-4ee1-be9a-6d192b0f7768 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:51.214627 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:51.214627 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:51.214627 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:51.214627 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:51.214627 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:51.214627 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:51.214627 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:51.214627 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:51.214627 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:51.214627 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:51.214627 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:51.214627 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:45:51.214627 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:45:51.214627 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:45:51.215644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:45:51.215644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:51.215644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:51.215644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:51.215644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:51.215644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:51.215644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:51.215644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:51.215644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:45:51.215644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:51.215644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:51.215644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:51.215644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:51.215644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:51.215644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:51.215644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:51.215644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:51.216636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:45:51.216636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:45:51.216636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:45:51.216636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:45:51.216636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 12/27] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:45:51.218897 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343291e6-ef82-4ee1-be9a-6d192b0f7768 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:51.227390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 16/28] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:45:51.228555 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebed2f-e2cf-4546-a4a6-8b7e890b2adf None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:51.424221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343291e6-ef82-4ee1-be9a-6d192b0f7768 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:51.450194 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebed2f-e2cf-4546-a4a6-8b7e890b2adf None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:51.495897 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33388c99-e8a2-43fd-a9d4-86adaf2410e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:51.497031 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33388c99-e8a2-43fd-a9d4-86adaf2410e1 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:51.498796 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33388c99-e8a2-43fd-a9d4-86adaf2410e1 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:51.503158 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33388c99-e8a2-43fd-a9d4-86adaf2410e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:51.519396 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33388c99-e8a2-43fd-a9d4-86adaf2410e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:45:51.535787 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-33388c99-e8a2-43fd-a9d4-86adaf2410e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:45:51.535787 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:51.535787 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:51.535787 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:51.535787 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:51.535787 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:51.535787 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:51.535787 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:51.535787 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:51.535787 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:51.535787 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:51.535787 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:51.535787 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:45:51.535787 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:45:51.535787 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:45:51.535787 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:45:51.537989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:45:51.537989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:45:51.537989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:45:51.537989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:45:51.537989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:51.537989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:51.537989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:51.537989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:51.537989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:51.537989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:51.537989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:51.537989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:45:51.537989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:51.537989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:51.537989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:51.537989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:51.539179 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:51.539179 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:51.539179 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:51.539179 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:51.539179 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:45:51.539179 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:45:51.539179 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:45:51.539179 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:45:51.539179 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:45:51.539179 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:45:51.539179 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:45:51.539179 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:45:51.542236 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 13/29] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:45:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:45:51.543771 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33388c99-e8a2-43fd-a9d4-86adaf2410e1 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:51.563530 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbe04b-ab7f-49d1-aa79-3fb83ae39764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:51.564251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbe04b-ab7f-49d1-aa79-3fb83ae39764 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:51.564545 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbe04b-ab7f-49d1-aa79-3fb83ae39764 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:51.564860 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbe04b-ab7f-49d1-aa79-3fb83ae39764 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:51.565673 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbe04b-ab7f-49d1-aa79-3fb83ae39764 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:51.565989 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbe04b-ab7f-49d1-aa79-3fb83ae39764 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:51.567449 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbe04b-ab7f-49d1-aa79-3fb83ae39764 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:51.605199 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 17/30] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:51.606401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbe04b-ab7f-49d1-aa79-3fb83ae39764 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:51.694154 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33388c99-e8a2-43fd-a9d4-86adaf2410e1 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:51.732521 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbe04b-ab7f-49d1-aa79-3fb83ae39764 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:51.736852 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e32aef-1f7f-4e7a-abb1-e8d1bc4765b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:51.737980 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e32aef-1f7f-4e7a-abb1-e8d1bc4765b4 None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:51.738500 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e32aef-1f7f-4e7a-abb1-e8d1bc4765b4 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:51.739004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e32aef-1f7f-4e7a-abb1-e8d1bc4765b4 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:51.740008 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e32aef-1f7f-4e7a-abb1-e8d1bc4765b4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:51.741738 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e32aef-1f7f-4e7a-abb1-e8d1bc4765b4 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:51.779411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6402a18-5917-4691-8755-ec865cb0dc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:51.779996 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6402a18-5917-4691-8755-ec865cb0dc8a None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:51.780281 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6402a18-5917-4691-8755-ec865cb0dc8a None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:51.780631 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6402a18-5917-4691-8755-ec865cb0dc8a None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:51.782540 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6402a18-5917-4691-8755-ec865cb0dc8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:51.782856 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6402a18-5917-4691-8755-ec865cb0dc8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:51.784354 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6402a18-5917-4691-8755-ec865cb0dc8a None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:51.794517 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 18/31] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:45:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:51.795949 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58061c62-f518-4fe4-9b55-3753fb323cfa None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:51.796248 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58061c62-f518-4fe4-9b55-3753fb323cfa None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:51.796591 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58061c62-f518-4fe4-9b55-3753fb323cfa None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:51.798193 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 19/32] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:45:51.798734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58061c62-f518-4fe4-9b55-3753fb323cfa None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:51.883815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 14/33] 10.222.0.48 () {60 vars in 1131 bytes} [Mon May 9 15:45:51 2022] POST /identity/v3/roles => generated 219 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:45:51.885610 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e32aef-1f7f-4e7a-abb1-e8d1bc4765b4 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:51.918683 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58061c62-f518-4fe4-9b55-3753fb323cfa None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:51.967001 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a353d-54a9-4652-af4e-563a9378566f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:51.967694 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a353d-54a9-4652-af4e-563a9378566f None admin] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:51.967984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a353d-54a9-4652-af4e-563a9378566f None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:51.968791 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a353d-54a9-4652-af4e-563a9378566f None admin] PATH_INFO: `/v3/projects` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:51.969561 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a353d-54a9-4652-af4e-563a9378566f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:51.971046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a353d-54a9-4652-af4e-563a9378566f None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:52.020348 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e32aef-1f7f-4e7a-abb1-e8d1bc4765b4 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:52.063029 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691f714-2e0d-49ab-97f5-08823f3f1de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:52.063875 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691f714-2e0d-49ab-97f5-08823f3f1de0 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:52.064163 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691f714-2e0d-49ab-97f5-08823f3f1de0 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:52.064446 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691f714-2e0d-49ab-97f5-08823f3f1de0 None admin] PATH_INFO: `/v3/users/d6c9373bbbf843ee901a91cc4e068dee` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:52.066432 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691f714-2e0d-49ab-97f5-08823f3f1de0 None admin] RBAC: Authorizing `identity:get_user(user_id=d6c9373bbbf843ee901a91cc4e068dee)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:52.068143 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691f714-2e0d-49ab-97f5-08823f3f1de0 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:52.070005 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 15/34] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:45:51 2022] GET /identity/v3/users/d6c9373bbbf843ee901a91cc4e068dee => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:52.071797 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2718bd-8a9a-40e5-9f2e-943597d7e1af None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:52.072094 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2718bd-8a9a-40e5-9f2e-943597d7e1af None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:52.072378 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2718bd-8a9a-40e5-9f2e-943597d7e1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:52.096018 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-9c2718bd-8a9a-40e5-9f2e-943597d7e1af None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:45:52.098841 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-9c2718bd-8a9a-40e5-9f2e-943597d7e1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:45:52.136412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 20/35] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:45:51 2022] POST /identity/v3/projects => generated 301 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:45:52.138423 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460d4a0-f061-470b-8403-3d3426c37cd0 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:52.138985 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460d4a0-f061-470b-8403-3d3426c37cd0 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:52.139547 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460d4a0-f061-470b-8403-3d3426c37cd0 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:52.141971 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 21/36] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:45:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:45:52.143228 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460d4a0-f061-470b-8403-3d3426c37cd0 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:52.208392 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 16/37] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:45:52.214387 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86da39-3c8e-4e38-8a55-604bfcede411 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:52.214853 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86da39-3c8e-4e38-8a55-604bfcede411 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:52.215259 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86da39-3c8e-4e38-8a55-604bfcede411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:52.258835 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-5f86da39-3c8e-4e38-8a55-604bfcede411 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:45:52.260214 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-5f86da39-3c8e-4e38-8a55-604bfcede411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:45:52.316745 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460d4a0-f061-470b-8403-3d3426c37cd0 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:52.362487 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb3129-7a44-4c61-aa9f-47c04a0ed550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:52.363736 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb3129-7a44-4c61-aa9f-47c04a0ed550 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:52.364510 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 17/38] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:45:52.364725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb3129-7a44-4c61-aa9f-47c04a0ed550 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:52.365211 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb3129-7a44-4c61-aa9f-47c04a0ed550 None admin] PATH_INFO: `/v3/domains/default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:52.365396 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86da39-3c8e-4e38-8a55-604bfcede411 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:52.367359 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb3129-7a44-4c61-aa9f-47c04a0ed550 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:52.369355 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb3129-7a44-4c61-aa9f-47c04a0ed550 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:52.371457 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 22/39] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:45:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:52.380858 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb3129-7a44-4c61-aa9f-47c04a0ed550 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:52.513289 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86da39-3c8e-4e38-8a55-604bfcede411 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:52.523618 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb3129-7a44-4c61-aa9f-47c04a0ed550 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:52.557177 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce5468-78c7-45b4-b2b2-73012291cd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:52.557891 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce5468-78c7-45b4-b2b2-73012291cd99 None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:52.558185 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce5468-78c7-45b4-b2b2-73012291cd99 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:52.558474 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce5468-78c7-45b4-b2b2-73012291cd99 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:52.559271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce5468-78c7-45b4-b2b2-73012291cd99 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:52.560671 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce5468-78c7-45b4-b2b2-73012291cd99 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:52.562645 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d40582-c3ce-4ea2-a264-c43fcb8c0047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:52.563529 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d40582-c3ce-4ea2-a264-c43fcb8c0047 None admin] REQUEST_METHOD: `PUT` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:52.563824 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d40582-c3ce-4ea2-a264-c43fcb8c0047 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:52.564110 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d40582-c3ce-4ea2-a264-c43fcb8c0047 None admin] PATH_INFO: `/v3/domains/default/users/d6c9373bbbf843ee901a91cc4e068dee/roles/2180d183afad443187521833c40ed8a1` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:52.566451 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d40582-c3ce-4ea2-a264-c43fcb8c0047 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d6c9373bbbf843ee901a91cc4e068dee, role_id=2180d183afad443187521833c40ed8a1)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:52.568301 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d40582-c3ce-4ea2-a264-c43fcb8c0047 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:52.575098 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 18/40] 10.222.0.48 () {60 vars in 1131 bytes} [Mon May 9 15:45:52 2022] POST /identity/v3/roles => generated 225 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:45:52.576135 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce5468-78c7-45b4-b2b2-73012291cd99 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:52.585561 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 23/41] 10.222.0.48 () {58 vars in 1361 bytes} [Mon May 9 15:45:52 2022] PUT /identity/v3/domains/default/users/d6c9373bbbf843ee901a91cc4e068dee/roles/2180d183afad443187521833c40ed8a1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:45:52.587631 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae9ca6-8b8b-470b-93b4-a2b258b53b7b None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:52.587937 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae9ca6-8b8b-470b-93b4-a2b258b53b7b None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:52.588259 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae9ca6-8b8b-470b-93b4-a2b258b53b7b None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:52.589894 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 24/42] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:45:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:45:52.605521 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129f4b3-4e94-425d-8054-c76751702768 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:52.605521 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129f4b3-4e94-425d-8054-c76751702768 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:52.605521 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129f4b3-4e94-425d-8054-c76751702768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:52.641021 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-5129f4b3-4e94-425d-8054-c76751702768 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:45:52.643832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-5129f4b3-4e94-425d-8054-c76751702768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:45:52.699831 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce5468-78c7-45b4-b2b2-73012291cd99 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:52.740853 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b05ef-5f6c-47c8-ab10-16ddb627e243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:52.741745 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b05ef-5f6c-47c8-ab10-16ddb627e243 None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:52.742120 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b05ef-5f6c-47c8-ab10-16ddb627e243 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:52.742488 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b05ef-5f6c-47c8-ab10-16ddb627e243 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:52.743363 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b05ef-5f6c-47c8-ab10-16ddb627e243 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:52.744929 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b05ef-5f6c-47c8-ab10-16ddb627e243 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:52.750873 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 25/43] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:45:52.771684 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 19/44] 10.222.0.48 () {60 vars in 1131 bytes} [Mon May 9 15:45:52 2022] POST /identity/v3/roles => generated 223 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:45:52.774661 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129f4b3-4e94-425d-8054-c76751702768 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:52.919476 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129f4b3-4e94-425d-8054-c76751702768 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:52.963712 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882d4c9-5e9e-4cb9-b73b-893edad5703d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:52.964545 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882d4c9-5e9e-4cb9-b73b-893edad5703d None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:52.964989 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882d4c9-5e9e-4cb9-b73b-893edad5703d None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:52.965173 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882d4c9-5e9e-4cb9-b73b-893edad5703d None admin] PATH_INFO: `/v3/domains/default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:52.966857 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882d4c9-5e9e-4cb9-b73b-893edad5703d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:52.968807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882d4c9-5e9e-4cb9-b73b-893edad5703d None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:52.970847 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 26/45] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:45:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:52.977183 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b05ef-5f6c-47c8-ab10-16ddb627e243 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:53.111144 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b05ef-5f6c-47c8-ab10-16ddb627e243 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:53.146814 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bc3ca-c34e-4e93-ad1c-405888dfd993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:53.147503 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bc3ca-c34e-4e93-ad1c-405888dfd993 None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:53.147789 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bc3ca-c34e-4e93-ad1c-405888dfd993 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:53.148070 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bc3ca-c34e-4e93-ad1c-405888dfd993 None admin] PATH_INFO: `/v3/projects` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:53.148797 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bc3ca-c34e-4e93-ad1c-405888dfd993 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:53.150301 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bc3ca-c34e-4e93-ad1c-405888dfd993 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:53.185504 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 20/46] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:45:52 2022] POST /identity/v3/projects => generated 312 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:45:55.078777 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cd88c-9edc-43e1-ae06-477d379fb827 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:55.079375 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cd88c-9edc-43e1-ae06-477d379fb827 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:55.079375 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cd88c-9edc-43e1-ae06-477d379fb827 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:55.080820 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 27/47] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:45:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:45:55.087070 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41085d3-f3ec-4af6-9d9f-92285d998607 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:55.087657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41085d3-f3ec-4af6-9d9f-92285d998607 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:55.087657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41085d3-f3ec-4af6-9d9f-92285d998607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:55.107030 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-c41085d3-f3ec-4af6-9d9f-92285d998607 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:45:55.108333 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-c41085d3-f3ec-4af6-9d9f-92285d998607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:45:55.187657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 21/48] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:45:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:45:55.211744 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cd88c-9edc-43e1-ae06-477d379fb827 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:55.360790 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cd88c-9edc-43e1-ae06-477d379fb827 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:55.397251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52eb19e-777c-43cb-9582-eda75b2e4495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:55.398098 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52eb19e-777c-43cb-9582-eda75b2e4495 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:55.398389 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52eb19e-777c-43cb-9582-eda75b2e4495 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:55.398671 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52eb19e-777c-43cb-9582-eda75b2e4495 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:55.410750 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52eb19e-777c-43cb-9582-eda75b2e4495 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:45:55.418609 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-d52eb19e-777c-43cb-9582-eda75b2e4495 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:45:55.418609 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:45:55.418609 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:45:55.418609 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:45:55.418609 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:45:55.418609 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:45:55.418609 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:45:55.418609 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:45:55.418609 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:45:55.418609 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:45:55.418609 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:45:55.418609 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:45:55.418609 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:45:55.418609 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:45:55.418609 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:45:55.418609 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:45:55.419747 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:45:55.419747 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:45:55.419747 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:45:55.419747 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:45:55.419747 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:45:55.419747 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:45:55.419747 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:45:55.419747 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:45:55.419747 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:45:55.419747 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:45:55.419747 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:45:55.419747 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:45:55.419747 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:45:55.419747 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:45:55.419747 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:45:55.419747 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:45:55.420652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:45:55.420652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:45:55.420652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:45:55.420652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:45:55.420652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:45:55.420652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:45:55.420652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:45:55.420652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:45:55.420652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:45:55.420652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:45:55.420652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:45:55.420652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:45:55.420652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 28/49] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:45:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:45:55.425789 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41085d3-f3ec-4af6-9d9f-92285d998607 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:55.527599 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41085d3-f3ec-4af6-9d9f-92285d998607 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:55.561433 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e152ac-77af-40ce-b159-7e6997261453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:55.562163 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e152ac-77af-40ce-b159-7e6997261453 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:55.562656 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e152ac-77af-40ce-b159-7e6997261453 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:55.563037 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e152ac-77af-40ce-b159-7e6997261453 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:55.563817 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e152ac-77af-40ce-b159-7e6997261453 None admin] RBAC: Adding query filter params (name=admin) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:55.564130 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e152ac-77af-40ce-b159-7e6997261453 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:55.565563 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e152ac-77af-40ce-b159-7e6997261453 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:55.578352 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 22/50] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:45:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:55.583955 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52eb19e-777c-43cb-9582-eda75b2e4495 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:55.674926 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0567db8-943f-45fb-a36a-3e877154cd60 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:55.675222 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0567db8-943f-45fb-a36a-3e877154cd60 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:55.675512 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0567db8-943f-45fb-a36a-3e877154cd60 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:55.676904 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 23/51] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:45:55.682312 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fe9cf-2361-4fc6-a2f7-3ecfb26cad93 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:55.682611 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fe9cf-2361-4fc6-a2f7-3ecfb26cad93 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:55.682900 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fe9cf-2361-4fc6-a2f7-3ecfb26cad93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:55.694598 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52eb19e-777c-43cb-9582-eda75b2e4495 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:55.701228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-6e8fe9cf-2361-4fc6-a2f7-3ecfb26cad93 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:45:55.702632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-6e8fe9cf-2361-4fc6-a2f7-3ecfb26cad93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:45:55.727438 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a567b-3be7-4bd2-9605-d2a69ff515dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:55.728317 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a567b-3be7-4bd2-9605-d2a69ff515dc None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:55.728608 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a567b-3be7-4bd2-9605-d2a69ff515dc None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:55.728896 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a567b-3be7-4bd2-9605-d2a69ff515dc None admin] PATH_INFO: `/v3/users/d6c9373bbbf843ee901a91cc4e068dee` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:55.731217 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a567b-3be7-4bd2-9605-d2a69ff515dc None admin] RBAC: Authorizing `identity:get_user(user_id=d6c9373bbbf843ee901a91cc4e068dee)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:55.732708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a567b-3be7-4bd2-9605-d2a69ff515dc None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:55.739058 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 29/52] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:45:55 2022] GET /identity/v3/users/d6c9373bbbf843ee901a91cc4e068dee => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:55.740113 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a567b-3be7-4bd2-9605-d2a69ff515dc None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:55.772429 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 24/53] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:45:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:45:55.795158 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fe9cf-2361-4fc6-a2f7-3ecfb26cad93 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:55.838423 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a567b-3be7-4bd2-9605-d2a69ff515dc None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:55.870883 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f33ac-78ab-4ddf-8b39-1de6d64d820a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:55.871685 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f33ac-78ab-4ddf-8b39-1de6d64d820a None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:55.871977 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f33ac-78ab-4ddf-8b39-1de6d64d820a None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:55.872266 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f33ac-78ab-4ddf-8b39-1de6d64d820a None admin] PATH_INFO: `/v3/domains/default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:55.873515 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f33ac-78ab-4ddf-8b39-1de6d64d820a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:55.875801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f33ac-78ab-4ddf-8b39-1de6d64d820a None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:55.877497 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 30/54] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:45:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:45:55.883205 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f33ac-78ab-4ddf-8b39-1de6d64d820a None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:55.894579 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fe9cf-2361-4fc6-a2f7-3ecfb26cad93 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:55.927715 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4e53f-d6f1-4eb3-813a-84a57255f888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:55.928524 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4e53f-d6f1-4eb3-813a-84a57255f888 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:55.928819 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4e53f-d6f1-4eb3-813a-84a57255f888 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:55.929106 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4e53f-d6f1-4eb3-813a-84a57255f888 None admin] PATH_INFO: `/v3/domains/default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:55.930348 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4e53f-d6f1-4eb3-813a-84a57255f888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:55.931847 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4e53f-d6f1-4eb3-813a-84a57255f888 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:55.933533 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 25/55] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:45:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:45:55.939513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4e53f-d6f1-4eb3-813a-84a57255f888 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:55.986896 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f33ac-78ab-4ddf-8b39-1de6d64d820a None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:56.021013 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d0ab3-f227-4e40-9d1c-83c97a8b37e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:56.021777 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d0ab3-f227-4e40-9d1c-83c97a8b37e6 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:56.022069 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d0ab3-f227-4e40-9d1c-83c97a8b37e6 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:56.022353 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d0ab3-f227-4e40-9d1c-83c97a8b37e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:56.023218 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d0ab3-f227-4e40-9d1c-83c97a8b37e6 None admin] RBAC: Adding query filter params (role.id=2180d183afad443187521833c40ed8a1, scope.domain.id=default, user.id=d6c9373bbbf843ee901a91cc4e068dee) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:45:56.023540 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d0ab3-f227-4e40-9d1c-83c97a8b37e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:56.025002 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d0ab3-f227-4e40-9d1c-83c97a8b37e6 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:56.031591 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 31/56] 10.222.0.48 () {56 vars in 1322 bytes} [Mon May 9 15:45:55 2022] GET /identity/v3/role_assignments?user.id=d6c9373bbbf843ee901a91cc4e068dee&scope.domain.id=default&role.id=2180d183afad443187521833c40ed8a1 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:45:56.036800 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4e53f-d6f1-4eb3-813a-84a57255f888 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:56.074939 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eaccdf-e71b-4797-b1d9-62a4d076875d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:56.075667 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaccdf-e71b-4797-b1d9-62a4d076875d None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:56.075925 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaccdf-e71b-4797-b1d9-62a4d076875d None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:56.076205 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaccdf-e71b-4797-b1d9-62a4d076875d None admin] PATH_INFO: `/v3/projects` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:56.076952 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eaccdf-e71b-4797-b1d9-62a4d076875d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:56.078682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eaccdf-e71b-4797-b1d9-62a4d076875d None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:56.106030 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 26/57] 10.222.0.48 () {60 vars in 1140 bytes} [Mon May 9 15:45:55 2022] POST /identity/v3/projects => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:45:58.430989 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4908f-a6e5-476b-8be1-8d99f0d4781b None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:58.431543 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4908f-a6e5-476b-8be1-8d99f0d4781b None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:58.431543 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4908f-a6e5-476b-8be1-8d99f0d4781b None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:58.432964 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 32/58] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:45:58.439788 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0e154-9a68-4511-8bc3-b09e6601b997 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:58.440357 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0e154-9a68-4511-8bc3-b09e6601b997 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:58.440357 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0e154-9a68-4511-8bc3-b09e6601b997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:58.458697 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-eaa0e154-9a68-4511-8bc3-b09e6601b997 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:45:58.459953 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-eaa0e154-9a68-4511-8bc3-b09e6601b997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:45:58.536957 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 27/59] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:45:58.560904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4908f-a6e5-476b-8be1-8d99f0d4781b None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:58.663758 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4908f-a6e5-476b-8be1-8d99f0d4781b None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:58.699501 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cd6a9-0d91-4ea9-b980-e91a153ff75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:58.700357 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cd6a9-0d91-4ea9-b980-e91a153ff75d None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:58.700647 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cd6a9-0d91-4ea9-b980-e91a153ff75d None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:58.700927 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cd6a9-0d91-4ea9-b980-e91a153ff75d None admin] PATH_INFO: `/v3/domains/default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:58.702229 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cd6a9-0d91-4ea9-b980-e91a153ff75d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:58.704315 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cd6a9-0d91-4ea9-b980-e91a153ff75d None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:58.706067 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 33/60] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:45:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:45:58.711816 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0e154-9a68-4511-8bc3-b09e6601b997 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:45:58.815655 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0e154-9a68-4511-8bc3-b09e6601b997 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:45:58.852334 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4b4f5-1e98-4c81-88e2-9b7d4563e435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:45:58.853026 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4b4f5-1e98-4c81-88e2-9b7d4563e435 None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:45:58.853318 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4b4f5-1e98-4c81-88e2-9b7d4563e435 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:45:58.853632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4b4f5-1e98-4c81-88e2-9b7d4563e435 None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:45:58.854368 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4b4f5-1e98-4c81-88e2-9b7d4563e435 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:45:58.855866 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4b4f5-1e98-4c81-88e2-9b7d4563e435 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:45:58.883118 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 28/61] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:45:58 2022] POST /identity/v3/users => generated 275 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:46:02.363399 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379cb0c-dc3a-424c-b05d-4b895128b0dc None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:02.363989 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379cb0c-dc3a-424c-b05d-4b895128b0dc None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:02.363989 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379cb0c-dc3a-424c-b05d-4b895128b0dc None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:02.365711 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 34/62] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:02.377005 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52773d4d-9316-4840-aa21-724d5238f258 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:02.378099 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52773d4d-9316-4840-aa21-724d5238f258 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:02.378623 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52773d4d-9316-4840-aa21-724d5238f258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:02.402395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-52773d4d-9316-4840-aa21-724d5238f258 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:02.403760 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-52773d4d-9316-4840-aa21-724d5238f258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:02.478803 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfdf6f-923c-427e-83be-1a7f2d6960e9 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:02.479470 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfdf6f-923c-427e-83be-1a7f2d6960e9 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:02.479966 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfdf6f-923c-427e-83be-1a7f2d6960e9 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:02.481674 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 35/63] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:02.488030 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1db82-2db1-4f89-bc20-727375611112 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:02.488673 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1db82-2db1-4f89-bc20-727375611112 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:02.489191 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1db82-2db1-4f89-bc20-727375611112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:02.507160 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 29/64] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:02.514697 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-3fd1db82-2db1-4f89-bc20-727375611112 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:02.516319 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-3fd1db82-2db1-4f89-bc20-727375611112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:02.547343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52773d4d-9316-4840-aa21-724d5238f258 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:02.594036 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 36/65] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:46:02.642872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1db82-2db1-4f89-bc20-727375611112 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:02.712897 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52773d4d-9316-4840-aa21-724d5238f258 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:02.751144 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287cb9c-d132-4c83-aa28-0ed731f5c04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:02.752377 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287cb9c-d132-4c83-aa28-0ed731f5c04d None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:02.752894 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287cb9c-d132-4c83-aa28-0ed731f5c04d None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:02.753439 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287cb9c-d132-4c83-aa28-0ed731f5c04d None admin] PATH_INFO: `/v3/roles/member` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:02.764623 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287cb9c-d132-4c83-aa28-0ed731f5c04d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:02.765399 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1db82-2db1-4f89-bc20-727375611112 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:02.773881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-c287cb9c-d132-4c83-aa28-0ed731f5c04d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:02.773881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:02.773881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:02.773881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:02.773881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:02.773881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:02.773881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:02.773881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:02.773881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:02.773881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:02.773881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:02.773881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:02.773881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:02.773881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:02.773881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:02.773881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:02.774947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:02.774947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:02.774947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:02.774947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:02.774947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:02.774947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:02.774947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:02.774947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:02.774947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:02.774947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:02.774947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:02.774947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:46:02.774947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:02.774947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:02.774947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:02.774947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:02.775858 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:02.775858 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:02.775858 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:02.775858 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:02.775858 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:02.775858 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:02.775858 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:02.775858 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:02.775858 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:02.775858 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:02.775858 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:02.775858 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:46:02.778448 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 30/66] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:46:02.780053 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902ae1b-7c6f-4c53-80df-d27e451e9904 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:02.781135 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902ae1b-7c6f-4c53-80df-d27e451e9904 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:02.781826 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902ae1b-7c6f-4c53-80df-d27e451e9904 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:02.787829 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 31/67] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:02.789024 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902ae1b-7c6f-4c53-80df-d27e451e9904 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:02.801702 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aee063-265f-429c-af3f-4433e1720cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:02.802520 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aee063-265f-429c-af3f-4433e1720cb7 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:02.802806 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aee063-265f-429c-af3f-4433e1720cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:02.803085 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aee063-265f-429c-af3f-4433e1720cb7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:02.814142 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aee063-265f-429c-af3f-4433e1720cb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:02.822386 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-43aee063-265f-429c-af3f-4433e1720cb7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:46:02.822386 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:02.822386 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:02.822386 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:02.822386 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:02.822386 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:02.822386 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:02.822386 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:02.822386 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:02.822386 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:02.822386 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:02.822386 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:02.822386 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:02.822386 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:02.822386 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:02.822386 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:02.823446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:02.823446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:02.823446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:02.823446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:02.823446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:02.823446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:02.823446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:02.823446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:02.823446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:02.823446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:02.823446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:02.823446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:46:02.823446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:02.823446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:02.823446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:02.823446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:02.824359 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:02.824359 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:02.824359 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:02.824359 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:02.824359 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:02.824359 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:02.824359 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:02.824359 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:02.824359 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:02.824359 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:02.824359 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:46:02.824359 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:46:02.826926 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 37/68] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:46:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:02.828842 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99699abb-8b37-42ae-81d2-9d35cc6e324e None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:02.829125 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99699abb-8b37-42ae-81d2-9d35cc6e324e None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:02.829453 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99699abb-8b37-42ae-81d2-9d35cc6e324e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:02.847364 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-99699abb-8b37-42ae-81d2-9d35cc6e324e None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:02.848576 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-99699abb-8b37-42ae-81d2-9d35cc6e324e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:02.905493 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902ae1b-7c6f-4c53-80df-d27e451e9904 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:02.919360 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 38/69] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:02.920303 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99699abb-8b37-42ae-81d2-9d35cc6e324e None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:02.950660 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1210121-4274-4e35-84a3-64d03245dd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:02.951499 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1210121-4274-4e35-84a3-64d03245dd97 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:02.951619 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1210121-4274-4e35-84a3-64d03245dd97 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:02.951849 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1210121-4274-4e35-84a3-64d03245dd97 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:02.952893 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1210121-4274-4e35-84a3-64d03245dd97 None admin] RBAC: Adding query filter params (name=member) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:02.953252 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1210121-4274-4e35-84a3-64d03245dd97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:02.954688 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1210121-4274-4e35-84a3-64d03245dd97 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:02.967815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 32/70] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:02.967815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223c8cc-727f-4410-82f5-7f0b787d8293 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:02.967815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223c8cc-727f-4410-82f5-7f0b787d8293 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:02.967815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223c8cc-727f-4410-82f5-7f0b787d8293 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:02.967815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 33/71] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:02.967815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223c8cc-727f-4410-82f5-7f0b787d8293 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:03.039479 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99699abb-8b37-42ae-81d2-9d35cc6e324e None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:03.075529 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b9114-63da-4181-991e-dc85a0afb529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:03.076259 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b9114-63da-4181-991e-dc85a0afb529 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:03.076554 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b9114-63da-4181-991e-dc85a0afb529 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:03.076844 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b9114-63da-4181-991e-dc85a0afb529 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:03.078300 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b9114-63da-4181-991e-dc85a0afb529 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:03.078643 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b9114-63da-4181-991e-dc85a0afb529 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:03.080058 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b9114-63da-4181-991e-dc85a0afb529 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:03.092692 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 39/72] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:46:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:03.092692 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b9114-63da-4181-991e-dc85a0afb529 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:03.100486 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223c8cc-727f-4410-82f5-7f0b787d8293 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:03.136884 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c913e-838e-4951-9a97-a04d34e1047e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:03.137722 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c913e-838e-4951-9a97-a04d34e1047e None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:03.138018 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c913e-838e-4951-9a97-a04d34e1047e None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:03.138307 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c913e-838e-4951-9a97-a04d34e1047e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:03.150500 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c913e-838e-4951-9a97-a04d34e1047e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:03.159170 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-f09c913e-838e-4951-9a97-a04d34e1047e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:46:03.159170 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:03.159170 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:03.159170 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:03.159170 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:03.159170 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:03.159170 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:03.159170 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:03.159170 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:03.159170 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:03.159170 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:03.159170 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:03.159170 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:03.159170 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:03.159170 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:03.159170 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:03.160457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:03.160457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:03.160457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:03.160457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:03.160457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:03.160457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:03.160457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:03.160457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:03.160457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:03.160457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:03.160457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:03.160457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:46:03.160457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:03.160457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:03.160457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:03.160457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:03.161520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:03.161520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:03.161520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:03.161520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:03.161520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:03.161520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:03.161520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:03.161520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:03.161520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:03.161520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:03.161520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:46:03.161520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:46:03.161520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 34/73] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:46:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:03.162352 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526ad63-0126-49ec-881c-d2687bcc8b89 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:03.162352 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526ad63-0126-49ec-881c-d2687bcc8b89 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:03.162352 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526ad63-0126-49ec-881c-d2687bcc8b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:03.180413 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-3526ad63-0126-49ec-881c-d2687bcc8b89 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:03.181682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-3526ad63-0126-49ec-881c-d2687bcc8b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:03.201121 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b9114-63da-4181-991e-dc85a0afb529 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:03.236543 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21993615-1c4f-497d-b4bf-24076de93551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:03.237466 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21993615-1c4f-497d-b4bf-24076de93551 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:03.237763 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21993615-1c4f-497d-b4bf-24076de93551 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:03.238048 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21993615-1c4f-497d-b4bf-24076de93551 None admin] PATH_INFO: `/v3/users/c8e11348f5be4ffaae295f091562aea9` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:03.247999 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 35/74] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:03.248923 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526ad63-0126-49ec-881c-d2687bcc8b89 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:03.263358 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21993615-1c4f-497d-b4bf-24076de93551 None admin] RBAC: Authorizing `identity:get_user(user_id=c8e11348f5be4ffaae295f091562aea9)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:03.264912 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21993615-1c4f-497d-b4bf-24076de93551 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:03.267479 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 40/75] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:03 2022] GET /identity/v3/users/c8e11348f5be4ffaae295f091562aea9 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:03.268202 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21993615-1c4f-497d-b4bf-24076de93551 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:03.356370 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526ad63-0126-49ec-881c-d2687bcc8b89 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:03.371014 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21993615-1c4f-497d-b4bf-24076de93551 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:03.392382 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be604d-6caf-40d7-80c1-896562db84a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:03.393263 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be604d-6caf-40d7-80c1-896562db84a1 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:03.393581 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be604d-6caf-40d7-80c1-896562db84a1 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:03.393862 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be604d-6caf-40d7-80c1-896562db84a1 None admin] PATH_INFO: `/v3/users/c8e11348f5be4ffaae295f091562aea9` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:03.395111 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be604d-6caf-40d7-80c1-896562db84a1 None admin] RBAC: Authorizing `identity:get_user(user_id=c8e11348f5be4ffaae295f091562aea9)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:03.396575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be604d-6caf-40d7-80c1-896562db84a1 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:03.398272 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 36/76] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:03 2022] GET /identity/v3/users/c8e11348f5be4ffaae295f091562aea9 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:03.399475 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bca59-b220-43ce-aa2f-b083ab445331 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:03.399771 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bca59-b220-43ce-aa2f-b083ab445331 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:03.400051 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bca59-b220-43ce-aa2f-b083ab445331 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:03.401511 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 37/77] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:03.402048 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bca59-b220-43ce-aa2f-b083ab445331 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:03.409705 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65351291-4ec3-483f-9249-414edeb4b121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:03.410320 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65351291-4ec3-483f-9249-414edeb4b121 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:03.410611 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65351291-4ec3-483f-9249-414edeb4b121 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:03.410894 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65351291-4ec3-483f-9249-414edeb4b121 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:03.411670 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65351291-4ec3-483f-9249-414edeb4b121 None admin] RBAC: Adding query filter params (name=admin) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:03.411983 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65351291-4ec3-483f-9249-414edeb4b121 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:03.413364 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65351291-4ec3-483f-9249-414edeb4b121 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:03.422060 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 41/78] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:03.423169 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65351291-4ec3-483f-9249-414edeb4b121 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:03.510588 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bca59-b220-43ce-aa2f-b083ab445331 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:03.521251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65351291-4ec3-483f-9249-414edeb4b121 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:03.543896 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5806ae-d3a3-4f98-9cbb-baedf82b3eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:03.544702 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5806ae-d3a3-4f98-9cbb-baedf82b3eb7 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:03.544993 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5806ae-d3a3-4f98-9cbb-baedf82b3eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:03.545281 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5806ae-d3a3-4f98-9cbb-baedf82b3eb7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:03.555738 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59b806-85bf-46fc-9b4e-795ede118f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:03.556397 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59b806-85bf-46fc-9b4e-795ede118f05 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:03.556615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5806ae-d3a3-4f98-9cbb-baedf82b3eb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:03.556751 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59b806-85bf-46fc-9b4e-795ede118f05 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:03.556959 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59b806-85bf-46fc-9b4e-795ede118f05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:03.565578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-7e5806ae-d3a3-4f98-9cbb-baedf82b3eb7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:03.565578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:03.565578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:03.565578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:03.565578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:03.565578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:03.565578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:03.565578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:03.565578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:03.565578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:03.565578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:03.565578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:03.565578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:03.565578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:03.565578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:03.565578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:03.566657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:03.566657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:03.566657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:03.566657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:03.566657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:03.566657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:03.566657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:03.566657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:03.566657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:03.566657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:03.566657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:03.566657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:46:03.566657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:03.566657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:03.566657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:03.566657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:03.567575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:03.567575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:03.567575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:03.567575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:03.567575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:03.567575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:03.567575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:03.567575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:03.567575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:03.567575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:03.567575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:03.567575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:46:03.567575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 38/79] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:03.568339 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5806ae-d3a3-4f98-9cbb-baedf82b3eb7 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:03.623879 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59b806-85bf-46fc-9b4e-795ede118f05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:03.626355 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59b806-85bf-46fc-9b4e-795ede118f05 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:03.668874 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5806ae-d3a3-4f98-9cbb-baedf82b3eb7 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:03.703793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0688d23-04d0-4240-9d60-2b003ecfd4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:03.704469 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0688d23-04d0-4240-9d60-2b003ecfd4b0 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:03.704755 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0688d23-04d0-4240-9d60-2b003ecfd4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:03.705039 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0688d23-04d0-4240-9d60-2b003ecfd4b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:03.725157 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 42/80] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:46:03.726522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ef802-e3cd-4a8c-bd58-8b5e849f9870 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:03.726819 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ef802-e3cd-4a8c-bd58-8b5e849f9870 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:03.727106 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ef802-e3cd-4a8c-bd58-8b5e849f9870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:03.745045 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-761ef802-e3cd-4a8c-bd58-8b5e849f9870 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:03.746312 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-761ef802-e3cd-4a8c-bd58-8b5e849f9870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:03.771767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0688d23-04d0-4240-9d60-2b003ecfd4b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:03.773295 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0688d23-04d0-4240-9d60-2b003ecfd4b0 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:03.816399 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 43/81] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:03.837644 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ef802-e3cd-4a8c-bd58-8b5e849f9870 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:03.869599 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 39/82] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:46:03.870464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0688d23-04d0-4240-9d60-2b003ecfd4b0 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:03.912923 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ef802-e3cd-4a8c-bd58-8b5e849f9870 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:03.946763 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473095ff-2322-4fe6-94ef-80e9bc74fda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:03.947648 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473095ff-2322-4fe6-94ef-80e9bc74fda1 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:03.947939 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473095ff-2322-4fe6-94ef-80e9bc74fda1 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:03.948223 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473095ff-2322-4fe6-94ef-80e9bc74fda1 None admin] PATH_INFO: `/v3/users/d6c9373bbbf843ee901a91cc4e068dee` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:03.949463 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473095ff-2322-4fe6-94ef-80e9bc74fda1 None admin] RBAC: Authorizing `identity:get_user(user_id=d6c9373bbbf843ee901a91cc4e068dee)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:03.950942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473095ff-2322-4fe6-94ef-80e9bc74fda1 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:03.953297 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 44/83] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:03 2022] GET /identity/v3/users/d6c9373bbbf843ee901a91cc4e068dee => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:03.954105 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473095ff-2322-4fe6-94ef-80e9bc74fda1 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:03.970116 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0688d23-04d0-4240-9d60-2b003ecfd4b0 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:04.003741 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932aa8c4-b27a-4548-91b9-d6bafe76f8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:04.004420 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932aa8c4-b27a-4548-91b9-d6bafe76f8a5 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:04.004711 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932aa8c4-b27a-4548-91b9-d6bafe76f8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:04.004993 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932aa8c4-b27a-4548-91b9-d6bafe76f8a5 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:04.005793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932aa8c4-b27a-4548-91b9-d6bafe76f8a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:04.006109 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932aa8c4-b27a-4548-91b9-d6bafe76f8a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:04.007495 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932aa8c4-b27a-4548-91b9-d6bafe76f8a5 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:04.015922 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 40/84] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:04.017719 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932aa8c4-b27a-4548-91b9-d6bafe76f8a5 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:04.054500 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473095ff-2322-4fe6-94ef-80e9bc74fda1 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:04.088575 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2165b2-cd82-4e39-aa6e-e5c5213cbd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:04.089484 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2165b2-cd82-4e39-aa6e-e5c5213cbd14 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:04.089779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2165b2-cd82-4e39-aa6e-e5c5213cbd14 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:04.090062 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2165b2-cd82-4e39-aa6e-e5c5213cbd14 None admin] PATH_INFO: `/v3/projects/049f004d411f4c94a764b0a9955e9216` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:04.091283 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2165b2-cd82-4e39-aa6e-e5c5213cbd14 None admin] RBAC: Authorizing `identity:get_project(project_id=049f004d411f4c94a764b0a9955e9216)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:04.092743 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2165b2-cd82-4e39-aa6e-e5c5213cbd14 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:04.095400 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 45/85] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:03 2022] GET /identity/v3/projects/049f004d411f4c94a764b0a9955e9216 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:04.097485 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2165b2-cd82-4e39-aa6e-e5c5213cbd14 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:04.116186 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932aa8c4-b27a-4548-91b9-d6bafe76f8a5 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:04.148376 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4758fa-f236-418c-8ee8-845d05d95d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:04.149166 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4758fa-f236-418c-8ee8-845d05d95d33 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:04.149486 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4758fa-f236-418c-8ee8-845d05d95d33 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:04.149772 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4758fa-f236-418c-8ee8-845d05d95d33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:04.150965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4758fa-f236-418c-8ee8-845d05d95d33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:04.152448 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4758fa-f236-418c-8ee8-845d05d95d33 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:04.154124 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 41/86] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:46:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:04.154894 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4758fa-f236-418c-8ee8-845d05d95d33 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:04.192320 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2165b2-cd82-4e39-aa6e-e5c5213cbd14 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:04.224924 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbb24e-b9d5-4ea9-ad87-8c430471a0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:04.225841 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbb24e-b9d5-4ea9-ad87-8c430471a0ea None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:04.226132 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbb24e-b9d5-4ea9-ad87-8c430471a0ea None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:04.226411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbb24e-b9d5-4ea9-ad87-8c430471a0ea None admin] PATH_INFO: `/v3/projects/049f004d411f4c94a764b0a9955e9216` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:04.227618 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbb24e-b9d5-4ea9-ad87-8c430471a0ea None admin] RBAC: Authorizing `identity:get_project(project_id=049f004d411f4c94a764b0a9955e9216)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:04.229071 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbb24e-b9d5-4ea9-ad87-8c430471a0ea None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:04.230978 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 46/87] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:04 2022] GET /identity/v3/projects/049f004d411f4c94a764b0a9955e9216 => generated 298 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:04.231575 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbb24e-b9d5-4ea9-ad87-8c430471a0ea None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:04.258752 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4758fa-f236-418c-8ee8-845d05d95d33 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:04.292414 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a5dca-0391-4a84-81ed-bcf998cc9def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:04.293104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a5dca-0391-4a84-81ed-bcf998cc9def None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:04.293416 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a5dca-0391-4a84-81ed-bcf998cc9def None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:04.293697 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a5dca-0391-4a84-81ed-bcf998cc9def None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:04.331517 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbb24e-b9d5-4ea9-ad87-8c430471a0ea None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:04.361874 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a5dca-0391-4a84-81ed-bcf998cc9def None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:04.363352 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a5dca-0391-4a84-81ed-bcf998cc9def None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:04.364486 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a4792-fcd5-4fac-9727-1622da2ac772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:04.365361 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a4792-fcd5-4fac-9727-1622da2ac772 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:04.365671 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a4792-fcd5-4fac-9727-1622da2ac772 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:04.365947 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a4792-fcd5-4fac-9727-1622da2ac772 None admin] PATH_INFO: `/v3/users/c8e11348f5be4ffaae295f091562aea9` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:04.367166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a4792-fcd5-4fac-9727-1622da2ac772 None admin] RBAC: Authorizing `identity:get_user(user_id=c8e11348f5be4ffaae295f091562aea9)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:04.368601 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a4792-fcd5-4fac-9727-1622da2ac772 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:04.370278 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 47/88] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:04 2022] GET /identity/v3/users/c8e11348f5be4ffaae295f091562aea9 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:04.371051 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a4792-fcd5-4fac-9727-1622da2ac772 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:04.461960 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 42/89] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:46:04.463460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a5dca-0391-4a84-81ed-bcf998cc9def None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:04.469168 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a4792-fcd5-4fac-9727-1622da2ac772 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:04.504114 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd9578-a2f7-46d7-817b-7775ee865d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:04.504704 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd9578-a2f7-46d7-817b-7775ee865d07 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:04.505001 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd9578-a2f7-46d7-817b-7775ee865d07 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:04.505287 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd9578-a2f7-46d7-817b-7775ee865d07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:04.506182 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd9578-a2f7-46d7-817b-7775ee865d07 None admin] RBAC: Adding query filter params (role.id=6a75cc334b5a44b5a347a1a0cc20f6d7, scope.project.id=049f004d411f4c94a764b0a9955e9216, user.id=c8e11348f5be4ffaae295f091562aea9) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:04.506504 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd9578-a2f7-46d7-817b-7775ee865d07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:04.508009 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd9578-a2f7-46d7-817b-7775ee865d07 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:04.513520 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 48/90] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:46:04 2022] GET /identity/v3/role_assignments?user.id=c8e11348f5be4ffaae295f091562aea9&scope.project.id=049f004d411f4c94a764b0a9955e9216&role.id=6a75cc334b5a44b5a347a1a0cc20f6d7 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:04.514401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd9578-a2f7-46d7-817b-7775ee865d07 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:04.575353 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a5dca-0391-4a84-81ed-bcf998cc9def None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:04.615059 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb11ee-ded4-4320-a46f-7de86e369750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:04.616220 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb11ee-ded4-4320-a46f-7de86e369750 None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:04.616515 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb11ee-ded4-4320-a46f-7de86e369750 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:04.616804 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb11ee-ded4-4320-a46f-7de86e369750 None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:04.617604 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb11ee-ded4-4320-a46f-7de86e369750 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:04.619125 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb11ee-ded4-4320-a46f-7de86e369750 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:04.631025 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd9578-a2f7-46d7-817b-7775ee865d07 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:04.645321 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 43/91] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:46:04 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:46:04.646326 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb11ee-ded4-4320-a46f-7de86e369750 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:04.678542 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef97b85-fa08-4e3e-8332-9277b60e5eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:04.679782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef97b85-fa08-4e3e-8332-9277b60e5eef None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:04.680343 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef97b85-fa08-4e3e-8332-9277b60e5eef None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:04.680868 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef97b85-fa08-4e3e-8332-9277b60e5eef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:04.682041 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef97b85-fa08-4e3e-8332-9277b60e5eef None admin] RBAC: Adding query filter params (role.id=cf8c8db912344d0f82f8e6b0fa805968, scope.project.id=049f004d411f4c94a764b0a9955e9216, user.id=c8e11348f5be4ffaae295f091562aea9) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:04.682636 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef97b85-fa08-4e3e-8332-9277b60e5eef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:04.684566 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef97b85-fa08-4e3e-8332-9277b60e5eef None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:04.692318 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 49/92] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:46:04 2022] GET /identity/v3/role_assignments?user.id=c8e11348f5be4ffaae295f091562aea9&scope.project.id=049f004d411f4c94a764b0a9955e9216&role.id=cf8c8db912344d0f82f8e6b0fa805968 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:04.693699 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef97b85-fa08-4e3e-8332-9277b60e5eef None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:04.778910 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb11ee-ded4-4320-a46f-7de86e369750 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:04.817291 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef97b85-fa08-4e3e-8332-9277b60e5eef None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:04.819292 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568db00-ff63-40e8-93dd-12716b3cbd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:04.819978 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568db00-ff63-40e8-93dd-12716b3cbd0c None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:04.820266 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568db00-ff63-40e8-93dd-12716b3cbd0c None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:04.820546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568db00-ff63-40e8-93dd-12716b3cbd0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:04.861210 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8bcc2-c009-48a5-ab4d-10e3f4d0835e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:04.862633 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8bcc2-c009-48a5-ab4d-10e3f4d0835e None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:04.863197 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8bcc2-c009-48a5-ab4d-10e3f4d0835e None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:04.863722 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8bcc2-c009-48a5-ab4d-10e3f4d0835e None admin] PATH_INFO: `/v3/projects/049f004d411f4c94a764b0a9955e9216` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:04.865532 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8bcc2-c009-48a5-ab4d-10e3f4d0835e None admin] RBAC: Authorizing `identity:get_project(project_id=049f004d411f4c94a764b0a9955e9216)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:04.867441 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8bcc2-c009-48a5-ab4d-10e3f4d0835e None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:04.869693 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 50/93] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:04 2022] GET /identity/v3/projects/049f004d411f4c94a764b0a9955e9216 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:04.881404 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8bcc2-c009-48a5-ab4d-10e3f4d0835e None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:04.938358 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568db00-ff63-40e8-93dd-12716b3cbd0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:04.939967 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568db00-ff63-40e8-93dd-12716b3cbd0c None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:05.044788 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8bcc2-c009-48a5-ab4d-10e3f4d0835e None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:05.074721 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 44/94] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:46:05.082130 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568db00-ff63-40e8-93dd-12716b3cbd0c None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:05.099226 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a7651-dfa3-4558-b2b4-7695bdcfadb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:05.100189 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a7651-dfa3-4558-b2b4-7695bdcfadb1 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:05.100703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a7651-dfa3-4558-b2b4-7695bdcfadb1 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:05.101146 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a7651-dfa3-4558-b2b4-7695bdcfadb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:05.102446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a7651-dfa3-4558-b2b4-7695bdcfadb1 None admin] RBAC: Adding query filter params (role.id=2180d183afad443187521833c40ed8a1, scope.project.id=049f004d411f4c94a764b0a9955e9216, user.id=d6c9373bbbf843ee901a91cc4e068dee) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:05.102944 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a7651-dfa3-4558-b2b4-7695bdcfadb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:05.104819 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a7651-dfa3-4558-b2b4-7695bdcfadb1 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:05.113169 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 51/95] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:46:04 2022] GET /identity/v3/role_assignments?user.id=d6c9373bbbf843ee901a91cc4e068dee&scope.project.id=049f004d411f4c94a764b0a9955e9216&role.id=2180d183afad443187521833c40ed8a1 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:05.212786 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568db00-ff63-40e8-93dd-12716b3cbd0c None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:05.257147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a214f7-5bf3-4cf0-8d29-5d045fc7d778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:05.258363 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a214f7-5bf3-4cf0-8d29-5d045fc7d778 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:05.258829 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a214f7-5bf3-4cf0-8d29-5d045fc7d778 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:05.259289 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a214f7-5bf3-4cf0-8d29-5d045fc7d778 None admin] PATH_INFO: `/v3/projects/a9bedf2584cb4ebfa1dfbe97823ff630` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:05.260862 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a214f7-5bf3-4cf0-8d29-5d045fc7d778 None admin] RBAC: Authorizing `identity:get_project(project_id=a9bedf2584cb4ebfa1dfbe97823ff630)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:05.262598 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a214f7-5bf3-4cf0-8d29-5d045fc7d778 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:05.264659 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 45/96] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:05 2022] GET /identity/v3/projects/a9bedf2584cb4ebfa1dfbe97823ff630 => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:05.271711 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a7651-dfa3-4558-b2b4-7695bdcfadb1 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:05.388012 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a7651-dfa3-4558-b2b4-7695bdcfadb1 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:05.426726 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50718d99-b657-4438-aa9f-b9f683fc04cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:05.427703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50718d99-b657-4438-aa9f-b9f683fc04cc None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:05.428162 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50718d99-b657-4438-aa9f-b9f683fc04cc None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:05.428607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50718d99-b657-4438-aa9f-b9f683fc04cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:05.429734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50718d99-b657-4438-aa9f-b9f683fc04cc None admin] RBAC: Adding query filter params (role.id=6a75cc334b5a44b5a347a1a0cc20f6d7, scope.project.id=a9bedf2584cb4ebfa1dfbe97823ff630, user.id=c8e11348f5be4ffaae295f091562aea9) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:05.430210 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50718d99-b657-4438-aa9f-b9f683fc04cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:05.431852 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50718d99-b657-4438-aa9f-b9f683fc04cc None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:05.438913 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 52/97] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:46:05 2022] GET /identity/v3/role_assignments?user.id=c8e11348f5be4ffaae295f091562aea9&scope.project.id=a9bedf2584cb4ebfa1dfbe97823ff630&role.id=6a75cc334b5a44b5a347a1a0cc20f6d7 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:08.057250 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470b2bd-fab2-400b-8b0e-31aecc8e1f36 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:08.058293 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470b2bd-fab2-400b-8b0e-31aecc8e1f36 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:08.058810 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470b2bd-fab2-400b-8b0e-31aecc8e1f36 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:08.060460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 46/98] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:08.066302 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ab32f-66d8-4b80-a532-348312987bbf None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:08.067184 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ab32f-66d8-4b80-a532-348312987bbf None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:08.067681 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ab32f-66d8-4b80-a532-348312987bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:08.089485 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37e0e1-749e-486e-a24d-beebd9e7e251 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:08.089485 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37e0e1-749e-486e-a24d-beebd9e7e251 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:08.089485 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37e0e1-749e-486e-a24d-beebd9e7e251 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:08.089485 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 47/99] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:08.091173 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-8b0ab32f-66d8-4b80-a532-348312987bbf None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:08.092617 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-8b0ab32f-66d8-4b80-a532-348312987bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:08.095403 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe8af8-ec59-4096-89f8-db675d00615f None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:08.095699 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe8af8-ec59-4096-89f8-db675d00615f None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:08.095983 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe8af8-ec59-4096-89f8-db675d00615f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:08.128584 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-4ebe8af8-ec59-4096-89f8-db675d00615f None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:08.129760 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-4ebe8af8-ec59-4096-89f8-db675d00615f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:08.191097 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 53/100] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:08.224445 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 48/101] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:46:08.229580 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ab32f-66d8-4b80-a532-348312987bbf None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:08.247446 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe8af8-ec59-4096-89f8-db675d00615f None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:08.348327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ab32f-66d8-4b80-a532-348312987bbf None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:08.390283 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3847ad3-85fd-4f99-bcae-87e86bf457cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:08.392012 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3847ad3-85fd-4f99-bcae-87e86bf457cd None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:08.392301 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3847ad3-85fd-4f99-bcae-87e86bf457cd None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:08.392579 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3847ad3-85fd-4f99-bcae-87e86bf457cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:08.408184 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3847ad3-85fd-4f99-bcae-87e86bf457cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:08.417045 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-b3847ad3-85fd-4f99-bcae-87e86bf457cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:46:08.417045 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:08.417045 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:08.417045 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:08.417045 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:08.417045 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:08.417045 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:08.417045 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:08.417045 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:08.417045 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:08.417045 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:08.417045 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:08.417045 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:08.417045 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:08.417045 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:08.417045 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:08.418201 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:08.418201 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:08.418201 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:08.418201 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:08.418201 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:08.418201 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:08.418201 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:08.418201 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:08.418201 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:08.418201 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:08.418201 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:08.418201 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:46:08.418201 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:08.418201 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:08.418201 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:08.418201 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:08.419118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:08.419118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:08.419118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:08.419118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:08.419118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:08.419118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:08.419118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:08.419118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:08.419118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:08.419118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:08.419118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:46:08.419118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:46:08.419118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 54/102] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:08.425398 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3847ad3-85fd-4f99-bcae-87e86bf457cd None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:08.460877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe8af8-ec59-4096-89f8-db675d00615f None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:08.557617 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb2d10-d3d4-48f6-81bf-776b796b8494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:08.558447 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb2d10-d3d4-48f6-81bf-776b796b8494 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:08.558734 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb2d10-d3d4-48f6-81bf-776b796b8494 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:08.559014 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb2d10-d3d4-48f6-81bf-776b796b8494 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:08.581251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb2d10-d3d4-48f6-81bf-776b796b8494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:08.596260 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3847ad3-85fd-4f99-bcae-87e86bf457cd None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:08.600845 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-0dcb2d10-d3d4-48f6-81bf-776b796b8494 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:46:08.600845 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:08.600845 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:08.600845 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:08.600845 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:08.600845 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:08.600845 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:08.600845 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:08.600845 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:08.600845 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:08.600845 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:08.600845 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:08.600845 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:08.600845 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:08.600845 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:08.600845 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:08.601971 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:08.601971 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:08.601971 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:08.601971 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:08.601971 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:08.601971 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:08.601971 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:08.601971 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:08.601971 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:08.601971 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:08.601971 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:08.601971 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:46:08.601971 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:08.601971 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:08.601971 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:08.601971 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:08.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:08.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:08.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:08.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:08.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:08.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:08.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:08.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:08.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:08.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:08.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:46:08.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:46:08.602908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 49/103] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:46:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:08.611200 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb982aea-ef2d-4793-bde3-77deaf2cfc1d None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:08.611598 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb982aea-ef2d-4793-bde3-77deaf2cfc1d None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:08.611775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb982aea-ef2d-4793-bde3-77deaf2cfc1d None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:08.615140 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 50/104] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:08 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:08.623775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb982aea-ef2d-4793-bde3-77deaf2cfc1d None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:08.683757 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63cd059-01b1-43c6-89e2-4838cde624b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:08.684442 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cd059-01b1-43c6-89e2-4838cde624b2 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:08.684728 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cd059-01b1-43c6-89e2-4838cde624b2 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:08.685009 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cd059-01b1-43c6-89e2-4838cde624b2 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:08.685814 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63cd059-01b1-43c6-89e2-4838cde624b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:08.686130 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63cd059-01b1-43c6-89e2-4838cde624b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:08.687589 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63cd059-01b1-43c6-89e2-4838cde624b2 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:08.713096 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 55/105] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:08.719210 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c68768-695f-4847-aa6c-25850990fe74 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:08.719702 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c68768-695f-4847-aa6c-25850990fe74 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:08.719993 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c68768-695f-4847-aa6c-25850990fe74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:08.747203 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-65c68768-695f-4847-aa6c-25850990fe74 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:08.748965 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-65c68768-695f-4847-aa6c-25850990fe74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:08.800487 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb982aea-ef2d-4793-bde3-77deaf2cfc1d None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:08.829702 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 56/106] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:08.831102 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc43ee9-d336-480d-91ea-e6cd279ed0ee None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:08.831410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc43ee9-d336-480d-91ea-e6cd279ed0ee None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:08.831701 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc43ee9-d336-480d-91ea-e6cd279ed0ee None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:08.837505 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 57/107] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:08.837505 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc43ee9-d336-480d-91ea-e6cd279ed0ee None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:08.850627 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ffe8a-bf7f-4dda-b6d2-07183176c8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:08.851526 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ffe8a-bf7f-4dda-b6d2-07183176c8fc None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:08.851653 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ffe8a-bf7f-4dda-b6d2-07183176c8fc None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:08.851895 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ffe8a-bf7f-4dda-b6d2-07183176c8fc None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:08.852715 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ffe8a-bf7f-4dda-b6d2-07183176c8fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:08.853053 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ffe8a-bf7f-4dda-b6d2-07183176c8fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:08.854586 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ffe8a-bf7f-4dda-b6d2-07183176c8fc None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:08.863823 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 51/108] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:46:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:08.865206 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab9e45-c23d-448e-aaf3-8ba4f831541b None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:08.865538 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab9e45-c23d-448e-aaf3-8ba4f831541b None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:08.865828 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab9e45-c23d-448e-aaf3-8ba4f831541b None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:08.867124 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 52/109] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:08.868194 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf13168-c55c-47bb-b5ef-508654d93eee None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:08.868480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf13168-c55c-47bb-b5ef-508654d93eee None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:08.868758 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf13168-c55c-47bb-b5ef-508654d93eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:08.886797 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-1cf13168-c55c-47bb-b5ef-508654d93eee None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:08.888001 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-1cf13168-c55c-47bb-b5ef-508654d93eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:08.944366 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc43ee9-d336-480d-91ea-e6cd279ed0ee None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:08.954795 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 53/110] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:08.956230 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c197d7-ee17-4090-8aea-c6912f79a211 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:08.956537 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c197d7-ee17-4090-8aea-c6912f79a211 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:08.956828 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c197d7-ee17-4090-8aea-c6912f79a211 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:08.958333 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 54/111] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:08.958962 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c197d7-ee17-4090-8aea-c6912f79a211 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:08.984674 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb299407-820d-4b4b-8e35-c4c6597ec64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:08.985629 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb299407-820d-4b4b-8e35-c4c6597ec64e None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:08.985924 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb299407-820d-4b4b-8e35-c4c6597ec64e None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:08.986209 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb299407-820d-4b4b-8e35-c4c6597ec64e None admin] PATH_INFO: `/v3/users/8c51fedf6f6e40b2ac9cf455ef0dbe8e` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:08.999586 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb299407-820d-4b4b-8e35-c4c6597ec64e None admin] RBAC: Authorizing `identity:get_user(user_id=8c51fedf6f6e40b2ac9cf455ef0dbe8e)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:09.001341 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb299407-820d-4b4b-8e35-c4c6597ec64e None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:09.003133 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 58/112] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:08 2022] GET /identity/v3/users/8c51fedf6f6e40b2ac9cf455ef0dbe8e => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:09.004275 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb299407-820d-4b4b-8e35-c4c6597ec64e None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:09.067732 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c197d7-ee17-4090-8aea-c6912f79a211 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:09.103051 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb299407-820d-4b4b-8e35-c4c6597ec64e None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:09.107657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310fe78-069f-40e8-b090-00304c14fbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:09.108978 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310fe78-069f-40e8-b090-00304c14fbb6 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:09.109262 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310fe78-069f-40e8-b090-00304c14fbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:09.109571 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310fe78-069f-40e8-b090-00304c14fbb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:09.119520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310fe78-069f-40e8-b090-00304c14fbb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:09.127929 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-2310fe78-069f-40e8-b090-00304c14fbb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:09.127929 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:09.127929 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:09.127929 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:09.127929 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:09.127929 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:09.127929 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:09.127929 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:09.127929 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:09.127929 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:09.127929 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:09.127929 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:09.127929 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:09.127929 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:09.127929 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:09.127929 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:09.128973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:09.128973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:09.128973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:09.128973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:09.128973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:09.128973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:09.128973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:09.128973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:09.128973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:09.128973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:09.128973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:09.128973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:46:09.128973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:09.128973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:09.128973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:09.128973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:09.135069 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:09.135069 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:09.135069 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:09.135069 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:09.135069 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:09.135069 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:09.135069 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:09.135069 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:09.135069 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:09.135069 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:09.135069 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:09.135069 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:46:09.135069 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 55/113] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:09.135069 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996c9d3-a461-4581-a6a4-e2b92e48f7df None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:09.135893 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996c9d3-a461-4581-a6a4-e2b92e48f7df None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:09.135893 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996c9d3-a461-4581-a6a4-e2b92e48f7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:09.138886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67ad60-0f97-4f8f-ac28-5287fa79b89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:09.139850 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67ad60-0f97-4f8f-ac28-5287fa79b89e None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:09.140822 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67ad60-0f97-4f8f-ac28-5287fa79b89e None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:09.141117 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67ad60-0f97-4f8f-ac28-5287fa79b89e None admin] PATH_INFO: `/v3/users/c8e11348f5be4ffaae295f091562aea9` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:09.142456 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67ad60-0f97-4f8f-ac28-5287fa79b89e None admin] RBAC: Authorizing `identity:get_user(user_id=c8e11348f5be4ffaae295f091562aea9)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:09.143902 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67ad60-0f97-4f8f-ac28-5287fa79b89e None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:09.145757 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 59/114] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:09 2022] GET /identity/v3/users/c8e11348f5be4ffaae295f091562aea9 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:09.146859 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb356b-8fd9-40ef-8ff5-9a216061d174 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:09.147092 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb356b-8fd9-40ef-8ff5-9a216061d174 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:09.147376 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb356b-8fd9-40ef-8ff5-9a216061d174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:09.147775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-1996c9d3-a461-4581-a6a4-e2b92e48f7df None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:09.148990 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-1996c9d3-a461-4581-a6a4-e2b92e48f7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:09.165089 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-93bb356b-8fd9-40ef-8ff5-9a216061d174 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:09.166342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-93bb356b-8fd9-40ef-8ff5-9a216061d174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:09.221646 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 56/115] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:09.232946 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996c9d3-a461-4581-a6a4-e2b92e48f7df None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:09.233066 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 60/116] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:09.234251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb356b-8fd9-40ef-8ff5-9a216061d174 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:09.328620 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996c9d3-a461-4581-a6a4-e2b92e48f7df None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:09.333565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb356b-8fd9-40ef-8ff5-9a216061d174 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:09.362277 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508a71b-6dd8-4c05-be22-97b0825a8668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:09.363007 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508a71b-6dd8-4c05-be22-97b0825a8668 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:09.363295 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508a71b-6dd8-4c05-be22-97b0825a8668 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:09.363581 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508a71b-6dd8-4c05-be22-97b0825a8668 None admin] PATH_INFO: `/v3/domains/default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:09.364807 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508a71b-6dd8-4c05-be22-97b0825a8668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:09.366301 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508a71b-6dd8-4c05-be22-97b0825a8668 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:09.367531 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32b970-6c91-45f1-b24d-4bd6e5ab4f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:09.368157 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 57/117] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:46:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:09.368280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32b970-6c91-45f1-b24d-4bd6e5ab4f44 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:09.368458 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32b970-6c91-45f1-b24d-4bd6e5ab4f44 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:09.368722 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508a71b-6dd8-4c05-be22-97b0825a8668 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:09.368833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32b970-6c91-45f1-b24d-4bd6e5ab4f44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:09.435372 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32b970-6c91-45f1-b24d-4bd6e5ab4f44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:09.437087 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32b970-6c91-45f1-b24d-4bd6e5ab4f44 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:09.468353 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508a71b-6dd8-4c05-be22-97b0825a8668 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:09.501443 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3c149-9906-430d-b9ca-9330b615c530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:09.502123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3c149-9906-430d-b9ca-9330b615c530 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:09.502405 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3c149-9906-430d-b9ca-9330b615c530 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:09.502685 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3c149-9906-430d-b9ca-9330b615c530 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:09.503447 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3c149-9906-430d-b9ca-9330b615c530 None admin] RBAC: Adding query filter params (name=member) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:09.503755 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3c149-9906-430d-b9ca-9330b615c530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:09.505140 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3c149-9906-430d-b9ca-9330b615c530 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:09.513153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 58/118] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:09.513153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3c149-9906-430d-b9ca-9330b615c530 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:09.538290 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 61/119] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:46:09.538990 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32b970-6c91-45f1-b24d-4bd6e5ab4f44 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:09.618569 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3c149-9906-430d-b9ca-9330b615c530 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:09.657033 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32b970-6c91-45f1-b24d-4bd6e5ab4f44 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:09.662886 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b453145-192f-40d9-a082-d1380d14c7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:09.663786 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b453145-192f-40d9-a082-d1380d14c7eb None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:09.664078 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b453145-192f-40d9-a082-d1380d14c7eb None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:09.664359 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b453145-192f-40d9-a082-d1380d14c7eb None admin] PATH_INFO: `/v3/projects/049f004d411f4c94a764b0a9955e9216` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:09.665732 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b453145-192f-40d9-a082-d1380d14c7eb None admin] RBAC: Authorizing `identity:get_project(project_id=049f004d411f4c94a764b0a9955e9216)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:09.667246 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b453145-192f-40d9-a082-d1380d14c7eb None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:09.669071 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 59/120] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:09 2022] GET /identity/v3/projects/049f004d411f4c94a764b0a9955e9216 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:09.675190 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b453145-192f-40d9-a082-d1380d14c7eb None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:09.695469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fab2b-fda9-4b08-863f-2d86bc7fa451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:09.696273 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fab2b-fda9-4b08-863f-2d86bc7fa451 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:09.696557 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fab2b-fda9-4b08-863f-2d86bc7fa451 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:09.696849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fab2b-fda9-4b08-863f-2d86bc7fa451 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:09.707611 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75fab2b-fda9-4b08-863f-2d86bc7fa451 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:09.715150 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-b75fab2b-fda9-4b08-863f-2d86bc7fa451 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:46:09.715150 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:09.715150 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:09.715150 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:09.715150 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:09.715150 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:09.715150 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:09.715150 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:09.715150 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:09.715150 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:09.715150 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:09.715150 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:09.715150 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:09.715150 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:09.715150 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:09.715150 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:09.716157 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:09.716157 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:09.716157 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:09.716157 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:09.716157 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:09.716157 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:09.716157 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:09.716157 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:09.716157 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:09.716157 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:09.716157 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:09.716157 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:46:09.716157 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:09.716157 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:09.716157 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:09.716157 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:09.717084 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:09.717084 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:09.717084 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:09.717084 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:09.717084 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:09.717084 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:09.717084 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:09.717084 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:09.717084 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:09.717084 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:09.717084 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:46:09.717084 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:46:09.717084 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 62/121] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:46:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:09.718602 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fab2b-fda9-4b08-863f-2d86bc7fa451 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:09.785971 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b453145-192f-40d9-a082-d1380d14c7eb None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:09.821466 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fab2b-fda9-4b08-863f-2d86bc7fa451 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:09.836924 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c58629-f795-4bda-8066-5481a5827bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:09.837783 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c58629-f795-4bda-8066-5481a5827bff None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:09.838080 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c58629-f795-4bda-8066-5481a5827bff None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:09.838373 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c58629-f795-4bda-8066-5481a5827bff None admin] PATH_INFO: `/v3/roles/member` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:09.854232 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c58629-f795-4bda-8066-5481a5827bff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:09.860674 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0857cf-7e4f-4d3e-bdfc-0eb40ce7193e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:09.861390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0857cf-7e4f-4d3e-bdfc-0eb40ce7193e None admin] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:09.861679 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0857cf-7e4f-4d3e-bdfc-0eb40ce7193e None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:09.861960 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0857cf-7e4f-4d3e-bdfc-0eb40ce7193e None admin] PATH_INFO: `/v3/projects` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:09.862317 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-c8c58629-f795-4bda-8066-5481a5827bff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:09.862317 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:09.862317 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:09.862317 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:09.862317 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:09.862317 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:09.862317 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:09.862317 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:09.862317 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:09.862317 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:09.862317 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:09.862317 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:09.862317 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:09.862317 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:09.862317 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:09.862317 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:09.863480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:09.863480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:09.863480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:09.863480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:09.863480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:09.863480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:09.863480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:09.863480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:09.863480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:09.863480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:09.863480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:09.863480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:46:09.863480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:09.863480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:09.863480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:09.863480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:09.865613 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:09.865613 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:09.865613 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:09.865613 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:09.865613 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:09.865613 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:09.865613 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:09.865613 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:09.865613 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:09.865613 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:09.865613 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:09.865613 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:46:09.867801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0857cf-7e4f-4d3e-bdfc-0eb40ce7193e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:09.867944 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 60/122] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:09.867944 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c58629-f795-4bda-8066-5481a5827bff None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:09.868180 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0857cf-7e4f-4d3e-bdfc-0eb40ce7193e None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:09.909493 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 63/123] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:46:09 2022] POST /identity/v3/projects => generated 302 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:46:09.909493 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0857cf-7e4f-4d3e-bdfc-0eb40ce7193e None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:10.034604 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0857cf-7e4f-4d3e-bdfc-0eb40ce7193e None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:10.036516 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c58629-f795-4bda-8066-5481a5827bff None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:10.081257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966b3bb-3b1f-42bb-8930-1632ad24a788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:10.082192 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966b3bb-3b1f-42bb-8930-1632ad24a788 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:10.082477 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966b3bb-3b1f-42bb-8930-1632ad24a788 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:10.082761 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966b3bb-3b1f-42bb-8930-1632ad24a788 None admin] PATH_INFO: `/v3/projects/049f004d411f4c94a764b0a9955e9216` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:10.085364 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966b3bb-3b1f-42bb-8930-1632ad24a788 None admin] RBAC: Authorizing `identity:get_project(project_id=049f004d411f4c94a764b0a9955e9216)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:10.085789 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966b3bb-3b1f-42bb-8930-1632ad24a788 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:10.087756 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 64/124] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:09 2022] GET /identity/v3/projects/049f004d411f4c94a764b0a9955e9216 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:10.091844 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8907df-344f-47e3-84a2-21863175149d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:10.093638 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8907df-344f-47e3-84a2-21863175149d None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:10.093942 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8907df-344f-47e3-84a2-21863175149d None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:10.094058 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966b3bb-3b1f-42bb-8930-1632ad24a788 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:10.094233 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8907df-344f-47e3-84a2-21863175149d None admin] PATH_INFO: `/v3/users/c8e11348f5be4ffaae295f091562aea9` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:10.095736 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8907df-344f-47e3-84a2-21863175149d None admin] RBAC: Authorizing `identity:get_user(user_id=c8e11348f5be4ffaae295f091562aea9)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:10.099827 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8907df-344f-47e3-84a2-21863175149d None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:10.101072 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 61/125] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:09 2022] GET /identity/v3/users/c8e11348f5be4ffaae295f091562aea9 => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:10.102145 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8907df-344f-47e3-84a2-21863175149d None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:10.223499 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966b3bb-3b1f-42bb-8930-1632ad24a788 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:10.227871 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8907df-344f-47e3-84a2-21863175149d None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:10.260309 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c0ab5-cd94-4081-981b-d6c94fefec07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:10.261217 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c0ab5-cd94-4081-981b-d6c94fefec07 None admin] REQUEST_METHOD: `PUT` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:10.261563 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c0ab5-cd94-4081-981b-d6c94fefec07 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:10.261871 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c0ab5-cd94-4081-981b-d6c94fefec07 None admin] PATH_INFO: `/v3/projects/049f004d411f4c94a764b0a9955e9216/users/c8e11348f5be4ffaae295f091562aea9/roles/cf8c8db912344d0f82f8e6b0fa805968` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:10.265357 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c0ab5-cd94-4081-981b-d6c94fefec07 None admin] RBAC: Authorizing `identity:create_grant(project_id=049f004d411f4c94a764b0a9955e9216, user_id=c8e11348f5be4ffaae295f091562aea9, role_id=cf8c8db912344d0f82f8e6b0fa805968)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:10.267792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c0ab5-cd94-4081-981b-d6c94fefec07 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:10.270123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfae78e-7408-41e2-b50c-9c9babea7628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:10.270978 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfae78e-7408-41e2-b50c-9c9babea7628 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:10.271404 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfae78e-7408-41e2-b50c-9c9babea7628 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:10.271846 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfae78e-7408-41e2-b50c-9c9babea7628 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:10.272822 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfae78e-7408-41e2-b50c-9c9babea7628 None admin] RBAC: Adding query filter params (name=admin) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:10.273135 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfae78e-7408-41e2-b50c-9c9babea7628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:10.274803 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfae78e-7408-41e2-b50c-9c9babea7628 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:10.283495 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 65/126] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:46:10 2022] PUT /identity/v3/projects/049f004d411f4c94a764b0a9955e9216/users/c8e11348f5be4ffaae295f091562aea9/roles/cf8c8db912344d0f82f8e6b0fa805968 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:46:10.284365 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c0ab5-cd94-4081-981b-d6c94fefec07 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:10.292289 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 62/127] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:10.298710 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfae78e-7408-41e2-b50c-9c9babea7628 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:10.420703 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfae78e-7408-41e2-b50c-9c9babea7628 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:10.429218 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c0ab5-cd94-4081-981b-d6c94fefec07 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:10.458920 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72ba4b-31bb-4e5d-9281-2404b52e0224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:10.459606 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72ba4b-31bb-4e5d-9281-2404b52e0224 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:10.459896 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72ba4b-31bb-4e5d-9281-2404b52e0224 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:10.460176 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72ba4b-31bb-4e5d-9281-2404b52e0224 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:10.461151 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72ba4b-31bb-4e5d-9281-2404b52e0224 None admin] RBAC: Adding query filter params (role.id=b890511935cc4c2fa062153280c4cd25, scope.project.id=049f004d411f4c94a764b0a9955e9216, user.id=8c51fedf6f6e40b2ac9cf455ef0dbe8e) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:10.461365 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72ba4b-31bb-4e5d-9281-2404b52e0224 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:10.463022 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72ba4b-31bb-4e5d-9281-2404b52e0224 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:10.473064 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 63/128] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:46:10 2022] GET /identity/v3/role_assignments?user.id=8c51fedf6f6e40b2ac9cf455ef0dbe8e&scope.project.id=049f004d411f4c94a764b0a9955e9216&role.id=b890511935cc4c2fa062153280c4cd25 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:10.474199 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72ba4b-31bb-4e5d-9281-2404b52e0224 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:10.477839 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4eadbf-8de1-41c4-b59b-bfcbcf9ac85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:10.478887 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4eadbf-8de1-41c4-b59b-bfcbcf9ac85d None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:10.479428 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4eadbf-8de1-41c4-b59b-bfcbcf9ac85d None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:10.479919 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4eadbf-8de1-41c4-b59b-bfcbcf9ac85d None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:10.480926 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4eadbf-8de1-41c4-b59b-bfcbcf9ac85d None admin] RBAC: Adding query filter params (name=member) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:10.481511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4eadbf-8de1-41c4-b59b-bfcbcf9ac85d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:10.483291 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4eadbf-8de1-41c4-b59b-bfcbcf9ac85d None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:10.493792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 66/129] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:10.498694 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4eadbf-8de1-41c4-b59b-bfcbcf9ac85d None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:10.618043 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72ba4b-31bb-4e5d-9281-2404b52e0224 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:10.635329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4eadbf-8de1-41c4-b59b-bfcbcf9ac85d None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:10.660390 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764deee-06a6-4402-8187-06e710d1a972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:10.661953 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764deee-06a6-4402-8187-06e710d1a972 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:10.662900 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764deee-06a6-4402-8187-06e710d1a972 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:10.663050 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764deee-06a6-4402-8187-06e710d1a972 None admin] PATH_INFO: `/v3/projects/049f004d411f4c94a764b0a9955e9216` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:10.665057 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764deee-06a6-4402-8187-06e710d1a972 None admin] RBAC: Authorizing `identity:get_project(project_id=049f004d411f4c94a764b0a9955e9216)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:10.666964 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764deee-06a6-4402-8187-06e710d1a972 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:10.669086 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 64/130] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:10 2022] GET /identity/v3/projects/049f004d411f4c94a764b0a9955e9216 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:10.674415 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764deee-06a6-4402-8187-06e710d1a972 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:10.691666 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524b751-8fd1-438a-aaa9-ed8896e8f763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:10.692588 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524b751-8fd1-438a-aaa9-ed8896e8f763 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:10.692882 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524b751-8fd1-438a-aaa9-ed8896e8f763 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:10.693160 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524b751-8fd1-438a-aaa9-ed8896e8f763 None admin] PATH_INFO: `/v3/users/d6c9373bbbf843ee901a91cc4e068dee` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:10.695139 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524b751-8fd1-438a-aaa9-ed8896e8f763 None admin] RBAC: Authorizing `identity:get_user(user_id=d6c9373bbbf843ee901a91cc4e068dee)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:10.696990 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524b751-8fd1-438a-aaa9-ed8896e8f763 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:10.699365 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 67/131] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:10 2022] GET /identity/v3/users/d6c9373bbbf843ee901a91cc4e068dee => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:10.700674 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524b751-8fd1-438a-aaa9-ed8896e8f763 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:10.810972 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764deee-06a6-4402-8187-06e710d1a972 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:10.834569 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524b751-8fd1-438a-aaa9-ed8896e8f763 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:10.873599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4b3fc-6a08-4075-8b4f-968d6316c517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:10.875500 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4b3fc-6a08-4075-8b4f-968d6316c517 None admin] REQUEST_METHOD: `PUT` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:10.875791 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4b3fc-6a08-4075-8b4f-968d6316c517 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:10.876085 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4b3fc-6a08-4075-8b4f-968d6316c517 None admin] PATH_INFO: `/v3/projects/049f004d411f4c94a764b0a9955e9216/users/c8e11348f5be4ffaae295f091562aea9/roles/6a75cc334b5a44b5a347a1a0cc20f6d7` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:10.878737 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4b3fc-6a08-4075-8b4f-968d6316c517 None admin] RBAC: Authorizing `identity:create_grant(project_id=049f004d411f4c94a764b0a9955e9216, user_id=c8e11348f5be4ffaae295f091562aea9, role_id=6a75cc334b5a44b5a347a1a0cc20f6d7)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:10.880390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4b3fc-6a08-4075-8b4f-968d6316c517 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:10.900320 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 68/132] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:46:10 2022] PUT /identity/v3/projects/049f004d411f4c94a764b0a9955e9216/users/c8e11348f5be4ffaae295f091562aea9/roles/6a75cc334b5a44b5a347a1a0cc20f6d7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:46:10.900994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7872ae-397b-4ba5-8876-543c0129b765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:10.901315 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4b3fc-6a08-4075-8b4f-968d6316c517 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:10.901928 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7872ae-397b-4ba5-8876-543c0129b765 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:10.902243 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7872ae-397b-4ba5-8876-543c0129b765 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:10.902530 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7872ae-397b-4ba5-8876-543c0129b765 None admin] PATH_INFO: `/v3/users/c8e11348f5be4ffaae295f091562aea9` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:10.910478 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7872ae-397b-4ba5-8876-543c0129b765 None admin] RBAC: Authorizing `identity:get_user(user_id=c8e11348f5be4ffaae295f091562aea9)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:10.912041 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7872ae-397b-4ba5-8876-543c0129b765 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:10.913958 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 65/133] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:10 2022] GET /identity/v3/users/c8e11348f5be4ffaae295f091562aea9 => generated 275 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:10.923287 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7872ae-397b-4ba5-8876-543c0129b765 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:11.032066 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4b3fc-6a08-4075-8b4f-968d6316c517 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:11.073088 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af78e2e-f848-4c7a-a29e-148d8871f6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:11.073976 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af78e2e-f848-4c7a-a29e-148d8871f6b7 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:11.074271 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af78e2e-f848-4c7a-a29e-148d8871f6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:11.074554 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af78e2e-f848-4c7a-a29e-148d8871f6b7 None admin] PATH_INFO: `/v3/projects/049f004d411f4c94a764b0a9955e9216` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:11.075825 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af78e2e-f848-4c7a-a29e-148d8871f6b7 None admin] RBAC: Authorizing `identity:get_project(project_id=049f004d411f4c94a764b0a9955e9216)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:11.078070 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af78e2e-f848-4c7a-a29e-148d8871f6b7 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:11.080127 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 69/134] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:10 2022] GET /identity/v3/projects/049f004d411f4c94a764b0a9955e9216 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:11.086193 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af78e2e-f848-4c7a-a29e-148d8871f6b7 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:11.143799 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7872ae-397b-4ba5-8876-543c0129b765 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:11.195550 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84641184-eae0-406c-9090-f1cd6415b2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:11.196436 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84641184-eae0-406c-9090-f1cd6415b2d1 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:11.196720 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84641184-eae0-406c-9090-f1cd6415b2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:11.197003 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84641184-eae0-406c-9090-f1cd6415b2d1 None admin] PATH_INFO: `/v3/projects/a9bedf2584cb4ebfa1dfbe97823ff630` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:11.199602 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af78e2e-f848-4c7a-a29e-148d8871f6b7 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:11.202318 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84641184-eae0-406c-9090-f1cd6415b2d1 None admin] RBAC: Authorizing `identity:get_project(project_id=a9bedf2584cb4ebfa1dfbe97823ff630)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:11.204066 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84641184-eae0-406c-9090-f1cd6415b2d1 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:11.206134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 66/135] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:10 2022] GET /identity/v3/projects/a9bedf2584cb4ebfa1dfbe97823ff630 => generated 312 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:11.211977 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84641184-eae0-406c-9090-f1cd6415b2d1 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:11.236962 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4918a-bdfc-4a02-9374-8d54cd0d6689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:11.237909 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4918a-bdfc-4a02-9374-8d54cd0d6689 None admin] REQUEST_METHOD: `PUT` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:11.238194 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4918a-bdfc-4a02-9374-8d54cd0d6689 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:11.238477 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4918a-bdfc-4a02-9374-8d54cd0d6689 None admin] PATH_INFO: `/v3/projects/049f004d411f4c94a764b0a9955e9216/users/d6c9373bbbf843ee901a91cc4e068dee/roles/2180d183afad443187521833c40ed8a1` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:11.240601 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4918a-bdfc-4a02-9374-8d54cd0d6689 None admin] RBAC: Authorizing `identity:create_grant(project_id=049f004d411f4c94a764b0a9955e9216, user_id=d6c9373bbbf843ee901a91cc4e068dee, role_id=2180d183afad443187521833c40ed8a1)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:11.242164 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4918a-bdfc-4a02-9374-8d54cd0d6689 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:11.268358 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 70/136] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:46:11 2022] PUT /identity/v3/projects/049f004d411f4c94a764b0a9955e9216/users/d6c9373bbbf843ee901a91cc4e068dee/roles/2180d183afad443187521833c40ed8a1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:46:11.364623 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84641184-eae0-406c-9090-f1cd6415b2d1 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:11.400230 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78118a7-5317-47bb-a9ff-630afb7934f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:11.401187 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78118a7-5317-47bb-a9ff-630afb7934f7 None admin] REQUEST_METHOD: `PUT` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:11.401502 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78118a7-5317-47bb-a9ff-630afb7934f7 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:11.401784 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78118a7-5317-47bb-a9ff-630afb7934f7 None admin] PATH_INFO: `/v3/projects/a9bedf2584cb4ebfa1dfbe97823ff630/users/c8e11348f5be4ffaae295f091562aea9/roles/6a75cc334b5a44b5a347a1a0cc20f6d7` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:11.405011 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78118a7-5317-47bb-a9ff-630afb7934f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=a9bedf2584cb4ebfa1dfbe97823ff630, user_id=c8e11348f5be4ffaae295f091562aea9, role_id=6a75cc334b5a44b5a347a1a0cc20f6d7)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:11.407129 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78118a7-5317-47bb-a9ff-630afb7934f7 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:11.430498 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 67/137] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:46:11 2022] PUT /identity/v3/projects/a9bedf2584cb4ebfa1dfbe97823ff630/users/c8e11348f5be4ffaae295f091562aea9/roles/6a75cc334b5a44b5a347a1a0cc20f6d7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:46:12.792125 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b7233-6cd0-497a-8b00-fbb58e8e32b3 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:12.793186 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b7233-6cd0-497a-8b00-fbb58e8e32b3 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:12.793758 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b7233-6cd0-497a-8b00-fbb58e8e32b3 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:12.795357 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 71/138] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:12.801250 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1ac3e-93ad-420a-91bd-dc11630aedcb None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:12.802166 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1ac3e-93ad-420a-91bd-dc11630aedcb None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:12.802681 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1ac3e-93ad-420a-91bd-dc11630aedcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:12.825820 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-f9a1ac3e-93ad-420a-91bd-dc11630aedcb None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:12.828020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-f9a1ac3e-93ad-420a-91bd-dc11630aedcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:12.918690 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 68/139] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:12.963598 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b7233-6cd0-497a-8b00-fbb58e8e32b3 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:13.075606 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b7233-6cd0-497a-8b00-fbb58e8e32b3 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:13.114341 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1ff55-78f7-4059-92dc-6f69604d9a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:13.115561 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1ff55-78f7-4059-92dc-6f69604d9a29 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:13.116074 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1ff55-78f7-4059-92dc-6f69604d9a29 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:13.116572 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1ff55-78f7-4059-92dc-6f69604d9a29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:13.118035 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1ff55-78f7-4059-92dc-6f69604d9a29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:13.119756 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1ff55-78f7-4059-92dc-6f69604d9a29 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:13.122097 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 72/140] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:46:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:13.128359 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1ac3e-93ad-420a-91bd-dc11630aedcb None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:13.251293 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1ac3e-93ad-420a-91bd-dc11630aedcb None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:13.303801 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a54abc-482e-4009-ad95-2b1a6d7a7aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:13.304503 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a54abc-482e-4009-ad95-2b1a6d7a7aa7 None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:13.304793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a54abc-482e-4009-ad95-2b1a6d7a7aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:13.305074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a54abc-482e-4009-ad95-2b1a6d7a7aa7 None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:13.305846 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a54abc-482e-4009-ad95-2b1a6d7a7aa7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:13.307298 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a54abc-482e-4009-ad95-2b1a6d7a7aa7 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:13.337048 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 69/141] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:46:13 2022] POST /identity/v3/users => generated 283 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:46:13.906594 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8e10f-8dc1-438d-815e-d0580995e56b None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:13.907631 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8e10f-8dc1-438d-815e-d0580995e56b None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:13.908154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8e10f-8dc1-438d-815e-d0580995e56b None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:13.910272 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 73/142] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:13.915960 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c6647-cc1f-4a49-8100-501f3b10fe80 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:13.916973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c6647-cc1f-4a49-8100-501f3b10fe80 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:13.917513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c6647-cc1f-4a49-8100-501f3b10fe80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:13.938893 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-a51c6647-cc1f-4a49-8100-501f3b10fe80 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:13.940535 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-a51c6647-cc1f-4a49-8100-501f3b10fe80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:13.946592 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aaa869-c782-43a1-9f36-0b346f44eb26 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:13.946951 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aaa869-c782-43a1-9f36-0b346f44eb26 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:13.947185 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aaa869-c782-43a1-9f36-0b346f44eb26 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:13.950509 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 74/143] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:13.955226 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b095d1a-dd3e-4154-a928-35012da259df None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:13.955587 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b095d1a-dd3e-4154-a928-35012da259df None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:13.955805 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b095d1a-dd3e-4154-a928-35012da259df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:13.986267 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-4b095d1a-dd3e-4154-a928-35012da259df None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:13.987493 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-4b095d1a-dd3e-4154-a928-35012da259df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:14.068045 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 70/144] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:14.088904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 75/145] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:46:14.098693 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c6647-cc1f-4a49-8100-501f3b10fe80 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:14.188481 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b095d1a-dd3e-4154-a928-35012da259df None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:14.267795 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c6647-cc1f-4a49-8100-501f3b10fe80 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:14.336269 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b095d1a-dd3e-4154-a928-35012da259df None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:14.342656 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8937fd-1956-40ef-acc8-258edbf58861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:14.343965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8937fd-1956-40ef-acc8-258edbf58861 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:14.344470 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8937fd-1956-40ef-acc8-258edbf58861 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:14.344963 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8937fd-1956-40ef-acc8-258edbf58861 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:14.367432 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8937fd-1956-40ef-acc8-258edbf58861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:14.377134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-da8937fd-1956-40ef-acc8-258edbf58861 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:46:14.377134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:14.377134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:14.377134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:14.377134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:14.377134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:14.377134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:14.377134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:14.377134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:14.377134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:14.377134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:14.377134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:14.377134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:14.377134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:14.377134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:14.377134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:14.378249 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:14.378249 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:14.378249 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:14.378249 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:14.378249 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:14.378249 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:14.378249 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:14.378249 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:14.378249 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:14.378249 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:14.378249 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:14.378249 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:46:14.378249 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:14.378249 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:14.378249 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:14.378249 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:14.379176 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:14.379176 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:14.379176 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:14.379176 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:14.379176 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:14.379176 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:14.379176 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:14.379176 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:14.379176 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:14.379176 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:14.379176 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:46:14.379176 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:46:14.382277 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 71/146] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:14.383844 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6791f41-a840-4a5d-8a86-b0c10cc01c79 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:14.384367 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6791f41-a840-4a5d-8a86-b0c10cc01c79 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:14.384875 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6791f41-a840-4a5d-8a86-b0c10cc01c79 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:14.386189 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2b68f-d221-4d36-afa0-67892e038615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:14.386997 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 72/147] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:14.387112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2b68f-d221-4d36-afa0-67892e038615 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:14.387379 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2b68f-d221-4d36-afa0-67892e038615 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:14.387715 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2b68f-d221-4d36-afa0-67892e038615 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:14.388732 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6791f41-a840-4a5d-8a86-b0c10cc01c79 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:14.402301 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2b68f-d221-4d36-afa0-67892e038615 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:14.411997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-bae2b68f-d221-4d36-afa0-67892e038615 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:46:14.411997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:14.411997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:14.411997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:14.411997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:14.411997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:14.411997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:14.411997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:14.411997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:14.411997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:14.411997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:14.411997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:14.411997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:14.411997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:14.411997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:14.411997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:14.413223 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:14.413223 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:14.413223 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:14.413223 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:14.413223 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:14.413223 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:14.413223 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:14.413223 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:14.413223 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:14.413223 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:14.413223 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:14.413223 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:46:14.413223 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:14.413223 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:14.413223 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:14.413223 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:14.414174 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:14.414174 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:14.414174 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:14.414174 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:14.414174 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:14.414174 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:14.414174 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:14.414174 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:14.414174 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:14.414174 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:14.414174 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:46:14.414174 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:46:14.414174 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 76/148] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:46:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:46:14.415096 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b46d2e-4a1c-4a2c-9e80-2a003b63b82c None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:14.415815 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b46d2e-4a1c-4a2c-9e80-2a003b63b82c None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:14.416203 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b46d2e-4a1c-4a2c-9e80-2a003b63b82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:14.434756 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-b1b46d2e-4a1c-4a2c-9e80-2a003b63b82c None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:14.436843 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-b1b46d2e-4a1c-4a2c-9e80-2a003b63b82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:14.533467 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 77/149] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:14.534703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b46d2e-4a1c-4a2c-9e80-2a003b63b82c None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:14.540783 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6791f41-a840-4a5d-8a86-b0c10cc01c79 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:14.580639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2623a-5cd0-45b0-90c4-3dc0d09dd5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:14.585419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2623a-5cd0-45b0-90c4-3dc0d09dd5b8 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:14.585419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2623a-5cd0-45b0-90c4-3dc0d09dd5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:14.585419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2623a-5cd0-45b0-90c4-3dc0d09dd5b8 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:14.585419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2623a-5cd0-45b0-90c4-3dc0d09dd5b8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:14.585419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2623a-5cd0-45b0-90c4-3dc0d09dd5b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:14.585419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2623a-5cd0-45b0-90c4-3dc0d09dd5b8 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:14.595220 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 73/150] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:14.602874 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2623a-5cd0-45b0-90c4-3dc0d09dd5b8 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:14.708578 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b46d2e-4a1c-4a2c-9e80-2a003b63b82c None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:14.731113 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2623a-5cd0-45b0-90c4-3dc0d09dd5b8 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:14.766169 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed1c8b-d2e6-4fa8-bbd2-c1ee32bc74b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:14.766930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed1c8b-d2e6-4fa8-bbd2-c1ee32bc74b3 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:14.767201 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa7852-0072-4f9d-9238-f3e154adb805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:14.767349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed1c8b-d2e6-4fa8-bbd2-c1ee32bc74b3 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:14.767560 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed1c8b-d2e6-4fa8-bbd2-c1ee32bc74b3 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:14.768085 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa7852-0072-4f9d-9238-f3e154adb805 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:14.768270 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed1c8b-d2e6-4fa8-bbd2-c1ee32bc74b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:14.768376 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa7852-0072-4f9d-9238-f3e154adb805 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:14.768579 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed1c8b-d2e6-4fa8-bbd2-c1ee32bc74b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:14.768694 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa7852-0072-4f9d-9238-f3e154adb805 None admin] PATH_INFO: `/v3/users/8c51fedf6f6e40b2ac9cf455ef0dbe8e` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:14.769904 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa7852-0072-4f9d-9238-f3e154adb805 None admin] RBAC: Authorizing `identity:get_user(user_id=8c51fedf6f6e40b2ac9cf455ef0dbe8e)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:14.770037 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed1c8b-d2e6-4fa8-bbd2-c1ee32bc74b3 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:14.771335 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa7852-0072-4f9d-9238-f3e154adb805 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:14.774419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 74/151] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:14 2022] GET /identity/v3/users/8c51fedf6f6e40b2ac9cf455ef0dbe8e => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:14.775283 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa7852-0072-4f9d-9238-f3e154adb805 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:14.786901 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 78/152] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:46:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:14.787829 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed1c8b-d2e6-4fa8-bbd2-c1ee32bc74b3 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:14.885776 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa7852-0072-4f9d-9238-f3e154adb805 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:14.919853 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef05d34-82e3-4863-9a0f-75a9fafc4b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:14.920660 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef05d34-82e3-4863-9a0f-75a9fafc4b2f None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:14.922464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef05d34-82e3-4863-9a0f-75a9fafc4b2f None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:14.922464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef05d34-82e3-4863-9a0f-75a9fafc4b2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:14.934048 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef05d34-82e3-4863-9a0f-75a9fafc4b2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:14.943614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-1ef05d34-82e3-4863-9a0f-75a9fafc4b2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:14.943614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:14.943614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:14.943614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:14.943614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:14.943614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:14.943614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:14.943614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:14.943614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:14.943614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:14.943614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:14.943614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:14.943614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:14.943614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:14.943614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:14.943614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:14.946029 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:14.946029 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:14.946029 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:14.946029 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:14.946029 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:14.946029 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:14.946029 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:14.946029 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:14.946029 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:14.946029 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:14.946029 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:14.946029 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:46:14.946029 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:14.946029 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:14.946029 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:14.946029 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:14.948297 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:14.948297 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:14.948297 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:14.948297 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:14.948297 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:14.948297 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:14.948297 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:14.948297 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:14.948297 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:14.948297 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:14.948297 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:14.948297 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:46:14.948297 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 75/153] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:14.948297 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef05d34-82e3-4863-9a0f-75a9fafc4b2f None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:14.972267 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed1c8b-d2e6-4fa8-bbd2-c1ee32bc74b3 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:15.022844 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1888085-3325-4fed-b2ba-2f3dcecdf3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:15.023733 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1888085-3325-4fed-b2ba-2f3dcecdf3e5 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:15.024019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1888085-3325-4fed-b2ba-2f3dcecdf3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:15.024300 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1888085-3325-4fed-b2ba-2f3dcecdf3e5 None admin] PATH_INFO: `/v3/projects/049f004d411f4c94a764b0a9955e9216` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:15.026525 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1888085-3325-4fed-b2ba-2f3dcecdf3e5 None admin] RBAC: Authorizing `identity:get_project(project_id=049f004d411f4c94a764b0a9955e9216)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:15.028017 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1888085-3325-4fed-b2ba-2f3dcecdf3e5 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:15.030149 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 79/154] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:14 2022] GET /identity/v3/projects/049f004d411f4c94a764b0a9955e9216 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:15.030893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1888085-3325-4fed-b2ba-2f3dcecdf3e5 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:15.059295 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef05d34-82e3-4863-9a0f-75a9fafc4b2f None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:15.095805 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a070b9-2498-4d1a-a0e1-6617ae29893b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:15.096862 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a070b9-2498-4d1a-a0e1-6617ae29893b None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:15.097500 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a070b9-2498-4d1a-a0e1-6617ae29893b None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:15.097935 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a070b9-2498-4d1a-a0e1-6617ae29893b None admin] PATH_INFO: `/v3/users/c8e11348f5be4ffaae295f091562aea9` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:15.099565 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a070b9-2498-4d1a-a0e1-6617ae29893b None admin] RBAC: Authorizing `identity:get_user(user_id=c8e11348f5be4ffaae295f091562aea9)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:15.101230 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a070b9-2498-4d1a-a0e1-6617ae29893b None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:15.103733 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 76/155] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:14 2022] GET /identity/v3/users/c8e11348f5be4ffaae295f091562aea9 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:15.106250 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a070b9-2498-4d1a-a0e1-6617ae29893b None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:15.163589 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1888085-3325-4fed-b2ba-2f3dcecdf3e5 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:15.242131 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22135c2d-ea75-44da-a47e-2264f694993d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:15.242846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22135c2d-ea75-44da-a47e-2264f694993d None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:15.243343 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22135c2d-ea75-44da-a47e-2264f694993d None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:15.243477 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22135c2d-ea75-44da-a47e-2264f694993d None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:15.244149 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22135c2d-ea75-44da-a47e-2264f694993d None admin] RBAC: Adding query filter params (name=member) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:15.244497 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22135c2d-ea75-44da-a47e-2264f694993d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:15.245905 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22135c2d-ea75-44da-a47e-2264f694993d None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:15.247093 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a070b9-2498-4d1a-a0e1-6617ae29893b None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:15.255467 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 80/156] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:15.256338 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22135c2d-ea75-44da-a47e-2264f694993d None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:15.286955 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c465b-3b97-4d42-b874-4d76c114040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:15.288282 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c465b-3b97-4d42-b874-4d76c114040a None admin] REQUEST_METHOD: `PUT` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:15.288783 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c465b-3b97-4d42-b874-4d76c114040a None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:15.289293 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c465b-3b97-4d42-b874-4d76c114040a None admin] PATH_INFO: `/v3/projects/049f004d411f4c94a764b0a9955e9216/users/8c51fedf6f6e40b2ac9cf455ef0dbe8e/roles/b890511935cc4c2fa062153280c4cd25` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:15.291624 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c465b-3b97-4d42-b874-4d76c114040a None admin] RBAC: Authorizing `identity:create_grant(project_id=049f004d411f4c94a764b0a9955e9216, user_id=8c51fedf6f6e40b2ac9cf455ef0dbe8e, role_id=b890511935cc4c2fa062153280c4cd25)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:15.293325 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c465b-3b97-4d42-b874-4d76c114040a None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:15.322925 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 77/157] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:46:15 2022] PUT /identity/v3/projects/049f004d411f4c94a764b0a9955e9216/users/8c51fedf6f6e40b2ac9cf455ef0dbe8e/roles/b890511935cc4c2fa062153280c4cd25 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:46:15.324675 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ecfc6-f288-453b-986f-8bb206e899a9 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:15.325242 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ecfc6-f288-453b-986f-8bb206e899a9 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:15.325797 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ecfc6-f288-453b-986f-8bb206e899a9 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:15.327540 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 78/158] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:15.337403 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589657c-2e85-4ef5-98dd-a30d3948bfc6 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:15.338267 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589657c-2e85-4ef5-98dd-a30d3948bfc6 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:15.338817 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589657c-2e85-4ef5-98dd-a30d3948bfc6 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:15.340597 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 79/159] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:15 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:15.341693 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589657c-2e85-4ef5-98dd-a30d3948bfc6 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:15.365971 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22135c2d-ea75-44da-a47e-2264f694993d None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:15.410586 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e849e-2b1e-4882-ba29-e595f9555535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:15.411275 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e849e-2b1e-4882-ba29-e595f9555535 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:15.411563 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e849e-2b1e-4882-ba29-e595f9555535 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:15.411839 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e849e-2b1e-4882-ba29-e595f9555535 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:15.535376 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589657c-2e85-4ef5-98dd-a30d3948bfc6 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:15.563418 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e849e-2b1e-4882-ba29-e595f9555535 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:15.566434 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e849e-2b1e-4882-ba29-e595f9555535 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:15.606865 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707079a-8071-4d66-93f1-d31bef17b98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:15.607684 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707079a-8071-4d66-93f1-d31bef17b98e None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:15.607963 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707079a-8071-4d66-93f1-d31bef17b98e None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:15.608749 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707079a-8071-4d66-93f1-d31bef17b98e None admin] PATH_INFO: `/v3/users/c8e11348f5be4ffaae295f091562aea9` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:15.610158 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707079a-8071-4d66-93f1-d31bef17b98e None admin] RBAC: Authorizing `identity:get_user(user_id=c8e11348f5be4ffaae295f091562aea9)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:15.611752 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707079a-8071-4d66-93f1-d31bef17b98e None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:15.614640 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 80/160] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:15 2022] GET /identity/v3/users/c8e11348f5be4ffaae295f091562aea9 => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:15.616684 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76d65d-f2e5-45be-8af9-99d1c3601a64 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:15.617404 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76d65d-f2e5-45be-8af9-99d1c3601a64 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:15.617404 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76d65d-f2e5-45be-8af9-99d1c3601a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:15.651850 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-3d76d65d-f2e5-45be-8af9-99d1c3601a64 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:15.654835 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-3d76d65d-f2e5-45be-8af9-99d1c3601a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:15.747251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 81/161] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:46:15.748983 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae4c27-46fa-44b9-b876-3ea319036876 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:15.749513 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae4c27-46fa-44b9-b876-3ea319036876 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:15.750743 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae4c27-46fa-44b9-b876-3ea319036876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:15.770006 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-58ae4c27-46fa-44b9-b876-3ea319036876 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:15.771903 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-58ae4c27-46fa-44b9-b876-3ea319036876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:15.810737 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 81/162] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:15.812224 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76d65d-f2e5-45be-8af9-99d1c3601a64 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:15.849284 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 82/163] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:15.850690 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae4c27-46fa-44b9-b876-3ea319036876 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:15.989692 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae4c27-46fa-44b9-b876-3ea319036876 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:16.029219 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86888cde-b194-4240-b2d7-0a6ae42fc39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:16.031211 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86888cde-b194-4240-b2d7-0a6ae42fc39f None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:16.032614 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86888cde-b194-4240-b2d7-0a6ae42fc39f None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:16.033113 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86888cde-b194-4240-b2d7-0a6ae42fc39f None admin] PATH_INFO: `/v3/projects/049f004d411f4c94a764b0a9955e9216` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:16.034687 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86888cde-b194-4240-b2d7-0a6ae42fc39f None admin] RBAC: Authorizing `identity:get_project(project_id=049f004d411f4c94a764b0a9955e9216)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:16.036429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86888cde-b194-4240-b2d7-0a6ae42fc39f None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:16.039053 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 83/164] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:15 2022] GET /identity/v3/projects/049f004d411f4c94a764b0a9955e9216 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:16.040073 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86888cde-b194-4240-b2d7-0a6ae42fc39f None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:16.100684 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76d65d-f2e5-45be-8af9-99d1c3601a64 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:16.158294 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86888cde-b194-4240-b2d7-0a6ae42fc39f None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:16.194157 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d5b82-931a-4014-8447-9f75a2f65af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:16.194845 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d5b82-931a-4014-8447-9f75a2f65af0 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:16.195135 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d5b82-931a-4014-8447-9f75a2f65af0 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:16.195417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d5b82-931a-4014-8447-9f75a2f65af0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:16.212110 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe87afc-c768-489a-a670-fd674d1ee02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:16.212966 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe87afc-c768-489a-a670-fd674d1ee02e None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:16.213459 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe87afc-c768-489a-a670-fd674d1ee02e None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:16.213894 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe87afc-c768-489a-a670-fd674d1ee02e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:16.254187 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe87afc-c768-489a-a670-fd674d1ee02e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:16.262456 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-7fe87afc-c768-489a-a670-fd674d1ee02e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:46:16.262456 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:16.262456 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:16.262456 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:16.262456 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:16.262456 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:16.262456 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:16.262456 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:16.262456 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:16.262456 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:16.262456 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:16.262456 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:16.262456 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:16.262456 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:16.262456 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:16.262456 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:16.263677 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:16.263677 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:16.263677 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:16.263677 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:16.263677 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:16.263677 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:16.263677 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:16.263677 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:16.263677 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:16.263677 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:16.263677 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:16.263677 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:46:16.263677 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:16.263677 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:16.263677 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:16.263677 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:16.265146 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:16.265146 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:16.265146 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:16.265146 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:16.265146 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:16.265146 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:16.265146 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:16.265146 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:16.265146 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:16.265146 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:16.265146 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:46:16.265146 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:46:16.271347 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d5b82-931a-4014-8447-9f75a2f65af0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:16.273011 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d5b82-931a-4014-8447-9f75a2f65af0 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:16.274920 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 84/165] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:46:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:16.275772 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe87afc-c768-489a-a670-fd674d1ee02e None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:16.392021 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 82/166] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:46:16.393438 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d5b82-931a-4014-8447-9f75a2f65af0 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:16.504162 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d5b82-931a-4014-8447-9f75a2f65af0 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:16.511656 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe87afc-c768-489a-a670-fd674d1ee02e None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:16.545409 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d065d8f-c03a-4018-9893-5fde44276315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:16.546984 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d065d8f-c03a-4018-9893-5fde44276315 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:16.547520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d065d8f-c03a-4018-9893-5fde44276315 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:16.548143 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d065d8f-c03a-4018-9893-5fde44276315 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:16.549249 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d065d8f-c03a-4018-9893-5fde44276315 None admin] RBAC: Adding query filter params (role.id=cf8c8db912344d0f82f8e6b0fa805968, scope.project.id=049f004d411f4c94a764b0a9955e9216, user.id=c8e11348f5be4ffaae295f091562aea9) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:16.549842 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d065d8f-c03a-4018-9893-5fde44276315 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:16.551520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d065d8f-c03a-4018-9893-5fde44276315 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:16.559063 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 83/167] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:46:16 2022] GET /identity/v3/role_assignments?user.id=c8e11348f5be4ffaae295f091562aea9&scope.project.id=049f004d411f4c94a764b0a9955e9216&role.id=cf8c8db912344d0f82f8e6b0fa805968 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:16.560337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d065d8f-c03a-4018-9893-5fde44276315 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:16.615965 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cb896-d708-4193-8440-06a664f9579f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:16.616805 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cb896-d708-4193-8440-06a664f9579f None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:16.617098 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cb896-d708-4193-8440-06a664f9579f None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:16.617413 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cb896-d708-4193-8440-06a664f9579f None admin] PATH_INFO: `/v3/roles/member` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:16.670516 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945cb896-d708-4193-8440-06a664f9579f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:16.679401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-945cb896-d708-4193-8440-06a664f9579f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:16.679401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:16.679401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:16.679401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:16.679401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:16.679401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:16.679401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:16.679401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:16.679401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:16.679401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:16.679401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:16.679401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:16.679401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:16.679401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:16.679401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:16.679401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:16.680688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:16.680688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:16.680688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:16.680688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:16.680688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:16.680688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:16.680688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:16.680688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:16.680688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:16.680688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:16.680688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:16.680688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:46:16.680688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:16.680688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:16.680688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:16.680688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:16.681855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:16.681855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:16.681855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:16.681855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:16.681855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:16.681855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:16.681855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:16.681855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:16.681855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:16.681855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:16.681855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:16.681855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:46:16.684243 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 85/168] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:16.685321 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cb896-d708-4193-8440-06a664f9579f None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:16.705430 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d065d8f-c03a-4018-9893-5fde44276315 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:16.751627 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df784cdc-a6b1-4153-890d-3ab6ce59d19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:16.752334 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df784cdc-a6b1-4153-890d-3ab6ce59d19f None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:16.752622 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df784cdc-a6b1-4153-890d-3ab6ce59d19f None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:16.752904 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df784cdc-a6b1-4153-890d-3ab6ce59d19f None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:16.758759 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df784cdc-a6b1-4153-890d-3ab6ce59d19f None admin] RBAC: Adding query filter params (name=admin) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:16.759090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df784cdc-a6b1-4153-890d-3ab6ce59d19f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:16.760521 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df784cdc-a6b1-4153-890d-3ab6ce59d19f None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:16.784748 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 84/169] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:16.785577 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df784cdc-a6b1-4153-890d-3ab6ce59d19f None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:16.935543 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cb896-d708-4193-8440-06a664f9579f None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:16.989790 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df784cdc-a6b1-4153-890d-3ab6ce59d19f None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:17.007181 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf2025-4563-47c6-ae77-59d913096c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:17.008065 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf2025-4563-47c6-ae77-59d913096c99 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:17.008352 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf2025-4563-47c6-ae77-59d913096c99 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:17.008630 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf2025-4563-47c6-ae77-59d913096c99 None admin] PATH_INFO: `/v3/projects/049f004d411f4c94a764b0a9955e9216` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:17.010056 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf2025-4563-47c6-ae77-59d913096c99 None admin] RBAC: Authorizing `identity:get_project(project_id=049f004d411f4c94a764b0a9955e9216)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:17.011750 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf2025-4563-47c6-ae77-59d913096c99 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:17.014360 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 86/170] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:16 2022] GET /identity/v3/projects/049f004d411f4c94a764b0a9955e9216 => generated 298 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:17.018515 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf2025-4563-47c6-ae77-59d913096c99 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:17.055600 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e1e02-a285-4ea0-bf22-4c4ed31b5741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:17.056923 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e1e02-a285-4ea0-bf22-4c4ed31b5741 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:17.058957 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e1e02-a285-4ea0-bf22-4c4ed31b5741 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:17.059473 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e1e02-a285-4ea0-bf22-4c4ed31b5741 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:17.060460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e1e02-a285-4ea0-bf22-4c4ed31b5741 None admin] RBAC: Adding query filter params (name=member) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:17.065599 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e1e02-a285-4ea0-bf22-4c4ed31b5741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:17.067400 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e1e02-a285-4ea0-bf22-4c4ed31b5741 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:17.086627 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 85/171] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:17.088567 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e1e02-a285-4ea0-bf22-4c4ed31b5741 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:17.179198 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf2025-4563-47c6-ae77-59d913096c99 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:17.214134 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c81e4-1851-4db4-92eb-b99b82a84e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:17.215423 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c81e4-1851-4db4-92eb-b99b82a84e70 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:17.215943 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c81e4-1851-4db4-92eb-b99b82a84e70 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:17.216482 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c81e4-1851-4db4-92eb-b99b82a84e70 None admin] PATH_INFO: `/v3/users/d6c9373bbbf843ee901a91cc4e068dee` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:17.218609 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c81e4-1851-4db4-92eb-b99b82a84e70 None admin] RBAC: Authorizing `identity:get_user(user_id=d6c9373bbbf843ee901a91cc4e068dee)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:17.220308 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c81e4-1851-4db4-92eb-b99b82a84e70 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:17.222234 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 87/172] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:17 2022] GET /identity/v3/users/d6c9373bbbf843ee901a91cc4e068dee => generated 247 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:17.223234 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c81e4-1851-4db4-92eb-b99b82a84e70 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:17.230770 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e1e02-a285-4ea0-bf22-4c4ed31b5741 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:17.273893 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ea53c-303c-4af4-8032-8ff1a5548a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:17.274604 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ea53c-303c-4af4-8032-8ff1a5548a1a None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:17.274879 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ea53c-303c-4af4-8032-8ff1a5548a1a None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:17.275160 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ea53c-303c-4af4-8032-8ff1a5548a1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:17.276046 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ea53c-303c-4af4-8032-8ff1a5548a1a None admin] RBAC: Adding query filter params (role.id=6a75cc334b5a44b5a347a1a0cc20f6d7, scope.project.id=049f004d411f4c94a764b0a9955e9216, user.id=c8e11348f5be4ffaae295f091562aea9) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:17.276371 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ea53c-303c-4af4-8032-8ff1a5548a1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:17.278024 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ea53c-303c-4af4-8032-8ff1a5548a1a None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:17.296351 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 86/173] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:46:17 2022] GET /identity/v3/role_assignments?user.id=c8e11348f5be4ffaae295f091562aea9&scope.project.id=049f004d411f4c94a764b0a9955e9216&role.id=6a75cc334b5a44b5a347a1a0cc20f6d7 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:17.297452 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ea53c-303c-4af4-8032-8ff1a5548a1a None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:17.457593 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c81e4-1851-4db4-92eb-b99b82a84e70 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:17.502100 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ea53c-303c-4af4-8032-8ff1a5548a1a None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:17.526201 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad2469-68a8-471b-ab38-9261e1ab67bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:17.527118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad2469-68a8-471b-ab38-9261e1ab67bf None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:17.527406 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad2469-68a8-471b-ab38-9261e1ab67bf None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:17.527687 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad2469-68a8-471b-ab38-9261e1ab67bf None admin] PATH_INFO: `/v3/users/c8e11348f5be4ffaae295f091562aea9` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:17.529071 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad2469-68a8-471b-ab38-9261e1ab67bf None admin] RBAC: Authorizing `identity:get_user(user_id=c8e11348f5be4ffaae295f091562aea9)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:17.531119 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad2469-68a8-471b-ab38-9261e1ab67bf None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:17.533482 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 88/174] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:17 2022] GET /identity/v3/users/c8e11348f5be4ffaae295f091562aea9 => generated 275 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:17.539994 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad2469-68a8-471b-ab38-9261e1ab67bf None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:17.572192 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e03cfb-2e7d-435e-946c-44439966ea17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:17.572872 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e03cfb-2e7d-435e-946c-44439966ea17 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:17.573163 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e03cfb-2e7d-435e-946c-44439966ea17 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:17.573484 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e03cfb-2e7d-435e-946c-44439966ea17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:17.713919 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e03cfb-2e7d-435e-946c-44439966ea17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:17.715334 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e03cfb-2e7d-435e-946c-44439966ea17 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:17.737741 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad2469-68a8-471b-ab38-9261e1ab67bf None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:17.822955 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f3c34-e5b5-478d-b386-30bfac5aa6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:17.823627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f3c34-e5b5-478d-b386-30bfac5aa6eb None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:17.823911 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f3c34-e5b5-478d-b386-30bfac5aa6eb None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:17.824191 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f3c34-e5b5-478d-b386-30bfac5aa6eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:17.824693 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 87/175] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:46:17.831323 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e03cfb-2e7d-435e-946c-44439966ea17 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:17.969727 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e03cfb-2e7d-435e-946c-44439966ea17 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:17.982326 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f3c34-e5b5-478d-b386-30bfac5aa6eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:17.985712 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f3c34-e5b5-478d-b386-30bfac5aa6eb None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:18.035663 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a177ec-18f8-4b8b-998f-4197fab8b41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:18.037467 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a177ec-18f8-4b8b-998f-4197fab8b41f None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:18.038142 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a177ec-18f8-4b8b-998f-4197fab8b41f None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:18.038809 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a177ec-18f8-4b8b-998f-4197fab8b41f None admin] PATH_INFO: `/v3/projects/049f004d411f4c94a764b0a9955e9216` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:18.042575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a177ec-18f8-4b8b-998f-4197fab8b41f None admin] RBAC: Authorizing `identity:get_project(project_id=049f004d411f4c94a764b0a9955e9216)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:18.045556 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a177ec-18f8-4b8b-998f-4197fab8b41f None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:18.049069 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 88/176] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:17 2022] GET /identity/v3/projects/049f004d411f4c94a764b0a9955e9216 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:18.058656 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a177ec-18f8-4b8b-998f-4197fab8b41f None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:18.187193 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 89/177] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:46:18.195459 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f3c34-e5b5-478d-b386-30bfac5aa6eb None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:18.333886 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a177ec-18f8-4b8b-998f-4197fab8b41f None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:18.387450 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990db8f-7c11-4094-aa1d-870411e10e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:18.388544 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990db8f-7c11-4094-aa1d-870411e10e93 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:18.389023 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990db8f-7c11-4094-aa1d-870411e10e93 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:18.390055 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990db8f-7c11-4094-aa1d-870411e10e93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:18.391109 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990db8f-7c11-4094-aa1d-870411e10e93 None admin] RBAC: Adding query filter params (role.id=2180d183afad443187521833c40ed8a1, scope.project.id=049f004d411f4c94a764b0a9955e9216, user.id=d6c9373bbbf843ee901a91cc4e068dee) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:18.391616 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990db8f-7c11-4094-aa1d-870411e10e93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:18.393269 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990db8f-7c11-4094-aa1d-870411e10e93 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:18.400773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 89/178] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:46:18 2022] GET /identity/v3/role_assignments?user.id=d6c9373bbbf843ee901a91cc4e068dee&scope.project.id=049f004d411f4c94a764b0a9955e9216&role.id=2180d183afad443187521833c40ed8a1 => generated 608 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:18.402605 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b18776-dd09-454b-97f8-496e605a6b1d None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:18.403104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b18776-dd09-454b-97f8-496e605a6b1d None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:18.403594 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b18776-dd09-454b-97f8-496e605a6b1d None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:18.409937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 90/179] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:18.411753 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dbafc-e102-49f9-aff9-a431dd0f27e2 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:18.412237 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dbafc-e102-49f9-aff9-a431dd0f27e2 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:18.412736 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dbafc-e102-49f9-aff9-a431dd0f27e2 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:18.414675 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 91/180] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:18.416121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c411213-f627-4287-8334-f4d0ab8ef3c3 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:18.420912 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c411213-f627-4287-8334-f4d0ab8ef3c3 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:18.421605 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c411213-f627-4287-8334-f4d0ab8ef3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:18.454862 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-5c411213-f627-4287-8334-f4d0ab8ef3c3 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:18.456100 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-5c411213-f627-4287-8334-f4d0ab8ef3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:18.474447 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f3c34-e5b5-478d-b386-30bfac5aa6eb None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:18.543603 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8858cfb-178e-473d-b75a-ebedc5056703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:18.544491 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8858cfb-178e-473d-b75a-ebedc5056703 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:18.544776 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8858cfb-178e-473d-b75a-ebedc5056703 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:18.545084 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8858cfb-178e-473d-b75a-ebedc5056703 None admin] PATH_INFO: `/v3/projects/a9bedf2584cb4ebfa1dfbe97823ff630` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:18.548070 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8858cfb-178e-473d-b75a-ebedc5056703 None admin] RBAC: Authorizing `identity:get_project(project_id=a9bedf2584cb4ebfa1dfbe97823ff630)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:18.549638 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8858cfb-178e-473d-b75a-ebedc5056703 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:18.551634 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 90/181] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:18 2022] GET /identity/v3/projects/a9bedf2584cb4ebfa1dfbe97823ff630 => generated 312 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:18.553922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d2845-8179-4d07-a218-9bb368e2f05a None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:18.554397 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d2845-8179-4d07-a218-9bb368e2f05a None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:18.554849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d2845-8179-4d07-a218-9bb368e2f05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:18.580322 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-1a2d2845-8179-4d07-a218-9bb368e2f05a None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:18.583465 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-1a2d2845-8179-4d07-a218-9bb368e2f05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:18.599763 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 92/182] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:18.600709 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c411213-f627-4287-8334-f4d0ab8ef3c3 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:18.698640 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 91/183] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:18.700348 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3069be-ad29-4f9d-94c4-6013f67437ca None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:18.700645 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3069be-ad29-4f9d-94c4-6013f67437ca None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:18.700921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3069be-ad29-4f9d-94c4-6013f67437ca None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:18.706937 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 92/184] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:18.708065 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3069be-ad29-4f9d-94c4-6013f67437ca None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:18.769543 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c411213-f627-4287-8334-f4d0ab8ef3c3 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:18.805881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1bdcf-1bc8-44ed-9afd-35843ff4c7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:18.806565 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1bdcf-1bc8-44ed-9afd-35843ff4c7a6 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:18.806855 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1bdcf-1bc8-44ed-9afd-35843ff4c7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:18.807138 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1bdcf-1bc8-44ed-9afd-35843ff4c7a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:18.807998 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1bdcf-1bc8-44ed-9afd-35843ff4c7a6 None admin] RBAC: Adding query filter params (role.id=6a75cc334b5a44b5a347a1a0cc20f6d7, scope.project.id=a9bedf2584cb4ebfa1dfbe97823ff630, user.id=c8e11348f5be4ffaae295f091562aea9) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:18.808341 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1bdcf-1bc8-44ed-9afd-35843ff4c7a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:18.809823 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1bdcf-1bc8-44ed-9afd-35843ff4c7a6 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:18.825393 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 93/185] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:46:18 2022] GET /identity/v3/role_assignments?user.id=c8e11348f5be4ffaae295f091562aea9&scope.project.id=a9bedf2584cb4ebfa1dfbe97823ff630&role.id=6a75cc334b5a44b5a347a1a0cc20f6d7 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:18.825393 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9f37b-07a3-40eb-be1e-78e0c017daf1 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:18.825393 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9f37b-07a3-40eb-be1e-78e0c017daf1 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:18.825393 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9f37b-07a3-40eb-be1e-78e0c017daf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:18.836971 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3069be-ad29-4f9d-94c4-6013f67437ca None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:18.837223 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-95a9f37b-07a3-40eb-be1e-78e0c017daf1 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:18.838554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-95a9f37b-07a3-40eb-be1e-78e0c017daf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:18.889613 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e704b-3fd2-4694-a981-f069b5408d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:18.891647 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e704b-3fd2-4694-a981-f069b5408d0f None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:18.892379 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e704b-3fd2-4694-a981-f069b5408d0f None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:18.893401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e704b-3fd2-4694-a981-f069b5408d0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:18.910579 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e704b-3fd2-4694-a981-f069b5408d0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:18.921840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-4c5e704b-3fd2-4694-a981-f069b5408d0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:46:18.921840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:18.921840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:18.921840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:18.921840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:18.921840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:18.921840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:18.921840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:18.921840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:18.921840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:18.921840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:18.921840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:18.921840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:18.921840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:18.921840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:18.921840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:18.922983 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:18.922983 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:18.922983 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:18.922983 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:18.922983 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:18.922983 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:18.922983 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:18.922983 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:18.922983 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:18.922983 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:18.922983 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:18.922983 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:46:18.922983 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:18.922983 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:18.922983 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:18.922983 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:18.923922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:18.923922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:18.923922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:18.923922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:18.923922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:18.923922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:18.923922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:18.923922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:18.923922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:18.923922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:18.923922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:46:18.923922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:46:18.924721 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 94/186] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:18.930466 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9f37b-07a3-40eb-be1e-78e0c017daf1 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:18.931946 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 93/187] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:46:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:18.933072 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e704b-3fd2-4694-a981-f069b5408d0f None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:19.057253 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e704b-3fd2-4694-a981-f069b5408d0f None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:19.079428 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9f37b-07a3-40eb-be1e-78e0c017daf1 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:19.098762 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbb81c-3eef-4b3c-bcd0-0f20f3f305b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:19.099755 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbb81c-3eef-4b3c-bcd0-0f20f3f305b8 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:19.100216 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbb81c-3eef-4b3c-bcd0-0f20f3f305b8 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:19.100664 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbb81c-3eef-4b3c-bcd0-0f20f3f305b8 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:19.101665 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbb81c-3eef-4b3c-bcd0-0f20f3f305b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:19.102028 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbb81c-3eef-4b3c-bcd0-0f20f3f305b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:19.103433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbb81c-3eef-4b3c-bcd0-0f20f3f305b8 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:19.114471 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 94/188] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:19.115377 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbb81c-3eef-4b3c-bcd0-0f20f3f305b8 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:19.128265 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48448d4-8243-4b76-a712-53e5ff4cc9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:19.129131 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48448d4-8243-4b76-a712-53e5ff4cc9b4 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:19.129449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48448d4-8243-4b76-a712-53e5ff4cc9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:19.129931 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48448d4-8243-4b76-a712-53e5ff4cc9b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:19.143625 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48448d4-8243-4b76-a712-53e5ff4cc9b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:19.152318 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-c48448d4-8243-4b76-a712-53e5ff4cc9b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:46:19.152318 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:19.152318 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:19.152318 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:19.152318 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:19.152318 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:19.152318 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:19.152318 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:19.152318 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:19.152318 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:19.152318 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:19.152318 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:19.152318 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:19.152318 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:19.152318 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:19.152318 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:19.153513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:19.153513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:19.153513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:19.153513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:19.153513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:19.153513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:19.153513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:19.153513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:19.153513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:19.153513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:19.153513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:19.153513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:46:19.153513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:19.153513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:19.153513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:19.153513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:19.154448 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:19.154448 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:19.154448 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:19.154448 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:19.154448 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:19.154448 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:19.154448 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:19.154448 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:19.154448 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:19.154448 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:19.154448 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:46:19.154448 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:46:19.154448 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 95/189] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:46:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:19.156785 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48448d4-8243-4b76-a712-53e5ff4cc9b4 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:19.235611 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbb81c-3eef-4b3c-bcd0-0f20f3f305b8 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:19.285071 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c184783-62e0-45f8-85c3-7e32fb967d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:19.285678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48448d4-8243-4b76-a712-53e5ff4cc9b4 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:19.285902 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c184783-62e0-45f8-85c3-7e32fb967d5a None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:19.286189 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c184783-62e0-45f8-85c3-7e32fb967d5a None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:19.286465 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c184783-62e0-45f8-85c3-7e32fb967d5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:19.287793 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c184783-62e0-45f8-85c3-7e32fb967d5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:19.289263 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c184783-62e0-45f8-85c3-7e32fb967d5a None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:19.295696 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 95/190] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:46:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:19.295696 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c184783-62e0-45f8-85c3-7e32fb967d5a None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:19.341590 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856f338-763b-448f-819b-b73c4c13f7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:19.343663 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856f338-763b-448f-819b-b73c4c13f7e3 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:19.344125 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856f338-763b-448f-819b-b73c4c13f7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:19.344616 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856f338-763b-448f-819b-b73c4c13f7e3 None admin] PATH_INFO: `/v3/users/3c6572180f9b45538afe7edd1939cdd6` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:19.370548 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856f338-763b-448f-819b-b73c4c13f7e3 None admin] RBAC: Authorizing `identity:get_user(user_id=3c6572180f9b45538afe7edd1939cdd6)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:19.373315 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856f338-763b-448f-819b-b73c4c13f7e3 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:19.377033 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 96/191] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:19 2022] GET /identity/v3/users/3c6572180f9b45538afe7edd1939cdd6 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:19.378252 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856f338-763b-448f-819b-b73c4c13f7e3 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:19.400592 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c184783-62e0-45f8-85c3-7e32fb967d5a None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:19.433381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e53b79-2880-4636-a7ff-bae15894937c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:19.434067 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e53b79-2880-4636-a7ff-bae15894937c None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:19.434356 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e53b79-2880-4636-a7ff-bae15894937c None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:19.434637 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e53b79-2880-4636-a7ff-bae15894937c None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:19.435405 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e53b79-2880-4636-a7ff-bae15894937c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:19.435718 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e53b79-2880-4636-a7ff-bae15894937c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:19.437339 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e53b79-2880-4636-a7ff-bae15894937c None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:19.445253 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 96/192] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:46:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:19.446556 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004df114-073e-4f3d-92df-5684f5aaa74b None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:19.446833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004df114-073e-4f3d-92df-5684f5aaa74b None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:19.447121 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004df114-073e-4f3d-92df-5684f5aaa74b None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:19.448369 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 97/193] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:19.450259 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004df114-073e-4f3d-92df-5684f5aaa74b None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:19.508813 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856f338-763b-448f-819b-b73c4c13f7e3 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:19.544647 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d622c69-b05a-40fd-8f84-9c7b8fee36e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:19.545524 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d622c69-b05a-40fd-8f84-9c7b8fee36e5 None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:19.546031 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d622c69-b05a-40fd-8f84-9c7b8fee36e5 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:19.546892 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d622c69-b05a-40fd-8f84-9c7b8fee36e5 None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:19.547857 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d622c69-b05a-40fd-8f84-9c7b8fee36e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:19.549607 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d622c69-b05a-40fd-8f84-9c7b8fee36e5 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:19.555953 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004df114-073e-4f3d-92df-5684f5aaa74b None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:19.568851 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 97/194] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:46:19 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:46:19.570171 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9e5bd-4703-4b93-bed7-78a583a8035b None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:19.570464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9e5bd-4703-4b93-bed7-78a583a8035b None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:19.570782 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9e5bd-4703-4b93-bed7-78a583a8035b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:19.589124 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-dcd9e5bd-4703-4b93-bed7-78a583a8035b None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:19.590433 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-dcd9e5bd-4703-4b93-bed7-78a583a8035b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:19.599771 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1226f-e416-4726-8df2-9a26752f1acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:19.600452 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1226f-e416-4726-8df2-9a26752f1acd None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:19.600740 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1226f-e416-4726-8df2-9a26752f1acd None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:19.601019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1226f-e416-4726-8df2-9a26752f1acd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:19.669914 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 98/195] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:19.670654 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9e5bd-4703-4b93-bed7-78a583a8035b None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:19.699585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1226f-e416-4726-8df2-9a26752f1acd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:19.701473 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1226f-e416-4726-8df2-9a26752f1acd None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:19.806402 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9e5bd-4703-4b93-bed7-78a583a8035b None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:19.828414 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 98/196] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:46:19.829295 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1226f-e416-4726-8df2-9a26752f1acd None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:19.851760 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96205bb-bb29-4206-ba95-5b3e0c952942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:19.852697 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96205bb-bb29-4206-ba95-5b3e0c952942 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:19.852980 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96205bb-bb29-4206-ba95-5b3e0c952942 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:19.853249 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96205bb-bb29-4206-ba95-5b3e0c952942 None admin] PATH_INFO: `/v3/users/3c6572180f9b45538afe7edd1939cdd6` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:19.854553 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96205bb-bb29-4206-ba95-5b3e0c952942 None admin] RBAC: Authorizing `identity:get_user(user_id=3c6572180f9b45538afe7edd1939cdd6)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:19.856020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96205bb-bb29-4206-ba95-5b3e0c952942 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:19.857899 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 99/197] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:19 2022] GET /identity/v3/users/3c6572180f9b45538afe7edd1939cdd6 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:19.862439 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96205bb-bb29-4206-ba95-5b3e0c952942 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:19.959086 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1226f-e416-4726-8df2-9a26752f1acd None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:19.989680 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96205bb-bb29-4206-ba95-5b3e0c952942 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:19.999725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421eaa8-b04b-4041-a861-c232d5047b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:20.000808 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421eaa8-b04b-4041-a861-c232d5047b11 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:20.001093 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421eaa8-b04b-4041-a861-c232d5047b11 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:20.001392 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421eaa8-b04b-4041-a861-c232d5047b11 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:20.012568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421eaa8-b04b-4041-a861-c232d5047b11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:20.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-a421eaa8-b04b-4041-a861-c232d5047b11 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:46:20.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:20.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:20.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:20.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:20.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:20.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:20.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:20.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:20.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:20.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:20.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:20.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:20.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:20.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:20.020626 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:20.021722 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:20.021722 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:20.021722 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:20.021722 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:20.021722 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:20.021722 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:20.021722 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:20.021722 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:20.021722 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:20.021722 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:20.021722 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:20.021722 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:46:20.021722 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:20.021722 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:20.021722 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:20.021722 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:20.022658 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:20.022658 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:20.022658 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:20.022658 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:20.022658 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:20.022658 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:20.022658 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:20.022658 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:20.022658 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:20.022658 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:20.022658 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:46:20.022658 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:46:20.022658 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 99/198] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:20.024460 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421eaa8-b04b-4041-a861-c232d5047b11 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:20.031727 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da4248-48d9-4784-ac3c-d4fc4a21d358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:20.032613 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da4248-48d9-4784-ac3c-d4fc4a21d358 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:20.032895 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da4248-48d9-4784-ac3c-d4fc4a21d358 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:20.033173 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da4248-48d9-4784-ac3c-d4fc4a21d358 None admin] PATH_INFO: `/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:20.034466 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da4248-48d9-4784-ac3c-d4fc4a21d358 None admin] RBAC: Authorizing `identity:get_project(project_id=8eb38f20a7f646d49f0c1da50ff81db2)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:20.035918 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da4248-48d9-4784-ac3c-d4fc4a21d358 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:20.037688 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 100/199] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:19 2022] GET /identity/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:20.038743 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da4248-48d9-4784-ac3c-d4fc4a21d358 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:20.130014 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421eaa8-b04b-4041-a861-c232d5047b11 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:20.144494 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da4248-48d9-4784-ac3c-d4fc4a21d358 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:20.164912 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f448cd3-ec0e-44ed-bd10-5b042531fb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:20.165619 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f448cd3-ec0e-44ed-bd10-5b042531fb18 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:20.165910 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f448cd3-ec0e-44ed-bd10-5b042531fb18 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:20.166193 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f448cd3-ec0e-44ed-bd10-5b042531fb18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:20.180774 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f0f4f-94ec-4229-b12b-8e0f714fdc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:20.181488 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f0f4f-94ec-4229-b12b-8e0f714fdc00 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:20.181777 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f0f4f-94ec-4229-b12b-8e0f714fdc00 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:20.182064 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f0f4f-94ec-4229-b12b-8e0f714fdc00 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:20.182834 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f0f4f-94ec-4229-b12b-8e0f714fdc00 None admin] RBAC: Adding query filter params (name=reader) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:20.183145 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f0f4f-94ec-4229-b12b-8e0f714fdc00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:20.184763 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f0f4f-94ec-4229-b12b-8e0f714fdc00 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:20.194285 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 101/200] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:20.195052 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f0f4f-94ec-4229-b12b-8e0f714fdc00 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:20.237101 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f448cd3-ec0e-44ed-bd10-5b042531fb18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:20.238537 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f448cd3-ec0e-44ed-bd10-5b042531fb18 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:20.302186 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f0f4f-94ec-4229-b12b-8e0f714fdc00 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:20.338554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f8007-c655-40e4-9b9b-79696be6891b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:20.339488 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f8007-c655-40e4-9b9b-79696be6891b None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:20.339775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f8007-c655-40e4-9b9b-79696be6891b None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:20.340055 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f8007-c655-40e4-9b9b-79696be6891b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:20.340915 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f8007-c655-40e4-9b9b-79696be6891b None admin] RBAC: Adding query filter params (role.id=2180d183afad443187521833c40ed8a1, scope.project.id=8eb38f20a7f646d49f0c1da50ff81db2, user.id=3c6572180f9b45538afe7edd1939cdd6) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:20.341517 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f8007-c655-40e4-9b9b-79696be6891b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:20.341721 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 100/201] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:46:20.343082 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f8007-c655-40e4-9b9b-79696be6891b None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:20.346427 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f448cd3-ec0e-44ed-bd10-5b042531fb18 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:20.349762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 102/202] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:46:20 2022] GET /identity/v3/role_assignments?user.id=3c6572180f9b45538afe7edd1939cdd6&scope.project.id=8eb38f20a7f646d49f0c1da50ff81db2&role.id=2180d183afad443187521833c40ed8a1 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:20.351456 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f8007-c655-40e4-9b9b-79696be6891b None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:20.469967 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f448cd3-ec0e-44ed-bd10-5b042531fb18 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:20.486005 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f8007-c655-40e4-9b9b-79696be6891b None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:20.521318 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133e927-37c8-44f3-8bd7-b0651399b48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:20.523897 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133e927-37c8-44f3-8bd7-b0651399b48a None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:20.524177 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133e927-37c8-44f3-8bd7-b0651399b48a None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:20.524456 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133e927-37c8-44f3-8bd7-b0651399b48a None admin] PATH_INFO: `/v3/users/8c51fedf6f6e40b2ac9cf455ef0dbe8e` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:20.527869 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133e927-37c8-44f3-8bd7-b0651399b48a None admin] RBAC: Authorizing `identity:get_user(user_id=8c51fedf6f6e40b2ac9cf455ef0dbe8e)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:20.529408 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133e927-37c8-44f3-8bd7-b0651399b48a None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:20.534985 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 101/203] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:20 2022] GET /identity/v3/users/8c51fedf6f6e40b2ac9cf455ef0dbe8e => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:20.536352 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d912b8b-c7e9-4779-a5a0-14d02017a2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:20.537175 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d912b8b-c7e9-4779-a5a0-14d02017a2a2 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:20.537497 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d912b8b-c7e9-4779-a5a0-14d02017a2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:20.537785 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d912b8b-c7e9-4779-a5a0-14d02017a2a2 None admin] PATH_INFO: `/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:20.539162 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d912b8b-c7e9-4779-a5a0-14d02017a2a2 None admin] RBAC: Authorizing `identity:get_project(project_id=8eb38f20a7f646d49f0c1da50ff81db2)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:20.540655 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d912b8b-c7e9-4779-a5a0-14d02017a2a2 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:20.542825 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133e927-37c8-44f3-8bd7-b0651399b48a None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:20.547131 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 103/204] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:20 2022] GET /identity/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:20.553219 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d912b8b-c7e9-4779-a5a0-14d02017a2a2 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:20.724249 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133e927-37c8-44f3-8bd7-b0651399b48a None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:20.770172 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d912b8b-c7e9-4779-a5a0-14d02017a2a2 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:20.784094 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbd971-95a5-4ecb-affd-31cc8f2be86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:20.784984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbd971-95a5-4ecb-affd-31cc8f2be86e None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:20.785427 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbd971-95a5-4ecb-affd-31cc8f2be86e None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:20.785839 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbd971-95a5-4ecb-affd-31cc8f2be86e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:20.823002 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02300c9-2dd6-4d01-9feb-c4b7551e1dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:20.824076 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02300c9-2dd6-4d01-9feb-c4b7551e1dfb None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:20.824565 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02300c9-2dd6-4d01-9feb-c4b7551e1dfb None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:20.825064 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02300c9-2dd6-4d01-9feb-c4b7551e1dfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:20.826151 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02300c9-2dd6-4d01-9feb-c4b7551e1dfb None admin] RBAC: Adding query filter params (role.id=cf8c8db912344d0f82f8e6b0fa805968, scope.project.id=8eb38f20a7f646d49f0c1da50ff81db2, user.id=3c6572180f9b45538afe7edd1939cdd6) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:20.826678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02300c9-2dd6-4d01-9feb-c4b7551e1dfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:20.837395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02300c9-2dd6-4d01-9feb-c4b7551e1dfb None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:20.844687 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 104/205] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:46:20 2022] GET /identity/v3/role_assignments?user.id=3c6572180f9b45538afe7edd1939cdd6&scope.project.id=8eb38f20a7f646d49f0c1da50ff81db2&role.id=cf8c8db912344d0f82f8e6b0fa805968 => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:20.868603 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbd971-95a5-4ecb-affd-31cc8f2be86e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:20.870117 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbd971-95a5-4ecb-affd-31cc8f2be86e None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:20.976065 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 102/206] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:46:20.982175 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02300c9-2dd6-4d01-9feb-c4b7551e1dfb None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:21.143073 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02300c9-2dd6-4d01-9feb-c4b7551e1dfb None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:21.179510 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f68c47-1ebb-4317-9fd0-eccbd24f8a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:21.180392 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f68c47-1ebb-4317-9fd0-eccbd24f8a81 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:21.180679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f68c47-1ebb-4317-9fd0-eccbd24f8a81 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:21.180954 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f68c47-1ebb-4317-9fd0-eccbd24f8a81 None admin] PATH_INFO: `/v3/projects/049f004d411f4c94a764b0a9955e9216` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:21.182233 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f68c47-1ebb-4317-9fd0-eccbd24f8a81 None admin] RBAC: Authorizing `identity:get_project(project_id=049f004d411f4c94a764b0a9955e9216)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:21.183687 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f68c47-1ebb-4317-9fd0-eccbd24f8a81 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:21.185479 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 105/207] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:20 2022] GET /identity/v3/projects/049f004d411f4c94a764b0a9955e9216 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:21.192038 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbd971-95a5-4ecb-affd-31cc8f2be86e None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:21.297488 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbd971-95a5-4ecb-affd-31cc8f2be86e None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:21.334716 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37fef8-e03d-4555-bec0-01c77c988610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:21.335391 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37fef8-e03d-4555-bec0-01c77c988610 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:21.335683 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37fef8-e03d-4555-bec0-01c77c988610 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:21.335962 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37fef8-e03d-4555-bec0-01c77c988610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:21.336823 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37fef8-e03d-4555-bec0-01c77c988610 None admin] RBAC: Adding query filter params (role.id=b890511935cc4c2fa062153280c4cd25, scope.project.id=049f004d411f4c94a764b0a9955e9216, user.id=8c51fedf6f6e40b2ac9cf455ef0dbe8e) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:21.337139 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37fef8-e03d-4555-bec0-01c77c988610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:21.338630 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37fef8-e03d-4555-bec0-01c77c988610 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:21.345627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 103/208] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:46:21 2022] GET /identity/v3/role_assignments?user.id=8c51fedf6f6e40b2ac9cf455ef0dbe8e&scope.project.id=049f004d411f4c94a764b0a9955e9216&role.id=b890511935cc4c2fa062153280c4cd25 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:22.395652 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69ba14-8f19-448e-ab56-aa3b2c255750 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:22.396226 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69ba14-8f19-448e-ab56-aa3b2c255750 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:22.396226 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69ba14-8f19-448e-ab56-aa3b2c255750 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:22.397924 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 106/209] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:22.403541 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23f76d-510e-4532-b663-7953d7d34fb7 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:22.404071 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23f76d-510e-4532-b663-7953d7d34fb7 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:22.404163 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23f76d-510e-4532-b663-7953d7d34fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:22.422515 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-2b23f76d-510e-4532-b663-7953d7d34fb7 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:22.423732 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-2b23f76d-510e-4532-b663-7953d7d34fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:22.442227 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b683f7-c912-4af4-8315-f14fa4159ab0 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:22.442898 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b683f7-c912-4af4-8315-f14fa4159ab0 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:22.443381 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b683f7-c912-4af4-8315-f14fa4159ab0 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:22.445267 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 107/210] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:22.450859 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9912a-2e60-42ef-a01b-7a97f9761f51 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:22.451437 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9912a-2e60-42ef-a01b-7a97f9761f51 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:22.452535 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9912a-2e60-42ef-a01b-7a97f9761f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:22.472231 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-c4f9912a-2e60-42ef-a01b-7a97f9761f51 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:22.473877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-c4f9912a-2e60-42ef-a01b-7a97f9761f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:22.501506 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 104/211] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:46:22.520507 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23f76d-510e-4532-b663-7953d7d34fb7 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:22.544719 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 108/212] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:46:22.569583 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9912a-2e60-42ef-a01b-7a97f9761f51 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:22.631330 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23f76d-510e-4532-b663-7953d7d34fb7 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:22.668160 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae9592-d32f-458f-9061-ccb484df996f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:22.669288 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae9592-d32f-458f-9061-ccb484df996f None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:22.669798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae9592-d32f-458f-9061-ccb484df996f None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:22.670303 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae9592-d32f-458f-9061-ccb484df996f None admin] PATH_INFO: `/v3/roles/member` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:22.679785 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9912a-2e60-42ef-a01b-7a97f9761f51 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:22.684344 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae9592-d32f-458f-9061-ccb484df996f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:22.692708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-09ae9592-d32f-458f-9061-ccb484df996f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:22.692708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:22.692708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:22.692708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:22.692708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:22.692708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:22.692708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:22.692708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:22.692708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:22.692708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:22.692708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:22.692708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:22.692708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:22.692708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:22.692708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:22.692708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:22.694120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:22.694120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:22.694120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:22.694120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:22.694120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:22.694120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:22.694120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:22.694120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:22.694120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:22.694120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:22.694120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:22.694120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:46:22.694120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:22.694120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:22.694120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:22.694120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:22.695061 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:22.695061 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:22.695061 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:22.695061 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:22.695061 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:22.695061 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:22.695061 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:22.695061 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:22.695061 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:22.695061 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:22.695061 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:22.695061 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:46:22.701519 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 105/213] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:22.704838 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae9592-d32f-458f-9061-ccb484df996f None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:22.718585 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4260613-58e0-4344-a054-27d5c0728256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:22.719390 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4260613-58e0-4344-a054-27d5c0728256 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:22.719672 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4260613-58e0-4344-a054-27d5c0728256 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:22.719946 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4260613-58e0-4344-a054-27d5c0728256 None admin] PATH_INFO: `/v3/domains/default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:22.721165 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4260613-58e0-4344-a054-27d5c0728256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:22.722659 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4260613-58e0-4344-a054-27d5c0728256 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:22.729019 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 109/214] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:46:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:22.729956 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4260613-58e0-4344-a054-27d5c0728256 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:22.812047 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae9592-d32f-458f-9061-ccb484df996f None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:22.832466 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4260613-58e0-4344-a054-27d5c0728256 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:22.847677 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25891c97-4156-45f7-a511-e9e6ddff8d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:22.848752 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25891c97-4156-45f7-a511-e9e6ddff8d6f None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:22.849280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25891c97-4156-45f7-a511-e9e6ddff8d6f None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:22.849796 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25891c97-4156-45f7-a511-e9e6ddff8d6f None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:22.850798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25891c97-4156-45f7-a511-e9e6ddff8d6f None admin] RBAC: Adding query filter params (name=member) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:22.851344 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25891c97-4156-45f7-a511-e9e6ddff8d6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:22.852986 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25891c97-4156-45f7-a511-e9e6ddff8d6f None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:22.866713 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 106/215] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:22.868011 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f8cfe-c65e-439d-bd49-4bb7681bc9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:22.868555 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25891c97-4156-45f7-a511-e9e6ddff8d6f None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:22.868672 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f8cfe-c65e-439d-bd49-4bb7681bc9c5 None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:22.868956 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f8cfe-c65e-439d-bd49-4bb7681bc9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:22.869229 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f8cfe-c65e-439d-bd49-4bb7681bc9c5 None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:22.869993 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f8cfe-c65e-439d-bd49-4bb7681bc9c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:22.871445 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f8cfe-c65e-439d-bd49-4bb7681bc9c5 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:22.901846 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 110/216] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:46:22 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:46:22.903409 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d5f3d-4a55-41a4-8ff6-5de92b34110d None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:22.903694 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d5f3d-4a55-41a4-8ff6-5de92b34110d None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:22.903977 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d5f3d-4a55-41a4-8ff6-5de92b34110d None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:22.905553 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 111/217] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:22.912861 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a9c9c-ff8c-471f-a80d-6caf0f98e2a4 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:22.913221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a9c9c-ff8c-471f-a80d-6caf0f98e2a4 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:22.913541 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a9c9c-ff8c-471f-a80d-6caf0f98e2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:22.932830 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-e43a9c9c-ff8c-471f-a80d-6caf0f98e2a4 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:22.934003 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-e43a9c9c-ff8c-471f-a80d-6caf0f98e2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:22.989938 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25891c97-4156-45f7-a511-e9e6ddff8d6f None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:23.016118 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 112/218] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:46:23.034217 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf40d44-1e77-4816-8deb-50f63a83d4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:23.035569 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf40d44-1e77-4816-8deb-50f63a83d4b6 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:23.036068 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf40d44-1e77-4816-8deb-50f63a83d4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:23.036582 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf40d44-1e77-4816-8deb-50f63a83d4b6 None admin] PATH_INFO: `/v3/users/652d9d02b77f464e981412125d1197d8` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:23.040730 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a9c9c-ff8c-471f-a80d-6caf0f98e2a4 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:23.053056 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf40d44-1e77-4816-8deb-50f63a83d4b6 None admin] RBAC: Authorizing `identity:get_user(user_id=652d9d02b77f464e981412125d1197d8)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:23.054963 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf40d44-1e77-4816-8deb-50f63a83d4b6 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:23.057318 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 107/219] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:22 2022] GET /identity/v3/users/652d9d02b77f464e981412125d1197d8 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:23.063309 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf40d44-1e77-4816-8deb-50f63a83d4b6 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:23.181651 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a9c9c-ff8c-471f-a80d-6caf0f98e2a4 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:23.186173 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf40d44-1e77-4816-8deb-50f63a83d4b6 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:23.222920 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf682ba7-40f4-4d41-8ef3-0a822650291f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:23.223731 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf682ba7-40f4-4d41-8ef3-0a822650291f None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:23.224014 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf682ba7-40f4-4d41-8ef3-0a822650291f None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:23.224288 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf682ba7-40f4-4d41-8ef3-0a822650291f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:23.235385 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f21c2-cb8f-440c-93a3-43e5ae10c606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:23.236426 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f21c2-cb8f-440c-93a3-43e5ae10c606 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:23.236936 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f21c2-cb8f-440c-93a3-43e5ae10c606 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:23.237284 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f21c2-cb8f-440c-93a3-43e5ae10c606 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:23.238197 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf682ba7-40f4-4d41-8ef3-0a822650291f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:23.245957 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-bf682ba7-40f4-4d41-8ef3-0a822650291f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:46:23.245957 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:23.245957 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:23.245957 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:23.245957 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:23.245957 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:23.245957 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:23.245957 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:23.245957 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:23.245957 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:23.245957 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:23.245957 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:23.245957 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:23.245957 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:23.245957 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:23.245957 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:23.247047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:23.247047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:23.247047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:23.247047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:23.247047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:23.247047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:23.247047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:23.247047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:23.247047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:23.247047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:23.247047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:23.247047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:46:23.247047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:23.247047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:23.247047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:23.247047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:23.249234 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:23.249234 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:23.249234 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:23.249234 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:23.249234 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:23.249234 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:23.249234 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:23.249234 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:23.249234 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:23.249234 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:23.249234 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:46:23.249234 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:46:23.249234 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 113/220] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:46:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:46:23.254124 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf682ba7-40f4-4d41-8ef3-0a822650291f None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:23.331540 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f21c2-cb8f-440c-93a3-43e5ae10c606 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:23.331935 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f21c2-cb8f-440c-93a3-43e5ae10c606 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:23.394406 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf682ba7-40f4-4d41-8ef3-0a822650291f None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:23.429977 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e14ce-8c58-479b-b245-45ea1ac74144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:23.431478 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e14ce-8c58-479b-b245-45ea1ac74144 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:23.432117 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e14ce-8c58-479b-b245-45ea1ac74144 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:23.432818 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e14ce-8c58-479b-b245-45ea1ac74144 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:23.433856 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e14ce-8c58-479b-b245-45ea1ac74144 None admin] RBAC: Adding query filter params (name=admin) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:23.434389 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e14ce-8c58-479b-b245-45ea1ac74144 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:23.435988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e14ce-8c58-479b-b245-45ea1ac74144 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:23.446319 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 114/221] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:23.453477 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 108/222] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:46:23.455199 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e14ce-8c58-479b-b245-45ea1ac74144 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:23.457328 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f21c2-cb8f-440c-93a3-43e5ae10c606 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:23.580098 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e14ce-8c58-479b-b245-45ea1ac74144 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:23.628989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a62a6b-c31d-42d7-babb-a21949f479d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:23.631386 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f21c2-cb8f-440c-93a3-43e5ae10c606 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:23.633473 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a62a6b-c31d-42d7-babb-a21949f479d6 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:23.633764 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a62a6b-c31d-42d7-babb-a21949f479d6 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:23.634046 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a62a6b-c31d-42d7-babb-a21949f479d6 None admin] PATH_INFO: `/v3/users/3c6572180f9b45538afe7edd1939cdd6` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:23.636246 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a62a6b-c31d-42d7-babb-a21949f479d6 None admin] RBAC: Authorizing `identity:get_user(user_id=3c6572180f9b45538afe7edd1939cdd6)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:23.641722 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a62a6b-c31d-42d7-babb-a21949f479d6 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:23.643931 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 115/223] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:23 2022] GET /identity/v3/users/3c6572180f9b45538afe7edd1939cdd6 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:23.649786 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a62a6b-c31d-42d7-babb-a21949f479d6 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:23.691021 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851961ea-ca29-4c94-b595-b1cefb5ed4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:23.692268 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851961ea-ca29-4c94-b595-b1cefb5ed4fd None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:23.692765 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851961ea-ca29-4c94-b595-b1cefb5ed4fd None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:23.693270 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851961ea-ca29-4c94-b595-b1cefb5ed4fd None admin] PATH_INFO: `/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:23.694768 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851961ea-ca29-4c94-b595-b1cefb5ed4fd None admin] RBAC: Authorizing `identity:get_project(project_id=8eb38f20a7f646d49f0c1da50ff81db2)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:23.696823 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851961ea-ca29-4c94-b595-b1cefb5ed4fd None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:23.698823 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 109/224] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:23 2022] GET /identity/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:23.700177 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23db85-24ea-49d0-a42c-7c98262abafa None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:23.700495 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23db85-24ea-49d0-a42c-7c98262abafa None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:23.700777 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23db85-24ea-49d0-a42c-7c98262abafa None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:23.702378 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 110/225] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:23.705980 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23db85-24ea-49d0-a42c-7c98262abafa None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:23.790545 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a62a6b-c31d-42d7-babb-a21949f479d6 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:23.825296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3940aa-1559-4279-a66f-73f89b94a220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:23.826235 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3940aa-1559-4279-a66f-73f89b94a220 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:23.826519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3940aa-1559-4279-a66f-73f89b94a220 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:23.827369 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3940aa-1559-4279-a66f-73f89b94a220 None admin] PATH_INFO: `/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:23.828645 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3940aa-1559-4279-a66f-73f89b94a220 None admin] RBAC: Authorizing `identity:get_project(project_id=8eb38f20a7f646d49f0c1da50ff81db2)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:23.830124 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3940aa-1559-4279-a66f-73f89b94a220 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:23.832153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 116/226] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:23 2022] GET /identity/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:23.833438 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12622285-880d-4e91-a0f2-5d7ec97a620d None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:23.833731 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12622285-880d-4e91-a0f2-5d7ec97a620d None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:23.834011 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12622285-880d-4e91-a0f2-5d7ec97a620d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:23.843950 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23db85-24ea-49d0-a42c-7c98262abafa None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:23.851823 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-12622285-880d-4e91-a0f2-5d7ec97a620d None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:23.853120 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-12622285-880d-4e91-a0f2-5d7ec97a620d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:23.890727 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05b78b-3b85-49fe-81f5-42923bd294f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:23.891391 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05b78b-3b85-49fe-81f5-42923bd294f1 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:23.891674 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05b78b-3b85-49fe-81f5-42923bd294f1 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:23.891948 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05b78b-3b85-49fe-81f5-42923bd294f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:23.892798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05b78b-3b85-49fe-81f5-42923bd294f1 None admin] RBAC: Adding query filter params (role.id=6a75cc334b5a44b5a347a1a0cc20f6d7, scope.project.id=8eb38f20a7f646d49f0c1da50ff81db2, user.id=652d9d02b77f464e981412125d1197d8) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:23.893469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05b78b-3b85-49fe-81f5-42923bd294f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:23.894947 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05b78b-3b85-49fe-81f5-42923bd294f1 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:23.903462 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 111/227] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:46:23 2022] GET /identity/v3/role_assignments?user.id=652d9d02b77f464e981412125d1197d8&scope.project.id=8eb38f20a7f646d49f0c1da50ff81db2&role.id=6a75cc334b5a44b5a347a1a0cc20f6d7 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:23.904631 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05b78b-3b85-49fe-81f5-42923bd294f1 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:23.937115 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 117/228] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:23.961249 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12622285-880d-4e91-a0f2-5d7ec97a620d None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:24.043752 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05b78b-3b85-49fe-81f5-42923bd294f1 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:24.081881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12622285-880d-4e91-a0f2-5d7ec97a620d None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:24.088626 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3839bb8-8c86-4bbe-912b-7534399cc387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:24.089637 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3839bb8-8c86-4bbe-912b-7534399cc387 None admin] REQUEST_METHOD: `PUT` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:24.089922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3839bb8-8c86-4bbe-912b-7534399cc387 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:24.090197 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3839bb8-8c86-4bbe-912b-7534399cc387 None admin] PATH_INFO: `/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2/users/3c6572180f9b45538afe7edd1939cdd6/roles/2180d183afad443187521833c40ed8a1` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:24.092255 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3839bb8-8c86-4bbe-912b-7534399cc387 None admin] RBAC: Authorizing `identity:create_grant(project_id=8eb38f20a7f646d49f0c1da50ff81db2, user_id=3c6572180f9b45538afe7edd1939cdd6, role_id=2180d183afad443187521833c40ed8a1)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:24.093813 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3839bb8-8c86-4bbe-912b-7534399cc387 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:24.124289 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 112/229] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:46:23 2022] PUT /identity/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2/users/3c6572180f9b45538afe7edd1939cdd6/roles/2180d183afad443187521833c40ed8a1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:46:24.140639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4650b-1067-400c-83cb-1b96d572567e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:24.141872 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4650b-1067-400c-83cb-1b96d572567e None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:24.142157 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4650b-1067-400c-83cb-1b96d572567e None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:24.142434 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4650b-1067-400c-83cb-1b96d572567e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:24.157663 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4650b-1067-400c-83cb-1b96d572567e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:24.166702 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-afc4650b-1067-400c-83cb-1b96d572567e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:46:24.166702 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:24.166702 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:24.166702 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:24.166702 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:24.166702 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:24.166702 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:24.166702 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:24.166702 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:24.166702 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:24.166702 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:24.166702 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:24.166702 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:24.166702 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:24.166702 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:24.166702 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:24.167970 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:24.167970 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:24.167970 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:24.167970 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:24.167970 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:24.167970 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:24.167970 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:24.167970 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:24.167970 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:24.167970 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:24.167970 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:24.167970 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:46:24.167970 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:24.167970 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:24.167970 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:24.167970 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:24.168895 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:24.168895 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:24.168895 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:24.168895 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:24.168895 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:24.168895 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:24.168895 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:24.168895 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:24.168895 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:24.168895 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:24.168895 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:46:24.168895 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:46:24.168895 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 118/230] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:46:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:46:24.175294 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3839bb8-8c86-4bbe-912b-7534399cc387 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:24.304871 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3839bb8-8c86-4bbe-912b-7534399cc387 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:24.344533 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b2e83-1ea8-4ea9-9138-c414121bf6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:24.345239 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b2e83-1ea8-4ea9-9138-c414121bf6bc None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:24.345563 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b2e83-1ea8-4ea9-9138-c414121bf6bc None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:24.345841 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b2e83-1ea8-4ea9-9138-c414121bf6bc None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:24.346627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b2e83-1ea8-4ea9-9138-c414121bf6bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:24.346933 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b2e83-1ea8-4ea9-9138-c414121bf6bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:24.348362 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b2e83-1ea8-4ea9-9138-c414121bf6bc None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:24.358230 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 113/231] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:46:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:24.364222 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4650b-1067-400c-83cb-1b96d572567e None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:24.476558 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4650b-1067-400c-83cb-1b96d572567e None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:24.511484 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ceb64-b3ca-4f3e-b09a-9d6c2fd1c776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:24.512375 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ceb64-b3ca-4f3e-b09a-9d6c2fd1c776 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:24.512655 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ceb64-b3ca-4f3e-b09a-9d6c2fd1c776 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:24.512930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ceb64-b3ca-4f3e-b09a-9d6c2fd1c776 None admin] PATH_INFO: `/v3/users/3c6572180f9b45538afe7edd1939cdd6` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:24.514729 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ceb64-b3ca-4f3e-b09a-9d6c2fd1c776 None admin] RBAC: Authorizing `identity:get_user(user_id=3c6572180f9b45538afe7edd1939cdd6)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:24.516312 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ceb64-b3ca-4f3e-b09a-9d6c2fd1c776 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:24.518196 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 119/232] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:24 2022] GET /identity/v3/users/3c6572180f9b45538afe7edd1939cdd6 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:24.524107 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b2e83-1ea8-4ea9-9138-c414121bf6bc None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:24.635274 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b2e83-1ea8-4ea9-9138-c414121bf6bc None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:24.670229 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab0980-67b8-4037-a606-005611fbc854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:24.672187 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab0980-67b8-4037-a606-005611fbc854 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:24.672483 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab0980-67b8-4037-a606-005611fbc854 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:24.672755 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab0980-67b8-4037-a606-005611fbc854 None admin] PATH_INFO: `/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:24.674010 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab0980-67b8-4037-a606-005611fbc854 None admin] RBAC: Authorizing `identity:get_project(project_id=8eb38f20a7f646d49f0c1da50ff81db2)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:24.675459 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab0980-67b8-4037-a606-005611fbc854 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:24.677608 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 114/233] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:24 2022] GET /identity/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:24.683391 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ceb64-b3ca-4f3e-b09a-9d6c2fd1c776 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:24.801161 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ceb64-b3ca-4f3e-b09a-9d6c2fd1c776 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:24.850359 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0005f6-1bb8-4e5e-af60-747349cfcdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:24.851272 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0005f6-1bb8-4e5e-af60-747349cfcdb6 None admin] REQUEST_METHOD: `PUT` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:24.851559 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0005f6-1bb8-4e5e-af60-747349cfcdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:24.851831 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0005f6-1bb8-4e5e-af60-747349cfcdb6 None admin] PATH_INFO: `/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2/users/3c6572180f9b45538afe7edd1939cdd6/roles/cf8c8db912344d0f82f8e6b0fa805968` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:24.854352 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0005f6-1bb8-4e5e-af60-747349cfcdb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8eb38f20a7f646d49f0c1da50ff81db2, user_id=3c6572180f9b45538afe7edd1939cdd6, role_id=cf8c8db912344d0f82f8e6b0fa805968)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:24.855815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0005f6-1bb8-4e5e-af60-747349cfcdb6 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:24.888205 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 120/234] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:46:24 2022] PUT /identity/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2/users/3c6572180f9b45538afe7edd1939cdd6/roles/cf8c8db912344d0f82f8e6b0fa805968 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:46:25.887562 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b10d9-fda3-49a1-825b-431de1d7ef20 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:25.888431 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b10d9-fda3-49a1-825b-431de1d7ef20 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:25.888925 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b10d9-fda3-49a1-825b-431de1d7ef20 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:25.891851 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 115/235] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:25.897324 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b42a48-3f03-4f33-99c5-155287fc6a50 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:25.898190 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b42a48-3f03-4f33-99c5-155287fc6a50 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:25.898638 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b42a48-3f03-4f33-99c5-155287fc6a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:25.926759 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-d7b42a48-3f03-4f33-99c5-155287fc6a50 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:25.928972 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-d7b42a48-3f03-4f33-99c5-155287fc6a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:25.955129 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f98ec-991c-428d-9be5-db49ca928f41 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:25.955420 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f98ec-991c-428d-9be5-db49ca928f41 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:25.955904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f98ec-991c-428d-9be5-db49ca928f41 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:25.961415 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 116/236] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:25.965613 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c61014-e84f-4303-bc3a-bbf50d259ba3 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:25.966117 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c61014-e84f-4303-bc3a-bbf50d259ba3 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:25.966554 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c61014-e84f-4303-bc3a-bbf50d259ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:25.994593 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-41c61014-e84f-4303-bc3a-bbf50d259ba3 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:25.996469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-41c61014-e84f-4303-bc3a-bbf50d259ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:26.065597 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 121/237] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:26.103766 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 117/238] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:26.110717 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b42a48-3f03-4f33-99c5-155287fc6a50 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:26.154635 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c61014-e84f-4303-bc3a-bbf50d259ba3 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:26.260459 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b42a48-3f03-4f33-99c5-155287fc6a50 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:26.336838 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c61014-e84f-4303-bc3a-bbf50d259ba3 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:26.354131 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570981e4-9513-42ab-8abe-eccb1810924b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:26.355328 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570981e4-9513-42ab-8abe-eccb1810924b None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:26.355871 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570981e4-9513-42ab-8abe-eccb1810924b None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:26.356374 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570981e4-9513-42ab-8abe-eccb1810924b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:26.377112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa03db-1cb0-4a71-9e74-f95454e6d396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:26.378311 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa03db-1cb0-4a71-9e74-f95454e6d396 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:26.378784 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa03db-1cb0-4a71-9e74-f95454e6d396 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:26.379400 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa03db-1cb0-4a71-9e74-f95454e6d396 None admin] PATH_INFO: `/v3/domains/default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:26.381182 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa03db-1cb0-4a71-9e74-f95454e6d396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:26.382861 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa03db-1cb0-4a71-9e74-f95454e6d396 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:26.385196 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 118/239] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:46:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:26.386383 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570981e4-9513-42ab-8abe-eccb1810924b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:26.390302 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa03db-1cb0-4a71-9e74-f95454e6d396 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:26.395388 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-570981e4-9513-42ab-8abe-eccb1810924b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:46:26.395388 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:26.395388 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:26.395388 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:26.395388 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:26.395388 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:26.395388 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:26.395388 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:26.395388 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:26.395388 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:26.395388 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:26.395388 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:26.395388 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:26.395388 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:26.395388 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:26.395388 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:26.396449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:26.396449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:26.396449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:26.396449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:26.396449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:26.396449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:26.396449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:26.396449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:26.396449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:26.396449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:26.396449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:26.396449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:46:26.396449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:26.396449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:26.396449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:26.396449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:26.397358 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:26.397358 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:26.397358 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:26.397358 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:26.397358 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:26.397358 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:26.397358 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:26.397358 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:26.397358 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:26.397358 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:26.397358 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:46:26.397358 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:46:26.404787 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 122/240] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:26.407175 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570981e4-9513-42ab-8abe-eccb1810924b None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:26.503109 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa03db-1cb0-4a71-9e74-f95454e6d396 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:26.539689 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac34ad9-0af9-4caf-bbe9-fa590a506db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:26.540375 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac34ad9-0af9-4caf-bbe9-fa590a506db1 None admin] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:26.540662 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac34ad9-0af9-4caf-bbe9-fa590a506db1 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:26.540932 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac34ad9-0af9-4caf-bbe9-fa590a506db1 None admin] PATH_INFO: `/v3/users` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:26.541883 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac34ad9-0af9-4caf-bbe9-fa590a506db1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:26.543522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac34ad9-0af9-4caf-bbe9-fa590a506db1 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:26.582357 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 119/241] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:46:26 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:46:26.602153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570981e4-9513-42ab-8abe-eccb1810924b None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:26.655746 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd18964-8496-484e-980e-ff8d0bb58446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:26.656559 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd18964-8496-484e-980e-ff8d0bb58446 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:26.656871 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd18964-8496-484e-980e-ff8d0bb58446 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:26.657299 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd18964-8496-484e-980e-ff8d0bb58446 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:26.658292 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd18964-8496-484e-980e-ff8d0bb58446 None admin] RBAC: Adding query filter params (name=reader) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:26.658658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd18964-8496-484e-980e-ff8d0bb58446 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:26.660292 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd18964-8496-484e-980e-ff8d0bb58446 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:26.680330 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 123/242] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:26.686106 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac34ad9-0af9-4caf-bbe9-fa590a506db1 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:26.814915 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac34ad9-0af9-4caf-bbe9-fa590a506db1 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:26.854354 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98f397-187e-4e5c-909f-a7302722cd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:26.855524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98f397-187e-4e5c-909f-a7302722cd47 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:26.855993 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98f397-187e-4e5c-909f-a7302722cd47 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:26.856446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98f397-187e-4e5c-909f-a7302722cd47 None admin] PATH_INFO: `/v3/users/d61638fb79254667926c8f1222794eaf` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:26.872128 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98f397-187e-4e5c-909f-a7302722cd47 None admin] RBAC: Authorizing `identity:get_user(user_id=d61638fb79254667926c8f1222794eaf)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:26.874620 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98f397-187e-4e5c-909f-a7302722cd47 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:26.876871 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 120/243] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:26 2022] GET /identity/v3/users/d61638fb79254667926c8f1222794eaf => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:26.882659 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd18964-8496-484e-980e-ff8d0bb58446 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:27.016582 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd18964-8496-484e-980e-ff8d0bb58446 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:27.037766 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45464a-69d9-4ed7-9c9b-0dfe4a39d6f0 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:27.038811 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45464a-69d9-4ed7-9c9b-0dfe4a39d6f0 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:27.039102 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45464a-69d9-4ed7-9c9b-0dfe4a39d6f0 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:27.040801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 121/244] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:27.052318 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48cd17-6856-4a86-a8a2-f80c4b8218ed None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:27.052639 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48cd17-6856-4a86-a8a2-f80c4b8218ed None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:27.052886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48cd17-6856-4a86-a8a2-f80c4b8218ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:27.079596 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-6d48cd17-6856-4a86-a8a2-f80c4b8218ed None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:27.080816 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-6d48cd17-6856-4a86-a8a2-f80c4b8218ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:27.082779 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a529d0-2c26-49dc-b024-d4a1a960e7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:27.084773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a529d0-2c26-49dc-b024-d4a1a960e7c4 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:27.085276 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a529d0-2c26-49dc-b024-d4a1a960e7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:27.085739 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a529d0-2c26-49dc-b024-d4a1a960e7c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:27.179363 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a529d0-2c26-49dc-b024-d4a1a960e7c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:27.180853 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a529d0-2c26-49dc-b024-d4a1a960e7c4 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:27.190265 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 122/245] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:46:27.191852 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0fa2f-7072-49c5-9f22-f70d7c677fdf None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:27.192225 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0fa2f-7072-49c5-9f22-f70d7c677fdf None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:27.192578 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0fa2f-7072-49c5-9f22-f70d7c677fdf None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:27.194072 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 123/246] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:27.199950 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d29ca-a500-4527-9702-74dfd9666eaa None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:27.200235 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d29ca-a500-4527-9702-74dfd9666eaa None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:27.200516 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d29ca-a500-4527-9702-74dfd9666eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:27.235958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-038d29ca-a500-4527-9702-74dfd9666eaa None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:27.237820 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-038d29ca-a500-4527-9702-74dfd9666eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:27.323233 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 124/247] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:46:27.324166 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a529d0-2c26-49dc-b024-d4a1a960e7c4 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:27.335800 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 124/248] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:46:27.336693 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d29ca-a500-4527-9702-74dfd9666eaa None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:27.450040 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a529d0-2c26-49dc-b024-d4a1a960e7c4 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:27.475485 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d29ca-a500-4527-9702-74dfd9666eaa None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:27.490890 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2c92d-eaac-40ea-a596-46090a0d1da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:27.491755 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2c92d-eaac-40ea-a596-46090a0d1da7 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:27.492045 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2c92d-eaac-40ea-a596-46090a0d1da7 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:27.492324 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2c92d-eaac-40ea-a596-46090a0d1da7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:27.504089 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f2c92d-eaac-40ea-a596-46090a0d1da7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:27.512035 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-76f2c92d-eaac-40ea-a596-46090a0d1da7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:27.512035 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:27.512035 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:27.512035 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:27.512035 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:27.512035 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:27.512035 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:27.512035 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:27.512035 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:27.512035 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:27.512035 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:27.512035 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:27.512035 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:27.512035 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:27.512035 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:27.512035 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:27.513097 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:27.513097 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:27.513097 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:27.513097 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:27.513097 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:27.513097 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:27.513097 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:27.513097 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:27.513097 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:27.513097 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:27.513097 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:27.513097 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:46:27.513097 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:27.513097 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:27.513097 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:27.513097 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:27.514056 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:27.514056 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:27.514056 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:27.514056 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:27.514056 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:27.514056 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:27.514056 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:27.514056 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:27.514056 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:27.514056 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:27.514056 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:27.514056 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:46:27.514056 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 125/249] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:27.516612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2c92d-eaac-40ea-a596-46090a0d1da7 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:27.528725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dccbbb-f326-47b9-b508-3f532ccff76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:27.529640 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dccbbb-f326-47b9-b508-3f532ccff76d None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:27.530566 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dccbbb-f326-47b9-b508-3f532ccff76d None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:27.530805 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dccbbb-f326-47b9-b508-3f532ccff76d None admin] PATH_INFO: `/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:27.538317 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dccbbb-f326-47b9-b508-3f532ccff76d None admin] RBAC: Authorizing `identity:get_project(project_id=8eb38f20a7f646d49f0c1da50ff81db2)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:27.539828 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dccbbb-f326-47b9-b508-3f532ccff76d None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:27.541695 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 125/250] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:27 2022] GET /identity/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:27.542508 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dccbbb-f326-47b9-b508-3f532ccff76d None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:27.623083 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2c92d-eaac-40ea-a596-46090a0d1da7 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:27.664824 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbefb5-ee38-4d9a-b29d-283454f636ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:27.665659 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbefb5-ee38-4d9a-b29d-283454f636ba None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:27.665942 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbefb5-ee38-4d9a-b29d-283454f636ba None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:27.666215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbefb5-ee38-4d9a-b29d-283454f636ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:27.691705 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbefb5-ee38-4d9a-b29d-283454f636ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:27.700767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-4fdbefb5-ee38-4d9a-b29d-283454f636ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:46:27.700767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:27.700767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:27.700767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:27.700767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:27.700767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:27.700767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:27.700767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:27.700767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:27.700767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:27.700767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:27.700767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:27.700767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:27.700767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:27.700767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:27.700767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:27.704551 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:27.704551 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:27.704551 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:27.704551 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:27.704551 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:27.704551 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:27.704551 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:27.704551 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:27.704551 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:27.704551 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:27.704551 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:27.704551 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:46:27.704551 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:27.704551 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:27.704551 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:27.704551 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:27.706872 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:27.706872 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:27.706872 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:27.706872 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:27.706872 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:27.706872 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:27.706872 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:27.706872 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:27.706872 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:27.706872 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:27.706872 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:46:27.706872 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:46:27.713133 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 126/251] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:46:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:27.714172 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbefb5-ee38-4d9a-b29d-283454f636ba None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:27.779878 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dccbbb-f326-47b9-b508-3f532ccff76d None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:27.868448 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbefb5-ee38-4d9a-b29d-283454f636ba None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:27.886802 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53d54c-5042-4744-837f-d26a7ede35e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:27.887414 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53d54c-5042-4744-837f-d26a7ede35e4 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:27.887701 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53d54c-5042-4744-837f-d26a7ede35e4 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:27.887979 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53d54c-5042-4744-837f-d26a7ede35e4 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:27.888755 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53d54c-5042-4744-837f-d26a7ede35e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:27.889063 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53d54c-5042-4744-837f-d26a7ede35e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:27.890552 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53d54c-5042-4744-837f-d26a7ede35e4 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:27.907589 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f17c8-e8b7-417e-88e8-9789a99bf918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:27.908332 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f17c8-e8b7-417e-88e8-9789a99bf918 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:27.908628 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f17c8-e8b7-417e-88e8-9789a99bf918 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:27.908911 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f17c8-e8b7-417e-88e8-9789a99bf918 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:27.909986 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f17c8-e8b7-417e-88e8-9789a99bf918 None admin] RBAC: Adding query filter params (role.id=b890511935cc4c2fa062153280c4cd25, scope.project.id=8eb38f20a7f646d49f0c1da50ff81db2, user.id=d61638fb79254667926c8f1222794eaf) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:27.910311 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f17c8-e8b7-417e-88e8-9789a99bf918 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:27.911798 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f17c8-e8b7-417e-88e8-9789a99bf918 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:27.911996 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 126/252] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:27.912893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53d54c-5042-4744-837f-d26a7ede35e4 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:27.924357 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 127/253] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:46:27 2022] GET /identity/v3/role_assignments?user.id=d61638fb79254667926c8f1222794eaf&scope.project.id=8eb38f20a7f646d49f0c1da50ff81db2&role.id=b890511935cc4c2fa062153280c4cd25 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:27.924952 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f17c8-e8b7-417e-88e8-9789a99bf918 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:28.068700 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f17c8-e8b7-417e-88e8-9789a99bf918 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:28.136122 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53d54c-5042-4744-837f-d26a7ede35e4 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:28.138499 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e8843-29bd-42fe-ad1e-a8a00696a077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:28.140045 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e8843-29bd-42fe-ad1e-a8a00696a077 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:28.140673 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e8843-29bd-42fe-ad1e-a8a00696a077 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:28.141118 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e8843-29bd-42fe-ad1e-a8a00696a077 None admin] PATH_INFO: `/v3/users/652d9d02b77f464e981412125d1197d8` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:28.144506 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e8843-29bd-42fe-ad1e-a8a00696a077 None admin] RBAC: Authorizing `identity:get_user(user_id=652d9d02b77f464e981412125d1197d8)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:28.147340 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e8843-29bd-42fe-ad1e-a8a00696a077 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:28.149402 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 128/254] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:27 2022] GET /identity/v3/users/652d9d02b77f464e981412125d1197d8 => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:28.156763 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078551d-37b4-4500-9ba3-bb7546d86f12 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:28.159420 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078551d-37b4-4500-9ba3-bb7546d86f12 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:28.159921 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078551d-37b4-4500-9ba3-bb7546d86f12 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:28.161647 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 129/255] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:28.164117 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078551d-37b4-4500-9ba3-bb7546d86f12 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:28.218105 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd78750-0249-4350-9c12-1f02268b6655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:28.222489 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd78750-0249-4350-9c12-1f02268b6655 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:28.222994 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd78750-0249-4350-9c12-1f02268b6655 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:28.223626 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd78750-0249-4350-9c12-1f02268b6655 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:28.224594 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd78750-0249-4350-9c12-1f02268b6655 None admin] RBAC: Adding query filter params (name=admin) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:28.225065 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd78750-0249-4350-9c12-1f02268b6655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:28.226823 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd78750-0249-4350-9c12-1f02268b6655 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:28.238227 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 127/256] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:28.239894 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c4a18-e495-4f42-a53a-e70d5210fc88 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:28.240199 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c4a18-e495-4f42-a53a-e70d5210fc88 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:28.240458 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c4a18-e495-4f42-a53a-e70d5210fc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:28.273742 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-0d0c4a18-e495-4f42-a53a-e70d5210fc88 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:28.275167 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-0d0c4a18-e495-4f42-a53a-e70d5210fc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:28.311704 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078551d-37b4-4500-9ba3-bb7546d86f12 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:28.348052 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879caacb-419d-4079-8e4c-a8a690a3e50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:28.348932 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879caacb-419d-4079-8e4c-a8a690a3e50e None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:28.349223 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879caacb-419d-4079-8e4c-a8a690a3e50e None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:28.349533 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879caacb-419d-4079-8e4c-a8a690a3e50e None admin] PATH_INFO: `/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:28.350761 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879caacb-419d-4079-8e4c-a8a690a3e50e None admin] RBAC: Authorizing `identity:get_project(project_id=8eb38f20a7f646d49f0c1da50ff81db2)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:28.352228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879caacb-419d-4079-8e4c-a8a690a3e50e None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:28.354217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 130/257] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:28 2022] GET /identity/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:28.354785 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879caacb-419d-4079-8e4c-a8a690a3e50e None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:28.422850 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 128/258] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:28.424227 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c4a18-e495-4f42-a53a-e70d5210fc88 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:28.463077 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879caacb-419d-4079-8e4c-a8a690a3e50e None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:28.497834 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e58354-7293-4068-bd58-33b04ca50c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:28.498767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e58354-7293-4068-bd58-33b04ca50c34 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:28.499055 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e58354-7293-4068-bd58-33b04ca50c34 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:28.499314 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e58354-7293-4068-bd58-33b04ca50c34 None admin] PATH_INFO: `/v3/users/3c6572180f9b45538afe7edd1939cdd6` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:28.500812 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e58354-7293-4068-bd58-33b04ca50c34 None admin] RBAC: Authorizing `identity:get_user(user_id=3c6572180f9b45538afe7edd1939cdd6)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:28.502288 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e58354-7293-4068-bd58-33b04ca50c34 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:28.504139 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 131/259] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:28 2022] GET /identity/v3/users/3c6572180f9b45538afe7edd1939cdd6 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:28.504722 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e58354-7293-4068-bd58-33b04ca50c34 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:28.602051 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c4a18-e495-4f42-a53a-e70d5210fc88 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:28.613408 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e58354-7293-4068-bd58-33b04ca50c34 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:28.658700 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e913f-a366-4bd4-8f6b-63fe9269a0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:28.659960 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e913f-a366-4bd4-8f6b-63fe9269a0dc None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:28.660465 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e913f-a366-4bd4-8f6b-63fe9269a0dc None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:28.660963 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e913f-a366-4bd4-8f6b-63fe9269a0dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:28.674697 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e913f-a366-4bd4-8f6b-63fe9269a0dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:28.683217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-bb8e913f-a366-4bd4-8f6b-63fe9269a0dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:46:28.683217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:28.683217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:28.683217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:28.683217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:28.683217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:28.683217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:28.683217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:28.683217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:28.683217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:28.683217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:28.683217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:28.683217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:28.683217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:28.683217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:28.683217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:28.684350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:28.684350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:28.684350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:28.684350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:28.684350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:28.684350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:28.684350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:28.684350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:28.684350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:28.684350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:28.684350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:28.684350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:46:28.684350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:28.684350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:28.684350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:28.684350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:28.685262 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:28.685262 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:28.685262 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:28.685262 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:28.685262 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:28.685262 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:28.685262 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:28.685262 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:28.685262 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:28.685262 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:28.685262 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:46:28.685262 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:46:28.689963 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 132/260] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:46:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:28.691058 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e913f-a366-4bd4-8f6b-63fe9269a0dc None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:28.707531 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c29741-4fe6-4e64-b7da-87a85a80d662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:28.708444 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c29741-4fe6-4e64-b7da-87a85a80d662 None admin] REQUEST_METHOD: `PUT` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:28.708830 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c29741-4fe6-4e64-b7da-87a85a80d662 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:28.709021 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c29741-4fe6-4e64-b7da-87a85a80d662 None admin] PATH_INFO: `/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2/users/652d9d02b77f464e981412125d1197d8/roles/6a75cc334b5a44b5a347a1a0cc20f6d7` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:28.711347 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c29741-4fe6-4e64-b7da-87a85a80d662 None admin] RBAC: Authorizing `identity:create_grant(project_id=8eb38f20a7f646d49f0c1da50ff81db2, user_id=652d9d02b77f464e981412125d1197d8, role_id=6a75cc334b5a44b5a347a1a0cc20f6d7)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:28.712807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c29741-4fe6-4e64-b7da-87a85a80d662 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:28.728407 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 129/261] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:46:28 2022] PUT /identity/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2/users/652d9d02b77f464e981412125d1197d8/roles/6a75cc334b5a44b5a347a1a0cc20f6d7 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:46:28.729365 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c29741-4fe6-4e64-b7da-87a85a80d662 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:28.851473 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e913f-a366-4bd4-8f6b-63fe9269a0dc None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:28.912379 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c29741-4fe6-4e64-b7da-87a85a80d662 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:28.913198 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055952bc-4510-420b-9a71-cbf49696e587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:28.914136 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055952bc-4510-420b-9a71-cbf49696e587 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:28.914656 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055952bc-4510-420b-9a71-cbf49696e587 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:28.915154 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055952bc-4510-420b-9a71-cbf49696e587 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:28.971017 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e7741-55b4-44f7-9d57-615ea006ebf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:28.971549 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e7741-55b4-44f7-9d57-615ea006ebf9 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:28.971835 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e7741-55b4-44f7-9d57-615ea006ebf9 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:28.972112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e7741-55b4-44f7-9d57-615ea006ebf9 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:28.972881 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e7741-55b4-44f7-9d57-615ea006ebf9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:28.973242 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e7741-55b4-44f7-9d57-615ea006ebf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:28.974613 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e7741-55b4-44f7-9d57-615ea006ebf9 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:28.984548 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 130/262] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:46:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:28.990825 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e7741-55b4-44f7-9d57-615ea006ebf9 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:29.014746 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055952bc-4510-420b-9a71-cbf49696e587 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:29.016678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055952bc-4510-420b-9a71-cbf49696e587 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:29.109833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e7741-55b4-44f7-9d57-615ea006ebf9 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:29.164331 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe28c67-4497-465e-a525-e649987adb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:29.165246 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe28c67-4497-465e-a525-e649987adb38 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:29.165567 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe28c67-4497-465e-a525-e649987adb38 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:29.165847 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe28c67-4497-465e-a525-e649987adb38 None admin] PATH_INFO: `/v3/users/3c6572180f9b45538afe7edd1939cdd6` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:29.167682 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe28c67-4497-465e-a525-e649987adb38 None admin] RBAC: Authorizing `identity:get_user(user_id=3c6572180f9b45538afe7edd1939cdd6)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:29.169238 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe28c67-4497-465e-a525-e649987adb38 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:29.172157 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 131/263] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:28 2022] GET /identity/v3/users/3c6572180f9b45538afe7edd1939cdd6 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:29.183449 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe28c67-4497-465e-a525-e649987adb38 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:29.212635 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 133/264] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:46:29.218462 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055952bc-4510-420b-9a71-cbf49696e587 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:29.321663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe28c67-4497-465e-a525-e649987adb38 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:29.368058 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04d1c5-1c5c-47e1-ae42-30e24c9d2509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:29.368742 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04d1c5-1c5c-47e1-ae42-30e24c9d2509 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:29.369037 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04d1c5-1c5c-47e1-ae42-30e24c9d2509 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:29.369317 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04d1c5-1c5c-47e1-ae42-30e24c9d2509 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:29.412662 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055952bc-4510-420b-9a71-cbf49696e587 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:29.478551 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f92e0-8bef-40fe-b5fa-39aa1f93f39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:29.480517 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f92e0-8bef-40fe-b5fa-39aa1f93f39f None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:29.481198 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f92e0-8bef-40fe-b5fa-39aa1f93f39f None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:29.482919 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f92e0-8bef-40fe-b5fa-39aa1f93f39f None admin] PATH_INFO: `/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:29.486118 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f92e0-8bef-40fe-b5fa-39aa1f93f39f None admin] RBAC: Authorizing `identity:get_project(project_id=8eb38f20a7f646d49f0c1da50ff81db2)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:29.490083 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f92e0-8bef-40fe-b5fa-39aa1f93f39f None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:29.492992 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 134/265] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:29 2022] GET /identity/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:29.495258 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04d1c5-1c5c-47e1-ae42-30e24c9d2509 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:29.497057 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04d1c5-1c5c-47e1-ae42-30e24c9d2509 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:29.501212 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f92e0-8bef-40fe-b5fa-39aa1f93f39f None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:29.662681 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 132/266] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:46:29.668145 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04d1c5-1c5c-47e1-ae42-30e24c9d2509 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:29.703980 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f92e0-8bef-40fe-b5fa-39aa1f93f39f None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:29.741242 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fd0f9-55ac-4759-84db-fee971954b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:29.742350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fd0f9-55ac-4759-84db-fee971954b29 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:29.742861 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fd0f9-55ac-4759-84db-fee971954b29 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:29.743377 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fd0f9-55ac-4759-84db-fee971954b29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:29.744483 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368fd0f9-55ac-4759-84db-fee971954b29 None admin] RBAC: Adding query filter params (role.id=2180d183afad443187521833c40ed8a1, scope.project.id=8eb38f20a7f646d49f0c1da50ff81db2, user.id=3c6572180f9b45538afe7edd1939cdd6) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:29.745044 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368fd0f9-55ac-4759-84db-fee971954b29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:29.746823 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368fd0f9-55ac-4759-84db-fee971954b29 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:29.754492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 135/267] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:46:29 2022] GET /identity/v3/role_assignments?user.id=3c6572180f9b45538afe7edd1939cdd6&scope.project.id=8eb38f20a7f646d49f0c1da50ff81db2&role.id=2180d183afad443187521833c40ed8a1 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:29.873533 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04d1c5-1c5c-47e1-ae42-30e24c9d2509 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:29.928308 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96e792-7249-4aa9-9d8c-92a928104da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:29.929119 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96e792-7249-4aa9-9d8c-92a928104da9 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:29.929423 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96e792-7249-4aa9-9d8c-92a928104da9 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:29.929705 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96e792-7249-4aa9-9d8c-92a928104da9 None admin] PATH_INFO: `/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:29.931025 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96e792-7249-4aa9-9d8c-92a928104da9 None admin] RBAC: Authorizing `identity:get_project(project_id=8eb38f20a7f646d49f0c1da50ff81db2)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:29.932539 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96e792-7249-4aa9-9d8c-92a928104da9 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:29.934734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 133/268] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:29 2022] GET /identity/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2 => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:29.941282 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fd0f9-55ac-4759-84db-fee971954b29 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:30.078037 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fd0f9-55ac-4759-84db-fee971954b29 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:30.115394 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e6aa8-1b1f-4122-b7dc-b5d1b7e64e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:30.116439 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e6aa8-1b1f-4122-b7dc-b5d1b7e64e2f None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:30.117005 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e6aa8-1b1f-4122-b7dc-b5d1b7e64e2f None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:30.117598 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e6aa8-1b1f-4122-b7dc-b5d1b7e64e2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:30.118699 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e6aa8-1b1f-4122-b7dc-b5d1b7e64e2f None admin] RBAC: Adding query filter params (role.id=cf8c8db912344d0f82f8e6b0fa805968, scope.project.id=8eb38f20a7f646d49f0c1da50ff81db2, user.id=3c6572180f9b45538afe7edd1939cdd6) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:30.119253 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e6aa8-1b1f-4122-b7dc-b5d1b7e64e2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:30.120976 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e6aa8-1b1f-4122-b7dc-b5d1b7e64e2f None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:30.129301 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 136/269] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:46:29 2022] GET /identity/v3/role_assignments?user.id=3c6572180f9b45538afe7edd1939cdd6&scope.project.id=8eb38f20a7f646d49f0c1da50ff81db2&role.id=cf8c8db912344d0f82f8e6b0fa805968 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:30.253167 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d97151-10fc-4470-9cbc-d6d76fe171d4 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:30.253738 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d97151-10fc-4470-9cbc-d6d76fe171d4 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:30.253738 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d97151-10fc-4470-9cbc-d6d76fe171d4 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:30.255716 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 134/270] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:30.256819 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ae488-b176-4232-bff7-a73ec1d5aa12 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:30.257688 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ae488-b176-4232-bff7-a73ec1d5aa12 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:30.258225 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ae488-b176-4232-bff7-a73ec1d5aa12 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:30.259986 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 137/271] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:46:30.261362 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655ebce-78d6-487a-ac8e-948ea78daad2 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:30.261679 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655ebce-78d6-487a-ac8e-948ea78daad2 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:30.261963 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655ebce-78d6-487a-ac8e-948ea78daad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:30.265544 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e8146-313d-4c42-ab10-1311d95d4725 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:30.266164 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e8146-313d-4c42-ab10-1311d95d4725 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:30.266670 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e8146-313d-4c42-ab10-1311d95d4725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:30.285966 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-0655ebce-78d6-487a-ac8e-948ea78daad2 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:30.287199 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-0655ebce-78d6-487a-ac8e-948ea78daad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:30.290061 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-5d0e8146-313d-4c42-ab10-1311d95d4725 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:30.291653 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-5d0e8146-313d-4c42-ab10-1311d95d4725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:30.405050 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 138/272] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:46:30.432552 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 135/273] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:30.437292 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e8146-313d-4c42-ab10-1311d95d4725 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:30.458070 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655ebce-78d6-487a-ac8e-948ea78daad2 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:30.544473 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e8146-313d-4c42-ab10-1311d95d4725 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:30.580215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d70b81-40ee-4b72-a347-7453270a285c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:30.581493 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d70b81-40ee-4b72-a347-7453270a285c None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:30.582008 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d70b81-40ee-4b72-a347-7453270a285c None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:30.582537 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d70b81-40ee-4b72-a347-7453270a285c None admin] PATH_INFO: `/v3/domains/default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:30.583995 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d70b81-40ee-4b72-a347-7453270a285c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:30.585740 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d70b81-40ee-4b72-a347-7453270a285c None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:30.585967 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655ebce-78d6-487a-ac8e-948ea78daad2 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:30.588157 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 139/274] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:46:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:30.597312 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d70b81-40ee-4b72-a347-7453270a285c None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:30.647755 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4da84-5b4b-4d6d-b94a-605bc4efc1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:30.649016 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4da84-5b4b-4d6d-b94a-605bc4efc1af None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:30.649629 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4da84-5b4b-4d6d-b94a-605bc4efc1af None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:30.650144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4da84-5b4b-4d6d-b94a-605bc4efc1af None admin] PATH_INFO: `/v3/roles/member` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:30.666674 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4da84-5b4b-4d6d-b94a-605bc4efc1af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:30.677171 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-f1f4da84-5b4b-4d6d-b94a-605bc4efc1af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:30.677171 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:30.677171 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:30.677171 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:30.677171 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:30.677171 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:30.677171 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:30.677171 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:30.677171 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:30.677171 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:30.677171 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:30.677171 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:30.677171 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:30.677171 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:30.677171 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:30.677171 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:30.678285 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:30.678285 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:30.678285 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:30.678285 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:30.678285 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:30.678285 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:30.678285 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:30.678285 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:30.678285 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:30.678285 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:30.678285 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:30.678285 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:46:30.678285 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:30.678285 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:30.678285 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:30.678285 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:30.679279 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:30.679279 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:30.679279 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:30.679279 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:30.679279 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:30.679279 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:30.679279 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:30.679279 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:30.679279 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:30.679279 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:30.679279 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:30.679279 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:46:30.682030 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 136/275] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:46:30.688462 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4da84-5b4b-4d6d-b94a-605bc4efc1af None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:30.748902 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d70b81-40ee-4b72-a347-7453270a285c None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:30.797296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d041525-df4b-46d8-a18d-a9a83139acfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:30.798127 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d041525-df4b-46d8-a18d-a9a83139acfa None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:30.798888 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d041525-df4b-46d8-a18d-a9a83139acfa None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:30.799172 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d041525-df4b-46d8-a18d-a9a83139acfa None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:30.800251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d041525-df4b-46d8-a18d-a9a83139acfa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:30.802004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d041525-df4b-46d8-a18d-a9a83139acfa None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:30.805894 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4da84-5b4b-4d6d-b94a-605bc4efc1af None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:30.831134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 140/276] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:46:30 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:46:30.861364 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bb58e-891a-4161-8578-6eee4efaad83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:30.861950 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bb58e-891a-4161-8578-6eee4efaad83 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:30.862243 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bb58e-891a-4161-8578-6eee4efaad83 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:30.862523 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bb58e-891a-4161-8578-6eee4efaad83 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:30.863337 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bb58e-891a-4161-8578-6eee4efaad83 None admin] RBAC: Adding query filter params (name=member) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:30.863647 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bb58e-891a-4161-8578-6eee4efaad83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:30.865112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bb58e-891a-4161-8578-6eee4efaad83 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:30.876435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 137/277] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:30.882291 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d041525-df4b-46d8-a18d-a9a83139acfa None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:30.998193 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d041525-df4b-46d8-a18d-a9a83139acfa None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:31.004450 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a4bb-83c2-4ae7-8929-28b9fadd2303 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:31.004770 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a4bb-83c2-4ae7-8929-28b9fadd2303 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:31.005015 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a4bb-83c2-4ae7-8929-28b9fadd2303 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:31.006757 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 138/278] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:31.012422 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0633c-f860-408a-84a3-4c7496105730 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:31.012760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0633c-f860-408a-84a3-4c7496105730 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:31.013060 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0633c-f860-408a-84a3-4c7496105730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:31.031713 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-71c0633c-f860-408a-84a3-4c7496105730 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:31.032943 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-71c0633c-f860-408a-84a3-4c7496105730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:31.037160 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cfaca3-319e-47b1-9e9a-eca1b4ff6eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:31.038109 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfaca3-319e-47b1-9e9a-eca1b4ff6eea None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:31.038397 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfaca3-319e-47b1-9e9a-eca1b4ff6eea None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:31.038671 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfaca3-319e-47b1-9e9a-eca1b4ff6eea None admin] PATH_INFO: `/v3/users/4cbced494e2941319732536a57d2b6f1` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:31.054238 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cfaca3-319e-47b1-9e9a-eca1b4ff6eea None admin] RBAC: Authorizing `identity:get_user(user_id=4cbced494e2941319732536a57d2b6f1)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:31.055643 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cfaca3-319e-47b1-9e9a-eca1b4ff6eea None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:31.057789 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 141/279] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:30 2022] GET /identity/v3/users/4cbced494e2941319732536a57d2b6f1 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:31.065846 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cfaca3-319e-47b1-9e9a-eca1b4ff6eea None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:31.120664 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 139/280] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:46:31.144272 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0633c-f860-408a-84a3-4c7496105730 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:31.204573 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cfaca3-319e-47b1-9e9a-eca1b4ff6eea None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:31.258188 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36205462-148a-4f6b-838e-2802a8cc13cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:31.258861 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36205462-148a-4f6b-838e-2802a8cc13cf None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:31.259134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36205462-148a-4f6b-838e-2802a8cc13cf None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:31.259415 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36205462-148a-4f6b-838e-2802a8cc13cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:31.260304 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36205462-148a-4f6b-838e-2802a8cc13cf None admin] RBAC: Adding query filter params (role.id=6a75cc334b5a44b5a347a1a0cc20f6d7, user.id=4cbced494e2941319732536a57d2b6f1, scope.system=all) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:31.260601 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36205462-148a-4f6b-838e-2802a8cc13cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:31.262088 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36205462-148a-4f6b-838e-2802a8cc13cf None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:31.273531 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 142/281] 10.222.0.48 () {56 vars in 1308 bytes} [Mon May 9 15:46:31 2022] GET /identity/v3/role_assignments?user.id=4cbced494e2941319732536a57d2b6f1&scope.system=all&role.id=6a75cc334b5a44b5a347a1a0cc20f6d7 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:31.283244 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0633c-f860-408a-84a3-4c7496105730 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:31.327250 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccc766-b579-48fa-b6af-24922a71f797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:31.328560 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccc766-b579-48fa-b6af-24922a71f797 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:31.329027 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccc766-b579-48fa-b6af-24922a71f797 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:31.329532 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccc766-b579-48fa-b6af-24922a71f797 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:31.342370 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccc766-b579-48fa-b6af-24922a71f797 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:31.351294 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-03ccc766-b579-48fa-b6af-24922a71f797 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:46:31.351294 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:31.351294 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:31.351294 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:31.351294 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:31.351294 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:31.351294 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:31.351294 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:31.351294 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:31.351294 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:31.351294 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:31.351294 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:31.351294 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:31.351294 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:31.351294 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:31.351294 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:31.352646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:31.352646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:31.352646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:31.352646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:31.352646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:31.352646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:31.352646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:31.352646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:31.352646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:31.352646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:31.352646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:31.352646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:46:31.352646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:31.352646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:31.352646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:31.352646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:31.353779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:31.353779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:31.353779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:31.353779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:31.353779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:31.353779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:31.353779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:31.353779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:31.353779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:31.353779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:31.353779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:46:31.353779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:46:31.356465 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 140/282] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:46:31.363198 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36205462-148a-4f6b-838e-2802a8cc13cf None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:31.502237 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36205462-148a-4f6b-838e-2802a8cc13cf None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:31.560491 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b0eed-2ef8-4493-afe8-4bf6bc379c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:31.561813 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b0eed-2ef8-4493-afe8-4bf6bc379c49 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:31.562455 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b0eed-2ef8-4493-afe8-4bf6bc379c49 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:31.562926 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b0eed-2ef8-4493-afe8-4bf6bc379c49 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:31.563869 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b0eed-2ef8-4493-afe8-4bf6bc379c49 None admin] RBAC: Adding query filter params (name=reader) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:31.564341 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b0eed-2ef8-4493-afe8-4bf6bc379c49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:31.565975 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b0eed-2ef8-4493-afe8-4bf6bc379c49 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:31.575793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 143/283] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:31.582562 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccc766-b579-48fa-b6af-24922a71f797 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:31.737938 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccc766-b579-48fa-b6af-24922a71f797 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:31.781417 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d1abf-f355-4744-a84b-aaa57258ead2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:31.782316 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d1abf-f355-4744-a84b-aaa57258ead2 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:31.782607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d1abf-f355-4744-a84b-aaa57258ead2 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:31.782889 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d1abf-f355-4744-a84b-aaa57258ead2 None admin] PATH_INFO: `/v3/users/d61638fb79254667926c8f1222794eaf` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:31.784168 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d1abf-f355-4744-a84b-aaa57258ead2 None admin] RBAC: Authorizing `identity:get_user(user_id=d61638fb79254667926c8f1222794eaf)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:31.785670 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d1abf-f355-4744-a84b-aaa57258ead2 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:31.787656 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 141/284] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:31 2022] GET /identity/v3/users/d61638fb79254667926c8f1222794eaf => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:31.793158 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b0eed-2ef8-4493-afe8-4bf6bc379c49 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:31.922306 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b0eed-2ef8-4493-afe8-4bf6bc379c49 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:31.960002 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf94ff-35cd-4982-a269-666f5aa164db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:31.961277 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf94ff-35cd-4982-a269-666f5aa164db None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:31.961816 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf94ff-35cd-4982-a269-666f5aa164db None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:31.962365 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf94ff-35cd-4982-a269-666f5aa164db None admin] PATH_INFO: `/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:31.963862 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf94ff-35cd-4982-a269-666f5aa164db None admin] RBAC: Authorizing `identity:get_project(project_id=8eb38f20a7f646d49f0c1da50ff81db2)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:31.965611 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf94ff-35cd-4982-a269-666f5aa164db None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:31.968718 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 144/285] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:31 2022] GET /identity/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:31.974179 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d1abf-f355-4744-a84b-aaa57258ead2 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:32.041161 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6873ead-de79-42b0-bcfd-4ffa12a6fab6 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:32.042575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6873ead-de79-42b0-bcfd-4ffa12a6fab6 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:32.043266 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6873ead-de79-42b0-bcfd-4ffa12a6fab6 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:32.050361 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 145/286] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:32.064826 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52126c2b-5ac6-4b60-8d6d-611efaa3cda9 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:32.065560 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52126c2b-5ac6-4b60-8d6d-611efaa3cda9 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:32.066095 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52126c2b-5ac6-4b60-8d6d-611efaa3cda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:32.085498 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-52126c2b-5ac6-4b60-8d6d-611efaa3cda9 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:32.087190 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-52126c2b-5ac6-4b60-8d6d-611efaa3cda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:32.165554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 146/287] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:46:32.185394 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d1abf-f355-4744-a84b-aaa57258ead2 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:32.190775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52126c2b-5ac6-4b60-8d6d-611efaa3cda9 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:32.235883 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9339085-d015-423a-b311-18b0b87f466f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:32.237395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9339085-d015-423a-b311-18b0b87f466f None admin] REQUEST_METHOD: `PUT` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:32.237886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9339085-d015-423a-b311-18b0b87f466f None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:32.238336 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9339085-d015-423a-b311-18b0b87f466f None admin] PATH_INFO: `/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2/users/d61638fb79254667926c8f1222794eaf/roles/b890511935cc4c2fa062153280c4cd25` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:32.240504 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9339085-d015-423a-b311-18b0b87f466f None admin] RBAC: Authorizing `identity:create_grant(project_id=8eb38f20a7f646d49f0c1da50ff81db2, user_id=d61638fb79254667926c8f1222794eaf, role_id=b890511935cc4c2fa062153280c4cd25)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:32.242034 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9339085-d015-423a-b311-18b0b87f466f None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:32.269474 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 142/288] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:46:31 2022] PUT /identity/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2/users/d61638fb79254667926c8f1222794eaf/roles/b890511935cc4c2fa062153280c4cd25 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:46:32.310063 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52126c2b-5ac6-4b60-8d6d-611efaa3cda9 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:32.351876 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16890c-c8bd-401b-95ae-dec571e65164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:32.353091 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16890c-c8bd-401b-95ae-dec571e65164 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:32.353676 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16890c-c8bd-401b-95ae-dec571e65164 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:32.354243 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16890c-c8bd-401b-95ae-dec571e65164 None admin] PATH_INFO: `/v3/roles/member` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:32.367406 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16890c-c8bd-401b-95ae-dec571e65164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:32.376793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-dd16890c-c8bd-401b-95ae-dec571e65164 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:32.376793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:32.376793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:32.376793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:32.376793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:32.376793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:32.376793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:32.376793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:32.376793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:32.376793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:32.376793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:32.376793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:32.376793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:32.376793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:32.376793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:32.376793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:32.377973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:32.377973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:32.377973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:32.377973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:32.377973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:32.377973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:32.377973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:32.377973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:32.377973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:32.377973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:32.377973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:32.377973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:46:32.377973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:32.377973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:32.377973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:32.377973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:32.378903 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:32.378903 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:32.378903 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:32.378903 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:32.378903 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:32.378903 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:32.378903 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:32.378903 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:32.378903 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:32.378903 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:32.378903 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:32.378903 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:46:32.383270 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 147/289] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:46:32.390227 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9339085-d015-423a-b311-18b0b87f466f None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:32.511218 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9339085-d015-423a-b311-18b0b87f466f None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:32.553843 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879f23d-7e4c-46f7-8eab-d0f56de10634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:32.554903 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879f23d-7e4c-46f7-8eab-d0f56de10634 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:32.555439 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879f23d-7e4c-46f7-8eab-d0f56de10634 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:32.555944 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879f23d-7e4c-46f7-8eab-d0f56de10634 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:32.556936 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879f23d-7e4c-46f7-8eab-d0f56de10634 None admin] RBAC: Adding query filter params (name=member) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:32.557529 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879f23d-7e4c-46f7-8eab-d0f56de10634 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:32.559248 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879f23d-7e4c-46f7-8eab-d0f56de10634 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:32.570576 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 143/290] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:32.576422 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16890c-c8bd-401b-95ae-dec571e65164 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:32.689879 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16890c-c8bd-401b-95ae-dec571e65164 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:32.727531 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529cf37-80ba-48ec-afde-dea55fb741f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:32.728430 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529cf37-80ba-48ec-afde-dea55fb741f3 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:32.728720 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529cf37-80ba-48ec-afde-dea55fb741f3 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:32.729004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529cf37-80ba-48ec-afde-dea55fb741f3 None admin] PATH_INFO: `/v3/users/652d9d02b77f464e981412125d1197d8` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:32.730303 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529cf37-80ba-48ec-afde-dea55fb741f3 None admin] RBAC: Authorizing `identity:get_user(user_id=652d9d02b77f464e981412125d1197d8)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:32.731820 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529cf37-80ba-48ec-afde-dea55fb741f3 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:32.735638 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 148/291] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:32 2022] GET /identity/v3/users/652d9d02b77f464e981412125d1197d8 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:32.741340 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879f23d-7e4c-46f7-8eab-d0f56de10634 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:32.855711 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879f23d-7e4c-46f7-8eab-d0f56de10634 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:32.903445 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c06a9-3eb1-4922-9369-be57d3d7ece5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:32.904109 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c06a9-3eb1-4922-9369-be57d3d7ece5 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:32.904401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c06a9-3eb1-4922-9369-be57d3d7ece5 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:32.904798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c06a9-3eb1-4922-9369-be57d3d7ece5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:33.017713 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c06a9-3eb1-4922-9369-be57d3d7ece5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:33.019193 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c06a9-3eb1-4922-9369-be57d3d7ece5 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:33.136086 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 144/292] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:46:33.142673 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529cf37-80ba-48ec-afde-dea55fb741f3 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:33.264342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529cf37-80ba-48ec-afde-dea55fb741f3 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:33.301133 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c5831-d79b-44f0-ab16-ea8650526aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:33.302047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c5831-d79b-44f0-ab16-ea8650526aa0 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:33.302336 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c5831-d79b-44f0-ab16-ea8650526aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:33.302621 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c5831-d79b-44f0-ab16-ea8650526aa0 None admin] PATH_INFO: `/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:33.303866 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c5831-d79b-44f0-ab16-ea8650526aa0 None admin] RBAC: Authorizing `identity:get_project(project_id=8eb38f20a7f646d49f0c1da50ff81db2)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:33.305331 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c5831-d79b-44f0-ab16-ea8650526aa0 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:33.307411 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 149/293] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:33 2022] GET /identity/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:33.314186 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c06a9-3eb1-4922-9369-be57d3d7ece5 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:33.431571 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c06a9-3eb1-4922-9369-be57d3d7ece5 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:33.468720 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41136d-fb87-4d32-8746-7efa36fd7a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:33.469414 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41136d-fb87-4d32-8746-7efa36fd7a8a None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:33.469681 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41136d-fb87-4d32-8746-7efa36fd7a8a None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:33.469956 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41136d-fb87-4d32-8746-7efa36fd7a8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:33.470802 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41136d-fb87-4d32-8746-7efa36fd7a8a None admin] RBAC: Adding query filter params (role.id=6a75cc334b5a44b5a347a1a0cc20f6d7, scope.project.id=8eb38f20a7f646d49f0c1da50ff81db2, user.id=652d9d02b77f464e981412125d1197d8) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:33.471115 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41136d-fb87-4d32-8746-7efa36fd7a8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:33.472547 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41136d-fb87-4d32-8746-7efa36fd7a8a None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:33.479366 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 145/294] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:46:33 2022] GET /identity/v3/role_assignments?user.id=652d9d02b77f464e981412125d1197d8&scope.project.id=8eb38f20a7f646d49f0c1da50ff81db2&role.id=6a75cc334b5a44b5a347a1a0cc20f6d7 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:33.976717 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6601cf3-e8d0-4052-9ac4-48677e9b28fe None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:33.977365 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6601cf3-e8d0-4052-9ac4-48677e9b28fe None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:33.977365 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6601cf3-e8d0-4052-9ac4-48677e9b28fe None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:33.978960 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 150/295] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:33.985035 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3605a-987a-499c-82d0-c9e7e09e52f4 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:33.985344 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3605a-987a-499c-82d0-c9e7e09e52f4 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:33.985640 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3605a-987a-499c-82d0-c9e7e09e52f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:34.007761 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-23c3605a-987a-499c-82d0-c9e7e09e52f4 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:34.009403 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-23c3605a-987a-499c-82d0-c9e7e09e52f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:34.091330 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 146/296] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:34.117702 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6601cf3-e8d0-4052-9ac4-48677e9b28fe None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:34.155739 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8a53a-8e7f-4310-88da-cff571a0c8eb None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:34.156093 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8a53a-8e7f-4310-88da-cff571a0c8eb None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:34.156388 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8a53a-8e7f-4310-88da-cff571a0c8eb None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:34.157782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 147/297] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:46:34.163432 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d665b-425e-4820-8d5e-93c219d943d6 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:34.163743 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d665b-425e-4820-8d5e-93c219d943d6 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:34.164020 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d665b-425e-4820-8d5e-93c219d943d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:34.184763 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-435d665b-425e-4820-8d5e-93c219d943d6 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:34.186067 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-435d665b-425e-4820-8d5e-93c219d943d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:34.242794 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6601cf3-e8d0-4052-9ac4-48677e9b28fe None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:34.265667 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 148/298] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:46:34.282774 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd8721-a844-4f9d-8d39-9c4945380045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:34.283593 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd8721-a844-4f9d-8d39-9c4945380045 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:34.283944 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd8721-a844-4f9d-8d39-9c4945380045 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:34.284233 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd8721-a844-4f9d-8d39-9c4945380045 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:34.285407 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d665b-425e-4820-8d5e-93c219d943d6 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:34.296158 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd8721-a844-4f9d-8d39-9c4945380045 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:34.304222 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-ddbd8721-a844-4f9d-8d39-9c4945380045 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:46:34.304222 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:34.304222 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:34.304222 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:34.304222 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:34.304222 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:34.304222 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:34.304222 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:34.304222 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:34.304222 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:34.304222 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:34.304222 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:34.304222 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:34.304222 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:34.304222 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:34.304222 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:34.305616 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:34.305616 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:34.305616 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:34.305616 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:34.305616 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:34.305616 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:34.305616 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:34.305616 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:34.305616 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:34.305616 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:34.305616 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:34.305616 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:46:34.305616 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:34.305616 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:34.305616 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:34.305616 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:34.306639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:34.306639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:34.306639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:34.306639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:34.306639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:34.306639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:34.306639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:34.306639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:34.306639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:34.306639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:34.306639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:46:34.306639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:46:34.306639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 151/299] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:34.311566 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd8721-a844-4f9d-8d39-9c4945380045 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:34.393298 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d665b-425e-4820-8d5e-93c219d943d6 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:34.427007 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd8721-a844-4f9d-8d39-9c4945380045 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:34.428842 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327f6ed-dadf-4101-b685-4316be31d588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:34.429674 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327f6ed-dadf-4101-b685-4316be31d588 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:34.429957 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327f6ed-dadf-4101-b685-4316be31d588 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:34.430234 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327f6ed-dadf-4101-b685-4316be31d588 None admin] PATH_INFO: `/v3/domains/default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:34.431413 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327f6ed-dadf-4101-b685-4316be31d588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:34.432861 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327f6ed-dadf-4101-b685-4316be31d588 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:34.434700 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 149/300] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:46:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:34.436119 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea13abe-f637-4ef0-941f-dcd4b6ad898c None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:34.436485 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea13abe-f637-4ef0-941f-dcd4b6ad898c None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:34.436790 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea13abe-f637-4ef0-941f-dcd4b6ad898c None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:34.438240 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 150/301] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:34.443053 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea13abe-f637-4ef0-941f-dcd4b6ad898c None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:34.466745 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bf1f3-899f-4b22-8fcc-f4185dde5115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:34.468076 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bf1f3-899f-4b22-8fcc-f4185dde5115 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:34.468363 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bf1f3-899f-4b22-8fcc-f4185dde5115 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:34.468641 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bf1f3-899f-4b22-8fcc-f4185dde5115 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:34.469421 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bf1f3-899f-4b22-8fcc-f4185dde5115 None admin] RBAC: Adding query filter params (name=reader) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:34.469736 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bf1f3-899f-4b22-8fcc-f4185dde5115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:34.471114 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bf1f3-899f-4b22-8fcc-f4185dde5115 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:34.479585 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 152/302] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:34.480843 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e06d91-4c88-4983-8773-d62baea43281 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:34.481132 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e06d91-4c88-4983-8773-d62baea43281 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:34.481567 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e06d91-4c88-4983-8773-d62baea43281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:34.498268 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-21e06d91-4c88-4983-8773-d62baea43281 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:34.499433 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-21e06d91-4c88-4983-8773-d62baea43281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:34.555619 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea13abe-f637-4ef0-941f-dcd4b6ad898c None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:34.577426 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 153/303] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:34.577426 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e06d91-4c88-4983-8773-d62baea43281 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:34.599742 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f709546-57eb-44e7-921f-db24bdc36dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:34.600444 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f709546-57eb-44e7-921f-db24bdc36dd6 None admin] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:34.600734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f709546-57eb-44e7-921f-db24bdc36dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:34.601013 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f709546-57eb-44e7-921f-db24bdc36dd6 None admin] PATH_INFO: `/v3/groups` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:34.601774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f709546-57eb-44e7-921f-db24bdc36dd6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:34.603263 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f709546-57eb-44e7-921f-db24bdc36dd6 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:34.619394 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 151/304] 10.222.0.48 () {60 vars in 1134 bytes} [Mon May 9 15:46:34 2022] POST /identity/v3/groups => generated 229 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:46:34.629672 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f709546-57eb-44e7-921f-db24bdc36dd6 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:34.695866 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e06d91-4c88-4983-8773-d62baea43281 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:34.739033 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d8eb0-2fec-449e-8c4b-a98f1103c842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:34.739932 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d8eb0-2fec-449e-8c4b-a98f1103c842 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:34.740225 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d8eb0-2fec-449e-8c4b-a98f1103c842 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:34.740505 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d8eb0-2fec-449e-8c4b-a98f1103c842 None admin] PATH_INFO: `/v3/users/16ba0755ec8f47dc8c0abd094ef5fb1e` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:34.756460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d8eb0-2fec-449e-8c4b-a98f1103c842 None admin] RBAC: Authorizing `identity:get_user(user_id=16ba0755ec8f47dc8c0abd094ef5fb1e)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:34.758017 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d8eb0-2fec-449e-8c4b-a98f1103c842 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:34.760187 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 154/305] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:34 2022] GET /identity/v3/users/16ba0755ec8f47dc8c0abd094ef5fb1e => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:34.767251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d8eb0-2fec-449e-8c4b-a98f1103c842 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:34.768927 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f709546-57eb-44e7-921f-db24bdc36dd6 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:34.807730 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893116d-aefb-4283-8213-25e5deceb737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:34.808575 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893116d-aefb-4283-8213-25e5deceb737 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:34.808858 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893116d-aefb-4283-8213-25e5deceb737 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:34.809131 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893116d-aefb-4283-8213-25e5deceb737 None admin] PATH_INFO: `/v3/roles/member` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:34.820859 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893116d-aefb-4283-8213-25e5deceb737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:34.829100 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-5893116d-aefb-4283-8213-25e5deceb737 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:34.829100 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:34.829100 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:34.829100 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:34.829100 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:34.829100 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:34.829100 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:34.829100 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:34.829100 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:34.829100 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:34.829100 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:34.829100 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:34.829100 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:34.829100 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:34.829100 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:34.829100 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:34.830471 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:34.830471 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:34.830471 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:34.830471 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:34.830471 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:34.830471 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:34.830471 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:34.830471 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:34.830471 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:34.830471 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:34.830471 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:34.830471 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:46:34.830471 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:34.830471 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:34.830471 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:34.830471 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:34.831381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:34.831381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:34.831381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:34.831381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:34.831381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:34.831381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:34.831381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:34.831381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:34.831381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:34.831381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:34.831381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:34.831381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:46:34.831381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 152/306] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:34.838452 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893116d-aefb-4283-8213-25e5deceb737 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:34.904853 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d8eb0-2fec-449e-8c4b-a98f1103c842 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:34.946105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a147220-771c-4458-a84b-6552286c4c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:34.946829 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a147220-771c-4458-a84b-6552286c4c8d None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:34.947120 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a147220-771c-4458-a84b-6552286c4c8d None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:34.947557 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a147220-771c-4458-a84b-6552286c4c8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:34.948873 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a147220-771c-4458-a84b-6552286c4c8d None admin] RBAC: Adding query filter params (role.id=b890511935cc4c2fa062153280c4cd25, user.id=16ba0755ec8f47dc8c0abd094ef5fb1e, scope.system=all) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:34.949496 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a147220-771c-4458-a84b-6552286c4c8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:34.951178 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a147220-771c-4458-a84b-6552286c4c8d None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:34.960166 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 155/307] 10.222.0.48 () {56 vars in 1308 bytes} [Mon May 9 15:46:34 2022] GET /identity/v3/role_assignments?user.id=16ba0755ec8f47dc8c0abd094ef5fb1e&scope.system=all&role.id=b890511935cc4c2fa062153280c4cd25 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:34.972718 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893116d-aefb-4283-8213-25e5deceb737 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:35.014342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6f0b4-e1b1-4ad4-9ff6-89719c4f05a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:35.014940 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6f0b4-e1b1-4ad4-9ff6-89719c4f05a8 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:35.015224 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6f0b4-e1b1-4ad4-9ff6-89719c4f05a8 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:35.015503 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6f0b4-e1b1-4ad4-9ff6-89719c4f05a8 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:35.016281 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6f0b4-e1b1-4ad4-9ff6-89719c4f05a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:35.016589 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6f0b4-e1b1-4ad4-9ff6-89719c4f05a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:35.018048 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6f0b4-e1b1-4ad4-9ff6-89719c4f05a8 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:35.028369 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 153/308] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:35.034492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a147220-771c-4458-a84b-6552286c4c8d None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:35.155217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a147220-771c-4458-a84b-6552286c4c8d None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:35.164097 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330d166-e9bf-46a0-930f-bf4f312b4a9c None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:35.164445 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330d166-e9bf-46a0-930f-bf4f312b4a9c None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:35.164669 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330d166-e9bf-46a0-930f-bf4f312b4a9c None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:35.166117 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 154/309] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:35.172009 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adb31d-1101-4ed9-ac97-cc253c94b64e None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:35.172306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adb31d-1101-4ed9-ac97-cc253c94b64e None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:35.172583 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adb31d-1101-4ed9-ac97-cc253c94b64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:35.194457 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-43adb31d-1101-4ed9-ac97-cc253c94b64e None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:35.195654 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-43adb31d-1101-4ed9-ac97-cc253c94b64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:35.200946 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66c1ec-7e9f-4d65-9d72-2ced1e96571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:35.202002 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66c1ec-7e9f-4d65-9d72-2ced1e96571a None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:35.202292 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66c1ec-7e9f-4d65-9d72-2ced1e96571a None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:35.202671 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66c1ec-7e9f-4d65-9d72-2ced1e96571a None admin] PATH_INFO: `/v3/users/4cbced494e2941319732536a57d2b6f1` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:35.204404 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66c1ec-7e9f-4d65-9d72-2ced1e96571a None admin] RBAC: Authorizing `identity:get_user(user_id=4cbced494e2941319732536a57d2b6f1)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:35.206291 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66c1ec-7e9f-4d65-9d72-2ced1e96571a None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:35.208822 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 156/310] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:35 2022] GET /identity/v3/users/4cbced494e2941319732536a57d2b6f1 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:35.215616 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66c1ec-7e9f-4d65-9d72-2ced1e96571a None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:35.270701 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 155/311] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:35.294524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43adb31d-1101-4ed9-ac97-cc253c94b64e None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:35.348530 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66c1ec-7e9f-4d65-9d72-2ced1e96571a None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:35.399728 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c48c8-cc12-462f-9225-2d2978103465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:35.401063 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c48c8-cc12-462f-9225-2d2978103465 None admin] REQUEST_METHOD: `PUT` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:35.401862 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c48c8-cc12-462f-9225-2d2978103465 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:35.402587 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c48c8-cc12-462f-9225-2d2978103465 None admin] PATH_INFO: `/v3/system/users/4cbced494e2941319732536a57d2b6f1/roles/6a75cc334b5a44b5a347a1a0cc20f6d7` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:35.405234 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c48c8-cc12-462f-9225-2d2978103465 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4cbced494e2941319732536a57d2b6f1, role_id=6a75cc334b5a44b5a347a1a0cc20f6d7)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:35.407187 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c48c8-cc12-462f-9225-2d2978103465 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:35.407866 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43adb31d-1101-4ed9-ac97-cc253c94b64e None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:35.422513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 157/312] 10.222.0.48 () {58 vars in 1334 bytes} [Mon May 9 15:46:35 2022] PUT /identity/v3/system/users/4cbced494e2941319732536a57d2b6f1/roles/6a75cc334b5a44b5a347a1a0cc20f6d7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:46:35.461036 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ed9cb-44be-474d-944a-e9617d656de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:35.462787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ed9cb-44be-474d-944a-e9617d656de8 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:35.463278 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ed9cb-44be-474d-944a-e9617d656de8 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:35.463837 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ed9cb-44be-474d-944a-e9617d656de8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:35.478111 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ed9cb-44be-474d-944a-e9617d656de8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:35.487412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-737ed9cb-44be-474d-944a-e9617d656de8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:46:35.487412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:35.487412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:35.487412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:35.487412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:35.487412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:35.487412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:35.487412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:35.487412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:35.487412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:35.487412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:35.487412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:35.487412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:35.487412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:35.487412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:35.487412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:35.488565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:35.488565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:35.488565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:35.488565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:35.488565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:35.488565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:35.488565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:35.488565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:35.488565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:35.488565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:35.488565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:35.488565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:46:35.488565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:35.488565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:35.488565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:35.488565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:35.489522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:35.489522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:35.489522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:35.489522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:35.489522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:35.489522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:35.489522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:35.489522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:35.489522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:35.489522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:35.489522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:46:35.489522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:46:35.492179 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 156/313] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:35.498617 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c48c8-cc12-462f-9225-2d2978103465 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:35.617232 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c48c8-cc12-462f-9225-2d2978103465 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:35.657405 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d710fa9-5794-4867-af21-98878d07276a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:35.658190 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d710fa9-5794-4867-af21-98878d07276a None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:35.658547 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d710fa9-5794-4867-af21-98878d07276a None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:35.658898 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d710fa9-5794-4867-af21-98878d07276a None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:35.659733 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d710fa9-5794-4867-af21-98878d07276a None admin] RBAC: Adding query filter params (name=reader) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:35.660113 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d710fa9-5794-4867-af21-98878d07276a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:35.661597 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d710fa9-5794-4867-af21-98878d07276a None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:35.671453 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 158/314] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:35.677159 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ed9cb-44be-474d-944a-e9617d656de8 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:35.784530 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ed9cb-44be-474d-944a-e9617d656de8 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:35.823544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cdc90-9923-4f5b-8a6a-56799436b278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:35.824610 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cdc90-9923-4f5b-8a6a-56799436b278 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:35.824966 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cdc90-9923-4f5b-8a6a-56799436b278 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:35.825317 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cdc90-9923-4f5b-8a6a-56799436b278 None admin] PATH_INFO: `/v3/users/d61638fb79254667926c8f1222794eaf` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:35.827340 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5cdc90-9923-4f5b-8a6a-56799436b278 None admin] RBAC: Authorizing `identity:get_user(user_id=d61638fb79254667926c8f1222794eaf)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:35.829010 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5cdc90-9923-4f5b-8a6a-56799436b278 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:35.831264 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 157/315] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:35 2022] GET /identity/v3/users/d61638fb79254667926c8f1222794eaf => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:35.837090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d710fa9-5794-4867-af21-98878d07276a None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:35.942544 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d710fa9-5794-4867-af21-98878d07276a None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:35.982146 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33692c-1c9e-4a5b-ab2b-4b1c841aac31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:35.983454 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33692c-1c9e-4a5b-ab2b-4b1c841aac31 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:35.983743 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33692c-1c9e-4a5b-ab2b-4b1c841aac31 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:35.984023 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33692c-1c9e-4a5b-ab2b-4b1c841aac31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:36.067281 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33692c-1c9e-4a5b-ab2b-4b1c841aac31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:36.068772 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33692c-1c9e-4a5b-ab2b-4b1c841aac31 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:36.183718 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 159/316] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:46:36.190032 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cdc90-9923-4f5b-8a6a-56799436b278 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:36.302347 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cdc90-9923-4f5b-8a6a-56799436b278 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:36.340730 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a3d3a-72ec-42d1-b551-e7cbf5fdbffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:36.341650 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a3d3a-72ec-42d1-b551-e7cbf5fdbffb None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:36.341940 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a3d3a-72ec-42d1-b551-e7cbf5fdbffb None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:36.342448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a3d3a-72ec-42d1-b551-e7cbf5fdbffb None admin] PATH_INFO: `/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:36.344068 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a3d3a-72ec-42d1-b551-e7cbf5fdbffb None admin] RBAC: Authorizing `identity:get_project(project_id=8eb38f20a7f646d49f0c1da50ff81db2)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:36.345577 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a3d3a-72ec-42d1-b551-e7cbf5fdbffb None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:36.347686 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 158/317] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:36 2022] GET /identity/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:36.353644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33692c-1c9e-4a5b-ab2b-4b1c841aac31 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:36.458027 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33692c-1c9e-4a5b-ab2b-4b1c841aac31 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:36.496515 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a227868-532b-42f2-b4db-f7450bbb4052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:36.497206 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a227868-532b-42f2-b4db-f7450bbb4052 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:36.497520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a227868-532b-42f2-b4db-f7450bbb4052 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:36.497807 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a227868-532b-42f2-b4db-f7450bbb4052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:36.498694 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a227868-532b-42f2-b4db-f7450bbb4052 None admin] RBAC: Adding query filter params (role.id=b890511935cc4c2fa062153280c4cd25, scope.project.id=8eb38f20a7f646d49f0c1da50ff81db2, user.id=d61638fb79254667926c8f1222794eaf) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:36.499011 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a227868-532b-42f2-b4db-f7450bbb4052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:36.500711 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a227868-532b-42f2-b4db-f7450bbb4052 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:36.509357 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 160/318] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:46:36 2022] GET /identity/v3/role_assignments?user.id=d61638fb79254667926c8f1222794eaf&scope.project.id=8eb38f20a7f646d49f0c1da50ff81db2&role.id=b890511935cc4c2fa062153280c4cd25 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:37.146744 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0443e-f825-46a5-8b94-85d815483f19 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:37.147315 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0443e-f825-46a5-8b94-85d815483f19 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:37.147315 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0443e-f825-46a5-8b94-85d815483f19 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:37.148967 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 159/319] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:37.154434 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35fc89-02ff-4bb0-bef0-6022e1d32270 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:37.154953 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35fc89-02ff-4bb0-bef0-6022e1d32270 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:37.155306 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35fc89-02ff-4bb0-bef0-6022e1d32270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:37.171947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-bb35fc89-02ff-4bb0-bef0-6022e1d32270 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:37.173138 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-bb35fc89-02ff-4bb0-bef0-6022e1d32270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:37.240621 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 161/320] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:37.263515 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0443e-f825-46a5-8b94-85d815483f19 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:37.306544 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1b634-2e83-4057-9558-39297a5330c5 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:37.306868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1b634-2e83-4057-9558-39297a5330c5 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:37.307108 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1b634-2e83-4057-9558-39297a5330c5 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:37.308616 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 162/321] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:46:37.313773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a679a-b0d5-43df-9ce0-7de1fad74d90 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:37.314067 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a679a-b0d5-43df-9ce0-7de1fad74d90 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:37.314351 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a679a-b0d5-43df-9ce0-7de1fad74d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:37.331359 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-431a679a-b0d5-43df-9ce0-7de1fad74d90 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:37.332562 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-431a679a-b0d5-43df-9ce0-7de1fad74d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:37.372837 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0443e-f825-46a5-8b94-85d815483f19 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:37.401636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 163/322] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:46:37.410431 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43652d43-1e29-47a8-b376-b8ef1da94752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:37.411519 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43652d43-1e29-47a8-b376-b8ef1da94752 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:37.412025 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43652d43-1e29-47a8-b376-b8ef1da94752 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:37.412535 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43652d43-1e29-47a8-b376-b8ef1da94752 None admin] PATH_INFO: `/v3/domains/default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:37.413975 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43652d43-1e29-47a8-b376-b8ef1da94752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:37.415664 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43652d43-1e29-47a8-b376-b8ef1da94752 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:37.417836 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 160/323] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:46:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:37.423700 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43652d43-1e29-47a8-b376-b8ef1da94752 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:37.423876 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a679a-b0d5-43df-9ce0-7de1fad74d90 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:37.527612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43652d43-1e29-47a8-b376-b8ef1da94752 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:37.527870 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a679a-b0d5-43df-9ce0-7de1fad74d90 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:37.563037 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f913b5-8796-486a-be7d-c0d2c3d215ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:37.563903 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f913b5-8796-486a-be7d-c0d2c3d215ad None admin] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:37.564188 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f913b5-8796-486a-be7d-c0d2c3d215ad None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:37.564512 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f913b5-8796-486a-be7d-c0d2c3d215ad None admin] PATH_INFO: `/v3/groups` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:37.564986 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca61e90-5d41-47ed-83fa-7fcac1c59fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:37.565284 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f913b5-8796-486a-be7d-c0d2c3d215ad None admin] RBAC: Authorizing `identity:create_group()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:37.565811 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca61e90-5d41-47ed-83fa-7fcac1c59fb4 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:37.566095 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca61e90-5d41-47ed-83fa-7fcac1c59fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:37.566368 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca61e90-5d41-47ed-83fa-7fcac1c59fb4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:37.566743 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f913b5-8796-486a-be7d-c0d2c3d215ad None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:37.578964 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca61e90-5d41-47ed-83fa-7fcac1c59fb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:37.582483 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 161/324] 10.222.0.48 () {60 vars in 1134 bytes} [Mon May 9 15:46:37 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:46:37.587481 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-dca61e90-5d41-47ed-83fa-7fcac1c59fb4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:46:37.587481 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:37.587481 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:37.587481 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:37.587481 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:37.587481 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:37.587481 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:37.587481 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:37.587481 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:37.587481 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:37.587481 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:37.587481 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:37.587481 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:37.587481 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:37.587481 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:37.587481 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:37.588605 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:37.588605 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:37.588605 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:37.588605 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:37.588605 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:37.588605 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:37.588605 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:37.588605 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:37.588605 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:37.588605 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:37.588605 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:37.588605 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:46:37.588605 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:37.588605 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:37.588605 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:37.588605 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:37.589576 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:37.589576 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:37.589576 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:37.589576 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:37.589576 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:37.589576 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:37.589576 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:37.589576 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:37.589576 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:37.589576 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:37.589576 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:46:37.589576 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:46:37.589576 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 164/325] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:37.596182 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f913b5-8796-486a-be7d-c0d2c3d215ad None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:37.714479 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f913b5-8796-486a-be7d-c0d2c3d215ad None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:37.751412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368d0bf-4d06-44b9-a94e-58a04b206e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:37.752098 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368d0bf-4d06-44b9-a94e-58a04b206e46 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:37.752385 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368d0bf-4d06-44b9-a94e-58a04b206e46 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:37.752663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368d0bf-4d06-44b9-a94e-58a04b206e46 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:37.753467 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368d0bf-4d06-44b9-a94e-58a04b206e46 None admin] RBAC: Adding query filter params (name=reader) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:37.753784 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368d0bf-4d06-44b9-a94e-58a04b206e46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:37.755201 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368d0bf-4d06-44b9-a94e-58a04b206e46 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:37.765558 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 162/326] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:37.770060 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca61e90-5d41-47ed-83fa-7fcac1c59fb4 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:37.841917 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c673d8-f0d4-4381-85c2-ca73ef98a241 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:37.842716 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c673d8-f0d4-4381-85c2-ca73ef98a241 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:37.843016 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c673d8-f0d4-4381-85c2-ca73ef98a241 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:37.844387 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 163/327] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:46:37.849865 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aee8a2-1883-40fd-ade6-d29b784960dc None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:37.850151 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aee8a2-1883-40fd-ade6-d29b784960dc None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:37.850427 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aee8a2-1883-40fd-ade6-d29b784960dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:37.870209 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-26aee8a2-1883-40fd-ade6-d29b784960dc None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:37.871410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-26aee8a2-1883-40fd-ade6-d29b784960dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:37.888099 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca61e90-5d41-47ed-83fa-7fcac1c59fb4 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:37.928630 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf202a-159b-4c31-bb2f-0c9d3b8b6d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:37.929889 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf202a-159b-4c31-bb2f-0c9d3b8b6d42 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:37.930388 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf202a-159b-4c31-bb2f-0c9d3b8b6d42 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:37.930886 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf202a-159b-4c31-bb2f-0c9d3b8b6d42 None admin] PATH_INFO: `/v3/users/16ba0755ec8f47dc8c0abd094ef5fb1e` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:37.932355 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf202a-159b-4c31-bb2f-0c9d3b8b6d42 None admin] RBAC: Authorizing `identity:get_user(user_id=16ba0755ec8f47dc8c0abd094ef5fb1e)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:37.933840 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf202a-159b-4c31-bb2f-0c9d3b8b6d42 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:37.935648 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 165/328] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:37 2022] GET /identity/v3/users/16ba0755ec8f47dc8c0abd094ef5fb1e => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:37.941828 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf202a-159b-4c31-bb2f-0c9d3b8b6d42 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:37.949921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 164/329] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:46:37.974732 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aee8a2-1883-40fd-ade6-d29b784960dc None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:38.067746 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf202a-159b-4c31-bb2f-0c9d3b8b6d42 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:38.094004 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aee8a2-1883-40fd-ade6-d29b784960dc None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:38.113800 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8179d3-7ab6-4132-9096-434631f6a454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:38.115043 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8179d3-7ab6-4132-9096-434631f6a454 None admin] REQUEST_METHOD: `PUT` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:38.115334 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8179d3-7ab6-4132-9096-434631f6a454 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:38.115614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8179d3-7ab6-4132-9096-434631f6a454 None admin] PATH_INFO: `/v3/system/users/16ba0755ec8f47dc8c0abd094ef5fb1e/roles/b890511935cc4c2fa062153280c4cd25` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:38.117284 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8179d3-7ab6-4132-9096-434631f6a454 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=16ba0755ec8f47dc8c0abd094ef5fb1e, role_id=b890511935cc4c2fa062153280c4cd25)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:38.119493 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8179d3-7ab6-4132-9096-434631f6a454 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:38.133515 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 166/330] 10.222.0.48 () {58 vars in 1334 bytes} [Mon May 9 15:46:37 2022] PUT /identity/v3/system/users/16ba0755ec8f47dc8c0abd094ef5fb1e/roles/b890511935cc4c2fa062153280c4cd25 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:46:38.136251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d530b01-368a-45c9-b079-5326d833871d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:38.137179 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d530b01-368a-45c9-b079-5326d833871d None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:38.137509 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d530b01-368a-45c9-b079-5326d833871d None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:38.137788 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d530b01-368a-45c9-b079-5326d833871d None admin] PATH_INFO: `/v3/roles/member` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:38.151469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d530b01-368a-45c9-b079-5326d833871d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:38.160141 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-6d530b01-368a-45c9-b079-5326d833871d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:38.160141 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:38.160141 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:38.160141 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:38.160141 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:38.160141 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:38.160141 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:38.160141 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:38.160141 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:38.160141 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:38.160141 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:38.160141 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:38.160141 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:38.160141 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:38.160141 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:38.160141 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:38.161295 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:38.161295 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:38.161295 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:38.161295 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:38.161295 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:38.161295 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:38.161295 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:38.161295 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:38.161295 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:38.161295 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:38.161295 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:38.161295 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:46:38.161295 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:38.161295 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:38.161295 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:38.161295 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:38.162241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:38.162241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:38.162241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:38.162241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:38.162241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:38.162241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:38.162241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:38.162241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:38.162241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:38.162241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:38.162241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:38.162241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:46:38.162241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 165/331] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:46:38.168366 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8179d3-7ab6-4132-9096-434631f6a454 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:38.313593 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8179d3-7ab6-4132-9096-434631f6a454 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:38.358596 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f822a6-25c9-4b24-ab11-a8c9a9b72412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:38.359233 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f822a6-25c9-4b24-ab11-a8c9a9b72412 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:38.359522 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f822a6-25c9-4b24-ab11-a8c9a9b72412 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:38.359811 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f822a6-25c9-4b24-ab11-a8c9a9b72412 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:38.360577 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f822a6-25c9-4b24-ab11-a8c9a9b72412 None admin] RBAC: Adding query filter params (name=member) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:38.360890 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f822a6-25c9-4b24-ab11-a8c9a9b72412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:38.362350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f822a6-25c9-4b24-ab11-a8c9a9b72412 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:38.371375 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 167/332] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:38.377682 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d530b01-368a-45c9-b079-5326d833871d None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:38.501022 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d530b01-368a-45c9-b079-5326d833871d None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:38.540474 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d0ebe-e402-4103-ad47-553aac4d64ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:38.541363 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d0ebe-e402-4103-ad47-553aac4d64ac None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:38.541681 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d0ebe-e402-4103-ad47-553aac4d64ac None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:38.541961 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d0ebe-e402-4103-ad47-553aac4d64ac None admin] PATH_INFO: `/v3/users/4cbced494e2941319732536a57d2b6f1` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:38.543214 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d0ebe-e402-4103-ad47-553aac4d64ac None admin] RBAC: Authorizing `identity:get_user(user_id=4cbced494e2941319732536a57d2b6f1)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:38.544685 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d0ebe-e402-4103-ad47-553aac4d64ac None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:38.547156 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 166/333] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:38 2022] GET /identity/v3/users/4cbced494e2941319732536a57d2b6f1 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:38.553090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f822a6-25c9-4b24-ab11-a8c9a9b72412 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:38.693959 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f822a6-25c9-4b24-ab11-a8c9a9b72412 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:38.733623 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408de91-bd89-467a-895c-4157592c2023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:38.734378 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408de91-bd89-467a-895c-4157592c2023 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:38.734661 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408de91-bd89-467a-895c-4157592c2023 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:38.734941 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408de91-bd89-467a-895c-4157592c2023 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:38.735862 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408de91-bd89-467a-895c-4157592c2023 None admin] RBAC: Adding query filter params (role.id=6a75cc334b5a44b5a347a1a0cc20f6d7, user.id=4cbced494e2941319732536a57d2b6f1, scope.system=all) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:38.736184 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408de91-bd89-467a-895c-4157592c2023 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:38.737677 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408de91-bd89-467a-895c-4157592c2023 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:38.755090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 168/334] 10.222.0.48 () {56 vars in 1308 bytes} [Mon May 9 15:46:38 2022] GET /identity/v3/role_assignments?user.id=4cbced494e2941319732536a57d2b6f1&scope.system=all&role.id=6a75cc334b5a44b5a347a1a0cc20f6d7 => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:40.700537 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5a78f-6d75-42ac-b9ee-1ad64ef80d05 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:40.701694 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5a78f-6d75-42ac-b9ee-1ad64ef80d05 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:40.702228 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5a78f-6d75-42ac-b9ee-1ad64ef80d05 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:40.704202 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 167/335] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:40.710771 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f05714-2699-4693-9eb0-3377d1db595a None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:40.711795 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f05714-2699-4693-9eb0-3377d1db595a None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:40.712310 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f05714-2699-4693-9eb0-3377d1db595a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:40.738550 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-f2f05714-2699-4693-9eb0-3377d1db595a None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:40.739793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-f2f05714-2699-4693-9eb0-3377d1db595a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:40.834086 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 169/336] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:40.875249 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5a78f-6d75-42ac-b9ee-1ad64ef80d05 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:41.023123 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5a78f-6d75-42ac-b9ee-1ad64ef80d05 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:41.069045 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cccf82-0212-474f-8809-b295ce62aa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:41.069955 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cccf82-0212-474f-8809-b295ce62aa23 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:41.070266 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cccf82-0212-474f-8809-b295ce62aa23 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:41.070553 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cccf82-0212-474f-8809-b295ce62aa23 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:41.083158 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cccf82-0212-474f-8809-b295ce62aa23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:41.096884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-a7cccf82-0212-474f-8809-b295ce62aa23 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:46:41.096884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:41.096884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:41.096884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:41.096884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:41.096884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:41.096884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:41.096884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:41.096884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:41.096884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:41.096884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:41.096884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:41.096884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:41.096884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:41.096884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:41.096884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:41.098054 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:41.098054 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:41.098054 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:41.098054 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:41.098054 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:41.098054 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:41.098054 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:41.098054 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:41.098054 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:41.098054 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:41.098054 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:41.098054 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:46:41.098054 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:41.098054 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:41.098054 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:41.098054 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:41.099183 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:41.099183 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:41.099183 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:41.099183 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:41.099183 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:41.099183 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:41.099183 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:41.099183 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:41.099183 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:41.099183 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:41.099183 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:46:41.099183 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:46:41.099183 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 168/337] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:46:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:41.105061 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f05714-2699-4693-9eb0-3377d1db595a None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:41.118136 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62f066-b3ac-4f2b-8df8-1b3534aa31f4 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:41.118465 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62f066-b3ac-4f2b-8df8-1b3534aa31f4 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:41.118705 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62f066-b3ac-4f2b-8df8-1b3534aa31f4 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:41.120699 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 169/338] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:46:41.131896 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951140c-6425-4a3a-b075-534a5416bf77 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:41.132232 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951140c-6425-4a3a-b075-534a5416bf77 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:41.132476 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951140c-6425-4a3a-b075-534a5416bf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:41.156282 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-b951140c-6425-4a3a-b075-534a5416bf77 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:41.158000 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-b951140c-6425-4a3a-b075-534a5416bf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:41.253398 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 170/339] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:46:41.280473 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951140c-6425-4a3a-b075-534a5416bf77 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:41.357646 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f05714-2699-4693-9eb0-3377d1db595a None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:41.407115 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951140c-6425-4a3a-b075-534a5416bf77 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:41.449751 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f91901-1a11-436f-a5be-9a11d0d00749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:41.450737 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f91901-1a11-436f-a5be-9a11d0d00749 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:41.451068 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f91901-1a11-436f-a5be-9a11d0d00749 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:41.451386 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f91901-1a11-436f-a5be-9a11d0d00749 None admin] PATH_INFO: `/v3/roles/member` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:41.465823 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f91901-1a11-436f-a5be-9a11d0d00749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:41.474769 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-88f91901-1a11-436f-a5be-9a11d0d00749 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:41.474769 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:41.474769 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:41.474769 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:41.474769 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:41.474769 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:41.474769 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:41.474769 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:41.474769 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:41.474769 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:41.474769 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:41.474769 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:41.474769 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:41.474769 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:41.474769 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:41.474769 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:41.476801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:41.476801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:41.476801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:41.476801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:41.476801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:41.476801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:41.476801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:41.476801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:41.476801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:41.476801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:41.476801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:41.476801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:46:41.476801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:41.476801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:41.476801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:41.476801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:41.478604 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:41.478604 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:41.478604 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:41.478604 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:41.478604 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:41.478604 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:41.478604 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:41.478604 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:41.478604 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:41.478604 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:41.478604 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:41.478604 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:46:41.478604 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 171/340] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:46:41.482519 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f91901-1a11-436f-a5be-9a11d0d00749 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:41.484785 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c6d53-9db6-404e-8dac-d091a54cfe66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:41.486505 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c6d53-9db6-404e-8dac-d091a54cfe66 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:41.487376 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c6d53-9db6-404e-8dac-d091a54cfe66 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:41.488195 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c6d53-9db6-404e-8dac-d091a54cfe66 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:41.494273 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c6d53-9db6-404e-8dac-d091a54cfe66 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:41.495358 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c6d53-9db6-404e-8dac-d091a54cfe66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:41.498507 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c6d53-9db6-404e-8dac-d091a54cfe66 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:41.524096 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 170/341] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:46:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:41.549926 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c6d53-9db6-404e-8dac-d091a54cfe66 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:41.625599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f91901-1a11-436f-a5be-9a11d0d00749 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:41.664323 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9590208-db0a-4eaa-973e-b966f7ab632c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:41.665016 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9590208-db0a-4eaa-973e-b966f7ab632c None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:41.665540 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9590208-db0a-4eaa-973e-b966f7ab632c None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:41.665999 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9590208-db0a-4eaa-973e-b966f7ab632c None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:41.667165 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9590208-db0a-4eaa-973e-b966f7ab632c None admin] RBAC: Adding query filter params (name=member) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:41.667686 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9590208-db0a-4eaa-973e-b966f7ab632c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:41.669880 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9590208-db0a-4eaa-973e-b966f7ab632c None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:41.681154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 172/342] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:41.683270 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7ed69-f9c9-4418-82cc-83e6a6faf5e0 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:41.683767 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7ed69-f9c9-4418-82cc-83e6a6faf5e0 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:41.684226 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7ed69-f9c9-4418-82cc-83e6a6faf5e0 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:41.690390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 173/343] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:41.694549 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7ed69-f9c9-4418-82cc-83e6a6faf5e0 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:41.824830 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c6d53-9db6-404e-8dac-d091a54cfe66 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:41.841561 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7ed69-f9c9-4418-82cc-83e6a6faf5e0 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:41.882289 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639fd6c4-4332-4f37-bb0c-6a94dc323dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:41.883244 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fd6c4-4332-4f37-bb0c-6a94dc323dfb None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:41.883701 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fd6c4-4332-4f37-bb0c-6a94dc323dfb None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:41.884215 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fd6c4-4332-4f37-bb0c-6a94dc323dfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:41.893978 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a120089-ce6a-4c91-8c5f-0e9093810e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:41.895104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a120089-ce6a-4c91-8c5f-0e9093810e67 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:41.895605 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a120089-ce6a-4c91-8c5f-0e9093810e67 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:41.896439 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a120089-ce6a-4c91-8c5f-0e9093810e67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:41.964402 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639fd6c4-4332-4f37-bb0c-6a94dc323dfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:41.966305 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639fd6c4-4332-4f37-bb0c-6a94dc323dfb None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:42.027386 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a120089-ce6a-4c91-8c5f-0e9093810e67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:42.030782 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a120089-ce6a-4c91-8c5f-0e9093810e67 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:42.081096 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 174/344] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:46:42.086744 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98c2ac-3a61-4525-bf37-d62a7fb628f3 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:42.087040 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98c2ac-3a61-4525-bf37-d62a7fb628f3 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:42.087427 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98c2ac-3a61-4525-bf37-d62a7fb628f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:42.109190 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-ce98c2ac-3a61-4525-bf37-d62a7fb628f3 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:42.110525 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-ce98c2ac-3a61-4525-bf37-d62a7fb628f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:42.204964 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 175/345] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:42.207806 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444d1da-f2d9-4a53-9c85-6a49d43635f9 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:42.208633 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444d1da-f2d9-4a53-9c85-6a49d43635f9 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:42.209406 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444d1da-f2d9-4a53-9c85-6a49d43635f9 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:42.212108 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 176/346] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:42.213543 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444d1da-f2d9-4a53-9c85-6a49d43635f9 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:42.232562 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 171/347] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:46:42.236252 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122d060-9344-450f-b67b-4969d72bb07b None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:42.237126 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122d060-9344-450f-b67b-4969d72bb07b None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:42.237999 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122d060-9344-450f-b67b-4969d72bb07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:42.268624 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-5122d060-9344-450f-b67b-4969d72bb07b None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:42.271268 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-5122d060-9344-450f-b67b-4969d72bb07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:42.400887 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 172/348] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:42.403004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122d060-9344-450f-b67b-4969d72bb07b None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:42.405389 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444d1da-f2d9-4a53-9c85-6a49d43635f9 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:42.454906 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927a281-f8db-4d1c-a78a-bcb588b935a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:42.456264 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927a281-f8db-4d1c-a78a-bcb588b935a3 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:42.456264 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927a281-f8db-4d1c-a78a-bcb588b935a3 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:42.456598 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927a281-f8db-4d1c-a78a-bcb588b935a3 None admin] PATH_INFO: `/v3/projects/049f004d411f4c94a764b0a9955e9216` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:42.457818 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927a281-f8db-4d1c-a78a-bcb588b935a3 None admin] RBAC: Authorizing `identity:get_project(project_id=049f004d411f4c94a764b0a9955e9216)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:42.459399 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927a281-f8db-4d1c-a78a-bcb588b935a3 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:42.461533 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 177/349] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:42 2022] GET /identity/v3/projects/049f004d411f4c94a764b0a9955e9216 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:42.462186 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927a281-f8db-4d1c-a78a-bcb588b935a3 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:42.591053 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927a281-f8db-4d1c-a78a-bcb588b935a3 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:42.600975 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122d060-9344-450f-b67b-4969d72bb07b None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:42.635363 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864dd99-486c-4ddd-b5c2-6091a2888fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:42.636304 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864dd99-486c-4ddd-b5c2-6091a2888fa7 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:42.636599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864dd99-486c-4ddd-b5c2-6091a2888fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:42.636868 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864dd99-486c-4ddd-b5c2-6091a2888fa7 None admin] PATH_INFO: `/v3/projects/049f004d411f4c94a764b0a9955e9216` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:42.640169 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864dd99-486c-4ddd-b5c2-6091a2888fa7 None admin] RBAC: Authorizing `identity:get_project(project_id=049f004d411f4c94a764b0a9955e9216)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:42.643508 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864dd99-486c-4ddd-b5c2-6091a2888fa7 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:42.645735 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 178/350] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:42 2022] GET /identity/v3/projects/049f004d411f4c94a764b0a9955e9216 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:42.646366 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864dd99-486c-4ddd-b5c2-6091a2888fa7 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:42.686672 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b0375-e5c4-452b-b66f-3b4fbcbe9ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:42.688628 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b0375-e5c4-452b-b66f-3b4fbcbe9ce9 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:42.689504 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b0375-e5c4-452b-b66f-3b4fbcbe9ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:42.690498 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b0375-e5c4-452b-b66f-3b4fbcbe9ce9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:42.711392 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b0375-e5c4-452b-b66f-3b4fbcbe9ce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:42.728185 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-830b0375-e5c4-452b-b66f-3b4fbcbe9ce9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:42.728185 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:42.728185 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:42.728185 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:42.728185 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:42.728185 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:42.728185 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:42.728185 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:42.728185 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:42.728185 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:42.728185 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:42.728185 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:42.728185 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:42.728185 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:42.728185 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:42.728185 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:42.730336 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:42.730336 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:42.730336 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:42.730336 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:42.730336 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:42.730336 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:42.730336 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:42.730336 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:42.730336 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:42.730336 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:42.730336 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:42.730336 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:46:42.730336 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:42.730336 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:42.730336 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:42.730336 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:42.732192 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:42.732192 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:42.732192 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:42.732192 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:42.732192 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:42.732192 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:42.732192 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:42.732192 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:42.732192 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:42.732192 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:42.732192 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:42.732192 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:46:42.738420 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 173/351] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:42.740285 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b0375-e5c4-452b-b66f-3b4fbcbe9ce9 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:42.770650 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864dd99-486c-4ddd-b5c2-6091a2888fa7 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:42.811498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc58a9e-1dd6-4b33-ae06-d89b81b13893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:42.811498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc58a9e-1dd6-4b33-ae06-d89b81b13893 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:42.811972 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc58a9e-1dd6-4b33-ae06-d89b81b13893 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:42.812360 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc58a9e-1dd6-4b33-ae06-d89b81b13893 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:42.825532 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc58a9e-1dd6-4b33-ae06-d89b81b13893 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:42.834731 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-8cc58a9e-1dd6-4b33-ae06-d89b81b13893 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:46:42.834731 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:42.834731 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:42.834731 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:42.834731 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:42.834731 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:42.834731 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:42.834731 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:42.834731 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:42.834731 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:42.834731 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:42.834731 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:42.834731 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:42.834731 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:42.834731 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:42.834731 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:42.836782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:42.836782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:42.836782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:42.836782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:42.836782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:42.836782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:42.836782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:42.836782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:42.836782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:42.836782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:42.836782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:42.836782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:46:42.836782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:42.836782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:42.836782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:42.836782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:42.838646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:42.838646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:42.838646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:42.838646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:42.838646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:42.838646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:42.838646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:42.838646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:42.838646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:42.838646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:42.838646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 09 15:46:42.838646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:46:42.838646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 179/352] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:42.838646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc58a9e-1dd6-4b33-ae06-d89b81b13893 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:42.943053 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b0375-e5c4-452b-b66f-3b4fbcbe9ce9 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:42.971242 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc58a9e-1dd6-4b33-ae06-d89b81b13893 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:42.984386 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324621e-acdd-472e-accd-65a12fa0e8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:42.985933 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324621e-acdd-472e-accd-65a12fa0e8f8 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:42.986482 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324621e-acdd-472e-accd-65a12fa0e8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:42.986984 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324621e-acdd-472e-accd-65a12fa0e8f8 None admin] PATH_INFO: `/v3/groups/c8b79b21afc54cbaab86d8a0863d0592` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:42.994286 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324621e-acdd-472e-accd-65a12fa0e8f8 None admin] RBAC: Authorizing `identity:get_group(group_id=c8b79b21afc54cbaab86d8a0863d0592)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:42.996170 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324621e-acdd-472e-accd-65a12fa0e8f8 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:42.998313 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 174/353] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:46:42 2022] GET /identity/v3/groups/c8b79b21afc54cbaab86d8a0863d0592 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:42.999554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324621e-acdd-472e-accd-65a12fa0e8f8 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:43.040492 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca4ec6-6a23-4e80-9ce2-24ef9a0a7d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:43.041874 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca4ec6-6a23-4e80-9ce2-24ef9a0a7d49 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:43.042329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca4ec6-6a23-4e80-9ce2-24ef9a0a7d49 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:43.042802 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca4ec6-6a23-4e80-9ce2-24ef9a0a7d49 None admin] PATH_INFO: `/v3/groups/c8b79b21afc54cbaab86d8a0863d0592` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:43.045176 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca4ec6-6a23-4e80-9ce2-24ef9a0a7d49 None admin] RBAC: Authorizing `identity:get_group(group_id=c8b79b21afc54cbaab86d8a0863d0592)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:43.049346 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca4ec6-6a23-4e80-9ce2-24ef9a0a7d49 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:43.051235 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 180/354] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:46:42 2022] GET /identity/v3/groups/c8b79b21afc54cbaab86d8a0863d0592 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:43.052222 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca4ec6-6a23-4e80-9ce2-24ef9a0a7d49 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:43.144234 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324621e-acdd-472e-accd-65a12fa0e8f8 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:43.189881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b128a-1b1d-426d-90b3-ed71f89cb725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:43.191334 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b128a-1b1d-426d-90b3-ed71f89cb725 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:43.191809 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b128a-1b1d-426d-90b3-ed71f89cb725 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:43.192275 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b128a-1b1d-426d-90b3-ed71f89cb725 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:43.194016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b128a-1b1d-426d-90b3-ed71f89cb725 None admin] RBAC: Adding query filter params (name=member) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:43.195319 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b128a-1b1d-426d-90b3-ed71f89cb725 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:43.196813 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b128a-1b1d-426d-90b3-ed71f89cb725 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:43.215433 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 175/355] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:43.219866 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b31a79-5211-4dcb-8cf9-9f9049ef1ca9 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:43.220501 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b31a79-5211-4dcb-8cf9-9f9049ef1ca9 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:43.221005 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b31a79-5211-4dcb-8cf9-9f9049ef1ca9 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:43.225133 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 176/356] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:43.226933 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b31a79-5211-4dcb-8cf9-9f9049ef1ca9 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:43.227404 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca4ec6-6a23-4e80-9ce2-24ef9a0a7d49 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:43.283566 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fd921-2437-4842-9c02-c26a02ed7b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:43.284369 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fd921-2437-4842-9c02-c26a02ed7b13 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:43.284686 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fd921-2437-4842-9c02-c26a02ed7b13 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:43.285774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fd921-2437-4842-9c02-c26a02ed7b13 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:43.286782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7fd921-2437-4842-9c02-c26a02ed7b13 None admin] RBAC: Adding query filter params (name=reader) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:43.287096 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7fd921-2437-4842-9c02-c26a02ed7b13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:43.288625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7fd921-2437-4842-9c02-c26a02ed7b13 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:43.303278 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 181/357] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:43.304220 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fd921-2437-4842-9c02-c26a02ed7b13 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:43.420483 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b31a79-5211-4dcb-8cf9-9f9049ef1ca9 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:43.456416 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fd921-2437-4842-9c02-c26a02ed7b13 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:43.486547 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9249d0f-b0b0-4490-8934-0966f8858f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:43.487640 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9249d0f-b0b0-4490-8934-0966f8858f80 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:43.488194 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9249d0f-b0b0-4490-8934-0966f8858f80 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:43.488505 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9249d0f-b0b0-4490-8934-0966f8858f80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:43.489346 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9249d0f-b0b0-4490-8934-0966f8858f80 None admin] RBAC: Adding query filter params (group.id=c8b79b21afc54cbaab86d8a0863d0592, role.id=6a75cc334b5a44b5a347a1a0cc20f6d7, scope.project.id=049f004d411f4c94a764b0a9955e9216) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:43.489714 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9249d0f-b0b0-4490-8934-0966f8858f80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:43.491324 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9249d0f-b0b0-4490-8934-0966f8858f80 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:43.501579 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 177/358] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:46:43 2022] GET /identity/v3/role_assignments?group.id=c8b79b21afc54cbaab86d8a0863d0592&scope.project.id=049f004d411f4c94a764b0a9955e9216&role.id=6a75cc334b5a44b5a347a1a0cc20f6d7 => generated 260 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:43.502663 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9249d0f-b0b0-4490-8934-0966f8858f80 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:43.516151 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a7565-ec7c-45e0-b129-754a52ad02de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:43.516832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a7565-ec7c-45e0-b129-754a52ad02de None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:43.517206 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a7565-ec7c-45e0-b129-754a52ad02de None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:43.517424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a7565-ec7c-45e0-b129-754a52ad02de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:43.519861 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a7565-ec7c-45e0-b129-754a52ad02de None admin] RBAC: Adding query filter params (group.id=c8b79b21afc54cbaab86d8a0863d0592, role.id=cf8c8db912344d0f82f8e6b0fa805968, scope.project.id=049f004d411f4c94a764b0a9955e9216) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:43.519861 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a7565-ec7c-45e0-b129-754a52ad02de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:43.520365 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a7565-ec7c-45e0-b129-754a52ad02de None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:43.533877 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 182/359] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:46:43 2022] GET /identity/v3/role_assignments?group.id=c8b79b21afc54cbaab86d8a0863d0592&scope.project.id=049f004d411f4c94a764b0a9955e9216&role.id=cf8c8db912344d0f82f8e6b0fa805968 => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:43.535524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe5534-f75b-4269-a124-f8e2a1f192f9 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:43.535829 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe5534-f75b-4269-a124-f8e2a1f192f9 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:43.536117 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe5534-f75b-4269-a124-f8e2a1f192f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:43.557710 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-9bbe5534-f75b-4269-a124-f8e2a1f192f9 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:43.559135 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-9bbe5534-f75b-4269-a124-f8e2a1f192f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:43.690491 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9249d0f-b0b0-4490-8934-0966f8858f80 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:43.692019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 183/360] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:43.693031 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe5534-f75b-4269-a124-f8e2a1f192f9 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:43.754512 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8eb6b1-92e9-464d-a569-232fd38018f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:43.755117 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8eb6b1-92e9-464d-a569-232fd38018f2 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:43.755409 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8eb6b1-92e9-464d-a569-232fd38018f2 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:43.755695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8eb6b1-92e9-464d-a569-232fd38018f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:43.841704 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe5534-f75b-4269-a124-f8e2a1f192f9 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:43.888717 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8eb6b1-92e9-464d-a569-232fd38018f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:43.891092 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8eb6b1-92e9-464d-a569-232fd38018f2 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:43.895305 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa28aca-ee0b-4a7c-bff3-7d371681eaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:43.895569 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa28aca-ee0b-4a7c-bff3-7d371681eaa6 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:43.895820 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa28aca-ee0b-4a7c-bff3-7d371681eaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:43.895996 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa28aca-ee0b-4a7c-bff3-7d371681eaa6 None admin] PATH_INFO: `/v3/users/16ba0755ec8f47dc8c0abd094ef5fb1e` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:43.898370 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa28aca-ee0b-4a7c-bff3-7d371681eaa6 None admin] RBAC: Authorizing `identity:get_user(user_id=16ba0755ec8f47dc8c0abd094ef5fb1e)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:43.901025 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa28aca-ee0b-4a7c-bff3-7d371681eaa6 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:43.903293 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 184/361] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:46:43 2022] GET /identity/v3/users/16ba0755ec8f47dc8c0abd094ef5fb1e => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:43.909734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4baf9-39d8-45eb-aa41-40d47bc27961 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:43.909734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4baf9-39d8-45eb-aa41-40d47bc27961 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:43.909734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4baf9-39d8-45eb-aa41-40d47bc27961 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:43.909734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 185/362] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:43.909734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4baf9-39d8-45eb-aa41-40d47bc27961 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:44.016032 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 178/363] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:46:44.017335 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdcecc-cb21-4b4c-9ce9-d32d3b47bef8 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:44.017771 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdcecc-cb21-4b4c-9ce9-d32d3b47bef8 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:44.018199 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdcecc-cb21-4b4c-9ce9-d32d3b47bef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:44.038009 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-11bdcecc-cb21-4b4c-9ce9-d32d3b47bef8 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:44.038975 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-11bdcecc-cb21-4b4c-9ce9-d32d3b47bef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:44.054123 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4baf9-39d8-45eb-aa41-40d47bc27961 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:44.102778 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78890904-5390-4c1c-9095-abbcc1e06df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:44.104307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78890904-5390-4c1c-9095-abbcc1e06df3 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:44.104611 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78890904-5390-4c1c-9095-abbcc1e06df3 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:44.104938 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78890904-5390-4c1c-9095-abbcc1e06df3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:44.122374 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 179/364] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:44.123333 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bdcecc-cb21-4b4c-9ce9-d32d3b47bef8 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:44.129145 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78890904-5390-4c1c-9095-abbcc1e06df3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:44.139627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-78890904-5390-4c1c-9095-abbcc1e06df3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:46:44.139627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:44.139627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:44.139627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:44.139627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:44.139627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:44.139627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:44.139627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:44.139627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:44.139627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:44.139627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:44.139627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:44.139627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:44.139627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:44.139627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:44.139627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:44.141286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:44.141286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:44.141286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:44.141286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:44.141286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:44.141286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:44.141286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:44.141286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:44.141286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:44.141286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:44.141286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:44.141286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:46:44.141286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:44.141286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:44.141286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:44.141286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:44.142286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:44.142286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:44.142286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:44.142286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:44.142286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:44.142286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:44.142286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:44.142286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:44.142286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:44.142286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:44.142286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:46:44.142286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:46:44.142286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 186/365] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:46:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:44.142286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78890904-5390-4c1c-9095-abbcc1e06df3 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:44.287521 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bdcecc-cb21-4b4c-9ce9-d32d3b47bef8 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:44.333840 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aafe9e-2c92-49b8-a3be-f046e1b932ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:44.335930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aafe9e-2c92-49b8-a3be-f046e1b932ea None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:44.336486 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aafe9e-2c92-49b8-a3be-f046e1b932ea None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:44.336980 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aafe9e-2c92-49b8-a3be-f046e1b932ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:44.338234 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aafe9e-2c92-49b8-a3be-f046e1b932ea None admin] RBAC: Adding query filter params (role.id=b890511935cc4c2fa062153280c4cd25, user.id=16ba0755ec8f47dc8c0abd094ef5fb1e, scope.system=all) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:44.338815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aafe9e-2c92-49b8-a3be-f046e1b932ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:44.340544 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aafe9e-2c92-49b8-a3be-f046e1b932ea None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:44.342939 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78890904-5390-4c1c-9095-abbcc1e06df3 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:44.356303 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 180/366] 10.222.0.48 () {56 vars in 1308 bytes} [Mon May 9 15:46:44 2022] GET /identity/v3/role_assignments?user.id=16ba0755ec8f47dc8c0abd094ef5fb1e&scope.system=all&role.id=b890511935cc4c2fa062153280c4cd25 => generated 510 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:44.361816 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aafe9e-2c92-49b8-a3be-f046e1b932ea None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:44.411916 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467557c-a28d-46cb-bd1e-931ecd4cb7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:44.413361 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467557c-a28d-46cb-bd1e-931ecd4cb7f2 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:44.413909 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467557c-a28d-46cb-bd1e-931ecd4cb7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:44.414297 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467557c-a28d-46cb-bd1e-931ecd4cb7f2 None admin] PATH_INFO: `/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:44.417093 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467557c-a28d-46cb-bd1e-931ecd4cb7f2 None admin] RBAC: Authorizing `identity:get_project(project_id=8eb38f20a7f646d49f0c1da50ff81db2)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:44.419493 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467557c-a28d-46cb-bd1e-931ecd4cb7f2 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:44.425181 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 187/367] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:44 2022] GET /identity/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:44.426840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467557c-a28d-46cb-bd1e-931ecd4cb7f2 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:44.609171 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aafe9e-2c92-49b8-a3be-f046e1b932ea None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:44.625775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467557c-a28d-46cb-bd1e-931ecd4cb7f2 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:44.692657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1a046-e72f-4420-8a62-f72ad7cb46a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:44.693362 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1a046-e72f-4420-8a62-f72ad7cb46a6 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:44.693676 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1a046-e72f-4420-8a62-f72ad7cb46a6 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:44.693959 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1a046-e72f-4420-8a62-f72ad7cb46a6 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:44.694754 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1a046-e72f-4420-8a62-f72ad7cb46a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:44.695073 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1a046-e72f-4420-8a62-f72ad7cb46a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:44.696489 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1a046-e72f-4420-8a62-f72ad7cb46a6 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:44.702149 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0179a-4127-4528-a42b-5625865e0d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:44.703580 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0179a-4127-4528-a42b-5625865e0d31 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:44.703982 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0179a-4127-4528-a42b-5625865e0d31 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:44.704446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0179a-4127-4528-a42b-5625865e0d31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:44.708711 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 181/368] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:46:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:44.709656 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1a046-e72f-4420-8a62-f72ad7cb46a6 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:44.728271 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0179a-4127-4528-a42b-5625865e0d31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:44.744675 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-33a0179a-4127-4528-a42b-5625865e0d31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:46:44.744675 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:44.744675 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:44.744675 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:44.744675 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:44.744675 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:44.744675 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:44.744675 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:44.744675 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:44.744675 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:44.744675 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:44.744675 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:44.744675 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:44.744675 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:44.744675 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:44.744675 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:44.745907 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:44.745907 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:44.745907 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:44.745907 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:44.745907 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:44.745907 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:44.745907 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:44.745907 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:44.745907 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:44.745907 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:44.745907 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:44.745907 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:46:44.745907 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:44.745907 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:44.745907 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:44.745907 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:44.746955 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:44.746955 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:44.746955 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:44.746955 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:44.746955 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:44.746955 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:44.746955 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:44.746955 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:44.746955 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:44.746955 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:44.746955 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:46:44.746955 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:46:44.746955 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 188/369] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:46:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:44.748360 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0179a-4127-4528-a42b-5625865e0d31 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:44.878944 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1a046-e72f-4420-8a62-f72ad7cb46a6 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:44.927449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070c619-7d1f-48bd-8a3b-cc72f6e8f58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:44.928362 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070c619-7d1f-48bd-8a3b-cc72f6e8f58a None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:44.928657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070c619-7d1f-48bd-8a3b-cc72f6e8f58a None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:44.929003 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070c619-7d1f-48bd-8a3b-cc72f6e8f58a None admin] PATH_INFO: `/v3/groups/c8b79b21afc54cbaab86d8a0863d0592` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:44.930428 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070c619-7d1f-48bd-8a3b-cc72f6e8f58a None admin] RBAC: Authorizing `identity:get_group(group_id=c8b79b21afc54cbaab86d8a0863d0592)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:44.931912 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070c619-7d1f-48bd-8a3b-cc72f6e8f58a None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:44.934069 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 182/370] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:46:44 2022] GET /identity/v3/groups/c8b79b21afc54cbaab86d8a0863d0592 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:44.935016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070c619-7d1f-48bd-8a3b-cc72f6e8f58a None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:45.009613 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0179a-4127-4528-a42b-5625865e0d31 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:45.085067 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e29a2-94eb-4594-961d-4332beab6e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:45.086157 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e29a2-94eb-4594-961d-4332beab6e51 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:45.086557 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e29a2-94eb-4594-961d-4332beab6e51 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:45.086860 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e29a2-94eb-4594-961d-4332beab6e51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:45.155576 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070c619-7d1f-48bd-8a3b-cc72f6e8f58a None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:45.230326 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e29a2-94eb-4594-961d-4332beab6e51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:45.233615 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e29a2-94eb-4594-961d-4332beab6e51 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:45.240147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0f034-8e23-4eb1-acf7-8917ad3399b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:45.241441 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0f034-8e23-4eb1-acf7-8917ad3399b7 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:45.241976 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0f034-8e23-4eb1-acf7-8917ad3399b7 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:45.242495 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0f034-8e23-4eb1-acf7-8917ad3399b7 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:45.243914 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0f034-8e23-4eb1-acf7-8917ad3399b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:45.244559 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0f034-8e23-4eb1-acf7-8917ad3399b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:45.247307 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0f034-8e23-4eb1-acf7-8917ad3399b7 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:45.269918 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 183/371] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:45.271313 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0f034-8e23-4eb1-acf7-8917ad3399b7 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:45.414199 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0f034-8e23-4eb1-acf7-8917ad3399b7 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:45.443903 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 189/372] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:46:45.445587 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e29a2-94eb-4594-961d-4332beab6e51 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:45.459239 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d96bf-470d-4b73-b2ab-5d1b7250f60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:45.459926 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d96bf-470d-4b73-b2ab-5d1b7250f60a None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:45.460209 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d96bf-470d-4b73-b2ab-5d1b7250f60a None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:45.460483 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d96bf-470d-4b73-b2ab-5d1b7250f60a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:45.461352 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d96bf-470d-4b73-b2ab-5d1b7250f60a None admin] RBAC: Adding query filter params (group.id=c8b79b21afc54cbaab86d8a0863d0592, role.id=6a75cc334b5a44b5a347a1a0cc20f6d7, scope.project.id=8eb38f20a7f646d49f0c1da50ff81db2) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:45.461694 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d96bf-470d-4b73-b2ab-5d1b7250f60a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:45.463229 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d96bf-470d-4b73-b2ab-5d1b7250f60a None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:45.470907 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 184/373] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:46:45 2022] GET /identity/v3/role_assignments?group.id=c8b79b21afc54cbaab86d8a0863d0592&scope.project.id=8eb38f20a7f646d49f0c1da50ff81db2&role.id=6a75cc334b5a44b5a347a1a0cc20f6d7 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:45.471822 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d96bf-470d-4b73-b2ab-5d1b7250f60a None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:45.652300 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d96bf-470d-4b73-b2ab-5d1b7250f60a None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:45.696829 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e29a2-94eb-4594-961d-4332beab6e51 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:45.735600 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c5557-e192-4f5d-8b42-88590863238e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:45.736616 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c5557-e192-4f5d-8b42-88590863238e None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:45.736900 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c5557-e192-4f5d-8b42-88590863238e None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:45.737187 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c5557-e192-4f5d-8b42-88590863238e None admin] PATH_INFO: `/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:45.738670 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c5557-e192-4f5d-8b42-88590863238e None admin] RBAC: Authorizing `identity:get_project(project_id=8eb38f20a7f646d49f0c1da50ff81db2)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:45.740154 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c5557-e192-4f5d-8b42-88590863238e None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:45.742584 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 185/374] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:45 2022] GET /identity/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:45.758524 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c5557-e192-4f5d-8b42-88590863238e None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:45.776960 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84389c87-1b1c-4fa2-9910-87e861f41155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:45.778095 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84389c87-1b1c-4fa2-9910-87e861f41155 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:45.778577 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84389c87-1b1c-4fa2-9910-87e861f41155 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:45.779042 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84389c87-1b1c-4fa2-9910-87e861f41155 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:45.900329 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c5557-e192-4f5d-8b42-88590863238e None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:45.950413 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7ac7b-3b04-40d6-9593-85a8515e1c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:45.952690 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7ac7b-3b04-40d6-9593-85a8515e1c12 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:45.952860 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7ac7b-3b04-40d6-9593-85a8515e1c12 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:45.953285 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7ac7b-3b04-40d6-9593-85a8515e1c12 None admin] PATH_INFO: `/v3/groups/c8b79b21afc54cbaab86d8a0863d0592` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:45.955563 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7ac7b-3b04-40d6-9593-85a8515e1c12 None admin] RBAC: Authorizing `identity:get_group(group_id=c8b79b21afc54cbaab86d8a0863d0592)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:45.958376 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7ac7b-3b04-40d6-9593-85a8515e1c12 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:45.961872 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 186/375] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:46:45 2022] GET /identity/v3/groups/c8b79b21afc54cbaab86d8a0863d0592 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:45.972518 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7ac7b-3b04-40d6-9593-85a8515e1c12 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:45.977214 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84389c87-1b1c-4fa2-9910-87e861f41155 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:45.980162 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84389c87-1b1c-4fa2-9910-87e861f41155 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:46.231806 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 190/376] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 782 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:46:46.233561 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84389c87-1b1c-4fa2-9910-87e861f41155 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:46.247512 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7ac7b-3b04-40d6-9593-85a8515e1c12 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:46.284264 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c676e1-a418-4de2-91d0-b8024d9b2d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:46.284938 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c676e1-a418-4de2-91d0-b8024d9b2d79 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:46.285220 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c676e1-a418-4de2-91d0-b8024d9b2d79 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:46.285561 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c676e1-a418-4de2-91d0-b8024d9b2d79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:46.286422 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c676e1-a418-4de2-91d0-b8024d9b2d79 None admin] RBAC: Adding query filter params (group.id=c8b79b21afc54cbaab86d8a0863d0592, role.id=cf8c8db912344d0f82f8e6b0fa805968, scope.project.id=8eb38f20a7f646d49f0c1da50ff81db2) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:46.286737 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c676e1-a418-4de2-91d0-b8024d9b2d79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:46.288178 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c676e1-a418-4de2-91d0-b8024d9b2d79 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:46.294604 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 187/377] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:46:45 2022] GET /identity/v3/role_assignments?group.id=c8b79b21afc54cbaab86d8a0863d0592&scope.project.id=8eb38f20a7f646d49f0c1da50ff81db2&role.id=cf8c8db912344d0f82f8e6b0fa805968 => generated 260 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:46.417810 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84389c87-1b1c-4fa2-9910-87e861f41155 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:46.460840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281f825-0cea-4563-bdc1-f05cef65def2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:46.461738 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281f825-0cea-4563-bdc1-f05cef65def2 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:46.462021 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281f825-0cea-4563-bdc1-f05cef65def2 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:46.462299 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281f825-0cea-4563-bdc1-f05cef65def2 None admin] PATH_INFO: `/v3/projects/d98726a0503446c8990ec97c6f98d1d8` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:46.463535 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281f825-0cea-4563-bdc1-f05cef65def2 None admin] RBAC: Authorizing `identity:get_project(project_id=d98726a0503446c8990ec97c6f98d1d8)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:46.464982 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281f825-0cea-4563-bdc1-f05cef65def2 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:46.467368 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 191/378] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:46 2022] GET /identity/v3/projects/d98726a0503446c8990ec97c6f98d1d8 => generated 344 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:46.472980 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c676e1-a418-4de2-91d0-b8024d9b2d79 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:46.588027 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c676e1-a418-4de2-91d0-b8024d9b2d79 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:46.640832 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fdbe7-a8ed-4002-8ce8-282c0f91beb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:46.645504 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fdbe7-a8ed-4002-8ce8-282c0f91beb3 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:46.645504 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fdbe7-a8ed-4002-8ce8-282c0f91beb3 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:46.645504 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fdbe7-a8ed-4002-8ce8-282c0f91beb3 None admin] PATH_INFO: `/v3/groups/bb358de4f0014e4bac2fd154033b75cb` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:46.654842 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6fdbe7-a8ed-4002-8ce8-282c0f91beb3 None admin] RBAC: Authorizing `identity:get_group(group_id=bb358de4f0014e4bac2fd154033b75cb)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:46.656351 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6fdbe7-a8ed-4002-8ce8-282c0f91beb3 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:46.658620 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 188/379] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:46:46 2022] GET /identity/v3/groups/bb358de4f0014e4bac2fd154033b75cb => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:46.668937 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281f825-0cea-4563-bdc1-f05cef65def2 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:46.799249 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281f825-0cea-4563-bdc1-f05cef65def2 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:46.840738 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774255f1-22fb-4302-bc46-b17e64ad3039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:46.841345 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774255f1-22fb-4302-bc46-b17e64ad3039 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:46.841656 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774255f1-22fb-4302-bc46-b17e64ad3039 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:46.842806 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774255f1-22fb-4302-bc46-b17e64ad3039 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:46.844618 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774255f1-22fb-4302-bc46-b17e64ad3039 None admin] RBAC: Adding query filter params (group.id=bb358de4f0014e4bac2fd154033b75cb, role.id=2180d183afad443187521833c40ed8a1, scope.project.id=d98726a0503446c8990ec97c6f98d1d8) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:46.844942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774255f1-22fb-4302-bc46-b17e64ad3039 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:46.846500 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774255f1-22fb-4302-bc46-b17e64ad3039 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:46.858184 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 192/380] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:46:46 2022] GET /identity/v3/role_assignments?group.id=bb358de4f0014e4bac2fd154033b75cb&scope.project.id=d98726a0503446c8990ec97c6f98d1d8&role.id=2180d183afad443187521833c40ed8a1 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:47.334588 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3f2dd-ad37-4227-8d7d-ab7ce4a4a2bb None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:47.335170 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3f2dd-ad37-4227-8d7d-ab7ce4a4a2bb None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:47.335558 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3f2dd-ad37-4227-8d7d-ab7ce4a4a2bb None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:47.338654 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 189/381] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:47.361857 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f2e51-cec2-473a-b10d-602c597ed8e6 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:47.362518 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f2e51-cec2-473a-b10d-602c597ed8e6 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:47.362518 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f2e51-cec2-473a-b10d-602c597ed8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:47.394796 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-ad3f2e51-cec2-473a-b10d-602c597ed8e6 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:47.396756 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-ad3f2e51-cec2-473a-b10d-602c597ed8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:47.493949 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 193/382] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:46:47.566565 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3f2dd-ad37-4227-8d7d-ab7ce4a4a2bb None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:47.834048 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3f2dd-ad37-4227-8d7d-ab7ce4a4a2bb None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:47.918958 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3267e-e315-445a-b271-642d14d7bdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:47.920783 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3267e-e315-445a-b271-642d14d7bdfd None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:47.921274 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3267e-e315-445a-b271-642d14d7bdfd None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:47.921808 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3267e-e315-445a-b271-642d14d7bdfd None admin] PATH_INFO: `/v3/roles/member` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:47.937947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3267e-e315-445a-b271-642d14d7bdfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:47.945815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-34b3267e-e315-445a-b271-642d14d7bdfd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:47.945815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:47.945815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:47.945815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:47.945815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:47.945815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:47.945815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:47.945815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:47.945815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:47.945815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:47.945815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:47.945815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:47.945815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:47.945815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:47.945815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:47.945815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:47.946868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:47.946868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:47.946868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:47.946868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:47.946868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:47.946868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:47.946868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:47.946868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:47.946868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:47.946868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:47.946868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:47.946868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:46:47.946868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:47.946868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:47.946868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:47.946868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:47.947775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:47.947775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:47.947775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:47.947775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:47.947775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:47.947775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:47.947775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:47.947775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:47.947775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:47.947775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:47.947775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:47.947775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:46:47.947775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 190/383] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:47.956485 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f2e51-cec2-473a-b10d-602c597ed8e6 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:48.030734 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66452205-9007-4bda-b572-5b56e163b3ba None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:48.031398 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66452205-9007-4bda-b572-5b56e163b3ba None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:48.031918 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66452205-9007-4bda-b572-5b56e163b3ba None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:48.033859 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 191/384] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:46:48.040972 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a8318-317b-4e84-991b-7fec6d9d0213 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:48.041873 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a8318-317b-4e84-991b-7fec6d9d0213 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:48.042406 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a8318-317b-4e84-991b-7fec6d9d0213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:48.061779 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-272a8318-317b-4e84-991b-7fec6d9d0213 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:48.063487 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-272a8318-317b-4e84-991b-7fec6d9d0213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:48.160299 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 192/385] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:46:48.183435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f2e51-cec2-473a-b10d-602c597ed8e6 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:48.241551 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ad835-fd9d-4a7d-b03d-4c87c6291ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:48.242836 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ad835-fd9d-4a7d-b03d-4c87c6291ec6 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:48.243348 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ad835-fd9d-4a7d-b03d-4c87c6291ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:48.243895 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ad835-fd9d-4a7d-b03d-4c87c6291ec6 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:48.244904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ad835-fd9d-4a7d-b03d-4c87c6291ec6 None admin] RBAC: Adding query filter params (name=member) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:48.245695 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ad835-fd9d-4a7d-b03d-4c87c6291ec6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:48.247523 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ad835-fd9d-4a7d-b03d-4c87c6291ec6 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:48.259720 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 194/386] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:48.262287 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a8318-317b-4e84-991b-7fec6d9d0213 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:48.270460 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ad835-fd9d-4a7d-b03d-4c87c6291ec6 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:48.398915 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ad835-fd9d-4a7d-b03d-4c87c6291ec6 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:48.441523 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5f88f-a300-4602-a38f-0b8ce16e1c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:48.443082 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5f88f-a300-4602-a38f-0b8ce16e1c26 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:48.443631 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5f88f-a300-4602-a38f-0b8ce16e1c26 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:48.444143 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5f88f-a300-4602-a38f-0b8ce16e1c26 None admin] PATH_INFO: `/v3/groups/c8b79b21afc54cbaab86d8a0863d0592` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:48.445967 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5f88f-a300-4602-a38f-0b8ce16e1c26 None admin] RBAC: Authorizing `identity:get_group(group_id=c8b79b21afc54cbaab86d8a0863d0592)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:48.447964 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5f88f-a300-4602-a38f-0b8ce16e1c26 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:48.450759 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 195/387] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:46:48 2022] GET /identity/v3/groups/c8b79b21afc54cbaab86d8a0863d0592 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:48.452118 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a8318-317b-4e84-991b-7fec6d9d0213 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:48.458716 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5f88f-a300-4602-a38f-0b8ce16e1c26 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:48.524063 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb1562-907e-46e9-b32d-063c65ba63d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:48.525503 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb1562-907e-46e9-b32d-063c65ba63d9 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:48.526268 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb1562-907e-46e9-b32d-063c65ba63d9 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:48.526507 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb1562-907e-46e9-b32d-063c65ba63d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:48.558992 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb1562-907e-46e9-b32d-063c65ba63d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:48.581641 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-7ddb1562-907e-46e9-b32d-063c65ba63d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:46:48.581641 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:48.581641 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:48.581641 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:48.581641 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:48.581641 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:48.581641 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:48.581641 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:48.581641 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:48.581641 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:48.581641 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:48.581641 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:48.581641 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:48.581641 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:48.581641 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:48.581641 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:48.582773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:48.582773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:48.582773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:48.582773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:48.582773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:48.582773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:48.582773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:48.582773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:48.582773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:48.582773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:48.582773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:48.582773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:46:48.582773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:48.582773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:48.582773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:48.582773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:48.583695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:48.583695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:48.583695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:48.583695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:48.583695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:48.583695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:48.583695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:48.583695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:48.583695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:48.583695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:48.583695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:46:48.583695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:46:48.589455 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 193/388] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:46:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:48.591414 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb1562-907e-46e9-b32d-063c65ba63d9 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:48.605779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5f88f-a300-4602-a38f-0b8ce16e1c26 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:48.718517 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6143e4c-89e6-4b45-8943-9b87e2173d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:48.719893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6143e4c-89e6-4b45-8943-9b87e2173d05 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:48.720447 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6143e4c-89e6-4b45-8943-9b87e2173d05 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:48.721446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6143e4c-89e6-4b45-8943-9b87e2173d05 None admin] PATH_INFO: `/v3/projects/049f004d411f4c94a764b0a9955e9216` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:48.723771 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6143e4c-89e6-4b45-8943-9b87e2173d05 None admin] RBAC: Authorizing `identity:get_project(project_id=049f004d411f4c94a764b0a9955e9216)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:48.726038 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6143e4c-89e6-4b45-8943-9b87e2173d05 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:48.729203 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 196/389] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:48 2022] GET /identity/v3/projects/049f004d411f4c94a764b0a9955e9216 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:48.736203 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6143e4c-89e6-4b45-8943-9b87e2173d05 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:48.802963 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb1562-907e-46e9-b32d-063c65ba63d9 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:48.880002 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317eaff-e85e-4d0f-9145-41312296f22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:48.883864 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317eaff-e85e-4d0f-9145-41312296f22d None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:48.884486 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317eaff-e85e-4d0f-9145-41312296f22d None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:48.885009 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317eaff-e85e-4d0f-9145-41312296f22d None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:48.886115 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317eaff-e85e-4d0f-9145-41312296f22d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:48.886680 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317eaff-e85e-4d0f-9145-41312296f22d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:48.888391 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317eaff-e85e-4d0f-9145-41312296f22d None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:48.899993 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 194/390] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:46:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:48.901851 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda7d21-4d42-4fe5-b4bb-1fc5944b39dd None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:48.902409 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda7d21-4d42-4fe5-b4bb-1fc5944b39dd None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:48.902950 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda7d21-4d42-4fe5-b4bb-1fc5944b39dd None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:48.905223 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 195/391] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:48.911075 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f647d8a-08f4-4338-a4b1-adf73a4aa86a None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:48.911750 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f647d8a-08f4-4338-a4b1-adf73a4aa86a None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:48.912250 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f647d8a-08f4-4338-a4b1-adf73a4aa86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:48.945761 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-1f647d8a-08f4-4338-a4b1-adf73a4aa86a None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:48.947664 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-1f647d8a-08f4-4338-a4b1-adf73a4aa86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:48.964606 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6143e4c-89e6-4b45-8943-9b87e2173d05 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:49.031099 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1844690-e9ca-4281-8886-53914fbc8708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:49.032482 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1844690-e9ca-4281-8886-53914fbc8708 None admin] REQUEST_METHOD: `PUT` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:49.032958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1844690-e9ca-4281-8886-53914fbc8708 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:49.033487 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1844690-e9ca-4281-8886-53914fbc8708 None admin] PATH_INFO: `/v3/projects/049f004d411f4c94a764b0a9955e9216/groups/c8b79b21afc54cbaab86d8a0863d0592/roles/6a75cc334b5a44b5a347a1a0cc20f6d7` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:49.038558 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1844690-e9ca-4281-8886-53914fbc8708 None admin] RBAC: Authorizing `identity:create_grant(project_id=049f004d411f4c94a764b0a9955e9216, group_id=c8b79b21afc54cbaab86d8a0863d0592, role_id=6a75cc334b5a44b5a347a1a0cc20f6d7)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:49.041039 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1844690-e9ca-4281-8886-53914fbc8708 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:49.047543 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 196/392] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:49.048997 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f647d8a-08f4-4338-a4b1-adf73a4aa86a None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:49.081691 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 197/393] 10.222.0.48 () {58 vars in 1442 bytes} [Mon May 9 15:46:48 2022] PUT /identity/v3/projects/049f004d411f4c94a764b0a9955e9216/groups/c8b79b21afc54cbaab86d8a0863d0592/roles/6a75cc334b5a44b5a347a1a0cc20f6d7 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:46:49.100992 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1844690-e9ca-4281-8886-53914fbc8708 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:49.214719 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f647d8a-08f4-4338-a4b1-adf73a4aa86a None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:49.266913 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ed5a2-7c93-48fa-b1ba-b7c3fc4ffac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:49.267919 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ed5a2-7c93-48fa-b1ba-b7c3fc4ffac7 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:49.268231 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ed5a2-7c93-48fa-b1ba-b7c3fc4ffac7 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:49.268537 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ed5a2-7c93-48fa-b1ba-b7c3fc4ffac7 None admin] PATH_INFO: `/v3/groups/c8b79b21afc54cbaab86d8a0863d0592` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:49.271187 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ed5a2-7c93-48fa-b1ba-b7c3fc4ffac7 None admin] RBAC: Authorizing `identity:get_group(group_id=c8b79b21afc54cbaab86d8a0863d0592)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:49.272702 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ed5a2-7c93-48fa-b1ba-b7c3fc4ffac7 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:49.274644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 197/394] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:46:49 2022] GET /identity/v3/groups/c8b79b21afc54cbaab86d8a0863d0592 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:49.281648 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ed5a2-7c93-48fa-b1ba-b7c3fc4ffac7 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:49.319886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1844690-e9ca-4281-8886-53914fbc8708 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:49.378251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e61c2-92cc-4a0d-a2bb-c2f65d33f740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:49.379366 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e61c2-92cc-4a0d-a2bb-c2f65d33f740 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:49.379854 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e61c2-92cc-4a0d-a2bb-c2f65d33f740 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:49.380172 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e61c2-92cc-4a0d-a2bb-c2f65d33f740 None admin] PATH_INFO: `/v3/roles/member` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:49.405781 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e61c2-92cc-4a0d-a2bb-c2f65d33f740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:49.412395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ed5a2-7c93-48fa-b1ba-b7c3fc4ffac7 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:49.424217 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-455e61c2-92cc-4a0d-a2bb-c2f65d33f740 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:49.424217 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:49.424217 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:49.424217 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:49.424217 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:49.424217 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:49.424217 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:49.424217 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:49.424217 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:49.424217 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:49.424217 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:49.424217 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:49.424217 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:49.424217 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:49.424217 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:49.424217 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:49.425354 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:49.425354 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:49.425354 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:49.425354 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:49.425354 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:49.425354 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:49.425354 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:49.425354 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:49.425354 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:49.425354 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:49.425354 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:49.425354 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:46:49.425354 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:49.425354 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:49.425354 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:49.425354 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:49.426396 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:49.426396 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:49.426396 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:49.426396 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:49.426396 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:49.426396 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:49.426396 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:49.426396 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:49.426396 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:49.426396 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:49.426396 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:49.426396 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:46:49.426396 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 198/395] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:46:49.432887 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e61c2-92cc-4a0d-a2bb-c2f65d33f740 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:49.457793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97ca11-14b1-4568-bc9c-7ccabc62f5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:49.458674 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97ca11-14b1-4568-bc9c-7ccabc62f5cb None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:49.458956 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97ca11-14b1-4568-bc9c-7ccabc62f5cb None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:49.459229 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97ca11-14b1-4568-bc9c-7ccabc62f5cb None admin] PATH_INFO: `/v3/projects/049f004d411f4c94a764b0a9955e9216` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:49.460558 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97ca11-14b1-4568-bc9c-7ccabc62f5cb None admin] RBAC: Authorizing `identity:get_project(project_id=049f004d411f4c94a764b0a9955e9216)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:49.462080 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97ca11-14b1-4568-bc9c-7ccabc62f5cb None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:49.464240 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 198/396] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:49 2022] GET /identity/v3/projects/049f004d411f4c94a764b0a9955e9216 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:49.473390 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97ca11-14b1-4568-bc9c-7ccabc62f5cb None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:49.563381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e61c2-92cc-4a0d-a2bb-c2f65d33f740 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:49.602500 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cbe3f-36f2-43f8-85a4-09e2089831f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:49.603658 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cbe3f-36f2-43f8-85a4-09e2089831f5 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:49.604176 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cbe3f-36f2-43f8-85a4-09e2089831f5 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:49.604713 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cbe3f-36f2-43f8-85a4-09e2089831f5 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:49.605176 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97ca11-14b1-4568-bc9c-7ccabc62f5cb None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:49.605980 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cbe3f-36f2-43f8-85a4-09e2089831f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:49.606547 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cbe3f-36f2-43f8-85a4-09e2089831f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:49.608728 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cbe3f-36f2-43f8-85a4-09e2089831f5 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:49.618847 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 199/397] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:49.629299 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cbe3f-36f2-43f8-85a4-09e2089831f5 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:49.667337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841022e-4385-4917-8f42-b426b6884d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:49.668664 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841022e-4385-4917-8f42-b426b6884d6b None admin] REQUEST_METHOD: `PUT` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:49.669258 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841022e-4385-4917-8f42-b426b6884d6b None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:49.669729 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841022e-4385-4917-8f42-b426b6884d6b None admin] PATH_INFO: `/v3/projects/049f004d411f4c94a764b0a9955e9216/groups/c8b79b21afc54cbaab86d8a0863d0592/roles/cf8c8db912344d0f82f8e6b0fa805968` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:49.674108 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841022e-4385-4917-8f42-b426b6884d6b None admin] RBAC: Authorizing `identity:create_grant(project_id=049f004d411f4c94a764b0a9955e9216, group_id=c8b79b21afc54cbaab86d8a0863d0592, role_id=cf8c8db912344d0f82f8e6b0fa805968)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:49.676452 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841022e-4385-4917-8f42-b426b6884d6b None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:49.705812 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 199/398] 10.222.0.48 () {58 vars in 1442 bytes} [Mon May 9 15:46:49 2022] PUT /identity/v3/projects/049f004d411f4c94a764b0a9955e9216/groups/c8b79b21afc54cbaab86d8a0863d0592/roles/cf8c8db912344d0f82f8e6b0fa805968 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:46:49.781995 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cbe3f-36f2-43f8-85a4-09e2089831f5 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:49.832377 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f73aac-ef33-459c-9526-67abd87907bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:49.833314 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f73aac-ef33-459c-9526-67abd87907bd None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:49.833711 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f73aac-ef33-459c-9526-67abd87907bd None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:49.834201 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f73aac-ef33-459c-9526-67abd87907bd None admin] PATH_INFO: `/v3/groups/c8b79b21afc54cbaab86d8a0863d0592` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:49.836052 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f73aac-ef33-459c-9526-67abd87907bd None admin] RBAC: Authorizing `identity:get_group(group_id=c8b79b21afc54cbaab86d8a0863d0592)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:49.837661 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f73aac-ef33-459c-9526-67abd87907bd None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:49.845778 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 200/399] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:46:49 2022] GET /identity/v3/groups/c8b79b21afc54cbaab86d8a0863d0592 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:49.848064 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841022e-4385-4917-8f42-b426b6884d6b None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:50.034350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841022e-4385-4917-8f42-b426b6884d6b None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:50.094872 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb6ca6-2277-487f-93bb-b2b0d85dc3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:50.096063 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb6ca6-2277-487f-93bb-b2b0d85dc3be None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:50.096411 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb6ca6-2277-487f-93bb-b2b0d85dc3be None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:50.096729 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb6ca6-2277-487f-93bb-b2b0d85dc3be None admin] PATH_INFO: `/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:50.103301 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c307fc3-4085-464e-aec6-618f448d9026 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:50.103628 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c307fc3-4085-464e-aec6-618f448d9026 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:50.103929 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c307fc3-4085-464e-aec6-618f448d9026 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:50.106042 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 201/400] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:50.106948 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb6ca6-2277-487f-93bb-b2b0d85dc3be None admin] RBAC: Authorizing `identity:get_project(project_id=8eb38f20a7f646d49f0c1da50ff81db2)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:50.109844 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb6ca6-2277-487f-93bb-b2b0d85dc3be None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:50.112457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 200/401] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:49 2022] GET /identity/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:50.113119 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1298f-82e4-48ac-b3da-1c898d86ef9d None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:50.113442 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1298f-82e4-48ac-b3da-1c898d86ef9d None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:50.113727 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1298f-82e4-48ac-b3da-1c898d86ef9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:50.119911 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb6ca6-2277-487f-93bb-b2b0d85dc3be None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:50.146567 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-8dc1298f-82e4-48ac-b3da-1c898d86ef9d None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:50.148810 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-8dc1298f-82e4-48ac-b3da-1c898d86ef9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:50.242528 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 202/402] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:50.294274 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1298f-82e4-48ac-b3da-1c898d86ef9d None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:50.314034 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb6ca6-2277-487f-93bb-b2b0d85dc3be None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:50.409878 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1298f-82e4-48ac-b3da-1c898d86ef9d None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:50.411122 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f8250-56d6-46cf-93fa-9d75b55dfe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:50.412739 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f8250-56d6-46cf-93fa-9d75b55dfe92 None admin] REQUEST_METHOD: `PUT` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:50.413244 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f8250-56d6-46cf-93fa-9d75b55dfe92 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:50.413786 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f8250-56d6-46cf-93fa-9d75b55dfe92 None admin] PATH_INFO: `/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2/groups/c8b79b21afc54cbaab86d8a0863d0592/roles/6a75cc334b5a44b5a347a1a0cc20f6d7` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:50.423966 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f8250-56d6-46cf-93fa-9d75b55dfe92 None admin] RBAC: Authorizing `identity:create_grant(project_id=8eb38f20a7f646d49f0c1da50ff81db2, group_id=c8b79b21afc54cbaab86d8a0863d0592, role_id=6a75cc334b5a44b5a347a1a0cc20f6d7)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:50.426656 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f8250-56d6-46cf-93fa-9d75b55dfe92 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:50.456884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da59253-03ff-4a3f-ad11-032b1345fa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:50.459164 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da59253-03ff-4a3f-ad11-032b1345fa4b None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:50.460342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da59253-03ff-4a3f-ad11-032b1345fa4b None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:50.460669 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da59253-03ff-4a3f-ad11-032b1345fa4b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:50.472482 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 201/403] 10.222.0.48 () {58 vars in 1442 bytes} [Mon May 9 15:46:50 2022] PUT /identity/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2/groups/c8b79b21afc54cbaab86d8a0863d0592/roles/6a75cc334b5a44b5a347a1a0cc20f6d7 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:46:50.485271 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da59253-03ff-4a3f-ad11-032b1345fa4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:50.499426 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-1da59253-03ff-4a3f-ad11-032b1345fa4b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:46:50.499426 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:50.499426 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:50.499426 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:50.499426 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:50.499426 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:50.499426 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:50.499426 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:50.499426 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:50.499426 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:50.499426 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:50.499426 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:50.499426 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:50.499426 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:50.499426 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:50.499426 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:50.500934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:50.500934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:50.500934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:50.500934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:50.500934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:50.500934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:50.500934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:50.500934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:50.500934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:50.500934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:50.500934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:50.500934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:46:50.500934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:50.500934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:50.500934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:50.500934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:50.501901 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:50.501901 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:50.501901 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:50.501901 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:50.501901 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:50.501901 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:50.501901 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:50.501901 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:50.501901 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:50.501901 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:50.501901 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:46:50.501901 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:46:50.505412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 203/404] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:46:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:50.510329 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f8250-56d6-46cf-93fa-9d75b55dfe92 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:50.742725 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f8250-56d6-46cf-93fa-9d75b55dfe92 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:50.802659 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33729574-8cb6-43a0-aa60-c5996e379d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:50.804019 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33729574-8cb6-43a0-aa60-c5996e379d3f None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:50.804841 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33729574-8cb6-43a0-aa60-c5996e379d3f None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:50.805684 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33729574-8cb6-43a0-aa60-c5996e379d3f None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:50.807329 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33729574-8cb6-43a0-aa60-c5996e379d3f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:50.808213 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33729574-8cb6-43a0-aa60-c5996e379d3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:50.811697 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33729574-8cb6-43a0-aa60-c5996e379d3f None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:50.826803 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 202/405] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:46:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:50.835876 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da59253-03ff-4a3f-ad11-032b1345fa4b None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:51.049820 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da59253-03ff-4a3f-ad11-032b1345fa4b None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:51.106675 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e75ab2-fa6c-41aa-afe2-12e30e1328ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:51.108988 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e75ab2-fa6c-41aa-afe2-12e30e1328ec None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:51.109762 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e75ab2-fa6c-41aa-afe2-12e30e1328ec None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:51.110293 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e75ab2-fa6c-41aa-afe2-12e30e1328ec None admin] PATH_INFO: `/v3/groups/c8b79b21afc54cbaab86d8a0863d0592` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:51.112168 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e75ab2-fa6c-41aa-afe2-12e30e1328ec None admin] RBAC: Authorizing `identity:get_group(group_id=c8b79b21afc54cbaab86d8a0863d0592)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:51.114188 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e75ab2-fa6c-41aa-afe2-12e30e1328ec None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:51.116811 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 204/406] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:46:50 2022] GET /identity/v3/groups/c8b79b21afc54cbaab86d8a0863d0592 => generated 226 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:51.124572 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33729574-8cb6-43a0-aa60-c5996e379d3f None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:51.262144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaa51e-807f-43a2-a11e-0b7d5772545a None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:51.262862 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaa51e-807f-43a2-a11e-0b7d5772545a None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:51.263403 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaa51e-807f-43a2-a11e-0b7d5772545a None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:51.277902 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 205/407] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:51 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:51.286274 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a9a59-20c0-4429-b460-d3005b7b37b1 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:51.287099 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a9a59-20c0-4429-b460-d3005b7b37b1 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:51.287821 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a9a59-20c0-4429-b460-d3005b7b37b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:51.331257 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33729574-8cb6-43a0-aa60-c5996e379d3f None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:51.355347 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-1a7a9a59-20c0-4429-b460-d3005b7b37b1 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:51.357332 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-1a7a9a59-20c0-4429-b460-d3005b7b37b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:51.397400 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3466d20-cea8-4f20-9952-b304d0e6c8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:51.397400 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3466d20-cea8-4f20-9952-b304d0e6c8a7 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:51.398022 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3466d20-cea8-4f20-9952-b304d0e6c8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:51.398022 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3466d20-cea8-4f20-9952-b304d0e6c8a7 None admin] PATH_INFO: `/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:51.400426 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3466d20-cea8-4f20-9952-b304d0e6c8a7 None admin] RBAC: Authorizing `identity:get_project(project_id=8eb38f20a7f646d49f0c1da50ff81db2)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:51.402187 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3466d20-cea8-4f20-9952-b304d0e6c8a7 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:51.404699 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 203/408] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:51 2022] GET /identity/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2 => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:51.415225 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3466d20-cea8-4f20-9952-b304d0e6c8a7 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:51.540269 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 206/409] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:51.577032 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a9a59-20c0-4429-b460-d3005b7b37b1 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:51.759322 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a9a59-20c0-4429-b460-d3005b7b37b1 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:51.760072 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3466d20-cea8-4f20-9952-b304d0e6c8a7 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:51.828257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e397ae-363e-4631-a25f-3d43b3067b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:51.830173 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e397ae-363e-4631-a25f-3d43b3067b0f None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:51.830978 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e397ae-363e-4631-a25f-3d43b3067b0f None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:51.831749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e397ae-363e-4631-a25f-3d43b3067b0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:51.836255 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d71f6-ee2e-480f-9657-8f543fdb6bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:51.837166 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d71f6-ee2e-480f-9657-8f543fdb6bdf None admin] REQUEST_METHOD: `PUT` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:51.837495 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d71f6-ee2e-480f-9657-8f543fdb6bdf None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:51.837784 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d71f6-ee2e-480f-9657-8f543fdb6bdf None admin] PATH_INFO: `/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2/groups/c8b79b21afc54cbaab86d8a0863d0592/roles/cf8c8db912344d0f82f8e6b0fa805968` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:51.850402 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d71f6-ee2e-480f-9657-8f543fdb6bdf None admin] RBAC: Authorizing `identity:create_grant(project_id=8eb38f20a7f646d49f0c1da50ff81db2, group_id=c8b79b21afc54cbaab86d8a0863d0592, role_id=cf8c8db912344d0f82f8e6b0fa805968)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:51.851995 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d71f6-ee2e-480f-9657-8f543fdb6bdf None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:51.856406 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e397ae-363e-4631-a25f-3d43b3067b0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:51.874411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-d8e397ae-363e-4631-a25f-3d43b3067b0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:46:51.874411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:51.874411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:51.874411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:51.874411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:51.874411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:51.874411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:51.874411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:51.874411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:51.874411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:51.874411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:51.874411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:51.874411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:51.874411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:51.874411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:51.874411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:51.876688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:51.876688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:51.876688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:51.876688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:51.876688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:51.876688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:51.876688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:51.876688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:51.876688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:51.876688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:51.876688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:51.876688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:46:51.876688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:51.876688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:51.876688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:51.876688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:51.878816 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:51.878816 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:51.878816 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:51.878816 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:51.878816 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:51.878816 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:51.878816 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:51.878816 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:51.878816 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:51.878816 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:51.878816 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:46:51.878816 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:46:51.880456 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 204/410] 10.222.0.48 () {58 vars in 1442 bytes} [Mon May 9 15:46:51 2022] PUT /identity/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2/groups/c8b79b21afc54cbaab86d8a0863d0592/roles/cf8c8db912344d0f82f8e6b0fa805968 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:46:51.883622 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 207/411] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:46:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:46:51.893361 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d71f6-ee2e-480f-9657-8f543fdb6bdf None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:52.079805 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d71f6-ee2e-480f-9657-8f543fdb6bdf None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:52.135279 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ec671-bf94-43ae-ae26-96b5f3be155b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:52.135973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ec671-bf94-43ae-ae26-96b5f3be155b None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:52.136362 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ec671-bf94-43ae-ae26-96b5f3be155b None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:52.136768 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ec671-bf94-43ae-ae26-96b5f3be155b None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:52.137578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ec671-bf94-43ae-ae26-96b5f3be155b None admin] RBAC: Adding query filter params (name=admin) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:52.137889 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ec671-bf94-43ae-ae26-96b5f3be155b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:52.139670 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ec671-bf94-43ae-ae26-96b5f3be155b None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:52.156248 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 205/412] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:52.166199 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e397ae-363e-4631-a25f-3d43b3067b0f None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:52.302952 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e397ae-363e-4631-a25f-3d43b3067b0f None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:52.349262 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a852125-e63f-4339-9040-48ea7fb4e8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:52.350308 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a852125-e63f-4339-9040-48ea7fb4e8c0 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:52.350618 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a852125-e63f-4339-9040-48ea7fb4e8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:52.350893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a852125-e63f-4339-9040-48ea7fb4e8c0 None admin] PATH_INFO: `/v3/groups/bb358de4f0014e4bac2fd154033b75cb` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:52.352174 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a852125-e63f-4339-9040-48ea7fb4e8c0 None admin] RBAC: Authorizing `identity:get_group(group_id=bb358de4f0014e4bac2fd154033b75cb)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:52.353697 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a852125-e63f-4339-9040-48ea7fb4e8c0 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:52.355714 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 208/413] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:46:52 2022] GET /identity/v3/groups/bb358de4f0014e4bac2fd154033b75cb => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:52.365872 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ec671-bf94-43ae-ae26-96b5f3be155b None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:52.554208 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ec671-bf94-43ae-ae26-96b5f3be155b None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:52.608736 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a92d1-a215-44db-bffc-af898b073047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:52.609641 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a92d1-a215-44db-bffc-af898b073047 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:52.609936 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a92d1-a215-44db-bffc-af898b073047 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:52.610204 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a92d1-a215-44db-bffc-af898b073047 None admin] PATH_INFO: `/v3/projects/d98726a0503446c8990ec97c6f98d1d8` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:52.614474 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a92d1-a215-44db-bffc-af898b073047 None admin] RBAC: Authorizing `identity:get_project(project_id=d98726a0503446c8990ec97c6f98d1d8)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:52.616116 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a92d1-a215-44db-bffc-af898b073047 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:52.618696 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 206/414] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:52 2022] GET /identity/v3/projects/d98726a0503446c8990ec97c6f98d1d8 => generated 344 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:52.630257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a852125-e63f-4339-9040-48ea7fb4e8c0 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:52.761527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a852125-e63f-4339-9040-48ea7fb4e8c0 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:52.809961 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71017318-fbf1-4aa1-8990-ba4eb69c45cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:52.811803 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71017318-fbf1-4aa1-8990-ba4eb69c45cd None admin] REQUEST_METHOD: `PUT` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:52.812142 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71017318-fbf1-4aa1-8990-ba4eb69c45cd None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:52.812414 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71017318-fbf1-4aa1-8990-ba4eb69c45cd None admin] PATH_INFO: `/v3/projects/d98726a0503446c8990ec97c6f98d1d8/groups/bb358de4f0014e4bac2fd154033b75cb/roles/2180d183afad443187521833c40ed8a1` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:52.818915 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71017318-fbf1-4aa1-8990-ba4eb69c45cd None admin] RBAC: Authorizing `identity:create_grant(project_id=d98726a0503446c8990ec97c6f98d1d8, group_id=bb358de4f0014e4bac2fd154033b75cb, role_id=2180d183afad443187521833c40ed8a1)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:52.820415 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71017318-fbf1-4aa1-8990-ba4eb69c45cd None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:52.839970 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 209/415] 10.222.0.48 () {58 vars in 1442 bytes} [Mon May 9 15:46:52 2022] PUT /identity/v3/projects/d98726a0503446c8990ec97c6f98d1d8/groups/bb358de4f0014e4bac2fd154033b75cb/roles/2180d183afad443187521833c40ed8a1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:46:52.883560 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b27ee-d391-466a-862c-d46872307338 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:52.884133 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b27ee-d391-466a-862c-d46872307338 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:52.884612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b27ee-d391-466a-862c-d46872307338 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:52.890041 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 207/416] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:46:52.895019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fbed4-581a-4fce-95ee-8c89437130c6 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:52.895333 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fbed4-581a-4fce-95ee-8c89437130c6 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:52.895689 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fbed4-581a-4fce-95ee-8c89437130c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:52.922800 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-ce9fbed4-581a-4fce-95ee-8c89437130c6 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:52.924225 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-ce9fbed4-581a-4fce-95ee-8c89437130c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:53.044597 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 210/417] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:53.094968 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b27ee-d391-466a-862c-d46872307338 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:53.205170 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd943160-9000-496f-af7f-f1a0acad7c17 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:53.205674 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd943160-9000-496f-af7f-f1a0acad7c17 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:53.205842 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd943160-9000-496f-af7f-f1a0acad7c17 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:53.207450 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 211/418] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:53.213550 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4053d-2130-4963-b138-e336be257f6f None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:53.213996 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4053d-2130-4963-b138-e336be257f6f None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:53.214152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4053d-2130-4963-b138-e336be257f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:53.238574 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-caf4053d-2130-4963-b138-e336be257f6f None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:53.239948 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-caf4053d-2130-4963-b138-e336be257f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:53.259914 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b27ee-d391-466a-862c-d46872307338 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:53.300059 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b15cd2-f1fb-426f-8955-5ec7bc80154a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:53.301482 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b15cd2-f1fb-426f-8955-5ec7bc80154a None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:53.301981 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b15cd2-f1fb-426f-8955-5ec7bc80154a None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:53.302449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b15cd2-f1fb-426f-8955-5ec7bc80154a None admin] PATH_INFO: `/v3/roles/member` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:53.322538 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b15cd2-f1fb-426f-8955-5ec7bc80154a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:53.340369 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-b5b15cd2-f1fb-426f-8955-5ec7bc80154a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:53.340369 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:53.340369 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:53.340369 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:53.340369 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:53.340369 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:53.340369 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:53.340369 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:53.340369 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:53.340369 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:53.340369 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:53.340369 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:53.340369 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:53.340369 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:53.340369 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:53.340369 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:53.341519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:53.341519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:53.341519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:53.341519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:53.341519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:53.341519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:53.341519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:53.341519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:53.341519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:53.341519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:53.341519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:53.341519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:46:53.341519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:53.341519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:53.341519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:53.341519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:53.343463 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:53.343463 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:53.343463 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:53.343463 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:53.343463 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:53.343463 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:53.343463 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:53.343463 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:53.343463 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:53.343463 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:53.343463 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:53.343463 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:46:53.345763 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 208/419] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:53.353397 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b15cd2-f1fb-426f-8955-5ec7bc80154a None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:53.459221 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 212/420] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:46:53.540753 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4053d-2130-4963-b138-e336be257f6f None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:53.581848 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b15cd2-f1fb-426f-8955-5ec7bc80154a None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:53.654986 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbde86-9d6b-44b1-b528-fc52c5f3809f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:53.655741 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbde86-9d6b-44b1-b528-fc52c5f3809f None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:53.656119 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbde86-9d6b-44b1-b528-fc52c5f3809f None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:53.656349 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbde86-9d6b-44b1-b528-fc52c5f3809f None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:53.657158 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbde86-9d6b-44b1-b528-fc52c5f3809f None admin] RBAC: Adding query filter params (name=member) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:53.657527 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbde86-9d6b-44b1-b528-fc52c5f3809f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:53.658982 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbde86-9d6b-44b1-b528-fc52c5f3809f None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:53.676564 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 209/421] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:53.685198 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbde86-9d6b-44b1-b528-fc52c5f3809f None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:53.769180 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4053d-2130-4963-b138-e336be257f6f None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:53.849260 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794aeae-12af-4c39-939a-2f71e706abde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:53.850220 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794aeae-12af-4c39-939a-2f71e706abde None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:53.850534 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794aeae-12af-4c39-939a-2f71e706abde None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:53.850847 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794aeae-12af-4c39-939a-2f71e706abde None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:53.864168 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794aeae-12af-4c39-939a-2f71e706abde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:53.873185 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-a794aeae-12af-4c39-939a-2f71e706abde None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:46:53.873185 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:53.873185 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:53.873185 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:53.873185 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:53.873185 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:53.873185 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:53.873185 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:53.873185 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:53.873185 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:53.873185 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:53.873185 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:53.873185 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:53.873185 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:53.873185 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:53.873185 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:53.876019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:53.876019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:53.876019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:53.876019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:53.876019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:53.876019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:53.876019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:53.876019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:53.876019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:53.876019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:53.876019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:53.876019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:46:53.876019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:53.876019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:53.876019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:53.876019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:53.878211 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:53.878211 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:53.878211 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:53.878211 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:53.878211 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:53.878211 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:53.878211 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:53.878211 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:53.878211 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:53.878211 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:53.878211 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:46:53.878211 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:46:53.878211 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 213/422] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:46:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:46:53.885407 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794aeae-12af-4c39-939a-2f71e706abde None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:53.898110 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbde86-9d6b-44b1-b528-fc52c5f3809f None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:53.994210 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de2405-90ec-424e-a75d-bd270cd74cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:53.995203 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de2405-90ec-424e-a75d-bd270cd74cb0 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:53.995678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de2405-90ec-424e-a75d-bd270cd74cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:53.996446 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de2405-90ec-424e-a75d-bd270cd74cb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:54.084550 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794aeae-12af-4c39-939a-2f71e706abde None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:54.127191 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de2405-90ec-424e-a75d-bd270cd74cb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:54.128792 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de2405-90ec-424e-a75d-bd270cd74cb0 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:54.131981 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375570fd-46b9-48f2-80b6-965ef214192c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:54.133430 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375570fd-46b9-48f2-80b6-965ef214192c None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:54.134175 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375570fd-46b9-48f2-80b6-965ef214192c None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:54.134675 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375570fd-46b9-48f2-80b6-965ef214192c None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:54.136265 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375570fd-46b9-48f2-80b6-965ef214192c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:54.136837 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375570fd-46b9-48f2-80b6-965ef214192c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:54.139799 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375570fd-46b9-48f2-80b6-965ef214192c None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:54.156898 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 214/423] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:46:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:54.159325 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5efb58-f2c6-4e8c-bcbd-bbce7e4f832d None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:54.159650 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5efb58-f2c6-4e8c-bcbd-bbce7e4f832d None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:54.159968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5efb58-f2c6-4e8c-bcbd-bbce7e4f832d None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:54.162456 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 215/424] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:54.165308 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5efb58-f2c6-4e8c-bcbd-bbce7e4f832d None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:54.269499 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 210/425] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:46:54.271552 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb7c96-4cf1-451a-bc2d-2c4c6dc833ad None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:54.272029 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb7c96-4cf1-451a-bc2d-2c4c6dc833ad None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:54.272467 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb7c96-4cf1-451a-bc2d-2c4c6dc833ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:54.292908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-89bb7c96-4cf1-451a-bc2d-2c4c6dc833ad None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:54.294555 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-89bb7c96-4cf1-451a-bc2d-2c4c6dc833ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:54.323088 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5efb58-f2c6-4e8c-bcbd-bbce7e4f832d None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:54.363354 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e66b5-a422-4dbb-9825-8bb792c2d5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:54.364393 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e66b5-a422-4dbb-9825-8bb792c2d5cc None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:54.364904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e66b5-a422-4dbb-9825-8bb792c2d5cc None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:54.365364 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e66b5-a422-4dbb-9825-8bb792c2d5cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:54.373398 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 211/426] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:54.374993 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb7c96-4cf1-451a-bc2d-2c4c6dc833ad None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:54.457629 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e66b5-a422-4dbb-9825-8bb792c2d5cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:54.459092 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e66b5-a422-4dbb-9825-8bb792c2d5cc None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:54.501013 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb7c96-4cf1-451a-bc2d-2c4c6dc833ad None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:54.542014 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e8b04-e0a1-42f0-98d7-ca63ae21bb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:54.543310 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e8b04-e0a1-42f0-98d7-ca63ae21bb9b None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:54.543782 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e8b04-e0a1-42f0-98d7-ca63ae21bb9b None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:54.544222 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e8b04-e0a1-42f0-98d7-ca63ae21bb9b None admin] PATH_INFO: `/v3/projects/049f004d411f4c94a764b0a9955e9216` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:54.547068 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e8b04-e0a1-42f0-98d7-ca63ae21bb9b None admin] RBAC: Authorizing `identity:get_project(project_id=049f004d411f4c94a764b0a9955e9216)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:54.548882 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e8b04-e0a1-42f0-98d7-ca63ae21bb9b None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:54.555722 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 212/427] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:54 2022] GET /identity/v3/projects/049f004d411f4c94a764b0a9955e9216 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:54.556881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e8b04-e0a1-42f0-98d7-ca63ae21bb9b None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:54.573401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 216/428] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:46:54.574359 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e66b5-a422-4dbb-9825-8bb792c2d5cc None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:54.677025 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e8b04-e0a1-42f0-98d7-ca63ae21bb9b None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:54.689082 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e66b5-a422-4dbb-9825-8bb792c2d5cc None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:54.717806 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409731d9-acb9-4330-a28a-9bee5ff7fe4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:54.718904 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409731d9-acb9-4330-a28a-9bee5ff7fe4e None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:54.719351 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409731d9-acb9-4330-a28a-9bee5ff7fe4e None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:54.719844 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409731d9-acb9-4330-a28a-9bee5ff7fe4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:54.727222 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9126f4-2732-441a-bf03-4174d55664de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:54.728111 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9126f4-2732-441a-bf03-4174d55664de None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:54.728478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9126f4-2732-441a-bf03-4174d55664de None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:54.728822 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9126f4-2732-441a-bf03-4174d55664de None admin] PATH_INFO: `/v3/groups/c8b79b21afc54cbaab86d8a0863d0592` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:54.730487 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9126f4-2732-441a-bf03-4174d55664de None admin] RBAC: Authorizing `identity:get_group(group_id=c8b79b21afc54cbaab86d8a0863d0592)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:54.731763 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9126f4-2732-441a-bf03-4174d55664de None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:54.734651 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 217/429] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:46:54 2022] GET /identity/v3/groups/c8b79b21afc54cbaab86d8a0863d0592 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:54.740943 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9126f4-2732-441a-bf03-4174d55664de None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:54.742678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409731d9-acb9-4330-a28a-9bee5ff7fe4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:54.757090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-409731d9-acb9-4330-a28a-9bee5ff7fe4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:54.757090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:54.757090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:54.757090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:54.757090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:54.757090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:54.757090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:54.757090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:54.757090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:54.757090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:54.757090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:54.757090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:54.757090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:54.757090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:54.757090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:54.757090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:54.758988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:54.758988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:54.758988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:54.758988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:54.758988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:54.758988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:54.758988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:54.758988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:54.758988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:54.758988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:54.758988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:54.758988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:46:54.758988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:54.758988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:54.758988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:54.758988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:54.761044 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:54.761044 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:54.761044 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:54.761044 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:54.761044 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:54.761044 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:54.761044 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:54.761044 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:54.761044 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:54.761044 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:54.761044 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 09 15:46:54.761044 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:46:54.766134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 213/430] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:54.772906 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409731d9-acb9-4330-a28a-9bee5ff7fe4e None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:54.848234 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9126f4-2732-441a-bf03-4174d55664de None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:54.887272 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8653f-40a8-4e03-b920-89636f048820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:54.888125 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8653f-40a8-4e03-b920-89636f048820 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:54.888443 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8653f-40a8-4e03-b920-89636f048820 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:54.888749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8653f-40a8-4e03-b920-89636f048820 None admin] PATH_INFO: `/v3/projects/049f004d411f4c94a764b0a9955e9216` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:54.890655 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8653f-40a8-4e03-b920-89636f048820 None admin] RBAC: Authorizing `identity:get_project(project_id=049f004d411f4c94a764b0a9955e9216)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:54.891667 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409731d9-acb9-4330-a28a-9bee5ff7fe4e None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:54.892143 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8653f-40a8-4e03-b920-89636f048820 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:54.894272 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 218/431] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:54 2022] GET /identity/v3/projects/049f004d411f4c94a764b0a9955e9216 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:54.895666 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8653f-40a8-4e03-b920-89636f048820 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:54.933780 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabf5c1-240e-4d92-a914-b4529f66fd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:54.935290 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabf5c1-240e-4d92-a914-b4529f66fd0e None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:54.936267 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabf5c1-240e-4d92-a914-b4529f66fd0e None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:54.936709 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabf5c1-240e-4d92-a914-b4529f66fd0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:54.937917 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabf5c1-240e-4d92-a914-b4529f66fd0e None admin] RBAC: Adding query filter params (group.id=c8b79b21afc54cbaab86d8a0863d0592, role.id=6a75cc334b5a44b5a347a1a0cc20f6d7, scope.project.id=049f004d411f4c94a764b0a9955e9216) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:54.938546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabf5c1-240e-4d92-a914-b4529f66fd0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:54.940669 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabf5c1-240e-4d92-a914-b4529f66fd0e None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:54.948502 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 214/432] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:46:54 2022] GET /identity/v3/role_assignments?group.id=c8b79b21afc54cbaab86d8a0863d0592&scope.project.id=049f004d411f4c94a764b0a9955e9216&role.id=6a75cc334b5a44b5a347a1a0cc20f6d7 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:54.949953 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabf5c1-240e-4d92-a914-b4529f66fd0e None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:55.025661 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8653f-40a8-4e03-b920-89636f048820 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:55.069069 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05e40e-50c2-45f5-92eb-34d2d3d264e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:55.069712 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05e40e-50c2-45f5-92eb-34d2d3d264e8 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:55.070003 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05e40e-50c2-45f5-92eb-34d2d3d264e8 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:55.070286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05e40e-50c2-45f5-92eb-34d2d3d264e8 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:55.071065 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05e40e-50c2-45f5-92eb-34d2d3d264e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:55.071393 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05e40e-50c2-45f5-92eb-34d2d3d264e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:55.072812 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05e40e-50c2-45f5-92eb-34d2d3d264e8 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:55.076645 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabf5c1-240e-4d92-a914-b4529f66fd0e None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:55.084292 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 219/433] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:46:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:55.091481 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05e40e-50c2-45f5-92eb-34d2d3d264e8 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:55.123784 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e94707-90c7-45b4-a0a0-72e6fe46036e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:55.125557 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e94707-90c7-45b4-a0a0-72e6fe46036e None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:55.126035 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e94707-90c7-45b4-a0a0-72e6fe46036e None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:55.126513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e94707-90c7-45b4-a0a0-72e6fe46036e None admin] PATH_INFO: `/v3/groups/c8b79b21afc54cbaab86d8a0863d0592` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:55.128196 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e94707-90c7-45b4-a0a0-72e6fe46036e None admin] RBAC: Authorizing `identity:get_group(group_id=c8b79b21afc54cbaab86d8a0863d0592)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:55.130145 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e94707-90c7-45b4-a0a0-72e6fe46036e None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:55.132681 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 215/434] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:46:54 2022] GET /identity/v3/groups/c8b79b21afc54cbaab86d8a0863d0592 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:55.141909 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e94707-90c7-45b4-a0a0-72e6fe46036e None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:55.313777 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e94707-90c7-45b4-a0a0-72e6fe46036e None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:55.369642 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d89b55-9809-4e6b-854d-df301178cf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:55.371156 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d89b55-9809-4e6b-854d-df301178cf4d None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:55.371665 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d89b55-9809-4e6b-854d-df301178cf4d None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:55.372209 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d89b55-9809-4e6b-854d-df301178cf4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:55.373595 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d89b55-9809-4e6b-854d-df301178cf4d None admin] RBAC: Adding query filter params (group.id=c8b79b21afc54cbaab86d8a0863d0592, role.id=cf8c8db912344d0f82f8e6b0fa805968, scope.project.id=049f004d411f4c94a764b0a9955e9216) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:55.373928 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05e40e-50c2-45f5-92eb-34d2d3d264e8 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:55.374384 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d89b55-9809-4e6b-854d-df301178cf4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:55.376431 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d89b55-9809-4e6b-854d-df301178cf4d None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:55.385932 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 216/435] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:46:55 2022] GET /identity/v3/role_assignments?group.id=c8b79b21afc54cbaab86d8a0863d0592&scope.project.id=049f004d411f4c94a764b0a9955e9216&role.id=cf8c8db912344d0f82f8e6b0fa805968 => generated 611 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:55.430641 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307a902-3c31-458f-9376-2a7714a6827d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:55.431900 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307a902-3c31-458f-9376-2a7714a6827d None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:55.432196 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307a902-3c31-458f-9376-2a7714a6827d None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:55.432508 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307a902-3c31-458f-9376-2a7714a6827d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:55.557075 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d562d7-8dac-409e-9099-95cf1e86ccd0 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:55.557444 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d562d7-8dac-409e-9099-95cf1e86ccd0 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:55.557713 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d562d7-8dac-409e-9099-95cf1e86ccd0 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:55.559660 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 217/436] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:46:55.567212 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ea14e-e83b-400a-95e1-7424eace42c0 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:55.567429 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ea14e-e83b-400a-95e1-7424eace42c0 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:55.567715 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ea14e-e83b-400a-95e1-7424eace42c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:55.590529 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307a902-3c31-458f-9376-2a7714a6827d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:55.593492 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307a902-3c31-458f-9376-2a7714a6827d None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:55.594705 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-4b0ea14e-e83b-400a-95e1-7424eace42c0 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:55.596002 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-4b0ea14e-e83b-400a-95e1-7424eace42c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:55.734844 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 218/437] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:46:55.761565 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ea14e-e83b-400a-95e1-7424eace42c0 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:55.775033 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 220/438] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:46:55.783982 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307a902-3c31-458f-9376-2a7714a6827d None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:55.898678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ea14e-e83b-400a-95e1-7424eace42c0 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:55.939819 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307a902-3c31-458f-9376-2a7714a6827d None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:55.956287 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d1f2d-e83d-4f27-8d8a-df96c475aeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:55.957584 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d1f2d-e83d-4f27-8d8a-df96c475aeaf None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:55.957876 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d1f2d-e83d-4f27-8d8a-df96c475aeaf None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:55.958158 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d1f2d-e83d-4f27-8d8a-df96c475aeaf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:55.973154 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d1f2d-e83d-4f27-8d8a-df96c475aeaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:55.984010 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-161d1f2d-e83d-4f27-8d8a-df96c475aeaf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:46:55.984010 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:55.984010 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:55.984010 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:55.984010 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:55.984010 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:55.984010 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:55.984010 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:55.984010 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:55.984010 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:55.984010 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:55.984010 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:55.984010 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:55.984010 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:55.984010 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:55.984010 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:55.985178 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:55.985178 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:55.985178 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:55.985178 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:55.985178 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:55.985178 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:55.985178 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:55.985178 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:55.985178 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:55.985178 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:55.985178 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:55.985178 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:46:55.985178 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:55.985178 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:55.985178 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:55.985178 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:55.988660 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:55.988660 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:55.988660 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:55.988660 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:55.988660 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:55.988660 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:55.988660 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:55.988660 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:55.988660 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:55.988660 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:55.988660 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:46:55.988660 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:46:55.988660 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 219/439] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:46:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:55.988660 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab26e2-e5e8-43d0-88f7-cb68e9a23dd6 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:55.991307 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab26e2-e5e8-43d0-88f7-cb68e9a23dd6 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:55.991307 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab26e2-e5e8-43d0-88f7-cb68e9a23dd6 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:55.991307 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 220/440] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:46:55.995485 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab26e2-e5e8-43d0-88f7-cb68e9a23dd6 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:56.001978 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f2f99-5b3e-41bc-9e47-849c5c04f1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:56.003232 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f2f99-5b3e-41bc-9e47-849c5c04f1f1 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:56.003700 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f2f99-5b3e-41bc-9e47-849c5c04f1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:56.004164 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f2f99-5b3e-41bc-9e47-849c5c04f1f1 None admin] PATH_INFO: `/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:56.005756 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f2f99-5b3e-41bc-9e47-849c5c04f1f1 None admin] RBAC: Authorizing `identity:get_project(project_id=8eb38f20a7f646d49f0c1da50ff81db2)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:56.007412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f2f99-5b3e-41bc-9e47-849c5c04f1f1 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:56.009172 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 221/441] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:55 2022] GET /identity/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:56.011800 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7b202-1672-4fda-ab3b-c502027fb18c None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:56.012084 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7b202-1672-4fda-ab3b-c502027fb18c None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:56.012427 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7b202-1672-4fda-ab3b-c502027fb18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:56.036811 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-2ff7b202-1672-4fda-ab3b-c502027fb18c None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:46:56.038384 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-2ff7b202-1672-4fda-ab3b-c502027fb18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:46:56.153478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 222/442] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:46:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:46:56.153478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7b202-1672-4fda-ab3b-c502027fb18c None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:56.153769 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab26e2-e5e8-43d0-88f7-cb68e9a23dd6 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:56.183740 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f184f-8e1e-4fe2-9dbf-a131fd8b2893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:56.184414 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f184f-8e1e-4fe2-9dbf-a131fd8b2893 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:56.184705 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f184f-8e1e-4fe2-9dbf-a131fd8b2893 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:56.184984 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f184f-8e1e-4fe2-9dbf-a131fd8b2893 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:56.185851 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f184f-8e1e-4fe2-9dbf-a131fd8b2893 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:56.186160 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f184f-8e1e-4fe2-9dbf-a131fd8b2893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:56.187549 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f184f-8e1e-4fe2-9dbf-a131fd8b2893 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:56.196173 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 221/443] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:46:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:56.197036 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f184f-8e1e-4fe2-9dbf-a131fd8b2893 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:56.258921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7b202-1672-4fda-ab3b-c502027fb18c None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:56.296019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e51ff-879d-425d-947b-16abe9586b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:56.296900 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e51ff-879d-425d-947b-16abe9586b7c None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:56.297186 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e51ff-879d-425d-947b-16abe9586b7c None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:56.297495 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e51ff-879d-425d-947b-16abe9586b7c None admin] PATH_INFO: `/v3/groups/c8b79b21afc54cbaab86d8a0863d0592` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:56.298731 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e51ff-879d-425d-947b-16abe9586b7c None admin] RBAC: Authorizing `identity:get_group(group_id=c8b79b21afc54cbaab86d8a0863d0592)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:56.300211 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e51ff-879d-425d-947b-16abe9586b7c None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:56.301917 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 223/444] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:46:56 2022] GET /identity/v3/groups/c8b79b21afc54cbaab86d8a0863d0592 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:56.302706 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e51ff-879d-425d-947b-16abe9586b7c None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:56.315972 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f184f-8e1e-4fe2-9dbf-a131fd8b2893 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:56.351171 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fa870-6a6c-491e-a6c0-15c9c729ef9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:56.352001 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fa870-6a6c-491e-a6c0-15c9c729ef9e None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:56.352285 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fa870-6a6c-491e-a6c0-15c9c729ef9e None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:56.352649 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fa870-6a6c-491e-a6c0-15c9c729ef9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:56.364512 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fa870-6a6c-491e-a6c0-15c9c729ef9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:46:56.373004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-e72fa870-6a6c-491e-a6c0-15c9c729ef9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:46:56.373004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:46:56.373004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:46:56.373004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:46:56.373004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:46:56.373004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:46:56.373004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:46:56.373004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:46:56.373004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:46:56.373004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:46:56.373004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:46:56.373004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:46:56.373004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:46:56.373004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:46:56.373004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:46:56.373004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:46:56.374926 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:46:56.374926 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:46:56.374926 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:46:56.374926 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:46:56.374926 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:46:56.374926 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:46:56.374926 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:46:56.374926 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:46:56.374926 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:46:56.374926 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:46:56.374926 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:46:56.374926 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:46:56.374926 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:46:56.374926 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:46:56.374926 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:46:56.374926 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:46:56.376273 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:46:56.376273 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:46:56.376273 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:46:56.376273 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:46:56.376273 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:46:56.376273 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:46:56.376273 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:46:56.376273 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:46:56.376273 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:46:56.376273 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:46:56.376273 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:46:56.376273 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:46:56.376273 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 222/445] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:46:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:46:56.376273 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fa870-6a6c-491e-a6c0-15c9c729ef9e None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:56.414083 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e51ff-879d-425d-947b-16abe9586b7c None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:56.453697 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fc2a7-a74d-44c9-af73-3fd0646650c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:56.454388 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fc2a7-a74d-44c9-af73-3fd0646650c3 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:56.454680 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fc2a7-a74d-44c9-af73-3fd0646650c3 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:56.454967 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fc2a7-a74d-44c9-af73-3fd0646650c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:56.480706 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fa870-6a6c-491e-a6c0-15c9c729ef9e None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:56.531443 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950b974-8fb2-418f-92de-e64de87307a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:56.532189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950b974-8fb2-418f-92de-e64de87307a9 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:56.532625 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950b974-8fb2-418f-92de-e64de87307a9 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:56.533096 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950b974-8fb2-418f-92de-e64de87307a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:56.534648 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950b974-8fb2-418f-92de-e64de87307a9 None admin] RBAC: Adding query filter params (group.id=c8b79b21afc54cbaab86d8a0863d0592, role.id=6a75cc334b5a44b5a347a1a0cc20f6d7, scope.project.id=8eb38f20a7f646d49f0c1da50ff81db2) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:56.535168 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950b974-8fb2-418f-92de-e64de87307a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:56.537573 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950b974-8fb2-418f-92de-e64de87307a9 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:56.545667 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 223/446] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:46:56 2022] GET /identity/v3/role_assignments?group.id=c8b79b21afc54cbaab86d8a0863d0592&scope.project.id=8eb38f20a7f646d49f0c1da50ff81db2&role.id=6a75cc334b5a44b5a347a1a0cc20f6d7 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:56.546466 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950b974-8fb2-418f-92de-e64de87307a9 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:56.547998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fc2a7-a74d-44c9-af73-3fd0646650c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:56.551235 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fc2a7-a74d-44c9-af73-3fd0646650c3 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:56.689312 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 224/447] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:46:56.691536 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950b974-8fb2-418f-92de-e64de87307a9 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:56.695243 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fc2a7-a74d-44c9-af73-3fd0646650c3 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:56.736878 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10495bc0-7a35-47a5-9229-1783ff08defd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:56.737668 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10495bc0-7a35-47a5-9229-1783ff08defd None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:56.737949 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10495bc0-7a35-47a5-9229-1783ff08defd None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:56.738221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10495bc0-7a35-47a5-9229-1783ff08defd None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:56.739964 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10495bc0-7a35-47a5-9229-1783ff08defd None admin] RBAC: Adding query filter params (name=admin) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:56.739964 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10495bc0-7a35-47a5-9229-1783ff08defd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:56.740685 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10495bc0-7a35-47a5-9229-1783ff08defd None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:56.751308 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 224/448] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:46:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:56.758364 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10495bc0-7a35-47a5-9229-1783ff08defd None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:56.844426 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fc2a7-a74d-44c9-af73-3fd0646650c3 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:56.903191 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73656dc-fc12-40de-b152-7ae9e4b23eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:56.904163 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73656dc-fc12-40de-b152-7ae9e4b23eae None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:56.904988 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73656dc-fc12-40de-b152-7ae9e4b23eae None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:56.905267 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73656dc-fc12-40de-b152-7ae9e4b23eae None admin] PATH_INFO: `/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:56.906707 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73656dc-fc12-40de-b152-7ae9e4b23eae None admin] RBAC: Authorizing `identity:get_project(project_id=8eb38f20a7f646d49f0c1da50ff81db2)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:56.908342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73656dc-fc12-40de-b152-7ae9e4b23eae None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:56.910007 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 225/449] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:56 2022] GET /identity/v3/projects/8eb38f20a7f646d49f0c1da50ff81db2 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:56.912587 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10495bc0-7a35-47a5-9229-1783ff08defd None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:56.918511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73656dc-fc12-40de-b152-7ae9e4b23eae None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:56.959901 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020d87b-8263-47b6-8340-60560a864e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:56.961364 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020d87b-8263-47b6-8340-60560a864e20 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:56.961364 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020d87b-8263-47b6-8340-60560a864e20 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:56.961930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020d87b-8263-47b6-8340-60560a864e20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:57.052461 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020d87b-8263-47b6-8340-60560a864e20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:57.054053 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020d87b-8263-47b6-8340-60560a864e20 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:57.075801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73656dc-fc12-40de-b152-7ae9e4b23eae None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:57.117726 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47956d0-95b3-4e6c-8c93-9b454b6c2052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:57.118640 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47956d0-95b3-4e6c-8c93-9b454b6c2052 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:57.119016 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47956d0-95b3-4e6c-8c93-9b454b6c2052 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:57.119415 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47956d0-95b3-4e6c-8c93-9b454b6c2052 None admin] PATH_INFO: `/v3/groups/c8b79b21afc54cbaab86d8a0863d0592` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:57.120996 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47956d0-95b3-4e6c-8c93-9b454b6c2052 None admin] RBAC: Authorizing `identity:get_group(group_id=c8b79b21afc54cbaab86d8a0863d0592)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:57.123574 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47956d0-95b3-4e6c-8c93-9b454b6c2052 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:57.126367 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 226/450] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:46:56 2022] GET /identity/v3/groups/c8b79b21afc54cbaab86d8a0863d0592 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:57.132932 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47956d0-95b3-4e6c-8c93-9b454b6c2052 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:57.180811 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 225/451] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:46:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:46:57.182124 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020d87b-8263-47b6-8340-60560a864e20 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:57.253934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47956d0-95b3-4e6c-8c93-9b454b6c2052 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:57.292172 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4deae9-fd42-4f39-8f46-b45ed30df987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:57.292972 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4deae9-fd42-4f39-8f46-b45ed30df987 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:57.293331 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4deae9-fd42-4f39-8f46-b45ed30df987 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:57.293703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4deae9-fd42-4f39-8f46-b45ed30df987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:57.294566 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4deae9-fd42-4f39-8f46-b45ed30df987 None admin] RBAC: Adding query filter params (group.id=c8b79b21afc54cbaab86d8a0863d0592, role.id=cf8c8db912344d0f82f8e6b0fa805968, scope.project.id=8eb38f20a7f646d49f0c1da50ff81db2) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:57.295647 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4deae9-fd42-4f39-8f46-b45ed30df987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:57.297627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4deae9-fd42-4f39-8f46-b45ed30df987 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:57.304480 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 227/452] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:46:57 2022] GET /identity/v3/role_assignments?group.id=c8b79b21afc54cbaab86d8a0863d0592&scope.project.id=8eb38f20a7f646d49f0c1da50ff81db2&role.id=cf8c8db912344d0f82f8e6b0fa805968 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:57.309332 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020d87b-8263-47b6-8340-60560a864e20 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:57.364946 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f0119-8f88-47f0-9c7b-f03fec05146c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:57.367467 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f0119-8f88-47f0-9c7b-f03fec05146c None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:57.368016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f0119-8f88-47f0-9c7b-f03fec05146c None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:57.368514 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f0119-8f88-47f0-9c7b-f03fec05146c None admin] PATH_INFO: `/v3/projects/d98726a0503446c8990ec97c6f98d1d8` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:57.370303 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f0119-8f88-47f0-9c7b-f03fec05146c None admin] RBAC: Authorizing `identity:get_project(project_id=d98726a0503446c8990ec97c6f98d1d8)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:57.372020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f0119-8f88-47f0-9c7b-f03fec05146c None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:57.375909 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 226/453] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:46:57 2022] GET /identity/v3/projects/d98726a0503446c8990ec97c6f98d1d8 => generated 344 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:46:57.391840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4deae9-fd42-4f39-8f46-b45ed30df987 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:57.523833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4deae9-fd42-4f39-8f46-b45ed30df987 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:57.566798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a5a33-53cc-4d98-b327-d32b04505fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:57.568154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a5a33-53cc-4d98-b327-d32b04505fbe None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:57.568447 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a5a33-53cc-4d98-b327-d32b04505fbe None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:57.568825 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a5a33-53cc-4d98-b327-d32b04505fbe None admin] PATH_INFO: `/v3/groups/bb358de4f0014e4bac2fd154033b75cb` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:57.570209 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a5a33-53cc-4d98-b327-d32b04505fbe None admin] RBAC: Authorizing `identity:get_group(group_id=bb358de4f0014e4bac2fd154033b75cb)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:57.572175 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a5a33-53cc-4d98-b327-d32b04505fbe None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:57.575044 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 228/454] 10.222.0.48 () {56 vars in 1180 bytes} [Mon May 9 15:46:57 2022] GET /identity/v3/groups/bb358de4f0014e4bac2fd154033b75cb => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:46:57.582624 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f0119-8f88-47f0-9c7b-f03fec05146c None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:46:57.726783 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f0119-8f88-47f0-9c7b-f03fec05146c None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:46:57.773618 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd588fb-1c89-40e0-9fc5-09e9119ecb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:46:57.774380 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd588fb-1c89-40e0-9fc5-09e9119ecb92 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:46:57.774652 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd588fb-1c89-40e0-9fc5-09e9119ecb92 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:46:57.774964 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd588fb-1c89-40e0-9fc5-09e9119ecb92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:46:57.775901 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd588fb-1c89-40e0-9fc5-09e9119ecb92 None admin] RBAC: Adding query filter params (group.id=bb358de4f0014e4bac2fd154033b75cb, role.id=2180d183afad443187521833c40ed8a1, scope.project.id=d98726a0503446c8990ec97c6f98d1d8) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:46:57.776239 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd588fb-1c89-40e0-9fc5-09e9119ecb92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:46:57.777706 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd588fb-1c89-40e0-9fc5-09e9119ecb92 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:46:57.788656 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 227/455] 10.222.0.48 () {56 vars in 1376 bytes} [Mon May 9 15:46:57 2022] GET /identity/v3/role_assignments?group.id=bb358de4f0014e4bac2fd154033b75cb&scope.project.id=d98726a0503446c8990ec97c6f98d1d8&role.id=2180d183afad443187521833c40ed8a1 => generated 611 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:00.668019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3615f-42e0-40f6-9603-2a9e104c5ce8 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:00.668586 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3615f-42e0-40f6-9603-2a9e104c5ce8 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:00.668586 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3615f-42e0-40f6-9603-2a9e104c5ce8 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:00.670862 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 229/456] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:00.683543 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fd1b0-b23f-46dc-97ff-9385455744a9 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:00.684099 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fd1b0-b23f-46dc-97ff-9385455744a9 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:00.684200 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fd1b0-b23f-46dc-97ff-9385455744a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:00.707691 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-113fd1b0-b23f-46dc-97ff-9385455744a9 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:00.708955 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-113fd1b0-b23f-46dc-97ff-9385455744a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:00.804086 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 228/457] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:00.849927 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3615f-42e0-40f6-9603-2a9e104c5ce8 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:01.012605 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3615f-42e0-40f6-9603-2a9e104c5ce8 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:01.075204 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a2838-8b31-47fc-9230-e09067612841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:01.076368 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a2838-8b31-47fc-9230-e09067612841 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:01.076828 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a2838-8b31-47fc-9230-e09067612841 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:01.077262 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a2838-8b31-47fc-9230-e09067612841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:01.094430 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a2838-8b31-47fc-9230-e09067612841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:01.096234 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a2838-8b31-47fc-9230-e09067612841 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:01.124232 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-c37a2838-8b31-47fc-9230-e09067612841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:01.124232 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:01.124232 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:01.124232 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:01.124232 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:01.124232 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:01.124232 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:01.124232 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:01.124232 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:01.124232 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:01.124232 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:01.124232 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:01.124232 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:01.124232 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:01.124232 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:01.125846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:01.125846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:01.125846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:01.125846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:01.125846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:01.125846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:01.125846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:01.125846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:01.125846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:01.125846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:01.125846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:01.125846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:01.125846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:01.125846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:01.125846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:01.125846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:01.125846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:01.126849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:01.126849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:01.126849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:01.126849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:01.128951 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 230/458] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:01.135110 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fd1b0-b23f-46dc-97ff-9385455744a9 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:01.211089 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f95f0-b1e7-41ff-b322-cc1c76d0d0f6 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:01.211759 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f95f0-b1e7-41ff-b322-cc1c76d0d0f6 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:01.212325 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f95f0-b1e7-41ff-b322-cc1c76d0d0f6 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:01.214416 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 231/459] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:01.226928 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634131a-fcb6-4636-adde-464cfd96ee18 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:01.226928 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634131a-fcb6-4636-adde-464cfd96ee18 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:01.226928 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634131a-fcb6-4636-adde-464cfd96ee18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:01.266685 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-b634131a-fcb6-4636-adde-464cfd96ee18 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:01.267935 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-b634131a-fcb6-4636-adde-464cfd96ee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:01.307356 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fd1b0-b23f-46dc-97ff-9385455744a9 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:01.362866 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621f8ab-c2b4-4111-8346-c69b5cee2459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:01.363567 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621f8ab-c2b4-4111-8346-c69b5cee2459 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:01.363854 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621f8ab-c2b4-4111-8346-c69b5cee2459 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:01.364137 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621f8ab-c2b4-4111-8346-c69b5cee2459 None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:01.364897 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621f8ab-c2b4-4111-8346-c69b5cee2459 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:01.365288 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621f8ab-c2b4-4111-8346-c69b5cee2459 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:01.366786 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621f8ab-c2b4-4111-8346-c69b5cee2459 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:01.380776 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 232/460] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:47:01.393896 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09974315-7ebc-4a6f-b7f0-d37a85248d40 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:01.394235 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09974315-7ebc-4a6f-b7f0-d37a85248d40 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:01.394496 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09974315-7ebc-4a6f-b7f0-d37a85248d40 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:01.396648 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 233/461] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:01.401107 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 229/462] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:01.407605 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09974315-7ebc-4a6f-b7f0-d37a85248d40 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:01.415401 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621f8ab-c2b4-4111-8346-c69b5cee2459 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:01.525813 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09974315-7ebc-4a6f-b7f0-d37a85248d40 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:01.567851 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38463086-a5f4-4a2d-83b5-e81e4ef91aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:01.568534 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621f8ab-c2b4-4111-8346-c69b5cee2459 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:01.569172 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38463086-a5f4-4a2d-83b5-e81e4ef91aeb None admin] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:01.569773 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38463086-a5f4-4a2d-83b5-e81e4ef91aeb None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:01.570330 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38463086-a5f4-4a2d-83b5-e81e4ef91aeb None admin] PATH_INFO: `/v3/users` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:01.571389 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38463086-a5f4-4a2d-83b5-e81e4ef91aeb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:01.573149 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38463086-a5f4-4a2d-83b5-e81e4ef91aeb None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:01.601839 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 234/463] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:47:01 2022] POST /identity/v3/users => generated 246 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:47:01.604031 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544911fe-cbb7-4b49-b29f-97246e11777e None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:01.604584 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544911fe-cbb7-4b49-b29f-97246e11777e None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:01.605113 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544911fe-cbb7-4b49-b29f-97246e11777e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:01.630075 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64555a1-b327-423a-b269-98a66d6272b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:01.633396 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64555a1-b327-423a-b269-98a66d6272b8 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:01.633396 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64555a1-b327-423a-b269-98a66d6272b8 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:01.633396 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64555a1-b327-423a-b269-98a66d6272b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:01.644173 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-544911fe-cbb7-4b49-b29f-97246e11777e None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:01.645632 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-544911fe-cbb7-4b49-b29f-97246e11777e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:01.652971 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64555a1-b327-423a-b269-98a66d6272b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:01.655708 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64555a1-b327-423a-b269-98a66d6272b8 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:01.681958 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-b64555a1-b327-423a-b269-98a66d6272b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:01.681958 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:01.681958 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:01.681958 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:01.681958 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:01.681958 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:01.681958 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:01.681958 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:01.681958 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:01.681958 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:01.681958 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:01.681958 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:01.681958 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:01.681958 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:01.681958 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:01.683633 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:01.683633 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:01.683633 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:01.683633 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:01.683633 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:01.683633 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:01.683633 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:01.683633 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:01.683633 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:01.683633 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:01.683633 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:01.683633 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:01.683633 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:01.683633 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:01.683633 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:01.683633 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:01.683633 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:01.685955 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:01.685955 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:01.685955 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:01.685955 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:01.688744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 230/464] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:47:01.697903 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64555a1-b327-423a-b269-98a66d6272b8 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:01.752178 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 235/465] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:01.762112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9758d1-27ce-49d3-a968-c5e00bcd1954 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:01.762691 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9758d1-27ce-49d3-a968-c5e00bcd1954 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:01.763261 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9758d1-27ce-49d3-a968-c5e00bcd1954 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:01.765585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 236/466] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:01 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:01.778456 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1151ae-1a43-4d75-b01d-8a2ad6973b1d None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:01.778643 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1151ae-1a43-4d75-b01d-8a2ad6973b1d None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:01.779451 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1151ae-1a43-4d75-b01d-8a2ad6973b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:01.807086 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-5c1151ae-1a43-4d75-b01d-8a2ad6973b1d None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:01.808403 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-5c1151ae-1a43-4d75-b01d-8a2ad6973b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:01.835145 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64555a1-b327-423a-b269-98a66d6272b8 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:01.875391 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb24226-feb1-4f1f-9c3e-81df1fbecf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:01.876076 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb24226-feb1-4f1f-9c3e-81df1fbecf8f None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:01.876361 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb24226-feb1-4f1f-9c3e-81df1fbecf8f None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:01.876681 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb24226-feb1-4f1f-9c3e-81df1fbecf8f None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:01.877462 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb24226-feb1-4f1f-9c3e-81df1fbecf8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:01.877775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb24226-feb1-4f1f-9c3e-81df1fbecf8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:01.879199 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb24226-feb1-4f1f-9c3e-81df1fbecf8f None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:01.889223 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 237/467] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:01.890225 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1151ae-1a43-4d75-b01d-8a2ad6973b1d None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:01.905855 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 231/468] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:01.915331 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb24226-feb1-4f1f-9c3e-81df1fbecf8f None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:02.023640 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1151ae-1a43-4d75-b01d-8a2ad6973b1d None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:02.053764 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb24226-feb1-4f1f-9c3e-81df1fbecf8f None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:02.082025 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5001292-38bc-4a0b-8f37-f0cc5fd2873f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:02.082879 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5001292-38bc-4a0b-8f37-f0cc5fd2873f None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:02.083190 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5001292-38bc-4a0b-8f37-f0cc5fd2873f None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:02.083492 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5001292-38bc-4a0b-8f37-f0cc5fd2873f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:02.104111 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5001292-38bc-4a0b-8f37-f0cc5fd2873f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:02.105898 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5001292-38bc-4a0b-8f37-f0cc5fd2873f None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:02.119744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c16e65-8374-4fdc-a5e7-9441c1290e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:02.122226 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c16e65-8374-4fdc-a5e7-9441c1290e0d None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:02.123242 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c16e65-8374-4fdc-a5e7-9441c1290e0d None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:02.123775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c16e65-8374-4fdc-a5e7-9441c1290e0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:02.131711 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-a5001292-38bc-4a0b-8f37-f0cc5fd2873f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:02.131711 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:02.131711 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:02.131711 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:02.131711 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:02.131711 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:02.131711 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:02.131711 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:02.131711 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:02.131711 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:02.131711 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:02.131711 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:02.131711 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:02.131711 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:02.131711 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:02.132724 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:02.132724 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:02.132724 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:02.132724 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:02.132724 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:02.132724 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:02.132724 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:02.132724 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:02.132724 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:02.132724 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:02.132724 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:02.132724 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:02.132724 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:02.132724 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:02.132724 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:02.132724 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:02.132724 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:02.133826 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:02.133826 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:02.133826 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:02.133826 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:02.133826 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 238/469] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:02.137404 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5001292-38bc-4a0b-8f37-f0cc5fd2873f None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:02.153101 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c16e65-8374-4fdc-a5e7-9441c1290e0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:02.158663 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c16e65-8374-4fdc-a5e7-9441c1290e0d None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:02.194254 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-a6c16e65-8374-4fdc-a5e7-9441c1290e0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:02.194254 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:02.194254 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:02.194254 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:02.194254 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:02.194254 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:02.194254 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:02.194254 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:02.194254 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:02.194254 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:02.194254 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:02.194254 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:02.194254 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:02.194254 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:02.194254 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:02.196579 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:02.196579 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:02.196579 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:02.196579 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:02.196579 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:02.196579 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:02.196579 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:02.196579 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:02.196579 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:02.196579 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:02.196579 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:02.196579 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:02.196579 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:02.196579 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:02.196579 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:02.196579 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:02.196579 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:02.198670 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:02.198670 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:02.198670 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:02.198670 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:02.198670 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 232/470] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:47:02.198670 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c16e65-8374-4fdc-a5e7-9441c1290e0d None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:02.329360 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5001292-38bc-4a0b-8f37-f0cc5fd2873f None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:02.372115 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e182798-d433-4be1-8a1f-eaa994b965b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:02.373603 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e182798-d433-4be1-8a1f-eaa994b965b3 None admin] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:02.374085 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e182798-d433-4be1-8a1f-eaa994b965b3 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:02.374534 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e182798-d433-4be1-8a1f-eaa994b965b3 None admin] PATH_INFO: `/v3/users` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:02.375683 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e182798-d433-4be1-8a1f-eaa994b965b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:02.377345 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e182798-d433-4be1-8a1f-eaa994b965b3 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:02.384854 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c16e65-8374-4fdc-a5e7-9441c1290e0d None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:02.418244 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 239/471] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:47:02 2022] POST /identity/v3/users => generated 248 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:47:02.420151 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e182798-d433-4be1-8a1f-eaa994b965b3 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:02.441277 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643c33b-d93e-41e9-858d-21183803e5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:02.442586 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643c33b-d93e-41e9-858d-21183803e5a9 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:02.443065 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643c33b-d93e-41e9-858d-21183803e5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:02.443567 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643c33b-d93e-41e9-858d-21183803e5a9 None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:02.444504 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643c33b-d93e-41e9-858d-21183803e5a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:02.445003 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643c33b-d93e-41e9-858d-21183803e5a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:02.446642 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643c33b-d93e-41e9-858d-21183803e5a9 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:02.461673 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 233/472] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:02.470757 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643c33b-d93e-41e9-858d-21183803e5a9 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:02.606102 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643c33b-d93e-41e9-858d-21183803e5a9 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:02.686241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d928b-93ae-43fe-af85-b054245ab067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:02.687874 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d928b-93ae-43fe-af85-b054245ab067 None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:02.688498 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d928b-93ae-43fe-af85-b054245ab067 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:02.689010 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d928b-93ae-43fe-af85-b054245ab067 None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:02.690057 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d928b-93ae-43fe-af85-b054245ab067 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:02.691772 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d928b-93ae-43fe-af85-b054245ab067 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:02.716965 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e182798-d433-4be1-8a1f-eaa994b965b3 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:02.719184 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 234/473] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:47:02 2022] POST /identity/v3/users => generated 248 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:47:02.720974 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f46bdf-9e01-4da8-8304-61f17714bada None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:02.721600 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f46bdf-9e01-4da8-8304-61f17714bada None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:02.722098 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f46bdf-9e01-4da8-8304-61f17714bada None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:02.728810 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 235/474] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:02.730756 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059530ea-9155-47b0-92cc-c2d63d013328 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:02.731362 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059530ea-9155-47b0-92cc-c2d63d013328 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:02.731859 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059530ea-9155-47b0-92cc-c2d63d013328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:02.752047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-059530ea-9155-47b0-92cc-c2d63d013328 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:02.754113 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-059530ea-9155-47b0-92cc-c2d63d013328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:02.774516 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4fc22e-a220-42ec-90ba-b6d73f50a913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:02.776914 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fc22e-a220-42ec-90ba-b6d73f50a913 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:02.776914 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fc22e-a220-42ec-90ba-b6d73f50a913 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:02.776914 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fc22e-a220-42ec-90ba-b6d73f50a913 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:02.777551 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4fc22e-a220-42ec-90ba-b6d73f50a913 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:02.777909 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4fc22e-a220-42ec-90ba-b6d73f50a913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:02.780464 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4fc22e-a220-42ec-90ba-b6d73f50a913 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:02.797548 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 240/475] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:02.805334 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4fc22e-a220-42ec-90ba-b6d73f50a913 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:02.869281 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 236/476] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:02.894383 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059530ea-9155-47b0-92cc-c2d63d013328 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:02.933899 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4fc22e-a220-42ec-90ba-b6d73f50a913 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:02.983914 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d5ceb-b246-4166-8ff9-34d2162d976c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:02.985637 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d5ceb-b246-4166-8ff9-34d2162d976c None admin] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:02.986311 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d5ceb-b246-4166-8ff9-34d2162d976c None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:02.986924 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d5ceb-b246-4166-8ff9-34d2162d976c None admin] PATH_INFO: `/v3/users` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:02.988041 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d5ceb-b246-4166-8ff9-34d2162d976c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:02.990481 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d5ceb-b246-4166-8ff9-34d2162d976c None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:03.018094 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 241/477] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:47:02 2022] POST /identity/v3/users => generated 249 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:47:03.058754 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059530ea-9155-47b0-92cc-c2d63d013328 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:03.123634 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efd0b4-5078-41fe-bac3-c443a5251630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:03.124662 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efd0b4-5078-41fe-bac3-c443a5251630 None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:03.125325 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efd0b4-5078-41fe-bac3-c443a5251630 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:03.125748 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efd0b4-5078-41fe-bac3-c443a5251630 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:03.126716 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efd0b4-5078-41fe-bac3-c443a5251630 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:03.128907 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efd0b4-5078-41fe-bac3-c443a5251630 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:03.138021 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.sql.core [None req-b8efd0b4-5078-41fe-bac3-c443a5251630 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 15:47:03.138021 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 09 15:47:03.138021 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [parameters: {'id': 'e8063df592fb4d1096cc844ea68855c3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 09 15:47:03.138021 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=276030) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 15:47:03.157615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-b8efd0b4-5078-41fe-bac3-c443a5251630 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 09 15:47:03.157615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:03.157615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:47:03.157615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:47:03.157615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:47:03.157615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:47:03.157615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:47:03.157615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:47:03.157615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:47:03.157615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application conn.query(q) May 09 15:47:03.157615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:47:03.157615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:47:03.157615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:47:03.157615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application result.read() May 09 15:47:03.157615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:47:03.158988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:47:03.158988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:47:03.158988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:47:03.158988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:47:03.158988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:47:03.158988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:47:03.158988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:47:03.158988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 15:47:03.158988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:03.158988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 15:47:03.158988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:03.158988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:03.158988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 15:47:03.158988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 15:47:03.158988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 09 15:47:03.158988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return ref.to_dict() May 09 15:47:03.158988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:47:03.158988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application next(self.gen) May 09 15:47:03.160701 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 15:47:03.160701 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application yield resource May 09 15:47:03.160701 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:47:03.160701 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application next(self.gen) May 09 15:47:03.160701 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 15:47:03.160701 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self.session.rollback() May 09 15:47:03.160701 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 15:47:03.160701 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self.force_reraise() May 09 15:47:03.160701 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 15:47:03.160701 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise self.value May 09 15:47:03.160701 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 15:47:03.160701 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 15:47:03.160701 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 15:47:03.160701 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application session.commit() May 09 15:47:03.160701 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 15:47:03.160701 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 15:47:03.160701 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 15:47:03.164560 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self._prepare_impl() May 09 15:47:03.164560 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 15:47:03.164560 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self.session.flush() May 09 15:47:03.164560 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 15:47:03.164560 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self._flush(objects) May 09 15:47:03.164560 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 15:47:03.164560 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 15:47:03.164560 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 15:47:03.164560 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application compat.raise_( May 09 15:47:03.164560 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:47:03.164560 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception May 09 15:47:03.164560 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 15:47:03.164560 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application flush_context.execute() May 09 15:47:03.164560 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 15:47:03.164560 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rec.execute(self) May 09 15:47:03.164560 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 15:47:03.164560 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 15:47:03.167332 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 15:47:03.167332 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 15:47:03.167332 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 09 15:47:03.167332 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application c = connection._execute_20( May 09 15:47:03.167332 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 15:47:03.167332 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 15:47:03.167332 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 15:47:03.167332 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 15:47:03.167332 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 15:47:03.167332 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 15:47:03.167332 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 15:47:03.167332 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 15:47:03.167332 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 15:47:03.167332 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 15:47:03.167332 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:47:03.167332 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception May 09 15:47:03.174574 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:47:03.174574 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:47:03.174574 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:47:03.174574 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:47:03.174574 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:47:03.174574 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:47:03.174574 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:47:03.174574 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application conn.query(q) May 09 15:47:03.174574 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:47:03.174574 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:47:03.174574 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:47:03.174574 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application result.read() May 09 15:47:03.174574 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:47:03.174574 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:47:03.174574 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:47:03.174574 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:47:03.175540 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:47:03.175540 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:47:03.175540 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:47:03.175540 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:47:03.175540 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 09 15:47:03.175540 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 09 15:47:03.175540 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [parameters: {'id': 'e8063df592fb4d1096cc844ea68855c3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 09 15:47:03.175540 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 15:47:03.175540 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:03.175540 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:47:03.175540 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:03.175540 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:03.175540 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:03.175540 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:03.175540 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:03.175540 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:03.176488 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:03.176488 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:03.176488 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:03.176488 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:03.176488 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:03.176488 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:03.176488 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 09 15:47:03.176488 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 09 15:47:03.176488 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:03.176488 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:03.176488 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 09 15:47:03.176488 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 09 15:47:03.176488 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 15:47:03.176488 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 15:47:03.176488 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 09 15:47:03.176488 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:03.177490 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 237/478] 10.222.0.48 () {60 vars in 1131 bytes} [Mon May 9 15:47:02 2022] POST /identity/v3/roles => generated 144 bytes in 266 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 09 15:47:03.177576 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d5ceb-b246-4166-8ff9-34d2162d976c None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:03.302325 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d5ceb-b246-4166-8ff9-34d2162d976c None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:03.341473 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8210250-19b7-4bdc-9ecb-4448099834ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:03.342611 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8210250-19b7-4bdc-9ecb-4448099834ad None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:03.343156 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8210250-19b7-4bdc-9ecb-4448099834ad None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:03.343616 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8210250-19b7-4bdc-9ecb-4448099834ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:03.359090 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8210250-19b7-4bdc-9ecb-4448099834ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:03.376866 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-a8210250-19b7-4bdc-9ecb-4448099834ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:47:03.376866 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:03.376866 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:03.376866 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:03.376866 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:03.376866 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:03.376866 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:03.376866 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:03.376866 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:03.376866 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:03.376866 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:03.376866 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:03.376866 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:03.376866 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:03.376866 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:03.376866 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:03.379197 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:03.379197 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:03.379197 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:03.379197 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:03.379197 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:03.379197 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:03.379197 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:03.379197 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:03.379197 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:03.379197 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:03.379197 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:03.379197 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:03.379197 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:03.379197 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:03.379197 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:03.379197 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:03.381309 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:03.381309 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:03.381309 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:03.381309 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:03.381309 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:03.381309 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:03.381309 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:03.381309 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:03.381309 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:03.381309 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:03.381309 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 09 15:47:03.381309 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:03.387938 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 242/479] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:47:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:03.394172 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efd0b4-5078-41fe-bac3-c443a5251630 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:03.538341 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efd0b4-5078-41fe-bac3-c443a5251630 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:03.586071 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6028b-73e4-4503-a658-578bb6132625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:03.587140 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6028b-73e4-4503-a658-578bb6132625 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:03.587625 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6028b-73e4-4503-a658-578bb6132625 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:03.588110 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6028b-73e4-4503-a658-578bb6132625 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:03.589128 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6028b-73e4-4503-a658-578bb6132625 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:03.589745 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6028b-73e4-4503-a658-578bb6132625 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:03.591464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6028b-73e4-4503-a658-578bb6132625 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:03.603281 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 238/480] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:04.429102 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54737c0-92a0-492a-8497-07294b753126 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:04.429859 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54737c0-92a0-492a-8497-07294b753126 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:04.429859 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54737c0-92a0-492a-8497-07294b753126 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:04.431392 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 243/481] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:04.437273 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5af16-fd2f-4a62-9463-b8b4385ac611 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:04.437814 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5af16-fd2f-4a62-9463-b8b4385ac611 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:04.437897 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5af16-fd2f-4a62-9463-b8b4385ac611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:04.462741 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-c1f5af16-fd2f-4a62-9463-b8b4385ac611 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:04.463968 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-c1f5af16-fd2f-4a62-9463-b8b4385ac611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:04.564036 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 239/482] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:04.604164 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54737c0-92a0-492a-8497-07294b753126 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:04.770068 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54737c0-92a0-492a-8497-07294b753126 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:04.829964 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a244bf-e39f-498e-8a85-4eb78be23b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:04.830823 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a244bf-e39f-498e-8a85-4eb78be23b41 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:04.831109 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a244bf-e39f-498e-8a85-4eb78be23b41 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:04.831386 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a244bf-e39f-498e-8a85-4eb78be23b41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:04.850577 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a244bf-e39f-498e-8a85-4eb78be23b41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:04.859741 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-e2a244bf-e39f-498e-8a85-4eb78be23b41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:04.859741 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:04.859741 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:04.859741 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:04.859741 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:04.859741 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:04.859741 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:04.859741 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:04.859741 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:04.859741 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:04.859741 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:04.859741 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:04.859741 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:04.859741 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:04.859741 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:04.859741 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:04.860978 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:04.860978 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:04.860978 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:04.860978 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:04.860978 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:04.860978 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:04.860978 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:04.860978 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:04.860978 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:04.860978 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:04.860978 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:04.860978 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:04.860978 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:04.860978 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:04.860978 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:04.860978 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:04.863198 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:04.863198 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:04.863198 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:04.863198 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:04.863198 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:04.863198 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:04.863198 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:04.863198 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:04.863198 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:04.863198 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:04.863198 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:04.863198 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:04.863198 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 244/483] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:47:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:04.870795 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5af16-fd2f-4a62-9463-b8b4385ac611 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:05.011992 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5af16-fd2f-4a62-9463-b8b4385ac611 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:05.063250 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c85ae9-861e-4fa2-aa8d-cafc89ee0c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:05.063867 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c85ae9-861e-4fa2-aa8d-cafc89ee0c5a None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:05.064166 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c85ae9-861e-4fa2-aa8d-cafc89ee0c5a None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:05.064454 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c85ae9-861e-4fa2-aa8d-cafc89ee0c5a None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:05.065234 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c85ae9-861e-4fa2-aa8d-cafc89ee0c5a None admin] RBAC: Adding query filter params (name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:05.065578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c85ae9-861e-4fa2-aa8d-cafc89ee0c5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:05.066975 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c85ae9-861e-4fa2-aa8d-cafc89ee0c5a None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:05.081348 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 240/484] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:47:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:05.086879 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a244bf-e39f-498e-8a85-4eb78be23b41 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:05.226995 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a244bf-e39f-498e-8a85-4eb78be23b41 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:05.266323 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081232f-5cb6-449a-a795-46513084229c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:05.267199 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081232f-5cb6-449a-a795-46513084229c None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:05.267490 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081232f-5cb6-449a-a795-46513084229c None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:05.267773 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081232f-5cb6-449a-a795-46513084229c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:05.279543 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081232f-5cb6-449a-a795-46513084229c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:05.281182 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081232f-5cb6-449a-a795-46513084229c None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:05.301029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-c081232f-5cb6-449a-a795-46513084229c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:05.301029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:05.301029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:05.301029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:05.301029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:05.301029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:05.301029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:05.301029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:05.301029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:05.301029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:05.301029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:05.301029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:05.301029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:05.301029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:05.301029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:05.302144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:05.302144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:05.302144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:05.302144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:05.302144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:05.302144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:05.302144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:05.302144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:05.302144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:05.302144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:05.302144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:05.302144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:05.302144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:05.302144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:05.302144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:05.302144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:05.302144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:05.304277 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:05.304277 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:05.304277 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:05.304277 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:05.307184 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 245/485] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:05.308547 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c85ae9-861e-4fa2-aa8d-cafc89ee0c5a None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:05.458187 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c85ae9-861e-4fa2-aa8d-cafc89ee0c5a None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:05.513651 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf28cb-2897-4125-b2e4-3be9689d51b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:05.514369 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf28cb-2897-4125-b2e4-3be9689d51b9 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:05.514753 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf28cb-2897-4125-b2e4-3be9689d51b9 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:05.514948 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf28cb-2897-4125-b2e4-3be9689d51b9 None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:05.515826 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf28cb-2897-4125-b2e4-3be9689d51b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:05.516140 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf28cb-2897-4125-b2e4-3be9689d51b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:05.517730 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf28cb-2897-4125-b2e4-3be9689d51b9 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:05.533186 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 241/486] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:05.539108 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081232f-5cb6-449a-a795-46513084229c None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:05.659446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081232f-5cb6-449a-a795-46513084229c None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:05.698641 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d5228-ca41-4791-8966-612e721e316c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:05.699564 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d5228-ca41-4791-8966-612e721e316c None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:05.699902 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d5228-ca41-4791-8966-612e721e316c None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:05.700205 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d5228-ca41-4791-8966-612e721e316c None admin] PATH_INFO: `/v3/users/nova` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:05.710101 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d5228-ca41-4791-8966-612e721e316c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:05.711616 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d5228-ca41-4791-8966-612e721e316c None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:05.729807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-d25d5228-ca41-4791-8966-612e721e316c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:47:05.729807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:05.729807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:05.729807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:05.729807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:05.729807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:05.729807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:05.729807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:05.729807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:05.729807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:05.729807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:05.729807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:05.729807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:05.729807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:05.729807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:05.729807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:05.730942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:05.730942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:05.730942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:05.730942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:05.730942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:05.730942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:05.730942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:05.730942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:05.730942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:05.730942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:05.730942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:05.730942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:05.730942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:05.730942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:05.730942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:05.730942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:05.730942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:05.730942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:05.733889 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:05.733889 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:05.733889 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:05.733889 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:05.733889 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:05.733889 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:05.733889 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:05.733889 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:05.733889 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:47:05.733889 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:05.733889 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 246/487] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:47:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:05.738462 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf28cb-2897-4125-b2e4-3be9689d51b9 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:05.749633 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad260e-28fb-4bac-9404-2386ef73d650 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:05.752084 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad260e-28fb-4bac-9404-2386ef73d650 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:05.752371 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad260e-28fb-4bac-9404-2386ef73d650 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:05.756839 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 247/488] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:05.764214 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abf6cb-6dd6-41cd-afc0-383600465df4 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:05.764544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abf6cb-6dd6-41cd-afc0-383600465df4 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:05.764939 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abf6cb-6dd6-41cd-afc0-383600465df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:05.799628 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-b5abf6cb-6dd6-41cd-afc0-383600465df4 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:05.801205 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-b5abf6cb-6dd6-41cd-afc0-383600465df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:05.936700 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf28cb-2897-4125-b2e4-3be9689d51b9 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:05.964087 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 248/489] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:47:06.000561 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156f28c-993d-4eaf-a952-ac5f053af1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:06.001717 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156f28c-993d-4eaf-a952-ac5f053af1c2 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:06.002233 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156f28c-993d-4eaf-a952-ac5f053af1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:06.002746 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156f28c-993d-4eaf-a952-ac5f053af1c2 None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:06.004282 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156f28c-993d-4eaf-a952-ac5f053af1c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:06.004853 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156f28c-993d-4eaf-a952-ac5f053af1c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:06.007631 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156f28c-993d-4eaf-a952-ac5f053af1c2 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:06.056270 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abf6cb-6dd6-41cd-afc0-383600465df4 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:06.089193 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 242/490] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:47:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:06.110336 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156f28c-993d-4eaf-a952-ac5f053af1c2 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:06.230555 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abf6cb-6dd6-41cd-afc0-383600465df4 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:06.272882 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ade9e9-ae35-4cb5-a7f5-d05aa772c510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:06.273731 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ade9e9-ae35-4cb5-a7f5-d05aa772c510 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:06.274061 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ade9e9-ae35-4cb5-a7f5-d05aa772c510 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:06.274344 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ade9e9-ae35-4cb5-a7f5-d05aa772c510 None admin] PATH_INFO: `/v3/roles/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:06.287455 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ade9e9-ae35-4cb5-a7f5-d05aa772c510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:06.288734 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156f28c-993d-4eaf-a952-ac5f053af1c2 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:06.296942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-08ade9e9-ae35-4cb5-a7f5-d05aa772c510 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:06.296942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:06.296942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:06.296942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:06.296942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:06.296942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:06.296942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:06.296942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:06.296942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:06.296942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:06.296942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:06.296942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:06.296942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:06.296942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:06.296942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:06.296942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:06.299483 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:06.299483 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:06.299483 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:06.299483 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:06.299483 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:06.299483 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:06.299483 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:06.299483 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:06.299483 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:06.299483 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:06.299483 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:06.299483 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:06.299483 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:06.299483 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:06.299483 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:06.299483 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:06.301857 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:06.301857 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:06.301857 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:06.301857 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:06.301857 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:06.301857 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:06.301857 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:06.301857 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:06.301857 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:06.301857 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:06.301857 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:06.301857 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:06.301857 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 249/491] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:47:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:06.301857 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac70bc-c90a-4ce9-b675-9895fa671c27 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:06.306851 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac70bc-c90a-4ce9-b675-9895fa671c27 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:06.306851 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac70bc-c90a-4ce9-b675-9895fa671c27 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:06.306851 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 250/492] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:06.309329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314e4ed-7367-4dc5-b0dd-1184cc4fdcaa None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:06.309329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314e4ed-7367-4dc5-b0dd-1184cc4fdcaa None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:06.309329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314e4ed-7367-4dc5-b0dd-1184cc4fdcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:06.332484 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-6314e4ed-7367-4dc5-b0dd-1184cc4fdcaa None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:06.334027 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-6314e4ed-7367-4dc5-b0dd-1184cc4fdcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:06.352774 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a35820-d263-4402-9d88-6832696d0bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:06.354974 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a35820-d263-4402-9d88-6832696d0bc7 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:06.355496 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a35820-d263-4402-9d88-6832696d0bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:06.356200 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a35820-d263-4402-9d88-6832696d0bc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:06.431035 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 251/493] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:47:06.432421 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314e4ed-7367-4dc5-b0dd-1184cc4fdcaa None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:06.471442 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a35820-d263-4402-9d88-6832696d0bc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:06.473049 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a35820-d263-4402-9d88-6832696d0bc7 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:06.594308 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314e4ed-7367-4dc5-b0dd-1184cc4fdcaa None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:06.603553 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 243/494] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:47:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:47:06.605705 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88bb0e-10f9-444b-ab4c-504f702adef2 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:06.606120 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88bb0e-10f9-444b-ab4c-504f702adef2 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:06.606471 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88bb0e-10f9-444b-ab4c-504f702adef2 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:06.609627 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 244/495] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:06.611429 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88bb0e-10f9-444b-ab4c-504f702adef2 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:06.649837 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca20f97-ada9-4a18-bcfd-b4deb2c93159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:06.650526 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca20f97-ada9-4a18-bcfd-b4deb2c93159 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:06.650804 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca20f97-ada9-4a18-bcfd-b4deb2c93159 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:06.651092 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca20f97-ada9-4a18-bcfd-b4deb2c93159 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:06.651850 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca20f97-ada9-4a18-bcfd-b4deb2c93159 None admin] RBAC: Adding query filter params (name=service) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:06.652156 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca20f97-ada9-4a18-bcfd-b4deb2c93159 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:06.653574 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca20f97-ada9-4a18-bcfd-b4deb2c93159 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:06.668903 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 252/496] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:47:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:06.668903 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca20f97-ada9-4a18-bcfd-b4deb2c93159 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:06.764090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88bb0e-10f9-444b-ab4c-504f702adef2 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:06.796984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca20f97-ada9-4a18-bcfd-b4deb2c93159 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:06.809217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa3116-d666-49d2-8a23-d6ce86da5449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:06.810157 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa3116-d666-49d2-8a23-d6ce86da5449 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:06.810573 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa3116-d666-49d2-8a23-d6ce86da5449 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:06.810897 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa3116-d666-49d2-8a23-d6ce86da5449 None admin] PATH_INFO: `/v3/roles/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:06.832775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa3116-d666-49d2-8a23-d6ce86da5449 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:06.844410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3cbee-a3ee-45c4-9736-a8f441674f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:06.844690 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-c3fa3116-d666-49d2-8a23-d6ce86da5449 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:06.844690 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:06.844690 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:06.844690 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:06.844690 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:06.844690 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:06.844690 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:06.844690 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:06.844690 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:06.844690 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:06.844690 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:06.844690 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:06.844690 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:06.844690 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:06.844690 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:06.844690 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:06.855122 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:06.855122 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:06.855122 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:06.855122 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:06.855122 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:06.855122 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:06.855122 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:06.855122 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:06.855122 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:06.855122 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:06.855122 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:06.855122 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:06.855122 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:06.855122 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:06.855122 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:06.855122 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:06.856691 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:06.856691 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:06.856691 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:06.856691 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:06.856691 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:06.856691 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:06.856691 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:06.856691 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:06.856691 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:06.856691 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:06.856691 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:06.856691 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:06.858984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3cbee-a3ee-45c4-9736-a8f441674f41 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:06.858984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3cbee-a3ee-45c4-9736-a8f441674f41 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:06.858984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3cbee-a3ee-45c4-9736-a8f441674f41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:06.859214 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 245/497] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:47:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:06.859214 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d0a3e-0d55-442c-bb1d-2993d9a82168 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:06.859214 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d0a3e-0d55-442c-bb1d-2993d9a82168 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:06.859214 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d0a3e-0d55-442c-bb1d-2993d9a82168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:06.867019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3cbee-a3ee-45c4-9736-a8f441674f41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:06.868505 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3cbee-a3ee-45c4-9736-a8f441674f41 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:06.886902 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-8d6d0a3e-0d55-442c-bb1d-2993d9a82168 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:06.888773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-8d6d0a3e-0d55-442c-bb1d-2993d9a82168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:06.892893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-e4a3cbee-a3ee-45c4-9736-a8f441674f41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:06.892893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:06.892893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:06.892893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:06.892893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:06.892893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:06.892893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:06.892893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:06.892893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:06.892893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:06.892893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:06.892893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:06.892893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:06.892893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:06.892893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:06.894484 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:06.894484 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:06.894484 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:06.894484 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:06.894484 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:06.894484 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:06.894484 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:06.894484 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:06.894484 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:06.894484 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:06.894484 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:06.894484 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:06.894484 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:06.894484 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:06.894484 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:06.894484 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:06.894484 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:06.896159 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:06.896159 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:06.896159 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:06.896159 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:06.896159 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 253/498] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:06.896159 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3cbee-a3ee-45c4-9736-a8f441674f41 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:06.978518 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 246/499] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:06.980417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d0a3e-0d55-442c-bb1d-2993d9a82168 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:07.053873 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3cbee-a3ee-45c4-9736-a8f441674f41 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:07.094748 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d1adc-544e-463d-b55d-5f28534aa4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:07.095522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d1adc-544e-463d-b55d-5f28534aa4d4 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:07.095802 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d1adc-544e-463d-b55d-5f28534aa4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:07.096084 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d1adc-544e-463d-b55d-5f28534aa4d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:07.102451 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d0a3e-0d55-442c-bb1d-2993d9a82168 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:07.109499 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d1adc-544e-463d-b55d-5f28534aa4d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:07.110864 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d1adc-544e-463d-b55d-5f28534aa4d4 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:07.131017 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-b35d1adc-544e-463d-b55d-5f28534aa4d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:07.131017 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:07.131017 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:07.131017 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:07.131017 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:07.131017 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:07.131017 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:07.131017 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:07.131017 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:07.131017 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:07.131017 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:07.131017 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:07.131017 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:07.131017 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:07.131017 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:07.132401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:07.132401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:07.132401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:07.132401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:07.132401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:07.132401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:07.132401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:07.132401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:07.132401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:07.132401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:07.132401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:07.132401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:07.132401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:07.132401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:07.132401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:07.132401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:07.132401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:07.135418 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:07.135418 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:07.135418 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:07.135418 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:07.135418 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 254/500] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:07.135418 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d1adc-544e-463d-b55d-5f28534aa4d4 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:07.153271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aef418-a8ec-4de6-9573-1dff98342033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:07.154599 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aef418-a8ec-4de6-9573-1dff98342033 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:07.155157 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aef418-a8ec-4de6-9573-1dff98342033 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:07.157073 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aef418-a8ec-4de6-9573-1dff98342033 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:07.157073 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aef418-a8ec-4de6-9573-1dff98342033 None admin] RBAC: Adding query filter params (name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:07.157073 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aef418-a8ec-4de6-9573-1dff98342033 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:07.159449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aef418-a8ec-4de6-9573-1dff98342033 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:07.167820 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 247/501] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:47:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:07.168743 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aef418-a8ec-4de6-9573-1dff98342033 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:07.266375 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d1adc-544e-463d-b55d-5f28534aa4d4 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:07.296498 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aef418-a8ec-4de6-9573-1dff98342033 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:07.308343 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8c8c0-e822-4e73-8613-28e1532f8909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:07.309109 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8c8c0-e822-4e73-8613-28e1532f8909 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:07.309526 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8c8c0-e822-4e73-8613-28e1532f8909 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:07.309824 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8c8c0-e822-4e73-8613-28e1532f8909 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:07.312134 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8c8c0-e822-4e73-8613-28e1532f8909 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:07.312468 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8c8c0-e822-4e73-8613-28e1532f8909 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:07.314300 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8c8c0-e822-4e73-8613-28e1532f8909 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:07.328889 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 255/502] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:07.330424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ae910-21af-480b-bb94-0e58c6014423 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:07.330818 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ae910-21af-480b-bb94-0e58c6014423 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:07.331193 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ae910-21af-480b-bb94-0e58c6014423 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:07.332922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 256/503] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:07.334883 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ae910-21af-480b-bb94-0e58c6014423 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:07.348286 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637ad2e-b8f7-4480-a777-0e2caa3b6dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:07.349054 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637ad2e-b8f7-4480-a777-0e2caa3b6dfc None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:07.349387 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637ad2e-b8f7-4480-a777-0e2caa3b6dfc None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:07.349717 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637ad2e-b8f7-4480-a777-0e2caa3b6dfc None admin] PATH_INFO: `/v3/roles/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:07.367770 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637ad2e-b8f7-4480-a777-0e2caa3b6dfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:07.377882 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-8637ad2e-b8f7-4480-a777-0e2caa3b6dfc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:07.377882 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:07.377882 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:07.377882 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:07.377882 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:07.377882 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:07.377882 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:07.377882 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:07.377882 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:07.377882 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:07.377882 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:07.377882 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:07.377882 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:07.377882 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:07.377882 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:07.377882 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:07.379105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:07.379105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:07.379105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:07.379105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:07.379105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:07.379105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:07.379105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:07.379105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:07.379105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:07.379105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:07.379105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:07.379105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:07.379105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:07.379105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:07.379105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:07.379105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:07.380346 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:07.380346 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:07.380346 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:07.380346 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:07.380346 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:07.380346 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:07.380346 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:07.380346 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:07.380346 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:07.380346 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:07.380346 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:07.380346 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:07.380346 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 248/504] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:47:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:07.380346 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637ad2e-b8f7-4480-a777-0e2caa3b6dfc None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:07.476945 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ae910-21af-480b-bb94-0e58c6014423 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:07.507681 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637ad2e-b8f7-4480-a777-0e2caa3b6dfc None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:07.517073 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22765cdc-a067-4fa7-b462-31a9e9f2a122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:07.517793 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22765cdc-a067-4fa7-b462-31a9e9f2a122 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:07.518080 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22765cdc-a067-4fa7-b462-31a9e9f2a122 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:07.518355 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22765cdc-a067-4fa7-b462-31a9e9f2a122 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:07.519088 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22765cdc-a067-4fa7-b462-31a9e9f2a122 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:07.519397 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22765cdc-a067-4fa7-b462-31a9e9f2a122 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:07.520776 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22765cdc-a067-4fa7-b462-31a9e9f2a122 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:07.537390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 257/505] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:07.538290 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22765cdc-a067-4fa7-b462-31a9e9f2a122 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:07.550338 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721bb79-5e1c-4b66-9323-cfac34223527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:07.551161 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721bb79-5e1c-4b66-9323-cfac34223527 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:07.551451 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721bb79-5e1c-4b66-9323-cfac34223527 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:07.551732 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721bb79-5e1c-4b66-9323-cfac34223527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:07.572352 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721bb79-5e1c-4b66-9323-cfac34223527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:07.574125 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721bb79-5e1c-4b66-9323-cfac34223527 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:07.595247 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-8721bb79-5e1c-4b66-9323-cfac34223527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:07.595247 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:07.595247 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:07.595247 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:07.595247 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:07.595247 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:07.595247 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:07.595247 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:07.595247 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:07.595247 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:07.595247 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:07.595247 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:07.595247 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:07.595247 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:07.595247 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:07.596449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:07.596449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:07.596449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:07.596449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:07.596449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:07.596449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:07.596449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:07.596449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:07.596449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:07.596449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:07.596449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:07.596449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:07.596449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:07.596449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:07.596449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:07.596449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:07.596449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:07.597748 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:07.597748 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:07.597748 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:07.597748 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:07.597748 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 249/506] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:07.598203 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94d495-1126-4734-9331-1a410d9f951e None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:07.598851 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94d495-1126-4734-9331-1a410d9f951e None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:07.598851 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94d495-1126-4734-9331-1a410d9f951e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:07.624793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-2c94d495-1126-4734-9331-1a410d9f951e None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:07.626338 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-2c94d495-1126-4734-9331-1a410d9f951e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:07.658135 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22765cdc-a067-4fa7-b462-31a9e9f2a122 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:07.721043 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf086243-479f-46ad-ab57-e483f484cdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:07.722368 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf086243-479f-46ad-ab57-e483f484cdd4 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:07.722830 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf086243-479f-46ad-ab57-e483f484cdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:07.723689 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf086243-479f-46ad-ab57-e483f484cdd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:07.749399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 250/507] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:07.749399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94d495-1126-4734-9331-1a410d9f951e None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:07.751287 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf086243-479f-46ad-ab57-e483f484cdd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:07.752825 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf086243-479f-46ad-ab57-e483f484cdd4 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:07.770233 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-bf086243-479f-46ad-ab57-e483f484cdd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:07.770233 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:07.770233 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:07.770233 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:07.770233 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:07.770233 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:07.770233 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:07.770233 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:07.770233 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:07.770233 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:07.770233 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:07.770233 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:07.770233 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:07.770233 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:07.770233 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:07.771627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:07.771627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:07.771627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:07.771627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:07.771627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:07.771627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:07.771627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:07.771627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:07.771627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:07.771627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:07.771627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:07.771627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:07.771627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:07.771627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:07.771627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:07.771627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:07.771627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:07.777442 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:07.777442 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:07.777442 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:07.777442 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:07.777442 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:07.777442 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:07.777442 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:07.777442 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:07.777442 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 258/508] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:07.777442 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf086243-479f-46ad-ab57-e483f484cdd4 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:07.851518 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94d495-1126-4734-9331-1a410d9f951e None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:07.887204 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf086243-479f-46ad-ab57-e483f484cdd4 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:07.891898 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcdf91-d540-4903-b0c8-7e02e4e1f972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:07.892764 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcdf91-d540-4903-b0c8-7e02e4e1f972 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:07.893101 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcdf91-d540-4903-b0c8-7e02e4e1f972 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:07.893438 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcdf91-d540-4903-b0c8-7e02e4e1f972 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:07.894278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fcdf91-d540-4903-b0c8-7e02e4e1f972 None admin] RBAC: Adding query filter params (name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:07.894591 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fcdf91-d540-4903-b0c8-7e02e4e1f972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:07.896279 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fcdf91-d540-4903-b0c8-7e02e4e1f972 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:07.910651 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 251/509] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:47:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:07.910651 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcdf91-d540-4903-b0c8-7e02e4e1f972 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:07.929181 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5eab7-0777-4979-a954-ffd888848ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:07.931202 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5eab7-0777-4979-a954-ffd888848ea3 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:07.931202 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5eab7-0777-4979-a954-ffd888848ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:07.931202 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5eab7-0777-4979-a954-ffd888848ea3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:07.940142 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5eab7-0777-4979-a954-ffd888848ea3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:07.941670 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5eab7-0777-4979-a954-ffd888848ea3 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:07.959452 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-6ac5eab7-0777-4979-a954-ffd888848ea3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 15:47:07.959452 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:07.959452 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:07.959452 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:07.959452 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:07.959452 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:07.959452 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:07.959452 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:07.959452 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:07.959452 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:07.959452 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:07.959452 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:07.959452 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:07.959452 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:07.959452 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:07.959452 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:07.960585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:07.960585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:07.960585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:07.960585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:07.960585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:07.960585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:07.960585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:07.960585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:07.960585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:07.960585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:07.960585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:07.960585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:07.960585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:07.960585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:07.960585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:07.960585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:07.960585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:07.960585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:07.961662 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:07.961662 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:07.961662 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:07.961662 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:07.961662 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:07.961662 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:07.961662 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:07.961662 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:07.961662 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 15:47:07.961662 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:07.965707 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 259/510] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:47:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:07.966464 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5eab7-0777-4979-a954-ffd888848ea3 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:08.030330 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcdf91-d540-4903-b0c8-7e02e4e1f972 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:08.065548 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21531aa8-0cd7-45a6-a168-add9b1aa9758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:08.066216 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21531aa8-0cd7-45a6-a168-add9b1aa9758 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:08.066499 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21531aa8-0cd7-45a6-a168-add9b1aa9758 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:08.066785 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21531aa8-0cd7-45a6-a168-add9b1aa9758 None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:08.067532 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21531aa8-0cd7-45a6-a168-add9b1aa9758 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:08.067836 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21531aa8-0cd7-45a6-a168-add9b1aa9758 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:08.069216 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21531aa8-0cd7-45a6-a168-add9b1aa9758 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:08.069886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5eab7-0777-4979-a954-ffd888848ea3 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:08.085861 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 252/511] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:08.085861 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21531aa8-0cd7-45a6-a168-add9b1aa9758 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:08.132874 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f9b9f-c1ab-4c56-82ca-d5ab7ffbff92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:08.133824 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f9b9f-c1ab-4c56-82ca-d5ab7ffbff92 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:08.134216 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f9b9f-c1ab-4c56-82ca-d5ab7ffbff92 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:08.134572 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f9b9f-c1ab-4c56-82ca-d5ab7ffbff92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:08.146709 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f9b9f-c1ab-4c56-82ca-d5ab7ffbff92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:08.148191 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f9b9f-c1ab-4c56-82ca-d5ab7ffbff92 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:08.167720 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-641f9b9f-c1ab-4c56-82ca-d5ab7ffbff92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:08.167720 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:08.167720 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:08.167720 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:08.167720 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:08.167720 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:08.167720 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:08.167720 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:08.167720 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:08.167720 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:08.167720 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:08.167720 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:08.167720 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:08.167720 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:08.167720 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:08.169032 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:08.169032 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:08.169032 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:08.169032 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:08.169032 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:08.169032 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:08.169032 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:08.169032 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:08.169032 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:08.169032 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:08.169032 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:08.169032 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:08.169032 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:08.169032 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:08.169032 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:08.169032 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:08.169032 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:08.171867 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:08.171867 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:08.171867 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:08.171867 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:08.173547 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 260/512] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:08.175002 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f9b9f-c1ab-4c56-82ca-d5ab7ffbff92 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:08.203314 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21531aa8-0cd7-45a6-a168-add9b1aa9758 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:08.240816 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164925d-ea5e-4f45-938b-33368af06408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:08.241578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164925d-ea5e-4f45-938b-33368af06408 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:08.241869 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164925d-ea5e-4f45-938b-33368af06408 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:08.242204 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164925d-ea5e-4f45-938b-33368af06408 None admin] PATH_INFO: `/v3/projects` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:08.243041 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164925d-ea5e-4f45-938b-33368af06408 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:08.243411 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164925d-ea5e-4f45-938b-33368af06408 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:08.244974 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164925d-ea5e-4f45-938b-33368af06408 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:08.267376 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 253/513] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:08.268621 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164925d-ea5e-4f45-938b-33368af06408 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:08.305023 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f9b9f-c1ab-4c56-82ca-d5ab7ffbff92 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:08.345060 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19616d47-dcba-4cfd-aa36-eff5691ca37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:08.345894 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19616d47-dcba-4cfd-aa36-eff5691ca37a None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:08.346171 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19616d47-dcba-4cfd-aa36-eff5691ca37a None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:08.346452 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19616d47-dcba-4cfd-aa36-eff5691ca37a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:08.357331 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19616d47-dcba-4cfd-aa36-eff5691ca37a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:08.359098 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19616d47-dcba-4cfd-aa36-eff5691ca37a None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:08.381068 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-19616d47-dcba-4cfd-aa36-eff5691ca37a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:08.381068 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:08.381068 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:08.381068 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:08.381068 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:08.381068 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:08.381068 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:08.381068 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:08.381068 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:08.381068 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:08.381068 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:08.381068 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:08.381068 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:08.381068 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:08.381068 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:08.382349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:08.382349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:08.382349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:08.382349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:08.382349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:08.382349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:08.382349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:08.382349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:08.382349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:08.382349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:08.382349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:08.382349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:08.382349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:08.382349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:08.382349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:08.382349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:08.382349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:08.383563 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:08.383563 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:08.383563 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:08.383563 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:08.383563 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 261/514] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:08.383563 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19616d47-dcba-4cfd-aa36-eff5691ca37a None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:08.393151 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164925d-ea5e-4f45-938b-33368af06408 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:08.432743 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e02834-6121-4649-9445-b228f0fd3818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:08.433887 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e02834-6121-4649-9445-b228f0fd3818 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:08.434221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e02834-6121-4649-9445-b228f0fd3818 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:08.434452 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e02834-6121-4649-9445-b228f0fd3818 None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:08.435580 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e02834-6121-4649-9445-b228f0fd3818 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:08.435907 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e02834-6121-4649-9445-b228f0fd3818 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:08.437488 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e02834-6121-4649-9445-b228f0fd3818 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:08.457150 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 254/515] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 9 15:47:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:08.458051 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e02834-6121-4649-9445-b228f0fd3818 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:08.508245 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19616d47-dcba-4cfd-aa36-eff5691ca37a None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:08.545969 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ff1a4-4eb1-4cfe-8cf5-32c28822a542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:08.546755 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ff1a4-4eb1-4cfe-8cf5-32c28822a542 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:08.547035 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ff1a4-4eb1-4cfe-8cf5-32c28822a542 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:08.547395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ff1a4-4eb1-4cfe-8cf5-32c28822a542 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:08.554967 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ff1a4-4eb1-4cfe-8cf5-32c28822a542 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:08.556421 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ff1a4-4eb1-4cfe-8cf5-32c28822a542 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:08.578069 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e02834-6121-4649-9445-b228f0fd3818 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:08.582684 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-3d5ff1a4-4eb1-4cfe-8cf5-32c28822a542 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:47:08.582684 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:08.582684 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:08.582684 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:08.582684 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:08.582684 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:08.582684 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:08.582684 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:08.582684 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:08.582684 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:08.582684 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:08.582684 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:08.582684 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:08.582684 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:08.582684 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:08.582684 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:08.583787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:08.583787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:08.583787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:08.583787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:08.583787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:08.583787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:08.583787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:08.583787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:08.583787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:08.583787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:08.583787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:08.583787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:08.583787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:08.583787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:08.583787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:08.583787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:08.583787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:08.583787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:08.585038 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:08.585038 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:08.585038 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:08.585038 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:08.585038 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:08.585038 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:08.585038 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:08.585038 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:08.585038 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:47:08.585038 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:08.585038 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 262/516] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:47:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:08.585038 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ff1a4-4eb1-4cfe-8cf5-32c28822a542 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:08.615875 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454f642-d073-4588-a0a2-dbc6f732aa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:08.616572 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454f642-d073-4588-a0a2-dbc6f732aa86 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:08.616878 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454f642-d073-4588-a0a2-dbc6f732aa86 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:08.617160 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454f642-d073-4588-a0a2-dbc6f732aa86 None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:08.617937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454f642-d073-4588-a0a2-dbc6f732aa86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:08.618248 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454f642-d073-4588-a0a2-dbc6f732aa86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:08.619648 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454f642-d073-4588-a0a2-dbc6f732aa86 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:08.632787 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 255/517] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:08.633945 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454f642-d073-4588-a0a2-dbc6f732aa86 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:08.706590 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ff1a4-4eb1-4cfe-8cf5-32c28822a542 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:08.746675 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454f642-d073-4588-a0a2-dbc6f732aa86 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:08.754083 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4be44-b45e-41bf-90e8-7ee3d8541ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:08.754754 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4be44-b45e-41bf-90e8-7ee3d8541ff8 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:08.755046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4be44-b45e-41bf-90e8-7ee3d8541ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:08.755328 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4be44-b45e-41bf-90e8-7ee3d8541ff8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:08.756186 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4be44-b45e-41bf-90e8-7ee3d8541ff8 None admin] RBAC: Adding query filter params (role.id=a6f10c1ca57b4299bb809b5bcc8797f5, scope.project.id=7860d281acf642d2a3950424901b9487, user.id=adf919c3ba31488694c724a803ca51eb) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:08.756501 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4be44-b45e-41bf-90e8-7ee3d8541ff8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:08.758000 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4be44-b45e-41bf-90e8-7ee3d8541ff8 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:08.764717 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 263/518] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:47:08 2022] GET /identity/v3/role_assignments?user.id=adf919c3ba31488694c724a803ca51eb&scope.project.id=7860d281acf642d2a3950424901b9487&role.id=a6f10c1ca57b4299bb809b5bcc8797f5 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:08.765827 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4be44-b45e-41bf-90e8-7ee3d8541ff8 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:08.790571 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94a467-8dc9-4971-baae-7f7fd255347c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:08.791683 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94a467-8dc9-4971-baae-7f7fd255347c None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:08.792144 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94a467-8dc9-4971-baae-7f7fd255347c None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:08.792552 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94a467-8dc9-4971-baae-7f7fd255347c None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:08.793693 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94a467-8dc9-4971-baae-7f7fd255347c None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:08.794139 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94a467-8dc9-4971-baae-7f7fd255347c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:08.796302 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94a467-8dc9-4971-baae-7f7fd255347c None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:08.819588 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 256/519] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:08.819588 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94a467-8dc9-4971-baae-7f7fd255347c None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:08.905485 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4be44-b45e-41bf-90e8-7ee3d8541ff8 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:08.949636 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ba6c3-5b51-49f5-8c4a-83e472379e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:08.950317 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ba6c3-5b51-49f5-8c4a-83e472379e77 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:08.950633 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ba6c3-5b51-49f5-8c4a-83e472379e77 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:08.950911 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ba6c3-5b51-49f5-8c4a-83e472379e77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:08.974200 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94a467-8dc9-4971-baae-7f7fd255347c None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:09.022126 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf677b8c-f690-41a3-b525-dfc6606438a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:09.022813 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf677b8c-f690-41a3-b525-dfc6606438a3 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:09.023090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf677b8c-f690-41a3-b525-dfc6606438a3 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:09.023373 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf677b8c-f690-41a3-b525-dfc6606438a3 None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:09.024229 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf677b8c-f690-41a3-b525-dfc6606438a3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:09.024577 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf677b8c-f690-41a3-b525-dfc6606438a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:09.025514 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ba6c3-5b51-49f5-8c4a-83e472379e77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:09.026031 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf677b8c-f690-41a3-b525-dfc6606438a3 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:09.026976 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ba6c3-5b51-49f5-8c4a-83e472379e77 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:09.046358 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 257/520] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 9 15:47:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:09.047224 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf677b8c-f690-41a3-b525-dfc6606438a3 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:09.175651 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 264/521] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:47:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:47:09.175651 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ba6c3-5b51-49f5-8c4a-83e472379e77 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:09.175939 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf677b8c-f690-41a3-b525-dfc6606438a3 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:09.216134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a113f-37ae-495e-8009-1c4ac139bf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:09.217989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a113f-37ae-495e-8009-1c4ac139bf55 None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:09.218520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a113f-37ae-495e-8009-1c4ac139bf55 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:09.218961 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a113f-37ae-495e-8009-1c4ac139bf55 None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:09.220151 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a113f-37ae-495e-8009-1c4ac139bf55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:09.222205 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a113f-37ae-495e-8009-1c4ac139bf55 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:09.249435 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 258/522] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:47:09 2022] POST /identity/v3/users => generated 247 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:47:09.251289 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a113f-37ae-495e-8009-1c4ac139bf55 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:09.301497 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ba6c3-5b51-49f5-8c4a-83e472379e77 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:09.343910 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf287ba-2620-47c7-8899-6ceb7b1c19c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:09.345121 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf287ba-2620-47c7-8899-6ceb7b1c19c9 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:09.345608 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf287ba-2620-47c7-8899-6ceb7b1c19c9 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:09.346118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf287ba-2620-47c7-8899-6ceb7b1c19c9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:09.354892 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf287ba-2620-47c7-8899-6ceb7b1c19c9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:09.356710 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf287ba-2620-47c7-8899-6ceb7b1c19c9 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:09.374342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-1cf287ba-2620-47c7-8899-6ceb7b1c19c9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:47:09.374342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:09.374342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:09.374342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:09.374342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:09.374342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:09.374342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:09.374342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:09.374342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:09.374342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:09.374342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:09.374342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:09.374342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:09.374342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:09.374342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:09.374342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:09.375832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:09.375832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:09.375832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:09.375832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:09.375832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:09.375832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:09.375832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:09.375832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:09.375832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:09.375832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:09.375832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:09.375832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:09.375832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:09.375832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:09.375832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:09.375832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:09.375832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:09.375832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:09.376872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:09.376872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:09.376872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:09.376872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:09.376872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:09.376872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:09.376872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:09.376872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:09.376872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:47:09.376872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:09.379454 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 265/523] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:47:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:09.380588 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf287ba-2620-47c7-8899-6ceb7b1c19c9 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:09.418918 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a113f-37ae-495e-8009-1c4ac139bf55 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:09.464855 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ddb76-6a3d-4a02-a44a-399cb6b355d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:09.465855 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ddb76-6a3d-4a02-a44a-399cb6b355d5 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:09.466312 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ddb76-6a3d-4a02-a44a-399cb6b355d5 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:09.466748 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ddb76-6a3d-4a02-a44a-399cb6b355d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:09.521535 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf287ba-2620-47c7-8899-6ceb7b1c19c9 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:09.555238 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ddb76-6a3d-4a02-a44a-399cb6b355d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:09.557092 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ddb76-6a3d-4a02-a44a-399cb6b355d5 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:09.572743 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f7135-cef3-40e9-89ab-0dc6cd8412df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:09.573584 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f7135-cef3-40e9-89ab-0dc6cd8412df None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:09.573872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f7135-cef3-40e9-89ab-0dc6cd8412df None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:09.574517 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f7135-cef3-40e9-89ab-0dc6cd8412df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:09.586699 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f7135-cef3-40e9-89ab-0dc6cd8412df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:09.588369 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f7135-cef3-40e9-89ab-0dc6cd8412df None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:09.631856 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-356f7135-cef3-40e9-89ab-0dc6cd8412df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:09.631856 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:09.631856 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:09.631856 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:09.631856 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:09.631856 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:09.631856 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:09.631856 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:09.631856 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:09.631856 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:09.631856 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:09.631856 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:09.631856 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:09.631856 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:09.631856 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:09.634625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:09.634625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:09.634625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:09.634625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:09.634625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:09.634625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:09.634625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:09.634625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:09.634625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:09.634625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:09.634625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:09.634625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:09.634625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:09.634625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:09.634625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:09.634625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:09.634625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:09.635640 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:09.635640 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:09.635640 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:09.635640 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:09.641568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 266/524] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:09.647189 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f7135-cef3-40e9-89ab-0dc6cd8412df None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:09.684685 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 259/525] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:47:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:47:09.686483 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ddb76-6a3d-4a02-a44a-399cb6b355d5 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:09.813897 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ddb76-6a3d-4a02-a44a-399cb6b355d5 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:09.869774 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b968d-7a13-4b4e-8ea2-0bc915c85d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:09.871331 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b968d-7a13-4b4e-8ea2-0bc915c85d54 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:09.872065 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b968d-7a13-4b4e-8ea2-0bc915c85d54 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:09.873318 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b968d-7a13-4b4e-8ea2-0bc915c85d54 None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:09.874994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b968d-7a13-4b4e-8ea2-0bc915c85d54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:09.876044 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b968d-7a13-4b4e-8ea2-0bc915c85d54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:09.879002 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b968d-7a13-4b4e-8ea2-0bc915c85d54 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:09.880703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f7135-cef3-40e9-89ab-0dc6cd8412df None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:09.905173 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 260/526] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:09.907152 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b968d-7a13-4b4e-8ea2-0bc915c85d54 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:09.933802 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdf762-8f7e-462a-a8dd-05a63772a64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:09.934830 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdf762-8f7e-462a-a8dd-05a63772a64a None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:09.935812 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdf762-8f7e-462a-a8dd-05a63772a64a None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:09.936180 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdf762-8f7e-462a-a8dd-05a63772a64a None admin] PATH_INFO: `/v3/users` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:09.937588 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cdf762-8f7e-462a-a8dd-05a63772a64a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:09.938041 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cdf762-8f7e-462a-a8dd-05a63772a64a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:09.940327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cdf762-8f7e-462a-a8dd-05a63772a64a None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:09.993810 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 267/527] 10.222.0.48 () {56 vars in 1139 bytes} [Mon May 9 15:47:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:09.994911 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdf762-8f7e-462a-a8dd-05a63772a64a None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:10.036031 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b968d-7a13-4b4e-8ea2-0bc915c85d54 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:10.075004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42ea6c-5cbd-400e-8de4-6da7ce8756b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:10.076328 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42ea6c-5cbd-400e-8de4-6da7ce8756b5 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:10.076771 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42ea6c-5cbd-400e-8de4-6da7ce8756b5 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:10.077215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42ea6c-5cbd-400e-8de4-6da7ce8756b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:10.089287 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42ea6c-5cbd-400e-8de4-6da7ce8756b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:10.091194 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42ea6c-5cbd-400e-8de4-6da7ce8756b5 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:10.113225 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdf762-8f7e-462a-a8dd-05a63772a64a None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:10.131680 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-ab42ea6c-5cbd-400e-8de4-6da7ce8756b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:10.131680 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:10.131680 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:10.131680 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:10.131680 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:10.131680 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:10.131680 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:10.131680 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:10.131680 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:10.131680 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:10.131680 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:10.131680 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:10.131680 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:10.131680 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:10.131680 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:10.133610 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:10.133610 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:10.133610 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:10.133610 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:10.133610 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:10.133610 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:10.133610 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:10.133610 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:10.133610 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:10.133610 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:10.133610 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:10.133610 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:10.133610 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:10.133610 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:10.133610 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:10.133610 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:10.133610 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:10.135335 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:10.135335 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:10.135335 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:10.135335 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:10.137448 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 261/528] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:10.138588 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42ea6c-5cbd-400e-8de4-6da7ce8756b5 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:10.171901 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8aa216-a52f-4e35-938d-354aa70dfaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:10.173198 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8aa216-a52f-4e35-938d-354aa70dfaba None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:10.173752 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8aa216-a52f-4e35-938d-354aa70dfaba None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:10.174086 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8aa216-a52f-4e35-938d-354aa70dfaba None admin] PATH_INFO: `/v3/projects/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:10.186851 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8aa216-a52f-4e35-938d-354aa70dfaba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:10.190031 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8aa216-a52f-4e35-938d-354aa70dfaba None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:10.219522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-ed8aa216-a52f-4e35-938d-354aa70dfaba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:10.219522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:10.219522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:10.219522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:10.219522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:10.219522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:10.219522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:10.219522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:10.219522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:10.219522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:10.219522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:10.219522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:10.219522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:10.219522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:10.219522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:10.221306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:10.221306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:10.221306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:10.221306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:10.221306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:10.221306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:10.221306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:10.221306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:10.221306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:10.221306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:10.221306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:10.221306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:10.221306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:10.221306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:10.221306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:10.221306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:10.221306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:10.222481 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:10.222481 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:10.222481 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:10.222481 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:10.222481 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:10.222481 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:10.222481 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:10.222481 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:10.229605 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 268/529] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:10.231299 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8aa216-a52f-4e35-938d-354aa70dfaba None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:10.267847 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42ea6c-5cbd-400e-8de4-6da7ce8756b5 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:10.321394 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad30638-e85b-412d-b336-694fb20f468e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:10.322505 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad30638-e85b-412d-b336-694fb20f468e None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:10.323041 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad30638-e85b-412d-b336-694fb20f468e None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:10.323385 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad30638-e85b-412d-b336-694fb20f468e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:10.387084 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8aa216-a52f-4e35-938d-354aa70dfaba None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:10.421940 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad30638-e85b-412d-b336-694fb20f468e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:10.423702 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad30638-e85b-412d-b336-694fb20f468e None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:10.440538 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec275a-652a-4797-b46e-afd079a93673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:10.441315 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec275a-652a-4797-b46e-afd079a93673 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:10.441667 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec275a-652a-4797-b46e-afd079a93673 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:10.441955 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec275a-652a-4797-b46e-afd079a93673 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:10.442968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec275a-652a-4797-b46e-afd079a93673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:10.443320 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec275a-652a-4797-b46e-afd079a93673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:10.445481 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec275a-652a-4797-b46e-afd079a93673 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:10.467145 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 269/530] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:10.474236 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec275a-652a-4797-b46e-afd079a93673 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:10.577162 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 262/531] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:47:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:47:10.578568 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad30638-e85b-412d-b336-694fb20f468e None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:10.623350 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec275a-652a-4797-b46e-afd079a93673 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:10.666554 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6e23b-2781-40ab-bdcf-29fa370b03d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:10.667125 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6e23b-2781-40ab-bdcf-29fa370b03d4 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:10.667434 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6e23b-2781-40ab-bdcf-29fa370b03d4 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:10.668226 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6e23b-2781-40ab-bdcf-29fa370b03d4 None admin] PATH_INFO: `/v3/projects` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:10.668713 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6e23b-2781-40ab-bdcf-29fa370b03d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:10.669133 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6e23b-2781-40ab-bdcf-29fa370b03d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:10.671214 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6e23b-2781-40ab-bdcf-29fa370b03d4 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:10.697772 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 270/532] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:10.698856 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6e23b-2781-40ab-bdcf-29fa370b03d4 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:10.725637 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad30638-e85b-412d-b336-694fb20f468e None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:10.800477 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887590a-3f04-4b79-9a2b-33a902f38b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:10.801502 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887590a-3f04-4b79-9a2b-33a902f38b5d None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:10.801646 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887590a-3f04-4b79-9a2b-33a902f38b5d None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:10.801909 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887590a-3f04-4b79-9a2b-33a902f38b5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:10.812212 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887590a-3f04-4b79-9a2b-33a902f38b5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:10.814827 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887590a-3f04-4b79-9a2b-33a902f38b5d None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:10.824324 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6e23b-2781-40ab-bdcf-29fa370b03d4 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:10.832852 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-d887590a-3f04-4b79-9a2b-33a902f38b5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:10.832852 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:10.832852 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:10.832852 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:10.832852 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:10.832852 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:10.832852 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:10.832852 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:10.832852 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:10.832852 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:10.832852 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:10.832852 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:10.832852 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:10.832852 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:10.832852 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:10.834093 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:10.834093 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:10.834093 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:10.834093 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:10.834093 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:10.834093 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:10.834093 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:10.834093 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:10.834093 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:10.834093 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:10.834093 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:10.834093 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:10.834093 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:10.834093 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:10.834093 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:10.834093 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:10.834093 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:10.835134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:10.835134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:10.835134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:10.835134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:10.835134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:10.835134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:10.835134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:10.835134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:10.839645 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 263/533] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:10.841031 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887590a-3f04-4b79-9a2b-33a902f38b5d None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:10.875554 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2412f-062c-4ce7-9fcf-6a90c1872ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:10.877066 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2412f-062c-4ce7-9fcf-6a90c1872ac7 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:10.877721 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2412f-062c-4ce7-9fcf-6a90c1872ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:10.878565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2412f-062c-4ce7-9fcf-6a90c1872ac7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:10.893830 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2412f-062c-4ce7-9fcf-6a90c1872ac7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:10.897137 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2412f-062c-4ce7-9fcf-6a90c1872ac7 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:10.922886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-beb2412f-062c-4ce7-9fcf-6a90c1872ac7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:10.922886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:10.922886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:10.922886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:10.922886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:10.922886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:10.922886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:10.922886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:10.922886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:10.922886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:10.922886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:10.922886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:10.922886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:10.922886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:10.922886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:10.924325 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:10.924325 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:10.924325 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:10.924325 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:10.924325 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:10.924325 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:10.924325 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:10.924325 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:10.924325 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:10.924325 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:10.924325 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:10.924325 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:10.924325 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:10.924325 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:10.924325 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:10.924325 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:10.924325 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:10.925502 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:10.925502 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:10.925502 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:10.925502 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:10.928455 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 271/534] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:10.929784 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2412f-062c-4ce7-9fcf-6a90c1872ac7 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:10.979729 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887590a-3f04-4b79-9a2b-33a902f38b5d None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:11.023384 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade128d7-ce5e-405c-873a-bad922d1a687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:11.024521 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade128d7-ce5e-405c-873a-bad922d1a687 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:11.024822 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade128d7-ce5e-405c-873a-bad922d1a687 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:11.025318 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade128d7-ce5e-405c-873a-bad922d1a687 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:11.026338 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade128d7-ce5e-405c-873a-bad922d1a687 None admin] RBAC: Adding query filter params (role.id=a6f10c1ca57b4299bb809b5bcc8797f5, scope.project.id=7860d281acf642d2a3950424901b9487, user.id=f24f3d53e78140b9bba6306aed2865ab) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:11.026860 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade128d7-ce5e-405c-873a-bad922d1a687 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:11.028498 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade128d7-ce5e-405c-873a-bad922d1a687 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:11.041551 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 264/535] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:47:10 2022] GET /identity/v3/role_assignments?user.id=f24f3d53e78140b9bba6306aed2865ab&scope.project.id=7860d281acf642d2a3950424901b9487&role.id=a6f10c1ca57b4299bb809b5bcc8797f5 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:11.042947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade128d7-ce5e-405c-873a-bad922d1a687 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:11.082485 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2412f-062c-4ce7-9fcf-6a90c1872ac7 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:11.182538 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f1c4c-b570-4b8c-86fc-ab2b672c7c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:11.183502 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f1c4c-b570-4b8c-86fc-ab2b672c7c72 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:11.183796 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f1c4c-b570-4b8c-86fc-ab2b672c7c72 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:11.184077 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f1c4c-b570-4b8c-86fc-ab2b672c7c72 None admin] PATH_INFO: `/v3/projects` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:11.185339 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f1c4c-b570-4b8c-86fc-ab2b672c7c72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:11.186464 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f1c4c-b570-4b8c-86fc-ab2b672c7c72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:11.193339 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f1c4c-b570-4b8c-86fc-ab2b672c7c72 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:11.249585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 272/536] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:11.259663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f1c4c-b570-4b8c-86fc-ab2b672c7c72 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:11.359006 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade128d7-ce5e-405c-873a-bad922d1a687 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:11.420775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f1c4c-b570-4b8c-86fc-ab2b672c7c72 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:11.440794 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cece5-c471-4ae2-9be4-4fba0079d3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:11.441791 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cece5-c471-4ae2-9be4-4fba0079d3ec None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:11.442387 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cece5-c471-4ae2-9be4-4fba0079d3ec None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:11.442895 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cece5-c471-4ae2-9be4-4fba0079d3ec None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:11.444644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cece5-c471-4ae2-9be4-4fba0079d3ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:11.445066 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cece5-c471-4ae2-9be4-4fba0079d3ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:11.447913 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cece5-c471-4ae2-9be4-4fba0079d3ec None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:11.486994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 265/537] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:11.493298 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cece5-c471-4ae2-9be4-4fba0079d3ec None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:11.494852 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7b7d9-ace0-49f4-a99b-4b473dda0743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:11.495594 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7b7d9-ace0-49f4-a99b-4b473dda0743 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:11.495914 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7b7d9-ace0-49f4-a99b-4b473dda0743 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:11.496212 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7b7d9-ace0-49f4-a99b-4b473dda0743 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:11.497084 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc7b7d9-ace0-49f4-a99b-4b473dda0743 None admin] RBAC: Adding query filter params (role.id=a6f10c1ca57b4299bb809b5bcc8797f5, scope.project.id=7860d281acf642d2a3950424901b9487, user.id=8f0df0a8cb634b8cbd133e68127c30a3) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:11.497511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc7b7d9-ace0-49f4-a99b-4b473dda0743 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:11.499085 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc7b7d9-ace0-49f4-a99b-4b473dda0743 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:11.521053 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 273/538] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:47:11 2022] GET /identity/v3/role_assignments?user.id=8f0df0a8cb634b8cbd133e68127c30a3&scope.project.id=7860d281acf642d2a3950424901b9487&role.id=a6f10c1ca57b4299bb809b5bcc8797f5 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:11.673468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cece5-c471-4ae2-9be4-4fba0079d3ec None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:11.715142 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0337ad-df28-43ee-9e71-af76089d24df None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:11.715344 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0337ad-df28-43ee-9e71-af76089d24df None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:11.715606 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0337ad-df28-43ee-9e71-af76089d24df None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:11.717517 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 274/539] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:11.727127 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d3c8f-38d6-4366-9e5d-248ac3a6acb6 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:11.727403 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed61e50-6f07-4b66-af38-0d05634b7f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:11.727872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d3c8f-38d6-4366-9e5d-248ac3a6acb6 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:11.727978 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d3c8f-38d6-4366-9e5d-248ac3a6acb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:11.728954 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed61e50-6f07-4b66-af38-0d05634b7f67 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:11.729549 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed61e50-6f07-4b66-af38-0d05634b7f67 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:11.730014 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed61e50-6f07-4b66-af38-0d05634b7f67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:11.739127 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed61e50-6f07-4b66-af38-0d05634b7f67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:11.740869 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed61e50-6f07-4b66-af38-0d05634b7f67 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:11.757928 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-fed61e50-6f07-4b66-af38-0d05634b7f67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:11.757928 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:11.757928 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:11.757928 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:11.757928 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:11.757928 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:11.757928 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:11.757928 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:11.757928 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:11.757928 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:11.757928 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:11.757928 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:11.757928 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:11.757928 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:11.757928 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:11.759215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:11.759215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:11.759215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:11.759215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:11.759215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:11.759215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:11.759215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:11.759215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:11.759215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:11.759215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:11.759215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:11.759215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:11.759215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:11.759215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:11.759215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:11.759215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:11.759215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:11.760380 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:11.760380 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:11.760380 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:11.760380 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:11.760380 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:11.760380 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:11.760380 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:11.760380 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:11.767826 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 266/540] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:11.769914 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed61e50-6f07-4b66-af38-0d05634b7f67 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:11.783266 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-8d6d3c8f-38d6-4366-9e5d-248ac3a6acb6 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:11.784884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-8d6d3c8f-38d6-4366-9e5d-248ac3a6acb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:11.914231 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed61e50-6f07-4b66-af38-0d05634b7f67 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:11.916250 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 275/541] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:11.952424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d3c8f-38d6-4366-9e5d-248ac3a6acb6 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:11.977859 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e772f2-87f2-42e0-acde-10d14915613f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:11.980259 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e772f2-87f2-42e0-acde-10d14915613f None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:11.981877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e772f2-87f2-42e0-acde-10d14915613f None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:11.982378 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e772f2-87f2-42e0-acde-10d14915613f None admin] PATH_INFO: `/v3/projects` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:11.985395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e772f2-87f2-42e0-acde-10d14915613f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:11.986048 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e772f2-87f2-42e0-acde-10d14915613f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:11.989392 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e772f2-87f2-42e0-acde-10d14915613f None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:12.013801 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 267/542] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:12.018400 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e772f2-87f2-42e0-acde-10d14915613f None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:12.149150 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d3c8f-38d6-4366-9e5d-248ac3a6acb6 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:12.188847 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461ec46-8f24-4b42-a7c1-2ceba208bcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:12.190026 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461ec46-8f24-4b42-a7c1-2ceba208bcec None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:12.190528 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461ec46-8f24-4b42-a7c1-2ceba208bcec None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:12.191005 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461ec46-8f24-4b42-a7c1-2ceba208bcec None admin] PATH_INFO: `/v3/roles/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:12.204040 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461ec46-8f24-4b42-a7c1-2ceba208bcec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:12.212633 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-d461ec46-8f24-4b42-a7c1-2ceba208bcec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:12.212633 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:12.212633 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:12.212633 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:12.212633 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:12.212633 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:12.212633 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:12.212633 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:12.212633 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:12.212633 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:12.212633 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:12.212633 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:12.212633 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:12.212633 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:12.212633 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:12.212633 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:12.213795 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:12.213795 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:12.213795 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:12.213795 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:12.213795 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:12.213795 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:12.213795 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:12.213795 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:12.213795 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:12.213795 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:12.213795 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:12.213795 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:12.213795 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:12.213795 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:12.213795 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:12.213795 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:12.214785 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:12.214785 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:12.214785 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:12.214785 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:12.214785 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:12.214785 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:12.214785 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:12.214785 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:12.214785 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:12.214785 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:12.214785 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:12.214785 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:12.218066 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 276/543] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:47:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:47:12.219732 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04470d00-537b-4f5c-87cb-9f454b944833 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:12.220195 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04470d00-537b-4f5c-87cb-9f454b944833 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:12.220642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04470d00-537b-4f5c-87cb-9f454b944833 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:12.222792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 277/544] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:12.223746 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04470d00-537b-4f5c-87cb-9f454b944833 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:12.231523 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e772f2-87f2-42e0-acde-10d14915613f None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:12.303760 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c8876-11c2-4477-97d7-aa08bf1a4f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:12.305600 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c8876-11c2-4477-97d7-aa08bf1a4f8d None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:12.306292 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c8876-11c2-4477-97d7-aa08bf1a4f8d None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:12.306984 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c8876-11c2-4477-97d7-aa08bf1a4f8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:12.308797 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c8876-11c2-4477-97d7-aa08bf1a4f8d None admin] RBAC: Adding query filter params (role.id=a6f10c1ca57b4299bb809b5bcc8797f5, scope.project.id=7860d281acf642d2a3950424901b9487, user.id=cc0eb4f69ab6423eae5e8b33fbc06563) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:12.309875 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c8876-11c2-4477-97d7-aa08bf1a4f8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:12.315917 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c8876-11c2-4477-97d7-aa08bf1a4f8d None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:12.323495 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 268/545] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:47:12 2022] GET /identity/v3/role_assignments?user.id=cc0eb4f69ab6423eae5e8b33fbc06563&scope.project.id=7860d281acf642d2a3950424901b9487&role.id=a6f10c1ca57b4299bb809b5bcc8797f5 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:47:12.325294 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c2820-9889-444e-aa76-bcbfc7cb624b None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:12.325749 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c2820-9889-444e-aa76-bcbfc7cb624b None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:12.326092 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c2820-9889-444e-aa76-bcbfc7cb624b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:12.368697 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-3c1c2820-9889-444e-aa76-bcbfc7cb624b None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:12.371843 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-3c1c2820-9889-444e-aa76-bcbfc7cb624b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:12.425579 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04470d00-537b-4f5c-87cb-9f454b944833 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:12.503700 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6bfed-4b72-41a7-bc16-11e45111a016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:12.504381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6bfed-4b72-41a7-bc16-11e45111a016 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:12.504691 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6bfed-4b72-41a7-bc16-11e45111a016 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:12.507491 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6bfed-4b72-41a7-bc16-11e45111a016 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:12.508367 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6bfed-4b72-41a7-bc16-11e45111a016 None admin] RBAC: Adding query filter params (name=service) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:12.508707 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6bfed-4b72-41a7-bc16-11e45111a016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:12.515106 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6bfed-4b72-41a7-bc16-11e45111a016 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:12.541893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 278/546] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:47:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:12.542283 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 269/547] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:12.548832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6bfed-4b72-41a7-bc16-11e45111a016 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:12.611115 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c2820-9889-444e-aa76-bcbfc7cb624b None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:12.680144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6bfed-4b72-41a7-bc16-11e45111a016 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:12.727674 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f0149-57db-44a5-ac54-5758cd1caa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:12.728493 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f0149-57db-44a5-ac54-5758cd1caa1b None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:12.728780 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f0149-57db-44a5-ac54-5758cd1caa1b None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:12.729057 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f0149-57db-44a5-ac54-5758cd1caa1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:12.743190 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c2820-9889-444e-aa76-bcbfc7cb624b None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:12.752505 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f0149-57db-44a5-ac54-5758cd1caa1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:12.758434 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f0149-57db-44a5-ac54-5758cd1caa1b None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:12.789410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-725f0149-57db-44a5-ac54-5758cd1caa1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:12.789410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:12.789410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:12.789410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:12.789410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:12.789410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:12.789410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:12.789410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:12.789410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:12.789410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:12.789410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:12.789410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:12.789410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:12.789410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:12.789410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:12.790505 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:12.790505 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:12.790505 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:12.790505 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:12.790505 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:12.790505 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:12.790505 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:12.790505 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:12.790505 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:12.790505 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:12.790505 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:12.790505 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:12.790505 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:12.790505 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:12.790505 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:12.790505 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:12.790505 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:12.791858 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:12.791858 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:12.791858 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:12.791858 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:12.800374 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13125d0-8008-465a-a85a-7a423024acea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:12.801684 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13125d0-8008-465a-a85a-7a423024acea None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:12.802164 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13125d0-8008-465a-a85a-7a423024acea None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:12.802624 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13125d0-8008-465a-a85a-7a423024acea None admin] PATH_INFO: `/v3/roles/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:12.804157 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 279/548] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:12.817477 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f0149-57db-44a5-ac54-5758cd1caa1b None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:12.839939 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13125d0-8008-465a-a85a-7a423024acea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:12.848074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-d13125d0-8008-465a-a85a-7a423024acea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:12.848074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:12.848074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:12.848074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:12.848074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:12.848074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:12.848074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:12.848074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:12.848074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:12.848074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:12.848074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:12.848074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:12.848074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:12.848074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:12.848074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:12.848074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:12.850615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:12.850615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:12.850615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:12.850615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:12.850615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:12.850615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:12.850615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:12.850615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:12.850615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:12.850615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:12.850615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:12.850615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:12.850615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:12.850615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:12.850615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:12.850615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:12.853181 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:12.853181 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:12.853181 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:12.853181 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:12.853181 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:12.853181 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:12.853181 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:12.853181 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:12.853181 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:12.853181 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:12.853181 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:12.853181 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:12.865596 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 270/549] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:47:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:47:12.867738 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13125d0-8008-465a-a85a-7a423024acea None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:12.952706 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f0149-57db-44a5-ac54-5758cd1caa1b None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:13.003230 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99367ad-4260-460b-b16d-53be264d47a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:13.003916 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99367ad-4260-460b-b16d-53be264d47a5 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:13.004204 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99367ad-4260-460b-b16d-53be264d47a5 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:13.004483 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99367ad-4260-460b-b16d-53be264d47a5 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:13.005241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99367ad-4260-460b-b16d-53be264d47a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:13.005580 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99367ad-4260-460b-b16d-53be264d47a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:13.007058 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99367ad-4260-460b-b16d-53be264d47a5 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:13.032088 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 280/550] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:47:13.039261 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99367ad-4260-460b-b16d-53be264d47a5 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:13.093608 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13125d0-8008-465a-a85a-7a423024acea None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:13.137352 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36032ba6-9884-4f89-971c-95a9f9a990b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:13.138344 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36032ba6-9884-4f89-971c-95a9f9a990b2 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:13.138664 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36032ba6-9884-4f89-971c-95a9f9a990b2 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:13.139016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36032ba6-9884-4f89-971c-95a9f9a990b2 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:13.139976 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36032ba6-9884-4f89-971c-95a9f9a990b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:13.140345 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36032ba6-9884-4f89-971c-95a9f9a990b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:13.142206 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36032ba6-9884-4f89-971c-95a9f9a990b2 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:13.155431 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 271/551] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:47:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:13.162911 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36032ba6-9884-4f89-971c-95a9f9a990b2 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:13.293048 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99367ad-4260-460b-b16d-53be264d47a5 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:13.295460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36032ba6-9884-4f89-971c-95a9f9a990b2 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:13.347434 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfdfcf-f458-487d-b09a-c8a680bdf1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:13.348267 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfdfcf-f458-487d-b09a-c8a680bdf1db None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:13.348554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfdfcf-f458-487d-b09a-c8a680bdf1db None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:13.348835 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfdfcf-f458-487d-b09a-c8a680bdf1db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:13.367155 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899992f-6467-4c6c-8006-b6178d4ddcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:13.367974 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899992f-6467-4c6c-8006-b6178d4ddcd1 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:13.368267 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899992f-6467-4c6c-8006-b6178d4ddcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:13.368528 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899992f-6467-4c6c-8006-b6178d4ddcd1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:13.370070 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcfdfcf-f458-487d-b09a-c8a680bdf1db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:13.371559 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcfdfcf-f458-487d-b09a-c8a680bdf1db None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:13.389913 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899992f-6467-4c6c-8006-b6178d4ddcd1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:13.391412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899992f-6467-4c6c-8006-b6178d4ddcd1 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:13.406016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-6bcfdfcf-f458-487d-b09a-c8a680bdf1db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:13.406016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:13.406016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:13.406016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:13.406016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:13.406016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:13.406016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:13.406016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:13.406016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:13.406016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:13.406016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:13.406016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:13.406016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:13.406016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:13.406016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:13.409404 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:13.409404 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:13.409404 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:13.409404 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:13.409404 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:13.409404 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:13.409404 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:13.409404 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:13.409404 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:13.409404 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:13.409404 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:13.409404 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:13.409404 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:13.409404 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:13.409404 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:13.409404 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:13.409404 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:13.411325 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:13.411325 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:13.411325 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:13.411325 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:13.411325 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 272/552] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:47:13.413514 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfdfcf-f458-487d-b09a-c8a680bdf1db None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:13.445934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-1899992f-6467-4c6c-8006-b6178d4ddcd1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:47:13.445934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:13.445934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:13.445934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:13.445934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:13.445934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:13.445934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:13.445934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:13.445934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:13.445934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:13.445934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:13.445934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:13.445934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:13.445934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:13.445934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:13.445934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:13.447760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:13.447760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:13.447760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:13.447760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:13.447760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:13.447760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:13.447760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:13.447760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:13.447760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:13.447760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:13.447760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:13.447760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:13.447760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:13.447760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:13.447760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:13.447760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:13.447760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:13.447760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:13.449832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:13.449832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:13.449832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:13.449832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:13.449832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:13.449832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:13.449832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:13.449832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:13.449832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:47:13.449832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:13.456121 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 281/553] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:47:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:13.462199 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899992f-6467-4c6c-8006-b6178d4ddcd1 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:13.537406 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfdfcf-f458-487d-b09a-c8a680bdf1db None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:13.581698 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752fa6c-cd3c-46b9-9426-dcaf7ec0f09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:13.582308 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752fa6c-cd3c-46b9-9426-dcaf7ec0f09c None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:13.582587 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752fa6c-cd3c-46b9-9426-dcaf7ec0f09c None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:13.582867 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752fa6c-cd3c-46b9-9426-dcaf7ec0f09c None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:13.583614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752fa6c-cd3c-46b9-9426-dcaf7ec0f09c None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:13.583928 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752fa6c-cd3c-46b9-9426-dcaf7ec0f09c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:13.590665 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752fa6c-cd3c-46b9-9426-dcaf7ec0f09c None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:13.617579 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 273/554] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:47:13.632950 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752fa6c-cd3c-46b9-9426-dcaf7ec0f09c None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:13.685288 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899992f-6467-4c6c-8006-b6178d4ddcd1 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:13.732084 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef95f69-b6e4-4943-9ea5-d766a0f237d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:13.732854 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef95f69-b6e4-4943-9ea5-d766a0f237d2 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:13.733157 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef95f69-b6e4-4943-9ea5-d766a0f237d2 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:13.733469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef95f69-b6e4-4943-9ea5-d766a0f237d2 None admin] PATH_INFO: `/v3/users` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:13.734406 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef95f69-b6e4-4943-9ea5-d766a0f237d2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:13.734723 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef95f69-b6e4-4943-9ea5-d766a0f237d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:13.736454 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef95f69-b6e4-4943-9ea5-d766a0f237d2 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:13.771414 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 282/555] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:47:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:47:13.778461 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef95f69-b6e4-4943-9ea5-d766a0f237d2 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:13.827016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752fa6c-cd3c-46b9-9426-dcaf7ec0f09c None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:13.867179 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732812d-454c-4fac-a096-6b7b00194f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:13.867914 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732812d-454c-4fac-a096-6b7b00194f1f None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:13.868217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732812d-454c-4fac-a096-6b7b00194f1f None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:13.868499 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732812d-454c-4fac-a096-6b7b00194f1f None admin] PATH_INFO: `/v3/users/swift` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:13.877931 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732812d-454c-4fac-a096-6b7b00194f1f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:13.879420 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732812d-454c-4fac-a096-6b7b00194f1f None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:13.897104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-6732812d-454c-4fac-a096-6b7b00194f1f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:47:13.897104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:13.897104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:13.897104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:13.897104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:13.897104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:13.897104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:13.897104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:13.897104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:13.897104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:13.897104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:13.897104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:13.897104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:13.897104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:13.897104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:13.897104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:13.898342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:13.898342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:13.898342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:13.898342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:13.898342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:13.898342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:13.898342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:13.898342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:13.898342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:13.898342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:13.898342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:13.898342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:13.898342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:13.898342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:13.898342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:13.898342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:13.898342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:13.898342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:13.902348 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:13.902348 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:13.902348 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:13.902348 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:13.902348 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:13.902348 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:13.902348 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:13.902348 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:13.902348 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:47:13.902348 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:13.902348 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 274/556] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:47:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:47:13.909399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732812d-454c-4fac-a096-6b7b00194f1f None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:14.017348 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732812d-454c-4fac-a096-6b7b00194f1f None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:14.025341 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef95f69-b6e4-4943-9ea5-d766a0f237d2 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:14.057636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac304f75-300a-4f91-87e4-3c3fa8736329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:14.058425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac304f75-300a-4f91-87e4-3c3fa8736329 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:14.058729 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac304f75-300a-4f91-87e4-3c3fa8736329 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:14.059118 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac304f75-300a-4f91-87e4-3c3fa8736329 None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:14.060552 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac304f75-300a-4f91-87e4-3c3fa8736329 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:14.061097 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac304f75-300a-4f91-87e4-3c3fa8736329 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:14.062857 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac304f75-300a-4f91-87e4-3c3fa8736329 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:14.086105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 275/557] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 9 15:47:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:14.094985 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac304f75-300a-4f91-87e4-3c3fa8736329 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:14.162490 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8b0ad-b445-434a-88e1-b311512de04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:14.163882 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8b0ad-b445-434a-88e1-b311512de04c None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:14.164480 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8b0ad-b445-434a-88e1-b311512de04c None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:14.165212 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8b0ad-b445-434a-88e1-b311512de04c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:14.191476 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8b0ad-b445-434a-88e1-b311512de04c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:14.193323 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8b0ad-b445-434a-88e1-b311512de04c None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:14.208020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac304f75-300a-4f91-87e4-3c3fa8736329 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:14.238210 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-5aa8b0ad-b445-434a-88e1-b311512de04c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:14.238210 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:14.238210 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:14.238210 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:14.238210 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:14.238210 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:14.238210 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:14.238210 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:14.238210 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:14.238210 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:14.238210 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:14.238210 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:14.238210 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:14.238210 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:14.238210 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:14.239288 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:14.239288 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:14.239288 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:14.239288 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:14.239288 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:14.239288 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:14.239288 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:14.239288 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:14.239288 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:14.239288 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:14.239288 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:14.239288 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:14.239288 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:14.239288 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:14.239288 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:14.239288 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:14.239288 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:14.240423 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:14.240423 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:14.240423 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:14.240423 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:14.244196 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 283/558] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 466 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:14.250355 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8b0ad-b445-434a-88e1-b311512de04c None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:14.253005 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d93eed-d841-4c6b-bcb8-ed3b9f1f5cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:14.253718 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d93eed-d841-4c6b-bcb8-ed3b9f1f5cf4 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:14.254012 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d93eed-d841-4c6b-bcb8-ed3b9f1f5cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:14.254297 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d93eed-d841-4c6b-bcb8-ed3b9f1f5cf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:14.334823 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d93eed-d841-4c6b-bcb8-ed3b9f1f5cf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:14.336957 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d93eed-d841-4c6b-bcb8-ed3b9f1f5cf4 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:14.391937 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8b0ad-b445-434a-88e1-b311512de04c None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:14.443801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb663ba-e4e2-4162-ac1b-93487562ee9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:14.445294 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb663ba-e4e2-4162-ac1b-93487562ee9b None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:14.445838 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb663ba-e4e2-4162-ac1b-93487562ee9b None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:14.446479 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb663ba-e4e2-4162-ac1b-93487562ee9b None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:14.448038 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb663ba-e4e2-4162-ac1b-93487562ee9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:14.449214 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb663ba-e4e2-4162-ac1b-93487562ee9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:14.453220 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb663ba-e4e2-4162-ac1b-93487562ee9b None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:14.464572 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 276/559] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:47:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:47:14.464572 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94a054-68d6-4607-a41b-de0585da38db None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:14.464572 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94a054-68d6-4607-a41b-de0585da38db None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:14.464572 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94a054-68d6-4607-a41b-de0585da38db None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:14.464572 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 277/560] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:14.467549 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94a054-68d6-4607-a41b-de0585da38db None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:14.476845 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 284/561] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:47:14.485731 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa00fc0-37f7-4e63-8a59-1ddc9f03ca22 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:14.485962 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa00fc0-37f7-4e63-8a59-1ddc9f03ca22 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:14.486292 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa00fc0-37f7-4e63-8a59-1ddc9f03ca22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:14.508514 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-5aa00fc0-37f7-4e63-8a59-1ddc9f03ca22 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:14.510206 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-5aa00fc0-37f7-4e63-8a59-1ddc9f03ca22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:14.617538 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 285/562] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:14.617948 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94a054-68d6-4607-a41b-de0585da38db None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:14.619143 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa00fc0-37f7-4e63-8a59-1ddc9f03ca22 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:14.665588 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ebd89-bb20-4efe-a3bf-6f9d0dd5d332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:14.666349 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ebd89-bb20-4efe-a3bf-6f9d0dd5d332 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:14.666753 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ebd89-bb20-4efe-a3bf-6f9d0dd5d332 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:14.667165 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ebd89-bb20-4efe-a3bf-6f9d0dd5d332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:14.685884 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ebd89-bb20-4efe-a3bf-6f9d0dd5d332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:14.687870 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ebd89-bb20-4efe-a3bf-6f9d0dd5d332 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:14.709762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-8c5ebd89-bb20-4efe-a3bf-6f9d0dd5d332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:14.709762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:14.709762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:14.709762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:14.709762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:14.709762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:14.709762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:14.709762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:14.709762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:14.709762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:14.709762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:14.709762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:14.709762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:14.709762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:14.709762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:14.710795 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:14.710795 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:14.710795 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:14.710795 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:14.710795 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:14.710795 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:14.710795 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:14.710795 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:14.710795 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:14.710795 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:14.710795 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:14.710795 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:14.710795 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:14.710795 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:14.710795 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:14.710795 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:14.710795 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:14.711770 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:14.711770 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:14.711770 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:14.711770 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:14.719968 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 278/563] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:14.721269 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ebd89-bb20-4efe-a3bf-6f9d0dd5d332 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:14.751872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa00fc0-37f7-4e63-8a59-1ddc9f03ca22 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:14.792502 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987002f-166b-4276-8d3e-d314850a001a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:14.793605 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987002f-166b-4276-8d3e-d314850a001a None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:14.794088 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987002f-166b-4276-8d3e-d314850a001a None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:14.795199 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987002f-166b-4276-8d3e-d314850a001a None admin] PATH_INFO: `/v3/projects/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:14.803917 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987002f-166b-4276-8d3e-d314850a001a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:14.805609 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987002f-166b-4276-8d3e-d314850a001a None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:14.822656 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-3987002f-166b-4276-8d3e-d314850a001a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:14.822656 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:14.822656 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:14.822656 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:14.822656 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:14.822656 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:14.822656 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:14.822656 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:14.822656 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:14.822656 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:14.822656 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:14.822656 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:14.822656 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:14.822656 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:14.822656 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:14.823959 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:14.823959 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:14.823959 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:14.823959 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:14.823959 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:14.823959 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:14.823959 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:14.823959 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:14.823959 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:14.823959 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:14.823959 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:14.823959 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:14.823959 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:14.823959 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:14.823959 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:14.823959 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:14.823959 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:14.825028 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:14.825028 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:14.825028 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:14.825028 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:14.825028 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:14.825028 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:14.825028 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:14.825028 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:14.825028 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 286/564] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:14.826301 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987002f-166b-4276-8d3e-d314850a001a None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:14.855429 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ebd89-bb20-4efe-a3bf-6f9d0dd5d332 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:14.895067 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb9f39-ead4-4fb3-a522-b45cef41048d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:14.895904 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb9f39-ead4-4fb3-a522-b45cef41048d None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:14.896191 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb9f39-ead4-4fb3-a522-b45cef41048d None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:14.896471 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb9f39-ead4-4fb3-a522-b45cef41048d None admin] PATH_INFO: `/v3/roles/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:14.908470 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb9f39-ead4-4fb3-a522-b45cef41048d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:14.916329 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-5edb9f39-ead4-4fb3-a522-b45cef41048d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:14.916329 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:14.916329 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:14.916329 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:14.916329 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:14.916329 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:14.916329 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:14.916329 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:14.916329 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:14.916329 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:14.916329 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:14.916329 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:14.916329 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:14.916329 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:14.916329 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:14.916329 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:14.917486 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:14.917486 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:14.917486 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:14.917486 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:14.917486 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:14.917486 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:14.917486 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:14.917486 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:14.917486 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:14.917486 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:14.917486 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:14.917486 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:14.917486 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:14.917486 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:14.917486 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:14.917486 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:14.918496 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:14.918496 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:14.918496 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:14.918496 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:14.918496 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:14.918496 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:14.918496 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:14.918496 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:14.918496 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:14.918496 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:14.918496 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:14.918496 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:14.918496 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 279/565] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:47:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:14.921407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e3978-9618-48eb-aa34-e5081af384b7 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:14.921407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e3978-9618-48eb-aa34-e5081af384b7 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:14.921407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e3978-9618-48eb-aa34-e5081af384b7 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:14.922401 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 280/566] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:14.925438 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e3978-9618-48eb-aa34-e5081af384b7 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:14.954645 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987002f-166b-4276-8d3e-d314850a001a None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:14.996381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79527c0d-2396-4825-8c9d-2d59ee5d9430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:14.996977 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79527c0d-2396-4825-8c9d-2d59ee5d9430 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:14.997818 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79527c0d-2396-4825-8c9d-2d59ee5d9430 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:14.998152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79527c0d-2396-4825-8c9d-2d59ee5d9430 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:14.998904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79527c0d-2396-4825-8c9d-2d59ee5d9430 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:14.999402 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79527c0d-2396-4825-8c9d-2d59ee5d9430 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:15.001599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79527c0d-2396-4825-8c9d-2d59ee5d9430 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:15.020610 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 287/567] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:15.020610 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79527c0d-2396-4825-8c9d-2d59ee5d9430 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:15.048045 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e3978-9618-48eb-aa34-e5081af384b7 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:15.085837 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c67772-10fa-414d-a201-ac219ddb1185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:15.086528 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c67772-10fa-414d-a201-ac219ddb1185 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:15.086818 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c67772-10fa-414d-a201-ac219ddb1185 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:15.087104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c67772-10fa-414d-a201-ac219ddb1185 None admin] PATH_INFO: `/v3/projects` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:15.087937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c67772-10fa-414d-a201-ac219ddb1185 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:15.088251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c67772-10fa-414d-a201-ac219ddb1185 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:15.089788 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c67772-10fa-414d-a201-ac219ddb1185 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:15.103740 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 281/568] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:15.105097 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9497f-bb19-4432-bff8-7633c60d06a2 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:15.105429 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9497f-bb19-4432-bff8-7633c60d06a2 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:15.105708 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9497f-bb19-4432-bff8-7633c60d06a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:15.127414 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-15d9497f-bb19-4432-bff8-7633c60d06a2 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:15.128624 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-15d9497f-bb19-4432-bff8-7633c60d06a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:15.157650 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79527c0d-2396-4825-8c9d-2d59ee5d9430 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:15.201404 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882bd76-a568-4008-a702-ca5457e761a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:15.202150 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882bd76-a568-4008-a702-ca5457e761a5 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:15.202378 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882bd76-a568-4008-a702-ca5457e761a5 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:15.202639 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882bd76-a568-4008-a702-ca5457e761a5 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:15.203407 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882bd76-a568-4008-a702-ca5457e761a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:15.203717 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882bd76-a568-4008-a702-ca5457e761a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:15.205105 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882bd76-a568-4008-a702-ca5457e761a5 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:15.219395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 282/569] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:15.219658 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 288/570] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:47:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:15.219658 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882bd76-a568-4008-a702-ca5457e761a5 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:15.222369 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9497f-bb19-4432-bff8-7633c60d06a2 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:15.329343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9497f-bb19-4432-bff8-7633c60d06a2 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:15.338521 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882bd76-a568-4008-a702-ca5457e761a5 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:15.366768 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b05427-38b5-413f-8861-34cb970d8bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:15.367611 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b05427-38b5-413f-8861-34cb970d8bdc None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:15.367869 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b05427-38b5-413f-8861-34cb970d8bdc None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:15.368150 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b05427-38b5-413f-8861-34cb970d8bdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:15.374910 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a670be-265c-4ab5-93b7-a0bad01bc2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:15.375875 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b05427-38b5-413f-8861-34cb970d8bdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:15.376069 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a670be-265c-4ab5-93b7-a0bad01bc2e6 None admin] REQUEST_METHOD: `PUT` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:15.376358 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a670be-265c-4ab5-93b7-a0bad01bc2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:15.376640 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a670be-265c-4ab5-93b7-a0bad01bc2e6 None admin] PATH_INFO: `/v3/projects/7860d281acf642d2a3950424901b9487/users/adf919c3ba31488694c724a803ca51eb/roles/a6f10c1ca57b4299bb809b5bcc8797f5` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:15.377342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b05427-38b5-413f-8861-34cb970d8bdc None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:15.392639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-e4b05427-38b5-413f-8861-34cb970d8bdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:15.392639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:15.392639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:15.392639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:15.392639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:15.392639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:15.392639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:15.392639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:15.392639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:15.392639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:15.392639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:15.392639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:15.392639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:15.392639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:15.392639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:15.400678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:15.400678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:15.400678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:15.400678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:15.400678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:15.400678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:15.400678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:15.400678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:15.400678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:15.400678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:15.400678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:15.400678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:15.400678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:15.400678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:15.400678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:15.400678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:15.400678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:15.402395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:15.402395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:15.402395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:15.402395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:15.402395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:15.402395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:15.402395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:15.402395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:15.403130 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a670be-265c-4ab5-93b7-a0bad01bc2e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7860d281acf642d2a3950424901b9487, user_id=adf919c3ba31488694c724a803ca51eb, role_id=a6f10c1ca57b4299bb809b5bcc8797f5)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:15.403319 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 283/571] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:15.403469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a670be-265c-4ab5-93b7-a0bad01bc2e6 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:15.403652 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b05427-38b5-413f-8861-34cb970d8bdc None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:15.411274 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 289/572] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:47:15 2022] PUT /identity/v3/projects/7860d281acf642d2a3950424901b9487/users/adf919c3ba31488694c724a803ca51eb/roles/a6f10c1ca57b4299bb809b5bcc8797f5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:47:15.412632 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb07e9-b698-433b-892b-e1f883354ac4 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:15.412914 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb07e9-b698-433b-892b-e1f883354ac4 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:15.413205 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb07e9-b698-433b-892b-e1f883354ac4 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:15.415125 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 290/573] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:15.415410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb07e9-b698-433b-892b-e1f883354ac4 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:15.540415 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b05427-38b5-413f-8861-34cb970d8bdc None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:15.550736 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb07e9-b698-433b-892b-e1f883354ac4 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:15.580530 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a2e1d-5133-4272-9763-d977b1d54c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:15.581262 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a2e1d-5133-4272-9763-d977b1d54c56 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:15.581580 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a2e1d-5133-4272-9763-d977b1d54c56 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:15.581866 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a2e1d-5133-4272-9763-d977b1d54c56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:15.592498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494a308-0d36-4fa6-a4ef-0e5829db6b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:15.593339 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494a308-0d36-4fa6-a4ef-0e5829db6b85 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:15.593658 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494a308-0d36-4fa6-a4ef-0e5829db6b85 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:15.593937 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494a308-0d36-4fa6-a4ef-0e5829db6b85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:15.595658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a2e1d-5133-4272-9763-d977b1d54c56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:15.597266 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a2e1d-5133-4272-9763-d977b1d54c56 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:15.606772 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494a308-0d36-4fa6-a4ef-0e5829db6b85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:15.615984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-0494a308-0d36-4fa6-a4ef-0e5829db6b85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:15.615984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:15.615984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:15.615984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:15.615984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:15.615984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:15.615984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:15.615984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:15.615984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:15.615984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:15.615984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:15.615984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:15.615984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:15.615984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:15.615984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:15.615984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:15.617189 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:15.617189 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:15.617189 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:15.617189 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:15.617189 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:15.617189 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:15.617189 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:15.617189 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:15.617189 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:15.617189 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:15.617189 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:15.617189 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:15.617189 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:15.617189 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:15.617189 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:15.617189 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:15.619570 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:15.619570 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:15.619570 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:15.619570 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:15.619570 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:15.619570 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:15.619570 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:15.619570 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:15.619570 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:15.619570 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:15.619570 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:15.619570 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:15.619570 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 291/574] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:47:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:15.619570 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494a308-0d36-4fa6-a4ef-0e5829db6b85 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:15.622863 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-722a2e1d-5133-4272-9763-d977b1d54c56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:15.622863 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:15.622863 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:15.622863 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:15.622863 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:15.622863 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:15.622863 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:15.622863 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:15.622863 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:15.622863 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:15.622863 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:15.622863 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:15.622863 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:15.622863 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:15.622863 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:15.625905 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:15.625905 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:15.625905 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:15.625905 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:15.625905 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:15.625905 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:15.625905 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:15.625905 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:15.625905 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:15.625905 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:15.625905 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:15.625905 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:15.625905 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:15.625905 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:15.625905 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:15.625905 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:15.625905 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:15.626910 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:15.626910 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:15.626910 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:15.626910 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:15.626910 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 284/575] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:15.626910 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da44e3-ef7f-493b-8eb7-d05f098c5751 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:15.626910 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da44e3-ef7f-493b-8eb7-d05f098c5751 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:15.626910 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da44e3-ef7f-493b-8eb7-d05f098c5751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:15.644867 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-71da44e3-ef7f-493b-8eb7-d05f098c5751 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:15.646200 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-71da44e3-ef7f-493b-8eb7-d05f098c5751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:15.722295 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 285/576] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:15.723681 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da44e3-ef7f-493b-8eb7-d05f098c5751 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:15.743422 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494a308-0d36-4fa6-a4ef-0e5829db6b85 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:15.779456 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220686c-031a-4181-8ba2-64eca77bcfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:15.780457 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220686c-031a-4181-8ba2-64eca77bcfad None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:15.780745 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220686c-031a-4181-8ba2-64eca77bcfad None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:15.781025 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220686c-031a-4181-8ba2-64eca77bcfad None admin] PATH_INFO: `/v3/projects` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:15.781880 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220686c-031a-4181-8ba2-64eca77bcfad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:15.782197 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220686c-031a-4181-8ba2-64eca77bcfad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:15.783661 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220686c-031a-4181-8ba2-64eca77bcfad None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:15.798017 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 292/577] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:15.798733 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220686c-031a-4181-8ba2-64eca77bcfad None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:15.834827 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da44e3-ef7f-493b-8eb7-d05f098c5751 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:15.869698 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54454854-7342-404a-b607-72b637aae21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:15.870400 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54454854-7342-404a-b607-72b637aae21b None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:15.870649 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54454854-7342-404a-b607-72b637aae21b None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:15.871607 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54454854-7342-404a-b607-72b637aae21b None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:15.871736 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54454854-7342-404a-b607-72b637aae21b None admin] RBAC: Adding query filter params (name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:15.871987 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54454854-7342-404a-b607-72b637aae21b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:15.873985 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54454854-7342-404a-b607-72b637aae21b None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:15.883071 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 286/578] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:47:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:15.889292 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54454854-7342-404a-b607-72b637aae21b None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:15.901684 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220686c-031a-4181-8ba2-64eca77bcfad None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:15.937876 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f2ef0-4a0c-4c31-8bcd-3686c75f5f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:15.938547 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f2ef0-4a0c-4c31-8bcd-3686c75f5f76 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:15.938916 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f2ef0-4a0c-4c31-8bcd-3686c75f5f76 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:15.939115 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f2ef0-4a0c-4c31-8bcd-3686c75f5f76 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:15.939822 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f2ef0-4a0c-4c31-8bcd-3686c75f5f76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:15.940152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f2ef0-4a0c-4c31-8bcd-3686c75f5f76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:15.941584 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f2ef0-4a0c-4c31-8bcd-3686c75f5f76 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:15.955189 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 293/579] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:15.955887 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f2ef0-4a0c-4c31-8bcd-3686c75f5f76 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:16.019584 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54454854-7342-404a-b607-72b637aae21b None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:16.058709 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f2ef0-4a0c-4c31-8bcd-3686c75f5f76 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:16.079117 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b555ef1-e1c2-4ede-96d2-d5c9f4bf6825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:16.080484 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b555ef1-e1c2-4ede-96d2-d5c9f4bf6825 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:16.080896 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b555ef1-e1c2-4ede-96d2-d5c9f4bf6825 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:16.081225 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b555ef1-e1c2-4ede-96d2-d5c9f4bf6825 None admin] PATH_INFO: `/v3/roles/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:16.095306 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b555ef1-e1c2-4ede-96d2-d5c9f4bf6825 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:16.099347 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b4c51-0a8e-4c96-b895-f14abfda7bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:16.100367 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b4c51-0a8e-4c96-b895-f14abfda7bed None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:16.100874 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b4c51-0a8e-4c96-b895-f14abfda7bed None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:16.101408 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b4c51-0a8e-4c96-b895-f14abfda7bed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:16.102652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b4c51-0a8e-4c96-b895-f14abfda7bed None admin] RBAC: Adding query filter params (role.id=a6f10c1ca57b4299bb809b5bcc8797f5, scope.project.id=7860d281acf642d2a3950424901b9487, user.id=95f73edea88646ab9b1e2f3b0fea34c0) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:16.103216 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b4c51-0a8e-4c96-b895-f14abfda7bed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:16.103449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-9b555ef1-e1c2-4ede-96d2-d5c9f4bf6825 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:16.103449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:16.103449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:16.103449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:16.103449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:16.103449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:16.103449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:16.103449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:16.103449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:16.103449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:16.103449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:16.103449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:16.103449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:16.103449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:16.103449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:16.103449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:16.104532 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:16.104532 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:16.104532 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:16.104532 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:16.104532 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:16.104532 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:16.104532 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:16.104532 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:16.104532 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:16.104532 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:16.104532 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:16.104532 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:16.104532 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:16.104532 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:16.104532 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:16.104532 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:16.105622 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:16.105622 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:16.105622 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:16.105622 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:16.105622 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:16.105622 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:16.105622 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:16.105622 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:16.105622 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:16.105622 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:16.105622 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:16.105622 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:16.105622 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 287/580] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:47:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:16.106528 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b555ef1-e1c2-4ede-96d2-d5c9f4bf6825 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:16.109838 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b4c51-0a8e-4c96-b895-f14abfda7bed None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:16.117584 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 294/581] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:47:15 2022] GET /identity/v3/role_assignments?user.id=95f73edea88646ab9b1e2f3b0fea34c0&scope.project.id=7860d281acf642d2a3950424901b9487&role.id=a6f10c1ca57b4299bb809b5bcc8797f5 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:16.118657 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b4c51-0a8e-4c96-b895-f14abfda7bed None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:16.233281 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b555ef1-e1c2-4ede-96d2-d5c9f4bf6825 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:16.241787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b4c51-0a8e-4c96-b895-f14abfda7bed None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:16.274052 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f64e52-a394-4eb0-8b75-bc318e422d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:16.275223 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f64e52-a394-4eb0-8b75-bc318e422d09 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:16.275713 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f64e52-a394-4eb0-8b75-bc318e422d09 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:16.276190 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f64e52-a394-4eb0-8b75-bc318e422d09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:16.285519 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708a759-4844-430c-91b7-87e41b75664f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:16.286504 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708a759-4844-430c-91b7-87e41b75664f None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:16.286894 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708a759-4844-430c-91b7-87e41b75664f None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:16.287277 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708a759-4844-430c-91b7-87e41b75664f None admin] PATH_INFO: `/v3/users/glance` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:16.290413 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f64e52-a394-4eb0-8b75-bc318e422d09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:16.291887 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f64e52-a394-4eb0-8b75-bc318e422d09 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:16.296642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a708a759-4844-430c-91b7-87e41b75664f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:16.298765 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a708a759-4844-430c-91b7-87e41b75664f None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:16.313307 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-d9f64e52-a394-4eb0-8b75-bc318e422d09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:16.313307 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:16.313307 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:16.313307 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:16.313307 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:16.313307 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:16.313307 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:16.313307 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:16.313307 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:16.313307 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:16.313307 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:16.313307 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:16.313307 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:16.313307 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:16.313307 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:16.314425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:16.314425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:16.314425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:16.314425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:16.314425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:16.314425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:16.314425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:16.314425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:16.314425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:16.314425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:16.314425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:16.314425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:16.314425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:16.314425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:16.314425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:16.314425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:16.314425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:16.315422 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:16.315422 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:16.315422 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:16.315422 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:16.315422 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 288/582] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:16.315422 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f64e52-a394-4eb0-8b75-bc318e422d09 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:16.318790 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-a708a759-4844-430c-91b7-87e41b75664f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 15:47:16.318790 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:16.318790 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:16.318790 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:16.318790 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:16.318790 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:16.318790 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:16.318790 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:16.318790 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:16.318790 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:16.318790 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:16.318790 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:16.318790 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:16.318790 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:16.318790 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:16.318790 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:16.319863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:16.319863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:16.319863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:16.319863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:16.319863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:16.319863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:16.319863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:16.319863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:16.319863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:16.319863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:16.319863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:16.319863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:16.319863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:16.319863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:16.319863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:16.319863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:16.319863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:16.319863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:16.320942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:16.320942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:16.320942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:16.320942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:16.320942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:16.320942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:16.320942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:16.320942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:16.320942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 15:47:16.320942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:16.323837 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 295/583] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:47:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:16.325011 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708a759-4844-430c-91b7-87e41b75664f None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:16.437628 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f64e52-a394-4eb0-8b75-bc318e422d09 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:16.438323 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708a759-4844-430c-91b7-87e41b75664f None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:16.474582 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961a97d-b473-4ba6-b453-9a7d1c43f984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:16.475249 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961a97d-b473-4ba6-b453-9a7d1c43f984 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:16.475534 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961a97d-b473-4ba6-b453-9a7d1c43f984 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:16.475809 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961a97d-b473-4ba6-b453-9a7d1c43f984 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:16.476544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961a97d-b473-4ba6-b453-9a7d1c43f984 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:16.476849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961a97d-b473-4ba6-b453-9a7d1c43f984 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:16.478245 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961a97d-b473-4ba6-b453-9a7d1c43f984 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:16.478718 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1d041-8e3a-4611-93c3-b00605512ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:16.479641 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1d041-8e3a-4611-93c3-b00605512ea4 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:16.480159 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1d041-8e3a-4611-93c3-b00605512ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:16.480657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1d041-8e3a-4611-93c3-b00605512ea4 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:16.482319 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1d041-8e3a-4611-93c3-b00605512ea4 None admin] RBAC: Adding query filter params (name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:16.483479 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1d041-8e3a-4611-93c3-b00605512ea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:16.485234 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1d041-8e3a-4611-93c3-b00605512ea4 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:16.491573 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 296/584] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:16.492261 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961a97d-b473-4ba6-b453-9a7d1c43f984 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:16.499406 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 289/585] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:47:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:16.499406 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1d041-8e3a-4611-93c3-b00605512ea4 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:16.608504 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961a97d-b473-4ba6-b453-9a7d1c43f984 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:16.610861 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1d041-8e3a-4611-93c3-b00605512ea4 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:16.646584 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfd475-a9d4-4d23-bc67-de81dcc42e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:16.647090 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfd475-a9d4-4d23-bc67-de81dcc42e57 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:16.647377 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfd475-a9d4-4d23-bc67-de81dcc42e57 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:16.647651 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfd475-a9d4-4d23-bc67-de81dcc42e57 None admin] PATH_INFO: `/v3/users` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:16.648502 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dfd475-a9d4-4d23-bc67-de81dcc42e57 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:16.648808 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dfd475-a9d4-4d23-bc67-de81dcc42e57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:16.650282 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dfd475-a9d4-4d23-bc67-de81dcc42e57 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:16.652873 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238008c-25ea-4945-a1ce-682206c91c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:16.654613 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238008c-25ea-4945-a1ce-682206c91c11 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:16.655066 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238008c-25ea-4945-a1ce-682206c91c11 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:16.655500 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238008c-25ea-4945-a1ce-682206c91c11 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:16.664350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238008c-25ea-4945-a1ce-682206c91c11 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:16.666135 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238008c-25ea-4945-a1ce-682206c91c11 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:16.675373 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 297/586] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 9 15:47:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:16.676362 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfd475-a9d4-4d23-bc67-de81dcc42e57 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:16.683409 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-b238008c-25ea-4945-a1ce-682206c91c11 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:47:16.683409 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:16.683409 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:16.683409 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:16.683409 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:16.683409 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:16.683409 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:16.683409 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:16.683409 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:16.683409 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:16.683409 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:16.683409 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:16.683409 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:16.683409 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:16.683409 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:16.683409 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:16.684775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:16.684775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:16.684775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:16.684775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:16.684775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:16.684775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:16.684775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:16.684775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:16.684775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:16.684775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:16.684775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:16.684775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:16.684775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:16.684775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:16.684775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:16.684775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:16.684775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:16.684775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:16.686436 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:16.686436 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:16.686436 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:16.686436 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:16.686436 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:16.686436 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:16.686436 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:16.686436 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:16.686436 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:47:16.686436 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:16.688827 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 290/587] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:47:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:16.689918 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238008c-25ea-4945-a1ce-682206c91c11 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:16.787317 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfd475-a9d4-4d23-bc67-de81dcc42e57 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:16.798972 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238008c-25ea-4945-a1ce-682206c91c11 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:16.823632 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44c245-ee68-4a64-ac32-48fd48778bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:16.824436 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44c245-ee68-4a64-ac32-48fd48778bb0 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:16.824716 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44c245-ee68-4a64-ac32-48fd48778bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:16.825059 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44c245-ee68-4a64-ac32-48fd48778bb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:16.836504 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44c245-ee68-4a64-ac32-48fd48778bb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:16.838006 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44c245-ee68-4a64-ac32-48fd48778bb0 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:16.838927 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b782382-7240-4db0-8bed-ee656b102e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:16.839938 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b782382-7240-4db0-8bed-ee656b102e0b None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:16.840378 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b782382-7240-4db0-8bed-ee656b102e0b None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:16.840806 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b782382-7240-4db0-8bed-ee656b102e0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:16.852899 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b782382-7240-4db0-8bed-ee656b102e0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:16.854627 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b782382-7240-4db0-8bed-ee656b102e0b None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:16.858126 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-be44c245-ee68-4a64-ac32-48fd48778bb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:16.858126 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:16.858126 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:16.858126 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:16.858126 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:16.858126 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:16.858126 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:16.858126 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:16.858126 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:16.858126 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:16.858126 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:16.858126 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:16.858126 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:16.858126 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:16.858126 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:16.859289 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:16.859289 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:16.859289 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:16.859289 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:16.859289 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:16.859289 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:16.859289 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:16.859289 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:16.859289 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:16.859289 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:16.859289 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:16.859289 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:16.859289 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:16.859289 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:16.859289 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:16.859289 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:16.859289 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:16.860436 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:16.860436 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:16.860436 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:16.860436 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:16.863783 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 298/588] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:16.864686 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44c245-ee68-4a64-ac32-48fd48778bb0 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:16.877830 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-2b782382-7240-4db0-8bed-ee656b102e0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:16.877830 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:16.877830 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:16.877830 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:16.877830 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:16.877830 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:16.877830 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:16.877830 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:16.877830 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:16.877830 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:16.877830 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:16.877830 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:16.877830 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:16.877830 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:16.877830 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:16.879407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:16.879407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:16.879407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:16.879407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:16.879407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:16.879407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:16.879407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:16.879407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:16.879407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:16.879407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:16.879407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:16.879407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:16.879407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:16.879407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:16.879407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:16.879407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:16.879407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:16.880525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:16.880525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:16.880525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:16.880525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:16.882406 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 291/589] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:16.883448 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b782382-7240-4db0-8bed-ee656b102e0b None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:16.972848 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44c245-ee68-4a64-ac32-48fd48778bb0 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:16.988038 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b782382-7240-4db0-8bed-ee656b102e0b None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:17.008046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e5686-2ae2-4c1c-992b-ea7101f17a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:17.008725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e5686-2ae2-4c1c-992b-ea7101f17a0b None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:17.009015 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e5686-2ae2-4c1c-992b-ea7101f17a0b None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:17.009288 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e5686-2ae2-4c1c-992b-ea7101f17a0b None admin] PATH_INFO: `/v3/users` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:17.010175 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e5686-2ae2-4c1c-992b-ea7101f17a0b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:17.010480 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e5686-2ae2-4c1c-992b-ea7101f17a0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:17.011917 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e5686-2ae2-4c1c-992b-ea7101f17a0b None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:17.026933 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c532e1-c873-4f75-bb56-5891831d688b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:17.027922 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c532e1-c873-4f75-bb56-5891831d688b None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:17.028376 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c532e1-c873-4f75-bb56-5891831d688b None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:17.029362 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c532e1-c873-4f75-bb56-5891831d688b None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:17.030732 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c532e1-c873-4f75-bb56-5891831d688b None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:17.031217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c532e1-c873-4f75-bb56-5891831d688b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:17.031881 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 299/590] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 9 15:47:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:17.033277 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e5686-2ae2-4c1c-992b-ea7101f17a0b None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:17.033450 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c532e1-c873-4f75-bb56-5891831d688b None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:17.049465 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 292/591] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:17.050600 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c532e1-c873-4f75-bb56-5891831d688b None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:17.157506 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c532e1-c873-4f75-bb56-5891831d688b None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:17.175166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e5686-2ae2-4c1c-992b-ea7101f17a0b None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:17.193736 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d8f9a-dd65-41c2-bf6a-0d12c83593f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:17.194842 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d8f9a-dd65-41c2-bf6a-0d12c83593f4 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:17.195296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d8f9a-dd65-41c2-bf6a-0d12c83593f4 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:17.195748 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d8f9a-dd65-41c2-bf6a-0d12c83593f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:17.207467 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d8f9a-dd65-41c2-bf6a-0d12c83593f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:17.209172 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d8f9a-dd65-41c2-bf6a-0d12c83593f4 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:17.212949 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a078f7-7306-4091-a322-8320d2e641e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:17.213666 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a078f7-7306-4091-a322-8320d2e641e2 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:17.213951 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a078f7-7306-4091-a322-8320d2e641e2 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:17.214225 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a078f7-7306-4091-a322-8320d2e641e2 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:17.214962 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a078f7-7306-4091-a322-8320d2e641e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:17.215268 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a078f7-7306-4091-a322-8320d2e641e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:17.216677 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a078f7-7306-4091-a322-8320d2e641e2 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:17.230161 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-2e1d8f9a-dd65-41c2-bf6a-0d12c83593f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:17.230161 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:17.230161 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:17.230161 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:17.230161 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:17.230161 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:17.230161 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:17.230161 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:17.230161 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:17.230161 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:17.230161 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:17.230161 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:17.230161 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:17.230161 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:17.230161 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:17.231343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:17.231343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:17.231343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:17.231343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:17.231343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:17.231343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:17.231343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:17.231343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:17.231343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:17.231343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:17.231343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:17.231343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:17.231343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:17.231343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:17.231343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:17.231343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:17.231343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:17.232468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:17.232468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:17.232468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:17.232468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:17.233150 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 300/592] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:17.234143 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a078f7-7306-4091-a322-8320d2e641e2 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:17.235112 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 293/593] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:17.236173 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d8f9a-dd65-41c2-bf6a-0d12c83593f4 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:17.337749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a078f7-7306-4091-a322-8320d2e641e2 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:17.342870 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d8f9a-dd65-41c2-bf6a-0d12c83593f4 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:17.374890 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b244ef-1235-4175-a642-867804332798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:17.376076 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b244ef-1235-4175-a642-867804332798 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:17.376414 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b244ef-1235-4175-a642-867804332798 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:17.376683 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b244ef-1235-4175-a642-867804332798 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:17.380744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405fb007-5094-447e-87cc-9896d4373b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:17.381890 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fb007-5094-447e-87cc-9896d4373b6f None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:17.382352 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fb007-5094-447e-87cc-9896d4373b6f None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:17.382792 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fb007-5094-447e-87cc-9896d4373b6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:17.386026 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b244ef-1235-4175-a642-867804332798 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:17.387451 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b244ef-1235-4175-a642-867804332798 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:17.391982 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405fb007-5094-447e-87cc-9896d4373b6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:17.393720 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405fb007-5094-447e-87cc-9896d4373b6f None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:17.408810 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-405fb007-5094-447e-87cc-9896d4373b6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:17.408810 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:17.408810 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:17.408810 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:17.408810 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:17.408810 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:17.408810 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:17.408810 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:17.408810 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:17.408810 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:17.408810 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:17.408810 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:17.408810 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:17.408810 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:17.408810 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:17.410066 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:17.410066 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:17.410066 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:17.410066 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:17.410066 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:17.410066 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:17.410066 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:17.410066 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:17.410066 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:17.410066 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:17.410066 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:17.410066 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:17.410066 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:17.410066 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:17.410066 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:17.410066 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:17.410066 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:17.411177 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:17.411177 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:17.411177 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:17.411177 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:17.411177 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:17.411177 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:17.411177 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:17.411177 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:17.412625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-95b244ef-1235-4175-a642-867804332798 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:47:17.412625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:17.412625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:17.412625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:17.412625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:17.412625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:17.412625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:17.412625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:17.412625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:17.412625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:17.412625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:17.412625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:17.412625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:17.412625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:17.412625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:17.412625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:17.413661 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:17.413661 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:17.413661 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:17.413661 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:17.413661 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:17.413661 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:17.413661 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:17.413661 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:17.413661 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:17.413661 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:17.413661 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:17.413661 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:17.413661 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:17.413661 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:17.413661 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:17.413661 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:17.413661 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:17.413661 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:17.414762 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:17.414762 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:17.414762 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:17.414762 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:17.414762 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:17.414762 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:17.414762 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:17.414762 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:17.414762 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:47:17.414762 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:17.416006 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 294/594] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:17.416959 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405fb007-5094-447e-87cc-9896d4373b6f None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:17.421865 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 301/595] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:47:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:17.430929 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b244ef-1235-4175-a642-867804332798 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:17.525246 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405fb007-5094-447e-87cc-9896d4373b6f None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:17.562246 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b257f-e7e8-4317-981b-fe2b32481087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:17.563224 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b257f-e7e8-4317-981b-fe2b32481087 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:17.563709 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b257f-e7e8-4317-981b-fe2b32481087 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:17.564209 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b257f-e7e8-4317-981b-fe2b32481087 None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:17.565139 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b257f-e7e8-4317-981b-fe2b32481087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:17.565650 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b257f-e7e8-4317-981b-fe2b32481087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:17.567223 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b257f-e7e8-4317-981b-fe2b32481087 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:17.581741 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 295/596] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:17.582914 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b257f-e7e8-4317-981b-fe2b32481087 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:17.615330 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b244ef-1235-4175-a642-867804332798 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:17.675941 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b36906-5785-440c-abee-c6a5434efc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:17.677090 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b36906-5785-440c-abee-c6a5434efc97 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:17.677649 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b36906-5785-440c-abee-c6a5434efc97 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:17.678179 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b36906-5785-440c-abee-c6a5434efc97 None admin] PATH_INFO: `/v3/projects` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:17.679986 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b36906-5785-440c-abee-c6a5434efc97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:17.680313 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b36906-5785-440c-abee-c6a5434efc97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:17.683340 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b36906-5785-440c-abee-c6a5434efc97 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:17.695231 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b257f-e7e8-4317-981b-fe2b32481087 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:17.712049 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 302/597] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:17.713055 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b36906-5785-440c-abee-c6a5434efc97 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:17.731593 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4748c6b-46aa-4e0a-930d-414cf785405c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:17.733285 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4748c6b-46aa-4e0a-930d-414cf785405c None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:17.733768 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4748c6b-46aa-4e0a-930d-414cf785405c None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:17.734202 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4748c6b-46aa-4e0a-930d-414cf785405c None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:17.735226 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4748c6b-46aa-4e0a-930d-414cf785405c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:17.735696 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4748c6b-46aa-4e0a-930d-414cf785405c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:17.737316 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4748c6b-46aa-4e0a-930d-414cf785405c None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:17.758245 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 296/598] 10.222.0.48 () {56 vars in 1139 bytes} [Mon May 9 15:47:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:17.759326 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4748c6b-46aa-4e0a-930d-414cf785405c None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:17.827912 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b36906-5785-440c-abee-c6a5434efc97 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:17.865833 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4748c6b-46aa-4e0a-930d-414cf785405c None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:17.878411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50128132-0191-4a1d-808c-f24807595071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:17.879516 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50128132-0191-4a1d-808c-f24807595071 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:17.879906 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50128132-0191-4a1d-808c-f24807595071 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:17.880169 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50128132-0191-4a1d-808c-f24807595071 None admin] PATH_INFO: `/v3/projects/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:17.887639 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50128132-0191-4a1d-808c-f24807595071 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:17.890487 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50128132-0191-4a1d-808c-f24807595071 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:17.904777 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-50128132-0191-4a1d-808c-f24807595071 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:17.904777 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:17.904777 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:17.904777 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:17.904777 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:17.904777 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:17.904777 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:17.904777 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:17.904777 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:17.904777 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:17.904777 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:17.904777 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:17.904777 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:17.904777 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:17.904777 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:17.906417 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:17.906417 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:17.906417 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:17.906417 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:17.906417 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:17.906417 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:17.906417 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:17.906417 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:17.906417 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:17.906417 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:17.906417 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:17.906417 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:17.906417 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:17.906417 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:17.906417 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:17.906417 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:17.906417 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:17.907761 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:17.907761 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:17.907761 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:17.907761 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:17.907761 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:17.907761 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:17.907761 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:17.907761 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:17.907761 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 303/599] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:17.907761 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50128132-0191-4a1d-808c-f24807595071 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:17.912386 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf4f78-3120-4402-b343-f9e1ffc01887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:17.913296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf4f78-3120-4402-b343-f9e1ffc01887 None admin] REQUEST_METHOD: `PUT` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:17.913626 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf4f78-3120-4402-b343-f9e1ffc01887 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:17.913900 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf4f78-3120-4402-b343-f9e1ffc01887 None admin] PATH_INFO: `/v3/projects/7860d281acf642d2a3950424901b9487/users/f24f3d53e78140b9bba6306aed2865ab/roles/a6f10c1ca57b4299bb809b5bcc8797f5` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:17.930719 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf4f78-3120-4402-b343-f9e1ffc01887 None admin] RBAC: Authorizing `identity:create_grant(project_id=7860d281acf642d2a3950424901b9487, user_id=f24f3d53e78140b9bba6306aed2865ab, role_id=a6f10c1ca57b4299bb809b5bcc8797f5)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:17.932159 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf4f78-3120-4402-b343-f9e1ffc01887 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:17.946950 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 297/600] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:47:17 2022] PUT /identity/v3/projects/7860d281acf642d2a3950424901b9487/users/f24f3d53e78140b9bba6306aed2865ab/roles/a6f10c1ca57b4299bb809b5bcc8797f5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:47:17.948828 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee06967-ff51-4435-8f01-48d486be9df8 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:17.949325 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee06967-ff51-4435-8f01-48d486be9df8 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:17.949822 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee06967-ff51-4435-8f01-48d486be9df8 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:17.956468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 298/601] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:17.956468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee06967-ff51-4435-8f01-48d486be9df8 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:18.053615 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50128132-0191-4a1d-808c-f24807595071 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:18.089944 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee06967-ff51-4435-8f01-48d486be9df8 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:18.112048 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116600a-f42c-405e-952d-25a0a0f28dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:18.112983 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116600a-f42c-405e-952d-25a0a0f28dd5 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:18.113307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116600a-f42c-405e-952d-25a0a0f28dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:18.113604 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116600a-f42c-405e-952d-25a0a0f28dd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:18.130674 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116600a-f42c-405e-952d-25a0a0f28dd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:18.132999 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116600a-f42c-405e-952d-25a0a0f28dd5 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:18.142351 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6d049-75a9-4e4d-b12c-862b1538a518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:18.143512 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6d049-75a9-4e4d-b12c-862b1538a518 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:18.144113 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6d049-75a9-4e4d-b12c-862b1538a518 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:18.144633 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6d049-75a9-4e4d-b12c-862b1538a518 None admin] PATH_INFO: `/v3/projects` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:18.145891 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6d049-75a9-4e4d-b12c-862b1538a518 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:18.146464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6d049-75a9-4e4d-b12c-862b1538a518 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:18.148396 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6d049-75a9-4e4d-b12c-862b1538a518 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:18.155838 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-0116600a-f42c-405e-952d-25a0a0f28dd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:18.155838 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:18.155838 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:18.155838 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:18.155838 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:18.155838 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:18.155838 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:18.155838 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:18.155838 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:18.155838 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:18.155838 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:18.155838 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:18.155838 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:18.155838 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:18.155838 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:18.156918 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:18.156918 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:18.156918 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:18.156918 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:18.156918 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:18.156918 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:18.156918 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:18.156918 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:18.156918 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:18.156918 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:18.156918 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:18.156918 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:18.156918 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:18.156918 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:18.156918 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:18.156918 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:18.156918 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:18.159132 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:18.159132 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:18.159132 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:18.159132 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:18.159132 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 304/602] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:18.159132 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759cc95-2bc5-41f3-b769-38f4bc825da0 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:18.159606 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759cc95-2bc5-41f3-b769-38f4bc825da0 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:18.159606 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759cc95-2bc5-41f3-b769-38f4bc825da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:18.173541 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 299/603] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:18.175030 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6d049-75a9-4e4d-b12c-862b1538a518 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:18.182667 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-3759cc95-2bc5-41f3-b769-38f4bc825da0 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:18.184882 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-3759cc95-2bc5-41f3-b769-38f4bc825da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:18.281039 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 305/604] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:18.281844 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759cc95-2bc5-41f3-b769-38f4bc825da0 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:18.318624 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6d049-75a9-4e4d-b12c-862b1538a518 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:18.355129 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd28e65-c8eb-4844-9dce-290d13ba9d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:18.355720 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd28e65-c8eb-4844-9dce-290d13ba9d26 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:18.356023 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd28e65-c8eb-4844-9dce-290d13ba9d26 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:18.356294 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd28e65-c8eb-4844-9dce-290d13ba9d26 None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:18.357636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd28e65-c8eb-4844-9dce-290d13ba9d26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:18.357953 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd28e65-c8eb-4844-9dce-290d13ba9d26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:18.359335 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd28e65-c8eb-4844-9dce-290d13ba9d26 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:18.372946 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 300/605] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:18.373776 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd28e65-c8eb-4844-9dce-290d13ba9d26 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:18.429466 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759cc95-2bc5-41f3-b769-38f4bc825da0 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:18.482592 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144dba8-fb06-4779-a3a8-212ae64b689a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:18.483207 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd28e65-c8eb-4844-9dce-290d13ba9d26 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:18.484198 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144dba8-fb06-4779-a3a8-212ae64b689a None admin] REQUEST_METHOD: `PUT` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:18.484740 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144dba8-fb06-4779-a3a8-212ae64b689a None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:18.485515 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144dba8-fb06-4779-a3a8-212ae64b689a None admin] PATH_INFO: `/v3/projects/7860d281acf642d2a3950424901b9487/users/8f0df0a8cb634b8cbd133e68127c30a3/roles/a6f10c1ca57b4299bb809b5bcc8797f5` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:18.507361 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144dba8-fb06-4779-a3a8-212ae64b689a None admin] RBAC: Authorizing `identity:create_grant(project_id=7860d281acf642d2a3950424901b9487, user_id=8f0df0a8cb634b8cbd133e68127c30a3, role_id=a6f10c1ca57b4299bb809b5bcc8797f5)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:18.509805 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144dba8-fb06-4779-a3a8-212ae64b689a None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:18.523829 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960d329-7d6f-4364-9e75-0fc76d4693b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:18.524763 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960d329-7d6f-4364-9e75-0fc76d4693b4 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:18.525057 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960d329-7d6f-4364-9e75-0fc76d4693b4 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:18.525410 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960d329-7d6f-4364-9e75-0fc76d4693b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:18.537610 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 306/606] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:47:18 2022] PUT /identity/v3/projects/7860d281acf642d2a3950424901b9487/users/8f0df0a8cb634b8cbd133e68127c30a3/roles/a6f10c1ca57b4299bb809b5bcc8797f5 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:47:18.539001 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144dba8-fb06-4779-a3a8-212ae64b689a None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:18.550604 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960d329-7d6f-4364-9e75-0fc76d4693b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:18.568147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-1960d329-7d6f-4364-9e75-0fc76d4693b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:18.568147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:18.568147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:18.568147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:18.568147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:18.568147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:18.568147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:18.568147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:18.568147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:18.568147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:18.568147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:18.568147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:18.568147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:18.568147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:18.568147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:18.568147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:18.569298 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:18.569298 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:18.569298 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:18.569298 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:18.569298 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:18.569298 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:18.569298 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:18.569298 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:18.569298 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:18.569298 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:18.569298 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:18.569298 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:18.569298 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:18.569298 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:18.569298 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:18.569298 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:18.570319 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:18.570319 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:18.570319 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:18.570319 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:18.570319 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:18.570319 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:18.570319 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:18.570319 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:18.570319 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:18.570319 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:18.570319 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:18.570319 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:18.572563 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 301/607] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:47:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:18.579601 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960d329-7d6f-4364-9e75-0fc76d4693b4 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:18.677862 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144dba8-fb06-4779-a3a8-212ae64b689a None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:18.715687 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1dcba-46f7-4a3e-8ded-efc9121489fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:18.717038 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1dcba-46f7-4a3e-8ded-efc9121489fd None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:18.717327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1dcba-46f7-4a3e-8ded-efc9121489fd None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:18.717639 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1dcba-46f7-4a3e-8ded-efc9121489fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:18.725252 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1dcba-46f7-4a3e-8ded-efc9121489fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:18.726759 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1dcba-46f7-4a3e-8ded-efc9121489fd None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:18.727892 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960d329-7d6f-4364-9e75-0fc76d4693b4 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:18.741518 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-28d1dcba-46f7-4a3e-8ded-efc9121489fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:18.741518 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:18.741518 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:18.741518 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:18.741518 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:18.741518 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:18.741518 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:18.741518 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:18.741518 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:18.741518 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:18.741518 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:18.741518 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:18.741518 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:18.741518 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:18.741518 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:18.742798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:18.742798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:18.742798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:18.742798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:18.742798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:18.742798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:18.742798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:18.742798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:18.742798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:18.742798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:18.742798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:18.742798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:18.742798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:18.742798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:18.742798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:18.742798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:18.742798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:18.744069 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:18.744069 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:18.744069 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:18.744069 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:18.744069 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:18.744069 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:18.744069 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:18.744069 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:18.744069 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 307/608] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:18.744731 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d269d-a3fb-46a1-8a47-417ddad2ffd4 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:18.744731 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d269d-a3fb-46a1-8a47-417ddad2ffd4 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:18.746518 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d269d-a3fb-46a1-8a47-417ddad2ffd4 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:18.746518 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 308/609] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:18.753103 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e1e52-55ea-4440-9e59-cb9039570272 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:18.753442 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e1e52-55ea-4440-9e59-cb9039570272 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:18.753708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e1e52-55ea-4440-9e59-cb9039570272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:18.771937 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-900e1e52-55ea-4440-9e59-cb9039570272 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:18.773262 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-900e1e52-55ea-4440-9e59-cb9039570272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:18.774080 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52872238-d4fc-402e-a06a-07eed98f2f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:18.774895 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52872238-d4fc-402e-a06a-07eed98f2f38 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:18.775257 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52872238-d4fc-402e-a06a-07eed98f2f38 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:18.775612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52872238-d4fc-402e-a06a-07eed98f2f38 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:18.776468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52872238-d4fc-402e-a06a-07eed98f2f38 None admin] RBAC: Adding query filter params (name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:18.776876 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52872238-d4fc-402e-a06a-07eed98f2f38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:18.778393 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52872238-d4fc-402e-a06a-07eed98f2f38 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:18.788496 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 302/610] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:47:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:18.789630 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52872238-d4fc-402e-a06a-07eed98f2f38 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:18.852709 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 309/611] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:18.854261 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e1e52-55ea-4440-9e59-cb9039570272 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:18.915480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52872238-d4fc-402e-a06a-07eed98f2f38 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:18.960660 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ce6fa-209b-4a74-bbb4-999899740f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:18.961734 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ce6fa-209b-4a74-bbb4-999899740f4c None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:18.962024 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ce6fa-209b-4a74-bbb4-999899740f4c None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:18.962589 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ce6fa-209b-4a74-bbb4-999899740f4c None admin] PATH_INFO: `/v3/projects` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:18.963555 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ce6fa-209b-4a74-bbb4-999899740f4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:18.963872 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ce6fa-209b-4a74-bbb4-999899740f4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:18.966261 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ce6fa-209b-4a74-bbb4-999899740f4c None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:18.969994 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e1e52-55ea-4440-9e59-cb9039570272 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:18.983289 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 303/612] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:18.984163 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ce6fa-209b-4a74-bbb4-999899740f4c None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:19.015751 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be079da3-6812-466c-a031-c12827cd01b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:19.016894 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be079da3-6812-466c-a031-c12827cd01b8 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:19.017324 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be079da3-6812-466c-a031-c12827cd01b8 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:19.017745 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be079da3-6812-466c-a031-c12827cd01b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:19.030224 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be079da3-6812-466c-a031-c12827cd01b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:19.031972 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be079da3-6812-466c-a031-c12827cd01b8 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:19.054342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-be079da3-6812-466c-a031-c12827cd01b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:19.054342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:19.054342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:19.054342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:19.054342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:19.054342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:19.054342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:19.054342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:19.054342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:19.054342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:19.054342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:19.054342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:19.054342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:19.054342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:19.054342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:19.056465 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:19.056465 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:19.056465 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:19.056465 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:19.056465 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:19.056465 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:19.056465 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:19.056465 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:19.056465 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:19.056465 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:19.056465 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:19.056465 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:19.056465 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:19.056465 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:19.056465 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:19.056465 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:19.056465 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:19.058849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:19.058849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:19.058849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:19.058849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:19.058849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 310/613] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:19.058849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be079da3-6812-466c-a031-c12827cd01b8 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:19.106143 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ce6fa-209b-4a74-bbb4-999899740f4c None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:19.150966 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c237d-250e-408d-b7d2-9defff25a99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:19.151777 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c237d-250e-408d-b7d2-9defff25a99d None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:19.152062 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c237d-250e-408d-b7d2-9defff25a99d None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:19.152338 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c237d-250e-408d-b7d2-9defff25a99d None admin] PATH_INFO: `/v3/roles/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:19.163210 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c237d-250e-408d-b7d2-9defff25a99d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:19.171538 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-706c237d-250e-408d-b7d2-9defff25a99d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:19.171538 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:19.171538 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:19.171538 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:19.171538 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:19.171538 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:19.171538 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:19.171538 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:19.171538 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:19.171538 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:19.171538 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:19.171538 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:19.171538 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:19.171538 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:19.171538 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:19.171538 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:19.173937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:19.173937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:19.173937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:19.173937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:19.173937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:19.173937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:19.173937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:19.173937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:19.173937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:19.173937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:19.173937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:19.173937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:19.173937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:19.173937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:19.173937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:19.173937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:19.176205 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:19.176205 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:19.176205 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:19.176205 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:19.176205 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:19.176205 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:19.176205 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:19.176205 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:19.176205 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:19.176205 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:19.176205 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:19.176205 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:19.186467 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be079da3-6812-466c-a031-c12827cd01b8 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:19.186629 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 304/614] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:47:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:19.186629 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c237d-250e-408d-b7d2-9defff25a99d None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:19.219867 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558f253-a827-4ed7-842f-6904ac755715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:19.220914 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558f253-a827-4ed7-842f-6904ac755715 None admin] REQUEST_METHOD: `PUT` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:19.221303 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558f253-a827-4ed7-842f-6904ac755715 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:19.222672 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558f253-a827-4ed7-842f-6904ac755715 None admin] PATH_INFO: `/v3/projects/7860d281acf642d2a3950424901b9487/users/cc0eb4f69ab6423eae5e8b33fbc06563/roles/a6f10c1ca57b4299bb809b5bcc8797f5` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:19.244437 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558f253-a827-4ed7-842f-6904ac755715 None admin] RBAC: Authorizing `identity:create_grant(project_id=7860d281acf642d2a3950424901b9487, user_id=cc0eb4f69ab6423eae5e8b33fbc06563, role_id=a6f10c1ca57b4299bb809b5bcc8797f5)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:19.246401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558f253-a827-4ed7-842f-6904ac755715 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:19.265198 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 311/615] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:47:19 2022] PUT /identity/v3/projects/7860d281acf642d2a3950424901b9487/users/cc0eb4f69ab6423eae5e8b33fbc06563/roles/a6f10c1ca57b4299bb809b5bcc8797f5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:47:19.266415 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558f253-a827-4ed7-842f-6904ac755715 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:19.291943 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c237d-250e-408d-b7d2-9defff25a99d None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:19.331915 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae87ed-081f-4397-919b-cea237ae25e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:19.332639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae87ed-081f-4397-919b-cea237ae25e1 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:19.332922 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae87ed-081f-4397-919b-cea237ae25e1 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:19.333248 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae87ed-081f-4397-919b-cea237ae25e1 None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:19.334093 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae87ed-081f-4397-919b-cea237ae25e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:19.334407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae87ed-081f-4397-919b-cea237ae25e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:19.335826 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae87ed-081f-4397-919b-cea237ae25e1 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:19.348750 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 305/616] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:19.355615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae87ed-081f-4397-919b-cea237ae25e1 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:19.401317 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558f253-a827-4ed7-842f-6904ac755715 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:19.444977 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e5dd4-aedd-42ae-94d7-73a51847abb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:19.445847 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e5dd4-aedd-42ae-94d7-73a51847abb7 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:19.446139 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e5dd4-aedd-42ae-94d7-73a51847abb7 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:19.446424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e5dd4-aedd-42ae-94d7-73a51847abb7 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:19.447522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e5dd4-aedd-42ae-94d7-73a51847abb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:19.448118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e5dd4-aedd-42ae-94d7-73a51847abb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:19.451345 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e5dd4-aedd-42ae-94d7-73a51847abb7 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:19.462597 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 312/617] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:47:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:19.470272 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e5dd4-aedd-42ae-94d7-73a51847abb7 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:19.553118 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae87ed-081f-4397-919b-cea237ae25e1 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:19.603882 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5728b1-77c1-4dd0-bece-bbd7b614fbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:19.604696 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5728b1-77c1-4dd0-bece-bbd7b614fbb6 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:19.604980 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5728b1-77c1-4dd0-bece-bbd7b614fbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:19.605252 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5728b1-77c1-4dd0-bece-bbd7b614fbb6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:19.614784 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5728b1-77c1-4dd0-bece-bbd7b614fbb6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:19.616410 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5728b1-77c1-4dd0-bece-bbd7b614fbb6 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:19.624035 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e5dd4-aedd-42ae-94d7-73a51847abb7 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:19.643906 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-ab5728b1-77c1-4dd0-bece-bbd7b614fbb6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:47:19.643906 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:19.643906 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:19.643906 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:19.643906 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:19.643906 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:19.643906 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:19.643906 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:19.643906 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:19.643906 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:19.643906 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:19.643906 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:19.643906 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:19.643906 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:19.643906 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:19.643906 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:19.644990 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:19.644990 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:19.644990 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:19.644990 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:19.644990 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:19.644990 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:19.644990 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:19.644990 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:19.644990 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:19.644990 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:19.644990 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:19.644990 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:19.644990 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:19.644990 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:19.644990 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:19.644990 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:19.644990 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:19.644990 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:19.646681 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:19.646681 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:19.646681 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:19.646681 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:19.646681 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:19.646681 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:19.646681 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:19.646681 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:19.646681 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:47:19.646681 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:19.646681 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 306/618] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:47:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:19.653394 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5728b1-77c1-4dd0-bece-bbd7b614fbb6 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:19.726212 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19714360-510d-4ffc-ae31-13bcadbe45f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:19.727406 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19714360-510d-4ffc-ae31-13bcadbe45f5 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:19.727924 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19714360-510d-4ffc-ae31-13bcadbe45f5 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:19.728410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19714360-510d-4ffc-ae31-13bcadbe45f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:19.750800 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19714360-510d-4ffc-ae31-13bcadbe45f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:19.752638 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19714360-510d-4ffc-ae31-13bcadbe45f5 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:19.769526 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5728b1-77c1-4dd0-bece-bbd7b614fbb6 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:19.778280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-19714360-510d-4ffc-ae31-13bcadbe45f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:19.778280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:19.778280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:19.778280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:19.778280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:19.778280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:19.778280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:19.778280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:19.778280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:19.778280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:19.778280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:19.778280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:19.778280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:19.778280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:19.778280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:19.779835 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:19.779835 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:19.779835 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:19.779835 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:19.779835 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:19.779835 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:19.779835 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:19.779835 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:19.779835 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:19.779835 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:19.779835 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:19.779835 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:19.779835 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:19.779835 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:19.779835 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:19.779835 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:19.779835 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:19.780822 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:19.780822 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:19.780822 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:19.780822 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:19.783166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 313/619] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:47:19.790653 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19714360-510d-4ffc-ae31-13bcadbe45f5 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:19.854757 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5b8f4-0f38-4eef-b4e3-b2531be2928c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:19.855502 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5b8f4-0f38-4eef-b4e3-b2531be2928c None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:19.855788 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5b8f4-0f38-4eef-b4e3-b2531be2928c None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:19.856067 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5b8f4-0f38-4eef-b4e3-b2531be2928c None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:19.857786 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5b8f4-0f38-4eef-b4e3-b2531be2928c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:19.858107 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5b8f4-0f38-4eef-b4e3-b2531be2928c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:19.859538 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5b8f4-0f38-4eef-b4e3-b2531be2928c None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:19.900014 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 307/620] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:47:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:47:19.905629 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5b8f4-0f38-4eef-b4e3-b2531be2928c None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:19.908584 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19714360-510d-4ffc-ae31-13bcadbe45f5 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:19.959534 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3de19-bc5d-4f4f-8fb7-0bb70787bada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:19.960596 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3de19-bc5d-4f4f-8fb7-0bb70787bada None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:19.961102 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3de19-bc5d-4f4f-8fb7-0bb70787bada None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:19.961644 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3de19-bc5d-4f4f-8fb7-0bb70787bada None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:19.962595 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3de19-bc5d-4f4f-8fb7-0bb70787bada None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:19.963129 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3de19-bc5d-4f4f-8fb7-0bb70787bada None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:19.964711 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3de19-bc5d-4f4f-8fb7-0bb70787bada None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:19.977780 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 314/621] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:19.990454 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3de19-bc5d-4f4f-8fb7-0bb70787bada None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:20.051467 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5b8f4-0f38-4eef-b4e3-b2531be2928c None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:20.110242 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e5494-1836-4d1d-9bd1-44ecf37e5a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:20.111069 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e5494-1836-4d1d-9bd1-44ecf37e5a24 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:20.111356 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e5494-1836-4d1d-9bd1-44ecf37e5a24 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:20.111713 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e5494-1836-4d1d-9bd1-44ecf37e5a24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:20.163096 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3de19-bc5d-4f4f-8fb7-0bb70787bada None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:20.219760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34985352-22d0-4bff-a0e7-bfd4bc30b38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:20.220593 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34985352-22d0-4bff-a0e7-bfd4bc30b38e None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:20.220880 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34985352-22d0-4bff-a0e7-bfd4bc30b38e None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:20.221161 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34985352-22d0-4bff-a0e7-bfd4bc30b38e None admin] PATH_INFO: `/v3/users/swift` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:20.239661 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34985352-22d0-4bff-a0e7-bfd4bc30b38e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:20.241069 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34985352-22d0-4bff-a0e7-bfd4bc30b38e None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:20.267725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-34985352-22d0-4bff-a0e7-bfd4bc30b38e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:47:20.267725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:20.267725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:20.267725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:20.267725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:20.267725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:20.267725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:20.267725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:20.267725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:20.267725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:20.267725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:20.267725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:20.267725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:20.267725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:20.267725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:20.267725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:20.268829 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:20.268829 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:20.268829 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:20.268829 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:20.268829 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:20.268829 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:20.268829 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:20.268829 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:20.268829 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:20.268829 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:20.268829 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:20.268829 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:20.268829 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:20.268829 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:20.268829 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:20.268829 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:20.268829 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:20.268829 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:20.269921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:20.269921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:20.269921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:20.269921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:20.269921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:20.269921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:20.269921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:20.269921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:20.269921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:47:20.269921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:20.271034 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e5494-1836-4d1d-9bd1-44ecf37e5a24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:20.273289 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e5494-1836-4d1d-9bd1-44ecf37e5a24 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:20.285864 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 315/622] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:47:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:20.286883 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34985352-22d0-4bff-a0e7-bfd4bc30b38e None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:20.509248 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34985352-22d0-4bff-a0e7-bfd4bc30b38e None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:20.552445 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 308/623] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:47:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:47:20.562127 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e5494-1836-4d1d-9bd1-44ecf37e5a24 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:20.582392 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75422f4b-345d-4850-a6a3-c8fb86253fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:20.583083 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75422f4b-345d-4850-a6a3-c8fb86253fd1 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:20.583365 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75422f4b-345d-4850-a6a3-c8fb86253fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:20.583640 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75422f4b-345d-4850-a6a3-c8fb86253fd1 None admin] PATH_INFO: `/v3/users` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:20.584501 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75422f4b-345d-4850-a6a3-c8fb86253fd1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:20.584810 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75422f4b-345d-4850-a6a3-c8fb86253fd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:20.586284 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75422f4b-345d-4850-a6a3-c8fb86253fd1 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:20.619467 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 316/624] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 9 15:47:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:20.628123 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75422f4b-345d-4850-a6a3-c8fb86253fd1 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:20.741004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e5494-1836-4d1d-9bd1-44ecf37e5a24 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:20.756913 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75422f4b-345d-4850-a6a3-c8fb86253fd1 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:20.784443 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e96af-4ab4-4728-89d0-01bec1cb012a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:20.785507 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e96af-4ab4-4728-89d0-01bec1cb012a None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:20.785793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e96af-4ab4-4728-89d0-01bec1cb012a None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:20.786067 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e96af-4ab4-4728-89d0-01bec1cb012a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:20.798113 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8111e8-9934-48bf-a211-2f61246f2b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:20.798933 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8111e8-9934-48bf-a211-2f61246f2b3a None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:20.799125 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e96af-4ab4-4728-89d0-01bec1cb012a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:20.799256 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8111e8-9934-48bf-a211-2f61246f2b3a None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:20.799473 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8111e8-9934-48bf-a211-2f61246f2b3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:20.800557 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e96af-4ab4-4728-89d0-01bec1cb012a None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:20.811111 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8111e8-9934-48bf-a211-2f61246f2b3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:20.812627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8111e8-9934-48bf-a211-2f61246f2b3a None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:20.820744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-9e7e96af-4ab4-4728-89d0-01bec1cb012a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:20.820744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:20.820744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:20.820744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:20.820744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:20.820744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:20.820744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:20.820744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:20.820744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:20.820744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:20.820744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:20.820744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:20.820744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:20.820744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:20.820744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:20.821848 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:20.821848 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:20.821848 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:20.821848 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:20.821848 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:20.821848 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:20.821848 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:20.821848 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:20.821848 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:20.821848 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:20.821848 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:20.821848 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:20.821848 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:20.821848 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:20.821848 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:20.821848 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:20.821848 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:20.823278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:20.823278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:20.823278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:20.823278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:20.823278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 309/625] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:20.823874 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e948d-41e3-4676-895d-76d8c67229a1 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:20.824058 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e948d-41e3-4676-895d-76d8c67229a1 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:20.824211 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e948d-41e3-4676-895d-76d8c67229a1 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:20.830686 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 310/626] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:20.831641 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e948d-41e3-4676-895d-76d8c67229a1 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:20.839269 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-7e8111e8-9934-48bf-a211-2f61246f2b3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:20.839269 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:20.839269 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:20.839269 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:20.839269 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:20.839269 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:20.839269 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:20.839269 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:20.839269 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:20.839269 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:20.839269 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:20.839269 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:20.839269 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:20.839269 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:20.839269 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:20.842772 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:20.842772 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:20.842772 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:20.842772 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:20.842772 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:20.842772 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:20.842772 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:20.842772 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:20.842772 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:20.842772 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:20.842772 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:20.842772 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:20.842772 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:20.842772 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:20.842772 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:20.842772 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:20.842772 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:20.845134 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:20.845134 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:20.845134 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:20.845134 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:20.853435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 317/627] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:20.853435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8227d-d57b-4162-95f1-e5ce3a34595a None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:20.853435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8227d-d57b-4162-95f1-e5ce3a34595a None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:20.853435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8227d-d57b-4162-95f1-e5ce3a34595a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:20.870962 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-31e8227d-d57b-4162-95f1-e5ce3a34595a None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:20.872757 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-31e8227d-d57b-4162-95f1-e5ce3a34595a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:20.943175 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 318/628] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:20.944078 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8227d-d57b-4162-95f1-e5ce3a34595a None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:20.964001 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e948d-41e3-4676-895d-76d8c67229a1 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:21.012669 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811db61f-aec0-497c-8cd4-c3e7fedcf280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:21.014574 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811db61f-aec0-497c-8cd4-c3e7fedcf280 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:21.014867 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811db61f-aec0-497c-8cd4-c3e7fedcf280 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:21.015145 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811db61f-aec0-497c-8cd4-c3e7fedcf280 None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:21.015891 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811db61f-aec0-497c-8cd4-c3e7fedcf280 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:21.016198 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811db61f-aec0-497c-8cd4-c3e7fedcf280 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:21.018118 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811db61f-aec0-497c-8cd4-c3e7fedcf280 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:21.034217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 311/629] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:21.035368 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811db61f-aec0-497c-8cd4-c3e7fedcf280 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:21.074202 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8227d-d57b-4162-95f1-e5ce3a34595a None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:21.121858 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e425b-8e22-4345-acb5-649810ceb678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:21.127099 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e425b-8e22-4345-acb5-649810ceb678 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:21.127415 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e425b-8e22-4345-acb5-649810ceb678 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:21.127639 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e425b-8e22-4345-acb5-649810ceb678 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:21.128415 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e425b-8e22-4345-acb5-649810ceb678 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:21.128776 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e425b-8e22-4345-acb5-649810ceb678 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:21.130216 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e425b-8e22-4345-acb5-649810ceb678 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:21.148208 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 319/630] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:21.149307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e425b-8e22-4345-acb5-649810ceb678 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:21.178992 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811db61f-aec0-497c-8cd4-c3e7fedcf280 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:21.219212 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e9861-d428-4360-bbdf-3fdf21de8e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:21.220036 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e9861-d428-4360-bbdf-3fdf21de8e64 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:21.220313 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e9861-d428-4360-bbdf-3fdf21de8e64 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:21.220567 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e9861-d428-4360-bbdf-3fdf21de8e64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:21.231652 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e9861-d428-4360-bbdf-3fdf21de8e64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:21.239379 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-e20e9861-d428-4360-bbdf-3fdf21de8e64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:21.239379 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:21.239379 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:21.239379 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:21.239379 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:21.239379 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:21.239379 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:21.239379 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:21.239379 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:21.239379 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:21.239379 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:21.239379 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:21.239379 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:21.239379 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:21.239379 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:21.239379 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:21.243206 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:21.243206 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:21.243206 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:21.243206 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:21.243206 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:21.243206 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:21.243206 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:21.243206 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:21.243206 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:21.243206 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:21.243206 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:21.243206 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:21.243206 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:21.243206 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:21.243206 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:21.243206 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:21.246697 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:21.246697 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:21.246697 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:21.246697 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:21.246697 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:21.246697 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:21.246697 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:21.246697 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:21.246697 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:21.246697 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:21.246697 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:21.246697 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:21.246697 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 312/631] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:47:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:21.246697 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e9861-d428-4360-bbdf-3fdf21de8e64 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:21.266144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e425b-8e22-4345-acb5-649810ceb678 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:21.302310 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993aa42-79b6-4513-89ae-81dd2f885b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:21.303054 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993aa42-79b6-4513-89ae-81dd2f885b9e None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:21.303341 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993aa42-79b6-4513-89ae-81dd2f885b9e None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:21.303590 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993aa42-79b6-4513-89ae-81dd2f885b9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:21.311174 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9993aa42-79b6-4513-89ae-81dd2f885b9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:21.312776 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9993aa42-79b6-4513-89ae-81dd2f885b9e None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:21.328998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-9993aa42-79b6-4513-89ae-81dd2f885b9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:21.328998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:21.328998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:21.328998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:21.328998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:21.328998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:21.328998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:21.328998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:21.328998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:21.328998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:21.328998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:21.328998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:21.328998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:21.328998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:21.328998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:21.332744 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:21.332744 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:21.332744 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:21.332744 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:21.332744 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:21.332744 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:21.332744 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:21.332744 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:21.332744 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:21.332744 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:21.332744 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:21.332744 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:21.332744 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:21.332744 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:21.332744 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:21.332744 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:21.332744 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:21.336478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:21.336478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:21.336478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:21.336478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:21.336478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:21.336478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:21.336478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:21.336478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:21.336478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 320/632] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:21.336478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993aa42-79b6-4513-89ae-81dd2f885b9e None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:21.352841 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e9861-d428-4360-bbdf-3fdf21de8e64 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:21.389294 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15514bd4-ff72-407b-8616-976e19ff21ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:21.390322 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15514bd4-ff72-407b-8616-976e19ff21ba None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:21.390596 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15514bd4-ff72-407b-8616-976e19ff21ba None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:21.391186 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15514bd4-ff72-407b-8616-976e19ff21ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:21.400604 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15514bd4-ff72-407b-8616-976e19ff21ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:21.402545 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15514bd4-ff72-407b-8616-976e19ff21ba None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:21.423313 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-15514bd4-ff72-407b-8616-976e19ff21ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:21.423313 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:21.423313 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:21.423313 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:21.423313 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:21.423313 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:21.423313 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:21.423313 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:21.423313 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:21.423313 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:21.423313 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:21.423313 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:21.423313 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:21.423313 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:21.423313 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:21.425965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:21.425965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:21.425965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:21.425965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:21.425965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:21.425965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:21.425965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:21.425965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:21.425965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:21.425965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:21.425965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:21.425965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:21.425965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:21.425965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:21.425965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:21.425965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:21.425965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:21.428060 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:21.428060 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:21.428060 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:21.428060 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:21.428060 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:21.428060 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:21.428060 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:21.428060 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:21.428060 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 313/633] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:21.428060 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15514bd4-ff72-407b-8616-976e19ff21ba None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:21.449610 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993aa42-79b6-4513-89ae-81dd2f885b9e None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:21.497918 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99223f0-f44a-4976-b8bb-4dfe6f4b9daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:21.498755 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99223f0-f44a-4976-b8bb-4dfe6f4b9daf None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:21.499375 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99223f0-f44a-4976-b8bb-4dfe6f4b9daf None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:21.499662 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99223f0-f44a-4976-b8bb-4dfe6f4b9daf None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:21.500964 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99223f0-f44a-4976-b8bb-4dfe6f4b9daf None admin] RBAC: Adding query filter params (name=service) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:21.501276 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99223f0-f44a-4976-b8bb-4dfe6f4b9daf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:21.502706 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99223f0-f44a-4976-b8bb-4dfe6f4b9daf None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:21.514594 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 321/634] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:47:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:21.514594 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99223f0-f44a-4976-b8bb-4dfe6f4b9daf None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:21.553464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15514bd4-ff72-407b-8616-976e19ff21ba None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:21.588408 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d876e-275f-43ae-9b62-aac47ad558d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:21.589082 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d876e-275f-43ae-9b62-aac47ad558d5 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:21.589386 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d876e-275f-43ae-9b62-aac47ad558d5 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:21.589670 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d876e-275f-43ae-9b62-aac47ad558d5 None admin] PATH_INFO: `/v3/projects` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:21.590477 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d876e-275f-43ae-9b62-aac47ad558d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:21.590796 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d876e-275f-43ae-9b62-aac47ad558d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:21.592265 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d876e-275f-43ae-9b62-aac47ad558d5 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:21.609405 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 314/635] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:21.609405 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2beef9-7621-41dc-a6d7-ab85a11c2f49 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:21.609405 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2beef9-7621-41dc-a6d7-ab85a11c2f49 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:21.609405 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2beef9-7621-41dc-a6d7-ab85a11c2f49 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:21.612491 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 315/636] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:21.613346 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2beef9-7621-41dc-a6d7-ab85a11c2f49 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:21.643864 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99223f0-f44a-4976-b8bb-4dfe6f4b9daf None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:21.679641 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2fa77-8aaa-4bfa-ba9b-915b48c89401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:21.680318 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2fa77-8aaa-4bfa-ba9b-915b48c89401 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:21.680599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2fa77-8aaa-4bfa-ba9b-915b48c89401 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:21.680944 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2fa77-8aaa-4bfa-ba9b-915b48c89401 None admin] PATH_INFO: `/v3/projects` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:21.681796 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2fa77-8aaa-4bfa-ba9b-915b48c89401 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:21.682110 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2fa77-8aaa-4bfa-ba9b-915b48c89401 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:21.683556 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2fa77-8aaa-4bfa-ba9b-915b48c89401 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:21.702260 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 322/637] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:21.702260 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2fa77-8aaa-4bfa-ba9b-915b48c89401 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:21.718702 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2beef9-7621-41dc-a6d7-ab85a11c2f49 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:21.756564 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bb593-9f4b-4c02-a0f6-d55b094f3154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:21.757416 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bb593-9f4b-4c02-a0f6-d55b094f3154 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:21.757708 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bb593-9f4b-4c02-a0f6-d55b094f3154 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:21.757982 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bb593-9f4b-4c02-a0f6-d55b094f3154 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:21.770408 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0bb593-9f4b-4c02-a0f6-d55b094f3154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:21.771916 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0bb593-9f4b-4c02-a0f6-d55b094f3154 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:21.791461 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-aa0bb593-9f4b-4c02-a0f6-d55b094f3154 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:21.791461 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:21.791461 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:21.791461 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:21.791461 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:21.791461 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:21.791461 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:21.791461 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:21.791461 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:21.791461 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:21.791461 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:21.791461 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:21.791461 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:21.791461 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:21.791461 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:21.792533 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:21.792533 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:21.792533 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:21.792533 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:21.792533 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:21.792533 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:21.792533 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:21.792533 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:21.792533 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:21.792533 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:21.792533 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:21.792533 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:21.792533 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:21.792533 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:21.792533 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:21.792533 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:21.792533 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:21.793994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:21.793994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:21.793994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:21.793994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:21.793994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 316/638] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:21.794325 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9ebe0-9b08-4302-b1d7-df65d8bbb812 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:21.794567 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9ebe0-9b08-4302-b1d7-df65d8bbb812 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:21.794835 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9ebe0-9b08-4302-b1d7-df65d8bbb812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:21.812186 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-c1a9ebe0-9b08-4302-b1d7-df65d8bbb812 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:21.813442 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-c1a9ebe0-9b08-4302-b1d7-df65d8bbb812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:21.820539 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2fa77-8aaa-4bfa-ba9b-915b48c89401 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:21.856887 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47feafe-fe65-4a0d-98f3-9fdb333ba0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:21.857620 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47feafe-fe65-4a0d-98f3-9fdb333ba0ec None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:21.857888 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47feafe-fe65-4a0d-98f3-9fdb333ba0ec None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:21.858167 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47feafe-fe65-4a0d-98f3-9fdb333ba0ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:21.859014 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47feafe-fe65-4a0d-98f3-9fdb333ba0ec None admin] RBAC: Adding query filter params (role.id=a6f10c1ca57b4299bb809b5bcc8797f5, scope.project.id=7860d281acf642d2a3950424901b9487, user.id=adf919c3ba31488694c724a803ca51eb) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:21.859330 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47feafe-fe65-4a0d-98f3-9fdb333ba0ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:21.860757 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47feafe-fe65-4a0d-98f3-9fdb333ba0ec None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:21.870653 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 323/639] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:47:21 2022] GET /identity/v3/role_assignments?user.id=adf919c3ba31488694c724a803ca51eb&scope.project.id=7860d281acf642d2a3950424901b9487&role.id=a6f10c1ca57b4299bb809b5bcc8797f5 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:21.872609 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47feafe-fe65-4a0d-98f3-9fdb333ba0ec None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:21.894764 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 317/640] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:21.896127 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9ebe0-9b08-4302-b1d7-df65d8bbb812 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:22.003533 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47feafe-fe65-4a0d-98f3-9fdb333ba0ec None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:22.023194 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9ebe0-9b08-4302-b1d7-df65d8bbb812 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:22.042692 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f6b3b-fa44-45c7-9be1-57ee45c3f033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:22.044111 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f6b3b-fa44-45c7-9be1-57ee45c3f033 None admin] REQUEST_METHOD: `PUT` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:22.044592 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f6b3b-fa44-45c7-9be1-57ee45c3f033 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:22.045027 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f6b3b-fa44-45c7-9be1-57ee45c3f033 None admin] PATH_INFO: `/v3/projects/7860d281acf642d2a3950424901b9487/users/95f73edea88646ab9b1e2f3b0fea34c0/roles/a6f10c1ca57b4299bb809b5bcc8797f5` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:22.061365 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f6b3b-fa44-45c7-9be1-57ee45c3f033 None admin] RBAC: Authorizing `identity:create_grant(project_id=7860d281acf642d2a3950424901b9487, user_id=95f73edea88646ab9b1e2f3b0fea34c0, role_id=a6f10c1ca57b4299bb809b5bcc8797f5)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:22.062442 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355eade-81e4-41ac-9599-340f00a66a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:22.063069 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355eade-81e4-41ac-9599-340f00a66a96 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:22.063356 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355eade-81e4-41ac-9599-340f00a66a96 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:22.063637 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355eade-81e4-41ac-9599-340f00a66a96 None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:22.063996 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f6b3b-fa44-45c7-9be1-57ee45c3f033 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:22.064391 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355eade-81e4-41ac-9599-340f00a66a96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:22.064702 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355eade-81e4-41ac-9599-340f00a66a96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:22.066123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355eade-81e4-41ac-9599-340f00a66a96 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:22.079523 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 318/641] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:22.080410 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355eade-81e4-41ac-9599-340f00a66a96 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:22.081189 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 324/642] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:47:21 2022] PUT /identity/v3/projects/7860d281acf642d2a3950424901b9487/users/95f73edea88646ab9b1e2f3b0fea34c0/roles/a6f10c1ca57b4299bb809b5bcc8797f5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:47:22.082976 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09211cbd-fb65-4cf0-b853-1d1e18f6482f None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:22.083456 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09211cbd-fb65-4cf0-b853-1d1e18f6482f None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:22.083925 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09211cbd-fb65-4cf0-b853-1d1e18f6482f None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:22.086324 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 325/643] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:22.088252 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09211cbd-fb65-4cf0-b853-1d1e18f6482f None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:22.236034 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355eade-81e4-41ac-9599-340f00a66a96 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:22.254489 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09211cbd-fb65-4cf0-b853-1d1e18f6482f None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:22.276582 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944a7b4-1eef-4c64-b75d-813ef3ba44c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:22.277499 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944a7b4-1eef-4c64-b75d-813ef3ba44c6 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:22.277790 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944a7b4-1eef-4c64-b75d-813ef3ba44c6 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:22.278070 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944a7b4-1eef-4c64-b75d-813ef3ba44c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:22.291198 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944a7b4-1eef-4c64-b75d-813ef3ba44c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:22.300128 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-8944a7b4-1eef-4c64-b75d-813ef3ba44c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:22.300128 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:22.300128 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:22.300128 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:22.300128 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:22.300128 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:22.300128 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:22.300128 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:22.300128 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:22.300128 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:22.300128 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:22.300128 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:22.300128 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:22.300128 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:22.300128 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:22.300128 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:22.301543 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:22.301543 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:22.301543 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:22.301543 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:22.301543 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:22.301543 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:22.301543 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:22.301543 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:22.301543 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:22.301543 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:22.301543 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:22.301543 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:22.301543 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:22.301543 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:22.301543 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:22.301543 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:22.302671 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:22.302671 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:22.302671 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:22.302671 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:22.302671 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:22.302671 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:22.302671 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:22.302671 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:22.302671 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:22.302671 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:22.302671 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:22.302671 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:22.302671 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 319/644] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:47:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:22.303525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf4992-298e-4554-9eb1-043009fd4082 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:22.303525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf4992-298e-4554-9eb1-043009fd4082 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:22.303674 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf4992-298e-4554-9eb1-043009fd4082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:22.306485 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6bd07-7b26-4615-975e-69399bac9a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:22.307583 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6bd07-7b26-4615-975e-69399bac9a6e None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:22.308128 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6bd07-7b26-4615-975e-69399bac9a6e None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:22.308570 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6bd07-7b26-4615-975e-69399bac9a6e None admin] PATH_INFO: `/v3/users/glance` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:22.321428 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6bd07-7b26-4615-975e-69399bac9a6e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:22.323261 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6bd07-7b26-4615-975e-69399bac9a6e None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:22.323382 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-e1bf4992-298e-4554-9eb1-043009fd4082 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:22.324638 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-e1bf4992-298e-4554-9eb1-043009fd4082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:22.347765 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-c6b6bd07-7b26-4615-975e-69399bac9a6e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 09 15:47:22.347765 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:22.347765 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:22.347765 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:22.347765 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:22.347765 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:22.347765 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:22.347765 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:22.347765 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:22.347765 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:22.347765 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:22.347765 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:22.347765 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:22.347765 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:22.347765 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:22.347765 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:22.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:22.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:22.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:22.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:22.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:22.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:22.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:22.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:22.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:22.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:22.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:22.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:22.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:22.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:22.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:22.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:22.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:22.348870 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:22.349953 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:22.349953 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:22.349953 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:22.349953 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:22.349953 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:22.349953 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:22.349953 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:22.349953 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:22.349953 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 09 15:47:22.349953 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:22.349953 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 326/645] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:47:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:22.354547 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6bd07-7b26-4615-975e-69399bac9a6e None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:22.408507 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 320/646] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:22.416872 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf4992-298e-4554-9eb1-043009fd4082 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:22.486188 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6bd07-7b26-4615-975e-69399bac9a6e None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:22.524121 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232bfaa-506e-48cc-a44b-3158e3a8f0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:22.525840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232bfaa-506e-48cc-a44b-3158e3a8f0d9 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:22.526380 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232bfaa-506e-48cc-a44b-3158e3a8f0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:22.526895 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232bfaa-506e-48cc-a44b-3158e3a8f0d9 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:22.527917 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232bfaa-506e-48cc-a44b-3158e3a8f0d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:22.529023 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232bfaa-506e-48cc-a44b-3158e3a8f0d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:22.531091 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232bfaa-506e-48cc-a44b-3158e3a8f0d9 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:22.540793 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 327/647] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:47:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:22.542156 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232bfaa-506e-48cc-a44b-3158e3a8f0d9 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:22.555334 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf4992-298e-4554-9eb1-043009fd4082 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:22.598867 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4a5f5-48b1-4418-8a5d-3c4f1585a419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:22.599498 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4a5f5-48b1-4418-8a5d-3c4f1585a419 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:22.600222 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4a5f5-48b1-4418-8a5d-3c4f1585a419 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:22.600503 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4a5f5-48b1-4418-8a5d-3c4f1585a419 None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:22.601450 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4a5f5-48b1-4418-8a5d-3c4f1585a419 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:22.601766 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4a5f5-48b1-4418-8a5d-3c4f1585a419 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:22.603593 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4a5f5-48b1-4418-8a5d-3c4f1585a419 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:22.630420 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 321/648] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 9 15:47:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:22.630420 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4a5f5-48b1-4418-8a5d-3c4f1585a419 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:22.663209 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232bfaa-506e-48cc-a44b-3158e3a8f0d9 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:22.714219 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf0913-28a3-4fab-954a-e0f96ad1bd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:22.715439 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf0913-28a3-4fab-954a-e0f96ad1bd6d None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:22.716666 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf0913-28a3-4fab-954a-e0f96ad1bd6d None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:22.717058 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf0913-28a3-4fab-954a-e0f96ad1bd6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:22.742607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaf0913-28a3-4fab-954a-e0f96ad1bd6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:22.757834 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4a5f5-48b1-4418-8a5d-3c4f1585a419 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:22.764630 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-ffaf0913-28a3-4fab-954a-e0f96ad1bd6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:22.764630 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:22.764630 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:22.764630 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:22.764630 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:22.764630 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:22.764630 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:22.764630 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:22.764630 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:22.764630 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:22.764630 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:22.764630 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:22.764630 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:22.764630 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:22.764630 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:22.764630 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:22.767007 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:22.767007 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:22.767007 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:22.767007 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:22.767007 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:22.767007 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:22.767007 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:22.767007 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:22.767007 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:22.767007 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:22.767007 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:22.767007 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:22.767007 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:22.767007 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:22.767007 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:22.767007 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:22.768863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:22.768863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:22.768863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:22.768863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:22.768863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:22.768863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:22.768863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:22.768863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:22.768863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:22.768863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:22.768863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:22.768863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:22.772936 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 328/649] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:47:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:22.775310 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf0913-28a3-4fab-954a-e0f96ad1bd6d None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:22.830555 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fd7d0-510a-487d-b05c-8b759ddfcf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:22.833124 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fd7d0-510a-487d-b05c-8b759ddfcf5a None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:22.834417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fd7d0-510a-487d-b05c-8b759ddfcf5a None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:22.835367 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fd7d0-510a-487d-b05c-8b759ddfcf5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:22.860887 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fd7d0-510a-487d-b05c-8b759ddfcf5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:22.862912 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fd7d0-510a-487d-b05c-8b759ddfcf5a None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:22.893695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-f61fd7d0-510a-487d-b05c-8b759ddfcf5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:22.893695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:22.893695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:22.893695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:22.893695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:22.893695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:22.893695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:22.893695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:22.893695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:22.893695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:22.893695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:22.893695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:22.893695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:22.893695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:22.893695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:22.895425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:22.895425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:22.895425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:22.895425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:22.895425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:22.895425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:22.895425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:22.895425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:22.895425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:22.895425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:22.895425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:22.895425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:22.895425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:22.895425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:22.895425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:22.895425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:22.895425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:22.896441 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:22.896441 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:22.896441 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:22.896441 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:22.899259 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 322/650] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:22.900502 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fd7d0-510a-487d-b05c-8b759ddfcf5a None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:22.907428 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaf0913-28a3-4fab-954a-e0f96ad1bd6d None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:22.945171 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800df265-b409-44c8-a2e0-110800cdf67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:22.946047 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800df265-b409-44c8-a2e0-110800cdf67c None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:22.946476 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800df265-b409-44c8-a2e0-110800cdf67c None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:22.946857 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800df265-b409-44c8-a2e0-110800cdf67c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:23.024601 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800df265-b409-44c8-a2e0-110800cdf67c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:23.026360 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800df265-b409-44c8-a2e0-110800cdf67c None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:23.046137 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fd7d0-510a-487d-b05c-8b759ddfcf5a None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:23.121174 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd21cc-cd63-4d12-9202-782127e661db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:23.123198 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd21cc-cd63-4d12-9202-782127e661db None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:23.123909 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd21cc-cd63-4d12-9202-782127e661db None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:23.124859 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd21cc-cd63-4d12-9202-782127e661db None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:23.126901 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd21cc-cd63-4d12-9202-782127e661db None admin] RBAC: Adding query filter params (name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:23.128072 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd21cc-cd63-4d12-9202-782127e661db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:23.131217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd21cc-cd63-4d12-9202-782127e661db None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:23.149021 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 323/651] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:47:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:23.150791 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd21cc-cd63-4d12-9202-782127e661db None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:23.154716 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 329/652] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:47:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:47:23.155999 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800df265-b409-44c8-a2e0-110800cdf67c None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:23.280971 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd21cc-cd63-4d12-9202-782127e661db None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:23.291286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800df265-b409-44c8-a2e0-110800cdf67c None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:23.317119 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35b7f0-9525-4c06-b592-d3c19224e8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:23.317847 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35b7f0-9525-4c06-b592-d3c19224e8af None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:23.318136 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35b7f0-9525-4c06-b592-d3c19224e8af None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:23.318417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35b7f0-9525-4c06-b592-d3c19224e8af None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:23.319176 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35b7f0-9525-4c06-b592-d3c19224e8af None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:23.319487 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35b7f0-9525-4c06-b592-d3c19224e8af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:23.320967 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35b7f0-9525-4c06-b592-d3c19224e8af None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:23.339768 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 324/653] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:23.340629 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a54f3-8463-4855-9b7a-3f3df265a203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:23.340781 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35b7f0-9525-4c06-b592-d3c19224e8af None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:23.342248 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a54f3-8463-4855-9b7a-3f3df265a203 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:23.342696 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a54f3-8463-4855-9b7a-3f3df265a203 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:23.343149 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a54f3-8463-4855-9b7a-3f3df265a203 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:23.355436 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a54f3-8463-4855-9b7a-3f3df265a203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:23.357149 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a54f3-8463-4855-9b7a-3f3df265a203 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:23.377538 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-100a54f3-8463-4855-9b7a-3f3df265a203 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:23.377538 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:23.377538 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:23.377538 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:23.377538 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:23.377538 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:23.377538 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:23.377538 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:23.377538 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:23.377538 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:23.377538 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:23.377538 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:23.377538 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:23.377538 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:23.377538 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:23.378758 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:23.378758 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:23.378758 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:23.378758 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:23.378758 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:23.378758 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:23.378758 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:23.378758 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:23.378758 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:23.378758 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:23.378758 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:23.378758 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:23.378758 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:23.378758 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:23.378758 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:23.378758 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:23.378758 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:23.379850 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:23.379850 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:23.379850 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:23.379850 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:23.379850 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 330/654] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:23.379850 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a54f3-8463-4855-9b7a-3f3df265a203 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:23.472781 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35b7f0-9525-4c06-b592-d3c19224e8af None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:23.483271 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a54f3-8463-4855-9b7a-3f3df265a203 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:23.518299 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8a31e-f73e-4a33-a10a-b91fa5db7fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:23.519202 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8a31e-f73e-4a33-a10a-b91fa5db7fca None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:23.519542 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8a31e-f73e-4a33-a10a-b91fa5db7fca None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:23.519825 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8a31e-f73e-4a33-a10a-b91fa5db7fca None admin] PATH_INFO: `/v3/users/cinder` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:23.520130 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa05ebf-bc1f-48d1-8781-f59f74b143f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:23.521291 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa05ebf-bc1f-48d1-8781-f59f74b143f9 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:23.521941 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa05ebf-bc1f-48d1-8781-f59f74b143f9 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:23.522379 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa05ebf-bc1f-48d1-8781-f59f74b143f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:23.527800 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8a31e-f73e-4a33-a10a-b91fa5db7fca None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:23.529313 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8a31e-f73e-4a33-a10a-b91fa5db7fca None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:23.536365 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa05ebf-bc1f-48d1-8781-f59f74b143f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:23.538347 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa05ebf-bc1f-48d1-8781-f59f74b143f9 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:23.545984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-1bf8a31e-f73e-4a33-a10a-b91fa5db7fca None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:47:23.545984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:23.545984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:23.545984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:23.545984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:23.545984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:23.545984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:23.545984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:23.545984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:23.545984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:23.545984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:23.545984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:23.545984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:23.545984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:23.545984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:23.545984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:23.547286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:23.547286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:23.547286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:23.547286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:23.547286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:23.547286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:23.547286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:23.547286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:23.547286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:23.547286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:23.547286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:23.547286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:23.547286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:23.547286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:23.547286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:23.547286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:23.547286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:23.547286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:23.548380 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:23.548380 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:23.548380 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:23.548380 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:23.548380 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:23.548380 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:23.548380 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:23.548380 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:23.548380 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:47:23.548380 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:23.551896 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 331/655] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:47:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:23.552736 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8a31e-f73e-4a33-a10a-b91fa5db7fca None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:23.562221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-caa05ebf-bc1f-48d1-8781-f59f74b143f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:23.562221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:23.562221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:23.562221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:23.562221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:23.562221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:23.562221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:23.562221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:23.562221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:23.562221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:23.562221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:23.562221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:23.562221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:23.562221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:23.562221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:23.563285 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:23.563285 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:23.563285 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:23.563285 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:23.563285 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:23.563285 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:23.563285 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:23.563285 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:23.563285 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:23.563285 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:23.563285 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:23.563285 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:23.563285 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:23.563285 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:23.563285 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:23.563285 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:23.563285 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:23.564373 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:23.564373 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:23.564373 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:23.564373 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:23.564373 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 325/656] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:23.564685 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa05ebf-bc1f-48d1-8781-f59f74b143f9 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:23.664538 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8a31e-f73e-4a33-a10a-b91fa5db7fca None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:23.668548 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa05ebf-bc1f-48d1-8781-f59f74b143f9 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:23.701398 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7c884-9053-4720-a3dd-8c6356f7a073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:23.702715 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7c884-9053-4720-a3dd-8c6356f7a073 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:23.703309 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7c884-9053-4720-a3dd-8c6356f7a073 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:23.703866 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7c884-9053-4720-a3dd-8c6356f7a073 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:23.705086 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7c884-9053-4720-a3dd-8c6356f7a073 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:23.705615 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7c884-9053-4720-a3dd-8c6356f7a073 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:23.705752 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef1af6-3f28-42b7-836f-9d185c429732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:23.706492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef1af6-3f28-42b7-836f-9d185c429732 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:23.706843 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef1af6-3f28-42b7-836f-9d185c429732 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:23.707192 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef1af6-3f28-42b7-836f-9d185c429732 None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:23.707967 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7c884-9053-4720-a3dd-8c6356f7a073 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:23.708093 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef1af6-3f28-42b7-836f-9d185c429732 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:23.708482 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef1af6-3f28-42b7-836f-9d185c429732 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:23.710002 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef1af6-3f28-42b7-836f-9d185c429732 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:23.721443 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 332/657] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:23.722670 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7c884-9053-4720-a3dd-8c6356f7a073 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:23.733816 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 326/658] 10.222.0.48 () {56 vars in 1137 bytes} [Mon May 9 15:47:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:23.734973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef1af6-3f28-42b7-836f-9d185c429732 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:23.828666 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7c884-9053-4720-a3dd-8c6356f7a073 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:23.838378 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef1af6-3f28-42b7-836f-9d185c429732 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:23.864042 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8663c1-8e0b-4a88-b3e8-157edcaf6da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:23.865078 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8663c1-8e0b-4a88-b3e8-157edcaf6da9 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:23.865583 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8663c1-8e0b-4a88-b3e8-157edcaf6da9 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:23.866057 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8663c1-8e0b-4a88-b3e8-157edcaf6da9 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:23.867027 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8663c1-8e0b-4a88-b3e8-157edcaf6da9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:23.867559 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8663c1-8e0b-4a88-b3e8-157edcaf6da9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:23.869173 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8663c1-8e0b-4a88-b3e8-157edcaf6da9 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:23.875377 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1f720-a4b6-485d-a296-9a9861983723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:23.876198 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1f720-a4b6-485d-a296-9a9861983723 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:23.876480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1f720-a4b6-485d-a296-9a9861983723 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:23.876754 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1f720-a4b6-485d-a296-9a9861983723 None admin] PATH_INFO: `/v3/projects/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:23.884509 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1f720-a4b6-485d-a296-9a9861983723 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:23.886009 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1f720-a4b6-485d-a296-9a9861983723 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:23.886549 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 333/659] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:23.887714 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8663c1-8e0b-4a88-b3e8-157edcaf6da9 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:23.902073 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-f7f1f720-a4b6-485d-a296-9a9861983723 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:23.902073 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:23.902073 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:23.902073 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:23.902073 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:23.902073 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:23.902073 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:23.902073 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:23.902073 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:23.902073 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:23.902073 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:23.902073 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:23.902073 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:23.902073 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:23.902073 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:23.903114 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:23.903114 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:23.903114 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:23.903114 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:23.903114 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:23.903114 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:23.903114 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:23.903114 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:23.903114 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:23.903114 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:23.903114 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:23.903114 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:23.903114 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:23.903114 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:23.903114 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:23.903114 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:23.903114 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:23.904198 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:23.904198 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:23.904198 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:23.904198 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:23.904198 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:23.904198 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:23.904198 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:23.904198 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:23.904198 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 327/660] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:23.904877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1f720-a4b6-485d-a296-9a9861983723 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:24.014418 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1f720-a4b6-485d-a296-9a9861983723 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:24.016128 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8663c1-8e0b-4a88-b3e8-157edcaf6da9 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:24.052339 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2ef51-b12b-46f5-aa90-b4e93b23b72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:24.053161 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2ef51-b12b-46f5-aa90-b4e93b23b72f None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:24.053579 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2ef51-b12b-46f5-aa90-b4e93b23b72f None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:24.053977 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2ef51-b12b-46f5-aa90-b4e93b23b72f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:24.055902 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d944d-2983-46a8-a2e7-b10643c2e417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:24.056723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d944d-2983-46a8-a2e7-b10643c2e417 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:24.057199 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d944d-2983-46a8-a2e7-b10643c2e417 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:24.057513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d944d-2983-46a8-a2e7-b10643c2e417 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:24.068712 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d944d-2983-46a8-a2e7-b10643c2e417 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:24.070367 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d944d-2983-46a8-a2e7-b10643c2e417 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:24.087127 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-388d944d-2983-46a8-a2e7-b10643c2e417 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:47:24.087127 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:24.087127 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:24.087127 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:24.087127 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:24.087127 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:24.087127 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:24.087127 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:24.087127 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:24.087127 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:24.087127 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:24.087127 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:24.087127 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:24.087127 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:24.087127 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:24.087127 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:24.088460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:24.088460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:24.088460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:24.088460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:24.088460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:24.088460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:24.088460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:24.088460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:24.088460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:24.088460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:24.088460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:24.088460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:24.088460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:24.088460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:24.088460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:24.088460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:24.088460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:24.088460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:24.089770 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:24.089770 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:24.089770 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:24.089770 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:24.089770 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:24.089770 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:24.089770 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:24.089770 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:24.089770 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 09 15:47:24.089770 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:24.097397 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 328/661] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:47:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:24.097397 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d944d-2983-46a8-a2e7-b10643c2e417 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:24.131993 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2ef51-b12b-46f5-aa90-b4e93b23b72f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:24.133635 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2ef51-b12b-46f5-aa90-b4e93b23b72f None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:24.210037 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d944d-2983-46a8-a2e7-b10643c2e417 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:24.245662 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c7a45-faf1-4814-9210-ae51b2354d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:24.246478 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c7a45-faf1-4814-9210-ae51b2354d70 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:24.246830 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c7a45-faf1-4814-9210-ae51b2354d70 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:24.247351 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c7a45-faf1-4814-9210-ae51b2354d70 None admin] PATH_INFO: `/v3/projects` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:24.248448 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c7a45-faf1-4814-9210-ae51b2354d70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:24.248859 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c7a45-faf1-4814-9210-ae51b2354d70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:24.250823 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c7a45-faf1-4814-9210-ae51b2354d70 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:24.254615 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 334/662] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:47:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:47:24.255540 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2ef51-b12b-46f5-aa90-b4e93b23b72f None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:24.271311 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 329/663] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:24.272484 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c7a45-faf1-4814-9210-ae51b2354d70 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:24.385301 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c7a45-faf1-4814-9210-ae51b2354d70 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:24.397815 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2ef51-b12b-46f5-aa90-b4e93b23b72f None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:24.422435 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db3748-cc82-4ccc-9f40-cb6ae147e330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:24.423409 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db3748-cc82-4ccc-9f40-cb6ae147e330 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:24.423758 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db3748-cc82-4ccc-9f40-cb6ae147e330 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:24.424105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db3748-cc82-4ccc-9f40-cb6ae147e330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:24.434913 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db3748-cc82-4ccc-9f40-cb6ae147e330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:24.436548 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db3748-cc82-4ccc-9f40-cb6ae147e330 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:24.438965 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fb2ef-f38b-44d5-8e9f-30ba38ef4f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:24.439875 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fb2ef-f38b-44d5-8e9f-30ba38ef4f44 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:24.440382 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fb2ef-f38b-44d5-8e9f-30ba38ef4f44 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:24.440849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fb2ef-f38b-44d5-8e9f-30ba38ef4f44 None admin] PATH_INFO: `/v3/users` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:24.441920 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fb2ef-f38b-44d5-8e9f-30ba38ef4f44 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:24.442450 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fb2ef-f38b-44d5-8e9f-30ba38ef4f44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:24.444090 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fb2ef-f38b-44d5-8e9f-30ba38ef4f44 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:24.458337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-71db3748-cc82-4ccc-9f40-cb6ae147e330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:24.458337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:24.458337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:24.458337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:24.458337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:24.458337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:24.458337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:24.458337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:24.458337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:24.458337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:24.458337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:24.458337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:24.458337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:24.458337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:24.458337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:24.459578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:24.459578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:24.459578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:24.459578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:24.459578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:24.459578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:24.459578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:24.459578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:24.459578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:24.459578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:24.459578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:24.459578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:24.459578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:24.459578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:24.459578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:24.459578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:24.459578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:24.460630 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:24.460630 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:24.460630 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:24.460630 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:24.460630 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 330/664] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:24.460987 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db3748-cc82-4ccc-9f40-cb6ae147e330 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:24.466191 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 335/665] 10.222.0.48 () {56 vars in 1139 bytes} [Mon May 9 15:47:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:24.467986 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a18e5c-590f-4481-b2a9-69bc6579b118 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:24.468468 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a18e5c-590f-4481-b2a9-69bc6579b118 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:24.468991 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a18e5c-590f-4481-b2a9-69bc6579b118 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:24.470741 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 336/666] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:24.471667 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a18e5c-590f-4481-b2a9-69bc6579b118 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:24.566296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db3748-cc82-4ccc-9f40-cb6ae147e330 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:24.575186 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a18e5c-590f-4481-b2a9-69bc6579b118 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:24.600139 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd25fba-98db-47c3-99ce-74b31487f357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:24.600802 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd25fba-98db-47c3-99ce-74b31487f357 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:24.601089 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd25fba-98db-47c3-99ce-74b31487f357 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:24.601379 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd25fba-98db-47c3-99ce-74b31487f357 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:24.602236 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd25fba-98db-47c3-99ce-74b31487f357 None admin] RBAC: Adding query filter params (role.id=a6f10c1ca57b4299bb809b5bcc8797f5, scope.project.id=7860d281acf642d2a3950424901b9487, user.id=f24f3d53e78140b9bba6306aed2865ab) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:24.602553 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd25fba-98db-47c3-99ce-74b31487f357 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:24.603977 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd25fba-98db-47c3-99ce-74b31487f357 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:24.609351 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3a811-5105-45b6-bd0b-bbed7050e1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:24.610047 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3a811-5105-45b6-bd0b-bbed7050e1d4 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:24.610332 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3a811-5105-45b6-bd0b-bbed7050e1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:24.610613 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3a811-5105-45b6-bd0b-bbed7050e1d4 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:24.610878 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 331/667] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:47:24 2022] GET /identity/v3/role_assignments?user.id=f24f3d53e78140b9bba6306aed2865ab&scope.project.id=7860d281acf642d2a3950424901b9487&role.id=a6f10c1ca57b4299bb809b5bcc8797f5 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:24.611349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3a811-5105-45b6-bd0b-bbed7050e1d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:24.611656 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3a811-5105-45b6-bd0b-bbed7050e1d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:24.611762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd25fba-98db-47c3-99ce-74b31487f357 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:24.613013 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3a811-5105-45b6-bd0b-bbed7050e1d4 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:24.628264 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 337/668] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:24.630113 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb62fd-3b16-4c22-b6a3-cba162999476 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:24.630703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb62fd-3b16-4c22-b6a3-cba162999476 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:24.631200 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb62fd-3b16-4c22-b6a3-cba162999476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:24.651654 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-92bb62fd-3b16-4c22-b6a3-cba162999476 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:24.654383 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-92bb62fd-3b16-4c22-b6a3-cba162999476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:24.733836 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd25fba-98db-47c3-99ce-74b31487f357 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:24.734965 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 338/669] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:24.736617 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d7b7a-ef3a-456f-b7a3-2448fd15830a None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:24.736976 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d7b7a-ef3a-456f-b7a3-2448fd15830a None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:24.737431 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d7b7a-ef3a-456f-b7a3-2448fd15830a None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:24.739065 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 339/670] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:24.744170 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d7b7a-ef3a-456f-b7a3-2448fd15830a None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:24.779453 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327af6e-6260-4e2e-b32d-78367e894d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:24.779829 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327af6e-6260-4e2e-b32d-78367e894d4e None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:24.780115 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327af6e-6260-4e2e-b32d-78367e894d4e None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:24.780396 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327af6e-6260-4e2e-b32d-78367e894d4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:24.860563 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327af6e-6260-4e2e-b32d-78367e894d4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:24.861737 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327af6e-6260-4e2e-b32d-78367e894d4e None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:24.862873 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d7b7a-ef3a-456f-b7a3-2448fd15830a None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:24.902330 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d07837-3e5a-4a1a-85ac-4c1f8c06d7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:24.904116 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d07837-3e5a-4a1a-85ac-4c1f8c06d7d9 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:24.904621 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d07837-3e5a-4a1a-85ac-4c1f8c06d7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:24.905126 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d07837-3e5a-4a1a-85ac-4c1f8c06d7d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:24.912604 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d07837-3e5a-4a1a-85ac-4c1f8c06d7d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:24.914401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d07837-3e5a-4a1a-85ac-4c1f8c06d7d9 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:24.929166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-e5d07837-3e5a-4a1a-85ac-4c1f8c06d7d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:24.929166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:24.929166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:24.929166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:24.929166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:24.929166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:24.929166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:24.929166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:24.929166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:24.929166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:24.929166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:24.929166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:24.929166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:24.929166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:24.929166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:24.935144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:24.935144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:24.935144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:24.935144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:24.935144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:24.935144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:24.935144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:24.935144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:24.935144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:24.935144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:24.935144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:24.935144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:24.935144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:24.935144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:24.935144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:24.935144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:24.935144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:24.936240 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:24.936240 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:24.936240 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:24.936240 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:24.936240 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:24.936240 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:24.936240 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:24.936240 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:24.936240 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 340/671] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:24.936240 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ee306-a00f-4969-8f6d-6e014de7c890 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:24.936240 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ee306-a00f-4969-8f6d-6e014de7c890 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:24.936939 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ee306-a00f-4969-8f6d-6e014de7c890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:24.951237 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-121ee306-a00f-4969-8f6d-6e014de7c890 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:24.952438 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-121ee306-a00f-4969-8f6d-6e014de7c890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:24.980381 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 332/672] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:47:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:47:24.980381 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327af6e-6260-4e2e-b32d-78367e894d4e None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:25.033490 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 341/673] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:25.033490 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ee306-a00f-4969-8f6d-6e014de7c890 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:25.094189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327af6e-6260-4e2e-b32d-78367e894d4e None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:25.132104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcc0d7-94a0-4365-b10c-f286a071db26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:25.132908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcc0d7-94a0-4365-b10c-f286a071db26 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:25.133192 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcc0d7-94a0-4365-b10c-f286a071db26 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:25.133499 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcc0d7-94a0-4365-b10c-f286a071db26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:25.145324 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afcc0d7-94a0-4365-b10c-f286a071db26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:25.147293 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ee306-a00f-4969-8f6d-6e014de7c890 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:25.152966 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-2afcc0d7-94a0-4365-b10c-f286a071db26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:47:25.152966 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:25.152966 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:25.152966 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:25.152966 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:25.152966 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:25.152966 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:25.152966 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:25.152966 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:25.152966 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:25.152966 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:25.152966 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:25.152966 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:25.152966 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:25.152966 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:25.152966 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:25.154924 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:25.154924 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:25.154924 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:25.154924 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:25.154924 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:25.154924 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:25.154924 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:25.154924 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:25.154924 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:25.154924 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:25.154924 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:25.154924 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:25.154924 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:25.154924 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:25.154924 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:25.154924 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:25.156147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:25.156147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:25.156147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:25.156147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:25.156147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:25.156147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:25.156147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:25.156147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:25.156147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:25.156147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:25.156147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:47:25.156147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:25.159960 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 333/674] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:47:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:25.160745 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcc0d7-94a0-4365-b10c-f286a071db26 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:25.191890 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f37133-e86e-4335-b50d-a6af94e76da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:25.192565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f37133-e86e-4335-b50d-a6af94e76da6 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:25.192845 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f37133-e86e-4335-b50d-a6af94e76da6 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:25.193121 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f37133-e86e-4335-b50d-a6af94e76da6 None admin] PATH_INFO: `/v3/projects` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:25.193950 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f37133-e86e-4335-b50d-a6af94e76da6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:25.194259 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f37133-e86e-4335-b50d-a6af94e76da6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:25.195690 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f37133-e86e-4335-b50d-a6af94e76da6 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:25.213094 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 342/675] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:25.213094 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f37133-e86e-4335-b50d-a6af94e76da6 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:25.272748 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcc0d7-94a0-4365-b10c-f286a071db26 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:25.307420 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245811c-c89a-4223-8a1a-8f75f028bb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:25.308132 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245811c-c89a-4223-8a1a-8f75f028bb8f None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:25.308411 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245811c-c89a-4223-8a1a-8f75f028bb8f None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:25.308689 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245811c-c89a-4223-8a1a-8f75f028bb8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:25.314137 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f37133-e86e-4335-b50d-a6af94e76da6 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:25.320484 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245811c-c89a-4223-8a1a-8f75f028bb8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:25.321968 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245811c-c89a-4223-8a1a-8f75f028bb8f None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:25.341767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-e245811c-c89a-4223-8a1a-8f75f028bb8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:25.341767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:25.341767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:25.341767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:25.341767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:25.341767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:25.341767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:25.341767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:25.341767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:25.341767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:25.341767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:25.341767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:25.341767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:25.341767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:25.341767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:25.342965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:25.342965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:25.342965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:25.342965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:25.342965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:25.342965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:25.342965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:25.342965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:25.342965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:25.342965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:25.342965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:25.342965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:25.342965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:25.342965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:25.342965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:25.342965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:25.342965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:25.343969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:25.343969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:25.343969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:25.343969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:25.343969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 334/676] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:25.343969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245811c-c89a-4223-8a1a-8f75f028bb8f None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:25.353322 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201b27f-a997-4ff4-b34f-5f10d380b961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:25.354158 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201b27f-a997-4ff4-b34f-5f10d380b961 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:25.354442 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201b27f-a997-4ff4-b34f-5f10d380b961 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:25.354718 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201b27f-a997-4ff4-b34f-5f10d380b961 None admin] PATH_INFO: `/v3/roles/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:25.366057 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201b27f-a997-4ff4-b34f-5f10d380b961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:25.374440 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-1201b27f-a997-4ff4-b34f-5f10d380b961 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:25.374440 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:25.374440 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:25.374440 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:25.374440 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:25.374440 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:25.374440 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:25.374440 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:25.374440 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:25.374440 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:25.374440 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:25.374440 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:25.374440 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:25.374440 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:25.374440 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:25.374440 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:25.375734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:25.375734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:25.375734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:25.375734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:25.375734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:25.375734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:25.375734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:25.375734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:25.375734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:25.375734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:25.375734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:25.375734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:25.375734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:25.375734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:25.375734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:25.375734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:25.376779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:25.376779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:25.376779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:25.376779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:25.376779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:25.376779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:25.376779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:25.376779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:25.376779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:25.376779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:25.376779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:25.376779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:25.380992 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 343/677] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:47:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:25.381921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201b27f-a997-4ff4-b34f-5f10d380b961 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:25.455334 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245811c-c89a-4223-8a1a-8f75f028bb8f None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:25.483267 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201b27f-a997-4ff4-b34f-5f10d380b961 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:25.489494 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf868c7c-2ed9-4751-b3ba-a9d76e43da3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:25.490183 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf868c7c-2ed9-4751-b3ba-a9d76e43da3f None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:25.490473 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf868c7c-2ed9-4751-b3ba-a9d76e43da3f None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:25.490757 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf868c7c-2ed9-4751-b3ba-a9d76e43da3f None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:25.491524 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf868c7c-2ed9-4751-b3ba-a9d76e43da3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:25.491835 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf868c7c-2ed9-4751-b3ba-a9d76e43da3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:25.493270 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf868c7c-2ed9-4751-b3ba-a9d76e43da3f None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:25.507326 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 335/678] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:47:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:25.507326 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf868c7c-2ed9-4751-b3ba-a9d76e43da3f None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:25.523115 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd44b8-2d72-4ba3-ac21-f2acffebe82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:25.523784 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd44b8-2d72-4ba3-ac21-f2acffebe82b None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:25.524064 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd44b8-2d72-4ba3-ac21-f2acffebe82b None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:25.524339 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd44b8-2d72-4ba3-ac21-f2acffebe82b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:25.525186 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd44b8-2d72-4ba3-ac21-f2acffebe82b None admin] RBAC: Adding query filter params (role.id=a6f10c1ca57b4299bb809b5bcc8797f5, scope.project.id=7860d281acf642d2a3950424901b9487, user.id=8f0df0a8cb634b8cbd133e68127c30a3) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:25.525537 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd44b8-2d72-4ba3-ac21-f2acffebe82b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:25.526976 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd44b8-2d72-4ba3-ac21-f2acffebe82b None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:25.533572 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 344/679] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:47:25 2022] GET /identity/v3/role_assignments?user.id=8f0df0a8cb634b8cbd133e68127c30a3&scope.project.id=7860d281acf642d2a3950424901b9487&role.id=a6f10c1ca57b4299bb809b5bcc8797f5 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:25.534419 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd44b8-2d72-4ba3-ac21-f2acffebe82b None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:25.623934 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf868c7c-2ed9-4751-b3ba-a9d76e43da3f None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:25.672109 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a7f04-ef48-4195-8174-09a8eabc1351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:25.673129 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a7f04-ef48-4195-8174-09a8eabc1351 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:25.673630 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd44b8-2d72-4ba3-ac21-f2acffebe82b None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:25.674253 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a7f04-ef48-4195-8174-09a8eabc1351 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:25.674769 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a7f04-ef48-4195-8174-09a8eabc1351 None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:25.675730 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a7f04-ef48-4195-8174-09a8eabc1351 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:25.676247 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a7f04-ef48-4195-8174-09a8eabc1351 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:25.677678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a7f04-ef48-4195-8174-09a8eabc1351 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:25.691581 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 336/680] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:25.692558 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a7f04-ef48-4195-8174-09a8eabc1351 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:25.724826 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc77803-113e-472d-8c68-9f707d4139d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:25.726068 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc77803-113e-472d-8c68-9f707d4139d5 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:25.726706 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc77803-113e-472d-8c68-9f707d4139d5 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:25.727066 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc77803-113e-472d-8c68-9f707d4139d5 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:25.728093 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc77803-113e-472d-8c68-9f707d4139d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:25.728832 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc77803-113e-472d-8c68-9f707d4139d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:25.730604 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc77803-113e-472d-8c68-9f707d4139d5 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:25.746249 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 345/681] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:47:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:25.747885 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc77803-113e-472d-8c68-9f707d4139d5 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:25.825090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a7f04-ef48-4195-8174-09a8eabc1351 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:25.863607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc77803-113e-472d-8c68-9f707d4139d5 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:25.867666 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2e150-c264-4e27-9031-95d5ed171e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:25.868492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2e150-c264-4e27-9031-95d5ed171e6a None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:25.868777 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2e150-c264-4e27-9031-95d5ed171e6a None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:25.869054 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2e150-c264-4e27-9031-95d5ed171e6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:25.882231 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2e150-c264-4e27-9031-95d5ed171e6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:25.883667 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2e150-c264-4e27-9031-95d5ed171e6a None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:25.903326 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0f7f8-c674-474e-b707-bb807664b3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:25.904626 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0f7f8-c674-474e-b707-bb807664b3da None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:25.904920 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0f7f8-c674-474e-b707-bb807664b3da None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:25.905191 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0f7f8-c674-474e-b707-bb807664b3da None admin] PATH_INFO: `/v3/projects/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:25.911065 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-15c2e150-c264-4e27-9031-95d5ed171e6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:25.911065 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:25.911065 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:25.911065 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:25.911065 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:25.911065 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:25.911065 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:25.911065 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:25.911065 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:25.911065 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:25.911065 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:25.911065 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:25.911065 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:25.911065 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:25.911065 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:25.912087 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:25.912087 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:25.912087 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:25.912087 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:25.912087 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:25.912087 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:25.912087 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:25.912087 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:25.912087 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:25.912087 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:25.912087 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:25.912087 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:25.912087 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:25.912087 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:25.912087 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:25.912087 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:25.912087 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:25.913098 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:25.913098 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:25.913098 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:25.913098 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:25.913358 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0f7f8-c674-474e-b707-bb807664b3da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:25.913461 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 337/682] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:25.913461 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2e150-c264-4e27-9031-95d5ed171e6a None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:25.918495 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e0f7f8-c674-474e-b707-bb807664b3da None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:25.933887 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-a9e0f7f8-c674-474e-b707-bb807664b3da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:25.933887 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:25.933887 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:25.933887 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:25.933887 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:25.933887 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:25.933887 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:25.933887 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:25.933887 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:25.933887 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:25.933887 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:25.933887 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:25.933887 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:25.933887 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:25.933887 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:25.936166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:25.936166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:25.936166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:25.936166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:25.936166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:25.936166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:25.936166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:25.936166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:25.936166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:25.936166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:25.936166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:25.936166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:25.936166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:25.936166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:25.936166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:25.936166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:25.936166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:25.938473 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:25.938473 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:25.938473 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:25.938473 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:25.938473 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:25.938473 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:25.938473 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:25.938473 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:25.943455 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 346/683] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:25.943455 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0f7f8-c674-474e-b707-bb807664b3da None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:26.019615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2e150-c264-4e27-9031-95d5ed171e6a None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:26.048367 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0f7f8-c674-474e-b707-bb807664b3da None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:26.057112 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa67d1-26f3-437b-bb72-eea1defef313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:26.058059 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa67d1-26f3-437b-bb72-eea1defef313 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:26.058347 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa67d1-26f3-437b-bb72-eea1defef313 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:26.058624 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa67d1-26f3-437b-bb72-eea1defef313 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:26.071023 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa67d1-26f3-437b-bb72-eea1defef313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:26.072519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa67d1-26f3-437b-bb72-eea1defef313 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:26.088008 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ecbd7-a288-4786-9179-eff3465eb936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:26.088695 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ecbd7-a288-4786-9179-eff3465eb936 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:26.088977 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ecbd7-a288-4786-9179-eff3465eb936 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:26.089253 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ecbd7-a288-4786-9179-eff3465eb936 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:26.090267 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ecbd7-a288-4786-9179-eff3465eb936 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:26.090553 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ecbd7-a288-4786-9179-eff3465eb936 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:26.092632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-67fa67d1-26f3-437b-bb72-eea1defef313 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:26.092632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:26.092632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:26.092632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:26.092632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:26.092632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:26.092632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:26.092632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:26.092632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:26.092632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:26.092632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:26.092632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:26.092632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:26.092632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:26.092632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:26.093968 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:26.093968 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:26.093968 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:26.093968 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:26.093968 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:26.093968 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:26.093968 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:26.093968 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:26.093968 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:26.093968 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:26.093968 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:26.093968 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:26.093968 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:26.093968 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:26.093968 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:26.093968 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:26.093968 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:26.095658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:26.095658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:26.095658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:26.095658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:26.095924 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ecbd7-a288-4786-9179-eff3465eb936 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:26.098877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 338/684] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:26.100172 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa67d1-26f3-437b-bb72-eea1defef313 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:26.113752 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 347/685] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:26.114855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ecbd7-a288-4786-9179-eff3465eb936 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:26.220002 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa67d1-26f3-437b-bb72-eea1defef313 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:26.242794 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ecbd7-a288-4786-9179-eff3465eb936 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:26.267347 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da77fb-6450-48e6-aed7-bba982469c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:26.268025 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da77fb-6450-48e6-aed7-bba982469c2b None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:26.268308 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da77fb-6450-48e6-aed7-bba982469c2b None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:26.268588 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da77fb-6450-48e6-aed7-bba982469c2b None admin] PATH_INFO: `/v3/projects` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:26.269416 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da77fb-6450-48e6-aed7-bba982469c2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:26.269742 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da77fb-6450-48e6-aed7-bba982469c2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:26.271520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da77fb-6450-48e6-aed7-bba982469c2b None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:26.285661 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 339/686] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:26.286694 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da77fb-6450-48e6-aed7-bba982469c2b None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:26.288596 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167d6eb-3ed9-4ed4-8a78-3a57d66bde85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:26.289741 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167d6eb-3ed9-4ed4-8a78-3a57d66bde85 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:26.291046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167d6eb-3ed9-4ed4-8a78-3a57d66bde85 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:26.291498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167d6eb-3ed9-4ed4-8a78-3a57d66bde85 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:26.292413 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167d6eb-3ed9-4ed4-8a78-3a57d66bde85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:26.292893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167d6eb-3ed9-4ed4-8a78-3a57d66bde85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:26.295353 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167d6eb-3ed9-4ed4-8a78-3a57d66bde85 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:26.312900 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 348/687] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:26.314158 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167d6eb-3ed9-4ed4-8a78-3a57d66bde85 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:26.397299 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da77fb-6450-48e6-aed7-bba982469c2b None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:26.432847 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e5dce-483a-45fa-86b4-d9258f080910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:26.433703 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e5dce-483a-45fa-86b4-d9258f080910 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:26.433987 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e5dce-483a-45fa-86b4-d9258f080910 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:26.434262 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e5dce-483a-45fa-86b4-d9258f080910 None admin] PATH_INFO: `/v3/users/nova` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:26.442080 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167d6eb-3ed9-4ed4-8a78-3a57d66bde85 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:26.442765 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e5dce-483a-45fa-86b4-d9258f080910 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:26.444258 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e5dce-483a-45fa-86b4-d9258f080910 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:26.462756 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-5d5e5dce-483a-45fa-86b4-d9258f080910 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:47:26.462756 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:26.462756 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:26.462756 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:26.462756 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:26.462756 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:26.462756 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:26.462756 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:26.462756 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:26.462756 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:26.462756 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:26.462756 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:26.462756 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:26.462756 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:26.462756 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:26.462756 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:26.464464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:26.464464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:26.464464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:26.464464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:26.464464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:26.464464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:26.464464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:26.464464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:26.464464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:26.464464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:26.464464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:26.464464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:26.464464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:26.464464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:26.464464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:26.464464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:26.464464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:26.464464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:26.465682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:26.465682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:26.465682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:26.465682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:26.465682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:26.465682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:26.465682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:26.465682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:26.465682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:47:26.465682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:26.465682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 340/688] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:47:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:26.465682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e5dce-483a-45fa-86b4-d9258f080910 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:26.488190 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c22d2b-53ca-47fa-8cea-8921e3c22123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:26.489616 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c22d2b-53ca-47fa-8cea-8921e3c22123 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:26.490063 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c22d2b-53ca-47fa-8cea-8921e3c22123 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:26.490809 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c22d2b-53ca-47fa-8cea-8921e3c22123 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:26.491982 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c22d2b-53ca-47fa-8cea-8921e3c22123 None admin] RBAC: Adding query filter params (role.id=a6f10c1ca57b4299bb809b5bcc8797f5, scope.project.id=7860d281acf642d2a3950424901b9487, user.id=cc0eb4f69ab6423eae5e8b33fbc06563) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:26.492792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c22d2b-53ca-47fa-8cea-8921e3c22123 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:26.494890 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c22d2b-53ca-47fa-8cea-8921e3c22123 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:26.504331 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 349/689] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:47:26 2022] GET /identity/v3/role_assignments?user.id=cc0eb4f69ab6423eae5e8b33fbc06563&scope.project.id=7860d281acf642d2a3950424901b9487&role.id=a6f10c1ca57b4299bb809b5bcc8797f5 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:26.505483 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c22d2b-53ca-47fa-8cea-8921e3c22123 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:26.581033 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e5dce-483a-45fa-86b4-d9258f080910 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:26.617542 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97ec98-1880-473d-b809-5effab649812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:26.618348 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97ec98-1880-473d-b809-5effab649812 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:26.618631 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97ec98-1880-473d-b809-5effab649812 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:26.618904 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97ec98-1880-473d-b809-5effab649812 None admin] PATH_INFO: `/v3/users/swift` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:26.621381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c22d2b-53ca-47fa-8cea-8921e3c22123 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:26.639543 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97ec98-1880-473d-b809-5effab649812 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:26.641195 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97ec98-1880-473d-b809-5effab649812 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:26.657041 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-ed97ec98-1880-473d-b809-5effab649812 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:47:26.657041 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:26.657041 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:26.657041 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:26.657041 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:26.657041 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:26.657041 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:26.657041 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:26.657041 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:26.657041 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:26.657041 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:26.657041 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:26.657041 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:26.657041 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:26.657041 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:26.657041 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:26.658189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:26.658189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:26.658189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:26.658189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:26.658189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:26.658189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:26.658189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:26.658189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:26.658189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:26.658189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:26.658189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:26.658189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:26.658189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:26.658189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:26.658189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:26.658189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:26.658189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:26.658189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:26.659279 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:26.659279 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:26.659279 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:26.659279 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:26.659279 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:26.659279 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:26.659279 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:26.659279 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:26.659279 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:47:26.659279 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:26.659279 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 341/690] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:47:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:26.664492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97ec98-1880-473d-b809-5effab649812 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:26.665083 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd6808-b42a-437c-a269-bf0620ff87f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:26.666152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd6808-b42a-437c-a269-bf0620ff87f2 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:26.666668 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd6808-b42a-437c-a269-bf0620ff87f2 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:26.667190 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd6808-b42a-437c-a269-bf0620ff87f2 None admin] PATH_INFO: `/v3/users` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:26.668292 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd6808-b42a-437c-a269-bf0620ff87f2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:26.669482 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd6808-b42a-437c-a269-bf0620ff87f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:26.671459 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd6808-b42a-437c-a269-bf0620ff87f2 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:26.691222 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 350/691] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:47:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:26.697624 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd6808-b42a-437c-a269-bf0620ff87f2 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:26.845864 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97ec98-1880-473d-b809-5effab649812 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:26.871597 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd6808-b42a-437c-a269-bf0620ff87f2 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:26.892315 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13f3bf-9642-42fc-b0e6-7d82169e0fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:26.893147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13f3bf-9642-42fc-b0e6-7d82169e0fdf None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:26.893601 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13f3bf-9642-42fc-b0e6-7d82169e0fdf None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:26.893989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13f3bf-9642-42fc-b0e6-7d82169e0fdf None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:26.894950 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13f3bf-9642-42fc-b0e6-7d82169e0fdf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:26.895364 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13f3bf-9642-42fc-b0e6-7d82169e0fdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:26.896894 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13f3bf-9642-42fc-b0e6-7d82169e0fdf None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:26.918337 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce94d1-3615-44af-9440-d89f3d92e8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:26.918963 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 342/692] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 9 15:47:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:47:26.919114 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce94d1-3615-44af-9440-d89f3d92e8af None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:26.919298 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce94d1-3615-44af-9440-d89f3d92e8af None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:26.919581 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce94d1-3615-44af-9440-d89f3d92e8af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:26.925733 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13f3bf-9642-42fc-b0e6-7d82169e0fdf None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:27.024559 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce94d1-3615-44af-9440-d89f3d92e8af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:27.026441 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce94d1-3615-44af-9440-d89f3d92e8af None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:27.046356 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13f3bf-9642-42fc-b0e6-7d82169e0fdf None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:27.097562 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef11cee-ad00-4f08-b1ee-81346291135e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:27.098132 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef11cee-ad00-4f08-b1ee-81346291135e None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:27.098413 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef11cee-ad00-4f08-b1ee-81346291135e None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:27.098870 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef11cee-ad00-4f08-b1ee-81346291135e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:27.193112 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef11cee-ad00-4f08-b1ee-81346291135e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:27.194998 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef11cee-ad00-4f08-b1ee-81346291135e None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:27.284134 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 351/693] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:47:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:47:27.285897 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652eaa7-caa0-4142-beed-08b0bcfae2a0 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:27.286188 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652eaa7-caa0-4142-beed-08b0bcfae2a0 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:27.286671 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652eaa7-caa0-4142-beed-08b0bcfae2a0 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:27.292797 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 352/694] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:27.295040 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8580e-ce15-4ac5-9926-c842153fdb23 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:27.295335 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8580e-ce15-4ac5-9926-c842153fdb23 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:27.295618 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8580e-ce15-4ac5-9926-c842153fdb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:27.311859 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 343/695] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:47:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 09 15:47:27.312744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef11cee-ad00-4f08-b1ee-81346291135e None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:27.319094 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-15e8580e-ce15-4ac5-9926-c842153fdb23 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:27.320296 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-15e8580e-ce15-4ac5-9926-c842153fdb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:27.398548 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 353/696] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:27.399436 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8580e-ce15-4ac5-9926-c842153fdb23 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:27.443319 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef11cee-ad00-4f08-b1ee-81346291135e None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:27.482686 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e346738-b514-4b99-b23d-ebce38d33f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:27.483485 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e346738-b514-4b99-b23d-ebce38d33f34 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:27.483768 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e346738-b514-4b99-b23d-ebce38d33f34 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:27.484046 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e346738-b514-4b99-b23d-ebce38d33f34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:27.494866 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e346738-b514-4b99-b23d-ebce38d33f34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:27.496317 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e346738-b514-4b99-b23d-ebce38d33f34 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:27.515644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-1e346738-b514-4b99-b23d-ebce38d33f34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:27.515644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:27.515644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:27.515644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:27.515644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:27.515644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:27.515644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:27.515644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:27.515644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:27.515644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:27.515644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:27.515644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:27.515644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:27.515644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:27.515644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:27.516705 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:27.516705 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:27.516705 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:27.516705 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:27.516705 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:27.516705 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:27.516705 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:27.516705 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:27.516705 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:27.516705 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:27.516705 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:27.516705 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:27.516705 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:27.516705 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:27.516705 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:27.516705 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:27.516705 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:27.517708 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:27.517708 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:27.517708 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:27.517708 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:27.517970 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8580e-ce15-4ac5-9926-c842153fdb23 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:27.521587 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 344/697] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:27.522489 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e346738-b514-4b99-b23d-ebce38d33f34 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:27.561386 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91d257-7440-41ab-8298-52e2b16847ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:27.562202 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91d257-7440-41ab-8298-52e2b16847ce None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:27.562482 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91d257-7440-41ab-8298-52e2b16847ce None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:27.562816 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91d257-7440-41ab-8298-52e2b16847ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:27.576339 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91d257-7440-41ab-8298-52e2b16847ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:27.578294 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91d257-7440-41ab-8298-52e2b16847ce None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:27.602130 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-0d91d257-7440-41ab-8298-52e2b16847ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:27.602130 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:27.602130 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:27.602130 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:27.602130 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:27.602130 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:27.602130 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:27.602130 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:27.602130 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:27.602130 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:27.602130 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:27.602130 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:27.602130 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:27.602130 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:27.602130 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:27.604395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:27.604395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:27.604395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:27.604395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:27.604395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:27.604395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:27.604395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:27.604395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:27.604395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:27.604395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:27.604395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:27.604395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:27.604395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:27.604395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:27.604395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:27.604395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:27.604395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:27.612133 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:27.612133 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:27.612133 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:27.612133 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:27.612133 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 354/698] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:27.612133 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91d257-7440-41ab-8298-52e2b16847ce None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:27.641186 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e346738-b514-4b99-b23d-ebce38d33f34 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:27.685762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7d380-9974-419b-97a5-453662f1ab3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:27.686583 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7d380-9974-419b-97a5-453662f1ab3a None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:27.687040 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7d380-9974-419b-97a5-453662f1ab3a None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:27.687328 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7d380-9974-419b-97a5-453662f1ab3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:27.701509 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7d380-9974-419b-97a5-453662f1ab3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:27.703255 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7d380-9974-419b-97a5-453662f1ab3a None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:27.721802 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91d257-7440-41ab-8298-52e2b16847ce None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:27.726148 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-a5b7d380-9974-419b-97a5-453662f1ab3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:27.726148 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:27.726148 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:27.726148 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:27.726148 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:27.726148 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:27.726148 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:27.726148 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:27.726148 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:27.726148 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:27.726148 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:27.726148 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:27.726148 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:27.726148 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:27.726148 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:27.727121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:27.727121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:27.727121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:27.727121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:27.727121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:27.727121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:27.727121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:27.727121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:27.727121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:27.727121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:27.727121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:27.727121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:27.727121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:27.727121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:27.727121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:27.727121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:27.727121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:27.728110 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:27.728110 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:27.728110 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:27.728110 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:27.728110 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 345/699] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:27.728844 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7d380-9974-419b-97a5-453662f1ab3a None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:27.768627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c8702-c112-4261-ad9f-c38c58fe25d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:27.769421 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c8702-c112-4261-ad9f-c38c58fe25d8 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:27.769719 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c8702-c112-4261-ad9f-c38c58fe25d8 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:27.770002 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c8702-c112-4261-ad9f-c38c58fe25d8 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:27.770752 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c8702-c112-4261-ad9f-c38c58fe25d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:27.771064 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c8702-c112-4261-ad9f-c38c58fe25d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:27.772449 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c8702-c112-4261-ad9f-c38c58fe25d8 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:27.788273 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 355/700] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:27.790240 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c8702-c112-4261-ad9f-c38c58fe25d8 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:27.856649 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7d380-9974-419b-97a5-453662f1ab3a None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:27.896439 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa11ea6-108f-4575-a2cf-2f1ea5c2365f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:27.897114 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa11ea6-108f-4575-a2cf-2f1ea5c2365f None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:27.897412 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa11ea6-108f-4575-a2cf-2f1ea5c2365f None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:27.897692 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa11ea6-108f-4575-a2cf-2f1ea5c2365f None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:27.898453 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa11ea6-108f-4575-a2cf-2f1ea5c2365f None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:27.898756 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa11ea6-108f-4575-a2cf-2f1ea5c2365f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:27.899053 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c8702-c112-4261-ad9f-c38c58fe25d8 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:27.900174 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa11ea6-108f-4575-a2cf-2f1ea5c2365f None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:27.914245 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 346/701] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:27.915120 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa11ea6-108f-4575-a2cf-2f1ea5c2365f None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:27.954176 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404242c-5ae7-44de-a6ef-ee7daaade872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:27.954782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404242c-5ae7-44de-a6ef-ee7daaade872 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:27.957409 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404242c-5ae7-44de-a6ef-ee7daaade872 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:27.957409 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404242c-5ae7-44de-a6ef-ee7daaade872 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:27.957409 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404242c-5ae7-44de-a6ef-ee7daaade872 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:27.957409 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404242c-5ae7-44de-a6ef-ee7daaade872 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:27.958156 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404242c-5ae7-44de-a6ef-ee7daaade872 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:27.974552 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 356/702] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:27.975730 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404242c-5ae7-44de-a6ef-ee7daaade872 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:28.033770 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa11ea6-108f-4575-a2cf-2f1ea5c2365f None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:28.070307 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc8f7c-3a6c-4f9f-8d96-bf964077c1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:28.071106 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc8f7c-3a6c-4f9f-8d96-bf964077c1b7 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:28.071414 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc8f7c-3a6c-4f9f-8d96-bf964077c1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:28.071821 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc8f7c-3a6c-4f9f-8d96-bf964077c1b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:28.079925 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc8f7c-3a6c-4f9f-8d96-bf964077c1b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:28.081396 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc8f7c-3a6c-4f9f-8d96-bf964077c1b7 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:28.089322 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404242c-5ae7-44de-a6ef-ee7daaade872 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:28.097799 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-53cc8f7c-3a6c-4f9f-8d96-bf964077c1b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:28.097799 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:28.097799 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:28.097799 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:28.097799 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:28.097799 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:28.097799 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:28.097799 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:28.097799 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:28.097799 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:28.097799 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:28.097799 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:28.097799 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:28.097799 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:28.097799 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:28.100710 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:28.100710 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:28.100710 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:28.100710 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:28.100710 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:28.100710 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:28.100710 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:28.100710 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:28.100710 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:28.100710 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:28.100710 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:28.100710 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:28.100710 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:28.100710 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:28.100710 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:28.100710 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:28.100710 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:28.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:28.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:28.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:28.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:28.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:28.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:28.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:28.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:28.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 347/703] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:28.103575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc8f7c-3a6c-4f9f-8d96-bf964077c1b7 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:28.141032 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d0c55-85c0-4379-a8e1-b24e9d2bceeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:28.142235 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d0c55-85c0-4379-a8e1-b24e9d2bceeb None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:28.142638 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d0c55-85c0-4379-a8e1-b24e9d2bceeb None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:28.143075 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d0c55-85c0-4379-a8e1-b24e9d2bceeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:28.153024 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d0c55-85c0-4379-a8e1-b24e9d2bceeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:28.155030 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d0c55-85c0-4379-a8e1-b24e9d2bceeb None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:28.174527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-081d0c55-85c0-4379-a8e1-b24e9d2bceeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:28.174527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:28.174527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:28.174527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:28.174527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:28.174527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:28.174527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:28.174527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:28.174527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:28.174527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:28.174527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:28.174527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:28.174527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:28.174527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:28.174527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:28.175904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:28.175904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:28.175904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:28.175904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:28.175904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:28.175904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:28.175904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:28.175904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:28.175904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:28.175904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:28.175904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:28.175904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:28.175904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:28.175904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:28.175904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:28.175904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:28.175904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:28.176892 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:28.176892 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:28.176892 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:28.176892 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:28.176892 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:28.176892 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:28.176892 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:28.176892 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:28.176892 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 357/704] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:28.177628 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d0c55-85c0-4379-a8e1-b24e9d2bceeb None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:28.219400 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc8f7c-3a6c-4f9f-8d96-bf964077c1b7 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:28.255745 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decae138-a9bf-49d8-ab94-d8c6afed6657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:28.256423 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decae138-a9bf-49d8-ab94-d8c6afed6657 None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:28.256703 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decae138-a9bf-49d8-ab94-d8c6afed6657 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:28.256978 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decae138-a9bf-49d8-ab94-d8c6afed6657 None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:28.257730 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decae138-a9bf-49d8-ab94-d8c6afed6657 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:28.259141 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decae138-a9bf-49d8-ab94-d8c6afed6657 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:28.280045 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 348/705] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:47:28 2022] POST /identity/v3/users => generated 254 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:47:28.281218 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77aab3e-84a2-41be-8e26-1994712e2a48 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:28.281537 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77aab3e-84a2-41be-8e26-1994712e2a48 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:28.281816 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77aab3e-84a2-41be-8e26-1994712e2a48 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:28.288073 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 349/706] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:28.288073 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77aab3e-84a2-41be-8e26-1994712e2a48 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:28.288384 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d0c55-85c0-4379-a8e1-b24e9d2bceeb None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:28.337574 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bf42d-e8a3-4346-8e05-1ca2a6dfa5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:28.338278 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bf42d-e8a3-4346-8e05-1ca2a6dfa5cd None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:28.338544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bf42d-e8a3-4346-8e05-1ca2a6dfa5cd None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:28.338860 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bf42d-e8a3-4346-8e05-1ca2a6dfa5cd None admin] PATH_INFO: `/v3/projects` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:28.340376 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bf42d-e8a3-4346-8e05-1ca2a6dfa5cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:28.340811 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bf42d-e8a3-4346-8e05-1ca2a6dfa5cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:28.343028 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bf42d-e8a3-4346-8e05-1ca2a6dfa5cd None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:28.365774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 358/707] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:28.365774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665d963-8d2e-451d-b747-a4cbaae9f079 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:28.365774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665d963-8d2e-451d-b747-a4cbaae9f079 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:28.365774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665d963-8d2e-451d-b747-a4cbaae9f079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:28.387249 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-7665d963-8d2e-451d-b747-a4cbaae9f079 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:28.389138 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-7665d963-8d2e-451d-b747-a4cbaae9f079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:28.438257 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77aab3e-84a2-41be-8e26-1994712e2a48 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:28.469396 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 359/708] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:28.469396 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665d963-8d2e-451d-b747-a4cbaae9f079 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:28.492797 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2755d-353e-487f-9d74-718df98700f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:28.493513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2755d-353e-487f-9d74-718df98700f1 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:28.493727 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2755d-353e-487f-9d74-718df98700f1 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:28.494040 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2755d-353e-487f-9d74-718df98700f1 None admin] PATH_INFO: `/v3/projects` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:28.494861 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2755d-353e-487f-9d74-718df98700f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:28.495237 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2755d-353e-487f-9d74-718df98700f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:28.496740 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2755d-353e-487f-9d74-718df98700f1 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:28.512142 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 350/709] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:28.513473 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2755d-353e-487f-9d74-718df98700f1 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:28.603877 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665d963-8d2e-451d-b747-a4cbaae9f079 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:28.642353 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5199c-36b8-4a1f-8e81-c352421493fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:28.643070 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5199c-36b8-4a1f-8e81-c352421493fa None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:28.643354 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5199c-36b8-4a1f-8e81-c352421493fa None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:28.643645 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5199c-36b8-4a1f-8e81-c352421493fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:28.644547 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d5199c-36b8-4a1f-8e81-c352421493fa None admin] RBAC: Adding query filter params (role.id=2180d183afad443187521833c40ed8a1, scope.project.id=7860d281acf642d2a3950424901b9487, user.id=adf919c3ba31488694c724a803ca51eb) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:28.644861 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d5199c-36b8-4a1f-8e81-c352421493fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:28.646331 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d5199c-36b8-4a1f-8e81-c352421493fa None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:28.657398 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 360/710] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:47:28 2022] GET /identity/v3/role_assignments?user.id=adf919c3ba31488694c724a803ca51eb&scope.project.id=7860d281acf642d2a3950424901b9487&role.id=2180d183afad443187521833c40ed8a1 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:28.657398 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5199c-36b8-4a1f-8e81-c352421493fa None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:28.672789 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2755d-353e-487f-9d74-718df98700f1 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:28.747514 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547d8c8-a601-4c9c-a236-488704181852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:28.748291 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547d8c8-a601-4c9c-a236-488704181852 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:28.748573 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547d8c8-a601-4c9c-a236-488704181852 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:28.748846 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547d8c8-a601-4c9c-a236-488704181852 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:28.751386 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7547d8c8-a601-4c9c-a236-488704181852 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:28.752935 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7547d8c8-a601-4c9c-a236-488704181852 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:28.785359 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-7547d8c8-a601-4c9c-a236-488704181852 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:47:28.785359 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:28.785359 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:47:28.785359 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:47:28.785359 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:47:28.785359 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:47:28.785359 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:47:28.785359 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:28.785359 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:47:28.785359 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:28.785359 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:47:28.785359 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:28.785359 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:28.785359 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:28.785359 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:28.785359 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:28.787016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:28.787016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:28.787016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:28.787016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:28.787016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:28.787016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:28.787016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:28.787016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:47:28.787016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:47:28.787016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:47:28.787016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:47:28.787016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:28.787016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:28.787016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:28.787016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:28.787016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:28.788687 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:28.788687 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:28.788687 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:28.788687 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:28.788687 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:28.788687 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:28.788687 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:28.788687 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:28.788687 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:28.788687 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:28.788687 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:28.788687 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:47:28.788687 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:28.788687 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:47:28.788687 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:28.788687 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 351/711] 10.222.0.48 () {56 vars in 1129 bytes} [Mon May 9 15:47:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:28.800751 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547d8c8-a601-4c9c-a236-488704181852 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:28.853786 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5199c-36b8-4a1f-8e81-c352421493fa None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:28.898886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e6cbf-a6d3-4af7-a244-396ad35a6d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:28.900211 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e6cbf-a6d3-4af7-a244-396ad35a6d96 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:28.900736 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e6cbf-a6d3-4af7-a244-396ad35a6d96 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:28.901279 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e6cbf-a6d3-4af7-a244-396ad35a6d96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:28.902463 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e6cbf-a6d3-4af7-a244-396ad35a6d96 None admin] RBAC: Adding query filter params (role.id=a6f10c1ca57b4299bb809b5bcc8797f5, scope.project.id=7860d281acf642d2a3950424901b9487, user.id=95f73edea88646ab9b1e2f3b0fea34c0) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:28.903062 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e6cbf-a6d3-4af7-a244-396ad35a6d96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:28.905688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e6cbf-a6d3-4af7-a244-396ad35a6d96 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:28.921481 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 361/712] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:47:28 2022] GET /identity/v3/role_assignments?user.id=95f73edea88646ab9b1e2f3b0fea34c0&scope.project.id=7860d281acf642d2a3950424901b9487&role.id=a6f10c1ca57b4299bb809b5bcc8797f5 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:29.037177 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547d8c8-a601-4c9c-a236-488704181852 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:29.088335 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac2944-cc19-4ca8-9a4d-40e3ca52ec0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:29.089588 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac2944-cc19-4ca8-9a4d-40e3ca52ec0e None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:29.090159 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac2944-cc19-4ca8-9a4d-40e3ca52ec0e None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:29.091189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac2944-cc19-4ca8-9a4d-40e3ca52ec0e None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:29.092306 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac2944-cc19-4ca8-9a4d-40e3ca52ec0e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:29.092918 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac2944-cc19-4ca8-9a4d-40e3ca52ec0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:29.094720 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac2944-cc19-4ca8-9a4d-40e3ca52ec0e None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:29.109047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 352/713] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 9 15:47:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:29.115926 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e6cbf-a6d3-4af7-a244-396ad35a6d96 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:29.233638 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e6cbf-a6d3-4af7-a244-396ad35a6d96 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:29.269658 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d12fb-8413-4e85-8abd-64c95f5ec19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:29.270349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d12fb-8413-4e85-8abd-64c95f5ec19a None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:29.270638 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d12fb-8413-4e85-8abd-64c95f5ec19a None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:29.270920 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d12fb-8413-4e85-8abd-64c95f5ec19a None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:29.271654 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d12fb-8413-4e85-8abd-64c95f5ec19a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:29.271964 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d12fb-8413-4e85-8abd-64c95f5ec19a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:29.273359 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d12fb-8413-4e85-8abd-64c95f5ec19a None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:29.279634 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a99fd-274a-4375-a2af-2aa02db4645f None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:29.280262 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a99fd-274a-4375-a2af-2aa02db4645f None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:29.280442 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 362/714] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 9 15:47:29 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:29.280905 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a99fd-274a-4375-a2af-2aa02db4645f None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:29.282779 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 353/715] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:29.288517 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ff3b3-cf24-43ea-a568-453da05af3cd None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:29.288812 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ff3b3-cf24-43ea-a568-453da05af3cd None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:29.289067 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ff3b3-cf24-43ea-a568-453da05af3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:29.308025 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-4e1ff3b3-cf24-43ea-a568-453da05af3cd None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:29.309274 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-4e1ff3b3-cf24-43ea-a568-453da05af3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:29.390893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 363/716] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:29.415768 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a99fd-274a-4375-a2af-2aa02db4645f None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:29.554654 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a99fd-274a-4375-a2af-2aa02db4645f None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:29.604105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523335d-cda3-41cc-ac9f-4743a90217f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:29.605330 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523335d-cda3-41cc-ac9f-4743a90217f6 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:29.605901 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523335d-cda3-41cc-ac9f-4743a90217f6 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:29.607377 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523335d-cda3-41cc-ac9f-4743a90217f6 None admin] PATH_INFO: `/v3/services/network` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:29.608277 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9523335d-cda3-41cc-ac9f-4743a90217f6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:29.609945 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9523335d-cda3-41cc-ac9f-4743a90217f6 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:29.642104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-9523335d-cda3-41cc-ac9f-4743a90217f6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:47:29.642104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:29.642104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:47:29.642104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:47:29.642104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:47:29.642104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:47:29.642104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:47:29.642104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:29.642104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:47:29.642104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:29.642104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:47:29.642104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:29.642104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:29.642104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:29.642104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:29.642104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:29.642104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:29.643251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:29.643251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:29.643251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:29.643251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:29.643251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:29.643251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:29.643251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:47:29.643251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:47:29.643251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:47:29.643251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:47:29.643251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:29.643251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:29.643251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:29.643251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:29.643251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:29.643251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:29.644184 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:29.644184 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:29.644184 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:29.644184 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:29.644184 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:29.644184 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:29.644184 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:29.644184 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:29.644184 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:29.644184 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:29.644184 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:47:29.644184 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:29.644184 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:47:29.644184 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:29.648107 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 354/717] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:29 2022] GET /identity/v3/services/network => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:29.654533 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ff3b3-cf24-43ea-a568-453da05af3cd None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:29.827917 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ff3b3-cf24-43ea-a568-453da05af3cd None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:29.871345 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62b126-2661-4f57-9ac2-cc37c5cc81ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:29.872658 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62b126-2661-4f57-9ac2-cc37c5cc81ae None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:29.873018 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62b126-2661-4f57-9ac2-cc37c5cc81ae None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:29.873304 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62b126-2661-4f57-9ac2-cc37c5cc81ae None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:29.874058 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62b126-2661-4f57-9ac2-cc37c5cc81ae None admin] RBAC: Adding query filter params (name=network) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:29.874365 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62b126-2661-4f57-9ac2-cc37c5cc81ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:29.876019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62b126-2661-4f57-9ac2-cc37c5cc81ae None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:29.884120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 364/718] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:47:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:29.891046 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523335d-cda3-41cc-ac9f-4743a90217f6 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:30.040074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523335d-cda3-41cc-ac9f-4743a90217f6 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:30.087245 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969540d1-1371-4c29-959a-0aa58c40adab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:30.088312 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969540d1-1371-4c29-959a-0aa58c40adab None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:30.088835 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969540d1-1371-4c29-959a-0aa58c40adab None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:30.089346 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969540d1-1371-4c29-959a-0aa58c40adab None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:30.090320 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969540d1-1371-4c29-959a-0aa58c40adab None admin] RBAC: Adding query filter params (type=network) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:30.091414 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969540d1-1371-4c29-959a-0aa58c40adab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:30.093007 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969540d1-1371-4c29-959a-0aa58c40adab None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:30.102168 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 355/719] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:47:29 2022] GET /identity/v3/services?type=network => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:31.049498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633c2b2-3428-4b70-aeba-30d4eab60a16 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:31.050032 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633c2b2-3428-4b70-aeba-30d4eab60a16 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:31.050116 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633c2b2-3428-4b70-aeba-30d4eab60a16 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:31.051725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 365/720] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:31.057973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60128f34-9bf6-43ea-b8c3-3961605d5c5f None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:31.058894 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60128f34-9bf6-43ea-b8c3-3961605d5c5f None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:31.059464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60128f34-9bf6-43ea-b8c3-3961605d5c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:31.082492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-60128f34-9bf6-43ea-b8c3-3961605d5c5f None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:31.083701 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-60128f34-9bf6-43ea-b8c3-3961605d5c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:31.179157 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 356/721] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 09 15:47:31.203845 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633c2b2-3428-4b70-aeba-30d4eab60a16 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:31.342206 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633c2b2-3428-4b70-aeba-30d4eab60a16 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:31.403139 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddf459-24cd-4247-ab4c-92eb49b6d884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:31.404467 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddf459-24cd-4247-ab4c-92eb49b6d884 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:31.405045 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddf459-24cd-4247-ab4c-92eb49b6d884 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:31.405593 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddf459-24cd-4247-ab4c-92eb49b6d884 None admin] PATH_INFO: `/v3/roles/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:31.424032 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeddf459-24cd-4247-ab4c-92eb49b6d884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:31.432486 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-eeddf459-24cd-4247-ab4c-92eb49b6d884 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:31.432486 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:31.432486 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:31.432486 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:31.432486 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:31.432486 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:31.432486 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:31.432486 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:31.432486 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:31.432486 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:31.432486 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:31.432486 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:31.432486 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:31.432486 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:31.432486 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:31.432486 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:31.433612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:31.433612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:31.433612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:31.433612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:31.433612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:31.433612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:31.433612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:31.433612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:31.433612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:31.433612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:31.433612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:31.433612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:31.433612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:31.433612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:31.433612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:31.433612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:31.435462 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:31.435462 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:31.435462 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:31.435462 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:31.435462 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:31.435462 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:31.435462 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:31.435462 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:31.435462 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:31.435462 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:31.435462 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:31.435462 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:31.439293 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 366/722] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:47:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:31.445324 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60128f34-9bf6-43ea-b8c3-3961605d5c5f None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:31.582343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60128f34-9bf6-43ea-b8c3-3961605d5c5f None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:31.614728 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2d5d7-fb6e-4a76-8328-2131c97efa26 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:31.615273 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2d5d7-fb6e-4a76-8328-2131c97efa26 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:31.615727 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2d5d7-fb6e-4a76-8328-2131c97efa26 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:31.617260 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 367/723] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:47:31.627032 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118d459-a6b2-4eda-867c-4a5aadfb6a58 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:31.627575 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118d459-a6b2-4eda-867c-4a5aadfb6a58 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:31.628019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118d459-a6b2-4eda-867c-4a5aadfb6a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:31.648887 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ead828-9859-4080-b1b9-9d9ef062349b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:31.653836 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ead828-9859-4080-b1b9-9d9ef062349b None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:31.654504 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ead828-9859-4080-b1b9-9d9ef062349b None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:31.655024 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ead828-9859-4080-b1b9-9d9ef062349b None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:31.656084 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ead828-9859-4080-b1b9-9d9ef062349b None admin] RBAC: Adding query filter params (name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:31.657474 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-0118d459-a6b2-4eda-867c-4a5aadfb6a58 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:31.658134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ead828-9859-4080-b1b9-9d9ef062349b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:31.659829 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ead828-9859-4080-b1b9-9d9ef062349b None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:31.661567 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-0118d459-a6b2-4eda-867c-4a5aadfb6a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:31.683216 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 357/724] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:47:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:31.689165 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ead828-9859-4080-b1b9-9d9ef062349b None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:31.755808 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 368/725] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:31.805899 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118d459-a6b2-4eda-867c-4a5aadfb6a58 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:31.897128 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ead828-9859-4080-b1b9-9d9ef062349b None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:31.920115 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118d459-a6b2-4eda-867c-4a5aadfb6a58 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:31.931803 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03048616-c278-435f-a10f-2dc7f171c400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:31.932614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03048616-c278-435f-a10f-2dc7f171c400 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:31.932899 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03048616-c278-435f-a10f-2dc7f171c400 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:31.933177 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03048616-c278-435f-a10f-2dc7f171c400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:31.945916 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03048616-c278-435f-a10f-2dc7f171c400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:31.947404 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03048616-c278-435f-a10f-2dc7f171c400 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:31.958872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57561b-4369-40fd-80ef-e11b3487afdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:31.960068 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57561b-4369-40fd-80ef-e11b3487afdd None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:31.960597 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57561b-4369-40fd-80ef-e11b3487afdd None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:31.961089 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57561b-4369-40fd-80ef-e11b3487afdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:31.967604 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-03048616-c278-435f-a10f-2dc7f171c400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:31.967604 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:31.967604 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:31.967604 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:31.967604 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:31.967604 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:31.967604 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:31.967604 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:31.967604 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:31.967604 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:31.967604 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:31.967604 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:31.967604 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:31.967604 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:31.967604 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:31.968662 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:31.968662 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:31.968662 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:31.968662 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:31.968662 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:31.968662 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:31.968662 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:31.968662 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:31.968662 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:31.968662 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:31.968662 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:31.968662 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:31.968662 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:31.968662 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:31.968662 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:31.968662 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:31.968662 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:31.969660 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:31.969660 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:31.969660 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:31.969660 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:31.971256 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 358/726] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:31.972320 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ec935-3c21-484e-9829-995fe95eb1c7 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:31.972761 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ec935-3c21-484e-9829-995fe95eb1c7 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:31.973203 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ec935-3c21-484e-9829-995fe95eb1c7 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:31.978556 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 359/727] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:31.979206 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57561b-4369-40fd-80ef-e11b3487afdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:31.979850 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ec935-3c21-484e-9829-995fe95eb1c7 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:31.988702 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-1d57561b-4369-40fd-80ef-e11b3487afdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:47:31.988702 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:31.988702 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:31.988702 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:31.988702 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:31.988702 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:31.988702 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:31.988702 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:31.988702 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:31.988702 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:31.988702 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:31.988702 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:31.988702 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:31.988702 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:31.988702 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:31.988702 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:31.989957 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:31.989957 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:31.989957 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:31.989957 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:31.989957 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:31.989957 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:31.989957 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:31.989957 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:31.989957 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:31.989957 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:31.989957 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:31.989957 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:31.989957 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:31.989957 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:31.989957 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:31.989957 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:31.990884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:31.990884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:31.990884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:31.990884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:31.990884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:31.990884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:31.990884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:31.990884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:31.990884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:31.990884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:31.990884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:47:31.990884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:31.995192 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 369/728] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:47:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:47:31.997861 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b9c23-fb91-478f-94b2-e730709dd7f5 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:31.998505 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b9c23-fb91-478f-94b2-e730709dd7f5 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:31.999030 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b9c23-fb91-478f-94b2-e730709dd7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:32.021227 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-cc7b9c23-fb91-478f-94b2-e730709dd7f5 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:32.022533 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-cc7b9c23-fb91-478f-94b2-e730709dd7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:32.119855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 370/729] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:32.121996 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b9c23-fb91-478f-94b2-e730709dd7f5 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:32.126904 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ec935-3c21-484e-9829-995fe95eb1c7 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:32.166645 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef9f60-d0cb-4f6c-8ab8-7a61870d04c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:32.167411 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef9f60-d0cb-4f6c-8ab8-7a61870d04c1 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:32.167875 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef9f60-d0cb-4f6c-8ab8-7a61870d04c1 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:32.168314 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef9f60-d0cb-4f6c-8ab8-7a61870d04c1 None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:32.169971 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef9f60-d0cb-4f6c-8ab8-7a61870d04c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:32.171330 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef9f60-d0cb-4f6c-8ab8-7a61870d04c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:32.172924 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef9f60-d0cb-4f6c-8ab8-7a61870d04c1 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:32.189071 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 360/730] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:32.190191 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef9f60-d0cb-4f6c-8ab8-7a61870d04c1 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:32.244750 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b9c23-fb91-478f-94b2-e730709dd7f5 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:32.280297 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d81680-94f4-4633-96d0-fe804058d556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:32.280980 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d81680-94f4-4633-96d0-fe804058d556 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:32.281268 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d81680-94f4-4633-96d0-fe804058d556 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:32.281570 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d81680-94f4-4633-96d0-fe804058d556 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:32.282329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d81680-94f4-4633-96d0-fe804058d556 None admin] RBAC: Adding query filter params (name=admin) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:32.282639 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d81680-94f4-4633-96d0-fe804058d556 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:32.284012 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d81680-94f4-4633-96d0-fe804058d556 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:32.292263 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 371/731] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:47:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:32.293089 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d81680-94f4-4633-96d0-fe804058d556 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:32.306702 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef9f60-d0cb-4f6c-8ab8-7a61870d04c1 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:32.346466 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fffcb-051e-4a8f-9bae-dc953b6c1144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:32.347142 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fffcb-051e-4a8f-9bae-dc953b6c1144 None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:32.347432 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fffcb-051e-4a8f-9bae-dc953b6c1144 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:32.347712 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fffcb-051e-4a8f-9bae-dc953b6c1144 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:32.348447 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fffcb-051e-4a8f-9bae-dc953b6c1144 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:32.349858 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fffcb-051e-4a8f-9bae-dc953b6c1144 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:32.373515 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 361/732] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:47:32 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:47:32.373515 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9a3c0-074c-40cd-bf3b-94676c749543 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:32.373515 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9a3c0-074c-40cd-bf3b-94676c749543 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:32.373515 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9a3c0-074c-40cd-bf3b-94676c749543 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:32.373515 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 362/733] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:32.373515 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9a3c0-074c-40cd-bf3b-94676c749543 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:32.405000 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d81680-94f4-4633-96d0-fe804058d556 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:32.448138 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04e8e8-3693-4e3c-81e3-91b3eeba4264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:32.448980 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04e8e8-3693-4e3c-81e3-91b3eeba4264 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:32.449865 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04e8e8-3693-4e3c-81e3-91b3eeba4264 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:32.450775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04e8e8-3693-4e3c-81e3-91b3eeba4264 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:32.462604 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04e8e8-3693-4e3c-81e3-91b3eeba4264 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:32.464108 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04e8e8-3693-4e3c-81e3-91b3eeba4264 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:32.486329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-4f04e8e8-3693-4e3c-81e3-91b3eeba4264 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:47:32.486329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:32.486329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:32.486329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:32.486329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:32.486329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:32.486329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:32.486329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:32.486329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:32.486329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:32.486329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:32.486329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:32.486329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:32.486329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:32.486329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:32.486329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:32.487430 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:32.487430 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:32.487430 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:32.487430 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:32.487430 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:32.487430 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:32.487430 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:32.487430 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:32.487430 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:32.487430 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:32.487430 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:32.487430 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:32.487430 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:32.487430 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:32.487430 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:32.487430 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:32.487430 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:32.487430 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:32.488464 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:32.488464 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:32.488464 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:32.488464 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:32.488464 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:32.488464 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:32.488464 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:32.488464 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:32.488464 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:47:32.488464 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:32.488464 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 372/734] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:47:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:32.492090 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd7882-0a86-4dab-a79a-5568fac2f476 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:32.492090 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd7882-0a86-4dab-a79a-5568fac2f476 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:32.492090 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd7882-0a86-4dab-a79a-5568fac2f476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:32.508964 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9a3c0-074c-40cd-bf3b-94676c749543 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:32.513732 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-b1cd7882-0a86-4dab-a79a-5568fac2f476 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:32.514985 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-b1cd7882-0a86-4dab-a79a-5568fac2f476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:32.559061 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab58ce-eff7-44a5-b098-47cff39d88c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:32.559914 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab58ce-eff7-44a5-b098-47cff39d88c5 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:32.560204 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab58ce-eff7-44a5-b098-47cff39d88c5 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:32.560570 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab58ce-eff7-44a5-b098-47cff39d88c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:32.574536 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab58ce-eff7-44a5-b098-47cff39d88c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:32.576885 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab58ce-eff7-44a5-b098-47cff39d88c5 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:32.597628 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-5eab58ce-eff7-44a5-b098-47cff39d88c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:32.597628 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:32.597628 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:32.597628 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:32.597628 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:32.597628 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:32.597628 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:32.597628 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:32.597628 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:32.597628 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:32.597628 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:32.597628 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:32.597628 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:32.597628 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:32.597628 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:32.599908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:32.599908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:32.599908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:32.599908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:32.599908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:32.599908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:32.599908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:32.599908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:32.599908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:32.599908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:32.599908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:32.599908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:32.599908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:32.599908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:32.599908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:32.599908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:32.599908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:32.602445 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:32.602445 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:32.602445 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:32.602445 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:32.602445 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 363/735] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:32.602445 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab58ce-eff7-44a5-b098-47cff39d88c5 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:32.613411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 373/736] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:32 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:32.614294 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd7882-0a86-4dab-a79a-5568fac2f476 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:32.727988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab58ce-eff7-44a5-b098-47cff39d88c5 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:32.758800 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd7882-0a86-4dab-a79a-5568fac2f476 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:32.764432 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a7a92-3106-47c9-a623-9ef9d6ec9480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:32.765554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a7a92-3106-47c9-a623-9ef9d6ec9480 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:32.766080 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a7a92-3106-47c9-a623-9ef9d6ec9480 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:32.766582 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a7a92-3106-47c9-a623-9ef9d6ec9480 None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:32.767668 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a7a92-3106-47c9-a623-9ef9d6ec9480 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:32.768219 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a7a92-3106-47c9-a623-9ef9d6ec9480 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:32.769989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a7a92-3106-47c9-a623-9ef9d6ec9480 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:32.791874 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 364/737] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 9 15:47:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:32.793156 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a7a92-3106-47c9-a623-9ef9d6ec9480 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:32.800873 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63246e5-e8a0-4033-835b-dc642e1eaeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:32.801986 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63246e5-e8a0-4033-835b-dc642e1eaeb8 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:32.802556 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63246e5-e8a0-4033-835b-dc642e1eaeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:32.803057 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63246e5-e8a0-4033-835b-dc642e1eaeb8 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:32.804031 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63246e5-e8a0-4033-835b-dc642e1eaeb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:32.804557 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63246e5-e8a0-4033-835b-dc642e1eaeb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:32.806204 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63246e5-e8a0-4033-835b-dc642e1eaeb8 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:32.819665 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 374/738] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:32.820966 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63246e5-e8a0-4033-835b-dc642e1eaeb8 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:32.909684 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a7a92-3106-47c9-a623-9ef9d6ec9480 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:32.942974 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63246e5-e8a0-4033-835b-dc642e1eaeb8 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:32.948060 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda1a7d-5a7a-4d22-8e74-bc9c27aad06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:32.949135 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda1a7d-5a7a-4d22-8e74-bc9c27aad06c None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:32.949680 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda1a7d-5a7a-4d22-8e74-bc9c27aad06c None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:32.950501 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda1a7d-5a7a-4d22-8e74-bc9c27aad06c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:32.961692 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda1a7d-5a7a-4d22-8e74-bc9c27aad06c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:32.970321 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-ddda1a7d-5a7a-4d22-8e74-bc9c27aad06c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:47:32.970321 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:32.970321 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:32.970321 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:32.970321 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:32.970321 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:32.970321 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:32.970321 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:32.970321 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:32.970321 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:32.970321 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:32.970321 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:32.970321 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:32.970321 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:32.970321 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:32.970321 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:32.971399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:32.971399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:32.971399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:32.971399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:32.971399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:32.971399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:32.971399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:32.971399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:32.971399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:32.971399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:32.971399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:32.971399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:32.971399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:32.971399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:32.971399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:32.971399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:32.972314 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:32.972314 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:32.972314 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:32.972314 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:32.972314 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:32.972314 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:32.972314 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:32.972314 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:32.972314 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:32.972314 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:32.972314 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:47:32.972314 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:32.980638 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 365/739] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:47:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:32.980638 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda1a7d-5a7a-4d22-8e74-bc9c27aad06c None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:32.983829 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcae9a5-695f-4a70-bb58-eede2e60c750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:32.984501 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcae9a5-695f-4a70-bb58-eede2e60c750 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:32.984785 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcae9a5-695f-4a70-bb58-eede2e60c750 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:32.985108 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcae9a5-695f-4a70-bb58-eede2e60c750 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:33.067330 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcae9a5-695f-4a70-bb58-eede2e60c750 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:33.069165 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcae9a5-695f-4a70-bb58-eede2e60c750 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:33.098472 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda1a7d-5a7a-4d22-8e74-bc9c27aad06c None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:33.133614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae2435-6628-4003-912b-24c834884fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:33.134425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae2435-6628-4003-912b-24c834884fd3 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:33.134704 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae2435-6628-4003-912b-24c834884fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:33.134981 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae2435-6628-4003-912b-24c834884fd3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:33.144093 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae2435-6628-4003-912b-24c834884fd3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:33.145165 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae2435-6628-4003-912b-24c834884fd3 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:33.161546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-36ae2435-6628-4003-912b-24c834884fd3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:47:33.161546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:33.161546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:33.161546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:33.161546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:33.161546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:33.161546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:33.161546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:33.161546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:33.161546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:33.161546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:33.161546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:33.161546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:33.161546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:33.161546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:33.161546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:33.162682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:33.162682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:33.162682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:33.162682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:33.162682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:33.162682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:33.162682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:33.162682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:33.162682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:33.162682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:33.162682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:33.162682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:33.162682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:33.162682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:33.162682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:33.162682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:33.162682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:33.162682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:33.163723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:33.163723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:33.163723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:33.163723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:33.163723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:33.163723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:33.163723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:33.163723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:33.163723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:47:33.163723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:33.167285 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 366/740] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:47:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:33.168155 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae2435-6628-4003-912b-24c834884fd3 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:33.182538 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 375/741] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:47:32 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 09 15:47:33.184144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcae9a5-695f-4a70-bb58-eede2e60c750 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:33.276350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae2435-6628-4003-912b-24c834884fd3 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:33.295522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcae9a5-695f-4a70-bb58-eede2e60c750 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:33.312150 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba4bb4-77ea-4d0c-ba4e-6d9402993c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:33.312836 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba4bb4-77ea-4d0c-ba4e-6d9402993c79 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:33.313125 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba4bb4-77ea-4d0c-ba4e-6d9402993c79 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:33.313433 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba4bb4-77ea-4d0c-ba4e-6d9402993c79 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:33.314252 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba4bb4-77ea-4d0c-ba4e-6d9402993c79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:33.314567 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba4bb4-77ea-4d0c-ba4e-6d9402993c79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:33.315940 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba4bb4-77ea-4d0c-ba4e-6d9402993c79 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:33.329974 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 367/742] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:47:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:33.329974 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba4bb4-77ea-4d0c-ba4e-6d9402993c79 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:33.339390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87ee96-c84c-4317-98b2-5465f058eb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:33.340412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87ee96-c84c-4317-98b2-5465f058eb53 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:33.342160 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87ee96-c84c-4317-98b2-5465f058eb53 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:33.342686 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87ee96-c84c-4317-98b2-5465f058eb53 None admin] PATH_INFO: `/v3/users` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:33.343793 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87ee96-c84c-4317-98b2-5465f058eb53 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:33.344326 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87ee96-c84c-4317-98b2-5465f058eb53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:33.346029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87ee96-c84c-4317-98b2-5465f058eb53 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:33.365152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 376/743] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:47:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:33.366391 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87ee96-c84c-4317-98b2-5465f058eb53 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:33.434780 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba4bb4-77ea-4d0c-ba4e-6d9402993c79 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:33.469138 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa05da-0fdd-4bc7-a454-866bbf818c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:33.470688 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa05da-0fdd-4bc7-a454-866bbf818c3c None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:33.471212 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa05da-0fdd-4bc7-a454-866bbf818c3c None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:33.471737 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87ee96-c84c-4317-98b2-5465f058eb53 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:33.472255 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa05da-0fdd-4bc7-a454-866bbf818c3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:33.485045 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa05da-0fdd-4bc7-a454-866bbf818c3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:33.486870 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa05da-0fdd-4bc7-a454-866bbf818c3c None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:33.504883 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-b3aa05da-0fdd-4bc7-a454-866bbf818c3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:33.504883 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:33.504883 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:33.504883 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:33.504883 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:33.504883 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:33.504883 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:33.504883 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:33.504883 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:33.504883 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:33.504883 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:33.504883 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:33.504883 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:33.504883 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:33.504883 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:33.506081 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:33.506081 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:33.506081 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:33.506081 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:33.506081 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:33.506081 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:33.506081 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:33.506081 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:33.506081 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:33.506081 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:33.506081 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:33.506081 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:33.506081 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:33.506081 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:33.506081 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:33.506081 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:33.506081 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:33.507264 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:33.507264 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:33.507264 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:33.507264 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:33.507562 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa17a6-3ba9-4e2c-a3bd-aae3cea381df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:33.507562 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa17a6-3ba9-4e2c-a3bd-aae3cea381df None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:33.507562 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa17a6-3ba9-4e2c-a3bd-aae3cea381df None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:33.507838 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa17a6-3ba9-4e2c-a3bd-aae3cea381df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:33.509293 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 368/744] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:33.510274 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa05da-0fdd-4bc7-a454-866bbf818c3c None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:33.523950 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa17a6-3ba9-4e2c-a3bd-aae3cea381df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:33.525550 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa17a6-3ba9-4e2c-a3bd-aae3cea381df None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:33.548975 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-64aa17a6-3ba9-4e2c-a3bd-aae3cea381df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:33.548975 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:33.548975 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:33.548975 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:33.548975 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:33.548975 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:33.548975 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:33.548975 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:33.548975 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:33.548975 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:33.548975 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:33.548975 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:33.548975 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:33.548975 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:33.548975 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:33.555280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:33.555280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:33.555280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:33.555280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:33.555280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:33.555280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:33.555280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:33.555280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:33.555280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:33.555280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:33.555280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:33.555280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:33.555280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:33.555280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:33.555280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:33.555280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:33.555280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:33.556321 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:33.556321 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:33.556321 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:33.556321 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:33.556321 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 377/745] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:33.556321 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6fc1d-d8ea-4c21-8c8b-82aa3dafd12d None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:33.556321 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6fc1d-d8ea-4c21-8c8b-82aa3dafd12d None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:33.556321 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6fc1d-d8ea-4c21-8c8b-82aa3dafd12d None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:33.556321 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 378/746] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:33.556875 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6fc1d-d8ea-4c21-8c8b-82aa3dafd12d None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:33.632045 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa05da-0fdd-4bc7-a454-866bbf818c3c None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:33.667157 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b561b-1194-4fd0-b66c-b9e073b21daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:33.668019 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b561b-1194-4fd0-b66c-b9e073b21daf None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:33.668243 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b561b-1194-4fd0-b66c-b9e073b21daf None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:33.668553 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b561b-1194-4fd0-b66c-b9e073b21daf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:33.670382 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6fc1d-d8ea-4c21-8c8b-82aa3dafd12d None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:33.680137 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b561b-1194-4fd0-b66c-b9e073b21daf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:33.681621 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b561b-1194-4fd0-b66c-b9e073b21daf None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:33.701423 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-b04b561b-1194-4fd0-b66c-b9e073b21daf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:33.701423 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:33.701423 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:33.701423 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:33.701423 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:33.701423 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:33.701423 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:33.701423 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:33.701423 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:33.701423 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:33.701423 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:33.701423 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:33.701423 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:33.701423 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:33.701423 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:33.702464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:33.702464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:33.702464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:33.702464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:33.702464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:33.702464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:33.702464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:33.702464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:33.702464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:33.702464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:33.702464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:33.702464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:33.702464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:33.702464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:33.702464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:33.702464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:33.702464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:33.703470 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:33.703470 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:33.703470 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:33.703470 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:33.703470 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 369/747] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:33.703470 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b561b-1194-4fd0-b66c-b9e073b21daf None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:33.713112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561d331-df31-4270-a8c3-c74dc0001b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:33.713827 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561d331-df31-4270-a8c3-c74dc0001b87 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:33.714126 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561d331-df31-4270-a8c3-c74dc0001b87 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:33.714408 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561d331-df31-4270-a8c3-c74dc0001b87 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:33.715152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561d331-df31-4270-a8c3-c74dc0001b87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:33.716031 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561d331-df31-4270-a8c3-c74dc0001b87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:33.717686 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561d331-df31-4270-a8c3-c74dc0001b87 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:33.729730 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 379/748] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:33.731088 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae03a4-4b5c-4165-82e2-05b387fdc67a None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:33.731088 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae03a4-4b5c-4165-82e2-05b387fdc67a None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:33.732354 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae03a4-4b5c-4165-82e2-05b387fdc67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:33.751329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-b8ae03a4-4b5c-4165-82e2-05b387fdc67a None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:33.752552 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-b8ae03a4-4b5c-4165-82e2-05b387fdc67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:33.815672 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b561b-1194-4fd0-b66c-b9e073b21daf None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:33.829437 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 380/749] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 09 15:47:33.829437 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae03a4-4b5c-4165-82e2-05b387fdc67a None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:33.860146 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ca67f-6dbc-46b7-9c94-7a7de1181a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:33.860850 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ca67f-6dbc-46b7-9c94-7a7de1181a26 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:33.861139 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ca67f-6dbc-46b7-9c94-7a7de1181a26 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:33.861452 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ca67f-6dbc-46b7-9c94-7a7de1181a26 None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:33.862215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ca67f-6dbc-46b7-9c94-7a7de1181a26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:33.862519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ca67f-6dbc-46b7-9c94-7a7de1181a26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:33.864067 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ca67f-6dbc-46b7-9c94-7a7de1181a26 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:33.876950 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 370/750] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:33.877908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ca67f-6dbc-46b7-9c94-7a7de1181a26 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:33.950664 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae03a4-4b5c-4165-82e2-05b387fdc67a None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:33.982270 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ca67f-6dbc-46b7-9c94-7a7de1181a26 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:33.984187 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5052d5d-ffe9-4d39-90df-d2cdb175e1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:33.984867 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5052d5d-ffe9-4d39-90df-d2cdb175e1d8 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:33.985152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5052d5d-ffe9-4d39-90df-d2cdb175e1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:33.985466 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5052d5d-ffe9-4d39-90df-d2cdb175e1d8 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:33.986210 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5052d5d-ffe9-4d39-90df-d2cdb175e1d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:33.986518 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5052d5d-ffe9-4d39-90df-d2cdb175e1d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:33.987913 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5052d5d-ffe9-4d39-90df-d2cdb175e1d8 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:34.000744 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 381/751] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:34.002049 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5052d5d-ffe9-4d39-90df-d2cdb175e1d8 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:34.022834 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535b557-ccb8-474c-9fbc-90b74921ab76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:34.023642 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535b557-ccb8-474c-9fbc-90b74921ab76 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:34.023926 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535b557-ccb8-474c-9fbc-90b74921ab76 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:34.024638 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535b557-ccb8-474c-9fbc-90b74921ab76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:34.032145 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535b557-ccb8-474c-9fbc-90b74921ab76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:34.033605 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535b557-ccb8-474c-9fbc-90b74921ab76 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:34.047020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-0535b557-ccb8-474c-9fbc-90b74921ab76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:34.047020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:34.047020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:34.047020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:34.047020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:34.047020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:34.047020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:34.047020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:34.047020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:34.047020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:34.047020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:34.047020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:34.047020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:34.047020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:34.047020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:34.048228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:34.048228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:34.048228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:34.048228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:34.048228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:34.048228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:34.048228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:34.048228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:34.048228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:34.048228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:34.048228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:34.048228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:34.048228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:34.048228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:34.048228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:34.048228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:34.048228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:34.049337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:34.049337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:34.049337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:34.049337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:34.049337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:34.049337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:34.049337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:34.049337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:34.049337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 371/752] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:34.049337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535b557-ccb8-474c-9fbc-90b74921ab76 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:34.113853 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5052d5d-ffe9-4d39-90df-d2cdb175e1d8 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:34.151360 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc97aa5-9234-4c87-8fce-c7c307c44785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:34.152036 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc97aa5-9234-4c87-8fce-c7c307c44785 None admin] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:34.152327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc97aa5-9234-4c87-8fce-c7c307c44785 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:34.152607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc97aa5-9234-4c87-8fce-c7c307c44785 None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:34.154114 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc97aa5-9234-4c87-8fce-c7c307c44785 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:34.155859 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc97aa5-9234-4c87-8fce-c7c307c44785 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:34.162532 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535b557-ccb8-474c-9fbc-90b74921ab76 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:34.181721 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 382/753] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:47:34 2022] POST /identity/v3/services => generated 240 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:47:34.181721 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc97aa5-9234-4c87-8fce-c7c307c44785 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:34.217401 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b88de-d8d6-4833-b9b8-a349a16df9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:34.218252 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b88de-d8d6-4833-b9b8-a349a16df9e6 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:34.218541 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b88de-d8d6-4833-b9b8-a349a16df9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:34.218820 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b88de-d8d6-4833-b9b8-a349a16df9e6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:34.229567 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b88de-d8d6-4833-b9b8-a349a16df9e6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:34.231056 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b88de-d8d6-4833-b9b8-a349a16df9e6 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:34.246859 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-5b9b88de-d8d6-4833-b9b8-a349a16df9e6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:47:34.246859 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:34.246859 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:34.246859 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:34.246859 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:34.246859 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:34.246859 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:34.246859 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:34.246859 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:34.246859 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:34.246859 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:34.246859 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:34.246859 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:34.246859 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:34.246859 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:34.246859 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:34.248136 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:34.248136 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:34.248136 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:34.248136 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:34.248136 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:34.248136 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:34.248136 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:34.248136 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:34.248136 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:34.248136 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:34.248136 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:34.248136 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:34.248136 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:34.248136 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:34.248136 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:34.248136 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:34.248136 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:34.248136 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:34.249745 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:34.249745 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:34.249745 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:34.249745 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:34.249745 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:34.249745 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:34.249745 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:34.249745 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:34.249745 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:47:34.249745 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:34.253240 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 372/754] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:47:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:34.254423 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b88de-d8d6-4833-b9b8-a349a16df9e6 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:34.336255 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc97aa5-9234-4c87-8fce-c7c307c44785 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:34.368490 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b88de-d8d6-4833-b9b8-a349a16df9e6 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:34.385077 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0701b99-db28-4546-ba79-0605a833513f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:34.386475 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0701b99-db28-4546-ba79-0605a833513f None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:34.387008 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0701b99-db28-4546-ba79-0605a833513f None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:34.388724 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0701b99-db28-4546-ba79-0605a833513f None admin] PATH_INFO: `/v3/projects/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:34.396921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0701b99-db28-4546-ba79-0605a833513f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:34.398781 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0701b99-db28-4546-ba79-0605a833513f None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:34.412347 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e0d77-0d00-43ad-a67f-eb9daa77b28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:34.413022 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e0d77-0d00-43ad-a67f-eb9daa77b28d None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:34.413310 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e0d77-0d00-43ad-a67f-eb9daa77b28d None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:34.413666 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e0d77-0d00-43ad-a67f-eb9daa77b28d None admin] PATH_INFO: `/v3/projects` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:34.414486 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e0d77-0d00-43ad-a67f-eb9daa77b28d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:34.414801 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e0d77-0d00-43ad-a67f-eb9daa77b28d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:34.416236 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e0d77-0d00-43ad-a67f-eb9daa77b28d None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:34.416545 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-e0701b99-db28-4546-ba79-0605a833513f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:34.416545 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:34.416545 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:34.416545 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:34.416545 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:34.416545 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:34.416545 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:34.416545 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:34.416545 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:34.416545 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:34.416545 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:34.416545 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:34.416545 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:34.416545 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:34.416545 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:34.417520 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:34.417520 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:34.417520 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:34.417520 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:34.417520 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:34.417520 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:34.417520 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:34.417520 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:34.417520 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:34.417520 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:34.417520 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:34.417520 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:34.417520 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:34.417520 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:34.417520 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:34.417520 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:34.417520 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:34.418525 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:34.418525 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:34.418525 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:34.418525 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:34.418525 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:34.418525 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:34.418525 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:34.418525 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:34.422047 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 383/755] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:34.422904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0701b99-db28-4546-ba79-0605a833513f None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:34.439191 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 373/756] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:34.440704 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e0d77-0d00-43ad-a67f-eb9daa77b28d None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:34.536624 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0701b99-db28-4546-ba79-0605a833513f None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:34.553867 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e0d77-0d00-43ad-a67f-eb9daa77b28d None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:34.574500 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0657ba2-5b42-479b-a6b3-7b0d95e0dbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:34.575512 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0657ba2-5b42-479b-a6b3-7b0d95e0dbe1 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:34.576153 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0657ba2-5b42-479b-a6b3-7b0d95e0dbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:34.576607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0657ba2-5b42-479b-a6b3-7b0d95e0dbe1 None admin] PATH_INFO: `/v3/users` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:34.577715 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0657ba2-5b42-479b-a6b3-7b0d95e0dbe1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:34.578184 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0657ba2-5b42-479b-a6b3-7b0d95e0dbe1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:34.579809 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0657ba2-5b42-479b-a6b3-7b0d95e0dbe1 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:34.590438 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79158968-5b01-440d-bc14-9572c01bbe51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:34.591968 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79158968-5b01-440d-bc14-9572c01bbe51 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:34.592366 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79158968-5b01-440d-bc14-9572c01bbe51 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:34.592655 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79158968-5b01-440d-bc14-9572c01bbe51 None admin] PATH_INFO: `/v3/projects` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:34.593538 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79158968-5b01-440d-bc14-9572c01bbe51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:34.593866 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79158968-5b01-440d-bc14-9572c01bbe51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:34.595324 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79158968-5b01-440d-bc14-9572c01bbe51 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:34.603147 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 384/757] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 9 15:47:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:34.604326 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0657ba2-5b42-479b-a6b3-7b0d95e0dbe1 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:34.610917 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 374/758] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:34.611836 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79158968-5b01-440d-bc14-9572c01bbe51 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:34.726971 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0657ba2-5b42-479b-a6b3-7b0d95e0dbe1 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:34.727588 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79158968-5b01-440d-bc14-9572c01bbe51 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:34.771755 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf5bbe-308e-4469-b006-0f248399deab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:34.771755 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf5bbe-308e-4469-b006-0f248399deab None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:34.771755 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf5bbe-308e-4469-b006-0f248399deab None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:34.771755 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf5bbe-308e-4469-b006-0f248399deab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:34.772251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf5bbe-308e-4469-b006-0f248399deab None admin] RBAC: Adding query filter params (role.id=a6f10c1ca57b4299bb809b5bcc8797f5, scope.project.id=7860d281acf642d2a3950424901b9487, user.id=64be0f5d9f1948e08b530b618245b6d0) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:34.772251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf5bbe-308e-4469-b006-0f248399deab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:34.772251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf5bbe-308e-4469-b006-0f248399deab None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:34.772483 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d04ea-74ca-40ce-8bef-9022be93768e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:34.772483 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d04ea-74ca-40ce-8bef-9022be93768e None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:34.772483 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d04ea-74ca-40ce-8bef-9022be93768e None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:34.772483 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d04ea-74ca-40ce-8bef-9022be93768e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:34.779443 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 385/759] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:47:34 2022] GET /identity/v3/role_assignments?user.id=64be0f5d9f1948e08b530b618245b6d0&scope.project.id=7860d281acf642d2a3950424901b9487&role.id=a6f10c1ca57b4299bb809b5bcc8797f5 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:34.780522 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf5bbe-308e-4469-b006-0f248399deab None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:34.881608 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d04ea-74ca-40ce-8bef-9022be93768e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:34.884278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d04ea-74ca-40ce-8bef-9022be93768e None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:34.921995 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf5bbe-308e-4469-b006-0f248399deab None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:34.969802 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea2cb2-0322-412f-a76e-25468b6ee2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:34.971612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea2cb2-0322-412f-a76e-25468b6ee2ee None admin] REQUEST_METHOD: `PUT` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:34.972130 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea2cb2-0322-412f-a76e-25468b6ee2ee None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:34.972525 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea2cb2-0322-412f-a76e-25468b6ee2ee None admin] PATH_INFO: `/v3/projects/7860d281acf642d2a3950424901b9487/users/adf919c3ba31488694c724a803ca51eb/roles/2180d183afad443187521833c40ed8a1` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:34.975871 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea2cb2-0322-412f-a76e-25468b6ee2ee None admin] RBAC: Authorizing `identity:create_grant(project_id=7860d281acf642d2a3950424901b9487, user_id=adf919c3ba31488694c724a803ca51eb, role_id=2180d183afad443187521833c40ed8a1)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:34.978460 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea2cb2-0322-412f-a76e-25468b6ee2ee None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:34.999045 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 386/760] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:47:34 2022] PUT /identity/v3/projects/7860d281acf642d2a3950424901b9487/users/adf919c3ba31488694c724a803ca51eb/roles/2180d183afad443187521833c40ed8a1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:47:35.001652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19776d0-7880-41f1-be43-74aaad68e086 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:35.002069 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19776d0-7880-41f1-be43-74aaad68e086 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:35.002742 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19776d0-7880-41f1-be43-74aaad68e086 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:35.005397 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 387/761] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:35.011293 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310b087-6658-407c-af48-b0c2aae03bc7 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:35.011804 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310b087-6658-407c-af48-b0c2aae03bc7 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:35.012236 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310b087-6658-407c-af48-b0c2aae03bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:35.054127 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 375/762] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:47:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:47:35.055963 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-3310b087-6658-407c-af48-b0c2aae03bc7 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:35.057734 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d04ea-74ca-40ce-8bef-9022be93768e None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:35.063249 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-3310b087-6658-407c-af48-b0c2aae03bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:35.218060 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d04ea-74ca-40ce-8bef-9022be93768e None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:35.224226 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 388/763] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:47:35.259666 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18cab25-8b34-4179-8d02-db1746b57721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:35.260556 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cab25-8b34-4179-8d02-db1746b57721 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:35.260850 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cab25-8b34-4179-8d02-db1746b57721 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:35.261136 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cab25-8b34-4179-8d02-db1746b57721 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:35.267152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310b087-6658-407c-af48-b0c2aae03bc7 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:35.273225 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18cab25-8b34-4179-8d02-db1746b57721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:35.274762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18cab25-8b34-4179-8d02-db1746b57721 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:35.296506 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-d18cab25-8b34-4179-8d02-db1746b57721 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:35.296506 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:35.296506 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:35.296506 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:35.296506 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:35.296506 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:35.296506 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:35.296506 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:35.296506 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:35.296506 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:35.296506 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:35.296506 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:35.296506 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:35.296506 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:35.296506 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:35.298732 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:35.298732 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:35.298732 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:35.298732 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:35.298732 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:35.298732 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:35.298732 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:35.298732 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:35.298732 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:35.298732 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:35.298732 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:35.298732 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:35.298732 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:35.298732 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:35.298732 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:35.298732 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:35.298732 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:35.300119 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:35.300119 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:35.300119 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:35.300119 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:35.300119 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 376/764] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:35.304135 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18cab25-8b34-4179-8d02-db1746b57721 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:35.426036 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310b087-6658-407c-af48-b0c2aae03bc7 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:35.455421 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18cab25-8b34-4179-8d02-db1746b57721 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:35.476019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822f897-d058-4cf8-8ea5-49682f7b02af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:35.476769 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822f897-d058-4cf8-8ea5-49682f7b02af None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:35.477056 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822f897-d058-4cf8-8ea5-49682f7b02af None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:35.477335 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822f897-d058-4cf8-8ea5-49682f7b02af None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:35.478573 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822f897-d058-4cf8-8ea5-49682f7b02af None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:35.479966 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822f897-d058-4cf8-8ea5-49682f7b02af None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:35.495306 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8e988-6a18-4ab6-8b93-9420512bc097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:35.495982 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8e988-6a18-4ab6-8b93-9420512bc097 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:35.496273 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8e988-6a18-4ab6-8b93-9420512bc097 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:35.496559 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8e988-6a18-4ab6-8b93-9420512bc097 None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:35.498217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8e988-6a18-4ab6-8b93-9420512bc097 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:35.498532 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8e988-6a18-4ab6-8b93-9420512bc097 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:35.499922 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8e988-6a18-4ab6-8b93-9420512bc097 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:35.501118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-8822f897-d058-4cf8-8ea5-49682f7b02af None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:47:35.501118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:35.501118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:47:35.501118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:47:35.501118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:47:35.501118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:47:35.501118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:47:35.501118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:35.501118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:47:35.501118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:35.501118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:47:35.501118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:35.501118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:35.501118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:35.501118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:35.501118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:35.503552 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:35.503552 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:35.503552 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:35.503552 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:35.503552 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:35.503552 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:35.503552 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:35.503552 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:47:35.503552 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:47:35.503552 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:47:35.503552 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:47:35.503552 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:35.503552 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:35.503552 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:35.503552 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:35.503552 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:35.505968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:35.505968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:35.505968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:35.505968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:35.505968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:35.505968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:35.505968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:35.505968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:35.505968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:35.505968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:35.505968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:35.505968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:47:35.505968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:35.505968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:47:35.505968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:35.505968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 389/765] 10.222.0.48 () {56 vars in 1129 bytes} [Mon May 9 15:47:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:35.513411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822f897-d058-4cf8-8ea5-49682f7b02af None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:35.517843 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 377/766] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:47:35.523632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8e988-6a18-4ab6-8b93-9420512bc097 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:35.651791 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8e988-6a18-4ab6-8b93-9420512bc097 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:35.691187 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a40efa-984f-4dd8-ad28-d5a03d19337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:35.692006 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a40efa-984f-4dd8-ad28-d5a03d19337e None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:35.692303 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a40efa-984f-4dd8-ad28-d5a03d19337e None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:35.692636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a40efa-984f-4dd8-ad28-d5a03d19337e None admin] PATH_INFO: `/v3/projects/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:35.701739 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a40efa-984f-4dd8-ad28-d5a03d19337e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:35.703275 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a40efa-984f-4dd8-ad28-d5a03d19337e None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:35.719500 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-39a40efa-984f-4dd8-ad28-d5a03d19337e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:35.719500 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:35.719500 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:35.719500 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:35.719500 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:35.719500 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:35.719500 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:35.719500 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:35.719500 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:35.719500 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:35.719500 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:35.719500 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:35.719500 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:35.719500 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:35.719500 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:35.720612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:35.720612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:35.720612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:35.720612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:35.720612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:35.720612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:35.720612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:35.720612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:35.720612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:35.720612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:35.720612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:35.720612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:35.720612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:35.720612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:35.720612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:35.720612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:35.720612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:35.721937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:35.721937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:35.721937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:35.721937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:35.721937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:35.721937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:35.721937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:35.721937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:35.721937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 378/767] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:35.726518 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a40efa-984f-4dd8-ad28-d5a03d19337e None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:35.734792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822f897-d058-4cf8-8ea5-49682f7b02af None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:35.807109 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad31c5-2128-44dc-921b-b9e78ae848a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:35.807802 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad31c5-2128-44dc-921b-b9e78ae848a6 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:35.808092 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad31c5-2128-44dc-921b-b9e78ae848a6 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:35.808375 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad31c5-2128-44dc-921b-b9e78ae848a6 None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:35.809116 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad31c5-2128-44dc-921b-b9e78ae848a6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:35.810188 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad31c5-2128-44dc-921b-b9e78ae848a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:35.811738 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad31c5-2128-44dc-921b-b9e78ae848a6 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:35.823897 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 390/768] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 9 15:47:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:47:35.829490 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad31c5-2128-44dc-921b-b9e78ae848a6 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:35.845411 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a40efa-984f-4dd8-ad28-d5a03d19337e None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:35.882811 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f71814-41f1-4457-a777-48e4a7b14238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:35.883492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f71814-41f1-4457-a777-48e4a7b14238 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:35.883787 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f71814-41f1-4457-a777-48e4a7b14238 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:35.884068 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f71814-41f1-4457-a777-48e4a7b14238 None admin] PATH_INFO: `/v3/projects` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:35.884880 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f71814-41f1-4457-a777-48e4a7b14238 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:35.885238 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f71814-41f1-4457-a777-48e4a7b14238 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:35.886793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f71814-41f1-4457-a777-48e4a7b14238 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:35.901530 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 379/769] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:35.908631 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f71814-41f1-4457-a777-48e4a7b14238 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:36.006043 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad31c5-2128-44dc-921b-b9e78ae848a6 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:36.049332 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f0c86-3f9d-4398-91b1-1c735b72c9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:36.050062 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f0c86-3f9d-4398-91b1-1c735b72c9bb None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:36.050353 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f0c86-3f9d-4398-91b1-1c735b72c9bb None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:36.050637 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f0c86-3f9d-4398-91b1-1c735b72c9bb None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:36.053403 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f0c86-3f9d-4398-91b1-1c735b72c9bb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:36.053403 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f0c86-3f9d-4398-91b1-1c735b72c9bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:36.053904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f0c86-3f9d-4398-91b1-1c735b72c9bb None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:36.061579 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 391/770] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 9 15:47:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:47:36.069155 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f0c86-3f9d-4398-91b1-1c735b72c9bb None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:36.167871 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f71814-41f1-4457-a777-48e4a7b14238 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:36.207666 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7836dc-dccc-44fa-afa3-23a07ed594bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:36.208345 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7836dc-dccc-44fa-afa3-23a07ed594bd None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:36.208629 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7836dc-dccc-44fa-afa3-23a07ed594bd None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:36.208910 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7836dc-dccc-44fa-afa3-23a07ed594bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:36.209801 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7836dc-dccc-44fa-afa3-23a07ed594bd None admin] RBAC: Adding query filter params (role.id=2180d183afad443187521833c40ed8a1, scope.project.id=7860d281acf642d2a3950424901b9487, user.id=95f73edea88646ab9b1e2f3b0fea34c0) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:36.210120 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7836dc-dccc-44fa-afa3-23a07ed594bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:36.211653 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7836dc-dccc-44fa-afa3-23a07ed594bd None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:36.219177 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 380/771] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:47:35 2022] GET /identity/v3/role_assignments?user.id=95f73edea88646ab9b1e2f3b0fea34c0&scope.project.id=7860d281acf642d2a3950424901b9487&role.id=2180d183afad443187521833c40ed8a1 => generated 259 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:36.271589 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f0c86-3f9d-4398-91b1-1c735b72c9bb None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:36.328755 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad84d3a-d606-4251-99ae-4f0c53a8edbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:36.329470 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad84d3a-d606-4251-99ae-4f0c53a8edbd None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:36.329765 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad84d3a-d606-4251-99ae-4f0c53a8edbd None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:36.330046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad84d3a-d606-4251-99ae-4f0c53a8edbd None admin] PATH_INFO: `/v3/endpoints` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:36.330882 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad84d3a-d606-4251-99ae-4f0c53a8edbd None admin] RBAC: Adding query filter params (interface=public, service_id=0ee11e54714349ae8e3b91b494d1757a, region_id=RegionOne) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:36.331199 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad84d3a-d606-4251-99ae-4f0c53a8edbd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:36.332622 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad84d3a-d606-4251-99ae-4f0c53a8edbd None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:36.342501 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 392/772] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:47:36 2022] GET /identity/v3/endpoints?service_id=0ee11e54714349ae8e3b91b494d1757a&interface=public®ion_id=RegionOne => generated 194 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:36.347824 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7836dc-dccc-44fa-afa3-23a07ed594bd None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:36.502020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7836dc-dccc-44fa-afa3-23a07ed594bd None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:36.555360 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf39dc-64ed-4efb-87b1-c58e9737e2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:36.555981 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf39dc-64ed-4efb-87b1-c58e9737e2c4 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:36.556269 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf39dc-64ed-4efb-87b1-c58e9737e2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:36.556584 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf39dc-64ed-4efb-87b1-c58e9737e2c4 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:36.557299 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf39dc-64ed-4efb-87b1-c58e9737e2c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:36.558763 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf39dc-64ed-4efb-87b1-c58e9737e2c4 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:36.569579 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 381/773] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:47:36 2022] GET /identity/v3/services => generated 772 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:37.134046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ad3db-e2e4-44a6-8003-1f0b6aeadd20 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:37.134618 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ad3db-e2e4-44a6-8003-1f0b6aeadd20 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:37.134721 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ad3db-e2e4-44a6-8003-1f0b6aeadd20 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:37.136475 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 393/774] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:37.163834 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e8bf7-4f71-43b4-9bbf-020298ee51a7 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:37.164244 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e8bf7-4f71-43b4-9bbf-020298ee51a7 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:37.164434 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e8bf7-4f71-43b4-9bbf-020298ee51a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:37.190669 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-461e8bf7-4f71-43b4-9bbf-020298ee51a7 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:37.192070 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-461e8bf7-4f71-43b4-9bbf-020298ee51a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:37.294332 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 382/775] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:47:37.325080 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ad3db-e2e4-44a6-8003-1f0b6aeadd20 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:37.475233 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ad3db-e2e4-44a6-8003-1f0b6aeadd20 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:37.516807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267c38d-75b2-4c0d-b042-287b34db287b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:37.518077 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267c38d-75b2-4c0d-b042-287b34db287b None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:37.518603 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267c38d-75b2-4c0d-b042-287b34db287b None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:37.519122 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267c38d-75b2-4c0d-b042-287b34db287b None admin] PATH_INFO: `/v3/services/network` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:37.520047 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267c38d-75b2-4c0d-b042-287b34db287b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:37.521818 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267c38d-75b2-4c0d-b042-287b34db287b None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:37.535585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-4267c38d-75b2-4c0d-b042-287b34db287b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:47:37.535585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:37.535585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:47:37.535585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:47:37.535585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:47:37.535585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:47:37.535585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:47:37.535585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:37.535585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:47:37.535585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:37.535585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:47:37.535585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:37.535585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:37.535585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:37.535585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:37.535585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:37.535585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:37.536775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:37.536775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:37.536775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:37.536775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:37.536775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:37.536775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:37.536775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:47:37.536775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:47:37.536775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:47:37.536775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:47:37.536775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:37.536775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:37.536775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:37.536775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:37.536775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:37.536775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:37.537723 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:37.537723 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:37.537723 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:37.537723 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:37.537723 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:37.537723 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:37.537723 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:37.537723 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:37.537723 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:37.537723 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:37.537723 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:47:37.537723 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:37.537723 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:47:37.537723 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:37.541280 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 394/776] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:37 2022] GET /identity/v3/services/network => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:37.550666 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e8bf7-4f71-43b4-9bbf-020298ee51a7 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:37.706373 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e8bf7-4f71-43b4-9bbf-020298ee51a7 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:37.745776 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e1956-53db-436c-bfdc-32f3cf24aca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:37.746452 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e1956-53db-436c-bfdc-32f3cf24aca7 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:37.746784 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e1956-53db-436c-bfdc-32f3cf24aca7 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:37.747074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e1956-53db-436c-bfdc-32f3cf24aca7 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:37.747884 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e1956-53db-436c-bfdc-32f3cf24aca7 None admin] RBAC: Adding query filter params (name=network) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:37.748254 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e1956-53db-436c-bfdc-32f3cf24aca7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:37.749673 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e1956-53db-436c-bfdc-32f3cf24aca7 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:37.755492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 383/777] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:47:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:37.761195 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267c38d-75b2-4c0d-b042-287b34db287b None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:37.853254 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d19de-13c8-4947-8fe1-4ba01204613e None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:37.854028 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d19de-13c8-4947-8fe1-4ba01204613e None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:37.854569 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d19de-13c8-4947-8fe1-4ba01204613e None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:37.856806 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 384/778] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:37.864821 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822f93c-d708-4c15-8d23-4767224f49cf None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:37.865150 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822f93c-d708-4c15-8d23-4767224f49cf None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:37.865398 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822f93c-d708-4c15-8d23-4767224f49cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:37.889348 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-4822f93c-d708-4c15-8d23-4767224f49cf None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:37.891550 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-4822f93c-d708-4c15-8d23-4767224f49cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:37.989407 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267c38d-75b2-4c0d-b042-287b34db287b None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:38.035300 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 385/779] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:47:38.049529 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991228cc-de47-4827-88c7-73b00e2c3464 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:38.049949 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991228cc-de47-4827-88c7-73b00e2c3464 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:38.050236 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991228cc-de47-4827-88c7-73b00e2c3464 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:38.052100 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 386/780] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:47:38.058466 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b0b99-ce0a-43d0-b885-07ef0461afd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:38.059643 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b0b99-ce0a-43d0-b885-07ef0461afd2 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:38.060146 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b0b99-ce0a-43d0-b885-07ef0461afd2 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:38.060723 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b0b99-ce0a-43d0-b885-07ef0461afd2 None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:38.060941 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b25252-9653-4bf1-a799-c91086fe697c None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:38.061208 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b25252-9653-4bf1-a799-c91086fe697c None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:38.061523 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b25252-9653-4bf1-a799-c91086fe697c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:38.062051 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b0b99-ce0a-43d0-b885-07ef0461afd2 None admin] RBAC: Adding query filter params (type=network) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:38.062593 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b0b99-ce0a-43d0-b885-07ef0461afd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:38.065408 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b0b99-ce0a-43d0-b885-07ef0461afd2 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:38.075092 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 395/781] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:47:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:38.076376 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b0b99-ce0a-43d0-b885-07ef0461afd2 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:38.097043 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-18b25252-9653-4bf1-a799-c91086fe697c None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:38.098824 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-18b25252-9653-4bf1-a799-c91086fe697c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:38.185401 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 387/782] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:47:38.185401 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b25252-9653-4bf1-a799-c91086fe697c None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:38.222443 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b0b99-ce0a-43d0-b885-07ef0461afd2 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:38.258357 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaee968-7689-406d-a0c2-34e5a425cc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:38.259163 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaee968-7689-406d-a0c2-34e5a425cc97 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:38.259444 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaee968-7689-406d-a0c2-34e5a425cc97 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:38.259719 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaee968-7689-406d-a0c2-34e5a425cc97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:38.273471 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaee968-7689-406d-a0c2-34e5a425cc97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:38.284613 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-3aaee968-7689-406d-a0c2-34e5a425cc97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:38.284613 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:38.284613 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:38.284613 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:38.284613 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:38.284613 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:38.284613 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:38.284613 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:38.284613 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:38.284613 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:38.284613 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:38.284613 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:38.284613 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:38.284613 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:38.284613 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:38.284613 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:38.295283 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:38.295283 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:38.295283 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:38.295283 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:38.295283 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:38.295283 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:38.295283 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:38.295283 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:38.295283 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:38.295283 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:38.295283 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:38.295283 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:38.295283 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:38.295283 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:38.295283 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:38.295283 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:38.297177 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:38.297177 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:38.297177 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:38.297177 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:38.297177 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:38.297177 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:38.297177 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:38.297177 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:38.297177 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:38.297177 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:38.297177 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:38.297177 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:38.297177 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 396/783] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:47:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:38.297177 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaee968-7689-406d-a0c2-34e5a425cc97 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:38.328215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b25252-9653-4bf1-a799-c91086fe697c None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:38.367014 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77990490-b18b-4902-af3b-084c4e44c4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:38.368127 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77990490-b18b-4902-af3b-084c4e44c4c6 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:38.368651 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77990490-b18b-4902-af3b-084c4e44c4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:38.369175 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77990490-b18b-4902-af3b-084c4e44c4c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:38.370280 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77990490-b18b-4902-af3b-084c4e44c4c6 None admin] RBAC: Adding query filter params (interface=public, service_id=fbd966b1c2624d47a8322e950bcd02bf, region_id=RegionOne) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:38.370840 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77990490-b18b-4902-af3b-084c4e44c4c6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:38.373743 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77990490-b18b-4902-af3b-084c4e44c4c6 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:38.392633 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 388/784] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:47:38 2022] GET /identity/v3/endpoints?service_id=fbd966b1c2624d47a8322e950bcd02bf&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:38.392633 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77990490-b18b-4902-af3b-084c4e44c4c6 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:38.431719 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaee968-7689-406d-a0c2-34e5a425cc97 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:38.477437 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f463d6-262e-4c07-85a0-f05ea26f4bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:38.478243 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f463d6-262e-4c07-85a0-f05ea26f4bdd None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:38.478524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f463d6-262e-4c07-85a0-f05ea26f4bdd None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:38.478805 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f463d6-262e-4c07-85a0-f05ea26f4bdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:38.490316 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f463d6-262e-4c07-85a0-f05ea26f4bdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:38.498395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-f3f463d6-262e-4c07-85a0-f05ea26f4bdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:47:38.498395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:38.498395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:38.498395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:38.498395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:38.498395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:38.498395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:38.498395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:38.498395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:38.498395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:38.498395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:38.498395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:38.498395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:38.498395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:38.498395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:38.498395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:38.499478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:38.499478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:38.499478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:38.499478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:38.499478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:38.499478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:38.499478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:38.499478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:38.499478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:38.499478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:38.499478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:38.499478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:38.499478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:38.499478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:38.499478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:38.499478 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:38.500693 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:38.500693 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:38.500693 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:38.500693 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:38.500693 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:38.500693 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:38.500693 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:38.500693 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:38.500693 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:38.500693 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:38.500693 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:47:38.500693 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:38.504833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 397/785] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:47:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:38.505756 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f463d6-262e-4c07-85a0-f05ea26f4bdd None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:38.516229 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77990490-b18b-4902-af3b-084c4e44c4c6 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:38.565797 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6037266-aad9-4659-a0c1-4ed40d3fe934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:38.567173 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6037266-aad9-4659-a0c1-4ed40d3fe934 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:38.567702 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6037266-aad9-4659-a0c1-4ed40d3fe934 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:38.568378 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6037266-aad9-4659-a0c1-4ed40d3fe934 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:38.569993 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6037266-aad9-4659-a0c1-4ed40d3fe934 None admin] RBAC: Adding query filter params (name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:38.570663 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6037266-aad9-4659-a0c1-4ed40d3fe934 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:38.572777 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6037266-aad9-4659-a0c1-4ed40d3fe934 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:38.589456 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 389/786] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:47:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:38.591643 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6037266-aad9-4659-a0c1-4ed40d3fe934 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:38.638762 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f463d6-262e-4c07-85a0-f05ea26f4bdd None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:38.678112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce3c80-68a9-45f7-a434-ec59c4adb45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:38.678584 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce3c80-68a9-45f7-a434-ec59c4adb45e None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:38.678788 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce3c80-68a9-45f7-a434-ec59c4adb45e None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:38.679144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce3c80-68a9-45f7-a434-ec59c4adb45e None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:38.679727 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce3c80-68a9-45f7-a434-ec59c4adb45e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:38.681179 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce3c80-68a9-45f7-a434-ec59c4adb45e None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:38.689528 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 398/787] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:47:38 2022] GET /identity/v3/services => generated 772 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:38.689528 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce3c80-68a9-45f7-a434-ec59c4adb45e None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:38.818614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6037266-aad9-4659-a0c1-4ed40d3fe934 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:38.905877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c2dbc-bf98-40ed-aec5-732dc5b676a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:38.907790 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c2dbc-bf98-40ed-aec5-732dc5b676a3 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:38.910033 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c2dbc-bf98-40ed-aec5-732dc5b676a3 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:38.911219 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c2dbc-bf98-40ed-aec5-732dc5b676a3 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:38.917778 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c2dbc-bf98-40ed-aec5-732dc5b676a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:38.920592 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c2dbc-bf98-40ed-aec5-732dc5b676a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:38.926022 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c2dbc-bf98-40ed-aec5-732dc5b676a3 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:38.959010 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 390/788] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:47:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:38.964920 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c2dbc-bf98-40ed-aec5-732dc5b676a3 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:39.167491 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c2dbc-bf98-40ed-aec5-732dc5b676a3 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:39.251592 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a5e20-acfe-4328-b0fe-1b8d2a4adb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:39.253569 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a5e20-acfe-4328-b0fe-1b8d2a4adb40 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:39.254064 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a5e20-acfe-4328-b0fe-1b8d2a4adb40 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:39.254611 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a5e20-acfe-4328-b0fe-1b8d2a4adb40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:39.260121 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce3c80-68a9-45f7-a434-ec59c4adb45e None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:39.279431 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a5e20-acfe-4328-b0fe-1b8d2a4adb40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:39.283223 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a5e20-acfe-4328-b0fe-1b8d2a4adb40 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:39.320519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-454a5e20-acfe-4328-b0fe-1b8d2a4adb40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:39.320519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:39.320519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:39.320519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:39.320519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:39.320519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:39.320519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:39.320519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:39.320519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:39.320519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:39.320519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:39.320519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:39.320519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:39.320519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:39.320519 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:39.322480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:39.322480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:39.322480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:39.322480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:39.322480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:39.322480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:39.322480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:39.322480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:39.322480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:39.322480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:39.322480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:39.322480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:39.322480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:39.322480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:39.322480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:39.322480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:39.322480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:39.326564 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:39.326564 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:39.326564 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:39.326564 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:39.326564 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 391/789] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:39.333823 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a5e20-acfe-4328-b0fe-1b8d2a4adb40 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:39.354732 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b6a01-52d1-4d3b-ba60-75573753dfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:39.355547 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b6a01-52d1-4d3b-ba60-75573753dfc7 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:39.355827 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b6a01-52d1-4d3b-ba60-75573753dfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:39.361733 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b6a01-52d1-4d3b-ba60-75573753dfc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:39.386676 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b6a01-52d1-4d3b-ba60-75573753dfc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:39.389156 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b6a01-52d1-4d3b-ba60-75573753dfc7 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:39.427459 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-a82b6a01-52d1-4d3b-ba60-75573753dfc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:39.427459 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:39.427459 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:39.427459 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:39.427459 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:39.427459 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:39.427459 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:39.427459 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:39.427459 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:39.427459 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:39.427459 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:39.427459 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:39.427459 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:39.427459 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:39.427459 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:39.429307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:39.429307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:39.429307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:39.429307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:39.429307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:39.429307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:39.429307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:39.429307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:39.429307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:39.429307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:39.429307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:39.429307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:39.429307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:39.429307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:39.429307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:39.429307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:39.429307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:39.431220 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:39.431220 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:39.431220 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:39.431220 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:39.441538 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 399/790] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 747 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:39.445351 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b6a01-52d1-4d3b-ba60-75573753dfc7 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:39.568953 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a5e20-acfe-4328-b0fe-1b8d2a4adb40 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:39.651708 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a6ffd-e0d8-47ad-8827-a595998c4ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:39.652903 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a6ffd-e0d8-47ad-8827-a595998c4ec1 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:39.653994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a6ffd-e0d8-47ad-8827-a595998c4ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:39.654480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a6ffd-e0d8-47ad-8827-a595998c4ec1 None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:39.655831 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a6ffd-e0d8-47ad-8827-a595998c4ec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:39.656373 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a6ffd-e0d8-47ad-8827-a595998c4ec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:39.658961 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a6ffd-e0d8-47ad-8827-a595998c4ec1 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:39.673317 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b6a01-52d1-4d3b-ba60-75573753dfc7 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:39.709853 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 392/791] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:47:39.713402 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b38f26-a863-4f71-8406-174ec8257b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:39.714090 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b38f26-a863-4f71-8406-174ec8257b18 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:39.714384 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b38f26-a863-4f71-8406-174ec8257b18 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:39.714697 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b38f26-a863-4f71-8406-174ec8257b18 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:39.716054 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b38f26-a863-4f71-8406-174ec8257b18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:39.717078 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b38f26-a863-4f71-8406-174ec8257b18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:39.718611 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b38f26-a863-4f71-8406-174ec8257b18 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:39.721583 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a6ffd-e0d8-47ad-8827-a595998c4ec1 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:39.735992 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 400/792] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:39.738494 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c4638-1692-4203-a5ac-faa370f77be7 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:39.738999 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c4638-1692-4203-a5ac-faa370f77be7 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:39.739460 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c4638-1692-4203-a5ac-faa370f77be7 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:39.741650 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 401/793] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:39.747930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba7ef5-f986-44fc-87a8-5372c0b050d7 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:39.747930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba7ef5-f986-44fc-87a8-5372c0b050d7 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:39.748772 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba7ef5-f986-44fc-87a8-5372c0b050d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:39.769547 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-7aba7ef5-f986-44fc-87a8-5372c0b050d7 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:39.770863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-7aba7ef5-f986-44fc-87a8-5372c0b050d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:39.844318 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 402/794] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:47:39.846100 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba7ef5-f986-44fc-87a8-5372c0b050d7 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:39.918183 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a6ffd-e0d8-47ad-8827-a595998c4ec1 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:39.968809 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f7057-05bd-4290-920c-ae382a0eba8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:39.969591 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f7057-05bd-4290-920c-ae382a0eba8d None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:39.969886 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f7057-05bd-4290-920c-ae382a0eba8d None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:39.970169 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f7057-05bd-4290-920c-ae382a0eba8d None admin] PATH_INFO: `/v3/users/nova` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:39.978635 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f7057-05bd-4290-920c-ae382a0eba8d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:39.980146 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f7057-05bd-4290-920c-ae382a0eba8d None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:39.999039 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-496f7057-05bd-4290-920c-ae382a0eba8d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:47:39.999039 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:39.999039 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:39.999039 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:39.999039 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:39.999039 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:39.999039 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:39.999039 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:39.999039 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:39.999039 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:39.999039 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:39.999039 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:39.999039 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:39.999039 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:39.999039 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:39.999039 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:40.000468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:40.000468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:40.000468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:40.000468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:40.000468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:40.000468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:40.000468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:40.000468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:40.000468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:40.000468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:40.000468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:40.000468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:40.000468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:40.000468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:40.000468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:40.000468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:40.000468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:40.000468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:40.001597 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:40.001597 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:40.001597 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:40.001597 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:40.001597 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:40.001597 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:40.001597 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:40.001597 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:40.001597 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:47:40.001597 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:40.001597 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 393/795] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:47:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:47:40.002478 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f7057-05bd-4290-920c-ae382a0eba8d None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:40.009084 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba7ef5-f986-44fc-87a8-5372c0b050d7 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:40.061415 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304328a-89c1-4bd5-be26-058bff20d7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:40.062585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304328a-89c1-4bd5-be26-058bff20d7aa None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:40.063010 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304328a-89c1-4bd5-be26-058bff20d7aa None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:40.063434 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304328a-89c1-4bd5-be26-058bff20d7aa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:40.072981 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304328a-89c1-4bd5-be26-058bff20d7aa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:40.075095 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304328a-89c1-4bd5-be26-058bff20d7aa None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:40.095749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-a304328a-89c1-4bd5-be26-058bff20d7aa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:47:40.095749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:40.095749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:40.095749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:40.095749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:40.095749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:40.095749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:40.095749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:40.095749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:40.095749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:40.095749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:40.095749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:40.095749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:40.095749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:40.095749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:40.095749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:40.098410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:40.098410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:40.098410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:40.098410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:40.098410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:40.098410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:40.098410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:40.098410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:40.098410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:40.098410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:40.098410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:40.098410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:40.098410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:40.098410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:40.098410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:40.098410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:40.098410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:40.098410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:40.100494 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:40.100494 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:40.100494 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:40.100494 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:40.100494 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:40.100494 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:40.100494 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:40.100494 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:40.100494 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:47:40.100494 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:40.100494 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 403/796] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:47:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:40.100494 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10f94d-92e6-416c-a3c2-53bc515fff03 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:40.100494 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10f94d-92e6-416c-a3c2-53bc515fff03 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:40.109069 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10f94d-92e6-416c-a3c2-53bc515fff03 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:40.109069 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 404/797] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:40.109069 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10f94d-92e6-416c-a3c2-53bc515fff03 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:40.145699 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f7057-05bd-4290-920c-ae382a0eba8d None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:40.189138 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb89cbb-6e0c-480a-b091-edf499fa2aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:40.190241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb89cbb-6e0c-480a-b091-edf499fa2aba None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:40.190546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb89cbb-6e0c-480a-b091-edf499fa2aba None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:40.190859 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb89cbb-6e0c-480a-b091-edf499fa2aba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:40.204098 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb89cbb-6e0c-480a-b091-edf499fa2aba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:40.212117 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-edb89cbb-6e0c-480a-b091-edf499fa2aba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:47:40.212117 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:40.212117 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:40.212117 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:40.212117 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:40.212117 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:40.212117 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:40.212117 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:40.212117 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:40.212117 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:40.212117 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:40.212117 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:40.212117 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:40.212117 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:40.212117 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:40.212117 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:40.213180 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:40.213180 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:40.213180 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:40.213180 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:40.213180 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:40.213180 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:40.213180 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:40.213180 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:40.213180 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:40.213180 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:40.213180 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:40.213180 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:40.213180 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:40.213180 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:40.213180 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:40.213180 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:40.214200 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:40.214200 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:40.214200 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:40.214200 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:40.214200 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:40.214200 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:40.214200 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:40.214200 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:40.214200 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:40.214200 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:40.214200 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:47:40.214200 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:40.214200 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 394/798] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:47:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:40.216326 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb89cbb-6e0c-480a-b091-edf499fa2aba None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:40.258448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10f94d-92e6-416c-a3c2-53bc515fff03 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:40.296821 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f797c-f4c2-4e6e-bd6a-f349252eb7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:40.297969 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f797c-f4c2-4e6e-bd6a-f349252eb7bf None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:40.297969 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f797c-f4c2-4e6e-bd6a-f349252eb7bf None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:40.298429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f797c-f4c2-4e6e-bd6a-f349252eb7bf None admin] PATH_INFO: `/v3/users` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:40.299313 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f797c-f4c2-4e6e-bd6a-f349252eb7bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:40.299626 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f797c-f4c2-4e6e-bd6a-f349252eb7bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:40.301098 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f797c-f4c2-4e6e-bd6a-f349252eb7bf None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:40.321539 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 405/799] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:47:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:40.323375 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d91808-928f-4d43-86e5-8486647775fe None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:40.323913 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d91808-928f-4d43-86e5-8486647775fe None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:40.324434 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d91808-928f-4d43-86e5-8486647775fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:40.343638 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-50d91808-928f-4d43-86e5-8486647775fe None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:40.344902 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-50d91808-928f-4d43-86e5-8486647775fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:40.353000 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb89cbb-6e0c-480a-b091-edf499fa2aba None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:40.402403 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390dde3-abd8-4bf3-972b-ec8a3f0a0e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:40.403289 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390dde3-abd8-4bf3-972b-ec8a3f0a0e47 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:40.403778 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390dde3-abd8-4bf3-972b-ec8a3f0a0e47 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:40.404280 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390dde3-abd8-4bf3-972b-ec8a3f0a0e47 None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:40.405164 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390dde3-abd8-4bf3-972b-ec8a3f0a0e47 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:40.405517 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390dde3-abd8-4bf3-972b-ec8a3f0a0e47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:40.407047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390dde3-abd8-4bf3-972b-ec8a3f0a0e47 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:40.431420 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 395/800] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 9 15:47:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:40.432289 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390dde3-abd8-4bf3-972b-ec8a3f0a0e47 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:40.432882 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 406/801] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:47:40.435224 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d91808-928f-4d43-86e5-8486647775fe None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:40.579241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d91808-928f-4d43-86e5-8486647775fe None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:40.592419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390dde3-abd8-4bf3-972b-ec8a3f0a0e47 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:40.616109 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bbca8-18bd-49e1-bd60-c3992e5c301d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:40.616769 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bbca8-18bd-49e1-bd60-c3992e5c301d None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:40.617061 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bbca8-18bd-49e1-bd60-c3992e5c301d None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:40.617342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bbca8-18bd-49e1-bd60-c3992e5c301d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:40.647438 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545467b-905b-4fdb-8083-9fb9c385c99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:40.648132 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545467b-905b-4fdb-8083-9fb9c385c99e None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:40.648423 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545467b-905b-4fdb-8083-9fb9c385c99e None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:40.648708 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545467b-905b-4fdb-8083-9fb9c385c99e None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:40.649524 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545467b-905b-4fdb-8083-9fb9c385c99e None admin] RBAC: Adding query filter params (name=admin) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:40.649842 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545467b-905b-4fdb-8083-9fb9c385c99e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:40.651267 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545467b-905b-4fdb-8083-9fb9c385c99e None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:40.663382 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 396/802] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:47:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:40.663382 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545467b-905b-4fdb-8083-9fb9c385c99e None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:40.719320 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226bbca8-18bd-49e1-bd60-c3992e5c301d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:40.721753 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226bbca8-18bd-49e1-bd60-c3992e5c301d None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:40.818652 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545467b-905b-4fdb-8083-9fb9c385c99e None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:40.871721 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f3c27-16b9-4774-ab4c-0fc1f20023bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:40.873763 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f3c27-16b9-4774-ab4c-0fc1f20023bb None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:40.874225 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f3c27-16b9-4774-ab4c-0fc1f20023bb None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:40.874682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f3c27-16b9-4774-ab4c-0fc1f20023bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:40.886978 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 407/803] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:47:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:47:40.886978 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bbca8-18bd-49e1-bd60-c3992e5c301d None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:40.893871 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f3c27-16b9-4774-ab4c-0fc1f20023bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:40.895383 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f3c27-16b9-4774-ab4c-0fc1f20023bb None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:40.915992 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-218f3c27-16b9-4774-ab4c-0fc1f20023bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:40.915992 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:40.915992 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:40.915992 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:40.915992 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:40.915992 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:40.915992 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:40.915992 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:40.915992 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:40.915992 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:40.915992 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:40.915992 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:40.915992 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:40.915992 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:40.915992 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:40.917092 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:40.917092 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:40.917092 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:40.917092 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:40.917092 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:40.917092 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:40.917092 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:40.917092 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:40.917092 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:40.917092 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:40.917092 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:40.917092 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:40.917092 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:40.917092 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:40.917092 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:40.917092 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:40.917092 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:40.919180 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:40.919180 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:40.919180 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:40.919180 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:40.919180 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 397/804] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:40.919180 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f3c27-16b9-4774-ab4c-0fc1f20023bb None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:41.023455 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bbca8-18bd-49e1-bd60-c3992e5c301d None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:41.057718 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f3c27-16b9-4774-ab4c-0fc1f20023bb None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:41.076035 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542f7c5-a0d8-4f42-8f4d-8ab7caa8b2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:41.076930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542f7c5-a0d8-4f42-8f4d-8ab7caa8b2da None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:41.077270 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542f7c5-a0d8-4f42-8f4d-8ab7caa8b2da None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:41.077653 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542f7c5-a0d8-4f42-8f4d-8ab7caa8b2da None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:41.078389 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542f7c5-a0d8-4f42-8f4d-8ab7caa8b2da None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:41.079823 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542f7c5-a0d8-4f42-8f4d-8ab7caa8b2da None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:41.101029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-2542f7c5-a0d8-4f42-8f4d-8ab7caa8b2da None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:47:41.101029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:41.101029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:47:41.101029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:47:41.101029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:47:41.101029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:47:41.101029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:47:41.101029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:41.101029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:47:41.101029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:41.101029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:47:41.101029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:41.101029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:41.101029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:41.101029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:41.101029 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:41.103287 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:41.103287 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:41.103287 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:41.103287 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:41.103287 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:41.103287 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:41.103287 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:41.103287 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:47:41.103287 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:47:41.103287 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:47:41.103287 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:47:41.103287 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:41.103287 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:41.103287 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:41.103287 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:41.103287 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:41.105120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:41.105120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:41.105120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:41.105120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:41.105120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:41.105120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:41.105120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:41.105120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:41.105120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:41.105120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:41.105120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:41.105120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:47:41.105120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:41.105120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 09 15:47:41.105120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:41.105120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 408/805] 10.222.0.48 () {56 vars in 1129 bytes} [Mon May 9 15:47:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:41.107319 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542f7c5-a0d8-4f42-8f4d-8ab7caa8b2da None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:41.125712 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ed432-51b6-4c0e-b9c5-797fca3fa898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:41.126811 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ed432-51b6-4c0e-b9c5-797fca3fa898 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:41.127244 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ed432-51b6-4c0e-b9c5-797fca3fa898 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:41.127659 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ed432-51b6-4c0e-b9c5-797fca3fa898 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:41.148093 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ed432-51b6-4c0e-b9c5-797fca3fa898 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:41.150382 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ed432-51b6-4c0e-b9c5-797fca3fa898 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:41.180368 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-2a8ed432-51b6-4c0e-b9c5-797fca3fa898 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:41.180368 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:41.180368 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:41.180368 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:41.180368 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:41.180368 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:41.180368 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:41.180368 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:41.180368 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:41.180368 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:41.180368 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:41.180368 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:41.180368 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:41.180368 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:41.180368 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:41.182278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:41.182278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:41.182278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:41.182278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:41.182278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:41.182278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:41.182278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:41.182278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:41.182278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:41.182278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:41.182278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:41.182278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:41.182278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:41.182278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:41.182278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:41.182278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:41.182278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:41.185342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:41.185342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:41.185342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:41.185342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:41.185342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 398/806] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:41.185342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ed432-51b6-4c0e-b9c5-797fca3fa898 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:41.248995 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542f7c5-a0d8-4f42-8f4d-8ab7caa8b2da None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:41.296691 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5f25c-9484-4d3c-961e-a286955ac018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:41.297532 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5f25c-9484-4d3c-961e-a286955ac018 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:41.298468 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5f25c-9484-4d3c-961e-a286955ac018 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:41.298468 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5f25c-9484-4d3c-961e-a286955ac018 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:41.310956 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5f25c-9484-4d3c-961e-a286955ac018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:41.312680 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5f25c-9484-4d3c-961e-a286955ac018 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:41.315205 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ed432-51b6-4c0e-b9c5-797fca3fa898 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:41.340833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-f7d5f25c-9484-4d3c-961e-a286955ac018 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:41.340833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:41.340833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:41.340833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:41.340833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:41.340833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:41.340833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:41.340833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:41.340833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:41.340833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:41.340833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:41.340833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:41.340833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:41.340833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:41.340833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:41.342435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:41.342435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:41.342435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:41.342435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:41.342435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:41.342435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:41.342435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:41.342435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:41.342435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:41.342435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:41.342435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:41.342435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:41.342435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:41.342435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:41.342435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:41.342435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:41.342435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:41.343443 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:41.343443 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:41.343443 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:41.343443 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:41.345708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 409/807] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:41.347234 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5f25c-9484-4d3c-961e-a286955ac018 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:41.362982 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eced92e-0e03-4489-b243-e664542b23e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:41.364039 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eced92e-0e03-4489-b243-e664542b23e0 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:41.364460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eced92e-0e03-4489-b243-e664542b23e0 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:41.364875 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eced92e-0e03-4489-b243-e664542b23e0 None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:41.365829 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eced92e-0e03-4489-b243-e664542b23e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:41.366287 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eced92e-0e03-4489-b243-e664542b23e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:41.368049 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eced92e-0e03-4489-b243-e664542b23e0 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:41.383047 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 399/808] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:41.384368 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eced92e-0e03-4489-b243-e664542b23e0 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:41.494889 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5f25c-9484-4d3c-961e-a286955ac018 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:41.544266 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eced92e-0e03-4489-b243-e664542b23e0 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:41.557290 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8bbc6-8a54-4a0f-b870-fb5342405b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:41.558427 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8bbc6-8a54-4a0f-b870-fb5342405b30 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:41.558767 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8bbc6-8a54-4a0f-b870-fb5342405b30 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:41.559122 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8bbc6-8a54-4a0f-b870-fb5342405b30 None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:41.560277 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8bbc6-8a54-4a0f-b870-fb5342405b30 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:41.560775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8bbc6-8a54-4a0f-b870-fb5342405b30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:41.563236 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8bbc6-8a54-4a0f-b870-fb5342405b30 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:41.570023 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 410/809] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 9 15:47:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:41.571554 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8bbc6-8a54-4a0f-b870-fb5342405b30 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:41.610461 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd0329-d775-4dc9-9e77-9944e848da1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:41.611572 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd0329-d775-4dc9-9e77-9944e848da1a None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:41.611926 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd0329-d775-4dc9-9e77-9944e848da1a None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:41.612221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd0329-d775-4dc9-9e77-9944e848da1a None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:41.612971 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd0329-d775-4dc9-9e77-9944e848da1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:41.613289 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd0329-d775-4dc9-9e77-9944e848da1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:41.614763 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd0329-d775-4dc9-9e77-9944e848da1a None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:41.632633 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 400/810] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:41.632633 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd0329-d775-4dc9-9e77-9944e848da1a None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:41.707578 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8bbc6-8a54-4a0f-b870-fb5342405b30 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:41.743523 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca9ba8-f646-4755-af49-7bce73691be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:41.744195 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca9ba8-f646-4755-af49-7bce73691be1 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:41.744469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca9ba8-f646-4755-af49-7bce73691be1 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:41.744756 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca9ba8-f646-4755-af49-7bce73691be1 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:41.744952 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd0329-d775-4dc9-9e77-9944e848da1a None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:41.745508 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca9ba8-f646-4755-af49-7bce73691be1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:41.745815 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca9ba8-f646-4755-af49-7bce73691be1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:41.747274 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca9ba8-f646-4755-af49-7bce73691be1 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:41.760309 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 411/811] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:41.760933 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca9ba8-f646-4755-af49-7bce73691be1 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:41.792028 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c2cf4-fd81-41a5-acd8-f9bbdcfdf7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:41.793090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c2cf4-fd81-41a5-acd8-f9bbdcfdf7b4 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:41.793537 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c2cf4-fd81-41a5-acd8-f9bbdcfdf7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:41.793906 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c2cf4-fd81-41a5-acd8-f9bbdcfdf7b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:41.802183 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c2cf4-fd81-41a5-acd8-f9bbdcfdf7b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:41.803668 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c2cf4-fd81-41a5-acd8-f9bbdcfdf7b4 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:41.819936 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-262c2cf4-fd81-41a5-acd8-f9bbdcfdf7b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:41.819936 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:41.819936 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:41.819936 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:41.819936 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:41.819936 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:41.819936 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:41.819936 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:41.819936 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:41.819936 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:41.819936 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:41.819936 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:41.819936 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:41.819936 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:41.819936 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:41.821977 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:41.821977 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:41.821977 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:41.821977 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:41.821977 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:41.821977 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:41.821977 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:41.821977 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:41.821977 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:41.821977 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:41.821977 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:41.821977 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:41.821977 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:41.821977 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:41.821977 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:41.821977 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:41.821977 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:41.823914 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:41.823914 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:41.823914 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:41.823914 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:41.823914 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:41.823914 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:41.823914 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:41.823914 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:41.823914 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 401/812] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:41.823914 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c2cf4-fd81-41a5-acd8-f9bbdcfdf7b4 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:41.880282 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca9ba8-f646-4755-af49-7bce73691be1 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:41.926863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622c046-fe15-4e6f-bfaa-7533fde36dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:41.927920 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622c046-fe15-4e6f-bfaa-7533fde36dd2 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:41.928427 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622c046-fe15-4e6f-bfaa-7533fde36dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:41.928939 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622c046-fe15-4e6f-bfaa-7533fde36dd2 None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:41.930349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622c046-fe15-4e6f-bfaa-7533fde36dd2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:41.930916 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622c046-fe15-4e6f-bfaa-7533fde36dd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:41.933583 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622c046-fe15-4e6f-bfaa-7533fde36dd2 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:41.947323 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 412/813] 10.222.0.48 () {56 vars in 1124 bytes} [Mon May 9 15:47:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:41.947323 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724c69f-0244-44c1-b6ac-17d830647032 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:41.947323 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724c69f-0244-44c1-b6ac-17d830647032 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:41.947323 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724c69f-0244-44c1-b6ac-17d830647032 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:41.948372 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 413/814] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:41.949636 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724c69f-0244-44c1-b6ac-17d830647032 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:41.969473 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c2cf4-fd81-41a5-acd8-f9bbdcfdf7b4 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:42.014178 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654a1a0-d4c2-4689-9b7a-f8ceedc6aa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:42.015381 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654a1a0-d4c2-4689-9b7a-f8ceedc6aa6c None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:42.015724 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654a1a0-d4c2-4689-9b7a-f8ceedc6aa6c None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:42.016150 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654a1a0-d4c2-4689-9b7a-f8ceedc6aa6c None admin] PATH_INFO: `/v3/users/swift` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:42.028396 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654a1a0-d4c2-4689-9b7a-f8ceedc6aa6c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:42.030034 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654a1a0-d4c2-4689-9b7a-f8ceedc6aa6c None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:42.045989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-f654a1a0-d4c2-4689-9b7a-f8ceedc6aa6c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:47:42.045989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:42.045989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:42.045989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:42.045989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:42.045989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:42.045989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:42.045989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:42.045989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:42.045989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:42.045989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:42.045989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:42.045989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:42.045989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:42.045989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:42.045989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:42.048183 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:42.048183 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:42.048183 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:42.048183 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:42.048183 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:42.048183 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:42.048183 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:42.048183 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:42.048183 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:42.048183 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:42.048183 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:42.048183 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:42.048183 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:42.048183 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:42.048183 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:42.048183 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:42.048183 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:42.048183 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:42.050350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:42.050350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:42.050350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:42.050350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:42.050350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:42.050350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:42.050350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:42.050350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:42.050350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:47:42.050350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:42.050350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 402/815] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:47:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:42.050350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654a1a0-d4c2-4689-9b7a-f8ceedc6aa6c None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:42.085764 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724c69f-0244-44c1-b6ac-17d830647032 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:42.132513 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71ae9e-bfdd-42bd-8840-eed9a3382e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:42.133633 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71ae9e-bfdd-42bd-8840-eed9a3382e40 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:42.134095 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71ae9e-bfdd-42bd-8840-eed9a3382e40 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:42.134549 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71ae9e-bfdd-42bd-8840-eed9a3382e40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:42.145218 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71ae9e-bfdd-42bd-8840-eed9a3382e40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:42.147694 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71ae9e-bfdd-42bd-8840-eed9a3382e40 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:42.172357 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-2f71ae9e-bfdd-42bd-8840-eed9a3382e40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:42.172357 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:42.172357 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:42.172357 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:42.172357 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:42.172357 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:42.172357 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:42.172357 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:42.172357 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:42.172357 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:42.172357 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:42.172357 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:42.172357 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:42.172357 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:42.172357 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:42.173792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:42.173792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:42.173792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:42.173792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:42.173792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:42.173792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:42.173792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:42.173792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:42.173792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:42.173792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:42.173792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:42.173792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:42.173792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:42.173792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:42.173792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:42.173792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:42.173792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:42.174930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:42.174930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:42.174930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:42.174930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:42.174930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:42.174930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:42.174930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:42.174930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:42.174930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 414/816] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:42.175590 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71ae9e-bfdd-42bd-8840-eed9a3382e40 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:42.183412 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654a1a0-d4c2-4689-9b7a-f8ceedc6aa6c None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:42.221531 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66084521-01a6-4f06-8eb1-b7da63b0fcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:42.222339 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66084521-01a6-4f06-8eb1-b7da63b0fcbb None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:42.222682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66084521-01a6-4f06-8eb1-b7da63b0fcbb None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:42.223020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66084521-01a6-4f06-8eb1-b7da63b0fcbb None admin] PATH_INFO: `/v3/projects` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:42.223897 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66084521-01a6-4f06-8eb1-b7da63b0fcbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:42.224261 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66084521-01a6-4f06-8eb1-b7da63b0fcbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:42.225827 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66084521-01a6-4f06-8eb1-b7da63b0fcbb None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:42.238528 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 403/817] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:42.239873 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50169d-57c7-49a7-90bf-c3c7e2c2fe18 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:42.240154 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50169d-57c7-49a7-90bf-c3c7e2c2fe18 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:42.240430 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50169d-57c7-49a7-90bf-c3c7e2c2fe18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:42.258699 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-bd50169d-57c7-49a7-90bf-c3c7e2c2fe18 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:42.259900 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-bd50169d-57c7-49a7-90bf-c3c7e2c2fe18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:42.316499 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71ae9e-bfdd-42bd-8840-eed9a3382e40 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:42.334063 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 404/818] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:47:42.334969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50169d-57c7-49a7-90bf-c3c7e2c2fe18 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:42.375114 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab3340-6962-48c4-b7e6-4d61d6f0d813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:42.375968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab3340-6962-48c4-b7e6-4d61d6f0d813 None admin] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:42.376351 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab3340-6962-48c4-b7e6-4d61d6f0d813 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:42.376598 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab3340-6962-48c4-b7e6-4d61d6f0d813 None admin] PATH_INFO: `/v3/endpoints` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:42.377412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab3340-6962-48c4-b7e6-4d61d6f0d813 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:42.378993 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab3340-6962-48c4-b7e6-4d61d6f0d813 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:42.410049 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 415/819] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:47:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:47:42.410911 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab3340-6962-48c4-b7e6-4d61d6f0d813 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:42.477358 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50169d-57c7-49a7-90bf-c3c7e2c2fe18 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:42.535968 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b80a27-7183-4f67-b17d-a3746d836858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:42.537170 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b80a27-7183-4f67-b17d-a3746d836858 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:42.537793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b80a27-7183-4f67-b17d-a3746d836858 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:42.538280 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b80a27-7183-4f67-b17d-a3746d836858 None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:42.539358 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b80a27-7183-4f67-b17d-a3746d836858 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:42.539979 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b80a27-7183-4f67-b17d-a3746d836858 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:42.541941 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b80a27-7183-4f67-b17d-a3746d836858 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:42.564886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab3340-6962-48c4-b7e6-4d61d6f0d813 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:42.571216 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 405/820] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 9 15:47:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:42.571216 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b80a27-7183-4f67-b17d-a3746d836858 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:42.613068 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b5c10-a59c-4ae2-9019-d03caabbd7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:42.615096 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b5c10-a59c-4ae2-9019-d03caabbd7e4 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:42.615686 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b5c10-a59c-4ae2-9019-d03caabbd7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:42.616228 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b5c10-a59c-4ae2-9019-d03caabbd7e4 None admin] PATH_INFO: `/v3/projects` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:42.617864 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b5c10-a59c-4ae2-9019-d03caabbd7e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:42.619429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b5c10-a59c-4ae2-9019-d03caabbd7e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:42.624669 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b5c10-a59c-4ae2-9019-d03caabbd7e4 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:42.643396 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 416/821] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:42.644894 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b5c10-a59c-4ae2-9019-d03caabbd7e4 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:42.718623 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b80a27-7183-4f67-b17d-a3746d836858 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:42.781074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c0b39-d39d-47c2-8632-30cf2c369763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:42.782345 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c0b39-d39d-47c2-8632-30cf2c369763 None admin] REQUEST_METHOD: `PUT` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:42.782833 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c0b39-d39d-47c2-8632-30cf2c369763 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:42.783253 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c0b39-d39d-47c2-8632-30cf2c369763 None admin] PATH_INFO: `/v3/projects/7860d281acf642d2a3950424901b9487/users/64be0f5d9f1948e08b530b618245b6d0/roles/a6f10c1ca57b4299bb809b5bcc8797f5` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:42.797730 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b5c10-a59c-4ae2-9019-d03caabbd7e4 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:42.800748 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c0b39-d39d-47c2-8632-30cf2c369763 None admin] RBAC: Authorizing `identity:create_grant(project_id=7860d281acf642d2a3950424901b9487, user_id=64be0f5d9f1948e08b530b618245b6d0, role_id=a6f10c1ca57b4299bb809b5bcc8797f5)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:42.802294 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c0b39-d39d-47c2-8632-30cf2c369763 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:42.818356 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 406/822] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:47:42 2022] PUT /identity/v3/projects/7860d281acf642d2a3950424901b9487/users/64be0f5d9f1948e08b530b618245b6d0/roles/a6f10c1ca57b4299bb809b5bcc8797f5 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:47:42.819530 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c0b39-d39d-47c2-8632-30cf2c369763 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:42.854379 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1587d8c-62bf-4b15-9d5b-095fd146cef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:42.855884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1587d8c-62bf-4b15-9d5b-095fd146cef2 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:42.857350 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1587d8c-62bf-4b15-9d5b-095fd146cef2 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:42.858276 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1587d8c-62bf-4b15-9d5b-095fd146cef2 None admin] PATH_INFO: `/v3/services/network` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:42.859334 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1587d8c-62bf-4b15-9d5b-095fd146cef2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:42.861703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1587d8c-62bf-4b15-9d5b-095fd146cef2 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:42.883153 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-c1587d8c-62bf-4b15-9d5b-095fd146cef2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:47:42.883153 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:42.883153 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:47:42.883153 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:47:42.883153 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:47:42.883153 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:47:42.883153 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:47:42.883153 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:42.883153 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:47:42.883153 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:42.883153 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:47:42.883153 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:42.883153 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:42.883153 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:42.883153 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:42.883153 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:42.883153 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:42.884861 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:42.884861 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:42.884861 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:42.884861 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:42.884861 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:42.884861 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:42.884861 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:47:42.884861 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:47:42.884861 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:47:42.884861 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:47:42.884861 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:42.884861 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:42.884861 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:42.884861 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:42.884861 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:42.884861 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:42.886565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:42.886565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:42.886565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:42.886565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:42.886565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:42.886565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:42.886565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:42.886565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:42.886565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:42.886565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:42.886565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:47:42.886565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:42.886565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 09 15:47:42.886565 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:42.892351 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 417/823] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:42 2022] GET /identity/v3/services/network => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:42.894555 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1587d8c-62bf-4b15-9d5b-095fd146cef2 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:42.965511 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c0b39-d39d-47c2-8632-30cf2c369763 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:43.012679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b62211-149d-4b96-96fa-7e8c0e2c413a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:43.014138 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b62211-149d-4b96-96fa-7e8c0e2c413a None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:43.014678 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b62211-149d-4b96-96fa-7e8c0e2c413a None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:43.015103 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b62211-149d-4b96-96fa-7e8c0e2c413a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:43.030049 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b62211-149d-4b96-96fa-7e8c0e2c413a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:43.032475 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b62211-149d-4b96-96fa-7e8c0e2c413a None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:43.047827 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1587d8c-62bf-4b15-9d5b-095fd146cef2 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:43.056182 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-d3b62211-149d-4b96-96fa-7e8c0e2c413a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:43.056182 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:43.056182 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:43.056182 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:43.056182 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:43.056182 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:43.056182 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:43.056182 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:43.056182 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:43.056182 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:43.056182 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:43.056182 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:43.056182 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:43.056182 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:43.056182 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:43.058458 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:43.058458 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:43.058458 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:43.058458 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:43.058458 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:43.058458 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:43.058458 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:43.058458 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:43.058458 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:43.058458 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:43.058458 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:43.058458 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:43.058458 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:43.058458 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:43.058458 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:43.058458 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:43.058458 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:43.060842 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:43.060842 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:43.060842 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:43.060842 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:43.060842 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 407/824] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:43.061944 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b62211-149d-4b96-96fa-7e8c0e2c413a None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:43.116702 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302aa2c-e463-48f0-b4f2-12b67e87426d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:43.117726 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302aa2c-e463-48f0-b4f2-12b67e87426d None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:43.118176 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302aa2c-e463-48f0-b4f2-12b67e87426d None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:43.118598 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302aa2c-e463-48f0-b4f2-12b67e87426d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:43.119984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302aa2c-e463-48f0-b4f2-12b67e87426d None admin] RBAC: Adding query filter params (role.id=2180d183afad443187521833c40ed8a1, scope.project.id=7860d281acf642d2a3950424901b9487, user.id=adf919c3ba31488694c724a803ca51eb) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:43.120557 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302aa2c-e463-48f0-b4f2-12b67e87426d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:43.124729 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302aa2c-e463-48f0-b4f2-12b67e87426d None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:43.141421 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 418/825] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:47:42 2022] GET /identity/v3/role_assignments?user.id=adf919c3ba31488694c724a803ca51eb&scope.project.id=7860d281acf642d2a3950424901b9487&role.id=2180d183afad443187521833c40ed8a1 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:43.141421 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302aa2c-e463-48f0-b4f2-12b67e87426d None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:43.256993 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b62211-149d-4b96-96fa-7e8c0e2c413a None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:43.306807 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee126da-99f8-4fe9-8cc5-70517ed2e222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:43.307673 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee126da-99f8-4fe9-8cc5-70517ed2e222 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:43.309707 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee126da-99f8-4fe9-8cc5-70517ed2e222 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:43.309707 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee126da-99f8-4fe9-8cc5-70517ed2e222 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:43.310708 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee126da-99f8-4fe9-8cc5-70517ed2e222 None admin] RBAC: Adding query filter params (name=network) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:43.311115 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee126da-99f8-4fe9-8cc5-70517ed2e222 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:43.319332 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee126da-99f8-4fe9-8cc5-70517ed2e222 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:43.319332 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 408/826] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:47:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:43.327321 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee126da-99f8-4fe9-8cc5-70517ed2e222 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:43.369401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302aa2c-e463-48f0-b4f2-12b67e87426d None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:43.459760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b2dcc-f9bb-40a7-8980-946e381ee155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:43.461111 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b2dcc-f9bb-40a7-8980-946e381ee155 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:43.461779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b2dcc-f9bb-40a7-8980-946e381ee155 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:43.462648 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b2dcc-f9bb-40a7-8980-946e381ee155 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:43.463917 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b2dcc-f9bb-40a7-8980-946e381ee155 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:43.464439 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b2dcc-f9bb-40a7-8980-946e381ee155 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:43.465582 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee126da-99f8-4fe9-8cc5-70517ed2e222 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:43.466496 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b2dcc-f9bb-40a7-8980-946e381ee155 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:43.486828 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 419/827] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:43.493842 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b2dcc-f9bb-40a7-8980-946e381ee155 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:43.521352 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e334b6-13dc-4bf6-85b0-2dba6932458d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:43.522121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e334b6-13dc-4bf6-85b0-2dba6932458d None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:43.522580 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e334b6-13dc-4bf6-85b0-2dba6932458d None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:43.523000 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e334b6-13dc-4bf6-85b0-2dba6932458d None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:43.523969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e334b6-13dc-4bf6-85b0-2dba6932458d None admin] RBAC: Adding query filter params (type=network) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:43.524533 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e334b6-13dc-4bf6-85b0-2dba6932458d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:43.526418 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e334b6-13dc-4bf6-85b0-2dba6932458d None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:43.537900 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 409/828] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:47:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:43.541523 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e334b6-13dc-4bf6-85b0-2dba6932458d None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:43.646620 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b2dcc-f9bb-40a7-8980-946e381ee155 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:43.691954 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d04202-e8d4-45fb-869b-55cb23e248d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:43.692891 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d04202-e8d4-45fb-869b-55cb23e248d3 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:43.693182 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d04202-e8d4-45fb-869b-55cb23e248d3 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:43.693515 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d04202-e8d4-45fb-869b-55cb23e248d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:43.695405 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e334b6-13dc-4bf6-85b0-2dba6932458d None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:43.703729 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d04202-e8d4-45fb-869b-55cb23e248d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:43.706452 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d04202-e8d4-45fb-869b-55cb23e248d3 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:43.723509 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-b1d04202-e8d4-45fb-869b-55cb23e248d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:43.723509 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:43.723509 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:43.723509 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:43.723509 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:43.723509 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:43.723509 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:43.723509 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:43.723509 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:43.723509 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:43.723509 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:43.723509 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:43.723509 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:43.723509 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:43.723509 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:43.724783 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:43.724783 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:43.724783 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:43.724783 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:43.724783 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:43.724783 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:43.724783 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:43.724783 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:43.724783 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:43.724783 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:43.724783 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:43.724783 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:43.724783 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:43.724783 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:43.724783 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:43.724783 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:43.724783 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:43.726016 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:43.726016 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:43.726016 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:43.726016 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:43.726016 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:43.726016 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:43.726016 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:43.726016 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:43.734971 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 420/829] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:43.736331 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d04202-e8d4-45fb-869b-55cb23e248d3 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:43.743561 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcba27-273a-425e-adb7-06ebb45ebb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:43.744527 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcba27-273a-425e-adb7-06ebb45ebb9b None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:43.744981 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcba27-273a-425e-adb7-06ebb45ebb9b None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:43.745473 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fcba27-273a-425e-adb7-06ebb45ebb9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:43.746391 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fcba27-273a-425e-adb7-06ebb45ebb9b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:43.747975 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fcba27-273a-425e-adb7-06ebb45ebb9b None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:43.783969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 410/830] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:47:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:47:43.941703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d04202-e8d4-45fb-869b-55cb23e248d3 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:44.009424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085b229-07fe-496d-93b7-a63331ffc56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:44.010611 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085b229-07fe-496d-93b7-a63331ffc56e None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:44.011141 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085b229-07fe-496d-93b7-a63331ffc56e None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:44.011738 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085b229-07fe-496d-93b7-a63331ffc56e None admin] PATH_INFO: `/v3/projects` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:44.012948 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085b229-07fe-496d-93b7-a63331ffc56e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:44.013676 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085b229-07fe-496d-93b7-a63331ffc56e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:44.017038 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085b229-07fe-496d-93b7-a63331ffc56e None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:44.042045 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 421/831] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:44.050802 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcba27-273a-425e-adb7-06ebb45ebb9b None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:44.292426 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fcba27-273a-425e-adb7-06ebb45ebb9b None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:44.359725 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68d6b2-9453-4d4c-baaa-9f81bc7b49dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:44.361201 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68d6b2-9453-4d4c-baaa-9f81bc7b49dd None admin] REQUEST_METHOD: `PUT` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:44.361818 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68d6b2-9453-4d4c-baaa-9f81bc7b49dd None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:44.362324 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68d6b2-9453-4d4c-baaa-9f81bc7b49dd None admin] PATH_INFO: `/v3/projects/7860d281acf642d2a3950424901b9487/users/95f73edea88646ab9b1e2f3b0fea34c0/roles/2180d183afad443187521833c40ed8a1` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:44.365020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68d6b2-9453-4d4c-baaa-9f81bc7b49dd None admin] RBAC: Authorizing `identity:create_grant(project_id=7860d281acf642d2a3950424901b9487, user_id=95f73edea88646ab9b1e2f3b0fea34c0, role_id=2180d183afad443187521833c40ed8a1)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:44.366866 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68d6b2-9453-4d4c-baaa-9f81bc7b49dd None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:44.386323 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 411/832] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:47:44 2022] PUT /identity/v3/projects/7860d281acf642d2a3950424901b9487/users/95f73edea88646ab9b1e2f3b0fea34c0/roles/2180d183afad443187521833c40ed8a1 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:47:45.361711 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5466ef4-6366-4d02-bd2b-d17e2e75516e None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:45.362292 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5466ef4-6366-4d02-bd2b-d17e2e75516e None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:45.362675 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5466ef4-6366-4d02-bd2b-d17e2e75516e None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:45.365740 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 422/833] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:45.372671 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cc9e0-c62e-488e-956f-b0a566fd5715 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:45.373284 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cc9e0-c62e-488e-956f-b0a566fd5715 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:45.373420 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cc9e0-c62e-488e-956f-b0a566fd5715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:45.395095 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-d08cc9e0-c62e-488e-956f-b0a566fd5715 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:45.396322 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-d08cc9e0-c62e-488e-956f-b0a566fd5715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:45.483682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 412/834] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:47:45.510012 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5466ef4-6366-4d02-bd2b-d17e2e75516e None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:45.648281 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5466ef4-6366-4d02-bd2b-d17e2e75516e None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:45.695622 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7531dd7-e870-4449-8bb7-2b7b73d0ebcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:45.696608 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7531dd7-e870-4449-8bb7-2b7b73d0ebcc None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:45.696902 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7531dd7-e870-4449-8bb7-2b7b73d0ebcc None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:45.697211 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7531dd7-e870-4449-8bb7-2b7b73d0ebcc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:45.698113 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7531dd7-e870-4449-8bb7-2b7b73d0ebcc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:45.700502 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7531dd7-e870-4449-8bb7-2b7b73d0ebcc None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:45.714948 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-f7531dd7-e870-4449-8bb7-2b7b73d0ebcc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:47:45.714948 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:45.714948 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:47:45.714948 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:47:45.714948 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:47:45.714948 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:47:45.714948 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:47:45.714948 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:45.714948 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:47:45.714948 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:45.714948 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:47:45.714948 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:45.714948 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:45.714948 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:45.714948 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:45.714948 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:45.714948 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:45.716258 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:45.716258 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:45.716258 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:45.716258 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:45.716258 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:45.716258 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:45.716258 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:47:45.716258 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:47:45.716258 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:47:45.716258 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:47:45.716258 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:45.716258 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:45.716258 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:45.716258 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:45.716258 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:45.716258 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:45.717897 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:45.717897 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:45.717897 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:45.717897 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:45.717897 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:45.717897 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:45.717897 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:45.717897 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:45.717897 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:45.717897 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:45.717897 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:47:45.717897 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:45.717897 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:47:45.717897 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:45.721486 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 423/835] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:47:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:45.724131 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cc9e0-c62e-488e-956f-b0a566fd5715 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:45.775656 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fb7ae-f2ef-4b81-b360-34e3d541896e None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:45.776517 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fb7ae-f2ef-4b81-b360-34e3d541896e None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:45.777187 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fb7ae-f2ef-4b81-b360-34e3d541896e None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:45.780671 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 424/836] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:47:45.786741 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c0ebc-d0af-4ef8-ab25-5416adf67a1f None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:45.787377 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c0ebc-d0af-4ef8-ab25-5416adf67a1f None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:45.787859 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c0ebc-d0af-4ef8-ab25-5416adf67a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:45.806974 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-989c0ebc-d0af-4ef8-ab25-5416adf67a1f None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:45.808772 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-989c0ebc-d0af-4ef8-ab25-5416adf67a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:45.858070 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cc9e0-c62e-488e-956f-b0a566fd5715 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:45.898101 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 425/837] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:47:45.902422 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c8e6d-edd8-45e2-8e35-89e6d4e46f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:45.903595 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c8e6d-edd8-45e2-8e35-89e6d4e46f01 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:45.904195 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c8e6d-edd8-45e2-8e35-89e6d4e46f01 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:45.904642 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c8e6d-edd8-45e2-8e35-89e6d4e46f01 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:45.905657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c8e6d-edd8-45e2-8e35-89e6d4e46f01 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:45.906049 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c8e6d-edd8-45e2-8e35-89e6d4e46f01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:45.907643 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c8e6d-edd8-45e2-8e35-89e6d4e46f01 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:45.914158 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 413/838] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:47:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:45.921010 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c8e6d-edd8-45e2-8e35-89e6d4e46f01 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:45.921230 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c0ebc-d0af-4ef8-ab25-5416adf67a1f None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:46.064710 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c8e6d-edd8-45e2-8e35-89e6d4e46f01 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:46.074332 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c0ebc-d0af-4ef8-ab25-5416adf67a1f None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:46.109459 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16a2b6-4e02-4c83-941a-c3671d87e9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:46.110730 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16a2b6-4e02-4c83-941a-c3671d87e9c9 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:46.111278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16a2b6-4e02-4c83-941a-c3671d87e9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:46.111816 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16a2b6-4e02-4c83-941a-c3671d87e9c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:46.126547 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16a2b6-4e02-4c83-941a-c3671d87e9c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:46.136123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-db16a2b6-4e02-4c83-941a-c3671d87e9c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:46.136123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:46.136123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:46.136123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:46.136123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:46.136123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:46.136123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:46.136123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:46.136123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:46.136123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:46.136123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:46.136123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:46.136123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:46.136123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:46.136123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:46.136123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:46.137492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:46.137492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:46.137492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:46.137492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:46.137492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:46.137492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:46.137492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:46.137492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:46.137492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:46.137492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:46.137492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:46.137492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:46.137492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:46.137492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:46.137492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:46.137492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:46.138726 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:46.138726 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:46.138726 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:46.138726 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:46.138726 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:46.138726 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:46.138726 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:46.138726 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:46.138726 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:46.138726 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:46.138726 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:47:46.138726 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:46.147205 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 414/839] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:47:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:46.149604 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16a2b6-4e02-4c83-941a-c3671d87e9c9 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:46.153814 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0bc81-f44c-4776-9cdf-c86fc4a67f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:46.155004 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0bc81-f44c-4776-9cdf-c86fc4a67f06 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:46.155484 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0bc81-f44c-4776-9cdf-c86fc4a67f06 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:46.156400 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0bc81-f44c-4776-9cdf-c86fc4a67f06 None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:46.157937 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0bc81-f44c-4776-9cdf-c86fc4a67f06 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:46.158547 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0bc81-f44c-4776-9cdf-c86fc4a67f06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:46.160833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0bc81-f44c-4776-9cdf-c86fc4a67f06 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:46.177576 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 426/840] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:47:45 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:46.284169 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16a2b6-4e02-4c83-941a-c3671d87e9c9 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:46.327075 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed15c8e-8c42-4b4b-a501-d716654610f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:46.327770 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed15c8e-8c42-4b4b-a501-d716654610f5 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:46.328052 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed15c8e-8c42-4b4b-a501-d716654610f5 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:46.328331 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed15c8e-8c42-4b4b-a501-d716654610f5 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:46.329114 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed15c8e-8c42-4b4b-a501-d716654610f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:46.329454 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed15c8e-8c42-4b4b-a501-d716654610f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:46.330991 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed15c8e-8c42-4b4b-a501-d716654610f5 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:46.345742 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 415/841] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:47:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:47:46.350897 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0bc81-f44c-4776-9cdf-c86fc4a67f06 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:46.512719 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0bc81-f44c-4776-9cdf-c86fc4a67f06 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:46.556450 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43b36a-30b9-4508-bff9-2b418e6184a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:46.557882 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43b36a-30b9-4508-bff9-2b418e6184a4 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:46.558409 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43b36a-30b9-4508-bff9-2b418e6184a4 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:46.558997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43b36a-30b9-4508-bff9-2b418e6184a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:46.571943 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43b36a-30b9-4508-bff9-2b418e6184a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:46.574062 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43b36a-30b9-4508-bff9-2b418e6184a4 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:46.596940 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-8f43b36a-30b9-4508-bff9-2b418e6184a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:46.596940 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:46.596940 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:46.596940 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:46.596940 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:46.596940 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:46.596940 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:46.596940 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:46.596940 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:46.596940 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:46.596940 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:46.596940 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:46.596940 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:46.596940 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:46.596940 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:46.598120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:46.598120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:46.598120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:46.598120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:46.598120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:46.598120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:46.598120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:46.598120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:46.598120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:46.598120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:46.598120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:46.598120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:46.598120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:46.598120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:46.598120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:46.598120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:46.598120 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:46.599246 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:46.599246 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:46.599246 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:46.599246 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:46.601911 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 427/842] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:46.610133 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed15c8e-8c42-4b4b-a501-d716654610f5 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:46.735652 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed15c8e-8c42-4b4b-a501-d716654610f5 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:46.772191 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2db354-a085-42ae-9c5b-8b6c047faac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:46.772852 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2db354-a085-42ae-9c5b-8b6c047faac6 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:46.773151 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2db354-a085-42ae-9c5b-8b6c047faac6 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:46.773542 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2db354-a085-42ae-9c5b-8b6c047faac6 None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:46.774308 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2db354-a085-42ae-9c5b-8b6c047faac6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:46.774694 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2db354-a085-42ae-9c5b-8b6c047faac6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:46.776187 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2db354-a085-42ae-9c5b-8b6c047faac6 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:46.795001 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 416/843] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:46.797657 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43b36a-30b9-4508-bff9-2b418e6184a4 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:46.943860 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43b36a-30b9-4508-bff9-2b418e6184a4 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:46.997654 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c11d6f-d637-4e61-b0f5-63dcf7d6cbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:46.998402 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c11d6f-d637-4e61-b0f5-63dcf7d6cbf1 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:46.998684 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c11d6f-d637-4e61-b0f5-63dcf7d6cbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:46.998995 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c11d6f-d637-4e61-b0f5-63dcf7d6cbf1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:47.007736 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c11d6f-d637-4e61-b0f5-63dcf7d6cbf1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:47.009334 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c11d6f-d637-4e61-b0f5-63dcf7d6cbf1 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:47.029617 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-02c11d6f-d637-4e61-b0f5-63dcf7d6cbf1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:47:47.029617 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:47.029617 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:47.029617 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:47.029617 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:47.029617 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:47.029617 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:47.029617 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:47.029617 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:47.029617 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:47.029617 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:47.029617 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:47.029617 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:47.029617 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:47.029617 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:47.029617 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:47.030805 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:47.030805 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:47.030805 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:47.030805 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:47.030805 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:47.030805 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:47.030805 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:47.030805 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:47.030805 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:47.030805 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:47.030805 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:47.030805 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:47.030805 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:47.030805 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:47.030805 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:47.030805 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:47.030805 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:47.030805 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:47.032049 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:47.032049 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:47.032049 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:47.032049 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:47.032049 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:47.032049 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:47.032049 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:47.032049 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:47.032049 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:47:47.032049 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:47.035239 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 428/844] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:47:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:47.041161 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2db354-a085-42ae-9c5b-8b6c047faac6 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:47.156045 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2db354-a085-42ae-9c5b-8b6c047faac6 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:47.198197 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c9f45-48fc-4597-8752-4ca3c49de979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:47.199006 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c9f45-48fc-4597-8752-4ca3c49de979 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:47.199296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c9f45-48fc-4597-8752-4ca3c49de979 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:47.199642 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c9f45-48fc-4597-8752-4ca3c49de979 None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:47.201086 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c9f45-48fc-4597-8752-4ca3c49de979 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:47.201507 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c9f45-48fc-4597-8752-4ca3c49de979 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:47.203137 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c9f45-48fc-4597-8752-4ca3c49de979 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:47.230999 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 417/845] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 9 15:47:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:47.232739 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c11d6f-d637-4e61-b0f5-63dcf7d6cbf1 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:47.356071 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c11d6f-d637-4e61-b0f5-63dcf7d6cbf1 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:47.394460 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a242337-ff63-4cb9-b3de-9faa74fd8bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:47.395125 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a242337-ff63-4cb9-b3de-9faa74fd8bc6 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:47.395475 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a242337-ff63-4cb9-b3de-9faa74fd8bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:47.395802 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a242337-ff63-4cb9-b3de-9faa74fd8bc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:47.471496 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a242337-ff63-4cb9-b3de-9faa74fd8bc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:47.473092 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a242337-ff63-4cb9-b3de-9faa74fd8bc6 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:47.541930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d9486-baa7-4d62-bdec-adcf986ac2d9 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:47.542482 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d9486-baa7-4d62-bdec-adcf986ac2d9 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:47.543654 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d9486-baa7-4d62-bdec-adcf986ac2d9 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:47.553645 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 418/846] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:47 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:47:47.556111 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0b8c3-ba90-4a5d-a848-587c8f8d93b0 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:47.556590 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0b8c3-ba90-4a5d-a848-587c8f8d93b0 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:47.557097 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0b8c3-ba90-4a5d-a848-587c8f8d93b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:47.590979 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-d9a0b8c3-ba90-4a5d-a848-587c8f8d93b0 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:47.595302 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-d9a0b8c3-ba90-4a5d-a848-587c8f8d93b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:47.602909 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 429/847] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:47:47 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:47:47.613498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a242337-ff63-4cb9-b3de-9faa74fd8bc6 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:47.730008 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 419/848] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:47:47.760695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0b8c3-ba90-4a5d-a848-587c8f8d93b0 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:47.815053 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a242337-ff63-4cb9-b3de-9faa74fd8bc6 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:47.870100 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c786a35-ab22-41c0-917e-83eb8f45c820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:47.872327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c786a35-ab22-41c0-917e-83eb8f45c820 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:47.873115 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c786a35-ab22-41c0-917e-83eb8f45c820 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:47.873890 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c786a35-ab22-41c0-917e-83eb8f45c820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:47.891278 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c786a35-ab22-41c0-917e-83eb8f45c820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:47.894545 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c786a35-ab22-41c0-917e-83eb8f45c820 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:47.915295 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0b8c3-ba90-4a5d-a848-587c8f8d93b0 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:47.922774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-6c786a35-ab22-41c0-917e-83eb8f45c820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:47.922774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:47.922774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:47.922774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:47.922774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:47.922774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:47.922774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:47.922774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:47.922774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:47.922774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:47.922774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:47.922774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:47.922774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:47.922774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:47.922774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:47.923997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:47.923997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:47.923997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:47.923997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:47.923997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:47.923997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:47.923997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:47.923997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:47.923997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:47.923997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:47.923997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:47.923997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:47.923997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:47.923997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:47.923997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:47.923997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:47.923997 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:47.925345 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:47.925345 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:47.925345 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:47.925345 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:47.928322 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 430/849] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:47.936501 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c786a35-ab22-41c0-917e-83eb8f45c820 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:47.961295 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fcdfe-dfd8-4df1-a0c9-a51d01196ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:47.962184 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fcdfe-dfd8-4df1-a0c9-a51d01196ddb None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:47.962486 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fcdfe-dfd8-4df1-a0c9-a51d01196ddb None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:47.962792 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fcdfe-dfd8-4df1-a0c9-a51d01196ddb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:47.963502 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fcdfe-dfd8-4df1-a0c9-a51d01196ddb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:47.964883 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fcdfe-dfd8-4df1-a0c9-a51d01196ddb None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:47.978773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-bf0fcdfe-dfd8-4df1-a0c9-a51d01196ddb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:47:47.978773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:47.978773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:47:47.978773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:47:47.978773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:47:47.978773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:47:47.978773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:47:47.978773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:47.978773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:47:47.978773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:47.978773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:47:47.978773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:47.978773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:47.978773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:47.978773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:47.978773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:47.981399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:47.981399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:47.981399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:47.981399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:47.981399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:47.981399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:47.981399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:47.981399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:47:47.981399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:47:47.981399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:47:47.981399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:47:47.981399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:47.981399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:47.981399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:47.981399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:47.981399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:47.983417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:47.983417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:47.983417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:47.983417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:47.983417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:47.983417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:47.983417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:47.983417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:47.983417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:47.983417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:47.983417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:47.983417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:47:47.983417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:47.983417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:47:47.983417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:47.986728 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 420/850] 10.222.0.48 () {56 vars in 1132 bytes} [Mon May 9 15:47:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:47:47.987975 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fcdfe-dfd8-4df1-a0c9-a51d01196ddb None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:48.094152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c786a35-ab22-41c0-917e-83eb8f45c820 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:48.101176 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fcdfe-dfd8-4df1-a0c9-a51d01196ddb None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:48.148695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4697a-fec8-44b4-aa83-6f395a2f0e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:48.149684 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4697a-fec8-44b4-aa83-6f395a2f0e24 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:48.149684 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4697a-fec8-44b4-aa83-6f395a2f0e24 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:48.149684 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4697a-fec8-44b4-aa83-6f395a2f0e24 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:48.150451 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4697a-fec8-44b4-aa83-6f395a2f0e24 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:48.150985 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4697a-fec8-44b4-aa83-6f395a2f0e24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:48.152252 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4697a-fec8-44b4-aa83-6f395a2f0e24 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:48.155303 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ee78b-6e12-49b1-94a4-4d35918cd16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:48.156105 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ee78b-6e12-49b1-94a4-4d35918cd16a None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:48.156508 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ee78b-6e12-49b1-94a4-4d35918cd16a None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:48.157206 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ee78b-6e12-49b1-94a4-4d35918cd16a None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:48.157764 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ee78b-6e12-49b1-94a4-4d35918cd16a None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:48.158169 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ee78b-6e12-49b1-94a4-4d35918cd16a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:48.160277 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ee78b-6e12-49b1-94a4-4d35918cd16a None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:48.164424 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 421/851] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:47:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:48.165709 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c902c35-124f-4bdb-bef4-f18dde71eee3 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:48.165983 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c902c35-124f-4bdb-bef4-f18dde71eee3 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:48.166362 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c902c35-124f-4bdb-bef4-f18dde71eee3 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:48.168178 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 422/852] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:48.169720 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c902c35-124f-4bdb-bef4-f18dde71eee3 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:48.181572 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 431/853] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:47:48.183383 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817acaf-926b-4ba7-8be2-c85fe1f802d1 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:48.183892 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817acaf-926b-4ba7-8be2-c85fe1f802d1 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:48.185045 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817acaf-926b-4ba7-8be2-c85fe1f802d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:48.210111 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-a817acaf-926b-4ba7-8be2-c85fe1f802d1 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:48.211833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-a817acaf-926b-4ba7-8be2-c85fe1f802d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:48.308329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 432/854] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:47:48.314538 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c902c35-124f-4bdb-bef4-f18dde71eee3 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:48.318396 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817acaf-926b-4ba7-8be2-c85fe1f802d1 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:48.355513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a2bf9-09e0-4302-b6f2-344e1af71577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:48.356714 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a2bf9-09e0-4302-b6f2-344e1af71577 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:48.357049 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a2bf9-09e0-4302-b6f2-344e1af71577 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:48.357262 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a2bf9-09e0-4302-b6f2-344e1af71577 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:48.358067 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a2bf9-09e0-4302-b6f2-344e1af71577 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:48.358371 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a2bf9-09e0-4302-b6f2-344e1af71577 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:48.359762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a2bf9-09e0-4302-b6f2-344e1af71577 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:48.365724 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 423/855] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:47:48 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:48.366565 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a2bf9-09e0-4302-b6f2-344e1af71577 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:48.510205 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817acaf-926b-4ba7-8be2-c85fe1f802d1 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:48.546758 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a2bf9-09e0-4302-b6f2-344e1af71577 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:48.577820 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5dc732-bf1c-40e4-a24d-552d0e35e128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:48.579293 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5dc732-bf1c-40e4-a24d-552d0e35e128 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:48.579915 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5dc732-bf1c-40e4-a24d-552d0e35e128 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:48.580382 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5dc732-bf1c-40e4-a24d-552d0e35e128 None admin] PATH_INFO: `/v3/projects/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:48.592254 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5dc732-bf1c-40e4-a24d-552d0e35e128 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:48.595975 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5dc732-bf1c-40e4-a24d-552d0e35e128 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:48.603380 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b49730-ee01-4b20-aaf5-aaca978a1af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:48.605178 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b49730-ee01-4b20-aaf5-aaca978a1af0 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:48.606127 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b49730-ee01-4b20-aaf5-aaca978a1af0 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:48.606777 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b49730-ee01-4b20-aaf5-aaca978a1af0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:48.614958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-5c5dc732-bf1c-40e4-a24d-552d0e35e128 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:48.614958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:48.614958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:48.614958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:48.614958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:48.614958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:48.614958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:48.614958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:48.614958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:48.614958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:48.614958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:48.614958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:48.614958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:48.614958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:48.614958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:48.616568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:48.616568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:48.616568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:48.616568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:48.616568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:48.616568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:48.616568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:48.616568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:48.616568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:48.616568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:48.616568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:48.616568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:48.616568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:48.616568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:48.616568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:48.616568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:48.616568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:48.617705 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:48.617705 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:48.617705 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:48.617705 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:48.617705 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:48.617705 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:48.617705 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:48.617705 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:48.624308 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 433/856] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:48.633452 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5dc732-bf1c-40e4-a24d-552d0e35e128 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:48.647219 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b49730-ee01-4b20-aaf5-aaca978a1af0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:48.658974 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-a1b49730-ee01-4b20-aaf5-aaca978a1af0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:47:48.658974 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:48.658974 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:48.658974 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:48.658974 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:48.658974 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:48.658974 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:48.658974 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:48.658974 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:48.658974 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:48.658974 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:48.658974 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:48.658974 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:48.658974 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:48.658974 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:48.658974 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:48.660361 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:48.660361 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:48.660361 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:48.660361 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:48.660361 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:48.660361 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:48.660361 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:48.660361 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:48.660361 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:48.660361 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:48.660361 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:48.660361 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:48.660361 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:48.660361 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:48.660361 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:48.660361 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:48.661802 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:48.661802 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:48.661802 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:48.661802 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:48.661802 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:48.661802 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:48.661802 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:48.661802 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:48.661802 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:48.661802 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:48.661802 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:47:48.661802 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:48.661802 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 424/857] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:47:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:48.669731 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b49730-ee01-4b20-aaf5-aaca978a1af0 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:48.791786 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5dc732-bf1c-40e4-a24d-552d0e35e128 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:48.800145 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b49730-ee01-4b20-aaf5-aaca978a1af0 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:48.839460 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8996fd-12ec-41ac-8b33-37f0bfd47430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:48.840217 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8996fd-12ec-41ac-8b33-37f0bfd47430 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:48.840793 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8996fd-12ec-41ac-8b33-37f0bfd47430 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:48.841231 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8996fd-12ec-41ac-8b33-37f0bfd47430 None admin] PATH_INFO: `/v3/projects` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:48.842550 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8996fd-12ec-41ac-8b33-37f0bfd47430 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:48.842943 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8996fd-12ec-41ac-8b33-37f0bfd47430 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:48.844603 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8996fd-12ec-41ac-8b33-37f0bfd47430 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:48.846865 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe5c59-4b35-41e6-842d-286a253d1b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:48.847830 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe5c59-4b35-41e6-842d-286a253d1b18 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:48.848345 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe5c59-4b35-41e6-842d-286a253d1b18 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:48.848816 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe5c59-4b35-41e6-842d-286a253d1b18 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:48.849858 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe5c59-4b35-41e6-842d-286a253d1b18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:48.850359 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe5c59-4b35-41e6-842d-286a253d1b18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:48.851942 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe5c59-4b35-41e6-842d-286a253d1b18 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:48.860361 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 434/858] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:48.862042 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 425/859] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:47:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:48.868428 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8996fd-12ec-41ac-8b33-37f0bfd47430 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:48.871281 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe5c59-4b35-41e6-842d-286a253d1b18 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:48.988626 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8996fd-12ec-41ac-8b33-37f0bfd47430 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:49.017293 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe5c59-4b35-41e6-842d-286a253d1b18 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:49.033449 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf410e-2bea-4945-bd2c-3c4d0996a9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:49.034315 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf410e-2bea-4945-bd2c-3c4d0996a9d9 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:49.034599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf410e-2bea-4945-bd2c-3c4d0996a9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:49.034874 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf410e-2bea-4945-bd2c-3c4d0996a9d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:49.047435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf410e-2bea-4945-bd2c-3c4d0996a9d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:49.048818 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf410e-2bea-4945-bd2c-3c4d0996a9d9 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:49.058413 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffc529-e0de-4e0a-bb56-7201774be62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:49.059841 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffc529-e0de-4e0a-bb56-7201774be62a None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:49.060225 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffc529-e0de-4e0a-bb56-7201774be62a None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:49.060502 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffc529-e0de-4e0a-bb56-7201774be62a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:49.061393 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffc529-e0de-4e0a-bb56-7201774be62a None admin] RBAC: Adding query filter params (role.id=a6f10c1ca57b4299bb809b5bcc8797f5, scope.project.id=7860d281acf642d2a3950424901b9487, user.id=64be0f5d9f1948e08b530b618245b6d0) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:49.061753 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffc529-e0de-4e0a-bb56-7201774be62a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:49.063206 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffc529-e0de-4e0a-bb56-7201774be62a None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:49.069616 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-62cf410e-2bea-4945-bd2c-3c4d0996a9d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:49.069616 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:49.069616 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:49.069616 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:49.069616 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:49.069616 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:49.069616 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:49.069616 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:49.069616 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:49.069616 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:49.069616 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:49.069616 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:49.069616 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:49.069616 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:49.069616 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:49.070864 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:49.070864 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:49.070864 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:49.070864 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:49.070864 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:49.070864 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:49.070864 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:49.070864 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:49.070864 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:49.070864 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:49.070864 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:49.070864 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:49.070864 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:49.070864 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:49.070864 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:49.070864 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:49.070864 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:49.071949 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:49.071949 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:49.071949 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:49.071949 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:49.074196 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 435/860] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:47:49.076545 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccda4aa-4a54-4eb6-92ba-9d77d6160d7c None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:49.077071 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccda4aa-4a54-4eb6-92ba-9d77d6160d7c None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:49.077462 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 426/861] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:47:48 2022] GET /identity/v3/role_assignments?user.id=64be0f5d9f1948e08b530b618245b6d0&scope.project.id=7860d281acf642d2a3950424901b9487&role.id=a6f10c1ca57b4299bb809b5bcc8797f5 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:49.077703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccda4aa-4a54-4eb6-92ba-9d77d6160d7c None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:49.084110 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 436/862] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:49.085621 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ff0dc-12c8-4acc-944d-cd9bd6f1163a None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:49.085923 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ff0dc-12c8-4acc-944d-cd9bd6f1163a None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:49.086206 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ff0dc-12c8-4acc-944d-cd9bd6f1163a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:49.086515 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccda4aa-4a54-4eb6-92ba-9d77d6160d7c None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:49.113033 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-947ff0dc-12c8-4acc-944d-cd9bd6f1163a None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:49.115362 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-947ff0dc-12c8-4acc-944d-cd9bd6f1163a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:49.227055 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 427/863] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:47:49.248826 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ff0dc-12c8-4acc-944d-cd9bd6f1163a None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:49.289524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccda4aa-4a54-4eb6-92ba-9d77d6160d7c None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:49.337539 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8be4cf-8877-4b2e-a10c-2430795f0f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:49.337973 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8be4cf-8877-4b2e-a10c-2430795f0f6b None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:49.338234 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8be4cf-8877-4b2e-a10c-2430795f0f6b None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:49.338513 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8be4cf-8877-4b2e-a10c-2430795f0f6b None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:49.340333 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8be4cf-8877-4b2e-a10c-2430795f0f6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:49.340333 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8be4cf-8877-4b2e-a10c-2430795f0f6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:49.340968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8be4cf-8877-4b2e-a10c-2430795f0f6b None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:49.360990 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 437/864] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:49.367585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8be4cf-8877-4b2e-a10c-2430795f0f6b None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:49.446189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ff0dc-12c8-4acc-944d-cd9bd6f1163a None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:49.504250 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331ce86-f354-4294-884e-3332afd8bd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:49.504939 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331ce86-f354-4294-884e-3332afd8bd4c None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:49.505222 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331ce86-f354-4294-884e-3332afd8bd4c None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:49.505546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331ce86-f354-4294-884e-3332afd8bd4c None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:49.506351 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331ce86-f354-4294-884e-3332afd8bd4c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:49.508070 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331ce86-f354-4294-884e-3332afd8bd4c None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:49.510330 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8be4cf-8877-4b2e-a10c-2430795f0f6b None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:49.527868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 428/865] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:47:49 2022] POST /identity/v3/services => generated 251 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:47:49.566841 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7a3bd-cb80-4fca-9949-fe4a242a1205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:49.567666 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7a3bd-cb80-4fca-9949-fe4a242a1205 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:49.567963 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7a3bd-cb80-4fca-9949-fe4a242a1205 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:49.568377 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7a3bd-cb80-4fca-9949-fe4a242a1205 None admin] PATH_INFO: `/v3/users/swift` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:49.580983 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7a3bd-cb80-4fca-9949-fe4a242a1205 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:49.583636 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7a3bd-cb80-4fca-9949-fe4a242a1205 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:49.602424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-3bd7a3bd-cb80-4fca-9949-fe4a242a1205 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 09 15:47:49.602424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:49.602424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:49.602424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:49.602424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:49.602424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:49.602424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:49.602424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:49.602424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:49.602424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:49.602424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:49.602424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:49.602424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:49.602424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:49.602424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:49.602424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:49.603846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:49.603846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:49.603846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:49.603846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:49.603846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:49.603846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:49.603846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:49.603846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:49.603846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:49.603846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:49.603846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:49.603846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:49.603846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:49.603846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:49.603846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:49.603846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:49.603846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:49.603846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:49.605075 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:49.605075 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:49.605075 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:49.605075 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:49.605075 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:49.605075 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:49.605075 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:49.605075 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:49.605075 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 09 15:47:49.605075 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:49.605075 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 438/866] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:47:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:49.614832 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331ce86-f354-4294-884e-3332afd8bd4c None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:49.752579 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331ce86-f354-4294-884e-3332afd8bd4c None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:49.806710 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bec12-25b3-4e29-8d55-1277a282fa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:49.807886 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bec12-25b3-4e29-8d55-1277a282fa4c None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:49.808292 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bec12-25b3-4e29-8d55-1277a282fa4c None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:49.808628 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bec12-25b3-4e29-8d55-1277a282fa4c None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:49.810048 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bec12-25b3-4e29-8d55-1277a282fa4c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:49.810505 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bec12-25b3-4e29-8d55-1277a282fa4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:49.812523 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bec12-25b3-4e29-8d55-1277a282fa4c None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:49.841865 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 429/867] 10.222.0.48 () {56 vars in 1135 bytes} [Mon May 9 15:47:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:47:49.847452 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7a3bd-cb80-4fca-9949-fe4a242a1205 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:50.012891 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7a3bd-cb80-4fca-9949-fe4a242a1205 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:50.086627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610fa16-a59a-4aeb-8866-7118447ee127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:50.087830 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610fa16-a59a-4aeb-8866-7118447ee127 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:50.088344 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610fa16-a59a-4aeb-8866-7118447ee127 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:50.088852 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610fa16-a59a-4aeb-8866-7118447ee127 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:50.221246 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610fa16-a59a-4aeb-8866-7118447ee127 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:50.224201 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610fa16-a59a-4aeb-8866-7118447ee127 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:50.409876 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 439/868] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:47:49 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:47:50.418853 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bec12-25b3-4e29-8d55-1277a282fa4c None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:50.540957 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bec12-25b3-4e29-8d55-1277a282fa4c None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:50.587173 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea634da-64e8-43fd-97d3-8e158953bcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:50.588508 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea634da-64e8-43fd-97d3-8e158953bcf3 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:50.589089 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea634da-64e8-43fd-97d3-8e158953bcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:50.589684 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea634da-64e8-43fd-97d3-8e158953bcf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:50.605308 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea634da-64e8-43fd-97d3-8e158953bcf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:50.607478 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea634da-64e8-43fd-97d3-8e158953bcf3 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:50.630419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-8ea634da-64e8-43fd-97d3-8e158953bcf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:50.630419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:50.630419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:50.630419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:50.630419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:50.630419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:50.630419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:50.630419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:50.630419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:50.630419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:50.630419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:50.630419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:50.630419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:50.630419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:50.630419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:50.631608 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:50.631608 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:50.631608 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:50.631608 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:50.631608 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:50.631608 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:50.631608 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:50.631608 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:50.631608 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:50.631608 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:50.631608 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:50.631608 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:50.631608 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:50.631608 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:50.631608 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:50.631608 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:50.631608 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:50.632723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:50.632723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:50.632723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:50.632723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:50.636652 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 430/869] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:50.643505 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610fa16-a59a-4aeb-8866-7118447ee127 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:50.801175 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610fa16-a59a-4aeb-8866-7118447ee127 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:50.849381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7528807-5d8e-40f3-8313-2943a506a081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:50.850970 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7528807-5d8e-40f3-8313-2943a506a081 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:50.851610 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7528807-5d8e-40f3-8313-2943a506a081 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:50.852153 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7528807-5d8e-40f3-8313-2943a506a081 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:50.854183 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7528807-5d8e-40f3-8313-2943a506a081 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:50.854698 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7528807-5d8e-40f3-8313-2943a506a081 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:50.858447 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7528807-5d8e-40f3-8313-2943a506a081 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:50.878230 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 440/870] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:47:50.883960 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea634da-64e8-43fd-97d3-8e158953bcf3 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:51.009467 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea634da-64e8-43fd-97d3-8e158953bcf3 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:51.050729 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f020b21-73df-4336-8a93-decce724aa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:51.052070 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f020b21-73df-4336-8a93-decce724aa8d None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:51.052580 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f020b21-73df-4336-8a93-decce724aa8d None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:51.053085 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f020b21-73df-4336-8a93-decce724aa8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:51.062545 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f020b21-73df-4336-8a93-decce724aa8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:51.064405 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f020b21-73df-4336-8a93-decce724aa8d None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:51.080459 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-1f020b21-73df-4336-8a93-decce724aa8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:51.080459 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:51.080459 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:51.080459 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:51.080459 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:51.080459 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:51.080459 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:51.080459 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:51.080459 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:51.080459 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:51.080459 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:51.080459 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:51.080459 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:51.080459 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:51.080459 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:51.081594 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:51.081594 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:51.081594 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:51.081594 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:51.081594 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:51.081594 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:51.081594 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:51.081594 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:51.081594 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:51.081594 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:51.081594 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:51.081594 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:51.081594 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:51.081594 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:51.081594 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:51.081594 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:51.081594 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:51.082679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:51.082679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:51.082679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:51.082679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:51.082679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:51.082679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:51.082679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:51.082679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:51.085824 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 431/871] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:51.094634 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7528807-5d8e-40f3-8313-2943a506a081 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:51.188613 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc636c3-d6fd-4b4d-a3e5-63b54059bd07 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:51.189027 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc636c3-d6fd-4b4d-a3e5-63b54059bd07 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:51.189167 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc636c3-d6fd-4b4d-a3e5-63b54059bd07 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:51.190944 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 432/872] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:47:51.199004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b9b8c-ae21-41bf-aa12-9ab2b25f51a6 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:51.199291 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b9b8c-ae21-41bf-aa12-9ab2b25f51a6 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:51.200074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b9b8c-ae21-41bf-aa12-9ab2b25f51a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:51.222692 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-5b8b9b8c-ae21-41bf-aa12-9ab2b25f51a6 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:51.224101 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-5b8b9b8c-ae21-41bf-aa12-9ab2b25f51a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:51.230517 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7528807-5d8e-40f3-8313-2943a506a081 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:51.279808 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6870dc0-e031-4157-90f6-9cb54afe9515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:51.281405 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6870dc0-e031-4157-90f6-9cb54afe9515 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:51.281877 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6870dc0-e031-4157-90f6-9cb54afe9515 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:51.282343 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6870dc0-e031-4157-90f6-9cb54afe9515 None admin] PATH_INFO: `/v3/projects` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:51.283595 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6870dc0-e031-4157-90f6-9cb54afe9515 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:51.284070 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6870dc0-e031-4157-90f6-9cb54afe9515 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:51.286317 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6870dc0-e031-4157-90f6-9cb54afe9515 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:51.303486 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 441/873] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:51.309991 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6870dc0-e031-4157-90f6-9cb54afe9515 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:51.310168 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 433/874] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:51 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:47:51.334452 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b9b8c-ae21-41bf-aa12-9ab2b25f51a6 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:51.460137 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6870dc0-e031-4157-90f6-9cb54afe9515 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:51.478841 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b9b8c-ae21-41bf-aa12-9ab2b25f51a6 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:51.520175 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694953c-2177-4a70-ada2-1bdcb5e5dff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:51.521825 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694953c-2177-4a70-ada2-1bdcb5e5dff4 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:51.523114 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694953c-2177-4a70-ada2-1bdcb5e5dff4 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:51.524014 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694953c-2177-4a70-ada2-1bdcb5e5dff4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:51.525835 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694953c-2177-4a70-ada2-1bdcb5e5dff4 None admin] RBAC: Adding query filter params (role.id=2180d183afad443187521833c40ed8a1, scope.project.id=7860d281acf642d2a3950424901b9487, user.id=95f73edea88646ab9b1e2f3b0fea34c0) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:51.526862 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694953c-2177-4a70-ada2-1bdcb5e5dff4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:51.531533 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694953c-2177-4a70-ada2-1bdcb5e5dff4 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:51.537183 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053eb12e-07b3-4de0-a45c-ea3970db53ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:51.538027 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053eb12e-07b3-4de0-a45c-ea3970db53ba None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:51.538593 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053eb12e-07b3-4de0-a45c-ea3970db53ba None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:51.539179 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053eb12e-07b3-4de0-a45c-ea3970db53ba None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:51.540440 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053eb12e-07b3-4de0-a45c-ea3970db53ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:51.542311 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 442/875] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:47:51 2022] GET /identity/v3/role_assignments?user.id=95f73edea88646ab9b1e2f3b0fea34c0&scope.project.id=7860d281acf642d2a3950424901b9487&role.id=2180d183afad443187521833c40ed8a1 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:47:51.550225 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053eb12e-07b3-4de0-a45c-ea3970db53ba None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:51.573746 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 434/876] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:47:51 2022] POST /identity/v3/services => generated 269 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:47:52.177044 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfcc8a-5bd0-44a0-802d-1018f7c7278c None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:52.177699 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfcc8a-5bd0-44a0-802d-1018f7c7278c None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:52.177699 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfcc8a-5bd0-44a0-802d-1018f7c7278c None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:52.179590 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 443/877] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:47:52.186926 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb55175-145e-4a72-a2c1-c6186e1048fa None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:52.187986 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb55175-145e-4a72-a2c1-c6186e1048fa None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:52.188505 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb55175-145e-4a72-a2c1-c6186e1048fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:52.209096 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-2eb55175-145e-4a72-a2c1-c6186e1048fa None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:52.210971 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-2eb55175-145e-4a72-a2c1-c6186e1048fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:52.307995 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 435/878] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:47:52.335807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfcc8a-5bd0-44a0-802d-1018f7c7278c None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:52.357722 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d1d14-05ef-4eb3-b407-20afe15b7c7c None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:52.358094 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d1d14-05ef-4eb3-b407-20afe15b7c7c None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:52.358283 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d1d14-05ef-4eb3-b407-20afe15b7c7c None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:52.361155 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 436/879] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:52.366715 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd38754-16a6-4e8c-8a82-69196a7e14df None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:52.367049 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd38754-16a6-4e8c-8a82-69196a7e14df None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:52.367319 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd38754-16a6-4e8c-8a82-69196a7e14df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:52.388506 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-5fd38754-16a6-4e8c-8a82-69196a7e14df None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:52.389650 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-5fd38754-16a6-4e8c-8a82-69196a7e14df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:52.461154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfcc8a-5bd0-44a0-802d-1018f7c7278c None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:52.466843 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 437/880] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:47:52.492123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd38754-16a6-4e8c-8a82-69196a7e14df None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:52.507746 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af65f8a-8eb6-4504-999c-af6f8ef90c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:52.508986 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af65f8a-8eb6-4504-999c-af6f8ef90c77 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:52.509544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af65f8a-8eb6-4504-999c-af6f8ef90c77 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:52.510063 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af65f8a-8eb6-4504-999c-af6f8ef90c77 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:52.522085 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af65f8a-8eb6-4504-999c-af6f8ef90c77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:52.532278 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-6af65f8a-8eb6-4504-999c-af6f8ef90c77 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:47:52.532278 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:52.532278 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:52.532278 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:52.532278 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:52.532278 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:52.532278 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:52.532278 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:52.532278 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:52.532278 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:52.532278 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:52.532278 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:52.532278 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:52.532278 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:52.532278 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:52.532278 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:52.533448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:52.533448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:52.533448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:52.533448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:52.533448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:52.533448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:52.533448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:52.533448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:52.533448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:52.533448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:52.533448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:52.533448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:52.533448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:52.533448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:52.533448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:52.533448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:52.534403 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:52.534403 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:52.534403 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:52.534403 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:52.534403 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:52.534403 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:52.534403 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:52.534403 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:52.534403 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:52.534403 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:52.534403 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:47:52.534403 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:52.538521 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 444/881] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 9 15:47:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:52.546624 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af65f8a-8eb6-4504-999c-af6f8ef90c77 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:52.599334 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd38754-16a6-4e8c-8a82-69196a7e14df None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:52.637444 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14736181-20ef-474f-ac02-bb25d6749684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:52.638587 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14736181-20ef-474f-ac02-bb25d6749684 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:52.638878 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14736181-20ef-474f-ac02-bb25d6749684 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:52.639164 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14736181-20ef-474f-ac02-bb25d6749684 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:52.639841 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14736181-20ef-474f-ac02-bb25d6749684 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:52.641224 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14736181-20ef-474f-ac02-bb25d6749684 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:52.655153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-14736181-20ef-474f-ac02-bb25d6749684 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:47:52.655153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:52.655153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:47:52.655153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:47:52.655153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:47:52.655153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:47:52.655153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:47:52.655153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:52.655153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:47:52.655153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:52.655153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:47:52.655153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:52.655153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:52.655153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:52.655153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:52.655153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:52.655153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:52.656296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:52.656296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:52.656296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:52.656296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:52.656296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:52.656296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:52.656296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:47:52.656296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:47:52.656296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:47:52.656296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:47:52.656296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:52.656296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:52.656296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:52.656296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:52.656296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:52.656296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:52.657231 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:52.657231 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:52.657231 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:52.657231 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:52.657231 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:52.657231 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:52.657231 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:52.657231 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:52.657231 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:52.657231 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:52.657231 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:47:52.657231 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:52.657231 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:47:52.657231 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:52.661419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 438/882] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:47:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:47:52.662354 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14736181-20ef-474f-ac02-bb25d6749684 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:52.678313 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af65f8a-8eb6-4504-999c-af6f8ef90c77 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:52.715125 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb477a65-4eed-4939-9122-a7dc44f49203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:52.717176 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb477a65-4eed-4939-9122-a7dc44f49203 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:52.717717 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb477a65-4eed-4939-9122-a7dc44f49203 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:52.718247 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb477a65-4eed-4939-9122-a7dc44f49203 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:52.719244 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb477a65-4eed-4939-9122-a7dc44f49203 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:52.719775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb477a65-4eed-4939-9122-a7dc44f49203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:52.721408 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb477a65-4eed-4939-9122-a7dc44f49203 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:52.729965 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 445/883] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:47:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:47:52.737311 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb477a65-4eed-4939-9122-a7dc44f49203 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:52.785223 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14736181-20ef-474f-ac02-bb25d6749684 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:52.829998 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611ba6f-325e-45ae-a802-aeda0b2be137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:52.831039 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611ba6f-325e-45ae-a802-aeda0b2be137 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:52.831607 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611ba6f-325e-45ae-a802-aeda0b2be137 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:52.832118 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611ba6f-325e-45ae-a802-aeda0b2be137 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:52.833043 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611ba6f-325e-45ae-a802-aeda0b2be137 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:52.833580 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611ba6f-325e-45ae-a802-aeda0b2be137 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:52.835138 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611ba6f-325e-45ae-a802-aeda0b2be137 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:52.841540 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 439/884] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:47:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:52.846626 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611ba6f-325e-45ae-a802-aeda0b2be137 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:52.860284 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb477a65-4eed-4939-9122-a7dc44f49203 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:52.905279 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7841ba6-ad25-4308-bd03-a4b6a5b3a55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:52.906679 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7841ba6-ad25-4308-bd03-a4b6a5b3a55f None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:52.907430 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7841ba6-ad25-4308-bd03-a4b6a5b3a55f None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:52.907885 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7841ba6-ad25-4308-bd03-a4b6a5b3a55f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:52.924666 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7841ba6-ad25-4308-bd03-a4b6a5b3a55f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:52.926519 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7841ba6-ad25-4308-bd03-a4b6a5b3a55f None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:52.952939 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-f7841ba6-ad25-4308-bd03-a4b6a5b3a55f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:52.952939 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:52.952939 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:52.952939 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:52.952939 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:52.952939 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:52.952939 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:52.952939 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:52.952939 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:52.952939 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:52.952939 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:52.952939 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:52.952939 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:52.952939 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:52.952939 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:52.954257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:52.954257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:52.954257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:52.954257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:52.954257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:52.954257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:52.954257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:52.954257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:52.954257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:52.954257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:52.954257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:52.954257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:52.954257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:52.954257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:52.954257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:52.954257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:52.954257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:52.955454 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:52.955454 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:52.955454 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:52.955454 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:52.958150 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 446/885] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:52.963311 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7841ba6-ad25-4308-bd03-a4b6a5b3a55f None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:52.971897 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611ba6f-325e-45ae-a802-aeda0b2be137 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:53.024569 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e558b-4421-4299-900e-f78a906fd6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:53.025249 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e558b-4421-4299-900e-f78a906fd6ec None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:53.026819 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e558b-4421-4299-900e-f78a906fd6ec None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:53.027104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e558b-4421-4299-900e-f78a906fd6ec None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:53.028844 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e558b-4421-4299-900e-f78a906fd6ec None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:53.029147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e558b-4421-4299-900e-f78a906fd6ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:53.030744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e558b-4421-4299-900e-f78a906fd6ec None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:53.036306 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 440/886] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:47:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:47:53.041947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e558b-4421-4299-900e-f78a906fd6ec None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:53.083739 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7841ba6-ad25-4308-bd03-a4b6a5b3a55f None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:53.141246 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c9b7d-fd93-4cf1-a288-0a9a1d06ccef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:53.142762 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c9b7d-fd93-4cf1-a288-0a9a1d06ccef None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:53.143060 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c9b7d-fd93-4cf1-a288-0a9a1d06ccef None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:53.143633 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c9b7d-fd93-4cf1-a288-0a9a1d06ccef None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:53.144963 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c9b7d-fd93-4cf1-a288-0a9a1d06ccef None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:53.145497 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c9b7d-fd93-4cf1-a288-0a9a1d06ccef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:53.147719 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c9b7d-fd93-4cf1-a288-0a9a1d06ccef None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:53.157349 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e558b-4421-4299-900e-f78a906fd6ec None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:53.172375 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 447/887] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:47:53.173533 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c9b7d-fd93-4cf1-a288-0a9a1d06ccef None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:53.195389 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece9401-f538-464c-9ee2-62afebf4cbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:53.196638 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece9401-f538-464c-9ee2-62afebf4cbe3 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:53.197127 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece9401-f538-464c-9ee2-62afebf4cbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:53.197646 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece9401-f538-464c-9ee2-62afebf4cbe3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:53.198670 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece9401-f538-464c-9ee2-62afebf4cbe3 None admin] RBAC: Adding query filter params (interface=public, service_id=250ded26134a4de0bdf429340eeec948, region_id=RegionOne) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:53.199194 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece9401-f538-464c-9ee2-62afebf4cbe3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:53.201324 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece9401-f538-464c-9ee2-62afebf4cbe3 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:53.207193 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 441/888] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:47:53 2022] GET /identity/v3/endpoints?service_id=250ded26134a4de0bdf429340eeec948&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:53.212303 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece9401-f538-464c-9ee2-62afebf4cbe3 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:53.285416 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c9b7d-fd93-4cf1-a288-0a9a1d06ccef None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:53.325515 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6053f1-e446-423f-b260-1f31054a75bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:53.326271 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6053f1-e446-423f-b260-1f31054a75bb None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:53.326625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6053f1-e446-423f-b260-1f31054a75bb None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:53.326996 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6053f1-e446-423f-b260-1f31054a75bb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:53.335724 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6053f1-e446-423f-b260-1f31054a75bb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:53.337266 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6053f1-e446-423f-b260-1f31054a75bb None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:53.354567 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-4b6053f1-e446-423f-b260-1f31054a75bb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:47:53.354567 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:53.354567 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:53.354567 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:53.354567 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:53.354567 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:53.354567 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:53.354567 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:53.354567 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:53.354567 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:53.354567 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:53.354567 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:53.354567 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:53.354567 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:53.354567 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:53.354567 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:53.356463 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:53.356463 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:53.356463 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:53.356463 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:53.356463 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:53.356463 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:53.356463 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:53.356463 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:53.356463 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:53.356463 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:53.356463 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:53.356463 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:53.356463 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:53.356463 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:53.356463 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:53.356463 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:53.356463 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:53.356463 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:53.358390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:53.358390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:53.358390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:53.358390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:53.358390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:53.358390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:53.358390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:53.358390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:53.358390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:47:53.358390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:53.361438 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 448/889] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:47:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:53.362015 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece9401-f538-464c-9ee2-62afebf4cbe3 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:53.362436 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6053f1-e446-423f-b260-1f31054a75bb None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:53.400477 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913520d-7728-4408-bd5a-3b4f9f196086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:53.401189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913520d-7728-4408-bd5a-3b4f9f196086 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:53.401569 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913520d-7728-4408-bd5a-3b4f9f196086 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:53.401961 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913520d-7728-4408-bd5a-3b4f9f196086 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:53.402844 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913520d-7728-4408-bd5a-3b4f9f196086 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:53.404295 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913520d-7728-4408-bd5a-3b4f9f196086 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:53.411074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 442/890] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:47:53 2022] GET /identity/v3/services => generated 1268 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 15:47:53.490497 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6053f1-e446-423f-b260-1f31054a75bb None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:53.534305 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94899ab6-71b1-4568-abd2-d841e1e5728e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:53.535308 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94899ab6-71b1-4568-abd2-d841e1e5728e None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:53.535817 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94899ab6-71b1-4568-abd2-d841e1e5728e None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:53.536272 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94899ab6-71b1-4568-abd2-d841e1e5728e None admin] PATH_INFO: `/v3/users` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:53.537316 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94899ab6-71b1-4568-abd2-d841e1e5728e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:53.537856 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94899ab6-71b1-4568-abd2-d841e1e5728e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:53.539512 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94899ab6-71b1-4568-abd2-d841e1e5728e None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:53.562948 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 449/891] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 9 15:47:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:53.568670 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913520d-7728-4408-bd5a-3b4f9f196086 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:53.692485 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913520d-7728-4408-bd5a-3b4f9f196086 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:53.727373 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716bbf1-cd43-4d5c-bc71-3da4dc92b12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:53.728315 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716bbf1-cd43-4d5c-bc71-3da4dc92b12e None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:53.728754 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716bbf1-cd43-4d5c-bc71-3da4dc92b12e None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:53.729187 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716bbf1-cd43-4d5c-bc71-3da4dc92b12e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:53.799460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716bbf1-cd43-4d5c-bc71-3da4dc92b12e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:53.801151 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716bbf1-cd43-4d5c-bc71-3da4dc92b12e None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:53.912897 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 443/892] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:47:53 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:47:53.918990 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94899ab6-71b1-4568-abd2-d841e1e5728e None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:54.026234 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94899ab6-71b1-4568-abd2-d841e1e5728e None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:54.061978 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e018e-fd91-44dc-90ee-4dc7a30fd871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:54.062701 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e018e-fd91-44dc-90ee-4dc7a30fd871 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:54.062983 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e018e-fd91-44dc-90ee-4dc7a30fd871 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:54.063257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e018e-fd91-44dc-90ee-4dc7a30fd871 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:54.082912 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e018e-fd91-44dc-90ee-4dc7a30fd871 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:54.084473 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e018e-fd91-44dc-90ee-4dc7a30fd871 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:54.096348 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cd67b-811a-40e7-9ee8-4f724068c08c None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:54.096556 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cd67b-811a-40e7-9ee8-4f724068c08c None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:54.096826 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cd67b-811a-40e7-9ee8-4f724068c08c None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:54.098927 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 444/893] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:54.106469 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74281e-0b29-4542-a2b3-752928568c97 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:54.106939 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74281e-0b29-4542-a2b3-752928568c97 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:54.107458 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74281e-0b29-4542-a2b3-752928568c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:54.107622 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-9e3e018e-fd91-44dc-90ee-4dc7a30fd871 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:54.107622 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:54.107622 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:54.107622 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:54.107622 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:54.107622 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:54.107622 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:54.107622 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:54.107622 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:54.107622 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:54.107622 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:54.107622 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:54.107622 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:54.107622 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:54.107622 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:54.108544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:54.108544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:54.108544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:54.108544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:54.108544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:54.108544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:54.108544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:54.108544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:54.108544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:54.108544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:54.108544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:54.108544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:54.108544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:54.108544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:54.108544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:54.108544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:54.108544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:54.109644 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:54.109644 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:54.109644 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:54.109644 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:54.112146 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 450/894] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:54.116378 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e018e-fd91-44dc-90ee-4dc7a30fd871 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:54.139853 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-4b74281e-0b29-4542-a2b3-752928568c97 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:54.141656 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-4b74281e-0b29-4542-a2b3-752928568c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:54.222200 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 445/895] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:47:54.223813 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f3eb6-6aa4-4f4a-be60-3c4c1666eeaf None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:54.224173 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f3eb6-6aa4-4f4a-be60-3c4c1666eeaf None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:54.224521 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f3eb6-6aa4-4f4a-be60-3c4c1666eeaf None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:54.226019 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 446/896] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:54.235534 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c3105-a3ea-43bf-b4e8-af45dab5ed8f None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:54.236209 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c3105-a3ea-43bf-b4e8-af45dab5ed8f None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:54.236720 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c3105-a3ea-43bf-b4e8-af45dab5ed8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:54.248620 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e018e-fd91-44dc-90ee-4dc7a30fd871 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:54.255196 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-ae5c3105-a3ea-43bf-b4e8-af45dab5ed8f None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:54.256769 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-ae5c3105-a3ea-43bf-b4e8-af45dab5ed8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:54.287399 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed657b-30c5-4f34-b703-6d088d1935e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:54.288067 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed657b-30c5-4f34-b703-6d088d1935e3 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:54.288347 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed657b-30c5-4f34-b703-6d088d1935e3 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:54.288626 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed657b-30c5-4f34-b703-6d088d1935e3 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:54.289352 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed657b-30c5-4f34-b703-6d088d1935e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:54.289693 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed657b-30c5-4f34-b703-6d088d1935e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:54.291059 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed657b-30c5-4f34-b703-6d088d1935e3 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:54.302996 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 451/897] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:47:54.303584 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed657b-30c5-4f34-b703-6d088d1935e3 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:54.341479 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 447/898] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:47:54.341479 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c3105-a3ea-43bf-b4e8-af45dab5ed8f None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:54.416668 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed657b-30c5-4f34-b703-6d088d1935e3 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:54.442418 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c3105-a3ea-43bf-b4e8-af45dab5ed8f None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:54.452510 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5020b-cf42-425d-863c-9e86670e9428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:54.453326 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5020b-cf42-425d-863c-9e86670e9428 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:54.453633 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5020b-cf42-425d-863c-9e86670e9428 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:54.453904 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5020b-cf42-425d-863c-9e86670e9428 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:54.454562 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5020b-cf42-425d-863c-9e86670e9428 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:54.455917 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5020b-cf42-425d-863c-9e86670e9428 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:54.469652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-19b5020b-cf42-425d-863c-9e86670e9428 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:47:54.469652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:54.469652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:47:54.469652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:47:54.469652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:47:54.469652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:47:54.469652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:47:54.469652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:54.469652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:47:54.469652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:54.469652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:47:54.469652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:54.469652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:54.469652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:54.469652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:54.469652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:54.470779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:54.470779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:54.470779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:54.470779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:54.470779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:54.470779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:54.470779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:54.470779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:47:54.470779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:47:54.470779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:47:54.470779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:47:54.470779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:54.470779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:54.470779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:54.470779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:54.470779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:54.471749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:54.471749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:54.471749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:54.471749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:54.471749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:54.471749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:54.471749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:54.471749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:54.471749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:54.471749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:54.471749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:54.471749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:47:54.471749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:54.471749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:47:54.471749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:54.471749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 452/899] 10.222.0.48 () {56 vars in 1132 bytes} [Mon May 9 15:47:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:54.473273 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5020b-cf42-425d-863c-9e86670e9428 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:54.484089 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8205b1-8cc3-4e8c-a56c-b409495007cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:54.484909 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8205b1-8cc3-4e8c-a56c-b409495007cf None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:54.485198 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8205b1-8cc3-4e8c-a56c-b409495007cf None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:54.485515 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8205b1-8cc3-4e8c-a56c-b409495007cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:54.492693 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8205b1-8cc3-4e8c-a56c-b409495007cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:54.494180 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8205b1-8cc3-4e8c-a56c-b409495007cf None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:54.510981 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-3e8205b1-8cc3-4e8c-a56c-b409495007cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:54.510981 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:54.510981 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:54.510981 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:54.510981 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:54.510981 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:54.510981 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:54.510981 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:54.510981 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:54.510981 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:54.510981 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:54.510981 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:54.510981 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:54.510981 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:54.510981 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:54.513011 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:54.513011 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:54.513011 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:54.513011 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:54.513011 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:54.513011 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:54.513011 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:54.513011 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:54.513011 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:54.513011 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:54.513011 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:54.513011 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:54.513011 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:54.513011 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:54.513011 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:54.513011 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:54.513011 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:54.519715 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:54.519715 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:54.519715 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:54.519715 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:54.519715 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:54.519715 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:54.519715 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:54.519715 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:54.519715 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 448/900] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:54.519715 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8205b1-8cc3-4e8c-a56c-b409495007cf None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:54.573028 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5020b-cf42-425d-863c-9e86670e9428 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:54.608351 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050485f3-68bb-41ef-89d1-a83d994b0487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:54.609747 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050485f3-68bb-41ef-89d1-a83d994b0487 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:54.610279 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050485f3-68bb-41ef-89d1-a83d994b0487 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:54.610778 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050485f3-68bb-41ef-89d1-a83d994b0487 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:54.611666 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050485f3-68bb-41ef-89d1-a83d994b0487 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:54.613270 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050485f3-68bb-41ef-89d1-a83d994b0487 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:54.624173 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8205b1-8cc3-4e8c-a56c-b409495007cf None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:54.633167 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-050485f3-68bb-41ef-89d1-a83d994b0487 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:47:54.633167 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:54.633167 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:47:54.633167 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:47:54.633167 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:47:54.633167 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:47:54.633167 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:47:54.633167 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:54.633167 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:47:54.633167 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:54.633167 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:47:54.633167 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:54.633167 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:54.633167 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:54.633167 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:54.633167 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:54.633167 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:54.634416 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:54.634416 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:54.634416 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:54.634416 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:54.634416 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:54.634416 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:54.634416 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:47:54.634416 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:47:54.634416 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:47:54.634416 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:47:54.634416 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:54.634416 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:54.634416 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:54.634416 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:54.634416 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:54.634416 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:54.635358 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:54.635358 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:54.635358 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:54.635358 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:54.635358 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:54.635358 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:54.635358 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:54.635358 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:54.635358 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:54.635358 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:54.635358 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:47:54.635358 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:54.635358 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:47:54.635358 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:54.635358 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 453/901] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:47:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:54.636382 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050485f3-68bb-41ef-89d1-a83d994b0487 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:54.666629 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa846d77-6e18-4e51-b0d1-362b3d537385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:54.667308 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa846d77-6e18-4e51-b0d1-362b3d537385 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:54.667602 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa846d77-6e18-4e51-b0d1-362b3d537385 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:54.667884 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa846d77-6e18-4e51-b0d1-362b3d537385 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:54.669806 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa846d77-6e18-4e51-b0d1-362b3d537385 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:54.670322 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa846d77-6e18-4e51-b0d1-362b3d537385 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:54.671937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa846d77-6e18-4e51-b0d1-362b3d537385 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:54.683266 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 449/902] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:47:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:54.683266 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa846d77-6e18-4e51-b0d1-362b3d537385 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:54.747371 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050485f3-68bb-41ef-89d1-a83d994b0487 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:54.785102 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa8154-ced7-4354-827e-1c96936d7f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:54.785822 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa8154-ced7-4354-827e-1c96936d7f3c None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:54.786108 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa8154-ced7-4354-827e-1c96936d7f3c None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:54.786388 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa8154-ced7-4354-827e-1c96936d7f3c None admin] PATH_INFO: `/v3/projects` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:54.787197 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa8154-ced7-4354-827e-1c96936d7f3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:54.787509 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa8154-ced7-4354-827e-1c96936d7f3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:54.788949 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa8154-ced7-4354-827e-1c96936d7f3c None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:54.790733 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa846d77-6e18-4e51-b0d1-362b3d537385 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:54.802139 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 454/903] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:54.803263 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa8154-ced7-4354-827e-1c96936d7f3c None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:54.831296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d9b61-23a7-4c02-9bea-eb6bc3b9b557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:54.831978 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d9b61-23a7-4c02-9bea-eb6bc3b9b557 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:54.832291 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d9b61-23a7-4c02-9bea-eb6bc3b9b557 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:54.832542 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d9b61-23a7-4c02-9bea-eb6bc3b9b557 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:54.833265 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d9b61-23a7-4c02-9bea-eb6bc3b9b557 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:54.833603 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d9b61-23a7-4c02-9bea-eb6bc3b9b557 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:54.834963 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d9b61-23a7-4c02-9bea-eb6bc3b9b557 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:54.839729 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 450/904] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:47:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:54.840829 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d9b61-23a7-4c02-9bea-eb6bc3b9b557 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:54.916272 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa8154-ced7-4354-827e-1c96936d7f3c None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:54.941499 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d9b61-23a7-4c02-9bea-eb6bc3b9b557 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:54.951272 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea1cac-a2c6-402a-acf0-122484b4a97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:54.951939 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea1cac-a2c6-402a-acf0-122484b4a97e None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:54.952220 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea1cac-a2c6-402a-acf0-122484b4a97e None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:54.952494 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea1cac-a2c6-402a-acf0-122484b4a97e None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:54.953205 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea1cac-a2c6-402a-acf0-122484b4a97e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:54.953542 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea1cac-a2c6-402a-acf0-122484b4a97e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:54.954896 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea1cac-a2c6-402a-acf0-122484b4a97e None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:54.964625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 455/905] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:47:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:54.964625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea1cac-a2c6-402a-acf0-122484b4a97e None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:54.977462 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d694d0c-c7af-45a3-8443-316c530049d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:54.978522 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d694d0c-c7af-45a3-8443-316c530049d9 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:54.978818 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d694d0c-c7af-45a3-8443-316c530049d9 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:54.979102 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d694d0c-c7af-45a3-8443-316c530049d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:54.979982 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d694d0c-c7af-45a3-8443-316c530049d9 None admin] RBAC: Adding query filter params (role.id=ff87cf1a4a9e4b3c81335757b13daf0b, scope.project.id=7860d281acf642d2a3950424901b9487, user.id=64be0f5d9f1948e08b530b618245b6d0) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:54.980300 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d694d0c-c7af-45a3-8443-316c530049d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:54.982705 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d694d0c-c7af-45a3-8443-316c530049d9 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:54.997677 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 451/906] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:47:54 2022] GET /identity/v3/role_assignments?user.id=64be0f5d9f1948e08b530b618245b6d0&scope.project.id=7860d281acf642d2a3950424901b9487&role.id=ff87cf1a4a9e4b3c81335757b13daf0b => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:54.997677 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d694d0c-c7af-45a3-8443-316c530049d9 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:55.115483 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea1cac-a2c6-402a-acf0-122484b4a97e None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:55.118869 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d694d0c-c7af-45a3-8443-316c530049d9 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:55.171813 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c93ab-0250-4533-b150-ea9b789dd8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:55.172757 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c93ab-0250-4533-b150-ea9b789dd8ff None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:55.173194 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c93ab-0250-4533-b150-ea9b789dd8ff None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:55.173628 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c93ab-0250-4533-b150-ea9b789dd8ff None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:55.174240 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806e6fb-5d40-4459-97a4-e3b2f5ca5449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:55.174655 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c93ab-0250-4533-b150-ea9b789dd8ff None admin] RBAC: Adding query filter params (type=object-store) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:55.175046 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806e6fb-5d40-4459-97a4-e3b2f5ca5449 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:55.175202 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c93ab-0250-4533-b150-ea9b789dd8ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:55.175530 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806e6fb-5d40-4459-97a4-e3b2f5ca5449 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:55.175861 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806e6fb-5d40-4459-97a4-e3b2f5ca5449 None admin] PATH_INFO: `/v3/endpoints` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:55.176873 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806e6fb-5d40-4459-97a4-e3b2f5ca5449 None admin] RBAC: Adding query filter params (interface=public, service_id=057a1ea4a40846608d3c427daf1df1fd, region_id=RegionOne) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:55.177334 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806e6fb-5d40-4459-97a4-e3b2f5ca5449 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:55.177491 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c93ab-0250-4533-b150-ea9b789dd8ff None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:55.179023 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806e6fb-5d40-4459-97a4-e3b2f5ca5449 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:55.185199 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 456/907] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:47:54 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:55.188215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 452/908] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:47:54 2022] GET /identity/v3/endpoints?service_id=057a1ea4a40846608d3c427daf1df1fd&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:55.195074 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c93ab-0250-4533-b150-ea9b789dd8ff None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:55.313677 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c93ab-0250-4533-b150-ea9b789dd8ff None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:55.353079 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12bc24e-1df6-4adb-a9c4-bee212b08406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:55.353792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bc24e-1df6-4adb-a9c4-bee212b08406 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:55.354077 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bc24e-1df6-4adb-a9c4-bee212b08406 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:55.354353 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bc24e-1df6-4adb-a9c4-bee212b08406 None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:55.355052 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12bc24e-1df6-4adb-a9c4-bee212b08406 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:55.356838 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12bc24e-1df6-4adb-a9c4-bee212b08406 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:55.363694 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 457/909] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:47:55 2022] GET /identity/v3/services => generated 1268 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:47:55.931627 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0353dbf-065f-42ca-bb7b-3d359d2ae467 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:55.932308 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0353dbf-065f-42ca-bb7b-3d359d2ae467 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:55.932308 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0353dbf-065f-42ca-bb7b-3d359d2ae467 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:55.934415 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 453/910] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:55.940594 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbb333-a354-4a63-8883-22cf85718610 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:55.940883 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbb333-a354-4a63-8883-22cf85718610 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:55.941164 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbb333-a354-4a63-8883-22cf85718610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:55.958708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-90dbb333-a354-4a63-8883-22cf85718610 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:55.959920 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-90dbb333-a354-4a63-8883-22cf85718610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:56.035320 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 458/911] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:47:56.060110 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0353dbf-065f-42ca-bb7b-3d359d2ae467 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:56.179145 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0353dbf-065f-42ca-bb7b-3d359d2ae467 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:56.216579 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b830c-94f3-4a07-a710-2ab2ddb42812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:56.217401 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b830c-94f3-4a07-a710-2ab2ddb42812 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:56.217669 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b830c-94f3-4a07-a710-2ab2ddb42812 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:56.217953 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b830c-94f3-4a07-a710-2ab2ddb42812 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:56.218632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b830c-94f3-4a07-a710-2ab2ddb42812 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:56.220018 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b830c-94f3-4a07-a710-2ab2ddb42812 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:56.233512 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-e50b830c-94f3-4a07-a710-2ab2ddb42812 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:47:56.233512 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:56.233512 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:47:56.233512 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:47:56.233512 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:47:56.233512 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:47:56.233512 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:47:56.233512 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:56.233512 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:47:56.233512 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:56.233512 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:47:56.233512 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:56.233512 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:56.233512 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:56.233512 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:56.233512 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:56.233512 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:56.236000 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:56.236000 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:56.236000 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:56.236000 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:56.236000 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:56.236000 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:56.236000 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:47:56.236000 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:47:56.236000 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:47:56.236000 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:47:56.236000 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:56.236000 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:56.236000 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:56.236000 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:56.236000 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:56.236000 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:56.238130 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:56.238130 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:56.238130 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:56.238130 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:56.238130 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:56.238130 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:56.238130 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:56.238130 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:56.238130 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:56.238130 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:56.238130 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:47:56.238130 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:56.238130 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 09 15:47:56.238130 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:56.238130 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 454/912] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:47:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:56.244663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbb333-a354-4a63-8883-22cf85718610 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:56.349571 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbb333-a354-4a63-8883-22cf85718610 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:56.390298 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeec9c5-9990-4fa0-b28d-e10746f5be47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:56.395307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeec9c5-9990-4fa0-b28d-e10746f5be47 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:56.395307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeec9c5-9990-4fa0-b28d-e10746f5be47 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:56.395307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeec9c5-9990-4fa0-b28d-e10746f5be47 None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:56.395307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeec9c5-9990-4fa0-b28d-e10746f5be47 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:56.395307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeec9c5-9990-4fa0-b28d-e10746f5be47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:56.395307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeec9c5-9990-4fa0-b28d-e10746f5be47 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:56.400735 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 459/913] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:47:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:56.407130 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b830c-94f3-4a07-a710-2ab2ddb42812 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:56.515970 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b830c-94f3-4a07-a710-2ab2ddb42812 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:56.555377 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d23bda-bfb9-4370-bdf1-6f4e08ecb0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:56.556073 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d23bda-bfb9-4370-bdf1-6f4e08ecb0f6 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:56.556363 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d23bda-bfb9-4370-bdf1-6f4e08ecb0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:56.556648 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d23bda-bfb9-4370-bdf1-6f4e08ecb0f6 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:56.557417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d23bda-bfb9-4370-bdf1-6f4e08ecb0f6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:56.557739 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d23bda-bfb9-4370-bdf1-6f4e08ecb0f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:56.559997 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d23bda-bfb9-4370-bdf1-6f4e08ecb0f6 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:56.566510 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 455/914] 10.222.0.48 () {56 vars in 1114 bytes} [Mon May 9 15:47:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:56.572352 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeec9c5-9990-4fa0-b28d-e10746f5be47 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:56.692599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeec9c5-9990-4fa0-b28d-e10746f5be47 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:56.731643 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828df71-7794-4281-ba69-e602accc698a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:56.732317 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828df71-7794-4281-ba69-e602accc698a None admin] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:56.732597 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828df71-7794-4281-ba69-e602accc698a None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:56.732868 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828df71-7794-4281-ba69-e602accc698a None admin] PATH_INFO: `/v3/endpoints` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:56.733687 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828df71-7794-4281-ba69-e602accc698a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:56.735107 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828df71-7794-4281-ba69-e602accc698a None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:56.758688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 460/915] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:47:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:47:57.467546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e017ed-3495-4c89-947a-176a685c1564 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:57.468243 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e017ed-3495-4c89-947a-176a685c1564 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:57.468243 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e017ed-3495-4c89-947a-176a685c1564 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:57.469682 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 456/916] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:57.476193 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c989f-be13-4a45-acf0-2d21aaa91316 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:57.477057 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c989f-be13-4a45-acf0-2d21aaa91316 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:57.477726 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c989f-be13-4a45-acf0-2d21aaa91316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:57.496004 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-fc1c989f-be13-4a45-acf0-2d21aaa91316 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:57.497793 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-fc1c989f-be13-4a45-acf0-2d21aaa91316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:57.589489 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 461/917] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:47:57.621926 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e017ed-3495-4c89-947a-176a685c1564 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:57.635762 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df32273-93bc-498f-9f39-e9a08b2d4d28 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:57.636315 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df32273-93bc-498f-9f39-e9a08b2d4d28 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:57.636900 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df32273-93bc-498f-9f39-e9a08b2d4d28 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:57.639626 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 462/918] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:57 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:57.649265 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454d25f-dab1-4bfc-b1fc-e68e3d6d7c25 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:57.649265 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454d25f-dab1-4bfc-b1fc-e68e3d6d7c25 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:57.649265 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454d25f-dab1-4bfc-b1fc-e68e3d6d7c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:57.684145 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-c454d25f-dab1-4bfc-b1fc-e68e3d6d7c25 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:57.689443 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-c454d25f-dab1-4bfc-b1fc-e68e3d6d7c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:57.821601 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 463/919] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:47:57.823599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80375cd-5e12-4a3d-ad14-9ec2f1a479f8 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:57.826140 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80375cd-5e12-4a3d-ad14-9ec2f1a479f8 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:57.826675 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80375cd-5e12-4a3d-ad14-9ec2f1a479f8 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:57.829312 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 464/920] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:57.834110 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340357e-9ee1-48ed-9e17-d3a1aa9e13a7 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:57.835413 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340357e-9ee1-48ed-9e17-d3a1aa9e13a7 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:57.836099 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340357e-9ee1-48ed-9e17-d3a1aa9e13a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:57.851712 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e017ed-3495-4c89-947a-176a685c1564 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:57.861067 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-e340357e-9ee1-48ed-9e17-d3a1aa9e13a7 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:57.862487 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-e340357e-9ee1-48ed-9e17-d3a1aa9e13a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:57.889593 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41192c48-4b5c-4fdf-b8de-605a4d610e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:57.890814 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41192c48-4b5c-4fdf-b8de-605a4d610e83 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:57.891359 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41192c48-4b5c-4fdf-b8de-605a4d610e83 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:57.891870 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41192c48-4b5c-4fdf-b8de-605a4d610e83 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:57.903557 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41192c48-4b5c-4fdf-b8de-605a4d610e83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:47:57.912221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-41192c48-4b5c-4fdf-b8de-605a4d610e83 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:47:57.912221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:57.912221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:57.912221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:57.912221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:57.912221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:57.912221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:57.912221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:57.912221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:57.912221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:57.912221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:57.912221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:57.912221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:47:57.912221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:47:57.912221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:47:57.912221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:47:57.913525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:47:57.913525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:47:57.913525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:47:57.913525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:47:57.913525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:57.913525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:57.913525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:57.913525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:57.913525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:57.913525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:57.913525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:57.913525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:57.913525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:57.913525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:57.913525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:57.913525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:57.914686 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:57.914686 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:57.914686 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:57.914686 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:57.914686 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:47:57.914686 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:47:57.914686 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:47:57.914686 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:47:57.914686 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:47:57.914686 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:47:57.914686 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:47:57.914686 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:57.922952 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 457/921] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 9 15:47:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:57.924133 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41192c48-4b5c-4fdf-b8de-605a4d610e83 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:57.949060 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 465/922] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:47:57.951165 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340357e-9ee1-48ed-9e17-d3a1aa9e13a7 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:58.069122 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41192c48-4b5c-4fdf-b8de-605a4d610e83 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:58.081428 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340357e-9ee1-48ed-9e17-d3a1aa9e13a7 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:58.107891 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef944ec-2533-4ec0-826f-b799f1cceedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:58.108757 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef944ec-2533-4ec0-826f-b799f1cceedc None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:58.109083 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef944ec-2533-4ec0-826f-b799f1cceedc None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:58.109422 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef944ec-2533-4ec0-826f-b799f1cceedc None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:58.110239 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef944ec-2533-4ec0-826f-b799f1cceedc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:58.112033 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef944ec-2533-4ec0-826f-b799f1cceedc None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:58.129877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 458/923] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:47:57 2022] POST /identity/v3/services => generated 241 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:47:58.130640 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef944ec-2533-4ec0-826f-b799f1cceedc None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:58.150104 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a4ade-5b48-4c37-bf5b-5308dd28b21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:58.152001 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a4ade-5b48-4c37-bf5b-5308dd28b21b None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:58.152786 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a4ade-5b48-4c37-bf5b-5308dd28b21b None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:58.153289 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a4ade-5b48-4c37-bf5b-5308dd28b21b None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:58.154645 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a4ade-5b48-4c37-bf5b-5308dd28b21b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:58.155607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a4ade-5b48-4c37-bf5b-5308dd28b21b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:58.157452 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a4ade-5b48-4c37-bf5b-5308dd28b21b None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:58.172673 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 466/924] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:47:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:58.179753 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a4ade-5b48-4c37-bf5b-5308dd28b21b None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:58.260185 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef944ec-2533-4ec0-826f-b799f1cceedc None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:58.299000 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8077203-3c5a-455d-87d0-fab635e2940f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:58.299875 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8077203-3c5a-455d-87d0-fab635e2940f None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:58.300212 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8077203-3c5a-455d-87d0-fab635e2940f None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:58.300497 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8077203-3c5a-455d-87d0-fab635e2940f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:58.301172 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8077203-3c5a-455d-87d0-fab635e2940f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:58.302613 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8077203-3c5a-455d-87d0-fab635e2940f None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:58.305678 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a4ade-5b48-4c37-bf5b-5308dd28b21b None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:58.316508 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-b8077203-3c5a-455d-87d0-fab635e2940f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:47:58.316508 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:58.316508 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:47:58.316508 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:47:58.316508 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:47:58.316508 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:47:58.316508 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:47:58.316508 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:58.316508 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:47:58.316508 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:58.316508 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:47:58.316508 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:58.316508 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:58.316508 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:58.316508 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:58.316508 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:58.317735 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:58.317735 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:58.317735 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:58.317735 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:58.317735 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:58.317735 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:58.317735 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:58.317735 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:47:58.317735 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:47:58.317735 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:47:58.317735 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:47:58.317735 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:58.317735 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:58.317735 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:58.317735 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:58.317735 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:58.319142 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:58.319142 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:58.319142 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:58.319142 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:58.319142 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:58.319142 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:58.319142 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:58.319142 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:58.319142 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:58.319142 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:58.319142 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:58.319142 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:47:58.319142 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:47:58.319142 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 09 15:47:58.319142 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:58.319142 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 459/925] 10.222.0.48 () {56 vars in 1132 bytes} [Mon May 9 15:47:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:58.323801 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8077203-3c5a-455d-87d0-fab635e2940f None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:58.354524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147cbfe-4284-4ee5-8525-5746626fce31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:58.355254 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147cbfe-4284-4ee5-8525-5746626fce31 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:58.356412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147cbfe-4284-4ee5-8525-5746626fce31 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:58.356928 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147cbfe-4284-4ee5-8525-5746626fce31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:58.368442 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147cbfe-4284-4ee5-8525-5746626fce31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:58.370202 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147cbfe-4284-4ee5-8525-5746626fce31 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:58.391808 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-e147cbfe-4284-4ee5-8525-5746626fce31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:58.391808 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:58.391808 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:58.391808 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:58.391808 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:58.391808 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:58.391808 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:58.391808 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:58.391808 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:58.391808 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:58.391808 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:58.391808 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:58.391808 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:58.391808 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:58.391808 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:58.393085 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:58.393085 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:58.393085 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:58.393085 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:58.393085 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:58.393085 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:58.393085 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:58.393085 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:58.393085 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:58.393085 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:58.393085 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:58.393085 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:58.393085 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:58.393085 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:58.393085 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:58.393085 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:58.393085 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:58.394212 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:58.394212 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:58.394212 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:58.394212 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:58.395489 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 467/926] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:58.400839 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147cbfe-4284-4ee5-8525-5746626fce31 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:58.468286 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8077203-3c5a-455d-87d0-fab635e2940f None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:58.507795 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec224d6-dd06-4967-a153-42c0278e0f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:58.508833 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec224d6-dd06-4967-a153-42c0278e0f49 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:58.509330 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec224d6-dd06-4967-a153-42c0278e0f49 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:58.509847 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec224d6-dd06-4967-a153-42c0278e0f49 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:58.510646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147cbfe-4284-4ee5-8525-5746626fce31 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:58.511400 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec224d6-dd06-4967-a153-42c0278e0f49 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:58.511993 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec224d6-dd06-4967-a153-42c0278e0f49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:58.514164 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec224d6-dd06-4967-a153-42c0278e0f49 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:58.524384 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 460/927] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:47:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:58.525662 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec224d6-dd06-4967-a153-42c0278e0f49 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:58.551974 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a8dbf-968a-45f5-8bdf-115a7cce7d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:58.552763 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a8dbf-968a-45f5-8bdf-115a7cce7d1d None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:58.553226 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a8dbf-968a-45f5-8bdf-115a7cce7d1d None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:58.553697 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a8dbf-968a-45f5-8bdf-115a7cce7d1d None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:58.554628 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a8dbf-968a-45f5-8bdf-115a7cce7d1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:58.555108 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a8dbf-968a-45f5-8bdf-115a7cce7d1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:58.556717 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a8dbf-968a-45f5-8bdf-115a7cce7d1d None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:58.575113 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 468/928] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:47:58.576686 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a8dbf-968a-45f5-8bdf-115a7cce7d1d None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:58.639789 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec224d6-dd06-4967-a153-42c0278e0f49 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:58.677053 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cbb3f-693e-4ca3-a37a-b6ceac9d7aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:58.678150 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cbb3f-693e-4ca3-a37a-b6ceac9d7aeb None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:58.678692 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cbb3f-693e-4ca3-a37a-b6ceac9d7aeb None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:58.679197 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cbb3f-693e-4ca3-a37a-b6ceac9d7aeb None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:58.680148 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cbb3f-693e-4ca3-a37a-b6ceac9d7aeb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:58.680701 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cbb3f-693e-4ca3-a37a-b6ceac9d7aeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:58.682330 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cbb3f-693e-4ca3-a37a-b6ceac9d7aeb None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:58.689772 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a8dbf-968a-45f5-8bdf-115a7cce7d1d None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:58.695064 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 461/929] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:47:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:58.696241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cbb3f-693e-4ca3-a37a-b6ceac9d7aeb None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:58.732174 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e0633-3d01-4bd8-8d1c-129a606d383b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:58.733418 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e0633-3d01-4bd8-8d1c-129a606d383b None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:58.733875 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e0633-3d01-4bd8-8d1c-129a606d383b None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:58.734347 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e0633-3d01-4bd8-8d1c-129a606d383b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:58.743033 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e0633-3d01-4bd8-8d1c-129a606d383b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:58.744498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e0633-3d01-4bd8-8d1c-129a606d383b None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:58.764553 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-9c0e0633-3d01-4bd8-8d1c-129a606d383b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:47:58.764553 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:58.764553 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:58.764553 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:58.764553 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:58.764553 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:58.764553 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:58.764553 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:58.764553 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:58.764553 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:58.764553 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:58.764553 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:58.764553 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:47:58.764553 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:47:58.764553 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:47:58.764553 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:47:58.766379 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:58.766379 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:58.766379 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:47:58.766379 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:58.766379 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:47:58.766379 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:47:58.766379 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:58.766379 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:58.766379 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:58.766379 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:58.766379 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:58.766379 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:58.766379 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:58.766379 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:58.766379 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:58.766379 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:58.766379 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:58.766379 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:58.768327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:58.768327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:58.768327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:47:58.768327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:47:58.768327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:47:58.768327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:47:58.768327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:47:58.768327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:47:58.768327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:47:58.768327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:58.768327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 469/930] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:47:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:47:58.773184 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e0633-3d01-4bd8-8d1c-129a606d383b None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:58.821035 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cbb3f-693e-4ca3-a37a-b6ceac9d7aeb None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:58.858779 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb2d63-d492-47a0-9393-31b90edeffad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:58.859445 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb2d63-d492-47a0-9393-31b90edeffad None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:58.859736 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb2d63-d492-47a0-9393-31b90edeffad None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:58.860080 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb2d63-d492-47a0-9393-31b90edeffad None admin] PATH_INFO: `/v3/endpoints` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:58.860851 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb2d63-d492-47a0-9393-31b90edeffad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:58.862278 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb2d63-d492-47a0-9393-31b90edeffad None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:58.893039 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 462/931] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:47:58 2022] POST /identity/v3/endpoints => generated 347 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:47:58.907311 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e0633-3d01-4bd8-8d1c-129a606d383b None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:58.955067 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ffb0b-2f0f-4bdc-b43f-c62fdae92331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:58.956117 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ffb0b-2f0f-4bdc-b43f-c62fdae92331 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:58.956574 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ffb0b-2f0f-4bdc-b43f-c62fdae92331 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:58.957011 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ffb0b-2f0f-4bdc-b43f-c62fdae92331 None admin] PATH_INFO: `/v3/users` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:58.958179 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ffb0b-2f0f-4bdc-b43f-c62fdae92331 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:58.958717 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ffb0b-2f0f-4bdc-b43f-c62fdae92331 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:58.960462 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ffb0b-2f0f-4bdc-b43f-c62fdae92331 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:58.987838 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 470/932] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 9 15:47:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:58.989592 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb2d63-d492-47a0-9393-31b90edeffad None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:59.111161 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb2d63-d492-47a0-9393-31b90edeffad None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:59.158789 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e3d1d-63b5-4050-bb5f-94d63193feb5 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:59.158789 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e3d1d-63b5-4050-bb5f-94d63193feb5 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:59.159142 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e3d1d-63b5-4050-bb5f-94d63193feb5 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:59.160985 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 471/933] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:47:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:47:59.162840 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c11b01-23b5-41a0-828e-939ff86d832a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:59.164235 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c11b01-23b5-41a0-828e-939ff86d832a None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:59.164703 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c11b01-23b5-41a0-828e-939ff86d832a None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:59.165228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c11b01-23b5-41a0-828e-939ff86d832a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:59.167160 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1797fa-0786-4a48-887b-11a31b1b2b3d None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:59.167564 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1797fa-0786-4a48-887b-11a31b1b2b3d None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:59.167849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1797fa-0786-4a48-887b-11a31b1b2b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:59.183499 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c11b01-23b5-41a0-828e-939ff86d832a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:59.185753 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c11b01-23b5-41a0-828e-939ff86d832a None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:59.193901 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-5d1797fa-0786-4a48-887b-11a31b1b2b3d None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:47:59.195125 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-5d1797fa-0786-4a48-887b-11a31b1b2b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:47:59.209772 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-f9c11b01-23b5-41a0-828e-939ff86d832a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:59.209772 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:59.209772 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:59.209772 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:59.209772 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:59.209772 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:59.209772 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:59.209772 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:59.209772 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:59.209772 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:59.209772 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:59.209772 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:59.209772 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:47:59.209772 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:47:59.209772 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:47:59.211253 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:47:59.211253 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:59.211253 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:59.211253 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:59.211253 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:59.211253 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:59.211253 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:59.211253 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:59.211253 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:59.211253 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:59.211253 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:59.211253 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:59.211253 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:59.211253 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:59.211253 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:59.211253 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:59.211253 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:59.212881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:47:59.212881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:47:59.212881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:47:59.212881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:59.212881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 463/934] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:59.217755 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c11b01-23b5-41a0-828e-939ff86d832a None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:59.291760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 472/935] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:47:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:47:59.316698 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1797fa-0786-4a48-887b-11a31b1b2b3d None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:59.326813 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c11b01-23b5-41a0-828e-939ff86d832a None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:59.365813 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecb163-ecff-473d-b7d5-7f9246ccb3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:59.366492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecb163-ecff-473d-b7d5-7f9246ccb3cd None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:59.366775 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecb163-ecff-473d-b7d5-7f9246ccb3cd None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:59.367053 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecb163-ecff-473d-b7d5-7f9246ccb3cd None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:59.368078 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecb163-ecff-473d-b7d5-7f9246ccb3cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:59.368388 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecb163-ecff-473d-b7d5-7f9246ccb3cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:59.369771 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecb163-ecff-473d-b7d5-7f9246ccb3cd None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:59.388366 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 464/936] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:47:59.389336 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecb163-ecff-473d-b7d5-7f9246ccb3cd None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:59.431438 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1797fa-0786-4a48-887b-11a31b1b2b3d None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:59.474719 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb85df-68cb-49fb-a2cc-77324c2dbfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:59.475407 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb85df-68cb-49fb-a2cc-77324c2dbfc7 None admin] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:59.475700 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb85df-68cb-49fb-a2cc-77324c2dbfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:59.475984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb85df-68cb-49fb-a2cc-77324c2dbfc7 None admin] PATH_INFO: `/v3/projects` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:59.476716 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb85df-68cb-49fb-a2cc-77324c2dbfc7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:59.478415 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb85df-68cb-49fb-a2cc-77324c2dbfc7 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:59.479807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: WARNING keystone.server.flask.common [None req-adfb85df-68cb-49fb-a2cc-77324c2dbfc7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 09 15:47:59.498646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.sql.core [None req-adfb85df-68cb-49fb-a2cc-77324c2dbfc7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 15:47:59.498646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 09 15:47:59.498646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [parameters: {'id': '4b99763bcf4c4f57b1db2ef9b6ee1716', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 09 15:47:59.498646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=276029) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 15:47:59.516888 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-adfb85df-68cb-49fb-a2cc-77324c2dbfc7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4b99763bcf4c4f57b1db2ef9b6ee1716.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4b99763bcf4c4f57b1db2ef9b6ee1716. May 09 15:47:59.516888 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:59.516888 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:47:59.516888 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:47:59.516888 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:47:59.516888 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:47:59.516888 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:47:59.516888 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:47:59.516888 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:47:59.516888 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application conn.query(q) May 09 15:47:59.516888 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:47:59.516888 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:47:59.516888 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:47:59.518327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application result.read() May 09 15:47:59.518327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:47:59.518327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:47:59.518327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:47:59.518327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:47:59.518327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:47:59.518327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:47:59.518327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:47:59.518327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:47:59.518327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 15:47:59.518327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:59.518327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 15:47:59.518327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:59.518327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:59.518327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 15:47:59.518327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 15:47:59.518327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 09 15:47:59.518327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return project_ref.to_dict() May 09 15:47:59.520175 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:47:59.520175 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application next(self.gen) May 09 15:47:59.520175 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 15:47:59.520175 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application yield resource May 09 15:47:59.520175 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:47:59.520175 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application next(self.gen) May 09 15:47:59.520175 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 15:47:59.520175 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self.session.rollback() May 09 15:47:59.520175 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 15:47:59.520175 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self.force_reraise() May 09 15:47:59.520175 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 15:47:59.520175 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise self.value May 09 15:47:59.520175 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 15:47:59.520175 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 15:47:59.520175 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 15:47:59.520175 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application session.commit() May 09 15:47:59.520175 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 15:47:59.521455 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 15:47:59.521455 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 15:47:59.521455 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._prepare_impl() May 09 15:47:59.521455 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 15:47:59.521455 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self.session.flush() May 09 15:47:59.521455 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 15:47:59.521455 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._flush(objects) May 09 15:47:59.521455 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 15:47:59.521455 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 15:47:59.521455 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 15:47:59.521455 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application compat.raise_( May 09 15:47:59.521455 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:47:59.521455 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception May 09 15:47:59.521455 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 15:47:59.521455 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application flush_context.execute() May 09 15:47:59.521455 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 15:47:59.521455 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rec.execute(self) May 09 15:47:59.522704 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 15:47:59.522704 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 15:47:59.522704 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 15:47:59.522704 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 15:47:59.522704 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 09 15:47:59.522704 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application c = connection._execute_20( May 09 15:47:59.522704 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 15:47:59.522704 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 15:47:59.522704 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 15:47:59.522704 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 15:47:59.522704 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 15:47:59.522704 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 15:47:59.522704 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 15:47:59.522704 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 15:47:59.522704 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 15:47:59.523981 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 15:47:59.523981 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:47:59.523981 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception May 09 15:47:59.523981 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:47:59.523981 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:47:59.523981 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:47:59.523981 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:47:59.523981 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:47:59.523981 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:47:59.523981 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:47:59.523981 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application conn.query(q) May 09 15:47:59.523981 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:47:59.523981 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:47:59.523981 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:47:59.523981 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application result.read() May 09 15:47:59.523981 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:47:59.523981 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:47:59.525241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:47:59.525241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:47:59.525241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:47:59.525241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:47:59.525241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:47:59.525241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:47:59.525241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 09 15:47:59.525241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 09 15:47:59.525241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [parameters: {'id': '4b99763bcf4c4f57b1db2ef9b6ee1716', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 09 15:47:59.525241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 15:47:59.525241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:59.525241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:47:59.525241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:59.525241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:59.525241 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 09 15:47:59.527425 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 09 15:47:59.527425 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 15:47:59.527425 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 15:47:59.527425 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 09 15:47:59.527425 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:59.527425 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:47:59.527425 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:59.527425 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:59.527425 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:59.527425 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:59.527425 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:59.527425 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:59.527425 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:59.527425 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:59.527425 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:59.527425 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:59.527425 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:59.530390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:59.530390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 09 15:47:59.530390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 09 15:47:59.530390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:59.530390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:59.530390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 09 15:47:59.530390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.Conflict( May 09 15:47:59.530390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4b99763bcf4c4f57b1db2ef9b6ee1716. May 09 15:47:59.530390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:59.530390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 473/937] 10.222.0.48 () {60 vars in 1140 bytes} [Mon May 9 15:47:59 2022] POST /identity/v3/projects => generated 262 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 09 15:47:59.530390 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb85df-68cb-49fb-a2cc-77324c2dbfc7 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:59.540085 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecb163-ecff-473d-b7d5-7f9246ccb3cd None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:59.587021 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdef4bb-9e91-44b6-a3d3-7919ec386a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:59.588409 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdef4bb-9e91-44b6-a3d3-7919ec386a53 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:59.588858 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdef4bb-9e91-44b6-a3d3-7919ec386a53 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:59.589479 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdef4bb-9e91-44b6-a3d3-7919ec386a53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:59.599322 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdef4bb-9e91-44b6-a3d3-7919ec386a53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:59.601728 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdef4bb-9e91-44b6-a3d3-7919ec386a53 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:59.618271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-acdef4bb-9e91-44b6-a3d3-7919ec386a53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:59.618271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:59.618271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:59.618271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:59.618271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:59.618271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:59.618271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:59.618271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:59.618271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:59.618271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:59.618271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:59.618271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:59.618271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:59.618271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:59.618271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:59.619559 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:59.619559 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:59.619559 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:59.619559 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:59.619559 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:59.619559 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:59.619559 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:59.619559 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:59.619559 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:47:59.619559 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:59.619559 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:59.619559 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:59.619559 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:59.619559 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:59.619559 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:59.619559 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:59.619559 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:59.620755 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:59.620755 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:59.620755 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:59.620755 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:59.620755 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:59.620755 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:59.620755 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:59.620755 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:47:59.623306 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 465/938] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:47:59.637281 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdef4bb-9e91-44b6-a3d3-7919ec386a53 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:59.650879 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb85df-68cb-49fb-a2cc-77324c2dbfc7 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:59.690638 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580ef9f-8d0f-4884-9106-8fb913bc17a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:59.691407 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580ef9f-8d0f-4884-9106-8fb913bc17a1 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:59.691698 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580ef9f-8d0f-4884-9106-8fb913bc17a1 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:59.691974 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580ef9f-8d0f-4884-9106-8fb913bc17a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:59.699809 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580ef9f-8d0f-4884-9106-8fb913bc17a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:59.701649 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580ef9f-8d0f-4884-9106-8fb913bc17a1 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:59.717338 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-4580ef9f-8d0f-4884-9106-8fb913bc17a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:59.717338 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:47:59.717338 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:47:59.717338 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:47:59.717338 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:47:59.717338 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:47:59.717338 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:47:59.717338 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:47:59.717338 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:47:59.717338 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:47:59.717338 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:47:59.717338 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:47:59.717338 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:47:59.717338 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:47:59.717338 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:47:59.719472 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:47:59.719472 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:47:59.719472 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:47:59.719472 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:47:59.719472 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:47:59.719472 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:47:59.719472 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:47:59.719472 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:47:59.719472 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:47:59.719472 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:47:59.719472 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:47:59.719472 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:47:59.719472 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:47:59.719472 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:47:59.719472 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:47:59.719472 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:47:59.719472 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:47:59.720825 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:47:59.720825 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:47:59.720825 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:47:59.720825 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:47:59.720825 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:47:59.720825 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:47:59.720825 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:47:59.720825 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:47:59.720825 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 474/939] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:47:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:47:59.727146 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580ef9f-8d0f-4884-9106-8fb913bc17a1 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:59.759919 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdef4bb-9e91-44b6-a3d3-7919ec386a53 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:59.802613 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722727d-a132-4717-ba2a-89e556d653a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:59.803454 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722727d-a132-4717-ba2a-89e556d653a0 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:59.803842 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722727d-a132-4717-ba2a-89e556d653a0 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:59.804224 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722727d-a132-4717-ba2a-89e556d653a0 None admin] PATH_INFO: `/v3/projects` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:59.805133 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722727d-a132-4717-ba2a-89e556d653a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:59.805578 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722727d-a132-4717-ba2a-89e556d653a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:59.807123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722727d-a132-4717-ba2a-89e556d653a0 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:59.825755 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 466/940] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:47:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:47:59.827533 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722727d-a132-4717-ba2a-89e556d653a0 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:47:59.844768 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580ef9f-8d0f-4884-9106-8fb913bc17a1 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:59.880824 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c8018-96aa-4879-b056-5bb3cbabdd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:59.881525 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c8018-96aa-4879-b056-5bb3cbabdd06 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:59.881812 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c8018-96aa-4879-b056-5bb3cbabdd06 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:59.882091 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c8018-96aa-4879-b056-5bb3cbabdd06 None admin] PATH_INFO: `/v3/projects` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:59.882961 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c8018-96aa-4879-b056-5bb3cbabdd06 None admin] RBAC: Adding query filter params (name=service) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:47:59.883304 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c8018-96aa-4879-b056-5bb3cbabdd06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:59.884744 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c8018-96aa-4879-b056-5bb3cbabdd06 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:47:59.907207 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 475/941] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:47:59 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:47:59.936267 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722727d-a132-4717-ba2a-89e556d653a0 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:47:59.975776 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb76706-e595-41cd-8004-f2e70b66be92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:47:59.976629 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb76706-e595-41cd-8004-f2e70b66be92 None admin] REQUEST_METHOD: `PUT` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:47:59.976914 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb76706-e595-41cd-8004-f2e70b66be92 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:47:59.977202 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb76706-e595-41cd-8004-f2e70b66be92 None admin] PATH_INFO: `/v3/projects/7860d281acf642d2a3950424901b9487/users/64be0f5d9f1948e08b530b618245b6d0/roles/ff87cf1a4a9e4b3c81335757b13daf0b` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:47:59.979702 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb76706-e595-41cd-8004-f2e70b66be92 None admin] RBAC: Authorizing `identity:create_grant(project_id=7860d281acf642d2a3950424901b9487, user_id=64be0f5d9f1948e08b530b618245b6d0, role_id=ff87cf1a4a9e4b3c81335757b13daf0b)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:47:59.981230 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb76706-e595-41cd-8004-f2e70b66be92 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:00.000079 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 467/942] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:47:59 2022] PUT /identity/v3/projects/7860d281acf642d2a3950424901b9487/users/64be0f5d9f1948e08b530b618245b6d0/roles/ff87cf1a4a9e4b3c81335757b13daf0b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:48:00.611122 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14196c-3b95-4e7e-95c0-11892a74d26f None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:00.611691 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14196c-3b95-4e7e-95c0-11892a74d26f None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:00.611691 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14196c-3b95-4e7e-95c0-11892a74d26f None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:00.613340 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 476/943] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:00.619071 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f0bf5-72e5-46ac-8e67-6c099aada039 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:00.619531 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f0bf5-72e5-46ac-8e67-6c099aada039 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:00.619643 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f0bf5-72e5-46ac-8e67-6c099aada039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:00.641915 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-976f0bf5-72e5-46ac-8e67-6c099aada039 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:00.643119 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-976f0bf5-72e5-46ac-8e67-6c099aada039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:00.716901 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 468/944] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:48:00.740237 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14196c-3b95-4e7e-95c0-11892a74d26f None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:00.852782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14196c-3b95-4e7e-95c0-11892a74d26f None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:00.890656 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61e628-715c-4ae5-aadc-dfb1c516f5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:00.891391 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61e628-715c-4ae5-aadc-dfb1c516f5fa None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:00.891679 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61e628-715c-4ae5-aadc-dfb1c516f5fa None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:00.891957 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61e628-715c-4ae5-aadc-dfb1c516f5fa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:00.892627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61e628-715c-4ae5-aadc-dfb1c516f5fa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:00.894171 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61e628-715c-4ae5-aadc-dfb1c516f5fa None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:00.907546 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-9a61e628-715c-4ae5-aadc-dfb1c516f5fa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:48:00.907546 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:00.907546 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:48:00.907546 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:48:00.907546 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:48:00.907546 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:48:00.907546 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:48:00.907546 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:48:00.907546 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:48:00.907546 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:00.907546 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:48:00.907546 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:00.907546 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:00.907546 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:00.907546 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:00.907546 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:00.907546 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:00.910444 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:00.910444 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:00.910444 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:00.910444 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:00.910444 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:00.910444 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:00.910444 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:48:00.910444 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:48:00.910444 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:48:00.910444 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:48:00.910444 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:00.910444 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:00.910444 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:00.910444 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:00.910444 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:00.910444 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:00.913044 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:00.913044 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:48:00.913044 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:00.913044 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:00.913044 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:00.913044 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:00.913044 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:00.913044 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:00.913044 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:00.913044 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:00.913044 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:48:00.913044 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:48:00.913044 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:48:00.913044 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:00.913044 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 477/945] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:48:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:48:00.922334 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f0bf5-72e5-46ac-8e67-6c099aada039 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:01.040537 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f0bf5-72e5-46ac-8e67-6c099aada039 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:01.081912 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4c55e-fba7-4e5d-b4e7-4354c284eb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:01.082965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4c55e-fba7-4e5d-b4e7-4354c284eb78 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:01.083541 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4c55e-fba7-4e5d-b4e7-4354c284eb78 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:01.084030 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4c55e-fba7-4e5d-b4e7-4354c284eb78 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:01.085065 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4c55e-fba7-4e5d-b4e7-4354c284eb78 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:01.085636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4c55e-fba7-4e5d-b4e7-4354c284eb78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:01.087299 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4c55e-fba7-4e5d-b4e7-4354c284eb78 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:01.094558 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 469/946] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:48:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:01.100877 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61e628-715c-4ae5-aadc-dfb1c516f5fa None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:01.235484 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61e628-715c-4ae5-aadc-dfb1c516f5fa None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:01.275414 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030d738-d4a5-4c7d-b5c7-6be7ef050a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:01.276107 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030d738-d4a5-4c7d-b5c7-6be7ef050a84 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:01.276393 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030d738-d4a5-4c7d-b5c7-6be7ef050a84 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:01.276673 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030d738-d4a5-4c7d-b5c7-6be7ef050a84 None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:01.277637 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030d738-d4a5-4c7d-b5c7-6be7ef050a84 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:01.278129 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030d738-d4a5-4c7d-b5c7-6be7ef050a84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:01.279841 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030d738-d4a5-4c7d-b5c7-6be7ef050a84 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:01.286166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 478/947] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:48:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:48:01.292254 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4c55e-fba7-4e5d-b4e7-4354c284eb78 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:01.398263 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57712e2b-59c3-4711-b93f-8039b3a61f68 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:01.398626 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57712e2b-59c3-4711-b93f-8039b3a61f68 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:01.398980 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57712e2b-59c3-4711-b93f-8039b3a61f68 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:01.401058 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 479/948] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:48:01.413048 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d857a-da39-49dd-b4bd-41ed5e11e560 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:01.413534 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d857a-da39-49dd-b4bd-41ed5e11e560 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:01.413926 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d857a-da39-49dd-b4bd-41ed5e11e560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:01.414235 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4c55e-fba7-4e5d-b4e7-4354c284eb78 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:01.437395 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-9f0d857a-da39-49dd-b4bd-41ed5e11e560 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:01.439339 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-9f0d857a-da39-49dd-b4bd-41ed5e11e560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:01.457027 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842e402-b9b8-4b2a-bf08-d5ee95d72e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:01.457850 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842e402-b9b8-4b2a-bf08-d5ee95d72e56 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:01.458135 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842e402-b9b8-4b2a-bf08-d5ee95d72e56 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:01.458414 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842e402-b9b8-4b2a-bf08-d5ee95d72e56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:01.459226 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842e402-b9b8-4b2a-bf08-d5ee95d72e56 None admin] RBAC: Adding query filter params (interface=public, service_id=39b2632745464a06a2eb8dcb96053ee8, region_id=RegionOne) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:01.459538 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842e402-b9b8-4b2a-bf08-d5ee95d72e56 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:01.460910 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842e402-b9b8-4b2a-bf08-d5ee95d72e56 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:01.467378 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 470/949] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:48:01 2022] GET /identity/v3/endpoints?service_id=39b2632745464a06a2eb8dcb96053ee8&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:01.474083 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842e402-b9b8-4b2a-bf08-d5ee95d72e56 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:01.529658 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 480/950] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:48:01.553790 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d857a-da39-49dd-b4bd-41ed5e11e560 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:01.584425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842e402-b9b8-4b2a-bf08-d5ee95d72e56 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:01.626054 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542ffa5-9196-4bdf-94fa-ef1b3d9559a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:01.626864 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542ffa5-9196-4bdf-94fa-ef1b3d9559a1 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:01.627040 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542ffa5-9196-4bdf-94fa-ef1b3d9559a1 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:01.633401 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542ffa5-9196-4bdf-94fa-ef1b3d9559a1 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:01.633401 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542ffa5-9196-4bdf-94fa-ef1b3d9559a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:01.633401 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542ffa5-9196-4bdf-94fa-ef1b3d9559a1 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:01.639363 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 471/951] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:48:01 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 15:48:01.663699 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d857a-da39-49dd-b4bd-41ed5e11e560 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:01.704849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7c0e3-0721-4281-909c-1b84dce6d5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:01.705723 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7c0e3-0721-4281-909c-1b84dce6d5ad None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:01.706009 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7c0e3-0721-4281-909c-1b84dce6d5ad None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:01.706291 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7c0e3-0721-4281-909c-1b84dce6d5ad None admin] PATH_INFO: `/v3/services/compute` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:01.706985 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7c0e3-0721-4281-909c-1b84dce6d5ad None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:01.708573 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7c0e3-0721-4281-909c-1b84dce6d5ad None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:01.722424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-bba7c0e3-0721-4281-909c-1b84dce6d5ad None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:48:01.722424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:01.722424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:48:01.722424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:48:01.722424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:48:01.722424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:48:01.722424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:48:01.722424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:48:01.722424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:48:01.722424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:01.722424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:48:01.722424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:01.722424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:01.722424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:01.722424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:01.722424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:01.722424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:01.725154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:01.725154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:01.725154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:01.725154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:01.725154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:01.725154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:01.725154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:48:01.725154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:48:01.725154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:48:01.725154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:48:01.725154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:01.725154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:01.725154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:01.725154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:01.725154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:01.725154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:01.727429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:01.727429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:48:01.727429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:01.727429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:01.727429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:01.727429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:01.727429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:01.727429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:01.727429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:01.727429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:01.727429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:48:01.727429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:48:01.727429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:48:01.727429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:01.729394 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 481/952] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:48:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:48:01.733430 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542ffa5-9196-4bdf-94fa-ef1b3d9559a1 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:01.887766 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542ffa5-9196-4bdf-94fa-ef1b3d9559a1 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:01.932808 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90094620-56b3-49db-9ac9-1ddc5ce699e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:01.934576 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90094620-56b3-49db-9ac9-1ddc5ce699e5 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:01.934942 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90094620-56b3-49db-9ac9-1ddc5ce699e5 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:01.935351 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90094620-56b3-49db-9ac9-1ddc5ce699e5 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:01.936092 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90094620-56b3-49db-9ac9-1ddc5ce699e5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:01.936405 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90094620-56b3-49db-9ac9-1ddc5ce699e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:01.937911 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90094620-56b3-49db-9ac9-1ddc5ce699e5 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:01.948059 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 472/953] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:48:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:01.950532 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7c0e3-0721-4281-909c-1b84dce6d5ad None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:02.067386 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7c0e3-0721-4281-909c-1b84dce6d5ad None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:02.107830 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ea489-2e72-4a83-a13f-683e9246e4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:02.108516 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ea489-2e72-4a83-a13f-683e9246e4d6 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:02.108806 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ea489-2e72-4a83-a13f-683e9246e4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:02.109089 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ea489-2e72-4a83-a13f-683e9246e4d6 None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:02.109870 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ea489-2e72-4a83-a13f-683e9246e4d6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:02.110316 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ea489-2e72-4a83-a13f-683e9246e4d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:02.111568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ea489-2e72-4a83-a13f-683e9246e4d6 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:02.121716 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 482/954] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:48:01 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:02.390958 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0baaf-64f9-4572-a14b-916f5f45130c None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:02.394296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0baaf-64f9-4572-a14b-916f5f45130c None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:02.394296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0baaf-64f9-4572-a14b-916f5f45130c None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:02.394296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 473/955] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:02.405520 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d724bc-5d00-4ae6-98e5-45b54b35407d None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:02.405520 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d724bc-5d00-4ae6-98e5-45b54b35407d None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:02.405520 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d724bc-5d00-4ae6-98e5-45b54b35407d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:02.422685 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-77d724bc-5d00-4ae6-98e5-45b54b35407d None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:02.424271 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-77d724bc-5d00-4ae6-98e5-45b54b35407d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:02.439258 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f5816-20e2-4631-b085-fab8bc8a0f5f None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:02.439626 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f5816-20e2-4631-b085-fab8bc8a0f5f None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:02.439817 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f5816-20e2-4631-b085-fab8bc8a0f5f None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:02.441569 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 474/956] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:02.446795 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c917afb-54a3-4658-9249-885d1cdb2905 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:02.447099 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c917afb-54a3-4658-9249-885d1cdb2905 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:02.447355 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c917afb-54a3-4658-9249-885d1cdb2905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:02.476309 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-9c917afb-54a3-4658-9249-885d1cdb2905 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:02.478066 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-9c917afb-54a3-4658-9249-885d1cdb2905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:02.525597 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 483/957] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:48:02.561317 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d724bc-5d00-4ae6-98e5-45b54b35407d None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:02.571348 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 475/958] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:48:02.595445 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c917afb-54a3-4658-9249-885d1cdb2905 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:02.677182 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d724bc-5d00-4ae6-98e5-45b54b35407d None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:02.712416 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c917afb-54a3-4658-9249-885d1cdb2905 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:02.714440 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdf3bc-6d2a-4cb7-97df-e76ccdae7bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:02.715227 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdf3bc-6d2a-4cb7-97df-e76ccdae7bf2 None admin] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:02.715513 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdf3bc-6d2a-4cb7-97df-e76ccdae7bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:02.715796 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdf3bc-6d2a-4cb7-97df-e76ccdae7bf2 None admin] PATH_INFO: `/v3/users` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:02.716516 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdf3bc-6d2a-4cb7-97df-e76ccdae7bf2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:02.718004 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdf3bc-6d2a-4cb7-97df-e76ccdae7bf2 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:02.736703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.sql.core [None req-bccdf3bc-6d2a-4cb7-97df-e76ccdae7bf2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 15:48:02.736703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 09 15:48:02.736703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [parameters: {'user_id': '3044a0e870de4ec38fa31a2b90dc63ae', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 09 15:48:02.736703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=276029) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 09 15:48:02.744921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-bccdf3bc-6d2a-4cb7-97df-e76ccdae7bf2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 09 15:48:02.744921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:02.744921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:48:02.744921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:48:02.744921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:48:02.744921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:48:02.744921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:48:02.744921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:48:02.744921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:48:02.744921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application conn.query(q) May 09 15:48:02.744921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:48:02.744921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:48:02.744921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:48:02.744921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application result.read() May 09 15:48:02.744921 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:48:02.746112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:48:02.746112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:48:02.746112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:48:02.746112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:48:02.746112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:48:02.746112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:48:02.746112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:48:02.746112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 15:48:02.746112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:02.746112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 09 15:48:02.746112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:02.746112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:02.746112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 09 15:48:02.746112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 09 15:48:02.746112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 09 15:48:02.746112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 09 15:48:02.746112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:48:02.746112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application next(self.gen) May 09 15:48:02.747923 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 09 15:48:02.747923 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application yield resource May 09 15:48:02.747923 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 09 15:48:02.747923 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application next(self.gen) May 09 15:48:02.747923 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 09 15:48:02.747923 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self.session.rollback() May 09 15:48:02.747923 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 15:48:02.747923 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self.force_reraise() May 09 15:48:02.747923 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 15:48:02.747923 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise self.value May 09 15:48:02.747923 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 09 15:48:02.747923 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 09 15:48:02.747923 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 09 15:48:02.747923 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application session.commit() May 09 15:48:02.747923 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 09 15:48:02.747923 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 09 15:48:02.747923 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 09 15:48:02.748951 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._prepare_impl() May 09 15:48:02.748951 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 09 15:48:02.748951 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self.session.flush() May 09 15:48:02.748951 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 09 15:48:02.748951 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._flush(objects) May 09 15:48:02.748951 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 09 15:48:02.748951 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 09 15:48:02.748951 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 09 15:48:02.748951 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application compat.raise_( May 09 15:48:02.748951 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:48:02.748951 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception May 09 15:48:02.748951 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 09 15:48:02.748951 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application flush_context.execute() May 09 15:48:02.748951 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 09 15:48:02.748951 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rec.execute(self) May 09 15:48:02.748951 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 09 15:48:02.748951 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 09 15:48:02.750511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 09 15:48:02.750511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application _emit_insert_statements( May 09 15:48:02.750511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 09 15:48:02.750511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application result = connection._execute_20( May 09 15:48:02.750511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 09 15:48:02.750511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 09 15:48:02.750511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 09 15:48:02.750511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 09 15:48:02.750511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 09 15:48:02.750511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ret = self._execute_context( May 09 15:48:02.750511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 09 15:48:02.750511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 09 15:48:02.750511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 09 15:48:02.750511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 09 15:48:02.750511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 09 15:48:02.750511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception May 09 15:48:02.751703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 09 15:48:02.751703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self.dialect.do_execute( May 09 15:48:02.751703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 09 15:48:02.751703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 09 15:48:02.751703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 09 15:48:02.751703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application result = self._query(query) May 09 15:48:02.751703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 09 15:48:02.751703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application conn.query(q) May 09 15:48:02.751703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 09 15:48:02.751703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 09 15:48:02.751703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 09 15:48:02.751703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application result.read() May 09 15:48:02.751703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 09 15:48:02.751703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 09 15:48:02.751703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 09 15:48:02.751703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application packet.raise_for_error() May 09 15:48:02.752855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 09 15:48:02.752855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 09 15:48:02.752855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 09 15:48:02.752855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 09 15:48:02.752855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 09 15:48:02.752855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 09 15:48:02.752855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [parameters: {'user_id': '3044a0e870de4ec38fa31a2b90dc63ae', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 09 15:48:02.752855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 09 15:48:02.752855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:02.752855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:48:02.752855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:02.752855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:02.752855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:02.752855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:02.752855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:02.763469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:02.763469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:02.763469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:02.763469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:02.763469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:02.763469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:02.763469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:02.763469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 09 15:48:02.763469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 09 15:48:02.763469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:02.763469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:02.763469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:48:02.763469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:48:02.763469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:48:02.763469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:48:02.763469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 09 15:48:02.763469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 09 15:48:02.765600 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 09 15:48:02.765600 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 09 15:48:02.765600 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 09 15:48:02.765600 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 09 15:48:02.765600 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 09 15:48:02.765600 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:02.765600 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 484/959] 10.222.0.48 () {60 vars in 1131 bytes} [Mon May 9 15:48:02 2022] POST /identity/v3/users => generated 160 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 09 15:48:02.765600 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdf3bc-6d2a-4cb7-97df-e76ccdae7bf2 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:02.766615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283ff46-eb14-4409-9024-0b3e99e2c5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:02.766615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283ff46-eb14-4409-9024-0b3e99e2c5d6 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:02.766615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283ff46-eb14-4409-9024-0b3e99e2c5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:02.766615 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283ff46-eb14-4409-9024-0b3e99e2c5d6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:02.773261 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283ff46-eb14-4409-9024-0b3e99e2c5d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:48:02.782554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-8283ff46-eb14-4409-9024-0b3e99e2c5d6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:48:02.782554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:02.782554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:02.782554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:02.782554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:02.782554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:02.782554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:02.782554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:02.782554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:02.782554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:02.782554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:02.782554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:02.782554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:48:02.782554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:48:02.782554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:48:02.782554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:48:02.784679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:48:02.784679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:48:02.784679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:48:02.784679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:48:02.784679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:02.784679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:02.784679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:02.784679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:02.784679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:02.784679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:02.784679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:02.784679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:48:02.784679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:02.784679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:02.784679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:02.784679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:02.786491 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:02.786491 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:02.786491 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:02.786491 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:02.786491 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:48:02.786491 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:48:02.786491 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:48:02.786491 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:48:02.786491 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:48:02.786491 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:48:02.786491 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:48:02.786491 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:02.793038 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 476/960] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 9 15:48:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:48:02.793038 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283ff46-eb14-4409-9024-0b3e99e2c5d6 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:02.867052 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdf3bc-6d2a-4cb7-97df-e76ccdae7bf2 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:02.899216 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283ff46-eb14-4409-9024-0b3e99e2c5d6 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:02.904549 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee80c2f-19d9-4f4b-8ff7-ceaecaceab99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:02.905546 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee80c2f-19d9-4f4b-8ff7-ceaecaceab99 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:02.905886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee80c2f-19d9-4f4b-8ff7-ceaecaceab99 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:02.906168 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee80c2f-19d9-4f4b-8ff7-ceaecaceab99 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:02.915728 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee80c2f-19d9-4f4b-8ff7-ceaecaceab99 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:02.917425 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee80c2f-19d9-4f4b-8ff7-ceaecaceab99 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:02.934849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-cee80c2f-19d9-4f4b-8ff7-ceaecaceab99 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:48:02.934849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:02.934849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:02.934849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:02.934849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:02.934849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:02.934849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:02.934849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:02.934849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:02.934849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:02.934849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:02.934849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:02.934849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:48:02.934849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:48:02.934849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:48:02.934849 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:48:02.937152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:02.937152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:02.937152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:48:02.937152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:48:02.937152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:48:02.937152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:48:02.937152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:02.937152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:02.937152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:02.937152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:02.937152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:02.937152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:48:02.937152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:02.937152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:02.937152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:02.937152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:02.937152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:02.937152 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:02.939361 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:02.939361 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:02.939361 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:48:02.939361 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:48:02.939361 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:48:02.939361 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:48:02.939361 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:48:02.939361 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:48:02.939361 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 09 15:48:02.939361 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:02.940609 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947408e-d1f1-4092-a21c-d1ab3ef87e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:02.940609 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947408e-d1f1-4092-a21c-d1ab3ef87e80 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:02.940609 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947408e-d1f1-4092-a21c-d1ab3ef87e80 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:02.940609 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947408e-d1f1-4092-a21c-d1ab3ef87e80 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:02.941155 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947408e-d1f1-4092-a21c-d1ab3ef87e80 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:02.941155 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947408e-d1f1-4092-a21c-d1ab3ef87e80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:02.941452 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 485/961] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:48:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:48:02.949402 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee80c2f-19d9-4f4b-8ff7-ceaecaceab99 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:02.949778 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947408e-d1f1-4092-a21c-d1ab3ef87e80 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:02.957119 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 477/962] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:48:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:02.958674 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947408e-d1f1-4092-a21c-d1ab3ef87e80 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:03.054598 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee80c2f-19d9-4f4b-8ff7-ceaecaceab99 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:03.071878 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947408e-d1f1-4092-a21c-d1ab3ef87e80 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:03.093705 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d6189-8c7a-4489-b093-f223adae6e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:03.094642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d6189-8c7a-4489-b093-f223adae6e61 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:03.095013 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d6189-8c7a-4489-b093-f223adae6e61 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:03.095411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d6189-8c7a-4489-b093-f223adae6e61 None admin] PATH_INFO: `/v3/users` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:03.096416 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d6189-8c7a-4489-b093-f223adae6e61 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:03.096829 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d6189-8c7a-4489-b093-f223adae6e61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:03.098600 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d6189-8c7a-4489-b093-f223adae6e61 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:03.110356 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd36412-b124-466d-a7ef-b3f6e815e1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:03.111180 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd36412-b124-466d-a7ef-b3f6e815e1f9 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:03.111468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd36412-b124-466d-a7ef-b3f6e815e1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:03.111750 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd36412-b124-466d-a7ef-b3f6e815e1f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:03.123743 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd36412-b124-466d-a7ef-b3f6e815e1f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:03.125225 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd36412-b124-466d-a7ef-b3f6e815e1f9 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:03.143813 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-8bd36412-b124-466d-a7ef-b3f6e815e1f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:48:03.143813 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:03.143813 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:03.143813 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:03.143813 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:03.143813 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:03.143813 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:03.143813 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:03.143813 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:03.143813 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:03.143813 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:03.143813 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:03.143813 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:48:03.143813 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:48:03.143813 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:48:03.145908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:48:03.145908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:03.145908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:03.145908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:03.145908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:03.145908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:03.145908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:03.145908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:03.145908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:48:03.145908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:03.145908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:03.145908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:03.145908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:03.145908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:03.145908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:03.145908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:03.145908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:03.147982 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:48:03.147982 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:48:03.147982 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:48:03.147982 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:03.153482 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 478/963] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:48:03.155083 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd36412-b124-466d-a7ef-b3f6e815e1f9 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:03.156100 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 486/964] 10.222.0.48 () {56 vars in 1101 bytes} [Mon May 9 15:48:02 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:48:03.278256 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd36412-b124-466d-a7ef-b3f6e815e1f9 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:03.317263 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adadd5-405f-411b-8c3e-fbd4c2a486e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:03.318402 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adadd5-405f-411b-8c3e-fbd4c2a486e1 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:03.318863 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adadd5-405f-411b-8c3e-fbd4c2a486e1 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:03.319326 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adadd5-405f-411b-8c3e-fbd4c2a486e1 None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:03.320289 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74adadd5-405f-411b-8c3e-fbd4c2a486e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:03.320768 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74adadd5-405f-411b-8c3e-fbd4c2a486e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:03.322371 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74adadd5-405f-411b-8c3e-fbd4c2a486e1 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:03.340292 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 479/965] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:03.345992 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d6189-8c7a-4489-b093-f223adae6e61 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:03.474106 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d6189-8c7a-4489-b093-f223adae6e61 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:03.511204 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c736fc-ffc9-45cb-a50f-e5e42977ae70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:03.512083 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c736fc-ffc9-45cb-a50f-e5e42977ae70 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:03.512393 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c736fc-ffc9-45cb-a50f-e5e42977ae70 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:03.512667 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c736fc-ffc9-45cb-a50f-e5e42977ae70 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:03.520406 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c736fc-ffc9-45cb-a50f-e5e42977ae70 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:03.521887 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c736fc-ffc9-45cb-a50f-e5e42977ae70 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:03.541642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-f2c736fc-ffc9-45cb-a50f-e5e42977ae70 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:48:03.541642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:03.541642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:03.541642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:03.541642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:03.541642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:03.541642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:03.541642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:03.541642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:03.541642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:03.541642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:03.541642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:03.541642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:48:03.541642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:48:03.541642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:48:03.541642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:48:03.543599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:03.543599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:03.543599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:48:03.543599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:48:03.543599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:48:03.543599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:48:03.543599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:03.543599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:03.543599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:03.543599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:03.543599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:03.543599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:48:03.543599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:03.543599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:03.543599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:03.543599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:03.543599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:03.543599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:03.546586 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:03.546586 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:03.546586 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:48:03.546586 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:48:03.546586 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:48:03.546586 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:48:03.546586 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:48:03.546586 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:48:03.546586 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 09 15:48:03.546586 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:03.546586 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 487/966] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:48:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:48:03.553694 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adadd5-405f-411b-8c3e-fbd4c2a486e1 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:03.680716 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adadd5-405f-411b-8c3e-fbd4c2a486e1 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:03.727569 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7777ded-aab0-4a62-b0f8-a0a440d33898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:03.728250 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7777ded-aab0-4a62-b0f8-a0a440d33898 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:03.728541 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7777ded-aab0-4a62-b0f8-a0a440d33898 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:03.728778 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7777ded-aab0-4a62-b0f8-a0a440d33898 None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:03.729748 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7777ded-aab0-4a62-b0f8-a0a440d33898 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:03.730060 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7777ded-aab0-4a62-b0f8-a0a440d33898 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:03.732077 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7777ded-aab0-4a62-b0f8-a0a440d33898 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:03.752451 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 480/967] 10.222.0.48 () {56 vars in 1149 bytes} [Mon May 9 15:48:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:03.757863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c736fc-ffc9-45cb-a50f-e5e42977ae70 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:03.855136 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c736fc-ffc9-45cb-a50f-e5e42977ae70 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:03.894079 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091c8a3-fe2e-41aa-a696-08b869f4ba0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:03.895045 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091c8a3-fe2e-41aa-a696-08b869f4ba0d None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:03.895335 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091c8a3-fe2e-41aa-a696-08b869f4ba0d None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:03.895615 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091c8a3-fe2e-41aa-a696-08b869f4ba0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:03.963148 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091c8a3-fe2e-41aa-a696-08b869f4ba0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:03.964622 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091c8a3-fe2e-41aa-a696-08b869f4ba0d None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:04.066558 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 488/968] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:48:03 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:48:04.067945 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7777ded-aab0-4a62-b0f8-a0a440d33898 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:04.143750 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0542b88-5bfb-49f1-80c7-9ae903b1bff2 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:04.144081 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0542b88-5bfb-49f1-80c7-9ae903b1bff2 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:04.144491 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0542b88-5bfb-49f1-80c7-9ae903b1bff2 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:04.147642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 489/969] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:48:04.165558 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc9777-784a-4d99-916a-69602123bcfe None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:04.166036 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc9777-784a-4d99-916a-69602123bcfe None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:04.166537 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc9777-784a-4d99-916a-69602123bcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:04.191250 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-40bc9777-784a-4d99-916a-69602123bcfe None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:04.192771 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7777ded-aab0-4a62-b0f8-a0a440d33898 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:04.193765 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-40bc9777-784a-4d99-916a-69602123bcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:04.244449 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96092eff-ec1d-4524-8a04-7eb8ebed09e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:04.245341 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96092eff-ec1d-4524-8a04-7eb8ebed09e1 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:04.245655 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96092eff-ec1d-4524-8a04-7eb8ebed09e1 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:04.245931 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96092eff-ec1d-4524-8a04-7eb8ebed09e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:04.258270 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96092eff-ec1d-4524-8a04-7eb8ebed09e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:04.259966 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96092eff-ec1d-4524-8a04-7eb8ebed09e1 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:04.274596 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 490/970] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:48:04.278920 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-96092eff-ec1d-4524-8a04-7eb8ebed09e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:48:04.278920 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:04.278920 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:04.278920 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:04.278920 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:04.278920 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:04.278920 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:04.278920 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:04.278920 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:04.278920 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:04.278920 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:04.278920 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:04.278920 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:48:04.278920 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:48:04.278920 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:48:04.279994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:48:04.279994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:04.279994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:04.279994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:04.279994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:04.279994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:04.279994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:04.279994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:04.279994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:48:04.279994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:04.279994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:04.279994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:04.279994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:04.279994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:04.279994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:04.279994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:04.279994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:04.281057 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:48:04.281057 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:48:04.281057 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:48:04.281057 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:04.285303 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 481/971] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:48:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:48:04.286463 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc9777-784a-4d99-916a-69602123bcfe None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:04.298250 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96092eff-ec1d-4524-8a04-7eb8ebed09e1 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:04.412881 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc9777-784a-4d99-916a-69602123bcfe None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:04.435004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96092eff-ec1d-4524-8a04-7eb8ebed09e1 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:04.460394 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbcb33-8850-4b79-b79a-9ee598aa0777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:04.461057 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbcb33-8850-4b79-b79a-9ee598aa0777 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:04.461341 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbcb33-8850-4b79-b79a-9ee598aa0777 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:04.461662 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbcb33-8850-4b79-b79a-9ee598aa0777 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:04.462415 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfbcb33-8850-4b79-b79a-9ee598aa0777 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:04.462725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfbcb33-8850-4b79-b79a-9ee598aa0777 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:04.464193 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfbcb33-8850-4b79-b79a-9ee598aa0777 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:04.483071 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 491/972] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:04.483304 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433f330-51c9-4a10-ad38-a4db0844cd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:04.483304 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433f330-51c9-4a10-ad38-a4db0844cd85 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:04.483304 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433f330-51c9-4a10-ad38-a4db0844cd85 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:04.483304 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433f330-51c9-4a10-ad38-a4db0844cd85 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:04.483677 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433f330-51c9-4a10-ad38-a4db0844cd85 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:04.483677 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433f330-51c9-4a10-ad38-a4db0844cd85 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:04.484491 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbcb33-8850-4b79-b79a-9ee598aa0777 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:04.496005 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-5433f330-51c9-4a10-ad38-a4db0844cd85 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:48:04.496005 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:04.496005 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:48:04.496005 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:48:04.496005 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:48:04.496005 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:48:04.496005 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:48:04.496005 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:48:04.496005 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:48:04.496005 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:04.496005 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:48:04.496005 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:04.496005 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:04.496005 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:04.496005 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:04.496005 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:04.496005 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:04.498105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:04.498105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:04.498105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:04.498105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:04.498105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:04.498105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:04.498105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:48:04.498105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:48:04.498105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:48:04.498105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:48:04.498105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:04.498105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:04.498105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:04.498105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:04.498105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:04.498105 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:04.499121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:04.499121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:48:04.499121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:04.499121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:04.499121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:04.499121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:04.499121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:04.499121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:04.499121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:04.499121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:04.499121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:48:04.499121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:48:04.499121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:48:04.499121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:04.499121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 482/973] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:48:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:48:04.503721 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433f330-51c9-4a10-ad38-a4db0844cd85 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:04.604984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbcb33-8850-4b79-b79a-9ee598aa0777 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:04.624731 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433f330-51c9-4a10-ad38-a4db0844cd85 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:04.645756 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb37b1-81fa-4da1-ba9c-3876f7112e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:04.646562 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb37b1-81fa-4da1-ba9c-3876f7112e10 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:04.646855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb37b1-81fa-4da1-ba9c-3876f7112e10 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:04.647129 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb37b1-81fa-4da1-ba9c-3876f7112e10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:04.655489 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb37b1-81fa-4da1-ba9c-3876f7112e10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:04.656943 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb37b1-81fa-4da1-ba9c-3876f7112e10 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:04.659924 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01525687-dc04-41c5-97d4-7268e3885662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:04.660592 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01525687-dc04-41c5-97d4-7268e3885662 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:04.660874 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01525687-dc04-41c5-97d4-7268e3885662 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:04.661147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01525687-dc04-41c5-97d4-7268e3885662 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:04.661895 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01525687-dc04-41c5-97d4-7268e3885662 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:04.662230 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01525687-dc04-41c5-97d4-7268e3885662 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:04.663658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01525687-dc04-41c5-97d4-7268e3885662 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:04.669218 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 483/974] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:48:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:04.670548 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dfdbd-7a2c-49d1-b99a-f0f7e847bd28 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:04.670833 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dfdbd-7a2c-49d1-b99a-f0f7e847bd28 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:04.671106 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dfdbd-7a2c-49d1-b99a-f0f7e847bd28 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:04.672513 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-4dcb37b1-81fa-4da1-ba9c-3876f7112e10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:48:04.672513 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:04.672513 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:04.672513 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:04.672513 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:04.672513 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:04.672513 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:04.672513 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:04.672513 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:04.672513 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:04.672513 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:04.672513 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:04.672513 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:48:04.672513 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:48:04.672513 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:48:04.673695 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:48:04.673695 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:04.673695 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:04.673695 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:04.673695 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:04.673695 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:04.673695 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:04.673695 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:04.673695 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:48:04.673695 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:04.673695 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:04.673695 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:04.673695 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:04.673695 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:04.673695 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:04.673695 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:04.673695 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:04.674778 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:48:04.674778 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:48:04.674778 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:48:04.674778 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:48:04.674778 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:48:04.674778 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:48:04.674778 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:48:04.674778 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:04.675287 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 484/975] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:04.675367 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 492/976] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:48:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:48:04.679736 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb37b1-81fa-4da1-ba9c-3876f7112e10 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:04.680434 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf337d2-d083-4a6e-b449-cd7dffad0a19 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:04.680596 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf337d2-d083-4a6e-b449-cd7dffad0a19 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:04.680809 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf337d2-d083-4a6e-b449-cd7dffad0a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:04.698586 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-ecf337d2-d083-4a6e-b449-cd7dffad0a19 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:04.700326 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-ecf337d2-d083-4a6e-b449-cd7dffad0a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:04.777094 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 485/977] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:48:04.778744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf337d2-d083-4a6e-b449-cd7dffad0a19 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:04.790740 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb37b1-81fa-4da1-ba9c-3876f7112e10 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:04.835693 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6797a-9465-4c1f-8cfe-535fe405d33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:04.836810 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6797a-9465-4c1f-8cfe-535fe405d33e None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:04.837311 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6797a-9465-4c1f-8cfe-535fe405d33e None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:04.837840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6797a-9465-4c1f-8cfe-535fe405d33e None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:04.839158 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6797a-9465-4c1f-8cfe-535fe405d33e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:04.840710 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6797a-9465-4c1f-8cfe-535fe405d33e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:04.844529 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6797a-9465-4c1f-8cfe-535fe405d33e None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:04.856458 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 493/978] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:48:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:04.857778 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6797a-9465-4c1f-8cfe-535fe405d33e None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:04.901943 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf337d2-d083-4a6e-b449-cd7dffad0a19 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:04.947903 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a976609-584f-45f9-84eb-a4bc8a142a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:04.948955 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a976609-584f-45f9-84eb-a4bc8a142a97 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:04.948955 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a976609-584f-45f9-84eb-a4bc8a142a97 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:04.954983 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a976609-584f-45f9-84eb-a4bc8a142a97 None admin] PATH_INFO: `/v3/projects` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:04.954983 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a976609-584f-45f9-84eb-a4bc8a142a97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:04.954983 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a976609-584f-45f9-84eb-a4bc8a142a97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:04.954983 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a976609-584f-45f9-84eb-a4bc8a142a97 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:04.963553 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 486/979] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:48:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:04.964380 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a976609-584f-45f9-84eb-a4bc8a142a97 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:04.983805 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6797a-9465-4c1f-8cfe-535fe405d33e None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:05.017807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd777b4e-55b3-4639-ad83-12afdf4ea705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:05.018474 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd777b4e-55b3-4639-ad83-12afdf4ea705 None admin] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:05.018760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd777b4e-55b3-4639-ad83-12afdf4ea705 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:05.019043 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd777b4e-55b3-4639-ad83-12afdf4ea705 None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:05.019766 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd777b4e-55b3-4639-ad83-12afdf4ea705 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:05.021181 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd777b4e-55b3-4639-ad83-12afdf4ea705 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:05.036054 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 494/980] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:48:04 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:48:05.036885 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd777b4e-55b3-4639-ad83-12afdf4ea705 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:05.068486 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a976609-584f-45f9-84eb-a4bc8a142a97 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:05.122268 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f948033-be7a-4f89-ae6b-0e3d21ef37f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:05.123619 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f948033-be7a-4f89-ae6b-0e3d21ef37f3 None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:05.124200 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f948033-be7a-4f89-ae6b-0e3d21ef37f3 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:05.125058 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f948033-be7a-4f89-ae6b-0e3d21ef37f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:05.126862 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f948033-be7a-4f89-ae6b-0e3d21ef37f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:05.129873 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f948033-be7a-4f89-ae6b-0e3d21ef37f3 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:05.167560 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 487/981] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:48:04 2022] POST /identity/v3/endpoints => generated 349 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:48:05.193726 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd777b4e-55b3-4639-ad83-12afdf4ea705 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:05.252176 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18dcb09-77a1-4c4a-bf18-30f40bc8d66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:05.252490 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dcb09-77a1-4c4a-bf18-30f40bc8d66a None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:05.252593 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dcb09-77a1-4c4a-bf18-30f40bc8d66a None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:05.252855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dcb09-77a1-4c4a-bf18-30f40bc8d66a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:05.254807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18dcb09-77a1-4c4a-bf18-30f40bc8d66a None admin] RBAC: Adding query filter params (role.id=ff87cf1a4a9e4b3c81335757b13daf0b, scope.project.id=7860d281acf642d2a3950424901b9487, user.id=64be0f5d9f1948e08b530b618245b6d0) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:05.254807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18dcb09-77a1-4c4a-bf18-30f40bc8d66a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:05.256525 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18dcb09-77a1-4c4a-bf18-30f40bc8d66a None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:05.263334 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 495/982] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:48:05 2022] GET /identity/v3/role_assignments?user.id=64be0f5d9f1948e08b530b618245b6d0&scope.project.id=7860d281acf642d2a3950424901b9487&role.id=ff87cf1a4a9e4b3c81335757b13daf0b => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:07.561190 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3427e3-75bc-4621-a3b5-81534d9400e4 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:07.562098 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3427e3-75bc-4621-a3b5-81534d9400e4 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:07.562098 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3427e3-75bc-4621-a3b5-81534d9400e4 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:07.563228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 488/983] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:07.569025 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd06868-982f-4110-b07e-b61d200ec963 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:07.569658 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd06868-982f-4110-b07e-b61d200ec963 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:07.569658 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd06868-982f-4110-b07e-b61d200ec963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:07.588078 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-1dd06868-982f-4110-b07e-b61d200ec963 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:07.589305 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-1dd06868-982f-4110-b07e-b61d200ec963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:07.626048 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a59d09-b313-4eb7-9d70-4710ddff94a0 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:07.626371 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a59d09-b313-4eb7-9d70-4710ddff94a0 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:07.626704 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a59d09-b313-4eb7-9d70-4710ddff94a0 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:07.633171 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 489/984] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:07.635554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce7550-7016-4c9f-9ebc-fe998df3f7dd None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:07.635848 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce7550-7016-4c9f-9ebc-fe998df3f7dd None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:07.636126 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce7550-7016-4c9f-9ebc-fe998df3f7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:07.653930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-e4ce7550-7016-4c9f-9ebc-fe998df3f7dd None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:07.655126 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-e4ce7550-7016-4c9f-9ebc-fe998df3f7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:07.679657 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 496/985] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:48:07.704427 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd06868-982f-4110-b07e-b61d200ec963 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:07.731722 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 490/986] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:48:07.733788 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b57d1b-b420-48b0-a613-0c6c1d80e440 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:07.734259 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b57d1b-b420-48b0-a613-0c6c1d80e440 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:07.734631 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b57d1b-b420-48b0-a613-0c6c1d80e440 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:07.737418 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 491/987] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:07.743881 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f1ac5-3660-43b5-abb7-a3cd3033bd3d None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:07.744978 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f1ac5-3660-43b5-abb7-a3cd3033bd3d None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:07.745685 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f1ac5-3660-43b5-abb7-a3cd3033bd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:07.772418 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-ab8f1ac5-3660-43b5-abb7-a3cd3033bd3d None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:07.774294 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-ab8f1ac5-3660-43b5-abb7-a3cd3033bd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:07.849281 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd06868-982f-4110-b07e-b61d200ec963 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:07.876364 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 492/988] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:48:07.877660 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f1ac5-3660-43b5-abb7-a3cd3033bd3d None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:07.895778 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e43b4-fa05-4f6a-bbd7-6401b0d75167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:07.896584 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e43b4-fa05-4f6a-bbd7-6401b0d75167 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:07.896870 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e43b4-fa05-4f6a-bbd7-6401b0d75167 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:07.897511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e43b4-fa05-4f6a-bbd7-6401b0d75167 None admin] PATH_INFO: `/v3/services/compute` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:07.898183 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e43b4-fa05-4f6a-bbd7-6401b0d75167 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:07.899567 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e43b4-fa05-4f6a-bbd7-6401b0d75167 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:07.912581 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-393e43b4-fa05-4f6a-bbd7-6401b0d75167 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:48:07.912581 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:07.912581 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:48:07.912581 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:48:07.912581 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:48:07.912581 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:48:07.912581 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:48:07.912581 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:48:07.912581 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:48:07.912581 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:07.912581 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:48:07.912581 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:07.912581 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:07.912581 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:07.912581 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:07.912581 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:07.912581 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:07.914170 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:07.914170 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:07.914170 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:07.914170 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:07.914170 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:07.914170 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:07.914170 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:48:07.914170 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:48:07.914170 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:48:07.914170 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:48:07.914170 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:07.914170 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:07.914170 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:07.914170 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:07.914170 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:07.914170 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:07.915292 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:07.915292 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:48:07.915292 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:07.915292 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:07.915292 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:07.915292 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:07.915292 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:07.915292 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:07.915292 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:07.915292 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:07.915292 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:48:07.915292 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:48:07.915292 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:48:07.915292 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:07.915292 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 497/989] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:48:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:48:07.916327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e43b4-fa05-4f6a-bbd7-6401b0d75167 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:07.999256 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f1ac5-3660-43b5-abb7-a3cd3033bd3d None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:08.029800 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e43b4-fa05-4f6a-bbd7-6401b0d75167 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:08.034254 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a58717-0e78-4759-84ea-1a80ad3aa7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:08.034975 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a58717-0e78-4759-84ea-1a80ad3aa7a2 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:08.035263 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a58717-0e78-4759-84ea-1a80ad3aa7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:08.035544 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a58717-0e78-4759-84ea-1a80ad3aa7a2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:08.036766 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a58717-0e78-4759-84ea-1a80ad3aa7a2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:08.038114 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a58717-0e78-4759-84ea-1a80ad3aa7a2 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:08.051123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-c2a58717-0e78-4759-84ea-1a80ad3aa7a2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:48:08.051123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:08.051123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:48:08.051123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:48:08.051123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:48:08.051123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:48:08.051123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:48:08.051123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:48:08.051123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:48:08.051123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:08.051123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:48:08.051123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:08.051123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:08.051123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:08.051123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:08.051123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:08.051123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:08.053076 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:08.053076 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:08.053076 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:08.053076 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:08.053076 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:08.053076 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:08.053076 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:48:08.053076 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:48:08.053076 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:48:08.053076 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:48:08.053076 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:08.053076 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:08.053076 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:08.053076 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:08.053076 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:08.053076 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:08.056068 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:08.056068 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:48:08.056068 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:08.056068 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:08.056068 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:08.056068 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:08.056068 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:08.056068 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:08.056068 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:08.056068 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:08.056068 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:48:08.056068 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:48:08.056068 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:48:08.056068 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:08.056068 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 493/990] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:48:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:48:08.060106 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a58717-0e78-4759-84ea-1a80ad3aa7a2 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:08.074688 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e3c48-4643-4c80-b709-ea29fd697c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:08.075493 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e3c48-4643-4c80-b709-ea29fd697c11 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:08.075781 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e3c48-4643-4c80-b709-ea29fd697c11 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:08.076056 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e3c48-4643-4c80-b709-ea29fd697c11 None admin] PATH_INFO: `/v3/services/image` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:08.076728 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e3c48-4643-4c80-b709-ea29fd697c11 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:08.078144 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e3c48-4643-4c80-b709-ea29fd697c11 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:08.090612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-9e2e3c48-4643-4c80-b709-ea29fd697c11 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:48:08.090612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:08.090612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:48:08.090612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:48:08.090612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:48:08.090612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:48:08.090612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:48:08.090612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:48:08.090612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:48:08.090612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:08.090612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:48:08.090612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:08.090612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:08.090612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:08.090612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:08.090612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:08.090612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:08.092219 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:08.092219 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:08.092219 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:08.092219 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:08.092219 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:08.092219 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:08.092219 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:48:08.092219 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:48:08.092219 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:48:08.092219 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:48:08.092219 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:08.092219 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:08.092219 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:08.092219 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:08.092219 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:08.092219 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:08.094708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:08.094708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:48:08.094708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:08.094708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:08.094708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:08.094708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:08.094708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:08.094708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:08.094708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:08.094708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:08.094708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:48:08.094708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:48:08.094708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:48:08.094708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:08.094708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 498/991] 10.222.0.48 () {56 vars in 1105 bytes} [Mon May 9 15:48:07 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:48:08.097833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e3c48-4643-4c80-b709-ea29fd697c11 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:08.168827 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a58717-0e78-4759-84ea-1a80ad3aa7a2 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:08.207931 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f2934-05ee-449b-9be9-4754eab10a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:08.208612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f2934-05ee-449b-9be9-4754eab10a35 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:08.208893 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f2934-05ee-449b-9be9-4754eab10a35 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:08.209169 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f2934-05ee-449b-9be9-4754eab10a35 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:08.209944 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f2934-05ee-449b-9be9-4754eab10a35 None admin] RBAC: Adding query filter params (name=compute) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:08.210255 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f2934-05ee-449b-9be9-4754eab10a35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:08.211655 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f2934-05ee-449b-9be9-4754eab10a35 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:08.222826 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 494/992] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:48:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:08.222826 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f2934-05ee-449b-9be9-4754eab10a35 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:08.223155 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e3c48-4643-4c80-b709-ea29fd697c11 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:08.281192 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba08975-4cf7-4376-8a5f-be1a3acbf342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:08.281893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba08975-4cf7-4376-8a5f-be1a3acbf342 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:08.282186 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba08975-4cf7-4376-8a5f-be1a3acbf342 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:08.282467 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba08975-4cf7-4376-8a5f-be1a3acbf342 None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:08.283187 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba08975-4cf7-4376-8a5f-be1a3acbf342 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:08.283497 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba08975-4cf7-4376-8a5f-be1a3acbf342 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:08.284863 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba08975-4cf7-4376-8a5f-be1a3acbf342 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:08.289869 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 499/993] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:48:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:08.290665 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba08975-4cf7-4376-8a5f-be1a3acbf342 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:08.356919 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f2934-05ee-449b-9be9-4754eab10a35 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:08.409347 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544b572-1129-4d90-94d6-f90b5f4b7107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:08.410450 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544b572-1129-4d90-94d6-f90b5f4b7107 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:08.410908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544b572-1129-4d90-94d6-f90b5f4b7107 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:08.411087 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba08975-4cf7-4376-8a5f-be1a3acbf342 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:08.411369 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544b572-1129-4d90-94d6-f90b5f4b7107 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:08.412577 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544b572-1129-4d90-94d6-f90b5f4b7107 None admin] RBAC: Adding query filter params (name=image) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:08.413092 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544b572-1129-4d90-94d6-f90b5f4b7107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:08.415075 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544b572-1129-4d90-94d6-f90b5f4b7107 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:08.423687 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 495/994] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:48:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:08.424990 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544b572-1129-4d90-94d6-f90b5f4b7107 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:08.453090 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44238550-c450-437d-ad79-9bcd4a2bcbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:08.453783 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44238550-c450-437d-ad79-9bcd4a2bcbbd None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:08.454069 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44238550-c450-437d-ad79-9bcd4a2bcbbd None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:08.454341 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44238550-c450-437d-ad79-9bcd4a2bcbbd None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:08.455067 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44238550-c450-437d-ad79-9bcd4a2bcbbd None admin] RBAC: Adding query filter params (type=compute) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:08.455371 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44238550-c450-437d-ad79-9bcd4a2bcbbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:08.456748 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44238550-c450-437d-ad79-9bcd4a2bcbbd None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:08.461848 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 500/995] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:48:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:08.462599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44238550-c450-437d-ad79-9bcd4a2bcbbd None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:08.535193 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544b572-1129-4d90-94d6-f90b5f4b7107 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:08.564335 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44238550-c450-437d-ad79-9bcd4a2bcbbd None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:08.571333 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7587ec-0c7b-4dff-987c-07e5a618644b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:08.572251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7587ec-0c7b-4dff-987c-07e5a618644b None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:08.572661 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7587ec-0c7b-4dff-987c-07e5a618644b None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:08.573133 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7587ec-0c7b-4dff-987c-07e5a618644b None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:08.574709 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7587ec-0c7b-4dff-987c-07e5a618644b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:08.575018 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7587ec-0c7b-4dff-987c-07e5a618644b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:08.576691 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7587ec-0c7b-4dff-987c-07e5a618644b None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:08.582265 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 496/996] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:48:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:08.583172 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7587ec-0c7b-4dff-987c-07e5a618644b None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:08.608530 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb89989-b3b3-420c-b9eb-6ed07bd79634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:08.609205 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb89989-b3b3-420c-b9eb-6ed07bd79634 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:08.609513 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb89989-b3b3-420c-b9eb-6ed07bd79634 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:08.609791 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb89989-b3b3-420c-b9eb-6ed07bd79634 None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:08.610516 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb89989-b3b3-420c-b9eb-6ed07bd79634 None admin] RBAC: Adding query filter params (type=image) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:08.610821 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb89989-b3b3-420c-b9eb-6ed07bd79634 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:08.612199 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb89989-b3b3-420c-b9eb-6ed07bd79634 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:08.616920 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 501/997] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:48:08 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:08.617766 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb89989-b3b3-420c-b9eb-6ed07bd79634 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:08.713488 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7587ec-0c7b-4dff-987c-07e5a618644b None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:08.753024 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb89989-b3b3-420c-b9eb-6ed07bd79634 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:08.776237 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d77e6-25a4-4508-839d-b669191546c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:08.778004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d77e6-25a4-4508-839d-b669191546c6 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:08.778512 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d77e6-25a4-4508-839d-b669191546c6 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:08.779011 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d77e6-25a4-4508-839d-b669191546c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:08.780557 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d77e6-25a4-4508-839d-b669191546c6 None admin] RBAC: Adding query filter params (interface=public, service_id=8dfcce9c50b04c9ab6c14229867c725d, region_id=RegionOne) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:08.781143 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d77e6-25a4-4508-839d-b669191546c6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:08.784012 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d77e6-25a4-4508-839d-b669191546c6 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:08.793258 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 497/998] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:48:08 2022] GET /identity/v3/endpoints?service_id=8dfcce9c50b04c9ab6c14229867c725d&interface=public®ion_id=RegionOne => generated 194 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:08.803234 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d77e6-25a4-4508-839d-b669191546c6 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:08.816677 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba1eaf-3c59-454c-abf5-5271b6296e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:08.817434 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba1eaf-3c59-454c-abf5-5271b6296e29 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:08.817724 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba1eaf-3c59-454c-abf5-5271b6296e29 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:08.818008 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba1eaf-3c59-454c-abf5-5271b6296e29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:08.818843 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba1eaf-3c59-454c-abf5-5271b6296e29 None admin] RBAC: Adding query filter params (interface=admin, service_id=39b2632745464a06a2eb8dcb96053ee8, region_id=RegionOne) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:08.819163 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba1eaf-3c59-454c-abf5-5271b6296e29 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:08.820573 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba1eaf-3c59-454c-abf5-5271b6296e29 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:08.827273 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 502/999] 10.222.0.48 () {56 vars in 1249 bytes} [Mon May 9 15:48:08 2022] GET /identity/v3/endpoints?service_id=39b2632745464a06a2eb8dcb96053ee8&interface=admin®ion_id=RegionOne => generated 193 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:08.832790 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba1eaf-3c59-454c-abf5-5271b6296e29 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:08.932436 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d77e6-25a4-4508-839d-b669191546c6 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:08.948809 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba1eaf-3c59-454c-abf5-5271b6296e29 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:08.970687 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed93d43-777b-434d-abed-cc37cebd8f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:08.971379 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed93d43-777b-434d-abed-cc37cebd8f56 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:08.971666 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed93d43-777b-434d-abed-cc37cebd8f56 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:08.971941 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed93d43-777b-434d-abed-cc37cebd8f56 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:08.972635 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed93d43-777b-434d-abed-cc37cebd8f56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:08.974058 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed93d43-777b-434d-abed-cc37cebd8f56 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:08.980606 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 498/1000] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:48:08 2022] GET /identity/v3/services => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:48:08.988476 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9e8b2-bd6c-44cb-be4f-65d1f55cd44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:08.989169 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9e8b2-bd6c-44cb-be4f-65d1f55cd44b None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:08.989500 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9e8b2-bd6c-44cb-be4f-65d1f55cd44b None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:08.989779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9e8b2-bd6c-44cb-be4f-65d1f55cd44b None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:08.990495 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9e8b2-bd6c-44cb-be4f-65d1f55cd44b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:08.991915 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9e8b2-bd6c-44cb-be4f-65d1f55cd44b None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:08.999758 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 503/1001] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:48:08 2022] GET /identity/v3/services => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 09 15:48:10.960051 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de062593-9056-460e-b20a-e980f6808614 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:10.960618 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de062593-9056-460e-b20a-e980f6808614 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:10.960618 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de062593-9056-460e-b20a-e980f6808614 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:10.962155 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 499/1002] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:48:10.968910 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a348b65-c282-47be-be6d-3411f4e7f4cc None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:10.969443 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a348b65-c282-47be-be6d-3411f4e7f4cc None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:10.969534 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a348b65-c282-47be-be6d-3411f4e7f4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:10.987161 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-5a348b65-c282-47be-be6d-3411f4e7f4cc None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:10.988373 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-5a348b65-c282-47be-be6d-3411f4e7f4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:11.061726 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 504/1003] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:10 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:48:11.084533 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de062593-9056-460e-b20a-e980f6808614 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:11.207706 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de062593-9056-460e-b20a-e980f6808614 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:11.250878 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556a421-74fb-42c8-b5fd-a8a0f19bc88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:11.251487 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556a421-74fb-42c8-b5fd-a8a0f19bc88c None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:11.251770 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556a421-74fb-42c8-b5fd-a8a0f19bc88c None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:11.252044 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556a421-74fb-42c8-b5fd-a8a0f19bc88c None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:11.252828 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556a421-74fb-42c8-b5fd-a8a0f19bc88c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:11.254323 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556a421-74fb-42c8-b5fd-a8a0f19bc88c None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:11.272332 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 500/1004] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:48:11 2022] POST /identity/v3/services => generated 242 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:48:11.436502 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257f3d7-9d0f-4ff0-bdeb-331452df3e1a None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:11.436901 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257f3d7-9d0f-4ff0-bdeb-331452df3e1a None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:11.437096 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257f3d7-9d0f-4ff0-bdeb-331452df3e1a None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:11.438750 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 505/1005] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:11.444792 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1789b-63a2-45ca-8d7b-c376e34cab78 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:11.445148 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1789b-63a2-45ca-8d7b-c376e34cab78 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:11.445397 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1789b-63a2-45ca-8d7b-c376e34cab78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:11.462810 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317f4fc-87c9-4c2b-b799-e5baf9c09130 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:11.463214 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317f4fc-87c9-4c2b-b799-e5baf9c09130 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:11.463391 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317f4fc-87c9-4c2b-b799-e5baf9c09130 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:11.465653 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 506/1006] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:48:11.466239 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-dfb1789b-63a2-45ca-8d7b-c376e34cab78 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:11.467918 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-dfb1789b-63a2-45ca-8d7b-c376e34cab78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:11.471308 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042bed9-b277-40c9-8c5d-93eebac2296c None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:11.471605 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042bed9-b277-40c9-8c5d-93eebac2296c None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:11.471875 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042bed9-b277-40c9-8c5d-93eebac2296c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:11.492683 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-7042bed9-b277-40c9-8c5d-93eebac2296c None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:11.493935 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-7042bed9-b277-40c9-8c5d-93eebac2296c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:11.560220 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 501/1007] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:11 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:48:11.583679 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1789b-63a2-45ca-8d7b-c376e34cab78 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:11.586603 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 507/1008] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:11 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:48:11.610721 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042bed9-b277-40c9-8c5d-93eebac2296c None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:11.713573 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1789b-63a2-45ca-8d7b-c376e34cab78 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:11.763782 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47595048-6359-45f2-8f32-44d58a0353fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:11.764812 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47595048-6359-45f2-8f32-44d58a0353fc None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:11.765138 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47595048-6359-45f2-8f32-44d58a0353fc None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:11.765618 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47595048-6359-45f2-8f32-44d58a0353fc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:11.766549 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47595048-6359-45f2-8f32-44d58a0353fc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:11.768014 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042bed9-b277-40c9-8c5d-93eebac2296c None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:11.768407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47595048-6359-45f2-8f32-44d58a0353fc None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:11.782614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-47595048-6359-45f2-8f32-44d58a0353fc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:48:11.782614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:11.782614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:48:11.782614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:48:11.782614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:48:11.782614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:48:11.782614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:48:11.782614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:48:11.782614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:48:11.782614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:11.782614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:48:11.782614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:11.782614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:11.782614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:11.782614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:11.782614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:11.782614 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:11.784762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:11.784762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:11.784762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:11.784762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:11.784762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:11.784762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:11.784762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:48:11.784762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:48:11.784762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:48:11.784762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:48:11.784762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:11.784762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:11.784762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:11.784762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:11.784762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:11.784762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:11.787228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:11.787228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:48:11.787228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:11.787228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:11.787228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:11.787228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:11.787228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:11.787228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:11.787228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:11.787228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:11.787228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:48:11.787228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:48:11.787228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 09 15:48:11.787228 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:11.790882 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 502/1009] 10.222.0.48 () {56 vars in 1126 bytes} [Mon May 9 15:48:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:48:11.792063 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47595048-6359-45f2-8f32-44d58a0353fc None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:11.822684 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4af1a-b0df-4a29-89e1-8f4f84f69ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:11.823411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4af1a-b0df-4a29-89e1-8f4f84f69ae1 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:11.823693 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4af1a-b0df-4a29-89e1-8f4f84f69ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:11.823964 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4af1a-b0df-4a29-89e1-8f4f84f69ae1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:11.825343 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4af1a-b0df-4a29-89e1-8f4f84f69ae1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:11.826852 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4af1a-b0df-4a29-89e1-8f4f84f69ae1 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:11.843119 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-d0e4af1a-b0df-4a29-89e1-8f4f84f69ae1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:48:11.843119 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:11.843119 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:48:11.843119 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:48:11.843119 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:48:11.843119 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:48:11.843119 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:48:11.843119 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:48:11.843119 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:48:11.843119 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:11.843119 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:48:11.843119 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:11.843119 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:11.843119 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:11.843119 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:11.843119 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:11.843119 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:11.844663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:11.844663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:11.844663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:11.844663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:11.844663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:11.844663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:11.844663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:48:11.844663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:48:11.844663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:48:11.844663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:48:11.844663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:11.844663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:11.844663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:11.844663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:11.844663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:11.844663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:11.846134 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:11.846134 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:48:11.846134 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:11.846134 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:11.846134 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:11.846134 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:11.846134 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:11.846134 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:11.846134 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:11.846134 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:11.846134 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:48:11.846134 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:48:11.846134 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 09 15:48:11.846134 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:11.849732 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 508/1010] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:48:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:48:11.854632 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4af1a-b0df-4a29-89e1-8f4f84f69ae1 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:11.909339 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47595048-6359-45f2-8f32-44d58a0353fc None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:11.950349 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c71a2-46ec-4369-a5fb-c18a28248cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:11.951172 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c71a2-46ec-4369-a5fb-c18a28248cd0 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:11.951537 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c71a2-46ec-4369-a5fb-c18a28248cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:11.951821 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c71a2-46ec-4369-a5fb-c18a28248cd0 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:11.952596 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c71a2-46ec-4369-a5fb-c18a28248cd0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:11.952893 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c71a2-46ec-4369-a5fb-c18a28248cd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:11.954286 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c71a2-46ec-4369-a5fb-c18a28248cd0 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:11.959564 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 503/1011] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:48:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:48:11.965763 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c71a2-46ec-4369-a5fb-c18a28248cd0 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:11.975651 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4af1a-b0df-4a29-89e1-8f4f84f69ae1 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:12.022121 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fbfcd-98a4-46e5-889f-d7b9804f2386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:12.022797 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fbfcd-98a4-46e5-889f-d7b9804f2386 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:12.023080 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fbfcd-98a4-46e5-889f-d7b9804f2386 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:12.023353 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fbfcd-98a4-46e5-889f-d7b9804f2386 None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:12.024076 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08fbfcd-98a4-46e5-889f-d7b9804f2386 None admin] RBAC: Adding query filter params (name=compute) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:12.024382 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08fbfcd-98a4-46e5-889f-d7b9804f2386 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:12.025798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08fbfcd-98a4-46e5-889f-d7b9804f2386 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:12.037900 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 509/1012] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:48:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:12.038884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fbfcd-98a4-46e5-889f-d7b9804f2386 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:12.104223 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c71a2-46ec-4369-a5fb-c18a28248cd0 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:12.150940 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f12eda-eba7-44b5-97db-71d5f37d4511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:12.151655 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f12eda-eba7-44b5-97db-71d5f37d4511 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:12.151947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f12eda-eba7-44b5-97db-71d5f37d4511 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:12.152869 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f12eda-eba7-44b5-97db-71d5f37d4511 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:12.153893 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f12eda-eba7-44b5-97db-71d5f37d4511 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:12.154212 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f12eda-eba7-44b5-97db-71d5f37d4511 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:12.156621 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f12eda-eba7-44b5-97db-71d5f37d4511 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:12.168827 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 504/1013] 10.222.0.48 () {56 vars in 1122 bytes} [Mon May 9 15:48:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:48:12.170179 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f12eda-eba7-44b5-97db-71d5f37d4511 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:12.199469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fbfcd-98a4-46e5-889f-d7b9804f2386 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:12.243244 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ff753-8e2f-4e1f-9691-887d1a18849e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:12.243935 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ff753-8e2f-4e1f-9691-887d1a18849e None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:12.244225 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ff753-8e2f-4e1f-9691-887d1a18849e None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:12.244506 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ff753-8e2f-4e1f-9691-887d1a18849e None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:12.245255 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ff753-8e2f-4e1f-9691-887d1a18849e None admin] RBAC: Adding query filter params (type=compute) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:12.245605 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ff753-8e2f-4e1f-9691-887d1a18849e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:12.248065 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ff753-8e2f-4e1f-9691-887d1a18849e None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:12.258608 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 510/1014] 10.222.0.48 () {56 vars in 1112 bytes} [Mon May 9 15:48:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:48:12.260591 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ff753-8e2f-4e1f-9691-887d1a18849e None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:12.336216 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f12eda-eba7-44b5-97db-71d5f37d4511 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:12.396801 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ea1d8-97aa-44fd-b55a-fbfc6a2c6d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:12.398520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ea1d8-97aa-44fd-b55a-fbfc6a2c6d80 None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:12.399885 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ea1d8-97aa-44fd-b55a-fbfc6a2c6d80 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:12.400182 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ea1d8-97aa-44fd-b55a-fbfc6a2c6d80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:12.401042 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ea1d8-97aa-44fd-b55a-fbfc6a2c6d80 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:12.404061 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ea1d8-97aa-44fd-b55a-fbfc6a2c6d80 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:12.430356 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 505/1015] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:48:12 2022] POST /identity/v3/endpoints => generated 325 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:48:12.446908 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ff753-8e2f-4e1f-9691-887d1a18849e None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:12.500165 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a1e79-97e4-40dd-95a1-354fd31cd20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:12.501401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a1e79-97e4-40dd-95a1-354fd31cd20c None admin] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:12.501756 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a1e79-97e4-40dd-95a1-354fd31cd20c None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:12.502030 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a1e79-97e4-40dd-95a1-354fd31cd20c None admin] PATH_INFO: `/v3/endpoints` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:12.503220 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a1e79-97e4-40dd-95a1-354fd31cd20c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:12.505492 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a1e79-97e4-40dd-95a1-354fd31cd20c None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:12.535927 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 511/1016] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:48:12 2022] POST /identity/v3/endpoints => generated 334 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:48:13.840536 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7dc35-7c80-444c-aa54-f500d09649a3 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:13.841131 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7dc35-7c80-444c-aa54-f500d09649a3 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:13.841131 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7dc35-7c80-444c-aa54-f500d09649a3 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:13.842600 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 506/1017] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:13.855439 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01d155-7f5b-461c-a500-90befa90e8d8 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:13.856451 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01d155-7f5b-461c-a500-90befa90e8d8 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:13.856953 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01d155-7f5b-461c-a500-90befa90e8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:13.875558 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-4f01d155-7f5b-461c-a500-90befa90e8d8 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:13.876739 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-4f01d155-7f5b-461c-a500-90befa90e8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:13.951129 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 512/1018] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:48:13.974012 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7dc35-7c80-444c-aa54-f500d09649a3 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:14.076370 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7dc35-7c80-444c-aa54-f500d09649a3 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:14.111012 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53723ed-da33-462f-b330-481cc9bcac66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:14.111808 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53723ed-da33-462f-b330-481cc9bcac66 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:14.112089 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53723ed-da33-462f-b330-481cc9bcac66 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:14.112363 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53723ed-da33-462f-b330-481cc9bcac66 None admin] PATH_INFO: `/v3/services/image` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:14.113015 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53723ed-da33-462f-b330-481cc9bcac66 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:14.114397 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53723ed-da33-462f-b330-481cc9bcac66 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:14.126477 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-a53723ed-da33-462f-b330-481cc9bcac66 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:48:14.126477 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:14.126477 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:48:14.126477 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:48:14.126477 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:48:14.126477 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:48:14.126477 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:48:14.126477 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:48:14.126477 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:48:14.126477 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:14.126477 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:48:14.126477 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:14.126477 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:14.126477 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:14.126477 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:14.126477 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:14.126477 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:14.127675 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:14.127675 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:14.127675 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:14.127675 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:14.127675 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:14.127675 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:14.127675 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:48:14.127675 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:48:14.127675 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:48:14.127675 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:48:14.127675 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:14.127675 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:14.127675 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:14.127675 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:14.127675 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:14.127675 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:14.129083 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:14.129083 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:48:14.129083 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:14.129083 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:14.129083 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:14.129083 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:14.129083 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:14.129083 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:14.129083 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:14.129083 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:14.129083 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:48:14.129083 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:48:14.129083 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:48:14.129083 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:14.130458 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 507/1019] 10.222.0.48 () {56 vars in 1105 bytes} [Mon May 9 15:48:13 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:48:14.134079 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01d155-7f5b-461c-a500-90befa90e8d8 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:14.235651 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01d155-7f5b-461c-a500-90befa90e8d8 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:14.270528 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578d3d9-9459-4fa7-ba92-a95162644a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:14.271204 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578d3d9-9459-4fa7-ba92-a95162644a7d None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:14.271493 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578d3d9-9459-4fa7-ba92-a95162644a7d None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:14.271775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578d3d9-9459-4fa7-ba92-a95162644a7d None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:14.272497 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578d3d9-9459-4fa7-ba92-a95162644a7d None admin] RBAC: Adding query filter params (name=image) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:14.272806 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578d3d9-9459-4fa7-ba92-a95162644a7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:14.274210 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578d3d9-9459-4fa7-ba92-a95162644a7d None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:14.284748 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 513/1020] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:48:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:14.286527 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53723ed-da33-462f-b330-481cc9bcac66 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:14.389069 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53723ed-da33-462f-b330-481cc9bcac66 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:14.425705 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a3f34-41d8-4046-8485-bb1887ae2470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:14.426712 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a3f34-41d8-4046-8485-bb1887ae2470 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:14.427143 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a3f34-41d8-4046-8485-bb1887ae2470 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:14.427561 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a3f34-41d8-4046-8485-bb1887ae2470 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:14.428692 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a3f34-41d8-4046-8485-bb1887ae2470 None admin] RBAC: Adding query filter params (type=image) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:14.429165 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a3f34-41d8-4046-8485-bb1887ae2470 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:14.431377 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a3f34-41d8-4046-8485-bb1887ae2470 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:14.444215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 508/1021] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:48:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:14.445544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578d3d9-9459-4fa7-ba92-a95162644a7d None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:14.555802 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578d3d9-9459-4fa7-ba92-a95162644a7d None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:14.591234 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd8d46-c077-4185-93f9-7d748f5a4e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:14.591920 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd8d46-c077-4185-93f9-7d748f5a4e7b None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:14.592201 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd8d46-c077-4185-93f9-7d748f5a4e7b None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:14.592476 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd8d46-c077-4185-93f9-7d748f5a4e7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:14.593296 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd8d46-c077-4185-93f9-7d748f5a4e7b None admin] RBAC: Adding query filter params (interface=public, service_id=4b2c1c075cc24fb08506ba2106573df6, region_id=RegionOne) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:14.593645 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd8d46-c077-4185-93f9-7d748f5a4e7b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:14.595075 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd8d46-c077-4185-93f9-7d748f5a4e7b None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:14.601256 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 514/1022] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:48:14 2022] GET /identity/v3/endpoints?service_id=4b2c1c075cc24fb08506ba2106573df6&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:48:14.607100 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a3f34-41d8-4046-8485-bb1887ae2470 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:14.719196 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a3f34-41d8-4046-8485-bb1887ae2470 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:14.757849 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001345a-97fe-45aa-9ffc-ad33146a9c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:14.758573 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001345a-97fe-45aa-9ffc-ad33146a9c3b None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:14.758857 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001345a-97fe-45aa-9ffc-ad33146a9c3b None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:14.759134 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001345a-97fe-45aa-9ffc-ad33146a9c3b None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:14.759823 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001345a-97fe-45aa-9ffc-ad33146a9c3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:14.761174 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001345a-97fe-45aa-9ffc-ad33146a9c3b None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:14.773631 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 509/1023] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:48:14 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:48:14.792422 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e6faf-bdc1-49a7-b28c-d4ae38b23795 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:14.793283 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e6faf-bdc1-49a7-b28c-d4ae38b23795 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:14.793586 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e6faf-bdc1-49a7-b28c-d4ae38b23795 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:14.795355 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 515/1024] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:14.801455 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b804de-8102-442e-aca4-899d22f1e037 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:14.801848 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b804de-8102-442e-aca4-899d22f1e037 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:14.802046 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b804de-8102-442e-aca4-899d22f1e037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:14.821277 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-b0b804de-8102-442e-aca4-899d22f1e037 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:14.822450 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-b0b804de-8102-442e-aca4-899d22f1e037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:14.901634 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 510/1025] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:48:14.926685 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e6faf-bdc1-49a7-b28c-d4ae38b23795 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:14.987890 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd85bd-2045-417b-b10c-ad7abe2068dc None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:14.988165 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd85bd-2045-417b-b10c-ad7abe2068dc None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:14.988450 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd85bd-2045-417b-b10c-ad7abe2068dc None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:14.989876 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 511/1026] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:48:14.995291 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8e9a5-366e-492a-96d4-f1bd66d63345 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:14.995586 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8e9a5-366e-492a-96d4-f1bd66d63345 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:14.996419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8e9a5-366e-492a-96d4-f1bd66d63345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:15.015353 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-27f8e9a5-366e-492a-96d4-f1bd66d63345 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:15.016548 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-27f8e9a5-366e-492a-96d4-f1bd66d63345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:15.046938 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e6faf-bdc1-49a7-b28c-d4ae38b23795 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:15.092788 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead7717-b5b6-4edd-8890-d7c95d7aac59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:15.093554 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead7717-b5b6-4edd-8890-d7c95d7aac59 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:15.093897 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead7717-b5b6-4edd-8890-d7c95d7aac59 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:15.094115 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead7717-b5b6-4edd-8890-d7c95d7aac59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:15.095460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 512/1027] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:48:15.095604 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead7717-b5b6-4edd-8890-d7c95d7aac59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:15.096755 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead7717-b5b6-4edd-8890-d7c95d7aac59 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:15.103090 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 516/1028] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:48:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:15.104017 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8e9a5-366e-492a-96d4-f1bd66d63345 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:15.122720 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead7717-b5b6-4edd-8890-d7c95d7aac59 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:15.207997 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8e9a5-366e-492a-96d4-f1bd66d63345 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:15.227768 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead7717-b5b6-4edd-8890-d7c95d7aac59 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:15.244812 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578cc50-1443-4369-b555-bbd15905b3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:15.245515 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578cc50-1443-4369-b555-bbd15905b3e3 None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:15.246466 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578cc50-1443-4369-b555-bbd15905b3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:15.247378 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578cc50-1443-4369-b555-bbd15905b3e3 None admin] PATH_INFO: `/v3/projects` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:15.248110 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578cc50-1443-4369-b555-bbd15905b3e3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:15.249592 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578cc50-1443-4369-b555-bbd15905b3e3 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:15.265474 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a9519-0850-4ed7-ba10-e3aa73db4de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:15.266364 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a9519-0850-4ed7-ba10-e3aa73db4de4 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:15.266635 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a9519-0850-4ed7-ba10-e3aa73db4de4 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:15.266918 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a9519-0850-4ed7-ba10-e3aa73db4de4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:15.277590 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a9519-0850-4ed7-ba10-e3aa73db4de4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:48:15.278188 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 513/1029] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:48:15 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:48:15.290098 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-3c8a9519-0850-4ed7-ba10-e3aa73db4de4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:48:15.290098 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:15.290098 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:15.290098 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:15.290098 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:15.290098 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:15.290098 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:15.290098 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:15.290098 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:15.290098 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:15.290098 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:15.290098 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:15.290098 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:48:15.290098 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:48:15.290098 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:48:15.290098 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:48:15.291446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:48:15.291446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:48:15.291446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:48:15.291446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:48:15.291446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:15.291446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:15.291446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:15.291446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:15.291446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:15.291446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:15.291446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:15.291446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:48:15.291446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:15.291446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:15.291446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:15.291446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:15.292514 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:15.292514 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:15.292514 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:15.292514 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:15.292514 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:48:15.292514 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:48:15.292514 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:48:15.292514 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:48:15.292514 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:48:15.292514 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:48:15.292514 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:48:15.292514 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:15.294866 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 517/1030] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 9 15:48:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:48:15.299054 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578cc50-1443-4369-b555-bbd15905b3e3 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:15.416041 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578cc50-1443-4369-b555-bbd15905b3e3 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:15.455566 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a18ee1-7aff-492c-92ec-e591a47ae6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:15.456254 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a18ee1-7aff-492c-92ec-e591a47ae6a8 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:15.456539 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a18ee1-7aff-492c-92ec-e591a47ae6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:15.456819 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a18ee1-7aff-492c-92ec-e591a47ae6a8 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:15.457622 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a18ee1-7aff-492c-92ec-e591a47ae6a8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:15.457971 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a18ee1-7aff-492c-92ec-e591a47ae6a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:15.459314 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a18ee1-7aff-492c-92ec-e591a47ae6a8 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:15.469120 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 514/1031] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:48:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:15.475132 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a9519-0850-4ed7-ba10-e3aa73db4de4 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:15.580402 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a9519-0850-4ed7-ba10-e3aa73db4de4 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:15.613731 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203ed19-3f77-4827-bd15-3e7fdd440320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:15.614536 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203ed19-3f77-4827-bd15-3e7fdd440320 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:15.614823 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203ed19-3f77-4827-bd15-3e7fdd440320 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:15.615101 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203ed19-3f77-4827-bd15-3e7fdd440320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:15.632436 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203ed19-3f77-4827-bd15-3e7fdd440320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:15.634366 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203ed19-3f77-4827-bd15-3e7fdd440320 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:15.654078 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-9203ed19-3f77-4827-bd15-3e7fdd440320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:48:15.654078 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:15.654078 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:15.654078 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:15.654078 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:15.654078 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:15.654078 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:15.654078 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:15.654078 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:15.654078 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:15.654078 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:15.654078 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:15.654078 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:48:15.654078 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:48:15.654078 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:48:15.655260 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:48:15.655260 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:15.655260 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:15.655260 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:15.655260 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:15.655260 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:15.655260 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:15.655260 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:15.655260 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:48:15.655260 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:15.655260 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:15.655260 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:15.655260 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:15.655260 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:15.655260 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:15.655260 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:15.655260 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:15.661092 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:48:15.661092 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:48:15.661092 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:48:15.661092 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:15.661092 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 518/1032] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:48:15.663331 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a18ee1-7aff-492c-92ec-e591a47ae6a8 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:15.765089 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a18ee1-7aff-492c-92ec-e591a47ae6a8 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:15.798303 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fbc0b-53a9-4539-82a4-a1afc23d4204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:15.798975 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fbc0b-53a9-4539-82a4-a1afc23d4204 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:15.799263 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fbc0b-53a9-4539-82a4-a1afc23d4204 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:15.799545 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fbc0b-53a9-4539-82a4-a1afc23d4204 None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:15.800280 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303fbc0b-53a9-4539-82a4-a1afc23d4204 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:15.800593 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303fbc0b-53a9-4539-82a4-a1afc23d4204 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:15.801984 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303fbc0b-53a9-4539-82a4-a1afc23d4204 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:15.819085 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 515/1033] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:15.820408 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203ed19-3f77-4827-bd15-3e7fdd440320 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:15.921064 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203ed19-3f77-4827-bd15-3e7fdd440320 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:15.956337 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67e554-1a75-4ebb-b45d-8955b605ef53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:15.957150 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67e554-1a75-4ebb-b45d-8955b605ef53 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:15.957502 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67e554-1a75-4ebb-b45d-8955b605ef53 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:15.957779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67e554-1a75-4ebb-b45d-8955b605ef53 None admin] PATH_INFO: `/v3/users/nova` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:15.965605 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67e554-1a75-4ebb-b45d-8955b605ef53 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:15.967044 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67e554-1a75-4ebb-b45d-8955b605ef53 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:15.981433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-9b67e554-1a75-4ebb-b45d-8955b605ef53 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:48:15.981433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:15.981433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:15.981433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:15.981433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:15.981433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:15.981433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:15.981433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:15.981433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:15.981433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:15.981433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:15.981433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:15.981433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:48:15.981433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:48:15.981433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:48:15.981433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:48:15.987381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:15.987381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:15.987381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:48:15.987381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:48:15.987381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:48:15.987381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:48:15.987381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:15.987381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:15.987381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:15.987381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:15.987381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:15.987381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:48:15.987381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:15.987381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:15.987381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:15.987381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:15.987381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:15.987381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:15.988568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:15.988568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:15.988568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:48:15.988568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:48:15.988568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:48:15.988568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:48:15.988568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:48:15.988568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:48:15.988568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:48:15.988568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:15.988568 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 519/1034] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:48:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:48:15.989302 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fbc0b-53a9-4539-82a4-a1afc23d4204 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:16.095109 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fbc0b-53a9-4539-82a4-a1afc23d4204 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:16.141867 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c616d66-40a7-4d33-b5b1-3573aa26ccb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:16.142548 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c616d66-40a7-4d33-b5b1-3573aa26ccb5 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:16.142832 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c616d66-40a7-4d33-b5b1-3573aa26ccb5 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:16.143108 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c616d66-40a7-4d33-b5b1-3573aa26ccb5 None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:16.143964 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c616d66-40a7-4d33-b5b1-3573aa26ccb5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:16.144276 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c616d66-40a7-4d33-b5b1-3573aa26ccb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:16.145904 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c616d66-40a7-4d33-b5b1-3573aa26ccb5 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:16.172801 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 516/1035] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:48:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:16.174092 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67e554-1a75-4ebb-b45d-8955b605ef53 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:16.297840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67e554-1a75-4ebb-b45d-8955b605ef53 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:16.345532 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820feda-b197-4ffb-aafb-1c5f227bfdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:16.345839 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820feda-b197-4ffb-aafb-1c5f227bfdd1 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:16.345989 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820feda-b197-4ffb-aafb-1c5f227bfdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:16.346375 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820feda-b197-4ffb-aafb-1c5f227bfdd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:16.423302 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820feda-b197-4ffb-aafb-1c5f227bfdd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:16.424759 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820feda-b197-4ffb-aafb-1c5f227bfdd1 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:16.548626 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 520/1036] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:48:16 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:48:16.549953 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c616d66-40a7-4d33-b5b1-3573aa26ccb5 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:16.668617 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c616d66-40a7-4d33-b5b1-3573aa26ccb5 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:16.704522 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae05cdc-866d-4c59-a402-6449de0e6876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:16.705330 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae05cdc-866d-4c59-a402-6449de0e6876 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:16.705635 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae05cdc-866d-4c59-a402-6449de0e6876 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:16.705912 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae05cdc-866d-4c59-a402-6449de0e6876 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:16.719699 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae05cdc-866d-4c59-a402-6449de0e6876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:16.719699 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae05cdc-866d-4c59-a402-6449de0e6876 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:16.738395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-0ae05cdc-866d-4c59-a402-6449de0e6876 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:48:16.738395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:16.738395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:16.738395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:16.738395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:16.738395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:16.738395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:16.738395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:16.738395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:16.738395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:16.738395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:16.738395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:16.738395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:48:16.738395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:48:16.738395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:48:16.739596 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:48:16.739596 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:16.739596 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:16.739596 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:16.739596 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:16.739596 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:16.739596 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:16.739596 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:16.739596 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:48:16.739596 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:16.739596 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:16.739596 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:16.739596 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:16.739596 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:16.739596 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:16.739596 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:16.739596 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:16.740707 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:48:16.740707 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:48:16.740707 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:48:16.740707 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:16.740707 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 517/1037] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:48:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:48:16.749917 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820feda-b197-4ffb-aafb-1c5f227bfdd1 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:16.872897 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820feda-b197-4ffb-aafb-1c5f227bfdd1 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:16.912990 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d26d4c-b948-44eb-a8a9-c5c3e86008aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:16.914159 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d26d4c-b948-44eb-a8a9-c5c3e86008aa None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:16.914687 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d26d4c-b948-44eb-a8a9-c5c3e86008aa None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:16.915197 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d26d4c-b948-44eb-a8a9-c5c3e86008aa None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:16.916167 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d26d4c-b948-44eb-a8a9-c5c3e86008aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:16.916684 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d26d4c-b948-44eb-a8a9-c5c3e86008aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:16.918841 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d26d4c-b948-44eb-a8a9-c5c3e86008aa None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:16.931171 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 521/1038] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:16.939481 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae05cdc-866d-4c59-a402-6449de0e6876 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:17.063894 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae05cdc-866d-4c59-a402-6449de0e6876 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:17.084118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec8f12-8b21-4479-be13-f2ab6cf7d975 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:17.084118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec8f12-8b21-4479-be13-f2ab6cf7d975 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:17.084118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec8f12-8b21-4479-be13-f2ab6cf7d975 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:17.085770 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 522/1039] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:48:17.088847 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23b053-3fd1-4d4f-b4c6-e55e6e04d878 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:17.089141 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23b053-3fd1-4d4f-b4c6-e55e6e04d878 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:17.090031 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23b053-3fd1-4d4f-b4c6-e55e6e04d878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:17.103527 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb5b67-dac2-454e-9c51-77883c115953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:17.104346 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb5b67-dac2-454e-9c51-77883c115953 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:17.104631 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb5b67-dac2-454e-9c51-77883c115953 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:17.104908 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb5b67-dac2-454e-9c51-77883c115953 None admin] PATH_INFO: `/v3/projects/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:17.108960 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-4f23b053-3fd1-4d4f-b4c6-e55e6e04d878 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:17.110499 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-4f23b053-3fd1-4d4f-b4c6-e55e6e04d878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:17.116050 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb5b67-dac2-454e-9c51-77883c115953 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:17.117624 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb5b67-dac2-454e-9c51-77883c115953 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:17.134008 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-1afb5b67-dac2-454e-9c51-77883c115953 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:48:17.134008 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:17.134008 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:17.134008 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:17.134008 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:17.134008 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:17.134008 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:17.134008 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:17.134008 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:17.134008 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:17.134008 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:17.134008 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:17.134008 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:48:17.134008 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:48:17.134008 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:48:17.135251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:48:17.135251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:17.135251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:17.135251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:17.135251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:17.135251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:17.135251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:17.135251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:17.135251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:48:17.135251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:17.135251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:17.135251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:17.135251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:17.135251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:17.135251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:17.135251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:17.135251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:17.136553 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:48:17.136553 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:48:17.136553 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:48:17.136553 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:48:17.136553 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:48:17.136553 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:48:17.136553 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:48:17.136553 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:17.140532 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 518/1040] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:48:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:48:17.141239 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb5b67-dac2-454e-9c51-77883c115953 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:17.190814 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 523/1041] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:48:17.213330 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23b053-3fd1-4d4f-b4c6-e55e6e04d878 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:17.258432 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb5b67-dac2-454e-9c51-77883c115953 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:17.298851 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414ebc0-4137-4b73-8f41-026fc3cd3440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:17.299540 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414ebc0-4137-4b73-8f41-026fc3cd3440 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:17.299828 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414ebc0-4137-4b73-8f41-026fc3cd3440 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:17.300108 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414ebc0-4137-4b73-8f41-026fc3cd3440 None admin] PATH_INFO: `/v3/projects` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:17.300910 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414ebc0-4137-4b73-8f41-026fc3cd3440 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:17.301218 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414ebc0-4137-4b73-8f41-026fc3cd3440 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:17.302694 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414ebc0-4137-4b73-8f41-026fc3cd3440 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:17.322266 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 519/1042] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:48:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:17.322479 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23b053-3fd1-4d4f-b4c6-e55e6e04d878 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:17.323661 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414ebc0-4137-4b73-8f41-026fc3cd3440 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:17.360764 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87778a4a-b5d6-46e6-86d4-7cf734cf55ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:17.361590 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87778a4a-b5d6-46e6-86d4-7cf734cf55ad None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:17.361876 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87778a4a-b5d6-46e6-86d4-7cf734cf55ad None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:17.362206 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87778a4a-b5d6-46e6-86d4-7cf734cf55ad None admin] PATH_INFO: `/v3/services/image` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:17.362901 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87778a4a-b5d6-46e6-86d4-7cf734cf55ad None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:17.364267 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87778a4a-b5d6-46e6-86d4-7cf734cf55ad None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:17.376580 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-87778a4a-b5d6-46e6-86d4-7cf734cf55ad None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:48:17.376580 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:17.376580 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:48:17.376580 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:48:17.376580 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:48:17.376580 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:48:17.376580 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:48:17.376580 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:48:17.376580 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:48:17.376580 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:17.376580 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:48:17.376580 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:17.376580 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:17.376580 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:17.376580 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:17.376580 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:17.376580 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:17.377958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:17.377958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:17.377958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:17.377958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:17.377958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:17.377958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:17.377958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:48:17.377958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:48:17.377958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:48:17.377958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:48:17.377958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:17.377958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:17.377958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:17.377958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:17.377958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:17.377958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:17.378971 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:17.378971 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:48:17.378971 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:17.378971 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:17.378971 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:17.378971 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:17.378971 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:17.378971 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:17.378971 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:17.378971 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:17.378971 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:48:17.378971 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:48:17.378971 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 09 15:48:17.378971 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:17.378971 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 524/1043] 10.222.0.48 () {56 vars in 1105 bytes} [Mon May 9 15:48:17 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:48:17.384611 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87778a4a-b5d6-46e6-86d4-7cf734cf55ad None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:17.454269 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414ebc0-4137-4b73-8f41-026fc3cd3440 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:17.491647 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b45b87-ea68-43b5-b8f3-f5870481ca27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:17.492296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b45b87-ea68-43b5-b8f3-f5870481ca27 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:17.492590 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b45b87-ea68-43b5-b8f3-f5870481ca27 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:17.492864 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b45b87-ea68-43b5-b8f3-f5870481ca27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:17.493729 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b45b87-ea68-43b5-b8f3-f5870481ca27 None admin] RBAC: Adding query filter params (role.id=ff87cf1a4a9e4b3c81335757b13daf0b, scope.project.id=7860d281acf642d2a3950424901b9487, user.id=adf919c3ba31488694c724a803ca51eb) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:17.494042 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b45b87-ea68-43b5-b8f3-f5870481ca27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:17.495484 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b45b87-ea68-43b5-b8f3-f5870481ca27 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:17.513401 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 520/1044] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:48:17 2022] GET /identity/v3/role_assignments?user.id=adf919c3ba31488694c724a803ca51eb&scope.project.id=7860d281acf642d2a3950424901b9487&role.id=ff87cf1a4a9e4b3c81335757b13daf0b => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:17.515637 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87778a4a-b5d6-46e6-86d4-7cf734cf55ad None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:17.560567 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae4a04-0da8-4a16-9a2a-744d9e9edd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:17.561275 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4a04-0da8-4a16-9a2a-744d9e9edd50 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:17.561596 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4a04-0da8-4a16-9a2a-744d9e9edd50 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:17.561878 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4a04-0da8-4a16-9a2a-744d9e9edd50 None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:17.562631 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae4a04-0da8-4a16-9a2a-744d9e9edd50 None admin] RBAC: Adding query filter params (name=image) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:17.562945 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae4a04-0da8-4a16-9a2a-744d9e9edd50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:17.564399 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae4a04-0da8-4a16-9a2a-744d9e9edd50 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:17.570563 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 525/1045] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:48:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:17.577999 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b45b87-ea68-43b5-b8f3-f5870481ca27 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:17.692271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b45b87-ea68-43b5-b8f3-f5870481ca27 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:17.728739 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9cda1-f6f5-4570-b9f6-9ccd731a982e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:17.729336 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9cda1-f6f5-4570-b9f6-9ccd731a982e None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:17.729656 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9cda1-f6f5-4570-b9f6-9ccd731a982e None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:17.729941 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9cda1-f6f5-4570-b9f6-9ccd731a982e None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:17.731191 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9cda1-f6f5-4570-b9f6-9ccd731a982e None admin] RBAC: Adding query filter params (type=image) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:17.731528 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9cda1-f6f5-4570-b9f6-9ccd731a982e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:17.732856 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9cda1-f6f5-4570-b9f6-9ccd731a982e None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:17.742564 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be6d7f-131f-4ee1-838d-9b77701a8581 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:17.742787 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 521/1046] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:48:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:17.742891 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be6d7f-131f-4ee1-838d-9b77701a8581 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:17.742891 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be6d7f-131f-4ee1-838d-9b77701a8581 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:17.742891 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 526/1047] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:17.743687 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9cda1-f6f5-4570-b9f6-9ccd731a982e None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:17.746413 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb140de2-092f-4c75-9239-51e1bdedb0cb None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:17.746781 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb140de2-092f-4c75-9239-51e1bdedb0cb None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:17.747058 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb140de2-092f-4c75-9239-51e1bdedb0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:17.764504 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-bb140de2-092f-4c75-9239-51e1bdedb0cb None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:17.765808 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-bb140de2-092f-4c75-9239-51e1bdedb0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:17.840835 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 527/1048] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:48:17.855625 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9cda1-f6f5-4570-b9f6-9ccd731a982e None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:17.865412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb140de2-092f-4c75-9239-51e1bdedb0cb None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:17.908969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32258ead-4043-4aa6-a473-32c6ababad9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:17.910677 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32258ead-4043-4aa6-a473-32c6ababad9e None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:17.911191 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32258ead-4043-4aa6-a473-32c6ababad9e None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:17.911711 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32258ead-4043-4aa6-a473-32c6ababad9e None admin] PATH_INFO: `/v3/endpoints` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:17.913229 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32258ead-4043-4aa6-a473-32c6ababad9e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:17.916196 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32258ead-4043-4aa6-a473-32c6ababad9e None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:17.941612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 522/1049] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:48:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:48:18.001358 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb140de2-092f-4c75-9239-51e1bdedb0cb None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:18.046265 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0591c2c-c69b-4d7b-a8e7-76eea147e2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:18.047474 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0591c2c-c69b-4d7b-a8e7-76eea147e2d5 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:18.047993 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0591c2c-c69b-4d7b-a8e7-76eea147e2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:18.048525 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0591c2c-c69b-4d7b-a8e7-76eea147e2d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:18.050069 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0591c2c-c69b-4d7b-a8e7-76eea147e2d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:18.051957 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0591c2c-c69b-4d7b-a8e7-76eea147e2d5 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:18.054235 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 528/1050] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:48:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:48:18.060202 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32258ead-4043-4aa6-a473-32c6ababad9e None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:18.209634 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32258ead-4043-4aa6-a473-32c6ababad9e None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:18.256808 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477c612-df47-44f1-a967-f0aaab854f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:18.257747 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477c612-df47-44f1-a967-f0aaab854f54 None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:18.258178 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477c612-df47-44f1-a967-f0aaab854f54 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:18.258597 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477c612-df47-44f1-a967-f0aaab854f54 None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:18.259725 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477c612-df47-44f1-a967-f0aaab854f54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:18.262609 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477c612-df47-44f1-a967-f0aaab854f54 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:18.292132 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 523/1051] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:48:18 2022] POST /identity/v3/users => generated 285 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:48:19.885638 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f0f11-9cb0-4b22-84fb-34caced6dedd None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:19.886168 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f0f11-9cb0-4b22-84fb-34caced6dedd None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:19.886168 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f0f11-9cb0-4b22-84fb-34caced6dedd None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:19.887575 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 529/1052] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:19.892862 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d3792-35ea-47e4-b0ae-1c1af8a11d3f None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:19.893302 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d3792-35ea-47e4-b0ae-1c1af8a11d3f None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:19.893434 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d3792-35ea-47e4-b0ae-1c1af8a11d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:19.910356 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-071d3792-35ea-47e4-b0ae-1c1af8a11d3f None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:19.911564 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-071d3792-35ea-47e4-b0ae-1c1af8a11d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:19.978546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 524/1053] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:48:20.002109 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f0f11-9cb0-4b22-84fb-34caced6dedd None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:20.106786 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f0f11-9cb0-4b22-84fb-34caced6dedd None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:20.146342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6dd4b-39ee-40a8-bfe0-0163de193ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:20.147081 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6dd4b-39ee-40a8-bfe0-0163de193ec1 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:20.147368 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6dd4b-39ee-40a8-bfe0-0163de193ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:20.147646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6dd4b-39ee-40a8-bfe0-0163de193ec1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:20.159427 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6dd4b-39ee-40a8-bfe0-0163de193ec1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:48:20.169843 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-86a6dd4b-39ee-40a8-bfe0-0163de193ec1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:48:20.169843 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:20.169843 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:20.169843 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:20.169843 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:20.169843 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:20.169843 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:20.169843 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:20.169843 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:20.169843 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:20.169843 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:20.169843 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:20.169843 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:48:20.169843 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:48:20.169843 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:48:20.169843 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:48:20.171139 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:48:20.171139 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:48:20.171139 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:48:20.171139 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:48:20.171139 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:20.171139 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:20.171139 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:20.171139 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:20.171139 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:20.171139 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:20.171139 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:20.171139 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:48:20.171139 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:20.171139 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:20.171139 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:20.171139 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:20.177610 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:20.177610 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:20.177610 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:20.177610 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:20.177610 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:48:20.177610 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:48:20.177610 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:48:20.177610 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:48:20.177610 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:48:20.177610 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:48:20.177610 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:48:20.177610 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:20.177610 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 530/1054] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 9 15:48:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:48:20.178440 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d3792-35ea-47e4-b0ae-1c1af8a11d3f None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:20.280211 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d3792-35ea-47e4-b0ae-1c1af8a11d3f None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:20.312344 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43384849-1055-477b-94e6-40b05d1b4c27 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:20.312715 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43384849-1055-477b-94e6-40b05d1b4c27 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:20.312915 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43384849-1055-477b-94e6-40b05d1b4c27 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:20.314601 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 531/1055] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:48:20.317172 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeec505-35ab-499e-9ff3-f134d64df711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:20.317888 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeec505-35ab-499e-9ff3-f134d64df711 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:20.318173 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeec505-35ab-499e-9ff3-f134d64df711 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:20.318466 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeec505-35ab-499e-9ff3-f134d64df711 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:20.319216 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeec505-35ab-499e-9ff3-f134d64df711 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:20.319525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeec505-35ab-499e-9ff3-f134d64df711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:20.319811 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a893163-9fbb-4262-9bfc-fffa1a5c0757 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:20.320115 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a893163-9fbb-4262-9bfc-fffa1a5c0757 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:20.320394 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a893163-9fbb-4262-9bfc-fffa1a5c0757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:20.320900 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeec505-35ab-499e-9ff3-f134d64df711 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:20.343059 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 525/1056] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:48:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:48:20.344252 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-7a893163-9fbb-4262-9bfc-fffa1a5c0757 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:20.344647 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeec505-35ab-499e-9ff3-f134d64df711 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:20.345571 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-7a893163-9fbb-4262-9bfc-fffa1a5c0757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:20.418086 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 532/1057] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:48:20.441248 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a893163-9fbb-4262-9bfc-fffa1a5c0757 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:20.453237 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeec505-35ab-499e-9ff3-f134d64df711 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:20.491384 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c41f5e-7f59-40f3-9a2b-bbd455ccea07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:20.492208 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c41f5e-7f59-40f3-9a2b-bbd455ccea07 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:20.492499 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c41f5e-7f59-40f3-9a2b-bbd455ccea07 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:20.492780 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c41f5e-7f59-40f3-9a2b-bbd455ccea07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:20.506360 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c41f5e-7f59-40f3-9a2b-bbd455ccea07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:20.507851 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c41f5e-7f59-40f3-9a2b-bbd455ccea07 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:20.526887 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-36c41f5e-7f59-40f3-9a2b-bbd455ccea07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:48:20.526887 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:20.526887 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:20.526887 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:20.526887 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:20.526887 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:20.526887 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:20.526887 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:20.526887 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:20.526887 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:20.526887 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:20.526887 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:20.526887 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:48:20.526887 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:48:20.526887 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:48:20.529169 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:48:20.529169 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:20.529169 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:20.529169 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:20.529169 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:20.529169 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:20.529169 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:20.529169 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:20.529169 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:48:20.529169 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:20.529169 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:20.529169 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:20.529169 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:20.529169 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:20.529169 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:20.529169 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:20.529169 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:20.530909 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:48:20.530909 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:48:20.530909 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:48:20.530909 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:20.533172 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 526/1058] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:48:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:48:20.534168 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c41f5e-7f59-40f3-9a2b-bbd455ccea07 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:20.549426 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a893163-9fbb-4262-9bfc-fffa1a5c0757 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:20.585966 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f3e9c-f2f9-4e36-bbee-14987500e487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:20.586631 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f3e9c-f2f9-4e36-bbee-14987500e487 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:20.586917 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f3e9c-f2f9-4e36-bbee-14987500e487 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:20.587194 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f3e9c-f2f9-4e36-bbee-14987500e487 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:20.654176 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c41f5e-7f59-40f3-9a2b-bbd455ccea07 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:20.661891 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f3e9c-f2f9-4e36-bbee-14987500e487 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:20.663467 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f3e9c-f2f9-4e36-bbee-14987500e487 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:20.693965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd618d-79e3-4d60-aa44-62449f05035d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:20.694642 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd618d-79e3-4d60-aa44-62449f05035d None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:20.694933 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd618d-79e3-4d60-aa44-62449f05035d None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:20.695217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd618d-79e3-4d60-aa44-62449f05035d None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:20.695965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd618d-79e3-4d60-aa44-62449f05035d None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:20.696274 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd618d-79e3-4d60-aa44-62449f05035d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:20.697683 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd618d-79e3-4d60-aa44-62449f05035d None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:20.710558 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 527/1059] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:20.711973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca4d01-dcdb-4817-82ab-ed59478a3fb3 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:20.712268 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca4d01-dcdb-4817-82ab-ed59478a3fb3 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:20.713143 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca4d01-dcdb-4817-82ab-ed59478a3fb3 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:20.715263 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 528/1060] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:20.716864 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca4d01-dcdb-4817-82ab-ed59478a3fb3 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:20.767106 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 533/1061] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:48:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:48:20.768512 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70aa98-373c-4110-add0-60371688cc15 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:20.768824 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70aa98-373c-4110-add0-60371688cc15 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:20.769085 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70aa98-373c-4110-add0-60371688cc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:20.786104 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-cd70aa98-373c-4110-add0-60371688cc15 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:20.787303 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-cd70aa98-373c-4110-add0-60371688cc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:20.820163 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca4d01-dcdb-4817-82ab-ed59478a3fb3 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:20.853776 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 534/1062] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:48:20.854660 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70aa98-373c-4110-add0-60371688cc15 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:20.857268 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f55fa-1322-4529-8f70-78df5f2866e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:20.858127 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f55fa-1322-4529-8f70-78df5f2866e5 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:20.858470 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f55fa-1322-4529-8f70-78df5f2866e5 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:20.858697 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f55fa-1322-4529-8f70-78df5f2866e5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:20.866417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f55fa-1322-4529-8f70-78df5f2866e5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:20.867868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f55fa-1322-4529-8f70-78df5f2866e5 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:20.884190 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-357f55fa-1322-4529-8f70-78df5f2866e5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:48:20.884190 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:20.884190 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:20.884190 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:20.884190 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:20.884190 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:20.884190 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:20.884190 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:20.884190 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:20.884190 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:20.884190 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:20.884190 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:20.884190 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:48:20.884190 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:48:20.884190 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:48:20.884190 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:48:20.885741 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:20.885741 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:20.885741 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:48:20.885741 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:48:20.885741 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:48:20.885741 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:48:20.885741 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:20.885741 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:20.885741 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:20.885741 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:20.885741 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:20.885741 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:48:20.885741 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:20.885741 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:20.885741 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:20.885741 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:20.885741 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:20.885741 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:20.887689 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:20.887689 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:20.887689 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:48:20.887689 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:48:20.887689 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:48:20.887689 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:48:20.887689 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:48:20.887689 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:48:20.887689 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:48:20.887689 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:20.889529 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 529/1063] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:48:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:48:20.890620 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f55fa-1322-4529-8f70-78df5f2866e5 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:20.959444 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70aa98-373c-4110-add0-60371688cc15 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:20.989763 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f55fa-1322-4529-8f70-78df5f2866e5 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:20.993460 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a92a4-da7e-4db4-9f4d-64532b1abdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:20.994259 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a92a4-da7e-4db4-9f4d-64532b1abdd4 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:20.994541 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a92a4-da7e-4db4-9f4d-64532b1abdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:20.994815 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a92a4-da7e-4db4-9f4d-64532b1abdd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:21.005485 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a92a4-da7e-4db4-9f4d-64532b1abdd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:21.006943 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a92a4-da7e-4db4-9f4d-64532b1abdd4 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:21.023674 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecc79a-0e02-49b4-8608-88559ef1f217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:21.024249 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-402a92a4-da7e-4db4-9f4d-64532b1abdd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:48:21.024249 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:21.024249 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:21.024249 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:21.024249 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:21.024249 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:21.024249 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:21.024249 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:21.024249 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:21.024249 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:21.024249 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:21.024249 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:21.024249 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:48:21.024249 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:48:21.024249 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:48:21.025400 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:48:21.025400 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:21.025400 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:21.025400 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:21.025400 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:21.025400 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:21.025400 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:21.025400 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:21.025400 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:48:21.025400 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:21.025400 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:21.025400 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:21.025400 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:21.025400 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:21.025400 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:21.025400 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:21.025400 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:21.026526 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:48:21.026526 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:48:21.026526 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:48:21.026526 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:21.027350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecc79a-0e02-49b4-8608-88559ef1f217 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:21.027350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecc79a-0e02-49b4-8608-88559ef1f217 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:21.027350 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecc79a-0e02-49b4-8608-88559ef1f217 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:21.027582 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 535/1064] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:48:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:48:21.027582 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a92a4-da7e-4db4-9f4d-64532b1abdd4 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:21.038857 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecc79a-0e02-49b4-8608-88559ef1f217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:48:21.047038 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-4eecc79a-0e02-49b4-8608-88559ef1f217 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:48:21.047038 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:21.047038 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:21.047038 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:21.047038 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:21.047038 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:21.047038 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:21.047038 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:21.047038 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:21.047038 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:21.047038 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:21.047038 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:21.047038 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:48:21.047038 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:48:21.047038 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:48:21.047038 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:48:21.048571 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:48:21.048571 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:48:21.048571 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:48:21.048571 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:48:21.048571 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:21.048571 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:21.048571 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:21.048571 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:21.048571 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:21.048571 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:21.048571 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:21.048571 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:48:21.048571 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:21.048571 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:21.048571 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:21.048571 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:21.049599 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:21.049599 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:21.049599 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:21.049599 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:21.049599 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:48:21.049599 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:48:21.049599 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:48:21.049599 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:48:21.049599 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:48:21.049599 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:48:21.049599 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:48:21.049599 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:21.049599 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 530/1065] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:48:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:48:21.049599 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecc79a-0e02-49b4-8608-88559ef1f217 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:21.133450 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a92a4-da7e-4db4-9f4d-64532b1abdd4 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:21.150416 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecc79a-0e02-49b4-8608-88559ef1f217 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:21.170003 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8013e88-b53b-422f-95fc-fac53415fee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:21.170675 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8013e88-b53b-422f-95fc-fac53415fee4 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:21.170957 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8013e88-b53b-422f-95fc-fac53415fee4 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:21.171227 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8013e88-b53b-422f-95fc-fac53415fee4 None admin] PATH_INFO: `/v3/users` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:21.172073 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8013e88-b53b-422f-95fc-fac53415fee4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:21.172378 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8013e88-b53b-422f-95fc-fac53415fee4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:21.173846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8013e88-b53b-422f-95fc-fac53415fee4 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:21.187771 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3ba02-a3bc-453d-9680-f03254b4a6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:21.188537 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3ba02-a3bc-453d-9680-f03254b4a6bf None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:21.188858 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3ba02-a3bc-453d-9680-f03254b4a6bf None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:21.189138 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3ba02-a3bc-453d-9680-f03254b4a6bf None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:21.189912 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3ba02-a3bc-453d-9680-f03254b4a6bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:21.190223 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3ba02-a3bc-453d-9680-f03254b4a6bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:21.191371 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 536/1066] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:48:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:21.191903 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3ba02-a3bc-453d-9680-f03254b4a6bf None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:21.192209 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8013e88-b53b-422f-95fc-fac53415fee4 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:21.205561 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 531/1067] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:21.206421 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3ba02-a3bc-453d-9680-f03254b4a6bf None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:21.304798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8013e88-b53b-422f-95fc-fac53415fee4 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:21.318284 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3ba02-a3bc-453d-9680-f03254b4a6bf None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:21.343675 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1aa08f-05bb-4638-bb5b-9a4a84a1e56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:21.344354 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1aa08f-05bb-4638-bb5b-9a4a84a1e56b None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:21.344999 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1aa08f-05bb-4638-bb5b-9a4a84a1e56b None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:21.344999 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1aa08f-05bb-4638-bb5b-9a4a84a1e56b None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:21.345758 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1aa08f-05bb-4638-bb5b-9a4a84a1e56b None admin] RBAC: Adding query filter params (name=admin) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:21.346042 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1aa08f-05bb-4638-bb5b-9a4a84a1e56b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:21.347410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1aa08f-05bb-4638-bb5b-9a4a84a1e56b None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:21.356710 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4cd8f-ce11-4cec-830b-db3be9c27e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:21.357547 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 537/1068] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:48:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:21.357669 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4cd8f-ce11-4cec-830b-db3be9c27e68 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:21.357880 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4cd8f-ce11-4cec-830b-db3be9c27e68 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:21.358098 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4cd8f-ce11-4cec-830b-db3be9c27e68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:21.362967 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1aa08f-05bb-4638-bb5b-9a4a84a1e56b None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:21.370050 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4cd8f-ce11-4cec-830b-db3be9c27e68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:21.371765 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4cd8f-ce11-4cec-830b-db3be9c27e68 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:21.393724 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-a5f4cd8f-ce11-4cec-830b-db3be9c27e68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:48:21.393724 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:21.393724 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:21.393724 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:21.393724 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:21.393724 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:21.393724 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:21.393724 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:21.393724 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:21.393724 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:21.393724 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:21.393724 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:21.393724 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:48:21.393724 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:48:21.393724 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:48:21.395067 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:48:21.395067 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:21.395067 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:21.395067 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:21.395067 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:21.395067 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:21.395067 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:21.395067 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:21.395067 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:48:21.395067 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:21.395067 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:21.395067 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:21.395067 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:21.395067 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:21.395067 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:21.395067 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:21.395067 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:21.396241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:48:21.396241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:48:21.396241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:48:21.396241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:21.396241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 532/1069] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:48:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:48:21.401124 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4cd8f-ce11-4cec-830b-db3be9c27e68 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:21.490378 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1aa08f-05bb-4638-bb5b-9a4a84a1e56b None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:21.531876 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1115aec-fedd-4d72-977d-b4842df8ecbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:21.532777 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1115aec-fedd-4d72-977d-b4842df8ecbe None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:21.533053 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1115aec-fedd-4d72-977d-b4842df8ecbe None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:21.533318 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1115aec-fedd-4d72-977d-b4842df8ecbe None admin] PATH_INFO: `/v3/users/53446ba61e4b4d4b90ed8d1ef06b5ec5` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:21.536565 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4cd8f-ce11-4cec-830b-db3be9c27e68 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:21.548443 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1115aec-fedd-4d72-977d-b4842df8ecbe None admin] RBAC: Authorizing `identity:get_user(user_id=53446ba61e4b4d4b90ed8d1ef06b5ec5)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:21.549946 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1115aec-fedd-4d72-977d-b4842df8ecbe None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:21.552042 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 538/1070] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:48:21 2022] GET /identity/v3/users/53446ba61e4b4d4b90ed8d1ef06b5ec5 => generated 285 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:48:21.558108 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1115aec-fedd-4d72-977d-b4842df8ecbe None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:21.575310 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544aca0-99b8-4af4-b80d-1475c656527e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:21.576015 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544aca0-99b8-4af4-b80d-1475c656527e None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:21.576282 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544aca0-99b8-4af4-b80d-1475c656527e None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:21.576560 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544aca0-99b8-4af4-b80d-1475c656527e None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:21.577295 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544aca0-99b8-4af4-b80d-1475c656527e None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:21.577639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544aca0-99b8-4af4-b80d-1475c656527e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:21.579040 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544aca0-99b8-4af4-b80d-1475c656527e None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:21.590935 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 533/1071] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:48:21.597038 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544aca0-99b8-4af4-b80d-1475c656527e None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:21.657763 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1115aec-fedd-4d72-977d-b4842df8ecbe None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:21.691270 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac4c72-0244-4072-8f72-b9abf823a7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:21.691920 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac4c72-0244-4072-8f72-b9abf823a7e6 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:21.692199 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac4c72-0244-4072-8f72-b9abf823a7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:21.692483 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac4c72-0244-4072-8f72-b9abf823a7e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:21.697194 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544aca0-99b8-4af4-b80d-1475c656527e None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:21.732116 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a174d-3dd9-4964-b7c2-0b83d045f6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:21.733017 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a174d-3dd9-4964-b7c2-0b83d045f6ff None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:21.733398 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a174d-3dd9-4964-b7c2-0b83d045f6ff None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:21.733675 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a174d-3dd9-4964-b7c2-0b83d045f6ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:21.740660 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a174d-3dd9-4964-b7c2-0b83d045f6ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:21.742148 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a174d-3dd9-4964-b7c2-0b83d045f6ff None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:21.757022 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-0b3a174d-3dd9-4964-b7c2-0b83d045f6ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:48:21.757022 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:21.757022 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:21.757022 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:21.757022 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:21.757022 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:21.757022 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:21.757022 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:21.757022 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:21.757022 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:21.757022 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:21.757022 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:21.757022 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:48:21.757022 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:48:21.757022 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:48:21.758385 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:48:21.758385 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:21.758385 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:21.758385 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:21.758385 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:21.758385 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:21.758385 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:21.758385 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:21.758385 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:48:21.758385 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:21.758385 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:21.758385 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:21.758385 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:21.758385 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:21.758385 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:21.758385 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:21.758385 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:21.759609 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:48:21.759609 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:48:21.759609 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:48:21.759609 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:48:21.759609 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:48:21.759609 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:48:21.759609 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:48:21.759609 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:21.759609 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 534/1072] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:48:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:48:21.761287 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac4c72-0244-4072-8f72-b9abf823a7e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:21.762801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac4c72-0244-4072-8f72-b9abf823a7e6 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:21.764410 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a174d-3dd9-4964-b7c2-0b83d045f6ff None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:21.863344 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 539/1073] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:48:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:48:21.863621 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a174d-3dd9-4964-b7c2-0b83d045f6ff None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:21.869143 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac4c72-0244-4072-8f72-b9abf823a7e6 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:21.898816 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e5546-e475-4c62-8f00-4b55818d6d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:21.899412 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e5546-e475-4c62-8f00-4b55818d6d6a None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:21.899700 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e5546-e475-4c62-8f00-4b55818d6d6a None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:21.899979 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e5546-e475-4c62-8f00-4b55818d6d6a None admin] PATH_INFO: `/v3/projects` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:21.900789 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e5546-e475-4c62-8f00-4b55818d6d6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:21.901100 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e5546-e475-4c62-8f00-4b55818d6d6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:21.903142 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e5546-e475-4c62-8f00-4b55818d6d6a None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:21.915089 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 535/1074] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:48:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:48:21.921265 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e5546-e475-4c62-8f00-4b55818d6d6a None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:21.968542 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac4c72-0244-4072-8f72-b9abf823a7e6 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:22.001868 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0f10d-457f-49b6-8cac-3c1d77044798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:22.002718 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0f10d-457f-49b6-8cac-3c1d77044798 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:22.002999 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0f10d-457f-49b6-8cac-3c1d77044798 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:22.003272 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0f10d-457f-49b6-8cac-3c1d77044798 None admin] PATH_INFO: `/v3/projects/70fe5b0375ac4c90b6f86b6168030ba2` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:22.004461 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0f10d-457f-49b6-8cac-3c1d77044798 None admin] RBAC: Authorizing `identity:get_project(project_id=70fe5b0375ac4c90b6f86b6168030ba2)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:22.005925 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0f10d-457f-49b6-8cac-3c1d77044798 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:22.007630 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 540/1075] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:48:21 2022] GET /identity/v3/projects/70fe5b0375ac4c90b6f86b6168030ba2 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:48:22.014158 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0f10d-457f-49b6-8cac-3c1d77044798 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:22.018081 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e5546-e475-4c62-8f00-4b55818d6d6a None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:22.050961 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529204d4-8671-4008-be72-553d19e9810d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:22.051864 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529204d4-8671-4008-be72-553d19e9810d None admin] REQUEST_METHOD: `PUT` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:22.052150 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529204d4-8671-4008-be72-553d19e9810d None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:22.052495 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529204d4-8671-4008-be72-553d19e9810d None admin] PATH_INFO: `/v3/projects/7860d281acf642d2a3950424901b9487/users/adf919c3ba31488694c724a803ca51eb/roles/ff87cf1a4a9e4b3c81335757b13daf0b` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:22.054746 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529204d4-8671-4008-be72-553d19e9810d None admin] RBAC: Authorizing `identity:create_grant(project_id=7860d281acf642d2a3950424901b9487, user_id=adf919c3ba31488694c724a803ca51eb, role_id=ff87cf1a4a9e4b3c81335757b13daf0b)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:22.056182 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529204d4-8671-4008-be72-553d19e9810d None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:22.069711 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 536/1076] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:48:21 2022] PUT /identity/v3/projects/7860d281acf642d2a3950424901b9487/users/adf919c3ba31488694c724a803ca51eb/roles/ff87cf1a4a9e4b3c81335757b13daf0b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:48:22.112636 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0f10d-457f-49b6-8cac-3c1d77044798 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:22.149554 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab80e7e-d1b4-4cbd-aa6d-1fb0c8ca750e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:22.150133 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab80e7e-d1b4-4cbd-aa6d-1fb0c8ca750e None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:22.150422 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab80e7e-d1b4-4cbd-aa6d-1fb0c8ca750e None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:22.150697 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab80e7e-d1b4-4cbd-aa6d-1fb0c8ca750e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:22.151544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab80e7e-d1b4-4cbd-aa6d-1fb0c8ca750e None admin] RBAC: Adding query filter params (role.id=2180d183afad443187521833c40ed8a1, scope.project.id=70fe5b0375ac4c90b6f86b6168030ba2, user.id=53446ba61e4b4d4b90ed8d1ef06b5ec5) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:22.152406 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab80e7e-d1b4-4cbd-aa6d-1fb0c8ca750e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:22.153915 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab80e7e-d1b4-4cbd-aa6d-1fb0c8ca750e None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:22.160058 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 541/1077] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:48:22 2022] GET /identity/v3/role_assignments?user.id=53446ba61e4b4d4b90ed8d1ef06b5ec5&scope.project.id=70fe5b0375ac4c90b6f86b6168030ba2&role.id=2180d183afad443187521833c40ed8a1 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:48:24.390698 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0fc32-b1e2-4d4c-a861-34fe4ba3f738 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:24.391255 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0fc32-b1e2-4d4c-a861-34fe4ba3f738 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:24.391255 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0fc32-b1e2-4d4c-a861-34fe4ba3f738 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:24.392613 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 537/1078] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:24.397929 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee728a57-1f8a-45a1-96a1-feeeb4a8c555 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:24.398365 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee728a57-1f8a-45a1-96a1-feeeb4a8c555 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:24.398500 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee728a57-1f8a-45a1-96a1-feeeb4a8c555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:24.415310 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-ee728a57-1f8a-45a1-96a1-feeeb4a8c555 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:24.416531 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-ee728a57-1f8a-45a1-96a1-feeeb4a8c555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:24.481460 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f500af3-1006-49f8-b588-73b5428d25e5 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:24.481770 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f500af3-1006-49f8-b588-73b5428d25e5 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:24.482130 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f500af3-1006-49f8-b588-73b5428d25e5 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:24.483417 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 538/1079] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:48:24.488734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 542/1080] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:48:24.488951 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18adb5-da4b-4e25-ab91-4cea15937e28 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:24.489184 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18adb5-da4b-4e25-ab91-4cea15937e28 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:24.489520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18adb5-da4b-4e25-ab91-4cea15937e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:24.507027 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-aa18adb5-da4b-4e25-ab91-4cea15937e28 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:24.508225 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-aa18adb5-da4b-4e25-ab91-4cea15937e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:24.513948 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee728a57-1f8a-45a1-96a1-feeeb4a8c555 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:24.609721 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 539/1081] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:48:24.651349 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18adb5-da4b-4e25-ab91-4cea15937e28 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:24.661707 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee728a57-1f8a-45a1-96a1-feeeb4a8c555 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:24.699111 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e11d9f-1b3d-433a-b359-c797861d7514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:24.699990 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e11d9f-1b3d-433a-b359-c797861d7514 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:24.700273 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e11d9f-1b3d-433a-b359-c797861d7514 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:24.700552 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e11d9f-1b3d-433a-b359-c797861d7514 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:24.711181 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e11d9f-1b3d-433a-b359-c797861d7514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:48:24.720449 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-e3e11d9f-1b3d-433a-b359-c797861d7514 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:48:24.720449 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:24.720449 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:24.720449 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:24.720449 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:24.720449 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:24.720449 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:24.720449 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:24.720449 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:24.720449 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:24.720449 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:24.720449 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:24.720449 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:48:24.720449 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:48:24.720449 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:48:24.720449 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:48:24.721930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:48:24.721930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:48:24.721930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:48:24.721930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:48:24.721930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:24.721930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:24.721930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:24.721930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:24.721930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:24.721930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:24.721930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:24.721930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:48:24.721930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:24.721930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:24.721930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:24.721930 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:24.722958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:24.722958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:24.722958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:24.722958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:24.722958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:48:24.722958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:48:24.722958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:48:24.722958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:48:24.722958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:48:24.722958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:48:24.722958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 09 15:48:24.722958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:24.722958 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 543/1082] 10.222.0.48 () {56 vars in 1120 bytes} [Mon May 9 15:48:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:48:24.727737 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e11d9f-1b3d-433a-b359-c797861d7514 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:24.764639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18adb5-da4b-4e25-ab91-4cea15937e28 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:24.803842 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715d5d7-cb14-40fb-87a0-44aae2db917b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:24.804640 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715d5d7-cb14-40fb-87a0-44aae2db917b None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:24.804931 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715d5d7-cb14-40fb-87a0-44aae2db917b None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:24.805212 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715d5d7-cb14-40fb-87a0-44aae2db917b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:24.816326 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715d5d7-cb14-40fb-87a0-44aae2db917b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:48:24.824345 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-8715d5d7-cb14-40fb-87a0-44aae2db917b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:48:24.824345 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:24.824345 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:24.824345 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:24.824345 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:24.824345 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:24.824345 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:24.824345 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:24.824345 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:24.824345 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:24.824345 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:24.824345 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:24.824345 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:48:24.824345 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:48:24.824345 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:48:24.824345 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:48:24.825570 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:48:24.825570 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:48:24.825570 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:48:24.825570 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:48:24.825570 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:24.825570 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:24.825570 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:24.825570 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:24.825570 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:24.825570 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:24.825570 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:24.825570 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:48:24.825570 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:24.825570 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:24.825570 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:24.825570 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:24.826607 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:24.826607 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:24.826607 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:24.826607 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:24.826607 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:48:24.826607 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:48:24.826607 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:48:24.826607 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:48:24.826607 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:48:24.826607 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:48:24.826607 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:48:24.826607 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:24.826607 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 540/1083] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:48:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:48:24.828992 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e11d9f-1b3d-433a-b359-c797861d7514 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:24.831824 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715d5d7-cb14-40fb-87a0-44aae2db917b None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:24.868717 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50a11d-6a1b-4c7d-82d7-1929e2e390b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:24.869918 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50a11d-6a1b-4c7d-82d7-1929e2e390b8 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:24.870452 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50a11d-6a1b-4c7d-82d7-1929e2e390b8 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:24.870911 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50a11d-6a1b-4c7d-82d7-1929e2e390b8 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:24.872304 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50a11d-6a1b-4c7d-82d7-1929e2e390b8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:24.872844 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50a11d-6a1b-4c7d-82d7-1929e2e390b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:24.875669 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50a11d-6a1b-4c7d-82d7-1929e2e390b8 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:24.886700 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 544/1084] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:48:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:48:24.893220 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50a11d-6a1b-4c7d-82d7-1929e2e390b8 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:24.943010 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715d5d7-cb14-40fb-87a0-44aae2db917b None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:24.981885 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3987602-bdcf-493e-af4d-cf93d03183ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:24.982561 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3987602-bdcf-493e-af4d-cf93d03183ec None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:24.982850 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3987602-bdcf-493e-af4d-cf93d03183ec None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:24.983129 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3987602-bdcf-493e-af4d-cf93d03183ec None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:24.983898 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3987602-bdcf-493e-af4d-cf93d03183ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:24.984204 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3987602-bdcf-493e-af4d-cf93d03183ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:24.985601 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3987602-bdcf-493e-af4d-cf93d03183ec None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:24.999060 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50a11d-6a1b-4c7d-82d7-1929e2e390b8 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:25.004984 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 541/1085] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:48:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:48:25.006296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3987602-bdcf-493e-af4d-cf93d03183ec None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:25.039544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b2443-ff52-4974-a4ef-75ada3ce0d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:25.040350 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b2443-ff52-4974-a4ef-75ada3ce0d81 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:25.040635 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b2443-ff52-4974-a4ef-75ada3ce0d81 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:25.040913 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b2443-ff52-4974-a4ef-75ada3ce0d81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:25.052498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b2443-ff52-4974-a4ef-75ada3ce0d81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:25.054016 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b2443-ff52-4974-a4ef-75ada3ce0d81 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:25.071448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-1d2b2443-ff52-4974-a4ef-75ada3ce0d81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:48:25.071448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:25.071448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:25.071448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:25.071448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:25.071448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:25.071448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:25.071448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:25.071448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:25.071448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:25.071448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:25.071448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:25.071448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:48:25.071448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:48:25.071448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:48:25.072730 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:48:25.072730 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:25.072730 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:25.072730 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:25.072730 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:25.072730 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:25.072730 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:25.072730 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:25.072730 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:48:25.072730 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:25.072730 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:25.072730 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:25.072730 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:25.072730 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:25.072730 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:25.072730 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:25.072730 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:25.074672 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:48:25.074672 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:48:25.074672 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:48:25.074672 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:25.074672 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 545/1086] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:48:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:48:25.078858 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b2443-ff52-4974-a4ef-75ada3ce0d81 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:25.114023 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3987602-bdcf-493e-af4d-cf93d03183ec None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:25.153201 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5badb-34cd-4f01-85df-8a9725e1228b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:25.154116 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5badb-34cd-4f01-85df-8a9725e1228b None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:25.154465 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5badb-34cd-4f01-85df-8a9725e1228b None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:25.154746 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5badb-34cd-4f01-85df-8a9725e1228b None admin] PATH_INFO: `/v3/users/53446ba61e4b4d4b90ed8d1ef06b5ec5` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:25.156021 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5badb-34cd-4f01-85df-8a9725e1228b None admin] RBAC: Authorizing `identity:get_user(user_id=53446ba61e4b4d4b90ed8d1ef06b5ec5)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:25.157468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5badb-34cd-4f01-85df-8a9725e1228b None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:25.159135 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 542/1087] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:48:25 2022] GET /identity/v3/users/53446ba61e4b4d4b90ed8d1ef06b5ec5 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:48:25.164896 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5badb-34cd-4f01-85df-8a9725e1228b None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:25.187796 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b2443-ff52-4974-a4ef-75ada3ce0d81 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:25.224396 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518bed2-8212-4486-a95c-2f6c7dbe0957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:25.224985 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518bed2-8212-4486-a95c-2f6c7dbe0957 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:25.225281 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518bed2-8212-4486-a95c-2f6c7dbe0957 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:25.225589 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518bed2-8212-4486-a95c-2f6c7dbe0957 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:25.226339 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518bed2-8212-4486-a95c-2f6c7dbe0957 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:25.226650 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518bed2-8212-4486-a95c-2f6c7dbe0957 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:25.228028 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518bed2-8212-4486-a95c-2f6c7dbe0957 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:25.240387 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 546/1088] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:48:25.246436 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518bed2-8212-4486-a95c-2f6c7dbe0957 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:25.270409 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5badb-34cd-4f01-85df-8a9725e1228b None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:25.307750 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584b335-ebbf-4112-9d9f-d02adae64a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:25.309953 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584b335-ebbf-4112-9d9f-d02adae64a4f None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:25.310243 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584b335-ebbf-4112-9d9f-d02adae64a4f None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:25.310528 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584b335-ebbf-4112-9d9f-d02adae64a4f None admin] PATH_INFO: `/v3/projects/70fe5b0375ac4c90b6f86b6168030ba2` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:25.311791 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584b335-ebbf-4112-9d9f-d02adae64a4f None admin] RBAC: Authorizing `identity:get_project(project_id=70fe5b0375ac4c90b6f86b6168030ba2)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:25.313224 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584b335-ebbf-4112-9d9f-d02adae64a4f None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:25.314995 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 543/1089] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:48:25 2022] GET /identity/v3/projects/70fe5b0375ac4c90b6f86b6168030ba2 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:48:25.320787 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584b335-ebbf-4112-9d9f-d02adae64a4f None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:25.351984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518bed2-8212-4486-a95c-2f6c7dbe0957 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:25.387811 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a37bb-290d-4a2d-a099-80a8c64a917c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:25.388606 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a37bb-290d-4a2d-a099-80a8c64a917c None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:25.388887 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a37bb-290d-4a2d-a099-80a8c64a917c None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:25.389163 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a37bb-290d-4a2d-a099-80a8c64a917c None admin] PATH_INFO: `/v3/users/nova` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:25.396570 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a37bb-290d-4a2d-a099-80a8c64a917c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:25.398066 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a37bb-290d-4a2d-a099-80a8c64a917c None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:25.413482 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-2c6a37bb-290d-4a2d-a099-80a8c64a917c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 09 15:48:25.413482 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:25.413482 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:25.413482 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:25.413482 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:25.413482 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:25.413482 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:25.413482 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:25.413482 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:25.413482 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:25.413482 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:25.413482 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:25.413482 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:48:25.413482 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:48:25.413482 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:48:25.413482 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:48:25.415524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:25.415524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:25.415524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:48:25.415524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:48:25.415524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:48:25.415524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:48:25.415524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:25.415524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:25.415524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:25.415524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:25.415524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:25.415524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:48:25.415524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:25.415524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:25.415524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:25.415524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:25.415524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:25.415524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:25.416751 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:25.416751 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:25.416751 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:48:25.416751 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:48:25.416751 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:48:25.416751 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:48:25.416751 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:48:25.416751 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:48:25.416751 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 09 15:48:25.416751 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:25.420438 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 547/1090] 10.222.0.48 () {56 vars in 1093 bytes} [Mon May 9 15:48:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:48:25.421335 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a37bb-290d-4a2d-a099-80a8c64a917c None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:25.428984 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584b335-ebbf-4112-9d9f-d02adae64a4f None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:25.479355 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc304be0-d300-49ac-b677-f7bba7842fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:25.482200 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc304be0-d300-49ac-b677-f7bba7842fbd None admin] REQUEST_METHOD: `PUT` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:25.482694 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc304be0-d300-49ac-b677-f7bba7842fbd None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:25.483163 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc304be0-d300-49ac-b677-f7bba7842fbd None admin] PATH_INFO: `/v3/projects/70fe5b0375ac4c90b6f86b6168030ba2/users/53446ba61e4b4d4b90ed8d1ef06b5ec5/roles/2180d183afad443187521833c40ed8a1` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:25.486323 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc304be0-d300-49ac-b677-f7bba7842fbd None admin] RBAC: Authorizing `identity:create_grant(project_id=70fe5b0375ac4c90b6f86b6168030ba2, user_id=53446ba61e4b4d4b90ed8d1ef06b5ec5, role_id=2180d183afad443187521833c40ed8a1)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:25.488756 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc304be0-d300-49ac-b677-f7bba7842fbd None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:25.508356 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 544/1091] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:48:25 2022] PUT /identity/v3/projects/70fe5b0375ac4c90b6f86b6168030ba2/users/53446ba61e4b4d4b90ed8d1ef06b5ec5/roles/2180d183afad443187521833c40ed8a1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 09 15:48:25.556517 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a37bb-290d-4a2d-a099-80a8c64a917c None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:25.594342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac01478-d62e-46ce-80f7-d0d2bba007e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:25.595028 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac01478-d62e-46ce-80f7-d0d2bba007e3 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:25.595314 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac01478-d62e-46ce-80f7-d0d2bba007e3 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:25.595592 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac01478-d62e-46ce-80f7-d0d2bba007e3 None admin] PATH_INFO: `/v3/users` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:25.596458 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac01478-d62e-46ce-80f7-d0d2bba007e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:25.596768 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac01478-d62e-46ce-80f7-d0d2bba007e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:25.598275 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac01478-d62e-46ce-80f7-d0d2bba007e3 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:25.617347 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 548/1092] 10.222.0.48 () {56 vars in 1133 bytes} [Mon May 9 15:48:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:48:25.623871 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc304be0-d300-49ac-b677-f7bba7842fbd None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:25.729082 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc304be0-d300-49ac-b677-f7bba7842fbd None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:25.764591 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5201385-46d5-47d8-b09b-94948d7cbdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:25.765161 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5201385-46d5-47d8-b09b-94948d7cbdaa None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:25.765475 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5201385-46d5-47d8-b09b-94948d7cbdaa None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:25.765753 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5201385-46d5-47d8-b09b-94948d7cbdaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:25.832610 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5201385-46d5-47d8-b09b-94948d7cbdaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:25.834077 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5201385-46d5-47d8-b09b-94948d7cbdaa None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:25.951677 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 545/1093] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:48:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:48:25.968476 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac01478-d62e-46ce-80f7-d0d2bba007e3 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:26.067236 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac01478-d62e-46ce-80f7-d0d2bba007e3 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:26.100951 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db2597-598a-4c88-93ef-d3c261fe3ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:26.101773 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db2597-598a-4c88-93ef-d3c261fe3ffb None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:26.102053 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db2597-598a-4c88-93ef-d3c261fe3ffb None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:26.102325 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db2597-598a-4c88-93ef-d3c261fe3ffb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:26.112234 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db2597-598a-4c88-93ef-d3c261fe3ffb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:26.113712 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db2597-598a-4c88-93ef-d3c261fe3ffb None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:26.131642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-e7db2597-598a-4c88-93ef-d3c261fe3ffb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:48:26.131642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:26.131642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:26.131642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:26.131642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:26.131642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:26.131642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:26.131642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:26.131642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:26.131642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:26.131642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:26.131642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:26.131642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:48:26.131642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:48:26.131642 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:48:26.132872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:48:26.132872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:26.132872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:26.132872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:26.132872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:26.132872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:26.132872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:26.132872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:26.132872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:48:26.132872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:26.132872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:26.132872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:26.132872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:26.132872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:26.132872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:26.132872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:26.132872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:26.134006 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:48:26.134006 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:48:26.134006 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:48:26.134006 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:26.134006 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 549/1094] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:48:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:48:26.138580 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5201385-46d5-47d8-b09b-94948d7cbdaa None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:26.236879 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5201385-46d5-47d8-b09b-94948d7cbdaa None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:26.280821 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a38f61-e1b4-4dba-96be-bf524816ef8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:26.281543 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a38f61-e1b4-4dba-96be-bf524816ef8e None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:26.281829 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a38f61-e1b4-4dba-96be-bf524816ef8e None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:26.282183 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a38f61-e1b4-4dba-96be-bf524816ef8e None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:26.282854 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a38f61-e1b4-4dba-96be-bf524816ef8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:26.283161 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a38f61-e1b4-4dba-96be-bf524816ef8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:26.284547 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a38f61-e1b4-4dba-96be-bf524816ef8e None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:26.301249 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 546/1095] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:26.306925 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db2597-598a-4c88-93ef-d3c261fe3ffb None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:26.419577 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db2597-598a-4c88-93ef-d3c261fe3ffb None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:26.455351 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56fbf1-5e5f-47e2-8e02-210eb8dc7024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:26.456148 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56fbf1-5e5f-47e2-8e02-210eb8dc7024 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:26.456435 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56fbf1-5e5f-47e2-8e02-210eb8dc7024 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:26.456714 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56fbf1-5e5f-47e2-8e02-210eb8dc7024 None admin] PATH_INFO: `/v3/projects/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:26.463503 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56fbf1-5e5f-47e2-8e02-210eb8dc7024 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:26.466035 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56fbf1-5e5f-47e2-8e02-210eb8dc7024 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:26.480710 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-df56fbf1-5e5f-47e2-8e02-210eb8dc7024 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:48:26.480710 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:26.480710 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:26.480710 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:26.480710 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:26.480710 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:26.480710 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:26.480710 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:26.480710 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:26.480710 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:26.480710 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:26.480710 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:26.480710 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:48:26.480710 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:48:26.480710 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:48:26.481968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:48:26.481968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:26.481968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:26.481968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:26.481968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:26.481968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:26.481968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:26.481968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:26.481968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:48:26.481968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:26.481968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:26.481968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:26.481968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:26.481968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:26.481968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:26.481968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:26.481968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:26.483376 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:48:26.483376 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:48:26.483376 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:48:26.483376 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:48:26.483376 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:48:26.483376 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:48:26.483376 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:48:26.483376 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:26.485670 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 550/1096] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:48:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:48:26.487718 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a38f61-e1b4-4dba-96be-bf524816ef8e None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:26.594424 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a38f61-e1b4-4dba-96be-bf524816ef8e None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:26.628450 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a27ace-a1b8-4e9a-b6c6-c8a000aed644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:26.629120 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a27ace-a1b8-4e9a-b6c6-c8a000aed644 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:26.629428 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a27ace-a1b8-4e9a-b6c6-c8a000aed644 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:26.629709 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a27ace-a1b8-4e9a-b6c6-c8a000aed644 None admin] PATH_INFO: `/v3/projects` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:26.630513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a27ace-a1b8-4e9a-b6c6-c8a000aed644 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:26.630820 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a27ace-a1b8-4e9a-b6c6-c8a000aed644 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:26.632821 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a27ace-a1b8-4e9a-b6c6-c8a000aed644 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:26.645062 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 547/1097] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:48:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:26.651121 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56fbf1-5e5f-47e2-8e02-210eb8dc7024 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:26.757145 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56fbf1-5e5f-47e2-8e02-210eb8dc7024 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:26.792114 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dc270-a1d6-4df5-9721-5dc0052211b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:26.792803 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dc270-a1d6-4df5-9721-5dc0052211b6 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:26.793193 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dc270-a1d6-4df5-9721-5dc0052211b6 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:26.793517 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dc270-a1d6-4df5-9721-5dc0052211b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:26.794365 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09dc270-a1d6-4df5-9721-5dc0052211b6 None admin] RBAC: Adding query filter params (role.id=ff87cf1a4a9e4b3c81335757b13daf0b, scope.project.id=7860d281acf642d2a3950424901b9487, user.id=adf919c3ba31488694c724a803ca51eb) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:26.794680 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09dc270-a1d6-4df5-9721-5dc0052211b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:26.796123 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09dc270-a1d6-4df5-9721-5dc0052211b6 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:26.802161 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 551/1098] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:48:26 2022] GET /identity/v3/role_assignments?user.id=adf919c3ba31488694c724a803ca51eb&scope.project.id=7860d281acf642d2a3950424901b9487&role.id=ff87cf1a4a9e4b3c81335757b13daf0b => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:48:27.802455 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f721ac-7310-408b-b78f-49d5e9e15878 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:27.803019 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f721ac-7310-408b-b78f-49d5e9e15878 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:27.803019 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f721ac-7310-408b-b78f-49d5e9e15878 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:27.804381 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 548/1099] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:27.810725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b44ca8-348a-4931-b18b-5e9deab51a59 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:27.811189 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b44ca8-348a-4931-b18b-5e9deab51a59 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:27.811303 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b44ca8-348a-4931-b18b-5e9deab51a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:27.828632 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-f9b44ca8-348a-4931-b18b-5e9deab51a59 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:27.829885 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-f9b44ca8-348a-4931-b18b-5e9deab51a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:27.899003 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 552/1100] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:48:27.922407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f721ac-7310-408b-b78f-49d5e9e15878 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:28.022681 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f721ac-7310-408b-b78f-49d5e9e15878 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:28.057207 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f40ad0-d39f-4a42-8a12-32fb33ea8347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:28.058816 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f40ad0-d39f-4a42-8a12-32fb33ea8347 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:28.059336 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f40ad0-d39f-4a42-8a12-32fb33ea8347 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:28.059631 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f40ad0-d39f-4a42-8a12-32fb33ea8347 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:28.069598 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f40ad0-d39f-4a42-8a12-32fb33ea8347 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:48:28.077636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-a1f40ad0-d39f-4a42-8a12-32fb33ea8347 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:48:28.077636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:28.077636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:28.077636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:28.077636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:28.077636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:28.077636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:28.077636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:28.077636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:28.077636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:28.077636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:28.077636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:28.077636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:48:28.077636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:48:28.077636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:48:28.077636 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:48:28.078925 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:48:28.078925 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:48:28.078925 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:48:28.078925 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:48:28.078925 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:28.078925 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:28.078925 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:28.078925 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:28.078925 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:28.078925 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:28.078925 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:28.078925 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:48:28.078925 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:28.078925 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:28.078925 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:28.078925 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:28.080115 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:28.080115 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:28.080115 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:28.080115 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:28.080115 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:48:28.080115 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:48:28.080115 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:48:28.080115 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:48:28.080115 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:48:28.080115 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:48:28.080115 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:48:28.080115 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:28.080115 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 549/1101] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:48:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:48:28.085043 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b44ca8-348a-4931-b18b-5e9deab51a59 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:28.182726 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b44ca8-348a-4931-b18b-5e9deab51a59 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:28.215925 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f8bc0-e2d6-4b08-a9fd-ad2a437bb086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:28.216597 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f8bc0-e2d6-4b08-a9fd-ad2a437bb086 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:28.216886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f8bc0-e2d6-4b08-a9fd-ad2a437bb086 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:28.217166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f8bc0-e2d6-4b08-a9fd-ad2a437bb086 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:28.217955 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f8bc0-e2d6-4b08-a9fd-ad2a437bb086 None admin] RBAC: Adding query filter params (name=admin) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:28.218269 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f8bc0-e2d6-4b08-a9fd-ad2a437bb086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:28.219646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f8bc0-e2d6-4b08-a9fd-ad2a437bb086 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:28.227685 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 553/1102] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:48:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:28.234481 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f40ad0-d39f-4a42-8a12-32fb33ea8347 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:28.338948 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f40ad0-d39f-4a42-8a12-32fb33ea8347 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:28.375342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbb9e3-fb51-4cd6-86b4-056529a2f313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:28.376505 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbb9e3-fb51-4cd6-86b4-056529a2f313 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:28.376785 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbb9e3-fb51-4cd6-86b4-056529a2f313 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:28.377062 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbb9e3-fb51-4cd6-86b4-056529a2f313 None admin] PATH_INFO: `/v3/users/53446ba61e4b4d4b90ed8d1ef06b5ec5` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:28.378315 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbb9e3-fb51-4cd6-86b4-056529a2f313 None admin] RBAC: Authorizing `identity:get_user(user_id=53446ba61e4b4d4b90ed8d1ef06b5ec5)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:28.379737 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbb9e3-fb51-4cd6-86b4-056529a2f313 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:28.381401 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 550/1103] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:48:28 2022] GET /identity/v3/users/53446ba61e4b4d4b90ed8d1ef06b5ec5 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:28.387988 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f8bc0-e2d6-4b08-a9fd-ad2a437bb086 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:28.484164 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f8bc0-e2d6-4b08-a9fd-ad2a437bb086 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:28.517051 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee099984-e9dc-4bbf-9cb2-2d70a4a48e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:28.517719 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee099984-e9dc-4bbf-9cb2-2d70a4a48e94 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:28.518006 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee099984-e9dc-4bbf-9cb2-2d70a4a48e94 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:28.518281 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee099984-e9dc-4bbf-9cb2-2d70a4a48e94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:28.583460 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee099984-e9dc-4bbf-9cb2-2d70a4a48e94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:28.584932 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee099984-e9dc-4bbf-9cb2-2d70a4a48e94 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:28.683847 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 554/1104] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:48:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 09 15:48:28.689978 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbb9e3-fb51-4cd6-86b4-056529a2f313 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:28.786852 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbb9e3-fb51-4cd6-86b4-056529a2f313 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:28.818511 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13258148-0246-4467-9c64-6ec84be1150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:28.819356 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13258148-0246-4467-9c64-6ec84be1150f None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:28.819635 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13258148-0246-4467-9c64-6ec84be1150f None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:28.819909 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13258148-0246-4467-9c64-6ec84be1150f None admin] PATH_INFO: `/v3/projects/70fe5b0375ac4c90b6f86b6168030ba2` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:28.821124 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13258148-0246-4467-9c64-6ec84be1150f None admin] RBAC: Authorizing `identity:get_project(project_id=70fe5b0375ac4c90b6f86b6168030ba2)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:28.822573 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13258148-0246-4467-9c64-6ec84be1150f None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:28.824865 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 551/1105] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:48:28 2022] GET /identity/v3/projects/70fe5b0375ac4c90b6f86b6168030ba2 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:28.831032 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee099984-e9dc-4bbf-9cb2-2d70a4a48e94 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:28.930258 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee099984-e9dc-4bbf-9cb2-2d70a4a48e94 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:28.971182 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7879ac5-4664-49fb-a5f3-e496241e21b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:28.971839 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7879ac5-4664-49fb-a5f3-e496241e21b9 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:28.972127 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7879ac5-4664-49fb-a5f3-e496241e21b9 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:28.972408 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7879ac5-4664-49fb-a5f3-e496241e21b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:28.973250 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7879ac5-4664-49fb-a5f3-e496241e21b9 None admin] RBAC: Adding query filter params (role.id=2180d183afad443187521833c40ed8a1, scope.project.id=70fe5b0375ac4c90b6f86b6168030ba2, user.id=53446ba61e4b4d4b90ed8d1ef06b5ec5) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:28.973597 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7879ac5-4664-49fb-a5f3-e496241e21b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:28.975033 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7879ac5-4664-49fb-a5f3-e496241e21b9 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:28.981067 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 555/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:48:28 2022] GET /identity/v3/role_assignments?user.id=53446ba61e4b4d4b90ed8d1ef06b5ec5&scope.project.id=70fe5b0375ac4c90b6f86b6168030ba2&role.id=2180d183afad443187521833c40ed8a1 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:31.265785 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed29c5f-a161-4c9b-8c98-abe426f6a085 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:31.267110 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed29c5f-a161-4c9b-8c98-abe426f6a085 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:31.267110 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed29c5f-a161-4c9b-8c98-abe426f6a085 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:31.267854 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 552/1107] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:31.273125 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58102607-5a87-44dd-87e5-747c35980057 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:31.273612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58102607-5a87-44dd-87e5-747c35980057 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:31.273715 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58102607-5a87-44dd-87e5-747c35980057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:31.291180 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-58102607-5a87-44dd-87e5-747c35980057 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:31.293459 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-58102607-5a87-44dd-87e5-747c35980057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:31.363647 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 556/1108] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:48:31.388713 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed29c5f-a161-4c9b-8c98-abe426f6a085 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:31.491773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed29c5f-a161-4c9b-8c98-abe426f6a085 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:31.527723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a57c33-05e7-4d29-9132-df97365f5809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:31.530396 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a57c33-05e7-4d29-9132-df97365f5809 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:31.530396 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a57c33-05e7-4d29-9132-df97365f5809 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:31.530396 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a57c33-05e7-4d29-9132-df97365f5809 None admin] PATH_INFO: `/v3/domains/default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:31.530396 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a57c33-05e7-4d29-9132-df97365f5809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:31.531606 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a57c33-05e7-4d29-9132-df97365f5809 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:31.533259 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 553/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:48:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:31.539195 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58102607-5a87-44dd-87e5-747c35980057 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:31.639038 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58102607-5a87-44dd-87e5-747c35980057 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:31.672905 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e97e26-929d-4c17-9733-3b663643d73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:31.673603 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e97e26-929d-4c17-9733-3b663643d73a None admin] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:31.673890 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e97e26-929d-4c17-9733-3b663643d73a None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:31.674168 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e97e26-929d-4c17-9733-3b663643d73a None admin] PATH_INFO: `/v3/users` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:31.674875 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e97e26-929d-4c17-9733-3b663643d73a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:31.676307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e97e26-929d-4c17-9733-3b663643d73a None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:31.696331 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 557/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:48:31 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:48:34.084326 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26141b-4724-479c-9b15-b91554d8617c None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:34.084886 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26141b-4724-479c-9b15-b91554d8617c None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:34.084886 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26141b-4724-479c-9b15-b91554d8617c None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:34.086289 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 554/1111] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:34.092147 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9ecce-f266-4d0a-a775-01e9da310e5e None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:34.092598 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9ecce-f266-4d0a-a775-01e9da310e5e None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:34.092698 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9ecce-f266-4d0a-a775-01e9da310e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:34.109949 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-50e9ecce-f266-4d0a-a775-01e9da310e5e None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:34.111149 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-50e9ecce-f266-4d0a-a775-01e9da310e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:34.177992 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 558/1112] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:48:34.202399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26141b-4724-479c-9b15-b91554d8617c None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:34.302630 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26141b-4724-479c-9b15-b91554d8617c None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:34.335593 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3502608-738f-4aef-b8d2-db7941373453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:34.336358 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3502608-738f-4aef-b8d2-db7941373453 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:34.336646 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3502608-738f-4aef-b8d2-db7941373453 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:34.336924 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3502608-738f-4aef-b8d2-db7941373453 None admin] PATH_INFO: `/v3/roles/cf8c8db912344d0f82f8e6b0fa805968` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:34.338462 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3502608-738f-4aef-b8d2-db7941373453 None admin] RBAC: Authorizing `identity:get_role(role_id=cf8c8db912344d0f82f8e6b0fa805968)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:34.340461 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3502608-738f-4aef-b8d2-db7941373453 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:34.341890 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 555/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:48:34 2022] GET /identity/v3/roles/cf8c8db912344d0f82f8e6b0fa805968 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:34.347789 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9ecce-f266-4d0a-a775-01e9da310e5e None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:34.455498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9ecce-f266-4d0a-a775-01e9da310e5e None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:34.487807 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828587a-2d44-433b-9e7c-a6f394cb62d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:34.488657 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828587a-2d44-433b-9e7c-a6f394cb62d5 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:34.488937 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828587a-2d44-433b-9e7c-a6f394cb62d5 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:34.489208 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828587a-2d44-433b-9e7c-a6f394cb62d5 None admin] PATH_INFO: `/v3/users/0169980d6ece48dfb2a743ab6640f099` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:34.502579 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828587a-2d44-433b-9e7c-a6f394cb62d5 None admin] RBAC: Authorizing `identity:get_user(user_id=0169980d6ece48dfb2a743ab6640f099)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:34.504028 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828587a-2d44-433b-9e7c-a6f394cb62d5 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:34.505723 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 559/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:48:34 2022] GET /identity/v3/users/0169980d6ece48dfb2a743ab6640f099 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:34.512185 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3502608-738f-4aef-b8d2-db7941373453 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:34.608407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3502608-738f-4aef-b8d2-db7941373453 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:34.642179 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705be60-f5a3-4b01-8618-c31dcc01d56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:34.642833 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705be60-f5a3-4b01-8618-c31dcc01d56b None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:34.643117 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705be60-f5a3-4b01-8618-c31dcc01d56b None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:34.643393 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705be60-f5a3-4b01-8618-c31dcc01d56b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:34.711050 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705be60-f5a3-4b01-8618-c31dcc01d56b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:34.712485 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705be60-f5a3-4b01-8618-c31dcc01d56b None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:34.811659 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 556/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:48:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:48:34.817677 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828587a-2d44-433b-9e7c-a6f394cb62d5 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:34.916108 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828587a-2d44-433b-9e7c-a6f394cb62d5 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:34.950938 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4070e-b4e6-4a95-8c15-4e75e6a403ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:34.951805 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4070e-b4e6-4a95-8c15-4e75e6a403ce None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:34.952093 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4070e-b4e6-4a95-8c15-4e75e6a403ce None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:34.952373 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4070e-b4e6-4a95-8c15-4e75e6a403ce None admin] PATH_INFO: `/v3/projects/70fe5b0375ac4c90b6f86b6168030ba2` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:34.953614 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4070e-b4e6-4a95-8c15-4e75e6a403ce None admin] RBAC: Authorizing `identity:get_project(project_id=70fe5b0375ac4c90b6f86b6168030ba2)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:34.955046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4070e-b4e6-4a95-8c15-4e75e6a403ce None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:34.956777 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 560/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:48:34 2022] GET /identity/v3/projects/70fe5b0375ac4c90b6f86b6168030ba2 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:34.962931 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705be60-f5a3-4b01-8618-c31dcc01d56b None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:35.067618 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705be60-f5a3-4b01-8618-c31dcc01d56b None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:35.103511 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aec049-07dc-42d7-a4fb-ed3b56de8794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:35.104221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aec049-07dc-42d7-a4fb-ed3b56de8794 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:35.104446 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aec049-07dc-42d7-a4fb-ed3b56de8794 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:35.105862 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aec049-07dc-42d7-a4fb-ed3b56de8794 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:35.106723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aec049-07dc-42d7-a4fb-ed3b56de8794 None admin] RBAC: Adding query filter params (role.id=cf8c8db912344d0f82f8e6b0fa805968, scope.project.id=70fe5b0375ac4c90b6f86b6168030ba2, user.id=0169980d6ece48dfb2a743ab6640f099) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:35.107043 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aec049-07dc-42d7-a4fb-ed3b56de8794 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:35.108494 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aec049-07dc-42d7-a4fb-ed3b56de8794 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:35.114329 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 557/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:48:34 2022] GET /identity/v3/role_assignments?user.id=0169980d6ece48dfb2a743ab6640f099&scope.project.id=70fe5b0375ac4c90b6f86b6168030ba2&role.id=cf8c8db912344d0f82f8e6b0fa805968 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:37.382804 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d01eb-9e25-4fa3-a928-40da989d6852 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:37.383457 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d01eb-9e25-4fa3-a928-40da989d6852 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:37.383457 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d01eb-9e25-4fa3-a928-40da989d6852 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:37.384745 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 561/1118] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:37.391450 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f76bc-c613-42b5-ab96-f44cfbbed9d3 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:37.391919 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f76bc-c613-42b5-ab96-f44cfbbed9d3 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:37.392037 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f76bc-c613-42b5-ab96-f44cfbbed9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:37.408469 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-524f76bc-c613-42b5-ab96-f44cfbbed9d3 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:37.409694 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-524f76bc-c613-42b5-ab96-f44cfbbed9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:37.474988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 558/1119] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:48:37.497619 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d01eb-9e25-4fa3-a928-40da989d6852 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:37.596173 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d01eb-9e25-4fa3-a928-40da989d6852 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:37.630966 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366f604-802c-4682-88b4-9ec9df928573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:37.631833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366f604-802c-4682-88b4-9ec9df928573 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:37.632119 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366f604-802c-4682-88b4-9ec9df928573 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:37.632398 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366f604-802c-4682-88b4-9ec9df928573 None admin] PATH_INFO: `/v3/roles/cf8c8db912344d0f82f8e6b0fa805968` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:37.634007 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366f604-802c-4682-88b4-9ec9df928573 None admin] RBAC: Authorizing `identity:get_role(role_id=cf8c8db912344d0f82f8e6b0fa805968)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:37.635329 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366f604-802c-4682-88b4-9ec9df928573 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:37.637946 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 562/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:48:37 2022] GET /identity/v3/roles/cf8c8db912344d0f82f8e6b0fa805968 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:37.643665 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f76bc-c613-42b5-ab96-f44cfbbed9d3 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:37.741184 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f76bc-c613-42b5-ab96-f44cfbbed9d3 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:37.775767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047d299-9282-41de-a6b5-fd7024e9a1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:37.776728 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047d299-9282-41de-a6b5-fd7024e9a1a6 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:37.777225 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047d299-9282-41de-a6b5-fd7024e9a1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:37.777755 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047d299-9282-41de-a6b5-fd7024e9a1a6 None admin] PATH_INFO: `/v3/users/0169980d6ece48dfb2a743ab6640f099` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:37.779100 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047d299-9282-41de-a6b5-fd7024e9a1a6 None admin] RBAC: Authorizing `identity:get_user(user_id=0169980d6ece48dfb2a743ab6640f099)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:37.780566 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047d299-9282-41de-a6b5-fd7024e9a1a6 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:37.782341 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 559/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:48:37 2022] GET /identity/v3/users/0169980d6ece48dfb2a743ab6640f099 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:37.794887 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366f604-802c-4682-88b4-9ec9df928573 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:37.903457 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366f604-802c-4682-88b4-9ec9df928573 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:37.936943 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95567f49-b547-47d9-9261-7027ac546182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:37.937819 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95567f49-b547-47d9-9261-7027ac546182 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:37.938104 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95567f49-b547-47d9-9261-7027ac546182 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:37.938379 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95567f49-b547-47d9-9261-7027ac546182 None admin] PATH_INFO: `/v3/projects/70fe5b0375ac4c90b6f86b6168030ba2` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:37.939585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95567f49-b547-47d9-9261-7027ac546182 None admin] RBAC: Authorizing `identity:get_project(project_id=70fe5b0375ac4c90b6f86b6168030ba2)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:37.941004 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95567f49-b547-47d9-9261-7027ac546182 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:37.942745 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 563/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:48:37 2022] GET /identity/v3/projects/70fe5b0375ac4c90b6f86b6168030ba2 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:37.949258 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047d299-9282-41de-a6b5-fd7024e9a1a6 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:38.047991 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047d299-9282-41de-a6b5-fd7024e9a1a6 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:38.083836 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb075f1-ee96-4d07-9ac1-80596169a6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:38.084722 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb075f1-ee96-4d07-9ac1-80596169a6fe None admin] REQUEST_METHOD: `PUT` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:38.085004 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb075f1-ee96-4d07-9ac1-80596169a6fe None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:38.085279 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb075f1-ee96-4d07-9ac1-80596169a6fe None admin] PATH_INFO: `/v3/projects/70fe5b0375ac4c90b6f86b6168030ba2/users/0169980d6ece48dfb2a743ab6640f099/roles/cf8c8db912344d0f82f8e6b0fa805968` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:38.087545 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb075f1-ee96-4d07-9ac1-80596169a6fe None admin] RBAC: Authorizing `identity:create_grant(project_id=70fe5b0375ac4c90b6f86b6168030ba2, user_id=0169980d6ece48dfb2a743ab6640f099, role_id=cf8c8db912344d0f82f8e6b0fa805968)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:38.089523 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb075f1-ee96-4d07-9ac1-80596169a6fe None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:38.101954 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 560/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:48:37 2022] PUT /identity/v3/projects/70fe5b0375ac4c90b6f86b6168030ba2/users/0169980d6ece48dfb2a743ab6640f099/roles/cf8c8db912344d0f82f8e6b0fa805968 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:48:40.490800 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c260d6-8039-4019-b22e-388820e21c9a None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:40.491439 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c260d6-8039-4019-b22e-388820e21c9a None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:40.491439 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c260d6-8039-4019-b22e-388820e21c9a None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:40.492884 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 564/1124] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:48:40.499947 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880a38a-2370-4a07-9bcc-602446d8a26c None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:40.500751 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880a38a-2370-4a07-9bcc-602446d8a26c None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:40.500879 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880a38a-2370-4a07-9bcc-602446d8a26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:40.518759 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-3880a38a-2370-4a07-9bcc-602446d8a26c None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:40.519960 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-3880a38a-2370-4a07-9bcc-602446d8a26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:40.604179 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 561/1125] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:48:40.629078 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c260d6-8039-4019-b22e-388820e21c9a None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:40.736091 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c260d6-8039-4019-b22e-388820e21c9a None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:40.770712 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510aaec7-9d77-4f7c-8449-616fa286b8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:40.771487 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510aaec7-9d77-4f7c-8449-616fa286b8bd None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:40.771774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510aaec7-9d77-4f7c-8449-616fa286b8bd None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:40.772056 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510aaec7-9d77-4f7c-8449-616fa286b8bd None admin] PATH_INFO: `/v3/roles/cf8c8db912344d0f82f8e6b0fa805968` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:40.773596 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510aaec7-9d77-4f7c-8449-616fa286b8bd None admin] RBAC: Authorizing `identity:get_role(role_id=cf8c8db912344d0f82f8e6b0fa805968)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:40.774968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510aaec7-9d77-4f7c-8449-616fa286b8bd None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:40.776701 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 565/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:48:40 2022] GET /identity/v3/roles/cf8c8db912344d0f82f8e6b0fa805968 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:48:40.782399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880a38a-2370-4a07-9bcc-602446d8a26c None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:40.881058 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880a38a-2370-4a07-9bcc-602446d8a26c None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:40.914949 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3841b07-af7b-4723-bf88-d5a20d994112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:40.915835 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3841b07-af7b-4723-bf88-d5a20d994112 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:40.916118 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3841b07-af7b-4723-bf88-d5a20d994112 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:40.916391 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3841b07-af7b-4723-bf88-d5a20d994112 None admin] PATH_INFO: `/v3/users/0169980d6ece48dfb2a743ab6640f099` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:40.918169 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3841b07-af7b-4723-bf88-d5a20d994112 None admin] RBAC: Authorizing `identity:get_user(user_id=0169980d6ece48dfb2a743ab6640f099)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:40.919608 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3841b07-af7b-4723-bf88-d5a20d994112 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:40.921422 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 562/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:48:40 2022] GET /identity/v3/users/0169980d6ece48dfb2a743ab6640f099 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:40.927479 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510aaec7-9d77-4f7c-8449-616fa286b8bd None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:41.029145 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510aaec7-9d77-4f7c-8449-616fa286b8bd None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:41.071987 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af78c0-ba0e-475b-b6c5-fed5034ccd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:41.073164 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af78c0-ba0e-475b-b6c5-fed5034ccd14 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:41.074308 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af78c0-ba0e-475b-b6c5-fed5034ccd14 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:41.074830 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af78c0-ba0e-475b-b6c5-fed5034ccd14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:41.156184 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af78c0-ba0e-475b-b6c5-fed5034ccd14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:41.157696 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af78c0-ba0e-475b-b6c5-fed5034ccd14 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:41.255025 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 566/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:48:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:48:41.261951 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3841b07-af7b-4723-bf88-d5a20d994112 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:41.359169 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3841b07-af7b-4723-bf88-d5a20d994112 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:41.393532 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192e4a7-4801-4bbd-915f-5b6d704c89e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:41.394403 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192e4a7-4801-4bbd-915f-5b6d704c89e8 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:41.394686 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192e4a7-4801-4bbd-915f-5b6d704c89e8 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:41.394961 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192e4a7-4801-4bbd-915f-5b6d704c89e8 None admin] PATH_INFO: `/v3/projects/70fe5b0375ac4c90b6f86b6168030ba2` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:41.396178 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192e4a7-4801-4bbd-915f-5b6d704c89e8 None admin] RBAC: Authorizing `identity:get_project(project_id=70fe5b0375ac4c90b6f86b6168030ba2)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:41.397631 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192e4a7-4801-4bbd-915f-5b6d704c89e8 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:41.399338 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 563/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:48:41 2022] GET /identity/v3/projects/70fe5b0375ac4c90b6f86b6168030ba2 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:41.405987 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af78c0-ba0e-475b-b6c5-fed5034ccd14 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:41.514288 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af78c0-ba0e-475b-b6c5-fed5034ccd14 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:41.550590 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ac48d-b999-47ca-a69a-e1d43c443bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:41.551260 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ac48d-b999-47ca-a69a-e1d43c443bcc None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:41.551544 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ac48d-b999-47ca-a69a-e1d43c443bcc None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:41.551820 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ac48d-b999-47ca-a69a-e1d43c443bcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:41.552683 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ac48d-b999-47ca-a69a-e1d43c443bcc None admin] RBAC: Adding query filter params (role.id=cf8c8db912344d0f82f8e6b0fa805968, scope.project.id=70fe5b0375ac4c90b6f86b6168030ba2, user.id=0169980d6ece48dfb2a743ab6640f099) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:41.553000 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ac48d-b999-47ca-a69a-e1d43c443bcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:41.554562 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ac48d-b999-47ca-a69a-e1d43c443bcc None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:41.562440 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 567/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:48:41 2022] GET /identity/v3/role_assignments?user.id=0169980d6ece48dfb2a743ab6640f099&scope.project.id=70fe5b0375ac4c90b6f86b6168030ba2&role.id=cf8c8db912344d0f82f8e6b0fa805968 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:44.017440 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259390d-2a3f-4ccf-9605-fbcebc2280fc None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:44.018077 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259390d-2a3f-4ccf-9605-fbcebc2280fc None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:44.018077 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259390d-2a3f-4ccf-9605-fbcebc2280fc None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:44.019380 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 564/1131] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:48:44.025359 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4466dc5-c4ce-44e0-ace4-9cb7efd3207e None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:44.025948 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4466dc5-c4ce-44e0-ace4-9cb7efd3207e None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:44.026664 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4466dc5-c4ce-44e0-ace4-9cb7efd3207e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:44.045384 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-b4466dc5-c4ce-44e0-ace4-9cb7efd3207e None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:44.047548 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-b4466dc5-c4ce-44e0-ace4-9cb7efd3207e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:44.150523 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 568/1132] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:48:44.177279 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259390d-2a3f-4ccf-9605-fbcebc2280fc None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:44.293339 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259390d-2a3f-4ccf-9605-fbcebc2280fc None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:44.334450 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d1251-862d-4613-8abf-eb6a4c5d1dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:44.335252 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d1251-862d-4613-8abf-eb6a4c5d1dd5 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:44.335540 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d1251-862d-4613-8abf-eb6a4c5d1dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:44.335821 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d1251-862d-4613-8abf-eb6a4c5d1dd5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:44.337048 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d1251-862d-4613-8abf-eb6a4c5d1dd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:44.338536 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d1251-862d-4613-8abf-eb6a4c5d1dd5 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:44.340720 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 565/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:48:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:48:44.346851 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4466dc5-c4ce-44e0-ace4-9cb7efd3207e None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:44.450716 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4466dc5-c4ce-44e0-ace4-9cb7efd3207e None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:44.486741 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2350d7-8ad0-4be9-afbf-36082515fb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:44.487486 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2350d7-8ad0-4be9-afbf-36082515fb39 None admin] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:44.487825 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2350d7-8ad0-4be9-afbf-36082515fb39 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:44.488156 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2350d7-8ad0-4be9-afbf-36082515fb39 None admin] PATH_INFO: `/v3/projects` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:44.488954 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2350d7-8ad0-4be9-afbf-36082515fb39 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:44.490492 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2350d7-8ad0-4be9-afbf-36082515fb39 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:44.520166 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 569/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:48:44 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:48:47.012014 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debea148-fe62-4ecd-b831-52e1bf01ee3a None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:47.012673 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debea148-fe62-4ecd-b831-52e1bf01ee3a None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:47.012673 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debea148-fe62-4ecd-b831-52e1bf01ee3a None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:47.013979 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 566/1135] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:48:47.020191 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606edfb-12f1-4e1e-86f5-a20f49e7fc54 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:47.020777 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606edfb-12f1-4e1e-86f5-a20f49e7fc54 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:47.020777 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606edfb-12f1-4e1e-86f5-a20f49e7fc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:47.039665 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-b606edfb-12f1-4e1e-86f5-a20f49e7fc54 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:47.040886 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-b606edfb-12f1-4e1e-86f5-a20f49e7fc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:47.116596 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 570/1136] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:48:47.144271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debea148-fe62-4ecd-b831-52e1bf01ee3a None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:47.247767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debea148-fe62-4ecd-b831-52e1bf01ee3a None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:47.282634 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511547e9-6b0c-4573-acb6-3746e78c3eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:47.283347 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511547e9-6b0c-4573-acb6-3746e78c3eb6 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:47.283634 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511547e9-6b0c-4573-acb6-3746e78c3eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:47.283912 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511547e9-6b0c-4573-acb6-3746e78c3eb6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:47.285178 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511547e9-6b0c-4573-acb6-3746e78c3eb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:47.286725 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511547e9-6b0c-4573-acb6-3746e78c3eb6 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:47.288493 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 567/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:48:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:48:47.295697 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606edfb-12f1-4e1e-86f5-a20f49e7fc54 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:47.471791 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606edfb-12f1-4e1e-86f5-a20f49e7fc54 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:47.509527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57134260-e6c8-4bfb-a080-9d6049a81af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:47.510206 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57134260-e6c8-4bfb-a080-9d6049a81af2 None admin] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:47.511297 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57134260-e6c8-4bfb-a080-9d6049a81af2 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:47.512069 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57134260-e6c8-4bfb-a080-9d6049a81af2 None admin] PATH_INFO: `/v3/users` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:47.512810 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57134260-e6c8-4bfb-a080-9d6049a81af2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:47.514454 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57134260-e6c8-4bfb-a080-9d6049a81af2 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:47.540856 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 571/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:48:47 2022] POST /identity/v3/users => generated 286 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:48:50.011839 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bba41-b7a9-4eac-babf-823ab835a668 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:50.012452 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bba41-b7a9-4eac-babf-823ab835a668 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:50.012452 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bba41-b7a9-4eac-babf-823ab835a668 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:50.013815 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 568/1139] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:50.019530 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4cae9-dee2-4608-bc52-bfd5b27c26ff None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:50.020086 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4cae9-dee2-4608-bc52-bfd5b27c26ff None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:50.020252 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4cae9-dee2-4608-bc52-bfd5b27c26ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:50.037977 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-b3e4cae9-dee2-4608-bc52-bfd5b27c26ff None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:50.039220 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-b3e4cae9-dee2-4608-bc52-bfd5b27c26ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:50.120701 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 572/1140] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:48:50.146165 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bba41-b7a9-4eac-babf-823ab835a668 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:50.252442 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bba41-b7a9-4eac-babf-823ab835a668 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:50.287687 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b025e7-394a-421a-8a3e-b536daf66a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:50.288470 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b025e7-394a-421a-8a3e-b536daf66a37 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:50.288808 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b025e7-394a-421a-8a3e-b536daf66a37 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:50.289138 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b025e7-394a-421a-8a3e-b536daf66a37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:50.300625 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b025e7-394a-421a-8a3e-b536daf66a37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:48:50.308937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-75b025e7-394a-421a-8a3e-b536daf66a37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:48:50.308937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:50.308937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:50.308937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:50.308937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:50.308937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:50.308937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:50.308937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:50.308937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:50.308937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:50.308937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:50.308937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:50.308937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:48:50.308937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:48:50.308937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:48:50.308937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:48:50.311204 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:48:50.311204 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:48:50.311204 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:48:50.311204 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:48:50.311204 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:50.311204 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:50.311204 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:50.311204 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:50.311204 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:50.311204 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:50.311204 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:50.311204 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:48:50.311204 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:50.311204 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:50.311204 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:50.311204 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:50.312612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:50.312612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:50.312612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:50.312612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:50.312612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:48:50.312612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:48:50.312612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:48:50.312612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:48:50.312612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:48:50.312612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:48:50.312612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:48:50.312612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:50.312612 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 569/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:48:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:48:50.317755 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4cae9-dee2-4608-bc52-bfd5b27c26ff None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:50.430287 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4cae9-dee2-4608-bc52-bfd5b27c26ff None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:50.488176 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb0d23-c245-4bac-a116-49a6a9e05f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:50.489252 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb0d23-c245-4bac-a116-49a6a9e05f20 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:50.489759 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb0d23-c245-4bac-a116-49a6a9e05f20 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:50.490227 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb0d23-c245-4bac-a116-49a6a9e05f20 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:50.491604 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb0d23-c245-4bac-a116-49a6a9e05f20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:50.492153 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb0d23-c245-4bac-a116-49a6a9e05f20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:50.495486 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb0d23-c245-4bac-a116-49a6a9e05f20 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:50.509649 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 573/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:48:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:50.515700 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b025e7-394a-421a-8a3e-b536daf66a37 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:50.622335 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b025e7-394a-421a-8a3e-b536daf66a37 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:50.659989 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fcae8-ac2b-44c2-a8a1-b23edb53975d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:50.660878 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fcae8-ac2b-44c2-a8a1-b23edb53975d None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:50.661169 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fcae8-ac2b-44c2-a8a1-b23edb53975d None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:50.661493 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fcae8-ac2b-44c2-a8a1-b23edb53975d None admin] PATH_INFO: `/v3/users/f02683d46090485890e4353e9b12140a` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:50.679469 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fcae8-ac2b-44c2-a8a1-b23edb53975d None admin] RBAC: Authorizing `identity:get_user(user_id=f02683d46090485890e4353e9b12140a)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:50.680999 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fcae8-ac2b-44c2-a8a1-b23edb53975d None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:50.683757 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 570/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:48:50 2022] GET /identity/v3/users/f02683d46090485890e4353e9b12140a => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:50.689932 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb0d23-c245-4bac-a116-49a6a9e05f20 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:50.800842 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb0d23-c245-4bac-a116-49a6a9e05f20 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:50.836627 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bbc24-b80f-49c1-bb20-de88799350b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:50.837338 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bbc24-b80f-49c1-bb20-de88799350b0 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:50.837719 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bbc24-b80f-49c1-bb20-de88799350b0 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:50.838040 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bbc24-b80f-49c1-bb20-de88799350b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:50.907025 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741bbc24-b80f-49c1-bb20-de88799350b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:50.908402 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741bbc24-b80f-49c1-bb20-de88799350b0 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:51.009615 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 574/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:48:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:48:51.019076 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fcae8-ac2b-44c2-a8a1-b23edb53975d None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:51.133497 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fcae8-ac2b-44c2-a8a1-b23edb53975d None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:51.172787 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2239a-8935-45ee-af7a-0e267dac831f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:51.173726 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2239a-8935-45ee-af7a-0e267dac831f None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:51.174062 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2239a-8935-45ee-af7a-0e267dac831f None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:51.174389 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2239a-8935-45ee-af7a-0e267dac831f None admin] PATH_INFO: `/v3/projects/5961391f841e4725a2c85ee68fd064e6` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:51.175845 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2239a-8935-45ee-af7a-0e267dac831f None admin] RBAC: Authorizing `identity:get_project(project_id=5961391f841e4725a2c85ee68fd064e6)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:51.177349 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2239a-8935-45ee-af7a-0e267dac831f None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:51.179251 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 571/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:48:51 2022] GET /identity/v3/projects/5961391f841e4725a2c85ee68fd064e6 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:51.185872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bbc24-b80f-49c1-bb20-de88799350b0 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:51.295529 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bbc24-b80f-49c1-bb20-de88799350b0 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:51.334472 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda121f-150b-450a-a7fa-8aee3becc664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:51.335225 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda121f-150b-450a-a7fa-8aee3becc664 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:51.335552 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda121f-150b-450a-a7fa-8aee3becc664 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:51.335925 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda121f-150b-450a-a7fa-8aee3becc664 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:51.336866 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda121f-150b-450a-a7fa-8aee3becc664 None admin] RBAC: Adding query filter params (role.id=2180d183afad443187521833c40ed8a1, scope.project.id=5961391f841e4725a2c85ee68fd064e6, user.id=f02683d46090485890e4353e9b12140a) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:51.337221 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda121f-150b-450a-a7fa-8aee3becc664 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:51.338947 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda121f-150b-450a-a7fa-8aee3becc664 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:51.345630 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 575/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:48:51 2022] GET /identity/v3/role_assignments?user.id=f02683d46090485890e4353e9b12140a&scope.project.id=5961391f841e4725a2c85ee68fd064e6&role.id=2180d183afad443187521833c40ed8a1 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:48:53.635120 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47354f7f-c9d7-4192-8970-2404d54605f4 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:53.636083 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47354f7f-c9d7-4192-8970-2404d54605f4 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:53.636286 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47354f7f-c9d7-4192-8970-2404d54605f4 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:53.637700 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 572/1147] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:53.643365 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29792504-160f-48f0-9c34-ae4fc51586de None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:53.643840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29792504-160f-48f0-9c34-ae4fc51586de None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:53.643938 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29792504-160f-48f0-9c34-ae4fc51586de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:53.663693 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-29792504-160f-48f0-9c34-ae4fc51586de None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:53.664917 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-29792504-160f-48f0-9c34-ae4fc51586de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:53.735913 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 576/1148] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:48:53.759740 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47354f7f-c9d7-4192-8970-2404d54605f4 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:53.873173 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47354f7f-c9d7-4192-8970-2404d54605f4 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:53.909201 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ec453-af4b-4ae6-bad8-51945c087244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:53.909940 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ec453-af4b-4ae6-bad8-51945c087244 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:53.910221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ec453-af4b-4ae6-bad8-51945c087244 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:53.910496 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ec453-af4b-4ae6-bad8-51945c087244 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:53.921788 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ec453-af4b-4ae6-bad8-51945c087244 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:48:53.929991 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-549ec453-af4b-4ae6-bad8-51945c087244 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:48:53.929991 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:53.929991 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:53.929991 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:53.929991 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:53.929991 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:53.929991 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:53.929991 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:53.929991 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:53.929991 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:53.929991 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:53.929991 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:53.929991 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:48:53.929991 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:48:53.929991 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:48:53.929991 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:48:53.931390 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:48:53.931390 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:48:53.931390 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:48:53.931390 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:48:53.931390 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:53.931390 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:53.931390 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:53.931390 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:53.931390 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:53.931390 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:53.931390 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:53.931390 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:48:53.931390 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:53.931390 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:53.931390 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:53.931390 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:53.933425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:53.933425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:53.933425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:53.933425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:53.933425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:48:53.933425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:48:53.933425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:48:53.933425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:48:53.933425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:48:53.933425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:48:53.933425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:48:53.933425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:48:53.933425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 573/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:48:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:48:53.938315 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29792504-160f-48f0-9c34-ae4fc51586de None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:54.040674 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29792504-160f-48f0-9c34-ae4fc51586de None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:54.075926 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d622829-f95f-4e6e-992e-c119754df0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:54.076864 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d622829-f95f-4e6e-992e-c119754df0b5 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:54.077245 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d622829-f95f-4e6e-992e-c119754df0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:54.077646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d622829-f95f-4e6e-992e-c119754df0b5 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:54.078775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d622829-f95f-4e6e-992e-c119754df0b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:54.079261 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d622829-f95f-4e6e-992e-c119754df0b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:54.080647 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d622829-f95f-4e6e-992e-c119754df0b5 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:54.088757 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 577/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:48:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:54.095295 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ec453-af4b-4ae6-bad8-51945c087244 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:54.199681 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ec453-af4b-4ae6-bad8-51945c087244 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:54.231899 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db6c28-8ec0-4e20-b80c-e743963785fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:54.232760 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db6c28-8ec0-4e20-b80c-e743963785fe None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:54.233043 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db6c28-8ec0-4e20-b80c-e743963785fe None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:54.233320 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db6c28-8ec0-4e20-b80c-e743963785fe None admin] PATH_INFO: `/v3/users/f02683d46090485890e4353e9b12140a` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:54.234546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db6c28-8ec0-4e20-b80c-e743963785fe None admin] RBAC: Authorizing `identity:get_user(user_id=f02683d46090485890e4353e9b12140a)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:54.235961 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db6c28-8ec0-4e20-b80c-e743963785fe None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:54.237628 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 574/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:48:54 2022] GET /identity/v3/users/f02683d46090485890e4353e9b12140a => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:54.243537 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d622829-f95f-4e6e-992e-c119754df0b5 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:54.346102 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d622829-f95f-4e6e-992e-c119754df0b5 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:54.379607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12deded2-9d30-40cc-97a3-6332652eac0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:54.380464 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12deded2-9d30-40cc-97a3-6332652eac0a None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:54.380750 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12deded2-9d30-40cc-97a3-6332652eac0a None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:54.381027 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12deded2-9d30-40cc-97a3-6332652eac0a None admin] PATH_INFO: `/v3/projects/5961391f841e4725a2c85ee68fd064e6` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:54.382252 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12deded2-9d30-40cc-97a3-6332652eac0a None admin] RBAC: Authorizing `identity:get_project(project_id=5961391f841e4725a2c85ee68fd064e6)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:54.383679 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12deded2-9d30-40cc-97a3-6332652eac0a None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:54.385441 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 578/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:48:54 2022] GET /identity/v3/projects/5961391f841e4725a2c85ee68fd064e6 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:54.391437 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db6c28-8ec0-4e20-b80c-e743963785fe None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:54.488773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db6c28-8ec0-4e20-b80c-e743963785fe None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:54.523301 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7a10e-4b2f-44fd-b2e4-51f595bb1052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:54.524192 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7a10e-4b2f-44fd-b2e4-51f595bb1052 None admin] REQUEST_METHOD: `PUT` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:54.524476 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7a10e-4b2f-44fd-b2e4-51f595bb1052 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:54.524751 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7a10e-4b2f-44fd-b2e4-51f595bb1052 None admin] PATH_INFO: `/v3/projects/5961391f841e4725a2c85ee68fd064e6/users/f02683d46090485890e4353e9b12140a/roles/2180d183afad443187521833c40ed8a1` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:54.527393 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7a10e-4b2f-44fd-b2e4-51f595bb1052 None admin] RBAC: Authorizing `identity:create_grant(project_id=5961391f841e4725a2c85ee68fd064e6, user_id=f02683d46090485890e4353e9b12140a, role_id=2180d183afad443187521833c40ed8a1)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:54.528846 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7a10e-4b2f-44fd-b2e4-51f595bb1052 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:54.544242 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 575/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:48:54 2022] PUT /identity/v3/projects/5961391f841e4725a2c85ee68fd064e6/users/f02683d46090485890e4353e9b12140a/roles/2180d183afad443187521833c40ed8a1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:48:56.796525 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30624920-4728-41fd-8dc7-f75b5b0bbcaf None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:56.797073 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30624920-4728-41fd-8dc7-f75b5b0bbcaf None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:56.797073 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30624920-4728-41fd-8dc7-f75b5b0bbcaf None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:56.798507 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 579/1154] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:48:56.803904 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dd1ee-ca59-4596-9fef-d93ebe03ffd9 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:56.804341 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dd1ee-ca59-4596-9fef-d93ebe03ffd9 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:56.804444 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dd1ee-ca59-4596-9fef-d93ebe03ffd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:56.821722 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-729dd1ee-ca59-4596-9fef-d93ebe03ffd9 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:48:56.823602 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-729dd1ee-ca59-4596-9fef-d93ebe03ffd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:48:56.889428 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 576/1155] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:48:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:48:56.912928 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30624920-4728-41fd-8dc7-f75b5b0bbcaf None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:57.013434 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30624920-4728-41fd-8dc7-f75b5b0bbcaf None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:57.046101 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79228b69-972d-4657-b31d-2ba104b26518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:57.046885 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79228b69-972d-4657-b31d-2ba104b26518 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:57.047176 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79228b69-972d-4657-b31d-2ba104b26518 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:57.047458 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79228b69-972d-4657-b31d-2ba104b26518 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:57.057700 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79228b69-972d-4657-b31d-2ba104b26518 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:48:57.065753 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-79228b69-972d-4657-b31d-2ba104b26518 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:48:57.065753 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:48:57.065753 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:48:57.065753 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:48:57.065753 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:48:57.065753 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:48:57.065753 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:48:57.065753 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:48:57.065753 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:48:57.065753 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:48:57.065753 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:48:57.065753 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:48:57.065753 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:48:57.065753 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:48:57.065753 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:48:57.065753 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:48:57.067046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:48:57.067046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:48:57.067046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:48:57.067046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:48:57.067046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:48:57.067046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:48:57.067046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:48:57.067046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:48:57.067046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:48:57.067046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:48:57.067046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:48:57.067046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:48:57.067046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:48:57.067046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:48:57.067046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:48:57.067046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:48:57.068257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:48:57.068257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:48:57.068257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:48:57.068257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:48:57.068257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:48:57.068257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:48:57.068257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:48:57.068257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:48:57.068257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:48:57.068257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:48:57.068257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:48:57.068257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:48:57.068257 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 580/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:48:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:48:57.073969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729dd1ee-ca59-4596-9fef-d93ebe03ffd9 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:57.172894 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729dd1ee-ca59-4596-9fef-d93ebe03ffd9 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:57.205525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdba80-30ec-44a3-9c5b-437054c29276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:57.206181 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdba80-30ec-44a3-9c5b-437054c29276 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:57.206466 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdba80-30ec-44a3-9c5b-437054c29276 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:57.206743 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdba80-30ec-44a3-9c5b-437054c29276 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:57.207493 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdba80-30ec-44a3-9c5b-437054c29276 None admin] RBAC: Adding query filter params (name=admin) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:57.207800 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdba80-30ec-44a3-9c5b-437054c29276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:57.209166 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdba80-30ec-44a3-9c5b-437054c29276 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:57.217666 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 577/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:48:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:57.223446 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79228b69-972d-4657-b31d-2ba104b26518 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:57.321360 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79228b69-972d-4657-b31d-2ba104b26518 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:57.356227 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5adec6-9098-4a8f-b920-6bab255383c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:57.357093 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5adec6-9098-4a8f-b920-6bab255383c7 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:57.357397 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5adec6-9098-4a8f-b920-6bab255383c7 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:57.357673 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5adec6-9098-4a8f-b920-6bab255383c7 None admin] PATH_INFO: `/v3/users/f02683d46090485890e4353e9b12140a` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:57.358903 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5adec6-9098-4a8f-b920-6bab255383c7 None admin] RBAC: Authorizing `identity:get_user(user_id=f02683d46090485890e4353e9b12140a)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:57.360326 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5adec6-9098-4a8f-b920-6bab255383c7 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:57.361994 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 581/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:48:57 2022] GET /identity/v3/users/f02683d46090485890e4353e9b12140a => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:57.367907 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdba80-30ec-44a3-9c5b-437054c29276 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:57.464990 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdba80-30ec-44a3-9c5b-437054c29276 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:57.496655 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21f140-a801-4ca9-933d-d82b12467b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:57.497292 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21f140-a801-4ca9-933d-d82b12467b8a None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:57.497608 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21f140-a801-4ca9-933d-d82b12467b8a None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:57.497884 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21f140-a801-4ca9-933d-d82b12467b8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:57.562186 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21f140-a801-4ca9-933d-d82b12467b8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:57.563622 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21f140-a801-4ca9-933d-d82b12467b8a None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:57.662644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 578/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:48:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:48:57.669123 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5adec6-9098-4a8f-b920-6bab255383c7 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:57.766201 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5adec6-9098-4a8f-b920-6bab255383c7 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:57.799417 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111383c-d787-4645-ad6a-24e3a17afba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:57.800273 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111383c-d787-4645-ad6a-24e3a17afba8 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:57.800557 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111383c-d787-4645-ad6a-24e3a17afba8 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:57.800835 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111383c-d787-4645-ad6a-24e3a17afba8 None admin] PATH_INFO: `/v3/projects/5961391f841e4725a2c85ee68fd064e6` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:57.802035 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111383c-d787-4645-ad6a-24e3a17afba8 None admin] RBAC: Authorizing `identity:get_project(project_id=5961391f841e4725a2c85ee68fd064e6)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:57.803492 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111383c-d787-4645-ad6a-24e3a17afba8 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:57.805212 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 582/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:48:57 2022] GET /identity/v3/projects/5961391f841e4725a2c85ee68fd064e6 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:48:57.811833 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21f140-a801-4ca9-933d-d82b12467b8a None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:48:57.907928 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21f140-a801-4ca9-933d-d82b12467b8a None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:48:57.941706 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958bf78-1a4e-4cca-9cc7-06d4777505bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:48:57.942376 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958bf78-1a4e-4cca-9cc7-06d4777505bf None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:48:57.942658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958bf78-1a4e-4cca-9cc7-06d4777505bf None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:48:57.942935 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958bf78-1a4e-4cca-9cc7-06d4777505bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:48:57.943783 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958bf78-1a4e-4cca-9cc7-06d4777505bf None admin] RBAC: Adding query filter params (role.id=2180d183afad443187521833c40ed8a1, scope.project.id=5961391f841e4725a2c85ee68fd064e6, user.id=f02683d46090485890e4353e9b12140a) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:48:57.944101 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958bf78-1a4e-4cca-9cc7-06d4777505bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:48:57.945553 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958bf78-1a4e-4cca-9cc7-06d4777505bf None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:48:57.951799 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 579/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:48:57 2022] GET /identity/v3/role_assignments?user.id=f02683d46090485890e4353e9b12140a&scope.project.id=5961391f841e4725a2c85ee68fd064e6&role.id=2180d183afad443187521833c40ed8a1 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:49:00.240132 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c20d51-69a4-4d7a-adcc-16dcc741a975 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:00.240734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c20d51-69a4-4d7a-adcc-16dcc741a975 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:00.240734 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c20d51-69a4-4d7a-adcc-16dcc741a975 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:00.242154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 583/1162] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:49:00.248381 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbce37d-590f-4c82-b7f5-c742f61099ff None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:00.248988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbce37d-590f-4c82-b7f5-c742f61099ff None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:00.248988 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbce37d-590f-4c82-b7f5-c742f61099ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:00.267526 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-0bbce37d-590f-4c82-b7f5-c742f61099ff None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:49:00.268754 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-0bbce37d-590f-4c82-b7f5-c742f61099ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:49:00.340034 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 580/1163] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:49:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:49:00.363973 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c20d51-69a4-4d7a-adcc-16dcc741a975 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:49:00.467211 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c20d51-69a4-4d7a-adcc-16dcc741a975 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:49:00.500965 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f429ca-2798-4760-adf5-d4da7387d7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:49:00.501566 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f429ca-2798-4760-adf5-d4da7387d7d9 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:00.501847 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f429ca-2798-4760-adf5-d4da7387d7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:00.502121 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f429ca-2798-4760-adf5-d4da7387d7d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:00.570540 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f429ca-2798-4760-adf5-d4da7387d7d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:49:00.571995 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f429ca-2798-4760-adf5-d4da7387d7d9 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:49:00.675569 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 584/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:49:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:49:00.681900 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbce37d-590f-4c82-b7f5-c742f61099ff None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:49:00.782249 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbce37d-590f-4c82-b7f5-c742f61099ff None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:49:00.816503 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb32227-0347-4aa4-a64f-70341a3454b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:49:00.817315 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb32227-0347-4aa4-a64f-70341a3454b1 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:00.817629 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb32227-0347-4aa4-a64f-70341a3454b1 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:00.817911 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb32227-0347-4aa4-a64f-70341a3454b1 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:00.824973 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb32227-0347-4aa4-a64f-70341a3454b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:49:00.826455 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb32227-0347-4aa4-a64f-70341a3454b1 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:49:00.841153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-3eb32227-0347-4aa4-a64f-70341a3454b1 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 09 15:49:00.841153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:49:00.841153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 09 15:49:00.841153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 09 15:49:00.841153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:49:00.841153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:49:00.841153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:49:00.841153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:49:00.841153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 09 15:49:00.841153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:49:00.841153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:49:00.841153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:49:00.841153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:49:00.841153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:49:00.841153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:49:00.841153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:49:00.841153 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:49:00.842658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:49:00.842658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:49:00.842658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:49:00.842658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:49:00.842658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:49:00.842658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:49:00.842658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:49:00.842658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:49:00.842658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:49:00.842658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:49:00.842658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:49:00.842658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:49:00.842658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:49:00.842658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:49:00.842658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:49:00.842658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:49:00.843902 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:49:00.843902 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:49:00.843902 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:49:00.843902 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:49:00.843902 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:49:00.843902 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:49:00.843902 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:49:00.843902 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:49:00.843902 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:49:00.843902 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:49:00.843902 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 09 15:49:00.843902 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:49:00.843902 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 09 15:49:00.843902 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:49:00.843902 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 581/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:49:00 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:49:00.848598 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f429ca-2798-4760-adf5-d4da7387d7d9 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:49:00.952589 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f429ca-2798-4760-adf5-d4da7387d7d9 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:49:00.986541 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ebc02-8d4b-4523-bba2-6c66c4280f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:49:00.987224 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ebc02-8d4b-4523-bba2-6c66c4280f9d None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:00.987483 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ebc02-8d4b-4523-bba2-6c66c4280f9d None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:00.987760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ebc02-8d4b-4523-bba2-6c66c4280f9d None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:00.988488 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ebc02-8d4b-4523-bba2-6c66c4280f9d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:49:00.988794 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ebc02-8d4b-4523-bba2-6c66c4280f9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:49:00.990195 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ebc02-8d4b-4523-bba2-6c66c4280f9d None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:49:00.998075 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 585/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Mon May 9 15:49:00 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:49:03.280600 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012a2a1-47ad-49b1-9f6f-177e3fd8b365 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:03.281199 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012a2a1-47ad-49b1-9f6f-177e3fd8b365 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:03.281199 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012a2a1-47ad-49b1-9f6f-177e3fd8b365 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:03.282643 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 582/1167] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:49:03.288226 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08c9d1-3293-4389-86d4-0a9c498fc430 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:03.288745 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08c9d1-3293-4389-86d4-0a9c498fc430 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:03.288873 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08c9d1-3293-4389-86d4-0a9c498fc430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:03.305264 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-bf08c9d1-3293-4389-86d4-0a9c498fc430 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:49:03.306497 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-bf08c9d1-3293-4389-86d4-0a9c498fc430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:49:03.376023 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 586/1168] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:49:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:49:03.399849 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012a2a1-47ad-49b1-9f6f-177e3fd8b365 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:49:03.510595 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012a2a1-47ad-49b1-9f6f-177e3fd8b365 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:49:03.548056 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1fd14-b20a-48e7-9756-1b7f2bb3dd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:49:03.548653 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1fd14-b20a-48e7-9756-1b7f2bb3dd9d None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:03.548940 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1fd14-b20a-48e7-9756-1b7f2bb3dd9d None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:03.549220 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1fd14-b20a-48e7-9756-1b7f2bb3dd9d None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:03.550034 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1fd14-b20a-48e7-9756-1b7f2bb3dd9d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:49:03.551473 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1fd14-b20a-48e7-9756-1b7f2bb3dd9d None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:49:03.568365 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 583/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Mon May 9 15:49:03 2022] POST /identity/v3/domains => generated 267 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:49:05.874757 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7575e-4e66-4533-8bd9-c13e0f58a001 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:05.875327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7575e-4e66-4533-8bd9-c13e0f58a001 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:05.875327 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7575e-4e66-4533-8bd9-c13e0f58a001 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:05.876926 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 587/1170] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:49:05.882657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa421a-8a7f-4d06-b922-59c5d78f9da7 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:05.883100 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa421a-8a7f-4d06-b922-59c5d78f9da7 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:05.883205 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa421a-8a7f-4d06-b922-59c5d78f9da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:05.900554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-93aa421a-8a7f-4d06-b922-59c5d78f9da7 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:49:05.902638 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-93aa421a-8a7f-4d06-b922-59c5d78f9da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:49:05.970085 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 584/1171] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:49:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:49:05.993758 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7575e-4e66-4533-8bd9-c13e0f58a001 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:49:06.105335 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7575e-4e66-4533-8bd9-c13e0f58a001 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:49:06.142728 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcac9e-6e07-4f99-b150-3558fd67b5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:49:06.143510 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcac9e-6e07-4f99-b150-3558fd67b5a5 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:06.143784 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcac9e-6e07-4f99-b150-3558fd67b5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:06.144054 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcac9e-6e07-4f99-b150-3558fd67b5a5 None admin] PATH_INFO: `/v3/domains/67dc467ee00349ea9f1be2a8d27f79a0` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:06.156594 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcac9e-6e07-4f99-b150-3558fd67b5a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=67dc467ee00349ea9f1be2a8d27f79a0)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:49:06.158394 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcac9e-6e07-4f99-b150-3558fd67b5a5 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:49:06.160146 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 588/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Mon May 9 15:49:05 2022] GET /identity/v3/domains/67dc467ee00349ea9f1be2a8d27f79a0 => generated 267 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:49:06.166770 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa421a-8a7f-4d06-b922-59c5d78f9da7 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:49:06.271338 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa421a-8a7f-4d06-b922-59c5d78f9da7 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:49:06.307050 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bdfe2-4726-4edc-84cb-4a959fa6d345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:49:06.307816 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bdfe2-4726-4edc-84cb-4a959fa6d345 None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:06.308091 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bdfe2-4726-4edc-84cb-4a959fa6d345 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:06.308368 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bdfe2-4726-4edc-84cb-4a959fa6d345 None admin] PATH_INFO: `/v3/projects` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:06.309090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bdfe2-4726-4edc-84cb-4a959fa6d345 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:49:06.310695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bdfe2-4726-4edc-84cb-4a959fa6d345 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:49:06.337523 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 585/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:49:06 2022] POST /identity/v3/projects => generated 361 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:49:08.773969 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85201350-ae14-496d-972b-4b027b9bbbda None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:08.774580 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85201350-ae14-496d-972b-4b027b9bbbda None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:08.774580 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85201350-ae14-496d-972b-4b027b9bbbda None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:08.776586 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 589/1174] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:49:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:49:08.782373 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f179c-1872-4325-b11c-04b7f15caf11 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:08.782921 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f179c-1872-4325-b11c-04b7f15caf11 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:08.782921 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f179c-1872-4325-b11c-04b7f15caf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:08.800622 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-760f179c-1872-4325-b11c-04b7f15caf11 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:49:08.801858 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-760f179c-1872-4325-b11c-04b7f15caf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:49:08.869283 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 586/1175] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:49:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:49:08.894689 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85201350-ae14-496d-972b-4b027b9bbbda None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:49:08.999633 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85201350-ae14-496d-972b-4b027b9bbbda None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:49:09.056723 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4048d-f87f-4ab8-8823-9ecba3518958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:49:09.058778 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4048d-f87f-4ab8-8823-9ecba3518958 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:09.059214 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4048d-f87f-4ab8-8823-9ecba3518958 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:09.059652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4048d-f87f-4ab8-8823-9ecba3518958 None admin] PATH_INFO: `/v3/domains/67dc467ee00349ea9f1be2a8d27f79a0` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:09.061659 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4048d-f87f-4ab8-8823-9ecba3518958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=67dc467ee00349ea9f1be2a8d27f79a0)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:49:09.064084 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4048d-f87f-4ab8-8823-9ecba3518958 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:49:09.066901 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 590/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Mon May 9 15:49:08 2022] GET /identity/v3/domains/67dc467ee00349ea9f1be2a8d27f79a0 => generated 267 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:49:09.072906 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f179c-1872-4325-b11c-04b7f15caf11 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:49:09.180600 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f179c-1872-4325-b11c-04b7f15caf11 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:49:09.216118 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b1374-be98-478d-a715-725045c315ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:49:09.216802 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b1374-be98-478d-a715-725045c315ff None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:09.217116 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b1374-be98-478d-a715-725045c315ff None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:09.217423 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b1374-be98-478d-a715-725045c315ff None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:09.218147 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b1374-be98-478d-a715-725045c315ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:49:09.219585 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b1374-be98-478d-a715-725045c315ff None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:49:09.242616 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 587/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:49:09 2022] POST /identity/v3/users => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:49:11.542695 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280991c-8f2d-41e0-af1f-f6d06cc06c70 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:11.543285 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280991c-8f2d-41e0-af1f-f6d06cc06c70 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:11.543285 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280991c-8f2d-41e0-af1f-f6d06cc06c70 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:11.544646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 591/1178] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:49:11.550754 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3d760-3490-4da7-83e8-958fe524bad1 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:11.551230 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3d760-3490-4da7-83e8-958fe524bad1 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:11.551337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3d760-3490-4da7-83e8-958fe524bad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:11.567910 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-b4c3d760-3490-4da7-83e8-958fe524bad1 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:49:11.569097 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-b4c3d760-3490-4da7-83e8-958fe524bad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:49:11.636148 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 588/1179] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:49:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:49:11.659989 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280991c-8f2d-41e0-af1f-f6d06cc06c70 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:49:11.763536 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280991c-8f2d-41e0-af1f-f6d06cc06c70 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:49:11.797705 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40213eb2-5b01-40ef-acf9-decfd7a5afef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:49:11.798423 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40213eb2-5b01-40ef-acf9-decfd7a5afef None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:11.798710 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40213eb2-5b01-40ef-acf9-decfd7a5afef None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:11.798984 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40213eb2-5b01-40ef-acf9-decfd7a5afef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:11.809456 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40213eb2-5b01-40ef-acf9-decfd7a5afef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:49:11.817439 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-40213eb2-5b01-40ef-acf9-decfd7a5afef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:49:11.817439 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:49:11.817439 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:49:11.817439 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:49:11.817439 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:49:11.817439 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:49:11.817439 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:49:11.817439 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:49:11.817439 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:49:11.817439 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:49:11.817439 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:49:11.817439 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:49:11.817439 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:49:11.817439 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:49:11.817439 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:49:11.817439 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:49:11.818868 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:49:11.818868 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:49:11.818868 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:49:11.818868 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:49:11.818868 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:49:11.818868 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:49:11.818868 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:49:11.818868 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:49:11.818868 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:49:11.818868 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:49:11.818868 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:49:11.818868 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:49:11.818868 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:49:11.818868 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:49:11.818868 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:49:11.818868 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:49:11.820414 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:49:11.820414 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:49:11.820414 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:49:11.820414 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:49:11.820414 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:49:11.820414 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:49:11.820414 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:49:11.820414 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:49:11.820414 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:49:11.820414 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:49:11.820414 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:49:11.820414 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:49:11.820414 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 592/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:49:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:49:11.826229 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3d760-3490-4da7-83e8-958fe524bad1 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:49:11.924346 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3d760-3490-4da7-83e8-958fe524bad1 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:49:11.959083 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03659c38-e232-47e2-9e71-08c065f7c2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:49:11.959761 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03659c38-e232-47e2-9e71-08c065f7c2ee None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:11.960050 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03659c38-e232-47e2-9e71-08c065f7c2ee None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:11.960332 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03659c38-e232-47e2-9e71-08c065f7c2ee None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:11.961095 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03659c38-e232-47e2-9e71-08c065f7c2ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:49:11.961436 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03659c38-e232-47e2-9e71-08c065f7c2ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:49:11.962814 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03659c38-e232-47e2-9e71-08c065f7c2ee None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:49:11.971547 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 589/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:49:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:49:11.977445 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40213eb2-5b01-40ef-acf9-decfd7a5afef None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:49:12.081752 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40213eb2-5b01-40ef-acf9-decfd7a5afef None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:49:12.117359 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82537e84-71fd-47ec-9807-f469a5198311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:49:12.118276 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82537e84-71fd-47ec-9807-f469a5198311 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:12.118561 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82537e84-71fd-47ec-9807-f469a5198311 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:12.118837 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82537e84-71fd-47ec-9807-f469a5198311 None admin] PATH_INFO: `/v3/users/04a190dfeffc4e7097694f82116a878f` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:12.136725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82537e84-71fd-47ec-9807-f469a5198311 None admin] RBAC: Authorizing `identity:get_user(user_id=04a190dfeffc4e7097694f82116a878f)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:49:12.138234 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82537e84-71fd-47ec-9807-f469a5198311 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:49:12.140034 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 593/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:49:11 2022] GET /identity/v3/users/04a190dfeffc4e7097694f82116a878f => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:49:12.146100 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03659c38-e232-47e2-9e71-08c065f7c2ee None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:49:12.260952 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03659c38-e232-47e2-9e71-08c065f7c2ee None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:49:12.295123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816f9e0-d411-49ca-be02-e1168525a9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:49:12.295802 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816f9e0-d411-49ca-be02-e1168525a9d3 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:12.296090 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816f9e0-d411-49ca-be02-e1168525a9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:12.296368 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816f9e0-d411-49ca-be02-e1168525a9d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:12.362564 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816f9e0-d411-49ca-be02-e1168525a9d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:49:12.363930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816f9e0-d411-49ca-be02-e1168525a9d3 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:49:12.458218 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 590/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:49:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:49:12.464768 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82537e84-71fd-47ec-9807-f469a5198311 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:49:12.562009 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82537e84-71fd-47ec-9807-f469a5198311 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:49:12.596956 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d9d25-b4be-4c74-b705-f92c44b07aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:49:12.597845 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d9d25-b4be-4c74-b705-f92c44b07aaf None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:12.598133 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d9d25-b4be-4c74-b705-f92c44b07aaf None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:12.598412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d9d25-b4be-4c74-b705-f92c44b07aaf None admin] PATH_INFO: `/v3/projects/b128b1e09add4c2b845fb6d4c7f2becc` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:12.599645 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d9d25-b4be-4c74-b705-f92c44b07aaf None admin] RBAC: Authorizing `identity:get_project(project_id=b128b1e09add4c2b845fb6d4c7f2becc)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:49:12.601062 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d9d25-b4be-4c74-b705-f92c44b07aaf None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:49:12.603188 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 594/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:49:12 2022] GET /identity/v3/projects/b128b1e09add4c2b845fb6d4c7f2becc => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:49:12.610236 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816f9e0-d411-49ca-be02-e1168525a9d3 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:49:12.719069 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816f9e0-d411-49ca-be02-e1168525a9d3 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:49:12.752453 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdead562-035b-4889-95c4-411e9fa2f67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:49:12.753110 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdead562-035b-4889-95c4-411e9fa2f67d None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:12.753425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdead562-035b-4889-95c4-411e9fa2f67d None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:12.753710 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdead562-035b-4889-95c4-411e9fa2f67d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:12.754544 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdead562-035b-4889-95c4-411e9fa2f67d None admin] RBAC: Adding query filter params (role.id=2180d183afad443187521833c40ed8a1, scope.project.id=b128b1e09add4c2b845fb6d4c7f2becc, user.id=04a190dfeffc4e7097694f82116a878f) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:49:12.754857 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdead562-035b-4889-95c4-411e9fa2f67d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:49:12.756283 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdead562-035b-4889-95c4-411e9fa2f67d None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:49:12.762806 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 591/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:49:12 2022] GET /identity/v3/role_assignments?user.id=04a190dfeffc4e7097694f82116a878f&scope.project.id=b128b1e09add4c2b845fb6d4c7f2becc&role.id=2180d183afad443187521833c40ed8a1 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:49:15.132338 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d19d3-c804-42c1-a37c-541d75a4e6f3 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:15.132917 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d19d3-c804-42c1-a37c-541d75a4e6f3 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:15.132917 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d19d3-c804-42c1-a37c-541d75a4e6f3 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:15.134323 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 595/1186] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:49:15.140583 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826a8f8-497a-40a2-a43b-8af07e6d114e None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:15.141063 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826a8f8-497a-40a2-a43b-8af07e6d114e None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:15.141176 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826a8f8-497a-40a2-a43b-8af07e6d114e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:15.159440 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-7826a8f8-497a-40a2-a43b-8af07e6d114e None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:49:15.160632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-7826a8f8-497a-40a2-a43b-8af07e6d114e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:49:15.231868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 592/1187] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:49:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:49:15.256184 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d19d3-c804-42c1-a37c-541d75a4e6f3 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:49:15.368260 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d19d3-c804-42c1-a37c-541d75a4e6f3 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:49:15.406376 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cb942-c83e-4c9e-a5d4-180ac6b5664c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:49:15.407091 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cb942-c83e-4c9e-a5d4-180ac6b5664c None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:15.407378 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cb942-c83e-4c9e-a5d4-180ac6b5664c None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:15.407655 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cb942-c83e-4c9e-a5d4-180ac6b5664c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:15.418569 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5cb942-c83e-4c9e-a5d4-180ac6b5664c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:49:15.426251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-7b5cb942-c83e-4c9e-a5d4-180ac6b5664c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:49:15.426251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:49:15.426251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:49:15.426251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:49:15.426251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:49:15.426251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:49:15.426251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:49:15.426251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:49:15.426251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:49:15.426251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:49:15.426251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:49:15.426251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:49:15.426251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:49:15.426251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:49:15.426251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:49:15.426251 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:49:15.427701 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:49:15.427701 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:49:15.427701 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:49:15.427701 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:49:15.427701 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:49:15.427701 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:49:15.427701 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:49:15.427701 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:49:15.427701 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:49:15.427701 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:49:15.427701 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:49:15.427701 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:49:15.427701 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:49:15.427701 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:49:15.427701 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:49:15.427701 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:49:15.428697 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:49:15.428697 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:49:15.428697 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:49:15.428697 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:49:15.428697 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:49:15.428697 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:49:15.428697 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:49:15.428697 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:49:15.428697 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:49:15.428697 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:49:15.428697 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:49:15.428697 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:49:15.428697 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 596/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:49:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:49:15.436280 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826a8f8-497a-40a2-a43b-8af07e6d114e None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:49:15.536933 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826a8f8-497a-40a2-a43b-8af07e6d114e None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:49:15.572003 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506765d-c37c-4c55-96c3-b59d24daa539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:49:15.573838 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506765d-c37c-4c55-96c3-b59d24daa539 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:15.574077 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506765d-c37c-4c55-96c3-b59d24daa539 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:15.574362 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506765d-c37c-4c55-96c3-b59d24daa539 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:15.575131 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506765d-c37c-4c55-96c3-b59d24daa539 None admin] RBAC: Adding query filter params (name=admin) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:49:15.575447 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506765d-c37c-4c55-96c3-b59d24daa539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:49:15.576821 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506765d-c37c-4c55-96c3-b59d24daa539 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:49:15.585138 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 593/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:49:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:49:15.591738 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cb942-c83e-4c9e-a5d4-180ac6b5664c None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:49:15.693028 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cb942-c83e-4c9e-a5d4-180ac6b5664c None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:49:15.726927 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205cb71-cd34-436f-ae96-d5b299329ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:49:15.727815 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205cb71-cd34-436f-ae96-d5b299329ca1 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:15.728092 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205cb71-cd34-436f-ae96-d5b299329ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:15.728364 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205cb71-cd34-436f-ae96-d5b299329ca1 None admin] PATH_INFO: `/v3/users/04a190dfeffc4e7097694f82116a878f` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:15.729730 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205cb71-cd34-436f-ae96-d5b299329ca1 None admin] RBAC: Authorizing `identity:get_user(user_id=04a190dfeffc4e7097694f82116a878f)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:49:15.731168 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205cb71-cd34-436f-ae96-d5b299329ca1 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:49:15.733054 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 597/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:49:15 2022] GET /identity/v3/users/04a190dfeffc4e7097694f82116a878f => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:49:15.738834 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506765d-c37c-4c55-96c3-b59d24daa539 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:49:15.838899 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506765d-c37c-4c55-96c3-b59d24daa539 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:49:15.870689 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8129d-9525-4600-8ddb-6d19fea9689a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:49:15.871544 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8129d-9525-4600-8ddb-6d19fea9689a None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:15.871829 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8129d-9525-4600-8ddb-6d19fea9689a None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:15.872114 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8129d-9525-4600-8ddb-6d19fea9689a None admin] PATH_INFO: `/v3/projects/b128b1e09add4c2b845fb6d4c7f2becc` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:15.873316 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8129d-9525-4600-8ddb-6d19fea9689a None admin] RBAC: Authorizing `identity:get_project(project_id=b128b1e09add4c2b845fb6d4c7f2becc)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:49:15.874766 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8129d-9525-4600-8ddb-6d19fea9689a None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:49:15.876719 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 594/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:49:15 2022] GET /identity/v3/projects/b128b1e09add4c2b845fb6d4c7f2becc => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:49:15.882670 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205cb71-cd34-436f-ae96-d5b299329ca1 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:49:15.987511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205cb71-cd34-436f-ae96-d5b299329ca1 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:49:16.028480 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7fad4-76ad-47ed-ba0d-4cc268aeb556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:49:16.029900 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7fad4-76ad-47ed-ba0d-4cc268aeb556 None admin] REQUEST_METHOD: `PUT` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:16.030334 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7fad4-76ad-47ed-ba0d-4cc268aeb556 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:16.030762 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7fad4-76ad-47ed-ba0d-4cc268aeb556 None admin] PATH_INFO: `/v3/projects/b128b1e09add4c2b845fb6d4c7f2becc/users/04a190dfeffc4e7097694f82116a878f/roles/2180d183afad443187521833c40ed8a1` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:16.033750 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7fad4-76ad-47ed-ba0d-4cc268aeb556 None admin] RBAC: Authorizing `identity:create_grant(project_id=b128b1e09add4c2b845fb6d4c7f2becc, user_id=04a190dfeffc4e7097694f82116a878f, role_id=2180d183afad443187521833c40ed8a1)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:49:16.036020 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7fad4-76ad-47ed-ba0d-4cc268aeb556 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:49:16.053698 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 598/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:49:15 2022] PUT /identity/v3/projects/b128b1e09add4c2b845fb6d4c7f2becc/users/04a190dfeffc4e7097694f82116a878f/roles/2180d183afad443187521833c40ed8a1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:49:18.351331 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b5e16-7a74-4e9a-9655-abb02233f084 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:18.351894 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b5e16-7a74-4e9a-9655-abb02233f084 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:18.351894 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b5e16-7a74-4e9a-9655-abb02233f084 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:18.353252 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 595/1193] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:49:18.359325 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c15e6-cae9-4646-b931-164f945a3209 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:18.359779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c15e6-cae9-4646-b931-164f945a3209 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:18.359887 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c15e6-cae9-4646-b931-164f945a3209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:18.376616 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-cb3c15e6-cae9-4646-b931-164f945a3209 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:49:18.377834 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-cb3c15e6-cae9-4646-b931-164f945a3209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:49:18.442611 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 599/1194] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:49:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:49:18.466446 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b5e16-7a74-4e9a-9655-abb02233f084 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:49:18.570397 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b5e16-7a74-4e9a-9655-abb02233f084 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:49:18.606015 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d36b8-d28b-44e8-a40a-d94985253ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:49:18.606538 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d36b8-d28b-44e8-a40a-d94985253ed3 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:18.606830 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d36b8-d28b-44e8-a40a-d94985253ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:18.607114 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d36b8-d28b-44e8-a40a-d94985253ed3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:18.617428 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d36b8-d28b-44e8-a40a-d94985253ed3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:49:18.626632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-9f5d36b8-d28b-44e8-a40a-d94985253ed3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:49:18.626632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:49:18.626632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:49:18.626632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:49:18.626632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:49:18.626632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:49:18.626632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:49:18.626632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:49:18.626632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:49:18.626632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:49:18.626632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:49:18.626632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:49:18.626632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:49:18.626632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:49:18.626632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:49:18.626632 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:49:18.628027 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:49:18.628027 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:49:18.628027 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:49:18.628027 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:49:18.628027 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:49:18.628027 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:49:18.628027 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:49:18.628027 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:49:18.628027 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:49:18.628027 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:49:18.628027 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:49:18.628027 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:49:18.628027 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:49:18.628027 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:49:18.628027 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:49:18.628027 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:49:18.629288 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:49:18.629288 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:49:18.629288 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:49:18.629288 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:49:18.629288 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:49:18.629288 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:49:18.629288 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:49:18.629288 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:49:18.629288 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:49:18.629288 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:49:18.629288 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:49:18.629288 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:49:18.629288 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 596/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:49:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:49:18.634220 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c15e6-cae9-4646-b931-164f945a3209 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:49:18.734657 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c15e6-cae9-4646-b931-164f945a3209 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:49:18.769528 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f5548-9f40-4c26-b469-65e894cdeda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:49:18.770211 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f5548-9f40-4c26-b469-65e894cdeda0 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:18.770498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f5548-9f40-4c26-b469-65e894cdeda0 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:18.770780 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f5548-9f40-4c26-b469-65e894cdeda0 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:18.771541 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f5548-9f40-4c26-b469-65e894cdeda0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:49:18.771851 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f5548-9f40-4c26-b469-65e894cdeda0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:49:18.773234 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f5548-9f40-4c26-b469-65e894cdeda0 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:49:18.781920 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 600/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:49:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:49:18.787726 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d36b8-d28b-44e8-a40a-d94985253ed3 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:49:18.889422 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d36b8-d28b-44e8-a40a-d94985253ed3 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:49:18.921915 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d6b75-d17e-4c06-9122-6ad98215cce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:49:18.922796 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d6b75-d17e-4c06-9122-6ad98215cce9 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:18.923081 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d6b75-d17e-4c06-9122-6ad98215cce9 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:18.923361 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d6b75-d17e-4c06-9122-6ad98215cce9 None admin] PATH_INFO: `/v3/users/04a190dfeffc4e7097694f82116a878f` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:18.924571 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d6b75-d17e-4c06-9122-6ad98215cce9 None admin] RBAC: Authorizing `identity:get_user(user_id=04a190dfeffc4e7097694f82116a878f)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:49:18.926046 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d6b75-d17e-4c06-9122-6ad98215cce9 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:49:18.927698 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 597/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Mon May 9 15:49:18 2022] GET /identity/v3/users/04a190dfeffc4e7097694f82116a878f => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:49:18.934458 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f5548-9f40-4c26-b469-65e894cdeda0 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:49:19.036045 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f5548-9f40-4c26-b469-65e894cdeda0 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:49:19.072872 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e40b8-0e02-4ff4-b1dc-3e73059275ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:49:19.074316 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e40b8-0e02-4ff4-b1dc-3e73059275ca None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:19.074607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e40b8-0e02-4ff4-b1dc-3e73059275ca None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:19.074888 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e40b8-0e02-4ff4-b1dc-3e73059275ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:19.146233 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e40b8-0e02-4ff4-b1dc-3e73059275ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:49:19.147620 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e40b8-0e02-4ff4-b1dc-3e73059275ca None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:49:19.243553 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 601/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:49:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:49:19.250866 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d6b75-d17e-4c06-9122-6ad98215cce9 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:49:19.358916 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d6b75-d17e-4c06-9122-6ad98215cce9 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:49:19.397359 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052e878-a0ed-4d7a-8908-6873d0a4522f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:49:19.398196 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052e878-a0ed-4d7a-8908-6873d0a4522f None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:19.398484 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052e878-a0ed-4d7a-8908-6873d0a4522f None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:19.398764 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052e878-a0ed-4d7a-8908-6873d0a4522f None admin] PATH_INFO: `/v3/projects/b128b1e09add4c2b845fb6d4c7f2becc` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:19.400083 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052e878-a0ed-4d7a-8908-6873d0a4522f None admin] RBAC: Authorizing `identity:get_project(project_id=b128b1e09add4c2b845fb6d4c7f2becc)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:49:19.401733 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052e878-a0ed-4d7a-8908-6873d0a4522f None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:49:19.403788 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 598/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Mon May 9 15:49:19 2022] GET /identity/v3/projects/b128b1e09add4c2b845fb6d4c7f2becc => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:49:19.410339 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e40b8-0e02-4ff4-b1dc-3e73059275ca None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:49:19.521749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e40b8-0e02-4ff4-b1dc-3e73059275ca None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:49:19.563324 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f29039-03d8-486b-b243-ee305b08d63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:49:19.564037 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f29039-03d8-486b-b243-ee305b08d63f None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:49:19.564411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f29039-03d8-486b-b243-ee305b08d63f None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:49:19.564823 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f29039-03d8-486b-b243-ee305b08d63f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:49:19.565908 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f29039-03d8-486b-b243-ee305b08d63f None admin] RBAC: Adding query filter params (role.id=2180d183afad443187521833c40ed8a1, scope.project.id=b128b1e09add4c2b845fb6d4c7f2becc, user.id=04a190dfeffc4e7097694f82116a878f) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:49:19.566234 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f29039-03d8-486b-b243-ee305b08d63f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:49:19.567704 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f29039-03d8-486b-b243-ee305b08d63f None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:49:19.574411 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 602/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:49:19 2022] GET /identity/v3/role_assignments?user.id=04a190dfeffc4e7097694f82116a878f&scope.project.id=b128b1e09add4c2b845fb6d4c7f2becc&role.id=2180d183afad443187521833c40ed8a1 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:21.133235 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5fd1d-6c3d-4ee0-97c3-6442163a9215 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:21.133893 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5fd1d-6c3d-4ee0-97c3-6442163a9215 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:21.134182 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5fd1d-6c3d-4ee0-97c3-6442163a9215 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:21.135645 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 599/1201] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:50:21.140778 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990a6b9-7fc2-4a21-8fdf-4a8521b01ced None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:21.141224 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990a6b9-7fc2-4a21-8fdf-4a8521b01ced None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:21.141333 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990a6b9-7fc2-4a21-8fdf-4a8521b01ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:21.161494 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-5990a6b9-7fc2-4a21-8fdf-4a8521b01ced None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:50:21.162876 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-5990a6b9-7fc2-4a21-8fdf-4a8521b01ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:50:21.247854 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 603/1202] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:50:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:50:21.274693 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5fd1d-6c3d-4ee0-97c3-6442163a9215 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:21.380709 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5fd1d-6c3d-4ee0-97c3-6442163a9215 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:21.423761 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8223a-5e0d-4453-b271-7ae81e60a179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:21.424534 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8223a-5e0d-4453-b271-7ae81e60a179 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:21.424816 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8223a-5e0d-4453-b271-7ae81e60a179 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:21.425146 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8223a-5e0d-4453-b271-7ae81e60a179 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:21.437896 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8223a-5e0d-4453-b271-7ae81e60a179 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:21.439423 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8223a-5e0d-4453-b271-7ae81e60a179 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:21.460020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-f9e8223a-5e0d-4453-b271-7ae81e60a179 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:21.460020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:21.460020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:21.460020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:21.460020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:21.460020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:21.460020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:21.460020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:21.460020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:21.460020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:21.460020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:21.460020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:21.460020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:50:21.460020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:50:21.460020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:50:21.461492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:50:21.461492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:21.461492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:21.461492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:21.461492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:21.461492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:21.461492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:21.461492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:21.461492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:50:21.461492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:21.461492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:21.461492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:21.461492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:21.461492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:21.461492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:21.461492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:21.461492 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:21.462657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:50:21.462657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:50:21.462657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:21.462657 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:50:21.469656 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 600/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:21.469875 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990a6b9-7fc2-4a21-8fdf-4a8521b01ced None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:21.572037 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990a6b9-7fc2-4a21-8fdf-4a8521b01ced None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:21.609652 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8496d-dbf5-40a7-a846-6d163553c8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:21.610364 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8496d-dbf5-40a7-a846-6d163553c8b9 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:21.610649 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8496d-dbf5-40a7-a846-6d163553c8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:21.610924 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8496d-dbf5-40a7-a846-6d163553c8b9 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:21.611662 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8496d-dbf5-40a7-a846-6d163553c8b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:21.611970 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8496d-dbf5-40a7-a846-6d163553c8b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:21.613333 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8496d-dbf5-40a7-a846-6d163553c8b9 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:21.630801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 604/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:21.637074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8223a-5e0d-4453-b271-7ae81e60a179 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:21.759982 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8223a-5e0d-4453-b271-7ae81e60a179 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:21.811527 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4c5e8-3231-430e-9d7c-a60623719560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:21.812991 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4c5e8-3231-430e-9d7c-a60623719560 None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:21.813532 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4c5e8-3231-430e-9d7c-a60623719560 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:21.814001 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4c5e8-3231-430e-9d7c-a60623719560 None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:21.815234 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4c5e8-3231-430e-9d7c-a60623719560 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:21.818058 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4c5e8-3231-430e-9d7c-a60623719560 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:21.854091 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 601/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Mon May 9 15:50:21 2022] POST /identity/v3/users => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:50:24.349531 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fa0c9-1831-432f-8c75-d348d19eb7e5 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:24.350153 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fa0c9-1831-432f-8c75-d348d19eb7e5 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:24.350153 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fa0c9-1831-432f-8c75-d348d19eb7e5 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:24.351477 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 605/1206] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:50:24.358493 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c105437-57d3-4859-acf3-be86b855b20c None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:24.358994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c105437-57d3-4859-acf3-be86b855b20c None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:24.359091 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c105437-57d3-4859-acf3-be86b855b20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:24.378573 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-5c105437-57d3-4859-acf3-be86b855b20c None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:50:24.381448 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-5c105437-57d3-4859-acf3-be86b855b20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:50:24.464364 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 602/1207] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:50:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:50:24.489773 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fa0c9-1831-432f-8c75-d348d19eb7e5 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:24.639970 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fa0c9-1831-432f-8c75-d348d19eb7e5 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:24.683931 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf4ace-2160-4c53-9d59-7769902325cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:24.684859 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf4ace-2160-4c53-9d59-7769902325cb None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:24.685150 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf4ace-2160-4c53-9d59-7769902325cb None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:24.685495 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf4ace-2160-4c53-9d59-7769902325cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:24.697469 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf4ace-2160-4c53-9d59-7769902325cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:50:24.705592 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-0fdf4ace-2160-4c53-9d59-7769902325cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:50:24.705592 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:24.705592 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:24.705592 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:24.705592 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:24.705592 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:24.705592 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:24.705592 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:24.705592 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:24.705592 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:24.705592 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:24.705592 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:24.705592 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:50:24.705592 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:50:24.705592 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:50:24.705592 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:50:24.706987 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:50:24.706987 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:50:24.706987 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:50:24.706987 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:50:24.706987 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:24.706987 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:24.706987 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:24.706987 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:24.706987 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:24.706987 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:24.706987 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:24.706987 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:50:24.706987 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:24.706987 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:24.706987 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:24.706987 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:24.708015 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:24.708015 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:24.708015 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:24.708015 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:24.708015 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:50:24.708015 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:50:24.708015 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:50:24.708015 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:50:24.708015 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:50:24.708015 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:50:24.708015 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:50:24.708015 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:50:24.708015 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 606/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:50:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:24.713837 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c105437-57d3-4859-acf3-be86b855b20c None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:24.854403 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c105437-57d3-4859-acf3-be86b855b20c None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:24.895135 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4ae29-67a6-4f55-ba86-474168ccb9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:24.895827 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4ae29-67a6-4f55-ba86-474168ccb9ac None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:24.896331 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4ae29-67a6-4f55-ba86-474168ccb9ac None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:24.896748 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4ae29-67a6-4f55-ba86-474168ccb9ac None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:24.897525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4ae29-67a6-4f55-ba86-474168ccb9ac None admin] RBAC: Adding query filter params (name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:24.897951 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4ae29-67a6-4f55-ba86-474168ccb9ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:24.899937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4ae29-67a6-4f55-ba86-474168ccb9ac None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:24.909690 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 603/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:50:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:24.916541 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf4ace-2160-4c53-9d59-7769902325cb None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:25.040272 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf4ace-2160-4c53-9d59-7769902325cb None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:25.080519 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18160e-3e0b-45c1-83ee-583f4e6f11d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:25.081457 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18160e-3e0b-45c1-83ee-583f4e6f11d5 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:25.081749 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18160e-3e0b-45c1-83ee-583f4e6f11d5 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:25.082055 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18160e-3e0b-45c1-83ee-583f4e6f11d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:25.095511 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18160e-3e0b-45c1-83ee-583f4e6f11d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:25.097093 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18160e-3e0b-45c1-83ee-583f4e6f11d5 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:25.116498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-1a18160e-3e0b-45c1-83ee-583f4e6f11d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:25.116498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:25.116498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:25.116498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:25.116498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:25.116498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:25.116498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:25.116498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:25.116498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:25.116498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:25.116498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:25.116498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:25.116498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:50:25.116498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:50:25.116498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:50:25.118437 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:50:25.118437 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:25.118437 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:25.118437 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:25.118437 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:25.118437 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:25.118437 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:25.118437 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:25.118437 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:50:25.118437 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:25.118437 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:25.118437 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:25.118437 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:25.118437 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:25.118437 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:25.118437 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:25.118437 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:25.119828 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:50:25.119828 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:50:25.119828 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:25.119828 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:50:25.119828 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 607/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:50:25.124113 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4ae29-67a6-4f55-ba86-474168ccb9ac None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:25.254061 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4ae29-67a6-4f55-ba86-474168ccb9ac None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:25.299130 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3981d5-14c2-4831-a5f1-3ec959bc1869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:25.300259 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3981d5-14c2-4831-a5f1-3ec959bc1869 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:25.300785 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3981d5-14c2-4831-a5f1-3ec959bc1869 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:25.301303 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3981d5-14c2-4831-a5f1-3ec959bc1869 None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:25.302295 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3981d5-14c2-4831-a5f1-3ec959bc1869 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:25.302823 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3981d5-14c2-4831-a5f1-3ec959bc1869 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:25.304419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3981d5-14c2-4831-a5f1-3ec959bc1869 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:25.325442 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 604/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:25.326710 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18160e-3e0b-45c1-83ee-583f4e6f11d5 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:25.451211 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18160e-3e0b-45c1-83ee-583f4e6f11d5 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:25.493973 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c5a99-37bc-4cc5-bcb9-610c4517ba72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:25.494833 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c5a99-37bc-4cc5-bcb9-610c4517ba72 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:25.495123 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c5a99-37bc-4cc5-bcb9-610c4517ba72 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:25.495404 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c5a99-37bc-4cc5-bcb9-610c4517ba72 None admin] PATH_INFO: `/v3/users/placement` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:25.505706 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c5a99-37bc-4cc5-bcb9-610c4517ba72 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:25.507217 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c5a99-37bc-4cc5-bcb9-610c4517ba72 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:25.523507 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-b93c5a99-37bc-4cc5-bcb9-610c4517ba72 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:50:25.523507 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:25.523507 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:25.523507 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:25.523507 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:25.523507 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:25.523507 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:25.523507 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:25.523507 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:25.523507 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:25.523507 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:25.523507 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:25.523507 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:50:25.523507 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:50:25.523507 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:50:25.523507 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:50:25.528282 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:25.528282 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:25.528282 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:50:25.528282 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:50:25.528282 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:50:25.528282 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:50:25.528282 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:25.528282 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:25.528282 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:25.528282 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:25.528282 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:25.528282 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:50:25.528282 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:25.528282 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:25.528282 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:25.528282 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:25.528282 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:25.528282 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:25.529457 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:25.529457 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:25.529457 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:50:25.529457 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:50:25.529457 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:50:25.529457 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:50:25.529457 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:50:25.529457 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:50:25.529457 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:50:25.529457 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:50:25.529457 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 608/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:50:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:50:25.531470 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3981d5-14c2-4831-a5f1-3ec959bc1869 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:25.666184 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3981d5-14c2-4831-a5f1-3ec959bc1869 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:25.707969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39436414-314b-4528-876b-5cf0385905f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:25.708758 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39436414-314b-4528-876b-5cf0385905f6 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:25.709080 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39436414-314b-4528-876b-5cf0385905f6 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:25.709451 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39436414-314b-4528-876b-5cf0385905f6 None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:25.710421 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39436414-314b-4528-876b-5cf0385905f6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:25.710789 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39436414-314b-4528-876b-5cf0385905f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:25.712506 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39436414-314b-4528-876b-5cf0385905f6 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:25.733756 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 605/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 9 15:50:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:25.739536 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c5a99-37bc-4cc5-bcb9-610c4517ba72 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:25.863801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c5a99-37bc-4cc5-bcb9-610c4517ba72 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:25.905893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451da91-4d15-4be6-895b-4871573dfc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:25.906558 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451da91-4d15-4be6-895b-4871573dfc45 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:25.906896 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451da91-4d15-4be6-895b-4871573dfc45 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:25.907138 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451da91-4d15-4be6-895b-4871573dfc45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:25.986693 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451da91-4d15-4be6-895b-4871573dfc45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:25.988215 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451da91-4d15-4be6-895b-4871573dfc45 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:26.106837 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 609/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:50:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:50:26.112981 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39436414-314b-4528-876b-5cf0385905f6 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:26.237019 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39436414-314b-4528-876b-5cf0385905f6 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:26.279103 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f10164-aa8a-4755-b621-974a7a39fea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:26.280318 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f10164-aa8a-4755-b621-974a7a39fea1 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:26.280606 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f10164-aa8a-4755-b621-974a7a39fea1 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:26.280887 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f10164-aa8a-4755-b621-974a7a39fea1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:26.295265 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f10164-aa8a-4755-b621-974a7a39fea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:26.296340 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f10164-aa8a-4755-b621-974a7a39fea1 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:26.319028 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-f6f10164-aa8a-4755-b621-974a7a39fea1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:26.319028 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:26.319028 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:26.319028 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:26.319028 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:26.319028 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:26.319028 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:26.319028 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:26.319028 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:26.319028 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:26.319028 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:26.319028 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:26.319028 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:50:26.319028 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:50:26.319028 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:50:26.320215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:50:26.320215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:26.320215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:26.320215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:26.320215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:26.320215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:26.320215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:26.320215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:26.320215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:50:26.320215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:26.320215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:26.320215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:26.320215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:26.320215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:26.320215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:26.320215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:26.320215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:26.321470 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:50:26.321470 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:50:26.321470 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:26.321470 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:50:26.321470 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 606/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:26.326782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451da91-4d15-4be6-895b-4871573dfc45 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:26.456127 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451da91-4d15-4be6-895b-4871573dfc45 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:26.508097 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403ea5a-d154-43ec-8c04-ea98b2e39f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:26.508815 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403ea5a-d154-43ec-8c04-ea98b2e39f75 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:26.509136 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403ea5a-d154-43ec-8c04-ea98b2e39f75 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:26.509363 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403ea5a-d154-43ec-8c04-ea98b2e39f75 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:26.510204 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403ea5a-d154-43ec-8c04-ea98b2e39f75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:26.510611 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403ea5a-d154-43ec-8c04-ea98b2e39f75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:26.512320 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403ea5a-d154-43ec-8c04-ea98b2e39f75 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:26.525645 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 610/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:26.532693 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f10164-aa8a-4755-b621-974a7a39fea1 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:26.646730 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f10164-aa8a-4755-b621-974a7a39fea1 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:26.688221 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a053b-5aeb-478d-abfc-eeb6d2cd7744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:26.689131 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a053b-5aeb-478d-abfc-eeb6d2cd7744 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:26.689473 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a053b-5aeb-478d-abfc-eeb6d2cd7744 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:26.689792 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a053b-5aeb-478d-abfc-eeb6d2cd7744 None admin] PATH_INFO: `/v3/projects/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:26.698695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a053b-5aeb-478d-abfc-eeb6d2cd7744 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:26.700314 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a053b-5aeb-478d-abfc-eeb6d2cd7744 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:26.716868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-ac4a053b-5aeb-478d-abfc-eeb6d2cd7744 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:50:26.716868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:26.716868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:26.716868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:26.716868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:26.716868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:26.716868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:26.716868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:26.716868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:26.716868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:26.716868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:26.716868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:26.716868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:50:26.716868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:50:26.716868 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:50:26.718104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:50:26.718104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:26.718104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:26.718104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:26.718104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:26.718104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:26.718104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:26.718104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:26.718104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:50:26.718104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:26.718104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:26.718104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:26.718104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:26.718104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:26.718104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:26.718104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:26.718104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:26.719322 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:50:26.719322 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:50:26.719322 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:50:26.719322 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:50:26.719322 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:50:26.719322 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:50:26.719322 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:50:26.719322 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:50:26.719322 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 607/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:50:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:26.727822 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403ea5a-d154-43ec-8c04-ea98b2e39f75 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:26.853097 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403ea5a-d154-43ec-8c04-ea98b2e39f75 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:26.898777 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9285f-ede4-4d27-b992-94ada3d4096d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:26.900053 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9285f-ede4-4d27-b992-94ada3d4096d None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:26.900489 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9285f-ede4-4d27-b992-94ada3d4096d None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:26.900769 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9285f-ede4-4d27-b992-94ada3d4096d None admin] PATH_INFO: `/v3/projects` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:26.901605 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9285f-ede4-4d27-b992-94ada3d4096d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:26.901923 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9285f-ede4-4d27-b992-94ada3d4096d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:26.903468 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9285f-ede4-4d27-b992-94ada3d4096d None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:26.917436 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 611/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:50:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:26.923980 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a053b-5aeb-478d-abfc-eeb6d2cd7744 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:27.043500 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a053b-5aeb-478d-abfc-eeb6d2cd7744 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:27.080229 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad396e-c3c6-48f5-8e7c-19fa913da3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:27.080960 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad396e-c3c6-48f5-8e7c-19fa913da3cd None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:27.081280 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad396e-c3c6-48f5-8e7c-19fa913da3cd None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:27.081591 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad396e-c3c6-48f5-8e7c-19fa913da3cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:27.082541 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad396e-c3c6-48f5-8e7c-19fa913da3cd None admin] RBAC: Adding query filter params (role.id=a6f10c1ca57b4299bb809b5bcc8797f5, scope.project.id=7860d281acf642d2a3950424901b9487, user.id=9ea084f29c9445658b2efc3f5e742b51) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:27.082861 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad396e-c3c6-48f5-8e7c-19fa913da3cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:27.084362 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad396e-c3c6-48f5-8e7c-19fa913da3cd None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:27.101660 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 608/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:50:26 2022] GET /identity/v3/role_assignments?user.id=9ea084f29c9445658b2efc3f5e742b51&scope.project.id=7860d281acf642d2a3950424901b9487&role.id=a6f10c1ca57b4299bb809b5bcc8797f5 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:29.739054 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddeb94-1eaf-4e42-8f36-0c863bcde7ad None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:29.739803 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddeb94-1eaf-4e42-8f36-0c863bcde7ad None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:29.739803 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddeb94-1eaf-4e42-8f36-0c863bcde7ad None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:29.741060 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 612/1220] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:50:29.748340 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0f784-8c31-41e2-b749-294514251fa8 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:29.748906 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0f784-8c31-41e2-b749-294514251fa8 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:29.748906 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0f784-8c31-41e2-b749-294514251fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:29.768026 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-c8b0f784-8c31-41e2-b749-294514251fa8 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:50:29.769263 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-c8b0f784-8c31-41e2-b749-294514251fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:50:29.847020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 609/1221] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:50:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:50:29.871686 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddeb94-1eaf-4e42-8f36-0c863bcde7ad None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:29.987491 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddeb94-1eaf-4e42-8f36-0c863bcde7ad None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:30.025742 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df454c-fe00-4bd0-af1c-3a4ba7eb0964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:30.026596 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df454c-fe00-4bd0-af1c-3a4ba7eb0964 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:30.026918 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df454c-fe00-4bd0-af1c-3a4ba7eb0964 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:30.027199 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df454c-fe00-4bd0-af1c-3a4ba7eb0964 None admin] PATH_INFO: `/v3/roles/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:30.039259 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df454c-fe00-4bd0-af1c-3a4ba7eb0964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:50:30.052429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-95df454c-fe00-4bd0-af1c-3a4ba7eb0964 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:50:30.052429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:30.052429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:30.052429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:30.052429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:30.052429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:30.052429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:30.052429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:30.052429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:30.052429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:30.052429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:30.052429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:30.052429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:50:30.052429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:50:30.052429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:50:30.052429 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:50:30.054954 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:50:30.054954 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:50:30.054954 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:50:30.054954 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:50:30.054954 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:30.054954 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:30.054954 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:30.054954 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:30.054954 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:30.054954 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:30.054954 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:30.054954 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:50:30.054954 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:30.054954 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:30.054954 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:30.054954 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:30.056775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:30.056775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:30.056775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:30.056775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:30.056775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:50:30.056775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:50:30.056775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:50:30.056775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:50:30.056775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:50:30.056775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:50:30.056775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:50:30.056775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:50:30.056775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 613/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:50:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:30.058360 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0f784-8c31-41e2-b749-294514251fa8 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:30.202762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0f784-8c31-41e2-b749-294514251fa8 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:30.255357 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e79e6a-c988-4b9a-b387-3fca9ff3bf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:30.256107 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e79e6a-c988-4b9a-b387-3fca9ff3bf28 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:30.256942 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e79e6a-c988-4b9a-b387-3fca9ff3bf28 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:30.256942 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e79e6a-c988-4b9a-b387-3fca9ff3bf28 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:30.257569 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e79e6a-c988-4b9a-b387-3fca9ff3bf28 None admin] RBAC: Adding query filter params (name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:30.257883 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e79e6a-c988-4b9a-b387-3fca9ff3bf28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:30.259312 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e79e6a-c988-4b9a-b387-3fca9ff3bf28 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:30.273450 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 610/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:50:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:30.278046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df454c-fe00-4bd0-af1c-3a4ba7eb0964 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:30.401467 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df454c-fe00-4bd0-af1c-3a4ba7eb0964 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:30.445263 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a41f31-8af6-492d-b672-1c95c295f3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:30.447220 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a41f31-8af6-492d-b672-1c95c295f3d1 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:30.447424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a41f31-8af6-492d-b672-1c95c295f3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:30.447574 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a41f31-8af6-492d-b672-1c95c295f3d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:30.462571 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a41f31-8af6-492d-b672-1c95c295f3d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:30.464481 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a41f31-8af6-492d-b672-1c95c295f3d1 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:30.491936 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-14a41f31-8af6-492d-b672-1c95c295f3d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:30.491936 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:30.491936 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:30.491936 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:30.491936 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:30.491936 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:30.491936 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:30.491936 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:30.491936 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:30.491936 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:30.491936 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:30.491936 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:30.491936 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:50:30.491936 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:50:30.491936 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:50:30.494328 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:50:30.494328 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:30.494328 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:30.494328 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:30.494328 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:30.494328 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:30.494328 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:30.494328 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:30.494328 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:50:30.494328 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:30.494328 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:30.494328 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:30.494328 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:30.494328 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:30.494328 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:30.494328 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:30.494328 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:30.497782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:50:30.497782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:50:30.497782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:30.497782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:50:30.497782 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 614/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:50:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:30.503195 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e79e6a-c988-4b9a-b387-3fca9ff3bf28 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:30.637646 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e79e6a-c988-4b9a-b387-3fca9ff3bf28 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:30.682384 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89953d2c-3ccc-48c5-9b40-d0e6b2ec61ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:30.683482 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89953d2c-3ccc-48c5-9b40-d0e6b2ec61ab None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:30.683953 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89953d2c-3ccc-48c5-9b40-d0e6b2ec61ab None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:30.684407 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89953d2c-3ccc-48c5-9b40-d0e6b2ec61ab None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:30.685712 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89953d2c-3ccc-48c5-9b40-d0e6b2ec61ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:30.686200 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89953d2c-3ccc-48c5-9b40-d0e6b2ec61ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:30.689174 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89953d2c-3ccc-48c5-9b40-d0e6b2ec61ab None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:30.712919 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 611/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:30.719345 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a41f31-8af6-492d-b672-1c95c295f3d1 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:30.840949 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a41f31-8af6-492d-b672-1c95c295f3d1 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:30.879679 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a301ff-3128-424a-8013-b285fa1953d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:30.880524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a301ff-3128-424a-8013-b285fa1953d5 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:30.880837 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a301ff-3128-424a-8013-b285fa1953d5 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:30.881230 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a301ff-3128-424a-8013-b285fa1953d5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:30.889701 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a301ff-3128-424a-8013-b285fa1953d5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:30.891087 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a301ff-3128-424a-8013-b285fa1953d5 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:30.907142 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-97a301ff-3128-424a-8013-b285fa1953d5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:50:30.907142 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:30.907142 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:30.907142 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:30.907142 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:30.907142 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:30.907142 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:30.907142 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:30.907142 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:30.907142 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:30.907142 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:30.907142 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:30.907142 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:50:30.907142 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:50:30.907142 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:50:30.907142 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:50:30.908392 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:30.908392 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:30.908392 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:50:30.908392 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:50:30.908392 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:50:30.908392 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:50:30.908392 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:30.908392 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:30.908392 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:30.908392 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:30.908392 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:30.908392 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:50:30.908392 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:30.908392 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:30.908392 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:30.908392 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:30.908392 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:30.908392 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:30.910040 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:30.910040 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:30.910040 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:50:30.910040 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:50:30.910040 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:50:30.910040 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:50:30.910040 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:50:30.910040 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:50:30.910040 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:50:30.910040 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:50:30.910040 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 615/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:50:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:30.914488 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89953d2c-3ccc-48c5-9b40-d0e6b2ec61ab None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:31.022693 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89953d2c-3ccc-48c5-9b40-d0e6b2ec61ab None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:31.061197 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5599b5-1eee-4fa3-a211-e24fa161a030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:31.061910 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5599b5-1eee-4fa3-a211-e24fa161a030 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:31.062197 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5599b5-1eee-4fa3-a211-e24fa161a030 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:31.062490 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5599b5-1eee-4fa3-a211-e24fa161a030 None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:31.063332 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5599b5-1eee-4fa3-a211-e24fa161a030 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:31.063674 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5599b5-1eee-4fa3-a211-e24fa161a030 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:31.065159 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5599b5-1eee-4fa3-a211-e24fa161a030 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:31.088594 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 612/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 9 15:50:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:31.091238 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a301ff-3128-424a-8013-b285fa1953d5 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:31.197928 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a301ff-3128-424a-8013-b285fa1953d5 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:31.235342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd65e7-d166-4e67-b84c-55e3f69533d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:31.236134 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd65e7-d166-4e67-b84c-55e3f69533d3 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:31.236442 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd65e7-d166-4e67-b84c-55e3f69533d3 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:31.236677 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd65e7-d166-4e67-b84c-55e3f69533d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:31.247638 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd65e7-d166-4e67-b84c-55e3f69533d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:31.249226 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd65e7-d166-4e67-b84c-55e3f69533d3 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:31.267083 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-48fd65e7-d166-4e67-b84c-55e3f69533d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:31.267083 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:31.267083 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:31.267083 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:31.267083 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:31.267083 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:31.267083 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:31.267083 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:31.267083 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:31.267083 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:31.267083 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:31.267083 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:31.267083 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:50:31.267083 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:50:31.267083 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:50:31.269527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:50:31.269527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:31.269527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:31.269527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:31.269527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:31.269527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:31.269527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:31.269527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:31.269527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:50:31.269527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:31.269527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:31.269527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:31.269527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:31.269527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:31.269527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:31.269527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:31.269527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:31.271928 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:50:31.271928 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:50:31.271928 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:31.271928 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:50:31.271928 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 616/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:31.274982 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5599b5-1eee-4fa3-a211-e24fa161a030 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:31.380110 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5599b5-1eee-4fa3-a211-e24fa161a030 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:31.428101 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35450bb-2714-4284-86ea-ae5632287925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:31.429607 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35450bb-2714-4284-86ea-ae5632287925 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:31.430394 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35450bb-2714-4284-86ea-ae5632287925 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:31.430939 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35450bb-2714-4284-86ea-ae5632287925 None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:31.431766 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35450bb-2714-4284-86ea-ae5632287925 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:31.432085 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35450bb-2714-4284-86ea-ae5632287925 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:31.433494 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35450bb-2714-4284-86ea-ae5632287925 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:31.448709 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 613/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:50:31.454811 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd65e7-d166-4e67-b84c-55e3f69533d3 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:31.580903 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd65e7-d166-4e67-b84c-55e3f69533d3 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:31.621190 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3ecd1-2d3e-455a-a41b-6764d65a042e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:31.622156 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3ecd1-2d3e-455a-a41b-6764d65a042e None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:31.622270 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3ecd1-2d3e-455a-a41b-6764d65a042e None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:31.622510 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3ecd1-2d3e-455a-a41b-6764d65a042e None admin] PATH_INFO: `/v3/projects/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:31.630313 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3ecd1-2d3e-455a-a41b-6764d65a042e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:31.631776 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3ecd1-2d3e-455a-a41b-6764d65a042e None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:31.647401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-1ff3ecd1-2d3e-455a-a41b-6764d65a042e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:50:31.647401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:31.647401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:31.647401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:31.647401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:31.647401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:31.647401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:31.647401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:31.647401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:31.647401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:31.647401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:31.647401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:31.647401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:50:31.647401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:50:31.647401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:50:31.649466 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:50:31.649466 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:31.649466 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:31.649466 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:31.649466 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:31.649466 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:31.649466 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:31.649466 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:31.649466 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:50:31.649466 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:31.649466 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:31.649466 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:31.649466 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:31.649466 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:31.649466 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:31.649466 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:31.649466 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:31.651333 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:50:31.651333 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:50:31.651333 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:50:31.651333 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:50:31.651333 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:50:31.651333 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:50:31.651333 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:50:31.651333 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:50:31.651333 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 617/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:50:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:31.655518 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35450bb-2714-4284-86ea-ae5632287925 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:31.765013 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35450bb-2714-4284-86ea-ae5632287925 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:31.800594 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70422b2b-73c4-4b55-a051-6c77b44eac08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:31.801435 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70422b2b-73c4-4b55-a051-6c77b44eac08 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:31.801751 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70422b2b-73c4-4b55-a051-6c77b44eac08 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:31.802078 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70422b2b-73c4-4b55-a051-6c77b44eac08 None admin] PATH_INFO: `/v3/projects` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:31.802941 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70422b2b-73c4-4b55-a051-6c77b44eac08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:31.803300 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70422b2b-73c4-4b55-a051-6c77b44eac08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:31.804837 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70422b2b-73c4-4b55-a051-6c77b44eac08 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:31.817732 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 614/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:50:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:31.824363 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3ecd1-2d3e-455a-a41b-6764d65a042e None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:31.931264 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3ecd1-2d3e-455a-a41b-6764d65a042e None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:31.969999 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50331a-16d3-4de7-86c1-3036a419b317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:31.970898 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50331a-16d3-4de7-86c1-3036a419b317 None admin] REQUEST_METHOD: `PUT` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:31.971181 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50331a-16d3-4de7-86c1-3036a419b317 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:31.971458 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50331a-16d3-4de7-86c1-3036a419b317 None admin] PATH_INFO: `/v3/projects/7860d281acf642d2a3950424901b9487/users/9ea084f29c9445658b2efc3f5e742b51/roles/a6f10c1ca57b4299bb809b5bcc8797f5` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:31.989995 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50331a-16d3-4de7-86c1-3036a419b317 None admin] RBAC: Authorizing `identity:create_grant(project_id=7860d281acf642d2a3950424901b9487, user_id=9ea084f29c9445658b2efc3f5e742b51, role_id=a6f10c1ca57b4299bb809b5bcc8797f5)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:31.991685 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50331a-16d3-4de7-86c1-3036a419b317 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:32.012646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 618/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:50:31 2022] PUT /identity/v3/projects/7860d281acf642d2a3950424901b9487/users/9ea084f29c9445658b2efc3f5e742b51/roles/a6f10c1ca57b4299bb809b5bcc8797f5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:50:34.615342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f01b2e-b56e-460b-a7af-a93417feb3db None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:34.616030 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f01b2e-b56e-460b-a7af-a93417feb3db None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:34.616398 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f01b2e-b56e-460b-a7af-a93417feb3db None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:34.618158 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 615/1233] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:50:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:50:34.625661 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46931a4-7cb7-443c-abaf-f927fcc65153 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:34.626498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46931a4-7cb7-443c-abaf-f927fcc65153 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:34.626840 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46931a4-7cb7-443c-abaf-f927fcc65153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:34.655172 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-e46931a4-7cb7-443c-abaf-f927fcc65153 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:50:34.657232 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-e46931a4-7cb7-443c-abaf-f927fcc65153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:50:34.768518 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 619/1234] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:50:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:50:34.804505 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f01b2e-b56e-460b-a7af-a93417feb3db None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:34.942035 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f01b2e-b56e-460b-a7af-a93417feb3db None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:34.983588 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2f8fa-017b-47c5-8b00-66044fb2dbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:34.984425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2f8fa-017b-47c5-8b00-66044fb2dbfd None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:34.984793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2f8fa-017b-47c5-8b00-66044fb2dbfd None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:34.985072 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2f8fa-017b-47c5-8b00-66044fb2dbfd None admin] PATH_INFO: `/v3/roles/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:34.995856 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2f8fa-017b-47c5-8b00-66044fb2dbfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:50:35.003893 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-8cb2f8fa-017b-47c5-8b00-66044fb2dbfd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 09 15:50:35.003893 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:35.003893 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:35.003893 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:35.003893 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:35.003893 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:35.003893 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:35.003893 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:35.003893 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:35.003893 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:35.003893 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:35.003893 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:35.003893 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:50:35.003893 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:50:35.003893 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:50:35.003893 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:50:35.005219 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:50:35.005219 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:50:35.005219 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:50:35.005219 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:50:35.005219 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:35.005219 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:35.005219 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:35.005219 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:35.005219 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:35.005219 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:35.005219 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:35.005219 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:50:35.005219 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:35.005219 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:35.005219 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:35.005219 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:35.006457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:35.006457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:35.006457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:35.006457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:35.006457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:50:35.006457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:50:35.006457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:50:35.006457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:50:35.006457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:50:35.006457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:50:35.006457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 09 15:50:35.006457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:50:35.006457 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 616/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Mon May 9 15:50:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:35.012368 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46931a4-7cb7-443c-abaf-f927fcc65153 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:35.122322 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46931a4-7cb7-443c-abaf-f927fcc65153 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:35.159938 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8ce57-adfc-42d2-af17-5c313f4d0c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:35.160703 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8ce57-adfc-42d2-af17-5c313f4d0c1b None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:35.160967 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8ce57-adfc-42d2-af17-5c313f4d0c1b None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:35.161247 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8ce57-adfc-42d2-af17-5c313f4d0c1b None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:35.162101 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8ce57-adfc-42d2-af17-5c313f4d0c1b None admin] RBAC: Adding query filter params (name=service) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:35.162454 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8ce57-adfc-42d2-af17-5c313f4d0c1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:35.163881 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8ce57-adfc-42d2-af17-5c313f4d0c1b None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:35.177991 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 620/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Mon May 9 15:50:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:35.179224 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2f8fa-017b-47c5-8b00-66044fb2dbfd None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:35.290288 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2f8fa-017b-47c5-8b00-66044fb2dbfd None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:35.325650 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df7942-d3d6-40e6-b056-d159c0712471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:35.326558 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df7942-d3d6-40e6-b056-d159c0712471 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:35.326875 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df7942-d3d6-40e6-b056-d159c0712471 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:35.327161 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df7942-d3d6-40e6-b056-d159c0712471 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:35.340053 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df7942-d3d6-40e6-b056-d159c0712471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:35.341600 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df7942-d3d6-40e6-b056-d159c0712471 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:35.360151 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-79df7942-d3d6-40e6-b056-d159c0712471 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:35.360151 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:35.360151 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:35.360151 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:35.360151 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:35.360151 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:35.360151 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:35.360151 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:35.360151 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:35.360151 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:35.360151 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:35.360151 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:35.360151 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:50:35.360151 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:50:35.360151 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:50:35.362017 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:50:35.362017 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:35.362017 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:35.362017 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:35.362017 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:35.362017 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:35.362017 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:35.362017 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:35.362017 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:50:35.362017 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:35.362017 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:35.362017 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:35.362017 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:35.362017 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:35.362017 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:35.362017 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:35.362017 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:35.363108 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:50:35.363108 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:50:35.363108 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:35.363108 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:50:35.363108 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 617/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:50:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:50:35.368295 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8ce57-adfc-42d2-af17-5c313f4d0c1b None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:35.476723 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8ce57-adfc-42d2-af17-5c313f4d0c1b None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:35.510428 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8b84e-3bbb-4dfb-9cbb-e3dab7e0d4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:35.511092 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8b84e-3bbb-4dfb-9cbb-e3dab7e0d4f8 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:35.511364 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8b84e-3bbb-4dfb-9cbb-e3dab7e0d4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:35.511638 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8b84e-3bbb-4dfb-9cbb-e3dab7e0d4f8 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:35.512366 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8b84e-3bbb-4dfb-9cbb-e3dab7e0d4f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:35.512671 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8b84e-3bbb-4dfb-9cbb-e3dab7e0d4f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:35.514064 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8b84e-3bbb-4dfb-9cbb-e3dab7e0d4f8 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:35.525769 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 621/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:35.531611 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df7942-d3d6-40e6-b056-d159c0712471 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:35.642163 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df7942-d3d6-40e6-b056-d159c0712471 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:35.679410 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677481dd-5aa1-4267-8035-b103549a4f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:35.681075 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677481dd-5aa1-4267-8035-b103549a4f44 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:35.681456 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677481dd-5aa1-4267-8035-b103549a4f44 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:35.681740 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677481dd-5aa1-4267-8035-b103549a4f44 None admin] PATH_INFO: `/v3/users/placement` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:35.689438 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677481dd-5aa1-4267-8035-b103549a4f44 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:35.690874 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677481dd-5aa1-4267-8035-b103549a4f44 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:35.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-677481dd-5aa1-4267-8035-b103549a4f44 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:50:35.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:35.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:35.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:35.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:35.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:35.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:35.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:35.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:35.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:35.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:35.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:35.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:50:35.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:50:35.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:50:35.705930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:50:35.707241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:35.707241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:35.707241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:50:35.707241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:50:35.707241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:50:35.707241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:50:35.707241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:35.707241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:35.707241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:35.707241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:35.707241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:35.707241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:50:35.707241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:35.707241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:35.707241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:35.707241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:35.707241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:35.707241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:35.708494 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:35.708494 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:35.708494 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:50:35.708494 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:50:35.708494 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:50:35.708494 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:50:35.708494 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:50:35.708494 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:50:35.708494 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:50:35.708494 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:50:35.708494 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 618/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:50:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:35.714179 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8b84e-3bbb-4dfb-9cbb-e3dab7e0d4f8 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:35.828336 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8b84e-3bbb-4dfb-9cbb-e3dab7e0d4f8 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:35.865625 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11238293-120c-414c-b842-9872127a9ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:35.866299 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11238293-120c-414c-b842-9872127a9ace None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:35.866699 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11238293-120c-414c-b842-9872127a9ace None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:35.867038 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11238293-120c-414c-b842-9872127a9ace None admin] PATH_INFO: `/v3/users` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:35.868584 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11238293-120c-414c-b842-9872127a9ace None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:35.868892 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11238293-120c-414c-b842-9872127a9ace None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:35.870462 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11238293-120c-414c-b842-9872127a9ace None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:35.889763 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 622/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 9 15:50:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:35.896453 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677481dd-5aa1-4267-8035-b103549a4f44 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:36.012420 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677481dd-5aa1-4267-8035-b103549a4f44 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:36.051352 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ecfe5-b1ea-44fa-b5d5-232f586a1bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:36.052206 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ecfe5-b1ea-44fa-b5d5-232f586a1bd1 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:36.052568 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ecfe5-b1ea-44fa-b5d5-232f586a1bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:36.053104 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ecfe5-b1ea-44fa-b5d5-232f586a1bd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:36.126739 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ecfe5-b1ea-44fa-b5d5-232f586a1bd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:36.128266 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ecfe5-b1ea-44fa-b5d5-232f586a1bd1 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:36.248252 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 619/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:50:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:50:36.249795 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11238293-120c-414c-b842-9872127a9ace None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:36.357742 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11238293-120c-414c-b842-9872127a9ace None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:36.393896 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33b4f6-18e9-4b01-bf15-132c4348cf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:36.394697 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33b4f6-18e9-4b01-bf15-132c4348cf06 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:36.395038 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33b4f6-18e9-4b01-bf15-132c4348cf06 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:36.395340 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33b4f6-18e9-4b01-bf15-132c4348cf06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:36.406342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33b4f6-18e9-4b01-bf15-132c4348cf06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:36.407842 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33b4f6-18e9-4b01-bf15-132c4348cf06 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:36.426343 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-8a33b4f6-18e9-4b01-bf15-132c4348cf06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:36.426343 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:36.426343 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:36.426343 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:36.426343 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:36.426343 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:36.426343 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:36.426343 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:36.426343 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:36.426343 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:36.426343 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:36.426343 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:36.426343 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:50:36.426343 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:50:36.426343 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:50:36.427663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:50:36.427663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:36.427663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:36.427663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:36.427663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:36.427663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:36.427663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:36.427663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:36.427663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:50:36.427663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:36.427663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:36.427663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:36.427663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:36.427663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:36.427663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:36.427663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:36.427663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:36.428867 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:50:36.428867 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:50:36.428867 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:36.428867 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:50:36.428867 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 623/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:36.434714 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ecfe5-b1ea-44fa-b5d5-232f586a1bd1 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:36.551858 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ecfe5-b1ea-44fa-b5d5-232f586a1bd1 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:36.589897 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade52e7-87ac-4a0e-a190-f361f24bf9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:36.590638 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade52e7-87ac-4a0e-a190-f361f24bf9a4 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:36.591051 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade52e7-87ac-4a0e-a190-f361f24bf9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:36.591427 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade52e7-87ac-4a0e-a190-f361f24bf9a4 None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:36.592270 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade52e7-87ac-4a0e-a190-f361f24bf9a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:36.592586 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade52e7-87ac-4a0e-a190-f361f24bf9a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:36.593986 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade52e7-87ac-4a0e-a190-f361f24bf9a4 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:36.607266 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 620/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:36.613658 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33b4f6-18e9-4b01-bf15-132c4348cf06 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:36.722082 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33b4f6-18e9-4b01-bf15-132c4348cf06 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:36.766101 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d1fdc-5d9f-4784-8000-9bf089516a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:36.766986 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d1fdc-5d9f-4784-8000-9bf089516a72 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:36.767375 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d1fdc-5d9f-4784-8000-9bf089516a72 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:36.767718 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d1fdc-5d9f-4784-8000-9bf089516a72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:36.775995 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d1fdc-5d9f-4784-8000-9bf089516a72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:36.777500 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d1fdc-5d9f-4784-8000-9bf089516a72 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:36.793306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-d37d1fdc-5d9f-4784-8000-9bf089516a72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:50:36.793306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:36.793306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:36.793306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:36.793306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:36.793306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:36.793306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:36.793306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:36.793306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:36.793306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:36.793306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:36.793306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:36.793306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:50:36.793306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:50:36.793306 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:50:36.794578 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:50:36.794578 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:36.794578 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:36.794578 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:36.794578 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:36.794578 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:36.794578 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:36.794578 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:36.794578 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:50:36.794578 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:36.794578 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:36.794578 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:36.794578 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:36.794578 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:36.794578 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:36.794578 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:36.794578 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:36.796047 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:50:36.796047 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:50:36.796047 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:50:36.796047 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:50:36.796047 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:50:36.796047 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:50:36.796047 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:50:36.796047 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:50:36.796047 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 624/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:50:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:36.800897 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade52e7-87ac-4a0e-a190-f361f24bf9a4 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:36.917557 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade52e7-87ac-4a0e-a190-f361f24bf9a4 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:36.953194 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d733dc-3a54-447f-908b-871f02843c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:36.953985 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d733dc-3a54-447f-908b-871f02843c2e None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:36.954276 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d733dc-3a54-447f-908b-871f02843c2e None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:36.954594 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d733dc-3a54-447f-908b-871f02843c2e None admin] PATH_INFO: `/v3/projects` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:36.955428 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d733dc-3a54-447f-908b-871f02843c2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:36.955772 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d733dc-3a54-447f-908b-871f02843c2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:36.957235 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d733dc-3a54-447f-908b-871f02843c2e None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:36.970342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 621/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:50:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:36.979250 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d1fdc-5d9f-4784-8000-9bf089516a72 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:37.095420 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d1fdc-5d9f-4784-8000-9bf089516a72 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:37.132751 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599ca91-d00d-4584-9f9f-ad1628e6c354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:37.133530 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599ca91-d00d-4584-9f9f-ad1628e6c354 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:37.133879 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599ca91-d00d-4584-9f9f-ad1628e6c354 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:37.134141 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599ca91-d00d-4584-9f9f-ad1628e6c354 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:37.135066 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599ca91-d00d-4584-9f9f-ad1628e6c354 None admin] RBAC: Adding query filter params (role.id=a6f10c1ca57b4299bb809b5bcc8797f5, scope.project.id=7860d281acf642d2a3950424901b9487, user.id=9ea084f29c9445658b2efc3f5e742b51) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:37.135427 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599ca91-d00d-4584-9f9f-ad1628e6c354 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:37.136897 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599ca91-d00d-4584-9f9f-ad1628e6c354 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:37.143658 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 625/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:50:36 2022] GET /identity/v3/role_assignments?user.id=9ea084f29c9445658b2efc3f5e742b51&scope.project.id=7860d281acf642d2a3950424901b9487&role.id=a6f10c1ca57b4299bb809b5bcc8797f5 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 09 15:50:39.636363 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc1849-abfd-471f-a311-f1f9a245ef27 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:39.636928 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc1849-abfd-471f-a311-f1f9a245ef27 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:39.637191 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc1849-abfd-471f-a311-f1f9a245ef27 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:39.640159 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 622/1247] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:50:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:50:39.652889 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dbb57-2092-4278-acf1-7c9c02afb4db None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:39.653645 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dbb57-2092-4278-acf1-7c9c02afb4db None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:39.653645 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dbb57-2092-4278-acf1-7c9c02afb4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:39.675964 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-854dbb57-2092-4278-acf1-7c9c02afb4db None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:50:39.677400 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-854dbb57-2092-4278-acf1-7c9c02afb4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:50:39.774888 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 626/1248] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:50:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:50:39.809526 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc1849-abfd-471f-a311-f1f9a245ef27 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:39.971907 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc1849-abfd-471f-a311-f1f9a245ef27 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:40.013099 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74885ff7-8539-4f67-a448-7f5fb19e8066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:40.013937 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74885ff7-8539-4f67-a448-7f5fb19e8066 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:40.014223 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74885ff7-8539-4f67-a448-7f5fb19e8066 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:40.014502 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74885ff7-8539-4f67-a448-7f5fb19e8066 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:40.026087 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74885ff7-8539-4f67-a448-7f5fb19e8066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:50:40.034381 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-74885ff7-8539-4f67-a448-7f5fb19e8066 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:50:40.034381 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:40.034381 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:40.034381 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:40.034381 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:40.034381 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:40.034381 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:40.034381 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:40.034381 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:40.034381 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:40.034381 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:40.034381 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:40.034381 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:50:40.034381 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:50:40.034381 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:50:40.034381 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:50:40.035923 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:50:40.035923 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:50:40.035923 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:50:40.035923 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:50:40.035923 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:40.035923 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:40.035923 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:40.035923 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:40.035923 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:40.035923 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:40.035923 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:40.035923 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:50:40.035923 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:40.035923 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:40.035923 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:40.035923 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:40.037513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:40.037513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:40.037513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:40.037513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:40.037513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:50:40.037513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:50:40.037513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:50:40.037513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:50:40.037513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:50:40.037513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:50:40.037513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:50:40.037513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:50:40.037513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 623/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:50:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:40.043183 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dbb57-2092-4278-acf1-7c9c02afb4db None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:40.170541 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dbb57-2092-4278-acf1-7c9c02afb4db None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:40.219423 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96d788-3ebf-47d9-a4df-bbcb214ac6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:40.220126 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96d788-3ebf-47d9-a4df-bbcb214ac6b4 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:40.220407 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96d788-3ebf-47d9-a4df-bbcb214ac6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:40.220717 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96d788-3ebf-47d9-a4df-bbcb214ac6b4 None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:40.221674 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96d788-3ebf-47d9-a4df-bbcb214ac6b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:40.221887 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96d788-3ebf-47d9-a4df-bbcb214ac6b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:40.223646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96d788-3ebf-47d9-a4df-bbcb214ac6b4 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:40.235443 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 627/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:50:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:40.243091 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74885ff7-8539-4f67-a448-7f5fb19e8066 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:40.361494 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74885ff7-8539-4f67-a448-7f5fb19e8066 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:40.400343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6517b-4d18-48fd-a020-242e86ce076f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:40.401203 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6517b-4d18-48fd-a020-242e86ce076f None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:40.401527 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6517b-4d18-48fd-a020-242e86ce076f None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:40.401816 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6517b-4d18-48fd-a020-242e86ce076f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:40.413831 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6517b-4d18-48fd-a020-242e86ce076f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:40.415408 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6517b-4d18-48fd-a020-242e86ce076f None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:40.435294 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-b4d6517b-4d18-48fd-a020-242e86ce076f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:40.435294 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:40.435294 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:40.435294 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:40.435294 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:40.435294 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:40.435294 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:40.435294 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:40.435294 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:40.435294 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:40.435294 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:40.435294 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:40.435294 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:50:40.435294 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:50:40.435294 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:50:40.436723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:50:40.436723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:40.436723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:40.436723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:40.436723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:40.436723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:40.436723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:40.436723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:40.436723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:50:40.436723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:40.436723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:40.436723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:40.436723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:40.436723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:40.436723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:40.436723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:40.436723 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:40.437852 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:50:40.437852 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:50:40.437852 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:40.437852 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:50:40.437852 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 624/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:50:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:50:40.442953 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96d788-3ebf-47d9-a4df-bbcb214ac6b4 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:40.557934 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96d788-3ebf-47d9-a4df-bbcb214ac6b4 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:40.596781 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5b026-d2f3-4ccc-b8f7-564fb45b246e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:40.597495 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5b026-d2f3-4ccc-b8f7-564fb45b246e None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:40.597780 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5b026-d2f3-4ccc-b8f7-564fb45b246e None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:40.598056 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5b026-d2f3-4ccc-b8f7-564fb45b246e None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:40.598910 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5b026-d2f3-4ccc-b8f7-564fb45b246e None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:40.599253 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5b026-d2f3-4ccc-b8f7-564fb45b246e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:40.600666 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5b026-d2f3-4ccc-b8f7-564fb45b246e None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:40.617416 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 628/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:40.621097 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6517b-4d18-48fd-a020-242e86ce076f None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:40.737050 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6517b-4d18-48fd-a020-242e86ce076f None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:40.774465 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad8bd3-f4ad-4a75-837a-448194ddba72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:40.775440 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad8bd3-f4ad-4a75-837a-448194ddba72 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:40.775746 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad8bd3-f4ad-4a75-837a-448194ddba72 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:40.776026 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad8bd3-f4ad-4a75-837a-448194ddba72 None admin] PATH_INFO: `/v3/users/placement` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:40.788216 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad8bd3-f4ad-4a75-837a-448194ddba72 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:40.790402 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad8bd3-f4ad-4a75-837a-448194ddba72 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:40.806644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-12ad8bd3-f4ad-4a75-837a-448194ddba72 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:50:40.806644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:40.806644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:40.806644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:40.806644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:40.806644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:40.806644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:40.806644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:40.806644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:40.806644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:40.806644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:40.806644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:40.806644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:50:40.806644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:50:40.806644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:50:40.806644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:50:40.808201 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:40.808201 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:40.808201 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:50:40.808201 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:50:40.808201 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:50:40.808201 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:50:40.808201 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:40.808201 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:40.808201 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:40.808201 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:40.808201 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:40.808201 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:50:40.808201 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:40.808201 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:40.808201 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:40.808201 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:40.808201 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:40.808201 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:40.810343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:40.810343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:40.810343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:50:40.810343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:50:40.810343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:50:40.810343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:50:40.810343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:50:40.810343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:50:40.810343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:50:40.810343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:50:40.810343 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 625/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:50:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:40.814195 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5b026-d2f3-4ccc-b8f7-564fb45b246e None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:40.965993 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5b026-d2f3-4ccc-b8f7-564fb45b246e None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:41.004609 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed7c50-fa60-4d9d-b0c9-6ca5444505d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:41.005838 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed7c50-fa60-4d9d-b0c9-6ca5444505d0 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:41.006486 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed7c50-fa60-4d9d-b0c9-6ca5444505d0 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:41.006846 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed7c50-fa60-4d9d-b0c9-6ca5444505d0 None admin] PATH_INFO: `/v3/users` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:41.008516 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed7c50-fa60-4d9d-b0c9-6ca5444505d0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:41.008913 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed7c50-fa60-4d9d-b0c9-6ca5444505d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:41.010742 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed7c50-fa60-4d9d-b0c9-6ca5444505d0 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:41.035820 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 629/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 9 15:50:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:41.043355 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad8bd3-f4ad-4a75-837a-448194ddba72 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:41.168052 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad8bd3-f4ad-4a75-837a-448194ddba72 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:41.221211 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b17ba-5b3c-4348-8550-adab816435c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:41.222121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b17ba-5b3c-4348-8550-adab816435c0 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:41.222433 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b17ba-5b3c-4348-8550-adab816435c0 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:41.222738 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b17ba-5b3c-4348-8550-adab816435c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:41.306399 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b17ba-5b3c-4348-8550-adab816435c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:41.308180 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b17ba-5b3c-4348-8550-adab816435c0 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:41.423608 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 626/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:50:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:50:41.424815 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed7c50-fa60-4d9d-b0c9-6ca5444505d0 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:41.534761 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed7c50-fa60-4d9d-b0c9-6ca5444505d0 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:41.574998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235ccd5-6554-4263-8d9b-fc800c7fa997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:41.575942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235ccd5-6554-4263-8d9b-fc800c7fa997 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:41.576227 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235ccd5-6554-4263-8d9b-fc800c7fa997 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:41.576529 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235ccd5-6554-4263-8d9b-fc800c7fa997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:41.587484 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235ccd5-6554-4263-8d9b-fc800c7fa997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:41.588896 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235ccd5-6554-4263-8d9b-fc800c7fa997 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:41.607587 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-8235ccd5-6554-4263-8d9b-fc800c7fa997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:41.607587 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:41.607587 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:41.607587 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:41.607587 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:41.607587 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:41.607587 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:41.607587 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:41.607587 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:41.607587 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:41.607587 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:41.607587 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:41.607587 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:50:41.607587 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:50:41.607587 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:50:41.608922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:50:41.608922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:41.608922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:41.608922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:41.608922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:41.608922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:41.608922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:41.608922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:41.608922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:50:41.608922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:41.608922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:41.608922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:41.608922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:41.608922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:41.608922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:41.608922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:41.608922 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:41.610240 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:50:41.610240 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:50:41.610240 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:41.610240 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:50:41.613746 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 630/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:50:41.614879 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b17ba-5b3c-4348-8550-adab816435c0 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:41.724486 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b17ba-5b3c-4348-8550-adab816435c0 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:41.765963 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a3628-b89c-402e-914b-00f62d2d06c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:41.767110 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a3628-b89c-402e-914b-00f62d2d06c8 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:41.767110 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a3628-b89c-402e-914b-00f62d2d06c8 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:41.767450 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a3628-b89c-402e-914b-00f62d2d06c8 None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:41.768008 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a3628-b89c-402e-914b-00f62d2d06c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:41.768324 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a3628-b89c-402e-914b-00f62d2d06c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:41.769771 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a3628-b89c-402e-914b-00f62d2d06c8 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:41.788029 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 627/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:41.790016 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235ccd5-6554-4263-8d9b-fc800c7fa997 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:41.908787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235ccd5-6554-4263-8d9b-fc800c7fa997 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:41.948569 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9ffd9-c269-4481-98e2-c08f3202949c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:41.949543 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9ffd9-c269-4481-98e2-c08f3202949c None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:41.949889 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9ffd9-c269-4481-98e2-c08f3202949c None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:41.950172 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9ffd9-c269-4481-98e2-c08f3202949c None admin] PATH_INFO: `/v3/projects/service` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:41.958305 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9ffd9-c269-4481-98e2-c08f3202949c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:41.959798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9ffd9-c269-4481-98e2-c08f3202949c None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:41.975998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-7ba9ffd9-c269-4481-98e2-c08f3202949c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:50:41.975998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:41.975998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:41.975998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:41.975998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:41.975998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:41.975998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:41.975998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:41.975998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:41.975998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:41.975998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:41.975998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:41.975998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:50:41.975998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:50:41.975998 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:50:41.978154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:50:41.978154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:41.978154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:41.978154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:41.978154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:41.978154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:41.978154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:41.978154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:41.978154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:50:41.978154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:41.978154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:41.978154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:41.978154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:41.978154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:41.978154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:41.978154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:41.978154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:41.979527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:50:41.979527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:50:41.979527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:50:41.979527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:50:41.979527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:50:41.979527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:50:41.979527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:50:41.979527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:50:41.979527 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 631/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:50:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:41.984263 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a3628-b89c-402e-914b-00f62d2d06c8 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:42.095877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a3628-b89c-402e-914b-00f62d2d06c8 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:42.137244 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0c9b7-59e5-417f-b160-51633137bc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:42.137963 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0c9b7-59e5-417f-b160-51633137bc3c None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:42.138241 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0c9b7-59e5-417f-b160-51633137bc3c None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:42.138517 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0c9b7-59e5-417f-b160-51633137bc3c None admin] PATH_INFO: `/v3/projects` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:42.139349 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0c9b7-59e5-417f-b160-51633137bc3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:42.139665 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0c9b7-59e5-417f-b160-51633137bc3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:42.141181 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0c9b7-59e5-417f-b160-51633137bc3c None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:42.161425 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 628/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:50:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:42.163008 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9ffd9-c269-4481-98e2-c08f3202949c None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:42.280413 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9ffd9-c269-4481-98e2-c08f3202949c None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:42.318342 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f6d85-9634-47b0-8a49-afc6d054c31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:42.319113 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f6d85-9634-47b0-8a49-afc6d054c31b None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:42.319385 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f6d85-9634-47b0-8a49-afc6d054c31b None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:42.319696 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f6d85-9634-47b0-8a49-afc6d054c31b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:42.321087 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f6d85-9634-47b0-8a49-afc6d054c31b None admin] RBAC: Adding query filter params (role.id=2180d183afad443187521833c40ed8a1, scope.project.id=7860d281acf642d2a3950424901b9487, user.id=9ea084f29c9445658b2efc3f5e742b51) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:42.321458 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f6d85-9634-47b0-8a49-afc6d054c31b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:42.323128 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f6d85-9634-47b0-8a49-afc6d054c31b None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:42.329171 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 632/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:50:42 2022] GET /identity/v3/role_assignments?user.id=9ea084f29c9445658b2efc3f5e742b51&scope.project.id=7860d281acf642d2a3950424901b9487&role.id=2180d183afad443187521833c40ed8a1 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:44.729816 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb28e4b-6152-40ac-b06a-9511ebfdca76 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:44.730410 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb28e4b-6152-40ac-b06a-9511ebfdca76 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:44.730410 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb28e4b-6152-40ac-b06a-9511ebfdca76 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:44.731759 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 629/1261] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:50:44.737759 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229ad06-9682-4392-aed2-4dfc5ee82dae None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:44.738349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229ad06-9682-4392-aed2-4dfc5ee82dae None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:44.738349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229ad06-9682-4392-aed2-4dfc5ee82dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:44.756044 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-c229ad06-9682-4392-aed2-4dfc5ee82dae None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:50:44.757267 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-c229ad06-9682-4392-aed2-4dfc5ee82dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:50:44.827007 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 633/1262] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:50:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:50:44.850985 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb28e4b-6152-40ac-b06a-9511ebfdca76 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:44.962949 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb28e4b-6152-40ac-b06a-9511ebfdca76 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:45.000054 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb455e9-aa5a-4011-bc7d-d5b902942685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:45.001102 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb455e9-aa5a-4011-bc7d-d5b902942685 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:45.001422 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb455e9-aa5a-4011-bc7d-d5b902942685 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:45.001707 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb455e9-aa5a-4011-bc7d-d5b902942685 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:45.013849 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb455e9-aa5a-4011-bc7d-d5b902942685 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:50:45.021644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-1fb455e9-aa5a-4011-bc7d-d5b902942685 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:50:45.021644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:45.021644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:45.021644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:45.021644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:45.021644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:45.021644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:45.021644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:45.021644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:45.021644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:45.021644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:45.021644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:45.021644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:50:45.021644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:50:45.021644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:50:45.021644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:50:45.022979 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:50:45.022979 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:50:45.022979 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:50:45.022979 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:50:45.022979 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:45.022979 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:45.022979 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:45.022979 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:45.022979 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:45.022979 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:45.022979 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:45.022979 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:50:45.022979 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:45.022979 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:45.022979 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:45.022979 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:45.025267 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:45.025267 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:45.025267 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:45.025267 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:45.025267 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:50:45.025267 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:50:45.025267 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:50:45.025267 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:50:45.025267 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:50:45.025267 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:50:45.025267 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:50:45.025267 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:50:45.025267 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 630/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:50:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:45.029964 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229ad06-9682-4392-aed2-4dfc5ee82dae None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:45.138293 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229ad06-9682-4392-aed2-4dfc5ee82dae None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:45.205931 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbf52c-0b8a-476c-ac1e-302fc56e9d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:45.206654 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbf52c-0b8a-476c-ac1e-302fc56e9d1a None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:45.207078 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbf52c-0b8a-476c-ac1e-302fc56e9d1a None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:45.207226 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbf52c-0b8a-476c-ac1e-302fc56e9d1a None admin] PATH_INFO: `/v3/roles` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:45.208154 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fbf52c-0b8a-476c-ac1e-302fc56e9d1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:45.208672 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fbf52c-0b8a-476c-ac1e-302fc56e9d1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:45.210016 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fbf52c-0b8a-476c-ac1e-302fc56e9d1a None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:45.222697 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 634/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:50:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:45.235312 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb455e9-aa5a-4011-bc7d-d5b902942685 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:45.375468 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb455e9-aa5a-4011-bc7d-d5b902942685 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:45.411889 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e852bb5-a156-49ac-8b71-acec54ab603c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:45.412686 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e852bb5-a156-49ac-8b71-acec54ab603c None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:45.412975 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e852bb5-a156-49ac-8b71-acec54ab603c None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:45.413261 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e852bb5-a156-49ac-8b71-acec54ab603c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:45.424137 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e852bb5-a156-49ac-8b71-acec54ab603c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:45.425610 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e852bb5-a156-49ac-8b71-acec54ab603c None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:45.442562 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-7e852bb5-a156-49ac-8b71-acec54ab603c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:45.442562 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:45.442562 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:45.442562 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:45.442562 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:45.442562 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:45.442562 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:45.442562 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:45.442562 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:45.442562 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:45.442562 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:45.442562 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:45.442562 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:50:45.442562 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:50:45.442562 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:50:45.443782 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:50:45.443782 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:45.443782 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:45.443782 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:45.443782 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:45.443782 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:45.443782 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:45.443782 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:45.443782 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:50:45.443782 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:45.443782 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:45.443782 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:45.443782 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:45.443782 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:45.443782 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:45.443782 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:45.443782 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:45.445009 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:50:45.445009 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:50:45.445009 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:45.445009 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:50:45.445009 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 631/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:45.450658 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbf52c-0b8a-476c-ac1e-302fc56e9d1a None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:45.548286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbf52c-0b8a-476c-ac1e-302fc56e9d1a None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:45.581386 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5886d4-ddb5-4332-8816-454346dee9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:45.582061 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5886d4-ddb5-4332-8816-454346dee9f8 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:45.582347 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5886d4-ddb5-4332-8816-454346dee9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:45.582628 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5886d4-ddb5-4332-8816-454346dee9f8 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:45.583361 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5886d4-ddb5-4332-8816-454346dee9f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:45.583671 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5886d4-ddb5-4332-8816-454346dee9f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:45.585033 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5886d4-ddb5-4332-8816-454346dee9f8 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:45.598202 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 635/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:45.604419 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e852bb5-a156-49ac-8b71-acec54ab603c None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:45.710583 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e852bb5-a156-49ac-8b71-acec54ab603c None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:45.749353 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac66eca-6282-43d1-b895-f4fe7f653626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:45.750185 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac66eca-6282-43d1-b895-f4fe7f653626 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:45.750473 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac66eca-6282-43d1-b895-f4fe7f653626 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:45.750751 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac66eca-6282-43d1-b895-f4fe7f653626 None admin] PATH_INFO: `/v3/users/placement` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:45.759776 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac66eca-6282-43d1-b895-f4fe7f653626 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:45.761215 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac66eca-6282-43d1-b895-f4fe7f653626 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:45.776353 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-eac66eca-6282-43d1-b895-f4fe7f653626 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:50:45.776353 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:45.776353 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:45.776353 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:45.776353 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:45.776353 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:45.776353 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:45.776353 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:45.776353 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:45.776353 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:45.776353 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:45.776353 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:45.776353 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:50:45.776353 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:50:45.776353 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:50:45.776353 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:50:45.777877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:45.777877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:45.777877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:50:45.777877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:50:45.777877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:50:45.777877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:50:45.777877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:45.777877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:45.777877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:45.777877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:45.777877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:45.777877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:50:45.777877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:45.777877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:45.777877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:45.777877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:45.777877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:45.777877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:45.779344 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:45.779344 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:45.779344 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:50:45.779344 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:50:45.779344 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:50:45.779344 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:50:45.779344 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:50:45.779344 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:50:45.779344 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:50:45.779344 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:50:45.779344 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 632/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:50:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:45.783504 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5886d4-ddb5-4332-8816-454346dee9f8 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:45.883957 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5886d4-ddb5-4332-8816-454346dee9f8 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:45.916283 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e0f1a-2928-407e-8ae4-116f6e35b2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:45.916942 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e0f1a-2928-407e-8ae4-116f6e35b2d8 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:45.917229 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e0f1a-2928-407e-8ae4-116f6e35b2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:45.917551 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e0f1a-2928-407e-8ae4-116f6e35b2d8 None admin] PATH_INFO: `/v3/users` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:45.918396 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e0f1a-2928-407e-8ae4-116f6e35b2d8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:45.918708 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e0f1a-2928-407e-8ae4-116f6e35b2d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:45.920128 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e0f1a-2928-407e-8ae4-116f6e35b2d8 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:45.936945 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 636/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 9 15:50:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:45.942595 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac66eca-6282-43d1-b895-f4fe7f653626 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:46.037866 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac66eca-6282-43d1-b895-f4fe7f653626 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:46.070524 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434a311-1ec6-466a-9ee3-de45f5a7951c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:46.071295 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434a311-1ec6-466a-9ee3-de45f5a7951c None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:46.071580 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434a311-1ec6-466a-9ee3-de45f5a7951c None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:46.071862 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434a311-1ec6-466a-9ee3-de45f5a7951c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:46.081904 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434a311-1ec6-466a-9ee3-de45f5a7951c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:46.083337 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434a311-1ec6-466a-9ee3-de45f5a7951c None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:46.099744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-b434a311-1ec6-466a-9ee3-de45f5a7951c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:46.099744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:46.099744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:46.099744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:46.099744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:46.099744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:46.099744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:46.099744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:46.099744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:46.099744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:46.099744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:46.099744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:46.099744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:50:46.099744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:50:46.099744 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:50:46.100969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:50:46.100969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:46.100969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:46.100969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:46.100969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:46.100969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:46.100969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:46.100969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:46.100969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:50:46.100969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:46.100969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:46.100969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:46.100969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:46.100969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:46.100969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:46.100969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:46.100969 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:46.103175 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:50:46.103175 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:50:46.103175 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:46.103175 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:50:46.103175 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 633/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:46.107142 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e0f1a-2928-407e-8ae4-116f6e35b2d8 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:46.211140 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e0f1a-2928-407e-8ae4-116f6e35b2d8 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:46.244339 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050a714-0a32-4ef2-bcc1-91825ff8f149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:46.245007 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050a714-0a32-4ef2-bcc1-91825ff8f149 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:46.245293 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050a714-0a32-4ef2-bcc1-91825ff8f149 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:46.245599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050a714-0a32-4ef2-bcc1-91825ff8f149 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:46.246328 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050a714-0a32-4ef2-bcc1-91825ff8f149 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:46.246638 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050a714-0a32-4ef2-bcc1-91825ff8f149 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:46.248002 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050a714-0a32-4ef2-bcc1-91825ff8f149 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:46.259003 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 637/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:46.264672 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434a311-1ec6-466a-9ee3-de45f5a7951c None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:46.360601 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434a311-1ec6-466a-9ee3-de45f5a7951c None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:46.392718 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908dbe3e-0c0a-4e66-a5ac-933a42c6ac42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:46.393525 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dbe3e-0c0a-4e66-a5ac-933a42c6ac42 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:46.393812 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dbe3e-0c0a-4e66-a5ac-933a42c6ac42 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:46.394087 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dbe3e-0c0a-4e66-a5ac-933a42c6ac42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:46.401493 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908dbe3e-0c0a-4e66-a5ac-933a42c6ac42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:46.402913 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908dbe3e-0c0a-4e66-a5ac-933a42c6ac42 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:46.417363 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-908dbe3e-0c0a-4e66-a5ac-933a42c6ac42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:50:46.417363 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:46.417363 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:46.417363 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:46.417363 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:46.417363 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:46.417363 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:46.417363 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:46.417363 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:46.417363 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:46.417363 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:46.417363 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:46.417363 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:50:46.417363 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:50:46.417363 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:50:46.418548 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:50:46.418548 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:46.418548 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:46.418548 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:46.418548 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:46.418548 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:46.418548 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:46.418548 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:46.418548 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:50:46.418548 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:46.418548 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:46.418548 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:46.418548 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:46.418548 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:46.418548 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:46.418548 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:46.418548 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:46.419658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:50:46.419658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:50:46.419658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:50:46.419658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:50:46.419658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:50:46.419658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:50:46.419658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:50:46.419658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:50:46.419658 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 634/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:50:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:46.424407 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050a714-0a32-4ef2-bcc1-91825ff8f149 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:46.520179 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050a714-0a32-4ef2-bcc1-91825ff8f149 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:46.553141 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcb1ed-e3ca-4fb9-b28f-c7f51b941cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:46.553834 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcb1ed-e3ca-4fb9-b28f-c7f51b941cae None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:46.554121 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcb1ed-e3ca-4fb9-b28f-c7f51b941cae None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:46.554396 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcb1ed-e3ca-4fb9-b28f-c7f51b941cae None admin] PATH_INFO: `/v3/projects` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:46.555373 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcb1ed-e3ca-4fb9-b28f-c7f51b941cae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:46.555683 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcb1ed-e3ca-4fb9-b28f-c7f51b941cae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:46.557101 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcb1ed-e3ca-4fb9-b28f-c7f51b941cae None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:46.568537 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 638/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:50:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:46.575036 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908dbe3e-0c0a-4e66-a5ac-933a42c6ac42 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:46.673217 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908dbe3e-0c0a-4e66-a5ac-933a42c6ac42 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:46.707618 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81f602-9247-4430-bbeb-55de40f9c137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:46.708505 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81f602-9247-4430-bbeb-55de40f9c137 None admin] REQUEST_METHOD: `PUT` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:46.708794 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81f602-9247-4430-bbeb-55de40f9c137 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:46.709075 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81f602-9247-4430-bbeb-55de40f9c137 None admin] PATH_INFO: `/v3/projects/7860d281acf642d2a3950424901b9487/users/9ea084f29c9445658b2efc3f5e742b51/roles/2180d183afad443187521833c40ed8a1` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:46.712034 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81f602-9247-4430-bbeb-55de40f9c137 None admin] RBAC: Authorizing `identity:create_grant(project_id=7860d281acf642d2a3950424901b9487, user_id=9ea084f29c9445658b2efc3f5e742b51, role_id=2180d183afad443187521833c40ed8a1)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:46.713503 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81f602-9247-4430-bbeb-55de40f9c137 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:46.725763 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 635/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Mon May 9 15:50:46 2022] PUT /identity/v3/projects/7860d281acf642d2a3950424901b9487/users/9ea084f29c9445658b2efc3f5e742b51/roles/2180d183afad443187521833c40ed8a1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 09 15:50:48.975070 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a37f6-0793-438b-951b-7fc7b724bc31 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:48.975686 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a37f6-0793-438b-951b-7fc7b724bc31 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:48.975686 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a37f6-0793-438b-951b-7fc7b724bc31 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:48.978059 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 639/1274] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:50:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:50:48.986520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dffb4c-2ba0-403c-a8cd-6ce7f2c4323c None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:48.987063 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dffb4c-2ba0-403c-a8cd-6ce7f2c4323c None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:48.987063 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dffb4c-2ba0-403c-a8cd-6ce7f2c4323c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:49.007365 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-01dffb4c-2ba0-403c-a8cd-6ce7f2c4323c None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:50:49.009060 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-01dffb4c-2ba0-403c-a8cd-6ce7f2c4323c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:50:49.082262 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 636/1275] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:50:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 09 15:50:49.106514 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a37f6-0793-438b-951b-7fc7b724bc31 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:49.213751 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a37f6-0793-438b-951b-7fc7b724bc31 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:49.250599 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da15b9e-fe5a-4636-86a6-5ea1998500ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:49.251569 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da15b9e-fe5a-4636-86a6-5ea1998500ec None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:49.251855 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da15b9e-fe5a-4636-86a6-5ea1998500ec None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:49.252133 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da15b9e-fe5a-4636-86a6-5ea1998500ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:49.262903 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da15b9e-fe5a-4636-86a6-5ea1998500ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 09 15:50:49.270607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-4da15b9e-fe5a-4636-86a6-5ea1998500ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:50:49.270607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:49.270607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:49.270607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:49.270607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:49.270607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:49.270607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:49.270607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:49.270607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:49.270607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:49.270607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:49.270607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:49.270607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 09 15:50:49.270607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(role_id) May 09 15:50:49.270607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 09 15:50:49.270607 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 09 15:50:49.271891 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 09 15:50:49.271891 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 09 15:50:49.271891 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 09 15:50:49.271891 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 09 15:50:49.271891 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:49.271891 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:49.271891 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:49.271891 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:49.271891 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:49.271891 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:49.271891 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:49.271891 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:50:49.271891 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:49.271891 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:49.271891 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:49.271891 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:49.273101 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:49.273101 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:49.273101 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:49.273101 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:49.273101 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 09 15:50:49.273101 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 09 15:50:49.273101 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 09 15:50:49.273101 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 09 15:50:49.273101 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 09 15:50:49.273101 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 09 15:50:49.273101 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 09 15:50:49.273101 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:50:49.273101 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 640/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Mon May 9 15:50:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:49.279001 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dffb4c-2ba0-403c-a8cd-6ce7f2c4323c None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:49.375229 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dffb4c-2ba0-403c-a8cd-6ce7f2c4323c None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:49.417585 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc174dc-5810-4e8b-be71-1eb544706cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:49.418270 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc174dc-5810-4e8b-be71-1eb544706cc0 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:49.418546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc174dc-5810-4e8b-be71-1eb544706cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:49.418821 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc174dc-5810-4e8b-be71-1eb544706cc0 None admin] PATH_INFO: `/v3/roles` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:49.419611 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc174dc-5810-4e8b-be71-1eb544706cc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:49.419898 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc174dc-5810-4e8b-be71-1eb544706cc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:49.421413 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc174dc-5810-4e8b-be71-1eb544706cc0 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:49.431116 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 637/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Mon May 9 15:50:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:49.436983 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da15b9e-fe5a-4636-86a6-5ea1998500ec None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:49.538906 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da15b9e-fe5a-4636-86a6-5ea1998500ec None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:49.571792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d21f7-b703-4027-adb6-014931e8f889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:49.572574 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d21f7-b703-4027-adb6-014931e8f889 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:49.572856 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d21f7-b703-4027-adb6-014931e8f889 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:49.573129 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d21f7-b703-4027-adb6-014931e8f889 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:49.583259 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d21f7-b703-4027-adb6-014931e8f889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:49.584691 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d21f7-b703-4027-adb6-014931e8f889 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:49.601002 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-ac7d21f7-b703-4027-adb6-014931e8f889 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:49.601002 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:49.601002 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:49.601002 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:49.601002 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:49.601002 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:49.601002 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:49.601002 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:49.601002 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:49.601002 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:49.601002 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:49.601002 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:49.601002 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:50:49.601002 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:50:49.601002 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:50:49.602433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:50:49.602433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:49.602433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:49.602433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:49.602433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:49.602433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:49.602433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:49.602433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:49.602433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:50:49.602433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:49.602433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:49.602433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:49.602433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:49.602433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:49.602433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:49.602433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:49.602433 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:49.603724 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:50:49.603724 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:50:49.603724 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:49.603724 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:50:49.603724 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 641/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:49.608362 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc174dc-5810-4e8b-be71-1eb544706cc0 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:49.706121 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc174dc-5810-4e8b-be71-1eb544706cc0 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:49.738570 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead7c96-b942-440d-9dac-e9f3bdad1a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:49.739234 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead7c96-b942-440d-9dac-e9f3bdad1a8a None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:49.739523 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead7c96-b942-440d-9dac-e9f3bdad1a8a None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:49.739806 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead7c96-b942-440d-9dac-e9f3bdad1a8a None admin] PATH_INFO: `/v3/domains` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:49.740536 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead7c96-b942-440d-9dac-e9f3bdad1a8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:49.740848 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead7c96-b942-440d-9dac-e9f3bdad1a8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:49.742754 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead7c96-b942-440d-9dac-e9f3bdad1a8a None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:49.755189 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 638/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:49.761733 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d21f7-b703-4027-adb6-014931e8f889 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:49.861022 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d21f7-b703-4027-adb6-014931e8f889 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:49.895136 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d98d36-c44c-496e-8793-311890ad101d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:49.895959 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d98d36-c44c-496e-8793-311890ad101d None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:49.896248 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d98d36-c44c-496e-8793-311890ad101d None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:49.896532 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d98d36-c44c-496e-8793-311890ad101d None admin] PATH_INFO: `/v3/users/placement` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:49.905985 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d98d36-c44c-496e-8793-311890ad101d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:49.907498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d98d36-c44c-496e-8793-311890ad101d None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:49.923551 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-e3d98d36-c44c-496e-8793-311890ad101d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 09 15:50:49.923551 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:49.923551 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:49.923551 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:49.923551 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:49.923551 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:49.923551 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:49.923551 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:49.923551 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:49.923551 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:49.923551 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:49.923551 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:49.923551 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 09 15:50:49.923551 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_user(user_id) May 09 15:50:49.923551 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 09 15:50:49.923551 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 09 15:50:49.924893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:49.924893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:49.924893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 09 15:50:49.924893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:50:49.924893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 09 15:50:49.924893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 09 15:50:49.924893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:49.924893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:49.924893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:49.924893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:49.924893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:49.924893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:50:49.924893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:49.924893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:49.924893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:49.924893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:49.924893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:49.924893 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:49.926151 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:49.926151 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:49.926151 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 09 15:50:49.926151 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 09 15:50:49.926151 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 09 15:50:49.926151 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 09 15:50:49.926151 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 09 15:50:49.926151 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 09 15:50:49.926151 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 09 15:50:49.926151 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:50:49.926151 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 642/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:50:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:49.931256 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead7c96-b942-440d-9dac-e9f3bdad1a8a None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:50.033194 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead7c96-b942-440d-9dac-e9f3bdad1a8a None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:50.083300 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd3b39-7492-4450-bd3d-a081a4f40c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:50.084515 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd3b39-7492-4450-bd3d-a081a4f40c62 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:50.085074 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd3b39-7492-4450-bd3d-a081a4f40c62 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:50.085645 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd3b39-7492-4450-bd3d-a081a4f40c62 None admin] PATH_INFO: `/v3/users` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:50.087199 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd3b39-7492-4450-bd3d-a081a4f40c62 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:50.087695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd3b39-7492-4450-bd3d-a081a4f40c62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:50.090405 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd3b39-7492-4450-bd3d-a081a4f40c62 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:50.109133 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 639/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Mon May 9 15:50:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:50.115074 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d98d36-c44c-496e-8793-311890ad101d None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:50.217875 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d98d36-c44c-496e-8793-311890ad101d None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:50.249931 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5521bde-d9b2-46d8-b75d-84708e9a998d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:50.250582 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5521bde-d9b2-46d8-b75d-84708e9a998d None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:50.251114 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5521bde-d9b2-46d8-b75d-84708e9a998d None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:50.251410 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5521bde-d9b2-46d8-b75d-84708e9a998d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:50.318037 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5521bde-d9b2-46d8-b75d-84708e9a998d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:50.319496 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5521bde-d9b2-46d8-b75d-84708e9a998d None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:50.416281 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 643/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Mon May 9 15:50:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 09 15:50:50.422236 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd3b39-7492-4450-bd3d-a081a4f40c62 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:50.521256 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd3b39-7492-4450-bd3d-a081a4f40c62 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:50.555670 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfcd01-c887-42ce-b741-a1a3bceb95d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:50.556464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfcd01-c887-42ce-b741-a1a3bceb95d7 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:50.556751 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfcd01-c887-42ce-b741-a1a3bceb95d7 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:50.557028 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfcd01-c887-42ce-b741-a1a3bceb95d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:50.566827 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bfcd01-c887-42ce-b741-a1a3bceb95d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:50.568259 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bfcd01-c887-42ce-b741-a1a3bceb95d7 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:50.587030 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-a0bfcd01-c887-42ce-b741-a1a3bceb95d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:50.587030 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:50.587030 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:50.587030 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:50.587030 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:50.587030 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:50.587030 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:50.587030 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:50.587030 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:50.587030 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:50.587030 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:50.587030 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:50.587030 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 09 15:50:50.587030 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 09 15:50:50.587030 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 09 15:50:50.588281 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 09 15:50:50.588281 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:50.588281 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:50.588281 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:50.588281 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:50.588281 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:50.588281 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:50.588281 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:50.588281 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:50:50.588281 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:50.588281 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:50.588281 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:50.588281 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:50.588281 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:50.588281 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:50.588281 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:50.588281 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:50.589801 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 09 15:50:50.589801 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 09 15:50:50.589801 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 09 15:50:50.589801 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:50:50.589801 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 640/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Mon May 9 15:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 09 15:50:50.594797 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5521bde-d9b2-46d8-b75d-84708e9a998d None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:50.693883 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5521bde-d9b2-46d8-b75d-84708e9a998d None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:50.728081 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012405f-4d92-4d17-8a6b-9bb3f259a182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:50.728735 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012405f-4d92-4d17-8a6b-9bb3f259a182 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:50.729019 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012405f-4d92-4d17-8a6b-9bb3f259a182 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:50.729297 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012405f-4d92-4d17-8a6b-9bb3f259a182 None admin] PATH_INFO: `/v3/domains` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:50.730061 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012405f-4d92-4d17-8a6b-9bb3f259a182 None admin] RBAC: Adding query filter params (name=Default) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:50.730363 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012405f-4d92-4d17-8a6b-9bb3f259a182 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:50.731726 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012405f-4d92-4d17-8a6b-9bb3f259a182 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:50.743042 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 644/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Mon May 9 15:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:50.748800 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfcd01-c887-42ce-b741-a1a3bceb95d7 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:50.849009 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfcd01-c887-42ce-b741-a1a3bceb95d7 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:50.881808 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c6dcc-f019-4093-b713-2e973e9c7d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:50.883109 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c6dcc-f019-4093-b713-2e973e9c7d11 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:50.883583 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c6dcc-f019-4093-b713-2e973e9c7d11 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:50.884015 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c6dcc-f019-4093-b713-2e973e9c7d11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:50.890647 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c6dcc-f019-4093-b713-2e973e9c7d11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:50.892087 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c6dcc-f019-4093-b713-2e973e9c7d11 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:50.906520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application [None req-793c6dcc-f019-4093-b713-2e973e9c7d11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:50:50.906520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:50.906520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:50.906520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:50.906520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:50.906520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:50.906520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:50.906520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:50.906520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:50.906520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:50.906520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:50.906520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:50.906520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 09 15:50:50.906520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(project_id) May 09 15:50:50.906520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 09 15:50:50.907820 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 09 15:50:50.907820 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:50.907820 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:50.907820 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:50.907820 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:50.907820 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:50.907820 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:50.907820 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:50.907820 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application with Lock( May 09 15:50:50.907820 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:50.907820 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:50.907820 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:50.907820 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:50.907820 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:50.907820 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:50.907820 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:50.907820 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:50.909271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 09 15:50:50.909271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 09 15:50:50.909271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 09 15:50:50.909271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 09 15:50:50.909271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 09 15:50:50.909271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 09 15:50:50.909271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 09 15:50:50.909271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: ERROR keystone.server.flask.application May 09 15:50:50.909271 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 641/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Mon May 9 15:50:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:50.913588 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012405f-4d92-4d17-8a6b-9bb3f259a182 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:51.009070 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012405f-4d92-4d17-8a6b-9bb3f259a182 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:51.041520 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb93a31-e9d7-43ac-9ecb-c3e8aa123750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:51.042161 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb93a31-e9d7-43ac-9ecb-c3e8aa123750 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:51.042441 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb93a31-e9d7-43ac-9ecb-c3e8aa123750 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:51.042714 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb93a31-e9d7-43ac-9ecb-c3e8aa123750 None admin] PATH_INFO: `/v3/projects` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:51.043497 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb93a31-e9d7-43ac-9ecb-c3e8aa123750 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:51.043802 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb93a31-e9d7-43ac-9ecb-c3e8aa123750 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:51.045233 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb93a31-e9d7-43ac-9ecb-c3e8aa123750 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:51.056992 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 645/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Mon May 9 15:50:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:51.062990 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c6dcc-f019-4093-b713-2e973e9c7d11 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:51.161226 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c6dcc-f019-4093-b713-2e973e9c7d11 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:51.196673 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89b155-7548-4f9a-965f-a2067bbc8b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:51.197327 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89b155-7548-4f9a-965f-a2067bbc8b9f None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:51.197637 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89b155-7548-4f9a-965f-a2067bbc8b9f None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:51.197911 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89b155-7548-4f9a-965f-a2067bbc8b9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:51.198830 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89b155-7548-4f9a-965f-a2067bbc8b9f None admin] RBAC: Adding query filter params (role.id=2180d183afad443187521833c40ed8a1, scope.project.id=7860d281acf642d2a3950424901b9487, user.id=9ea084f29c9445658b2efc3f5e742b51) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:51.199181 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89b155-7548-4f9a-965f-a2067bbc8b9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:51.200915 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89b155-7548-4f9a-965f-a2067bbc8b9f None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:51.206629 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 642/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Mon May 9 15:50:51 2022] GET /identity/v3/role_assignments?user.id=9ea084f29c9445658b2efc3f5e742b51&scope.project.id=7860d281acf642d2a3950424901b9487&role.id=2180d183afad443187521833c40ed8a1 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:53.464113 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bde19-4368-4c9b-8224-128a699cfc7f None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:53.464706 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bde19-4368-4c9b-8224-128a699cfc7f None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:53.464706 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bde19-4368-4c9b-8224-128a699cfc7f None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:53.466076 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 646/1288] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:50:53.472507 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16655906-9b43-4cce-a2e0-0397b2110d8f None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:53.472965 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16655906-9b43-4cce-a2e0-0397b2110d8f None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:53.473082 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16655906-9b43-4cce-a2e0-0397b2110d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:53.490176 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-16655906-9b43-4cce-a2e0-0397b2110d8f None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:50:53.491368 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-16655906-9b43-4cce-a2e0-0397b2110d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:50:53.566930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 643/1289] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:50:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:50:53.589270 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bde19-4368-4c9b-8224-128a699cfc7f None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:53.690027 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bde19-4368-4c9b-8224-128a699cfc7f None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:53.722978 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206b9c6-e1e4-44ea-84a2-71541c4982d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:53.723918 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206b9c6-e1e4-44ea-84a2-71541c4982d1 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:53.724198 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206b9c6-e1e4-44ea-84a2-71541c4982d1 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:53.724471 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206b9c6-e1e4-44ea-84a2-71541c4982d1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:53.725130 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206b9c6-e1e4-44ea-84a2-71541c4982d1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:53.727078 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206b9c6-e1e4-44ea-84a2-71541c4982d1 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:53.738814 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-1206b9c6-e1e4-44ea-84a2-71541c4982d1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:50:53.738814 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:53.738814 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:50:53.738814 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:50:53.738814 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:50:53.738814 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:50:53.738814 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:50:53.738814 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:50:53.738814 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:50:53.738814 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:50:53.738814 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:50:53.738814 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:50:53.738814 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:53.738814 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:53.738814 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:53.738814 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:53.738814 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:53.740273 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:53.740273 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:53.740273 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:53.740273 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:53.740273 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:53.740273 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:53.740273 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:50:53.740273 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:50:53.740273 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:50:53.740273 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:50:53.740273 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:53.740273 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:53.740273 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:53.740273 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:53.740273 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:53.740273 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:53.741349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:53.741349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:50:53.741349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:53.741349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:53.741349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:53.741349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:53.741349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:53.741349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:53.741349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:53.741349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:53.741349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:50:53.741349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:50:53.741349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:50:53.741349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:50:53.741349 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 647/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:50:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:53.746923 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16655906-9b43-4cce-a2e0-0397b2110d8f None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:53.841617 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16655906-9b43-4cce-a2e0-0397b2110d8f None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:53.875266 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3819c60-a36c-418d-968c-9ba0ffcfd0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:53.876175 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3819c60-a36c-418d-968c-9ba0ffcfd0d6 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:53.876456 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3819c60-a36c-418d-968c-9ba0ffcfd0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:53.876756 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3819c60-a36c-418d-968c-9ba0ffcfd0d6 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:53.877497 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3819c60-a36c-418d-968c-9ba0ffcfd0d6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:53.877804 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3819c60-a36c-418d-968c-9ba0ffcfd0d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:53.879169 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3819c60-a36c-418d-968c-9ba0ffcfd0d6 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:53.884072 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 644/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Mon May 9 15:50:53 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:53.889880 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206b9c6-e1e4-44ea-84a2-71541c4982d1 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:53.993046 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206b9c6-e1e4-44ea-84a2-71541c4982d1 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:54.026778 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2c00b-5668-48d9-be48-f38d17ce652e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:54.027448 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2c00b-5668-48d9-be48-f38d17ce652e None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:54.027738 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2c00b-5668-48d9-be48-f38d17ce652e None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:54.028018 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2c00b-5668-48d9-be48-f38d17ce652e None admin] PATH_INFO: `/v3/services` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:54.028750 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2c00b-5668-48d9-be48-f38d17ce652e None admin] RBAC: Adding query filter params (type=placement) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:54.029065 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2c00b-5668-48d9-be48-f38d17ce652e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:54.030477 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2c00b-5668-48d9-be48-f38d17ce652e None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:54.035155 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 648/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Mon May 9 15:50:53 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:56.340659 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f5623-1377-452a-9f4f-ee58dd2a7b4b None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:56.341542 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f5623-1377-452a-9f4f-ee58dd2a7b4b None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:56.341721 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f5623-1377-452a-9f4f-ee58dd2a7b4b None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:56.343490 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 645/1293] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:50:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:50:56.349463 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664667a-4125-4965-b003-047d0c36c670 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:56.350034 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664667a-4125-4965-b003-047d0c36c670 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:56.350034 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664667a-4125-4965-b003-047d0c36c670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:56.367919 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-6664667a-4125-4965-b003-047d0c36c670 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:50:56.369092 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-6664667a-4125-4965-b003-047d0c36c670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:50:56.433008 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 649/1294] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:50:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:50:56.455324 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f5623-1377-452a-9f4f-ee58dd2a7b4b None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:56.558342 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f5623-1377-452a-9f4f-ee58dd2a7b4b None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:56.593558 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901906f0-68c5-48cb-ae11-e1913902cae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:56.594086 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901906f0-68c5-48cb-ae11-e1913902cae2 None admin] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:56.594370 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901906f0-68c5-48cb-ae11-e1913902cae2 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:56.594647 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901906f0-68c5-48cb-ae11-e1913902cae2 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:56.595383 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901906f0-68c5-48cb-ae11-e1913902cae2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:56.596740 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901906f0-68c5-48cb-ae11-e1913902cae2 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:56.610914 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 646/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Mon May 9 15:50:56 2022] POST /identity/v3/services => generated 246 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 09 15:50:58.890491 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d093fe5-50e2-4e02-9093-61d97a38a713 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:58.891028 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d093fe5-50e2-4e02-9093-61d97a38a713 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:58.891028 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d093fe5-50e2-4e02-9093-61d97a38a713 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:58.892341 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 650/1296] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:50:58.897805 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e36964-a151-4ab6-877c-b6e1b4899cd5 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:58.898299 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e36964-a151-4ab6-877c-b6e1b4899cd5 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:58.898692 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e36964-a151-4ab6-877c-b6e1b4899cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:58.916232 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-57e36964-a151-4ab6-877c-b6e1b4899cd5 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:50:58.917483 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-57e36964-a151-4ab6-877c-b6e1b4899cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:50:58.988695 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 647/1297] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:50:58 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:50:59.013470 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d093fe5-50e2-4e02-9093-61d97a38a713 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:59.112462 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d093fe5-50e2-4e02-9093-61d97a38a713 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:59.146114 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5ac44-a932-4c50-8853-a68257f9f248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:59.146877 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5ac44-a932-4c50-8853-a68257f9f248 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:59.147169 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5ac44-a932-4c50-8853-a68257f9f248 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:59.147440 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5ac44-a932-4c50-8853-a68257f9f248 None admin] PATH_INFO: `/v3/services/placement` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:59.148646 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb5ac44-a932-4c50-8853-a68257f9f248 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:59.150171 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb5ac44-a932-4c50-8853-a68257f9f248 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:59.162916 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-0eb5ac44-a932-4c50-8853-a68257f9f248 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:50:59.162916 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:59.162916 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:50:59.162916 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:50:59.162916 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:50:59.162916 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:50:59.162916 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:50:59.162916 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:50:59.162916 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:50:59.162916 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:50:59.162916 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:50:59.162916 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:50:59.162916 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:50:59.162916 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:50:59.162916 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:50:59.162916 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:50:59.162916 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:50:59.164873 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:50:59.164873 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:50:59.164873 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:50:59.164873 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:50:59.164873 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:50:59.164873 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:50:59.164873 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:50:59.164873 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:50:59.164873 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:50:59.164873 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:50:59.164873 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:50:59.164873 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:50:59.164873 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:50:59.164873 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:50:59.164873 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:50:59.164873 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:50:59.166458 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:50:59.166458 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:50:59.166458 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:50:59.166458 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:50:59.166458 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:50:59.166458 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:50:59.166458 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:50:59.166458 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:50:59.166458 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:50:59.166458 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:50:59.166458 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:50:59.166458 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:50:59.166458 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:50:59.166458 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:50:59.166458 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 651/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:50:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:50:59.171059 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e36964-a151-4ab6-877c-b6e1b4899cd5 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:59.266196 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e36964-a151-4ab6-877c-b6e1b4899cd5 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:59.302210 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590fbb2-ca22-4474-a3ab-2ee9cef7d1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:59.302880 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590fbb2-ca22-4474-a3ab-2ee9cef7d1d6 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:59.303165 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590fbb2-ca22-4474-a3ab-2ee9cef7d1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:59.303442 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590fbb2-ca22-4474-a3ab-2ee9cef7d1d6 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:59.304169 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590fbb2-ca22-4474-a3ab-2ee9cef7d1d6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:59.305014 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590fbb2-ca22-4474-a3ab-2ee9cef7d1d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:59.306575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590fbb2-ca22-4474-a3ab-2ee9cef7d1d6 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:59.312024 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 648/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Mon May 9 15:50:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:59.318147 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5ac44-a932-4c50-8853-a68257f9f248 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:59.420732 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5ac44-a932-4c50-8853-a68257f9f248 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:59.454247 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29824c41-1219-4da6-99ca-6cca7a2555e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:59.454911 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29824c41-1219-4da6-99ca-6cca7a2555e9 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:59.455198 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29824c41-1219-4da6-99ca-6cca7a2555e9 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:59.455474 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29824c41-1219-4da6-99ca-6cca7a2555e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:59.456273 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29824c41-1219-4da6-99ca-6cca7a2555e9 None admin] RBAC: Adding query filter params (interface=public, service_id=1a8f5fb9fd2f4b6ca8866f5635df5171, region_id=RegionOne) {{(pid=276029) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:50:59.456586 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29824c41-1219-4da6-99ca-6cca7a2555e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:59.458010 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29824c41-1219-4da6-99ca-6cca7a2555e9 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:59.463424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 652/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Mon May 9 15:50:59 2022] GET /identity/v3/endpoints?service_id=1a8f5fb9fd2f4b6ca8866f5635df5171&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:50:59.469291 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590fbb2-ca22-4474-a3ab-2ee9cef7d1d6 None admin] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:50:59.572315 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590fbb2-ca22-4474-a3ab-2ee9cef7d1d6 None admin] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:50:59.607628 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5275d16-9bce-4e1f-b905-5dd68b765779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:50:59.608304 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5275d16-9bce-4e1f-b905-5dd68b765779 None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:50:59.608590 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5275d16-9bce-4e1f-b905-5dd68b765779 None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:50:59.608869 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5275d16-9bce-4e1f-b905-5dd68b765779 None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:50:59.609591 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5275d16-9bce-4e1f-b905-5dd68b765779 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:50:59.610972 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5275d16-9bce-4e1f-b905-5dd68b765779 None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:50:59.618714 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 649/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Mon May 9 15:50:59 2022] GET /identity/v3/services => generated 2191 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 09 15:51:01.881865 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccee37-ff29-47c5-82a3-8b0f19dd6c81 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:51:01.883038 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccee37-ff29-47c5-82a3-8b0f19dd6c81 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:51:01.883038 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccee37-ff29-47c5-82a3-8b0f19dd6c81 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:51:01.884497 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 653/1302] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:51:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:51:01.889759 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525df5b9-097b-4984-80c5-ad66cb002733 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:51:01.890176 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525df5b9-097b-4984-80c5-ad66cb002733 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:51:01.890328 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525df5b9-097b-4984-80c5-ad66cb002733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:51:01.908029 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-525df5b9-097b-4984-80c5-ad66cb002733 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:51:01.909239 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-525df5b9-097b-4984-80c5-ad66cb002733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:51:01.979599 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 650/1303] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:51:01 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 09 15:51:02.002088 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cccee37-ff29-47c5-82a3-8b0f19dd6c81 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:51:02.104147 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cccee37-ff29-47c5-82a3-8b0f19dd6c81 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:51:02.136766 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c81725-6263-48e2-8997-bc943d3b1b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:51:02.137516 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c81725-6263-48e2-8997-bc943d3b1b49 None admin] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:51:02.137801 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c81725-6263-48e2-8997-bc943d3b1b49 None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:51:02.138075 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c81725-6263-48e2-8997-bc943d3b1b49 None admin] PATH_INFO: `/v3/services/placement` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:51:02.138725 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c81725-6263-48e2-8997-bc943d3b1b49 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:51:02.140076 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c81725-6263-48e2-8997-bc943d3b1b49 None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:51:02.152391 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application [None req-a2c81725-6263-48e2-8997-bc943d3b1b49 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:51:02.152391 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:51:02.152391 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 09 15:51:02.152391 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 09 15:51:02.152391 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 09 15:51:02.152391 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 09 15:51:02.152391 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 09 15:51:02.152391 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:51:02.152391 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:51:02.152391 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:51:02.152391 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 09 15:51:02.152391 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:51:02.152391 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application Traceback (most recent call last): May 09 15:51:02.152391 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 09 15:51:02.152391 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 09 15:51:02.152391 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 09 15:51:02.152391 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 09 15:51:02.153774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 09 15:51:02.153774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 09 15:51:02.153774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 09 15:51:02.153774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 09 15:51:02.153774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 09 15:51:02.153774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 09 15:51:02.153774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 09 15:51:02.153774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._get_service(service_id) May 09 15:51:02.153774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 09 15:51:02.153774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 09 15:51:02.153774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 09 15:51:02.153774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 09 15:51:02.153774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 09 15:51:02.153774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 09 15:51:02.153774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 09 15:51:02.153774 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.get_or_create( May 09 15:51:02.155027 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 09 15:51:02.155027 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application with Lock( May 09 15:51:02.155027 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 09 15:51:02.155027 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self._enter() May 09 15:51:02.155027 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 09 15:51:02.155027 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 09 15:51:02.155027 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 09 15:51:02.155027 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application return self.creator() May 09 15:51:02.155027 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 09 15:51:02.155027 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application created_value = creator( May 09 15:51:02.155027 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 09 15:51:02.155027 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 09 15:51:02.155027 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 09 15:51:02.155027 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: ERROR keystone.server.flask.application May 09 15:51:02.155027 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 654/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Mon May 9 15:51:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 09 15:51:02.159790 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525df5b9-097b-4984-80c5-ad66cb002733 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:51:02.260416 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525df5b9-097b-4984-80c5-ad66cb002733 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:51:02.294016 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6958f9f-f219-4845-ba79-2e1dc821e4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:51:02.294696 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6958f9f-f219-4845-ba79-2e1dc821e4cb None admin] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:51:02.294983 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6958f9f-f219-4845-ba79-2e1dc821e4cb None admin] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:51:02.295263 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6958f9f-f219-4845-ba79-2e1dc821e4cb None admin] PATH_INFO: `/v3/services` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:51:02.295994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6958f9f-f219-4845-ba79-2e1dc821e4cb None admin] RBAC: Adding query filter params (name=placement) {{(pid=276030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 09 15:51:02.296309 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6958f9f-f219-4845-ba79-2e1dc821e4cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:51:02.297733 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6958f9f-f219-4845-ba79-2e1dc821e4cb None admin] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:51:02.303044 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 651/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Mon May 9 15:51:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 09 15:51:02.310990 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c81725-6263-48e2-8997-bc943d3b1b49 None admin] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:51:02.411311 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c81725-6263-48e2-8997-bc943d3b1b49 None admin] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:51:02.446099 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee462d-c168-4e47-b3f7-7c941235edaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6c9373bbbf843ee901a91cc4e068dee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:51:02.446806 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee462d-c168-4e47-b3f7-7c941235edaa None admin] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:51:02.447097 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee462d-c168-4e47-b3f7-7c941235edaa None admin] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:51:02.447381 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee462d-c168-4e47-b3f7-7c941235edaa None admin] PATH_INFO: `/v3/endpoints` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:51:02.448142 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee462d-c168-4e47-b3f7-7c941235edaa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:51:02.449613 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee462d-c168-4e47-b3f7-7c941235edaa None admin] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:51:02.467938 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 655/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Mon May 9 15:51:02 2022] POST /identity/v3/endpoints => generated 331 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 09 15:52:10.163542 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771ec13-b283-4158-96a6-05d41edb3a53 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:10.164099 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771ec13-b283-4158-96a6-05d41edb3a53 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:10.164099 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771ec13-b283-4158-96a6-05d41edb3a53 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:10.165331 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 652/1307] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:52:10.170996 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2def5e-c22c-4f4f-aed4-6d6438f70141 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:10.171488 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2def5e-c22c-4f4f-aed4-6d6438f70141 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:10.171899 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2def5e-c22c-4f4f-aed4-6d6438f70141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:10.341261 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-4e2def5e-c22c-4f4f-aed4-6d6438f70141 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:52:10.342716 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-4e2def5e-c22c-4f4f-aed4-6d6438f70141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:10.569424 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 656/1308] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:52:10.616123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3ccd3-67f5-454f-933a-c1f9e7ed9567 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:10.616123 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3ccd3-67f5-454f-933a-c1f9e7ed9567 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:10.616532 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3ccd3-67f5-454f-933a-c1f9e7ed9567 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:10.617897 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 653/1309] 10.222.0.48 () {54 vars in 964 bytes} [Mon May 9 15:52:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:52:10.624674 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ffce8-41f0-4df9-addf-9018824eded6 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:10.625307 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ffce8-41f0-4df9-addf-9018824eded6 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:10.625868 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ffce8-41f0-4df9-addf-9018824eded6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:10.751640 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-8d3ffce8-41f0-4df9-addf-9018824eded6 None None] MFA Rules not processed for user `cc0eb4f69ab6423eae5e8b33fbc06563`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:52:10.753249 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-8d3ffce8-41f0-4df9-addf-9018824eded6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:10.897412 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 657/1310] 10.222.0.48 () {58 vars in 1061 bytes} [Mon May 9 15:52:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:52:10.906721 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3ccd3-67f5-454f-933a-c1f9e7ed9567 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:52:10.908690 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-e1e3ccd3-67f5-454f-933a-c1f9e7ed9567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:11.143488 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3ccd3-67f5-454f-933a-c1f9e7ed9567 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:52:11.291686 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b6616-6323-4d12-a7d5-214e7dca0a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0eb4f69ab6423eae5e8b33fbc06563', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7860d281acf642d2a3950424901b9487', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:52:11.292520 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b6616-6323-4d12-a7d5-214e7dca0a11 service neutron] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:11.292955 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b6616-6323-4d12-a7d5-214e7dca0a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:11.293313 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b6616-6323-4d12-a7d5-214e7dca0a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:11.295114 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-945b6616-6323-4d12-a7d5-214e7dca0a11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:11.424714 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b6616-6323-4d12-a7d5-214e7dca0a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:52:11.426454 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b6616-6323-4d12-a7d5-214e7dca0a11 service neutron] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:52:11.453233 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 654/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:52:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:52:14.627343 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b10de-d727-455f-b04f-4d3686505914 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:14.628261 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b10de-d727-455f-b04f-4d3686505914 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:14.628736 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b10de-d727-455f-b04f-4d3686505914 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:14.636712 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 658/1312] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:52:14 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:52:14.638026 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3247ec-6073-4d2e-acd9-b62c8e83d387 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:14.638839 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3247ec-6073-4d2e-acd9-b62c8e83d387 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:14.639287 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3247ec-6073-4d2e-acd9-b62c8e83d387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:14.735464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-3e3247ec-6073-4d2e-acd9-b62c8e83d387 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:52:14.736951 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-3e3247ec-6073-4d2e-acd9-b62c8e83d387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:14.852639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 655/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:52:14.892192 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b10de-d727-455f-b04f-4d3686505914 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:52:14.894663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-d79b10de-d727-455f-b04f-4d3686505914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:15.003663 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b10de-d727-455f-b04f-4d3686505914 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:52:15.080341 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eddca9-a5ac-45c4-aebe-dad4fcb79c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0eb4f69ab6423eae5e8b33fbc06563', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7860d281acf642d2a3950424901b9487', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:52:15.081006 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eddca9-a5ac-45c4-aebe-dad4fcb79c1f service neutron] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:15.081298 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eddca9-a5ac-45c4-aebe-dad4fcb79c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:15.081612 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eddca9-a5ac-45c4-aebe-dad4fcb79c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:15.083325 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-c5eddca9-a5ac-45c4-aebe-dad4fcb79c1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:15.200314 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eddca9-a5ac-45c4-aebe-dad4fcb79c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:52:15.201812 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eddca9-a5ac-45c4-aebe-dad4fcb79c1f service neutron] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:52:15.223585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 659/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:52:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:52:17.983218 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d5aaf-4155-4c38-b7b6-de4a27eaadea None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:17.983791 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d5aaf-4155-4c38-b7b6-de4a27eaadea None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:17.983791 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d5aaf-4155-4c38-b7b6-de4a27eaadea None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:17.985148 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 656/1315] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:52:17.990432 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4615945-1546-4d7c-bac3-7e1abac83f21 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:17.990895 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4615945-1546-4d7c-bac3-7e1abac83f21 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:17.991458 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4615945-1546-4d7c-bac3-7e1abac83f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:18.052919 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-b4615945-1546-4d7c-bac3-7e1abac83f21 None None] MFA Rules not processed for user `c8e11348f5be4ffaae295f091562aea9`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:52:18.054188 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-b4615945-1546-4d7c-bac3-7e1abac83f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:18.160130 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 660/1316] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:52:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:52:18.217994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136493d-0eba-4ae8-96e5-f883137b3230 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:18.218285 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136493d-0eba-4ae8-96e5-f883137b3230 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:18.218588 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136493d-0eba-4ae8-96e5-f883137b3230 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:18.220005 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 657/1317] 10.222.0.48 () {54 vars in 964 bytes} [Mon May 9 15:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:52:18.226816 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe93d9b-45e0-4b6d-b79a-7dd9695e626e None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:18.227109 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe93d9b-45e0-4b6d-b79a-7dd9695e626e None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:18.227671 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe93d9b-45e0-4b6d-b79a-7dd9695e626e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:18.300341 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-dbe93d9b-45e0-4b6d-b79a-7dd9695e626e None None] MFA Rules not processed for user `cc0eb4f69ab6423eae5e8b33fbc06563`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:52:18.301509 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-dbe93d9b-45e0-4b6d-b79a-7dd9695e626e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:18.374859 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 661/1318] 10.222.0.48 () {58 vars in 1061 bytes} [Mon May 9 15:52:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:52:18.385063 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136493d-0eba-4ae8-96e5-f883137b3230 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:52:18.386651 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-3136493d-0eba-4ae8-96e5-f883137b3230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:18.488375 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136493d-0eba-4ae8-96e5-f883137b3230 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:52:18.561930 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81cb59f-2e5c-4ea5-aa44-0d50bdbbbd19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0eb4f69ab6423eae5e8b33fbc06563', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7860d281acf642d2a3950424901b9487', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:52:18.562510 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cb59f-2e5c-4ea5-aa44-0d50bdbbbd19 service neutron] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:18.562796 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cb59f-2e5c-4ea5-aa44-0d50bdbbbd19 service neutron] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:18.563070 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cb59f-2e5c-4ea5-aa44-0d50bdbbbd19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:18.564721 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-f81cb59f-2e5c-4ea5-aa44-0d50bdbbbd19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:18.671639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81cb59f-2e5c-4ea5-aa44-0d50bdbbbd19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:52:18.673080 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81cb59f-2e5c-4ea5-aa44-0d50bdbbbd19 service neutron] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:52:18.691469 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 658/1319] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:52:18 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:52:21.921630 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9bc74-9b1d-4d0e-a0d7-2526ca853187 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:21.922220 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9bc74-9b1d-4d0e-a0d7-2526ca853187 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:21.922220 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9bc74-9b1d-4d0e-a0d7-2526ca853187 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:21.923493 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 662/1320] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:52:21.929194 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77fef1-f1ad-466f-a103-57906047b856 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:21.929630 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77fef1-f1ad-466f-a103-57906047b856 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:21.929785 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77fef1-f1ad-466f-a103-57906047b856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:21.993061 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-8c77fef1-f1ad-466f-a103-57906047b856 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:52:21.994315 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-8c77fef1-f1ad-466f-a103-57906047b856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:22.089845 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 659/1321] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:52:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:52:22.131112 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9bc74-9b1d-4d0e-a0d7-2526ca853187 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:52:22.132654 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-13a9bc74-9b1d-4d0e-a0d7-2526ca853187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:22.237233 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9bc74-9b1d-4d0e-a0d7-2526ca853187 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:52:22.310037 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ccdd42-85bd-462f-ac22-56448b8866b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0eb4f69ab6423eae5e8b33fbc06563', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7860d281acf642d2a3950424901b9487', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:52:22.310680 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccdd42-85bd-462f-ac22-56448b8866b9 service neutron] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:22.310957 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccdd42-85bd-462f-ac22-56448b8866b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:22.311229 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccdd42-85bd-462f-ac22-56448b8866b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:22.312866 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-34ccdd42-85bd-462f-ac22-56448b8866b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:22.420122 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ccdd42-85bd-462f-ac22-56448b8866b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:52:22.421647 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ccdd42-85bd-462f-ac22-56448b8866b9 service neutron] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:52:22.439635 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 663/1322] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:52:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:52:25.354966 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda984c7-0d54-4632-bac1-137409b0af62 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:25.355515 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda984c7-0d54-4632-bac1-137409b0af62 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:25.355515 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda984c7-0d54-4632-bac1-137409b0af62 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:25.356809 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 660/1323] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:52:25.362247 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8bab6-80b7-4c4d-972b-170fce03008d None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:25.362655 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8bab6-80b7-4c4d-972b-170fce03008d None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:25.362810 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8bab6-80b7-4c4d-972b-170fce03008d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:25.427551 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-07e8bab6-80b7-4c4d-972b-170fce03008d None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:52:25.428746 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-07e8bab6-80b7-4c4d-972b-170fce03008d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:25.521926 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 664/1324] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:52:25.557778 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda984c7-0d54-4632-bac1-137409b0af62 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:52:25.559431 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-bda984c7-0d54-4632-bac1-137409b0af62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:25.664575 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda984c7-0d54-4632-bac1-137409b0af62 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:52:25.737487 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1b6ff-c2d3-40e6-bb72-b9ba870bdad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0eb4f69ab6423eae5e8b33fbc06563', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7860d281acf642d2a3950424901b9487', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:52:25.738176 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1b6ff-c2d3-40e6-bb72-b9ba870bdad8 service neutron] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:25.738464 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1b6ff-c2d3-40e6-bb72-b9ba870bdad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:25.738748 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1b6ff-c2d3-40e6-bb72-b9ba870bdad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:25.741017 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-c6a1b6ff-c2d3-40e6-bb72-b9ba870bdad8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:25.853282 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1b6ff-c2d3-40e6-bb72-b9ba870bdad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:52:25.854756 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1b6ff-c2d3-40e6-bb72-b9ba870bdad8 service neutron] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:52:25.873639 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 661/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:52:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:52:28.242286 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7cc90-e311-40a2-a974-540910dd13aa None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:28.242866 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7cc90-e311-40a2-a974-540910dd13aa None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:28.242866 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7cc90-e311-40a2-a974-540910dd13aa None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:28.244234 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 665/1326] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:52:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:52:28.249773 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eff33c-a84e-4e60-b57f-dadfc8f51104 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:28.250199 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eff33c-a84e-4e60-b57f-dadfc8f51104 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:28.250346 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eff33c-a84e-4e60-b57f-dadfc8f51104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:28.315411 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-80eff33c-a84e-4e60-b57f-dadfc8f51104 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:52:28.316537 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-80eff33c-a84e-4e60-b57f-dadfc8f51104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:28.413111 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 662/1327] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:52:28.449061 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7cc90-e311-40a2-a974-540910dd13aa None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:52:28.450957 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-85b7cc90-e311-40a2-a974-540910dd13aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:28.555095 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7cc90-e311-40a2-a974-540910dd13aa None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:52:28.627741 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827f49d-7a36-4d8d-8869-08c039c7d8d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0eb4f69ab6423eae5e8b33fbc06563', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7860d281acf642d2a3950424901b9487', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:52:28.631556 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827f49d-7a36-4d8d-8869-08c039c7d8d2 service neutron] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:28.631556 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827f49d-7a36-4d8d-8869-08c039c7d8d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:28.631556 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827f49d-7a36-4d8d-8869-08c039c7d8d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:28.631556 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-b827f49d-7a36-4d8d-8869-08c039c7d8d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:28.740731 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827f49d-7a36-4d8d-8869-08c039c7d8d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:52:28.742224 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827f49d-7a36-4d8d-8869-08c039c7d8d2 service neutron] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:52:28.760510 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 666/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:52:31.113089 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c513b-fc0a-44d4-a29b-6543d1128a72 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:31.113606 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c513b-fc0a-44d4-a29b-6543d1128a72 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:31.113719 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c513b-fc0a-44d4-a29b-6543d1128a72 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:31.115566 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 663/1329] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:52:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:52:31.121102 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cc323-e833-461a-bda7-41377e1c5b69 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:31.121579 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cc323-e833-461a-bda7-41377e1c5b69 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:31.121681 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cc323-e833-461a-bda7-41377e1c5b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:31.187710 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-9a0cc323-e833-461a-bda7-41377e1c5b69 None None] MFA Rules not processed for user `c8e11348f5be4ffaae295f091562aea9`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:52:31.188943 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-9a0cc323-e833-461a-bda7-41377e1c5b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:31.286798 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 667/1330] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:52:31 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:52:31.324567 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c513b-fc0a-44d4-a29b-6543d1128a72 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:52:31.326131 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-f51c513b-fc0a-44d4-a29b-6543d1128a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:31.429191 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c513b-fc0a-44d4-a29b-6543d1128a72 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:52:31.501922 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca5322-5848-40fc-88e9-dd9fb3e984f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0eb4f69ab6423eae5e8b33fbc06563', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7860d281acf642d2a3950424901b9487', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:52:31.502571 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca5322-5848-40fc-88e9-dd9fb3e984f5 service neutron] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:31.502860 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca5322-5848-40fc-88e9-dd9fb3e984f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:31.503137 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca5322-5848-40fc-88e9-dd9fb3e984f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:31.505427 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-72ca5322-5848-40fc-88e9-dd9fb3e984f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:31.611323 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca5322-5848-40fc-88e9-dd9fb3e984f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:52:31.612687 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca5322-5848-40fc-88e9-dd9fb3e984f5 service neutron] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:52:31.634125 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 664/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:52:31 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:52:34.118881 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae5426-934a-4b79-bfeb-7888ea354ae0 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:34.119444 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae5426-934a-4b79-bfeb-7888ea354ae0 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:34.119444 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae5426-934a-4b79-bfeb-7888ea354ae0 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:34.120799 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 668/1332] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:52:34.126022 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e3bd4-a7c6-4281-97ba-c071edd7bf96 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:34.126742 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e3bd4-a7c6-4281-97ba-c071edd7bf96 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:34.126867 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e3bd4-a7c6-4281-97ba-c071edd7bf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:34.191849 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-324e3bd4-a7c6-4281-97ba-c071edd7bf96 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:52:34.193715 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-324e3bd4-a7c6-4281-97ba-c071edd7bf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:34.300078 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 665/1333] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:52:34.336643 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae5426-934a-4b79-bfeb-7888ea354ae0 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:52:34.338521 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-d3ae5426-934a-4b79-bfeb-7888ea354ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:34.437843 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae5426-934a-4b79-bfeb-7888ea354ae0 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:52:34.508264 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c8b7c-4f50-434c-b6e5-ba3cd862cc09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0eb4f69ab6423eae5e8b33fbc06563', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7860d281acf642d2a3950424901b9487', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:52:34.508905 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c8b7c-4f50-434c-b6e5-ba3cd862cc09 service neutron] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:34.509191 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c8b7c-4f50-434c-b6e5-ba3cd862cc09 service neutron] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:34.509498 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c8b7c-4f50-434c-b6e5-ba3cd862cc09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:34.511135 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-ee1c8b7c-4f50-434c-b6e5-ba3cd862cc09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:34.615266 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c8b7c-4f50-434c-b6e5-ba3cd862cc09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:52:34.616699 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c8b7c-4f50-434c-b6e5-ba3cd862cc09 service neutron] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:52:34.635649 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 669/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:52:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:52:36.981974 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83424e7-b714-4d93-bcb0-4ca08b70c721 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:36.982552 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83424e7-b714-4d93-bcb0-4ca08b70c721 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:36.982552 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83424e7-b714-4d93-bcb0-4ca08b70c721 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:36.983875 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 666/1335] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:52:36.989856 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b06aa0-db32-47b8-9786-913953d9bf29 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:36.990278 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b06aa0-db32-47b8-9786-913953d9bf29 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:36.990437 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b06aa0-db32-47b8-9786-913953d9bf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:37.053616 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-d3b06aa0-db32-47b8-9786-913953d9bf29 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:52:37.054864 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-d3b06aa0-db32-47b8-9786-913953d9bf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:37.148955 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 670/1336] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:52:37.190395 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83424e7-b714-4d93-bcb0-4ca08b70c721 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:52:37.192057 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-f83424e7-b714-4d93-bcb0-4ca08b70c721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:37.296740 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83424e7-b714-4d93-bcb0-4ca08b70c721 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:52:37.367100 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc2405-e8e3-4fc6-bedd-fd5a229bacdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0eb4f69ab6423eae5e8b33fbc06563', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7860d281acf642d2a3950424901b9487', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:52:37.367741 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc2405-e8e3-4fc6-bedd-fd5a229bacdf service neutron] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:37.368021 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc2405-e8e3-4fc6-bedd-fd5a229bacdf service neutron] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:37.368294 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc2405-e8e3-4fc6-bedd-fd5a229bacdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:37.369963 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-41fc2405-e8e3-4fc6-bedd-fd5a229bacdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:37.476762 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc2405-e8e3-4fc6-bedd-fd5a229bacdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:52:37.478224 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc2405-e8e3-4fc6-bedd-fd5a229bacdf service neutron] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:52:37.496747 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 667/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:52:40.250098 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dcce6-ec4f-4b65-8359-b0447ed6fb34 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:40.250653 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dcce6-ec4f-4b65-8359-b0447ed6fb34 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:40.250653 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dcce6-ec4f-4b65-8359-b0447ed6fb34 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:40.252303 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 671/1338] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:52:40.258857 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03352c-2d6a-4347-bb4d-3de47b65905b None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:40.259319 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03352c-2d6a-4347-bb4d-3de47b65905b None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:40.259440 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03352c-2d6a-4347-bb4d-3de47b65905b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:40.329272 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-cd03352c-2d6a-4347-bb4d-3de47b65905b None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:52:40.330543 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-cd03352c-2d6a-4347-bb4d-3de47b65905b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:40.426175 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 668/1339] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:52:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:52:40.463430 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dcce6-ec4f-4b65-8359-b0447ed6fb34 None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:52:40.466486 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-853dcce6-ec4f-4b65-8359-b0447ed6fb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:40.576009 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dcce6-ec4f-4b65-8359-b0447ed6fb34 None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:52:40.579643 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df853ab-5817-4ac8-b27f-fa7b5d8fccf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0eb4f69ab6423eae5e8b33fbc06563', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7860d281acf642d2a3950424901b9487', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:52:40.580295 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df853ab-5817-4ac8-b27f-fa7b5d8fccf1 service neutron] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:40.580585 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df853ab-5817-4ac8-b27f-fa7b5d8fccf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:40.580868 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df853ab-5817-4ac8-b27f-fa7b5d8fccf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:40.582680 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-4df853ab-5817-4ac8-b27f-fa7b5d8fccf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:40.682392 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df853ab-5817-4ac8-b27f-fa7b5d8fccf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:52:40.683836 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df853ab-5817-4ac8-b27f-fa7b5d8fccf1 service neutron] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:52:40.702925 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 672/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:52:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:52:45.023145 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9863e-eaa0-453a-9d67-b72c55d83e3e None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:45.023753 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9863e-eaa0-453a-9d67-b72c55d83e3e None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:45.023753 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9863e-eaa0-453a-9d67-b72c55d83e3e None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:45.024994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 669/1341] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:52:45.030310 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf44f4-ce66-423e-b6a4-edf9b806a447 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:45.030787 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf44f4-ce66-423e-b6a4-edf9b806a447 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:45.030892 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf44f4-ce66-423e-b6a4-edf9b806a447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:45.077907 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-dbdf44f4-ce66-423e-b6a4-edf9b806a447 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:52:45.079118 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-dbdf44f4-ce66-423e-b6a4-edf9b806a447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:45.155011 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 673/1342] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 09 15:52:45.194469 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9863e-eaa0-453a-9d67-b72c55d83e3e None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:52:45.206349 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9863e-eaa0-453a-9d67-b72c55d83e3e None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:52:45.210546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76916869-9b34-4f86-b140-248467d689a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0eb4f69ab6423eae5e8b33fbc06563', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7860d281acf642d2a3950424901b9487', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:52:45.211285 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76916869-9b34-4f86-b140-248467d689a4 service neutron] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:45.211644 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76916869-9b34-4f86-b140-248467d689a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:45.212020 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76916869-9b34-4f86-b140-248467d689a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:45.221297 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76916869-9b34-4f86-b140-248467d689a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:52:45.222767 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76916869-9b34-4f86-b140-248467d689a4 service neutron] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:52:45.232994 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 670/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:52:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:52:48.102047 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a33389-d933-4d9a-9a87-e13d11de346d None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:48.102615 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a33389-d933-4d9a-9a87-e13d11de346d None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:48.102615 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a33389-d933-4d9a-9a87-e13d11de346d None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:48.103992 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 674/1344] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:52:48.109413 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2821e-4f4b-4008-9275-e0376714e284 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:48.109840 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2821e-4f4b-4008-9275-e0376714e284 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:48.109957 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2821e-4f4b-4008-9275-e0376714e284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:48.138398 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-d0c2821e-4f4b-4008-9275-e0376714e284 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:52:48.139609 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-d0c2821e-4f4b-4008-9275-e0376714e284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:48.147724 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 671/1345] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:52:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:52:48.187760 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a33389-d933-4d9a-9a87-e13d11de346d None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:52:48.200188 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a33389-d933-4d9a-9a87-e13d11de346d None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:52:48.204184 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ba457-048a-44c0-81e9-ef152ab5eed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0eb4f69ab6423eae5e8b33fbc06563', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7860d281acf642d2a3950424901b9487', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:52:48.204881 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ba457-048a-44c0-81e9-ef152ab5eed6 service neutron] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:48.205162 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ba457-048a-44c0-81e9-ef152ab5eed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:48.205476 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ba457-048a-44c0-81e9-ef152ab5eed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:48.215323 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ba457-048a-44c0-81e9-ef152ab5eed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:52:48.216775 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ba457-048a-44c0-81e9-ef152ab5eed6 service neutron] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:52:48.226430 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 675/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:52:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:52:52.658669 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe61aeb-8414-462f-8c1a-92516a1d51b8 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:52.659194 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe61aeb-8414-462f-8c1a-92516a1d51b8 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:52.659324 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe61aeb-8414-462f-8c1a-92516a1d51b8 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:52.661220 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 672/1347] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:52:52.666871 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9f911-33c6-4cbb-b880-fc5ebac07822 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:52.667296 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9f911-33c6-4cbb-b880-fc5ebac07822 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:52.667414 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9f911-33c6-4cbb-b880-fc5ebac07822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:52.689025 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-4aa9f911-33c6-4cbb-b880-fc5ebac07822 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:52:52.690326 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-4aa9f911-33c6-4cbb-b880-fc5ebac07822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:52.699344 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 676/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:52:52.738866 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe61aeb-8414-462f-8c1a-92516a1d51b8 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:52:52.749896 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe61aeb-8414-462f-8c1a-92516a1d51b8 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:52:52.753793 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5821f59-1dc2-4411-908a-0189675f3c9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc0eb4f69ab6423eae5e8b33fbc06563', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7860d281acf642d2a3950424901b9487', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:52:52.754529 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5821f59-1dc2-4411-908a-0189675f3c9b service neutron] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:52.754923 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5821f59-1dc2-4411-908a-0189675f3c9b service neutron] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:52.755262 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5821f59-1dc2-4411-908a-0189675f3c9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:52.764787 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5821f59-1dc2-4411-908a-0189675f3c9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:52:52.766287 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5821f59-1dc2-4411-908a-0189675f3c9b service neutron] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:52:52.777307 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 673/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:52:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:52:58.343265 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04dbd5-931e-4ac4-b270-38e130dd0318 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:58.344556 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04dbd5-931e-4ac4-b270-38e130dd0318 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:58.345212 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04dbd5-931e-4ac4-b270-38e130dd0318 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:58.349170 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 677/1350] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 9 15:52:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:52:58.355293 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6938a-b2d8-45e0-a40b-1e6b5bd16bf6 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:52:58.355693 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6938a-b2d8-45e0-a40b-1e6b5bd16bf6 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:52:58.355873 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6938a-b2d8-45e0-a40b-1e6b5bd16bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:52:58.500959 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-a8b6938a-b2d8-45e0-a40b-1e6b5bd16bf6 None None] MFA Rules not processed for user `9ea084f29c9445658b2efc3f5e742b51`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:52:58.502485 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-a8b6938a-b2d8-45e0-a40b-1e6b5bd16bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:52:58.602796 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 674/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 9 15:52:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:53:03.297621 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04b1ce-de7e-4667-845d-e510f06dc3f4 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:53:03.298168 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04b1ce-de7e-4667-845d-e510f06dc3f4 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:53:03.298168 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04b1ce-de7e-4667-845d-e510f06dc3f4 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:53:03.299709 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 678/1352] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 9 15:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:53:03.304765 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e1f11-61b7-4294-b5cc-f14e197e55be None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:53:03.305262 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e1f11-61b7-4294-b5cc-f14e197e55be None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:53:03.305356 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e1f11-61b7-4294-b5cc-f14e197e55be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:53:03.324546 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-3b9e1f11-61b7-4294-b5cc-f14e197e55be None None] MFA Rules not processed for user `9ea084f29c9445658b2efc3f5e742b51`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:53:03.325779 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-3b9e1f11-61b7-4294-b5cc-f14e197e55be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:53:03.335296 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 675/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 9 15:53:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:53:04.986225 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36861b-96ec-4806-b66d-f0dcd17b0a4c None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:53:04.986806 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36861b-96ec-4806-b66d-f0dcd17b0a4c None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:53:04.986806 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36861b-96ec-4806-b66d-f0dcd17b0a4c None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:53:04.988156 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 679/1354] 10.222.0.48 () {54 vars in 921 bytes} [Mon May 9 15:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:53:04.993827 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca12d8-c2df-459c-aed8-b2cdb5186170 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:53:04.994257 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca12d8-c2df-459c-aed8-b2cdb5186170 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:53:04.994513 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca12d8-c2df-459c-aed8-b2cdb5186170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:53:05.013827 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-99ca12d8-c2df-459c-aed8-b2cdb5186170 None None] MFA Rules not processed for user `9ea084f29c9445658b2efc3f5e742b51`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:53:05.015031 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-99ca12d8-c2df-459c-aed8-b2cdb5186170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:53:05.024712 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 676/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Mon May 9 15:53:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:53:09.066965 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee3067-c33b-4631-8998-fa43d57e14a5 None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:53:09.067871 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee3067-c33b-4631-8998-fa43d57e14a5 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:53:09.068229 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee3067-c33b-4631-8998-fa43d57e14a5 None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:53:09.070421 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 680/1356] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:53:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:53:09.075833 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336ed46-2dac-485c-8c06-fb4df07f313f None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:53:09.076299 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336ed46-2dac-485c-8c06-fb4df07f313f None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:53:09.076403 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336ed46-2dac-485c-8c06-fb4df07f313f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:53:09.100019 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-2336ed46-2dac-485c-8c06-fb4df07f313f None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:53:09.101524 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-2336ed46-2dac-485c-8c06-fb4df07f313f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:53:09.110171 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 677/1357] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:53:09.159299 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d87368-8dbc-4eb9-ae58-50787d2379ef None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:53:09.159591 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d87368-8dbc-4eb9-ae58-50787d2379ef None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:53:09.159869 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d87368-8dbc-4eb9-ae58-50787d2379ef None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:53:09.162655 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 681/1358] 10.222.0.48 () {54 vars in 961 bytes} [Mon May 9 15:53:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 09 15:53:09.167862 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb66e52-5c02-47e2-bcdd-8d7aaf6555d6 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:53:09.168155 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb66e52-5c02-47e2-bcdd-8d7aaf6555d6 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:53:09.168432 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb66e52-5c02-47e2-bcdd-8d7aaf6555d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:53:09.222504 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-3bb66e52-5c02-47e2-bcdd-8d7aaf6555d6 None None] MFA Rules not processed for user `adf919c3ba31488694c724a803ca51eb`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:53:09.224480 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-3bb66e52-5c02-47e2-bcdd-8d7aaf6555d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:53:09.315864 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 678/1359] 10.222.0.48 () {58 vars in 1058 bytes} [Mon May 9 15:53:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:53:09.317727 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d87368-8dbc-4eb9-ae58-50787d2379ef None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:53:09.335437 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d87368-8dbc-4eb9-ae58-50787d2379ef None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:53:09.341797 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9d1ab-5c6d-42dc-90c3-3d029cb2fc85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf919c3ba31488694c724a803ca51eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7860d281acf642d2a3950424901b9487', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:53:09.342614 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9d1ab-5c6d-42dc-90c3-3d029cb2fc85 service nova] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:53:09.343058 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9d1ab-5c6d-42dc-90c3-3d029cb2fc85 service nova] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:53:09.343603 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9d1ab-5c6d-42dc-90c3-3d029cb2fc85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:53:09.353767 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9d1ab-5c6d-42dc-90c3-3d029cb2fc85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:53:09.355552 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9d1ab-5c6d-42dc-90c3-3d029cb2fc85 service nova] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:53:09.367733 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 682/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:53:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 15:53:11.857246 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9318cf2-3ec9-411f-9a02-7b5143e61030 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:53:11.857736 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9318cf2-3ec9-411f-9a02-7b5143e61030 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:53:11.857882 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9318cf2-3ec9-411f-9a02-7b5143e61030 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:53:11.859283 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 679/1361] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:53:11.865473 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc1e56-1044-4c08-b2e5-ab77190c1500 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:53:11.865968 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc1e56-1044-4c08-b2e5-ab77190c1500 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:53:11.866075 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc1e56-1044-4c08-b2e5-ab77190c1500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:53:11.885557 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-05bc1e56-1044-4c08-b2e5-ab77190c1500 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:53:11.886779 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-05bc1e56-1044-4c08-b2e5-ab77190c1500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:53:11.896378 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 683/1362] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:53:11.940506 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9318cf2-3ec9-411f-9a02-7b5143e61030 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:53:11.955877 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9318cf2-3ec9-411f-9a02-7b5143e61030 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:53:11.962698 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5d7c5-3162-4586-b4c0-660194acb2b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf919c3ba31488694c724a803ca51eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7860d281acf642d2a3950424901b9487', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:53:11.963379 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5d7c5-3162-4586-b4c0-660194acb2b4 service nova] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:53:11.963665 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5d7c5-3162-4586-b4c0-660194acb2b4 service nova] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:53:11.963935 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5d7c5-3162-4586-b4c0-660194acb2b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:53:11.973705 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5d7c5-3162-4586-b4c0-660194acb2b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:53:11.975398 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5d7c5-3162-4586-b4c0-660194acb2b4 service nova] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:53:11.985635 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 680/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:53:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:53:14.612225 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c7070-b9cc-47dc-a0ea-c40afcab80de None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:53:14.612792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c7070-b9cc-47dc-a0ea-c40afcab80de None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:53:14.612792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c7070-b9cc-47dc-a0ea-c40afcab80de None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:53:14.614398 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 684/1364] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:53:14.619932 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3e6ec-160d-4f58-b915-3091dd1fee92 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:53:14.620845 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3e6ec-160d-4f58-b915-3091dd1fee92 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:53:14.621392 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3e6ec-160d-4f58-b915-3091dd1fee92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:53:14.644931 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-fda3e6ec-160d-4f58-b915-3091dd1fee92 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:53:14.646690 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-fda3e6ec-160d-4f58-b915-3091dd1fee92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:53:14.656299 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 681/1365] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:53:14.702645 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b009a-8935-4eef-b6f1-56b879a42a6a None None] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:53:14.702937 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b009a-8935-4eef-b6f1-56b879a42a6a None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:53:14.703425 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b009a-8935-4eef-b6f1-56b879a42a6a None None] PATH_INFO: `/` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:53:14.705403 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 685/1366] 10.222.0.48 () {54 vars in 961 bytes} [Mon May 9 15:53:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:53:14.711959 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0973f00-72c0-44b9-ab88-79096f0b1cf1 None None] REQUEST_METHOD: `POST` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:53:14.712439 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0973f00-72c0-44b9-ab88-79096f0b1cf1 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:53:14.712807 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0973f00-72c0-44b9-ab88-79096f0b1cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:53:14.736476 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.auth.core [None req-a0973f00-72c0-44b9-ab88-79096f0b1cf1 None None] MFA Rules not processed for user `adf919c3ba31488694c724a803ca51eb`. Rule list: `[]` (Enabled: `True`). {{(pid=276030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:53:14.737754 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.fernet_utils [None req-a0973f00-72c0-44b9-ab88-79096f0b1cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:53:14.748643 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 682/1367] 10.222.0.48 () {58 vars in 1058 bytes} [Mon May 9 15:53:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:53:14.757210 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b009a-8935-4eef-b6f1-56b879a42a6a None None] Authenticating user token {{(pid=276029) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:53:14.775378 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b009a-8935-4eef-b6f1-56b879a42a6a None None] Validating token access rules against request {{(pid=276029) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:53:14.781318 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bace9-3940-437b-bed1-8ec70397ae8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf919c3ba31488694c724a803ca51eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7860d281acf642d2a3950424901b9487', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276029) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:53:14.782196 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bace9-3940-437b-bed1-8ec70397ae8b service nova] REQUEST_METHOD: `GET` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:53:14.782792 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bace9-3940-437b-bed1-8ec70397ae8b service nova] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:53:14.783274 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bace9-3940-437b-bed1-8ec70397ae8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:53:14.793097 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133bace9-3940-437b-bed1-8ec70397ae8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:53:14.794945 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133bace9-3940-437b-bed1-8ec70397ae8b service nova] RBAC: Authorization granted {{(pid=276029) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:53:14.805704 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 686/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:53:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 09 15:53:15.788554 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6b4dc-3e20-4e79-a966-9f07c78e53ce None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:53:15.789145 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6b4dc-3e20-4e79-a966-9f07c78e53ce None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:53:15.789145 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6b4dc-3e20-4e79-a966-9f07c78e53ce None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:53:15.790536 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 683/1369] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:53:15.796914 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcdb07-aa0d-4a84-81a5-d3bd627d3297 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:53:15.797573 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcdb07-aa0d-4a84-81a5-d3bd627d3297 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:53:15.797573 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcdb07-aa0d-4a84-81a5-d3bd627d3297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:53:15.819016 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-18dcdb07-aa0d-4a84-81a5-d3bd627d3297 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:53:15.820266 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-18dcdb07-aa0d-4a84-81a5-d3bd627d3297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:53:15.828374 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 687/1370] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:53:17.197361 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130712a-5a9c-4974-8134-7e0fbba467d3 None None] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:53:17.197967 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130712a-5a9c-4974-8134-7e0fbba467d3 None None] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:53:17.197967 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130712a-5a9c-4974-8134-7e0fbba467d3 None None] PATH_INFO: `/` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:53:17.199372 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 684/1371] 10.222.0.48 () {54 vars in 926 bytes} [Mon May 9 15:53:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 09 15:53:17.205859 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47a646-3fb6-4aa0-8280-c7920f376e58 None None] REQUEST_METHOD: `POST` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:53:17.206359 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47a646-3fb6-4aa0-8280-c7920f376e58 None None] SCRIPT_NAME: `/identity` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:53:17.207394 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47a646-3fb6-4aa0-8280-c7920f376e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=276029) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:53:17.232584 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.auth.core [None req-be47a646-3fb6-4aa0-8280-c7920f376e58 None None] MFA Rules not processed for user `d6c9373bbbf843ee901a91cc4e068dee`. Rule list: `[]` (Enabled: `True`). {{(pid=276029) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 09 15:53:17.235524 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: DEBUG keystone.common.fernet_utils [None req-be47a646-3fb6-4aa0-8280-c7920f376e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=276029) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 09 15:53:17.246401 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: [pid: 276029|app: 0|req: 688/1372] 10.222.0.48 () {58 vars in 1023 bytes} [Mon May 9 15:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 09 15:53:17.296062 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130712a-5a9c-4974-8134-7e0fbba467d3 None None] Authenticating user token {{(pid=276030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 09 15:53:17.310866 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130712a-5a9c-4974-8134-7e0fbba467d3 None None] Validating token access rules against request {{(pid=276030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 09 15:53:17.316958 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0367d-8da0-4efe-bfa5-15164e03b734 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adf919c3ba31488694c724a803ca51eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7860d281acf642d2a3950424901b9487', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=276030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 09 15:53:17.317647 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0367d-8da0-4efe-bfa5-15164e03b734 service nova] REQUEST_METHOD: `GET` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 09 15:53:17.317929 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0367d-8da0-4efe-bfa5-15164e03b734 service nova] SCRIPT_NAME: `/identity` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 09 15:53:17.318200 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0367d-8da0-4efe-bfa5-15164e03b734 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=276030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 09 15:53:17.327155 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0367d-8da0-4efe-bfa5-15164e03b734 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 09 15:53:17.328768 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0367d-8da0-4efe-bfa5-15164e03b734 service nova] RBAC: Authorization granted {{(pid=276030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 09 15:53:17.339680 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: [pid: 276030|app: 0|req: 685/1373] 10.222.0.48 () {60 vars in 1365 bytes} [Mon May 9 15:53:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 09 15:53:45.177504 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: Mon May 9 15:53:45 2022 - graceful shutdown triggered... May 09 15:53:45.178126 dv-cinder-835881-7-iscsi devstack@keystone.service[276030]: Gracefully killing worker 2 (pid: 276030)... May 09 15:53:45.178608 dv-cinder-835881-7-iscsi devstack@keystone.service[276029]: Gracefully killing worker 1 (pid: 276029)... May 09 15:53:45.180203 dv-cinder-835881-7-iscsi systemd[1]: Stopping Devstack devstack@keystone.service... May 09 15:53:46.178632 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: worker 1 buried after 1 seconds May 09 15:53:46.178632 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: worker 2 buried after 1 seconds May 09 15:53:46.178632 dv-cinder-835881-7-iscsi devstack@keystone.service[276028]: goodbye to uWSGI. May 09 15:53:46.180280 dv-cinder-835881-7-iscsi systemd[1]: devstack@keystone.service: Succeeded. May 09 15:53:46.180823 dv-cinder-835881-7-iscsi systemd[1]: Stopped Devstack devstack@keystone.service.